Hi! I am trying to do an efficient inter-related reliability check. I have two coders who each examined the same documents and what I'm trying to do is compare their coding. I have 1000's of documents (and variables) to check so would love to find a way to efficiently compare rows. A mock-up is attached.
As seen on the Raw tab - I have 2 coders who each examined 3 documents. For the 5 variables, they are each supposed to put a code. My goal is to see where they coded something the same, and where they coded something differently so that I can go back and check the documents myself, and agree on a final code.
As seen on the Final tab - what I want is a single line for each document, and using a formula find the two documents of the same name in the Raw tab (I assume using a helper column), and if the two answers for each variable (can also just be a drag across the columns) match return a TRUE or ideally the 'matched' value; or it will return a FALSE. For the FALSE, those would be the only ones I would then need to check.
Again, given the number of variables and documents to review it would be great to find an efficient way to check codes. Thanks in advance!
Bookmarks