I have a dataset where 149 raters have classified 14 video scenarios into a
binary (1,0) classification system on two occasions, once before and once
after an education intervention. I'm interested in seeing whether the
education intervention improved the agreement of the raters in classifying the
video scenarios. I can use the "kappa" command on a table summarising this
dataset to calculate the kappa statistic across the 14 scenarios on each
occasion. I would now like to calculate bootstrapped confidence intervals for
these and also compare kappa statistics between the two assessment occasions.
However, I would like the bootstrap procedure to resample raters rather than
the 14 video scenarios. Can anyone tell me how I can calculate kappa in the
case of more than two raters using a dataset where each rater and their
classifications of the video scenarios are presented as an individual row in
the dataset so that these can be resampled when I perform the bootstrap
procedure?
Bernadette Massey
*
* For searches and help try:
* http://www.stata.com/support/faqs/res/findit.html
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
