st: RE: Kappa query - unequal distribution of scores

["Downs, Sara" <Sara.Downs@ahvla.gsi.gov.uk>]

Hi,
 
I am trying to calculate agreement between 2 distributions of scores.
There are 3 possible scores: One score predominates and the other 2 are
extremely rare :
 
  tab rev1 rev2
 
           |               rev2
      rev1 |         0          1          2 |     Total
-----------+---------------------------------+----------
         0 |         1          6          0 |         7 
         1 |        13         57          3 |        73 
         2 |         0          2          1 |         3 
-----------+---------------------------------+----------
     Total |        14         65          4 |        83 
 

.         kap rev1 rev2
 
             Expected
Agreement   Agreement     Kappa   Std. Err.         Z      Prob>Z
-----------------------------------------------------------------
  71.08%      70.47%     0.0206     0.0852       0.24      0.4042

 
I understand that the usual kappa statistic is not reliable in this
situation .   Is there any way in STATA that I can adjust for the high
expected frequency. I am using STATA 10.1.
 
Thanks for any advice
 
Sara
 
 
 
Dr Sara Downs
CERA (Centre for Epidemiology & Risk Analysis)
Veterinary Laboratories Agency - Weybridge
New Haw
Addlestone
Surrey
KT15 3NB
United Kingdom
 
Phone: +44 (0) 1932 357893
Fax: +44 (0) 1932 357406
x2893
 
Animal Health and Veterinary Laboratories Agency (AHVLA)
 
This email and any attachments is intended for the named recipient only.
If you have received it in error you have no authority to use, disclose, 
store or copy any of its contents and you should destroy it and inform the sender.
Whilst this email and associated attachments will have been checked for known viruses whilst within AHVLA systems we can accept no responsibility once it has left our systems.
Communications on AHVLA computer systems may be monitored and/or recorded to secure the effective operation of the system and for other lawful purposes.


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/