[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

st: RE: Calculating weighted kappa for multiple raters

From   "Martin Weiss" <>
To   <>
Subject   st: RE: Calculating weighted kappa for multiple raters
Date   Thu, 3 Dec 2009 18:59:02 +0100


"  (i have attached my full code in a do-file)"

You have, and it is unlikely to go down well with the community...
See the FAQ!


-----Original Message-----
[] On Behalf Of Karen Wright
Sent: Donnerstag, 3. Dezember 2009 17:46
Subject: st: Calculating weighted kappa for multiple raters

Dear list,

I have a problem that is perhaps more to do withprogramming than anything
else.  i am not experieced in programming stata and so have given up writing
an ado-file program for whta I am trying to do, but unfortunately I am stil
encountering problems!

  I am trying to calculate weighted kappa for multiple raters, i have
attached a small word document with the equation.  My problem occurs when I
am trying to calculate marginal totals.  I am trying to create a total of
the frequency for each rater, within each category and multiply these
together, as shown in the equation.

The current method i am employing to do this is :

forval a=1/`r' {
	summ _freq if reader1==`a' 
	loc A_`a' = r(sum)
	summ _freq if reader2==`a' 
	loc B_`a' = r(sum)
	summ _freq if reader3==`a' 
	loc C_`a' = r(sum)
forval a=1/4 {
	forval b=1/4 {
		forval c=1/4 {
gen d_`a'`b'`c' = weight*`A_`a''*`B_`b''*`C_`c'' if reader1==`a' &
reader2==`b' & reader3==`c'
egen den = rowtotal(d_111-d_`r'`r'`r')
drop d_*
loc denom = r(sum)
di `denom'

  (i have attached my full code in a do-file)

But this becomes very lengthy and produces too many variables to do for any
sufficient amount of raters.  Eventually i hope to analyse gradings from
>100 raters, and yet with my current methods stata cannot compute it for
only 8!  too many variables created.

Is there another way anyone with much better stata programming experience
than me can see to proceed?

Thank you, any help is much appreciated!

The Institute of Cancer Research: Royal Cancer Hospital, a charitable
Company Limited by Guarantee, Registered in England under Company No. 534147
with its Registered Office at 123 Old Brompton Road, London SW7 3RP.

This e-mail message is confidential and for use by the addressee only.  If
the message is received by anyone other than the addressee, please return
the message to the sender by replying to it and then delete the message from
your computer and network.

*   For searches and help try:

© Copyright 1996–2017 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index