Statalist The Stata Listserver


[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

RE: st: RE: Calculating a "disagrement scale" from several individuall assessments


From   "Nick Cox" <n.j.cox@durham.ac.uk>
To   <statalist@hsphsun2.harvard.edu>
Subject   RE: st: RE: Calculating a "disagrement scale" from several individuall assessments
Date   Sun, 11 Feb 2007 23:03:51 -0000

I am not sure whether this is quite the question, 
but it may be worthwhile in any case. 

In a paper on the analysis of agreement -- which despite 
its title is applicable to all kinds of measured data --
I suggesting looking at a matrix of concordance correlations. 
The eigenvalues and eigenvectors of that matrix might also
be of interest. That might be over the top for 3 observers, 
but others watching might have more. 

Naturally, I know the example below might not considered 
measured, but I think this proposal is on all fours with 
Steven's.  

The paper is 

Cox, N.J. 2006. 
Assessing agreement of measurements and predictions in geomorphology. 
Geomorphology 76: 332-346. 

It covers a variety of graphical and numerical summaries.      

Nick 
n.j.cox@durham.ac.uk 

Steven Samuels
 
> Kappa is one standard measure of disagreement among raters. A google  
> search on "multiple raters" and "kappa" will turn up 
> references which  
> show that an intraclass correlation is equivalent to a generalized  
> kappa statistic.  Then a search on "intraclass" and "stata"  will  
> lead you to the appropriate stata command.
> 
> Christer Thrane wrote
> 
> > I have three variables: A, B, and C. They are individual
> > assesssments of the
> > same phenomenon on a scale from 1 (poor) to 5 (very good).
> > The data looks
> > like:
> >
> > id        A    B    C       DS
> > 1        4    4     4        0
> > 2        3    4     4        1
> > 3        5    2     3        ?
> > 4        2    2     4        ?
> > and so on.

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index