Re: st: reliability with -icc- and -estat icc-

[Nick Cox <njcoxstata@gmail.com>]

No one seems interested in this suggestion. But it is well to know
what patterns do or do not exist before you start quantifying them.
This is just to underline that repeating the graphs with ranks
underlines how much information is thereby discarded and that while
such graphs may not work well with many more raters and/or scores,
they do work well here.

On Tue, Feb 26, 2013 at 7:35 PM, Nick Cox <njcoxstata@gmail.com> wrote:
> A scatter plot matrix is instructive.
>
> Warning: destroys your data.
>
> reshape wide Score rank , i(Application) j(Rator)
> graph matrix Score?
>
> #4 really is oddball.
>
> Another interesting plot is
>
> parplot Score?, tr(raw)
>
> where -parplot- must be installed from SSC first.
>
> Nick
>
> On Tue, Feb 26, 2013 at 7:24 PM, Lenny Lesser <lenny3200@gmail.com> wrote:
>> Hi Rebecca,
>> Thank you for your help.  As a clarification:
>> We used scores originally, but Rater 4's scores were all very low.
>> Thus, when we ranked them, there were a lot of ties.  As seen below, 8
>> of the 11 apps got a rank of "2" by rater.
>> Lenny
>>
>> Application Rator Score rank
>> 5 1 2 1
>> 7 1 5 2
>> 2 1 6 3
>> 9 1 6 3
>> 11 1 7 4
>> 6 1 7 4
>> 8 1 11 5
>> 3 1 13 6
>> 4 1 16 7
>> 10 1 17 8
>> 1 1 18 9
>> 6 2 1 1
>> 5 2 2 2
>> 11 2 3 3
>> 7 2 3 3
>> 4 2 5 4
>> 1 2 7 5
>> 8 2 8 6
>> 2 2 9 7
>> 3 2 10 8
>> 10 2 12 9
>> 9 2 12 9
>> 5 3 2 1
>> 2 3 5 2
>> 7 3 6 3
>> 6 3 6 3
>> 9 3 6 3
>> 11 3 7 4
>> 8 3 11 5
>> 3 3 13 6
>> 4 3 15 7
>> 10 3 16 8
>> 1 3 17 9
>> 7 4 0 1
>> 1 4 1 2
>> 9 4 1 2
>> 6 4 1 2
>> 8 4 1 2
>> 4 4 1 2
>> 5 4 1 2
>> 3 4 1 2
>> 11 4 1 2
>> 2 4 2 3
>> 10 4 3 4
>>
*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/faqs/resources/statalist-faq/
*   http://www.ats.ucla.edu/stat/stata/