[S] Chance Corrected Measures of Agreement

Nancy Friday (nfriday@whsun1.wh.whoi.edu)
Thu, 16 Apr 1998 18:52:53 -0400 (EDT)

I'm looking for S-Plus code for chance-corrected measures of
agreement. I have 5 to 8 observers (so the standard 2 observer
kappa statistics don't work). Subjects are evaluated for
variables with ordinal categories and for variables with nominal
categories. Most of my data are balanced (ie, the same number of
observations for each subject), however some cases are unbalanced.
A procedure for unbalanced data would be a plus but not necessary.
For each variable, I want to measure the agreement between
observers and identify the observers, if any, which are
significantly different from the rest.

The procedure which I am considering is presented in O'Connell
and Dobson. 1984. General Observer-Agreement Measures on Individual
Subjects and Groups of Subjects. Biometrics. 40:973-983.

I'm also looking into Landis and Koch. 1977. An Application of
Hierarchical Kappa-type Statistics in the Assessment of Majority
Agreement Among Multiple Observers. Biometrics. 33:363-374.

In addition to looking for S-Plus code for such methods, I would
appreciate any other suggestions for chance-corrected measures of

Nancy Friday

* Nancy Friday, PhD NRC Research Associate *
* NEFSC/NMFS Tel: (508) 495-2397 *
* 166 Water St. Fax: (508) 495-2258 *
* Woods Hole, MA 02543 Email: Nancy.Friday@noaa.gov *
This message was distributed by s-news@wubios.wustl.edu. To unsubscribe
send e-mail to s-news-request@wubios.wustl.edu with the BODY of the
message: unsubscribe s-news