The analysis of ordinal agreement data : beyond weighted kappa.
The weighted kappa statistic has been used as an agreement index for ordinal data.
Using data on the comparability of primary and proxy respondent reports of alcohol drinking frequency we show that the value of weighted kappa can be sensitive to the choice of weights.
The distinction between association and agreement is clarified and it is shown that in some respects weighted kappa behaves more like a measure of association than an index of agreement.
In particular, it is demonstrated that the weighted kappa statistic is not always sensitive to differences in the observed proportion in exact agreement and that high values of weighted kappa can be observed even when the level of agreement is low.
Mots-clés Pascal : Epidémiologie, Accord, Homme, Méthodologie, Consommation, Ethanol, Modèle statistique, Analyse statistique
Mots-clés Pascal anglais : Epidemiology, Agreement, Human, Methodology, Consumption, Ethanol, Statistical model, Statistical analysis
Notice produite par :
Inist-CNRS - Institut de l'Information Scientifique et Technique
Cote : 93-0611678
Code Inist : 002B30A01A1. Création : 199406.