Semantic Krippendorff’s α for measuring inter-rater agreement in SNOMED CT coding studies
2014 (English)In: e-Health – For Continuity of Care / [ed] Christian Lovis, et al., Amsterdam, 2014, 151-155 p.Conference paper (Refereed)
Semantic interoperability requires consistency in use of terminologies such as SNOMED CT. Inter-rater agreement measurement can be used to quantify this consistency among terminology users. Increasingly, studies of SNOMED CT include inter-rater agreement measures. However, published studies do not consider distance between concepts when calculating the inter-rater agreement measures. In this paper we propose a semantic inter-rater agreement measure for use with SNOMED CT encoded data. A semantic Krippendorff's α measure is implemented using a path-length based difference function. The measure is tested using three different datasets. Results show that the proposed semantic measure is sensitive to seriousness of coding differences whereas a nominal measure is not. The proposed measure reflects the intuition that distance matters when comparing uses of SNOMED CT.
Place, publisher, year, edition, pages
Amsterdam, 2014. 151-155 p.
, Studies in Health Technology and Informatics, ISSN 0926-9630 (print) 1879-8365 (online) ; 205
IdentifiersURN: urn:nbn:se:liu:diva-119393DOI: 10.3233/978-1-61499-432-9-151PubMedID: 25160164ISBN: 978-1-61499-431-2ISBN: 978-1-61499-432-9OAI: oai:DiVA.org:liu-119393DiVA: diva2:821978