liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Qualitative analysis of manual annotations of clinical text with SNOMED CT
Med Univ Graz, Austria.
Med Univ Graz, Austria.
Linköping University, Department of Biomedical Engineering, Division of Biomedical Engineering. Linköping University, Faculty of Science & Engineering.
Med Univ Graz, Austria.
Show others and affiliations
2018 (English)In: PLoS ONE, ISSN 1932-6203, E-ISSN 1932-6203, Vol. 13, no 12, article id e0209547Article in journal (Refereed) Published
Abstract [en]

SNOMED CT provides about 300,000 codes with fine-grained concept definitions to support interoperability of health data. Coding clinical texts with medical terminologies it is not a trivial task and is prone to disagreements between coders. We conducted a qualitative analysis to identify sources of disagreements on an annotation experiment which used a subset of SNOMED CT with some restrictions. A corpus of 20 English clinical text fragments from diverse origins and languages was annotated independently by two domain medically trained annotators following a specific annotation guideline. By following this guideline, the annotators had to assign sets of SNOMED CT codes to noun phrases, together with concept and term coverage ratings. Then, the annotations were manually examined against a reference standard to determine sources of disagreements. Five categories were identified. In our results, the most frequent cause of inter-annotator disagreement was related to human issues. In several cases disagreements revealed gaps in the annotation guidelines and lack of training of annotators. The reminder issues can be influenced by some SNOMED CT features.

Place, publisher, year, edition, pages
PUBLIC LIBRARY SCIENCE , 2018. Vol. 13, no 12, article id e0209547
National Category
General Language Studies and Linguistics
Identifiers
URN: urn:nbn:se:liu:diva-153825DOI: 10.1371/journal.pone.0209547ISI: 000454418200026PubMedID: 30589855OAI: oai:DiVA.org:liu-153825DiVA, id: diva2:1278047
Note

Funding Agencies|European Union [643818]; [U54LM008748]

Available from: 2019-01-11 Created: 2019-01-11 Last updated: 2019-03-15

Open Access in DiVA

fulltext(664 kB)58 downloads
File information
File name FULLTEXT01.pdfFile size 664 kBChecksum SHA-512
c574d5d4131fcca7a7039f7abe0dcb59071be022d322bb893eca606ae3eab80d3c47e9f20002cd5a11e0d14648a8f87ca0e16a8a7716d89e07023bdc5ce37b26
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMed

Search in DiVA

By author/editor
Karlsson, Daniel
By organisation
Division of Biomedical EngineeringFaculty of Science & Engineering
In the same journal
PLoS ONE
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar
Total: 58 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 49 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf