liu.seSearch for publications in DiVA
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Towards automated assessment of team performance by mimicking expert observers ratings
Linköpings universitet, Institutionen för datavetenskap. Linköpings universitet, Tekniska fakulteten. Swedish Def Res Agcy, Sweden.
2019 (engelsk)Inngår i: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 21, nr 2, s. 253-274Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Automation is the holy grail of performance assessment. Cheap and reliable automated systems that produce consistent feedback on performance. Many such systems have been proposed that accurately measure the state of a product or the outcome of a process. Procedural faults can be detected and even mitigated without the need for human interference. In production industry and professional sports, this is a natural part of business. However, in macrocognitive team performance studies, human appraisal is still king. This study investigates the reliability of human observers as assessors of performance among virtual teams, and what they base their assessments on when only able to monitor one of the team members at a time. The results show that expert observers put a lot of emphasis on task outcomes and on communication and are generally reliable raters of team performance, but there are several aspects that they cannot rate reliably under these circumstances, e.g., team workload, stress, and collaborative problem-solving. Through simple algorithms, this study shows that by capturing task scores and different quantitative communication metrics, team performance ratings can be estimated to closely match how the expert observers assess team performance in a virtual team setting. The implication of the study is that numeric team performance estimations can be acquired by automated systems, with reasonable accuracy and reliability compared to observer ratings.

sted, utgiver, år, opplag, sider
SPRINGER LONDON LTD , 2019. Vol. 21, nr 2, s. 253-274
Emneord [en]
Team performance; Performance assessment; Automation
HSV kategori
Identifikatorer
URN: urn:nbn:se:liu:diva-157538DOI: 10.1007/s10111-018-0499-6ISI: 000467039000006OAI: oai:DiVA.org:liu-157538DiVA, id: diva2:1328675
Merknad

Funding Agencies|Department of the Navy Grant by Office of Naval Research Global [N62909-11-1-7019]

Tilgjengelig fra: 2019-06-22 Laget: 2019-06-22 Sist oppdatert: 2019-06-22

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekst

Søk i DiVA

Av forfatter/redaktør
Granasen, Dennis
Av organisasjonen
I samme tidsskrift
Cognition, Technology & Work

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 3 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf