liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Towards automated assessment of team performance by mimicking expert observers ratings
Linköpings universitet, Institutionen för datavetenskap. Linköpings universitet, Tekniska fakulteten. Swedish Def Res Agcy, Sweden.
2019 (Engelska)Ingår i: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 21, nr 2, s. 253-274Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Automation is the holy grail of performance assessment. Cheap and reliable automated systems that produce consistent feedback on performance. Many such systems have been proposed that accurately measure the state of a product or the outcome of a process. Procedural faults can be detected and even mitigated without the need for human interference. In production industry and professional sports, this is a natural part of business. However, in macrocognitive team performance studies, human appraisal is still king. This study investigates the reliability of human observers as assessors of performance among virtual teams, and what they base their assessments on when only able to monitor one of the team members at a time. The results show that expert observers put a lot of emphasis on task outcomes and on communication and are generally reliable raters of team performance, but there are several aspects that they cannot rate reliably under these circumstances, e.g., team workload, stress, and collaborative problem-solving. Through simple algorithms, this study shows that by capturing task scores and different quantitative communication metrics, team performance ratings can be estimated to closely match how the expert observers assess team performance in a virtual team setting. The implication of the study is that numeric team performance estimations can be acquired by automated systems, with reasonable accuracy and reliability compared to observer ratings.

Ort, förlag, år, upplaga, sidor
SPRINGER LONDON LTD , 2019. Vol. 21, nr 2, s. 253-274
Nyckelord [en]
Team performance; Performance assessment; Automation
Nationell ämneskategori
Produktionsteknik, arbetsvetenskap och ergonomi
Identifikatorer
URN: urn:nbn:se:liu:diva-157538DOI: 10.1007/s10111-018-0499-6ISI: 000467039000006OAI: oai:DiVA.org:liu-157538DiVA, id: diva2:1328675
Anmärkning

Funding Agencies|Department of the Navy Grant by Office of Naval Research Global [N62909-11-1-7019]

Tillgänglig från: 2019-06-22 Skapad: 2019-06-22 Senast uppdaterad: 2019-06-22

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltext

Sök vidare i DiVA

Av författaren/redaktören
Granasen, Dennis
Av organisationen
Institutionen för datavetenskapTekniska fakulteten
I samma tidskrift
Cognition, Technology & Work
Produktionsteknik, arbetsvetenskap och ergonomi

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 2 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf