liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Approaches to team performance assessment: a comparison of self-assessment reports and behavioral observer scales
Linköping University, Department of Computer and Information Science, Human-Centered systems. Linköping University, The Institute of Technology. Swedish Def Research Agency, Linkoping, Sweden.
Linköping University, Department of Computer and Information Science, Human-Centered systems. Linköping University, Faculty of Arts and Sciences.
Naval Postgrad Sch, USA.
2017 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 19, no 2-3, p. 517-528Article in journal (Refereed) Published
Abstract [en]

Human factors research popularly employs perception-based techniques to investigate team performance and its dependency to cognitive processes. Such studies frequently rely upon either observer-based or self-assessment techniques to collect data. In this study, we examined behavioral observer ratings and self-assessment ratings for measuring team performance in virtual teams, with team performance regarded as a combination of task outcome and team cognition. Juxtaposing self-assessments and observer ratings from a quasi-experiment comparing team performance rating techniques reveals that they indeed produce overall similar results, with both singling out teamwork effectiveness ratings as the strongest contributor to overall team performance. However, the comparisons show remarkably low correlation on individual questionnaire items. The most striking difference is that the team members self-assessments of workload are lower than the corresponding observer ratings. In particular, the self-assessments do not correlate at all with overall team performance, whereas the observers workload ratings are more consistent with contemporary research that suggests a strong correlation between workload and team performance, suggesting that observer-based techniques are more reliable than self-assessments for assessing workload. For other ratings, the results show that the two techniques are fairly equal, suggesting that the choice between methods to employ can be deferred to other considerations such as obtrusiveness, accessibility, and resource availability.

Place, publisher, year, edition, pages
SPRINGER LONDON LTD , 2017. Vol. 19, no 2-3, p. 517-528
Keywords [en]
Behavioral observation scales; Performance assessment; Self-assessment reports; Team performance
National Category
Production Engineering, Human Work Science and Ergonomics
Identifiers
URN: urn:nbn:se:liu:diva-140947DOI: 10.1007/s10111-017-0428-0ISI: 000409121400020OAI: oai:DiVA.org:liu-140947DiVA, id: diva2:1142427
Note

Funding Agencies|US Office of Naval Research Global, Arlington, VA [N62909-11-1-7019]; Swedish Civil Contingencies Agency, Stockholm, Sweden [2012-3380]

Available from: 2017-09-19 Created: 2017-09-19 Last updated: 2017-10-06

Open Access in DiVA

fulltext(652 kB)326 downloads
File information
File name FULLTEXT01.pdfFile size 652 kBChecksum SHA-512
6496b0af98c92119a05445941dd2b1a1c448540675656502a21b59309f2124e8091ad56cdf443dcd79223b54be1510063f17086aacbd4d085794106d29c314da
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Andersson, DennisRankin, Amy
By organisation
Human-Centered systemsThe Institute of TechnologyFaculty of Arts and Sciences
In the same journal
Cognition, Technology & Work
Production Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar
Total: 326 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 204 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf