liu.seSearch for publications in DiVA
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
2016 (engelsk)Inngår i: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 18, nr 1, s. 121-143Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

In 2010, IT-security experts from northern European governments and organizations gathered to conduct the first of a series of NATO-led cyber-defense exercises in a pilot attempt of training cyber defense. To gain knowledge on how to assess team effectiveness in cyber-defense exercises, this case study investigates the role of behavioral assessment techniques as a complement to task-based performance measurement. The collected data resulted in a massive data set including system logs, observer reports, and surveys. Six different methods were compared for feasibility in assessing the teams’ performance, including automated availability check, exploratory sequential data analysis, and network intrusion detection system attack analysis. In addition, observer reports and surveys were used to collect aspects relating to team structures and processes, aiming to discover whether these aspects can explain differences in effectiveness. The crossdisciplinary approach and multiple metrics create possibilities to study not only the performance-related outcome of the exercise, but also why this result is obtained. The main conclusions found are (1) a combination of technical performance measurements and behavioral assessment techniques are needed to assess team effectiveness, and (2) cyber situation awareness is required not only for the defending teams, but also for the observers and the game control.

sted, utgiver, år, opplag, sider
Springer London, 2016. Vol. 18, nr 1, s. 121-143
Emneord [en]
Cyber-defense exercise, Cyber SA, Performance assessment, Team cognition, Team effectiveness
HSV kategori
Identifikatorer
URN: urn:nbn:se:liu:diva-156502DOI: 10.1007/s10111-015-0350-2ISI: 000368178300009Scopus ID: 2-s2.0-84954360683OAI: oai:DiVA.org:liu-156502DiVA, id: diva2:1306756
Tilgjengelig fra: 2019-04-24 Laget: 2019-04-24 Sist oppdatert: 2019-12-02bibliografisk kontrollert
Inngår i avhandling
1. Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
Åpne denne publikasjonen i ny fane eller vindu >>Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
2019 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Modern societies are affected by various threats and hazards, including natural disasters, cyber-attacks, extreme weather events and inter-state conflicts. Managing these challenging situations requires immediate actions, suspension of ordinary procedures, decision making under uncertainty and coordinated action. In other words, challenging situations put high demands on the command and control (C2) capability. To strengthen the capability of C2, it is vital to identify the prerequisites for effective coordination and direction within the domain of interest. This thesis explores C2 capability and effectiveness in three domains: interorganizational crisis management, military command and control, and cyber defence operations. The thesis aims to answer three research questions: (1) What constitutes C2 capability? (2) What constitutes C2 effectiveness? and (3) How can C2 effectiveness be assessed? The work was carried out as two case studies and one systematic literature review. The main contributions of the thesis are the identification of perspectives of C2 capability in challenging situations and an overview of approaches to C2 effectiveness assessment. Based on the results of the three studies, six recurring perspectives of capability in the domains studied were identified: interaction (collaboration), direction and coordination, relationships, situation awareness, resilience and preparedness. In the domains there are differences concerning which perspectives that are most emphasized in order obtain C2 capability. C2 effectiveness is defined as the extent to which a C2 system is successful in achieving its intended result. The thesis discusses the interconnectedness of performance and effectiveness measures, and concludes that there is not a united view on the difference between measures of effectiveness and measures of performance. Different approaches to effectiveness assessment were identified, where assessment may be conducted based on one specific issue, in relation to a defined goal for a C2 function or using a more exploratory approach.

sted, utgiver, år, opplag, sider
Linköping: Linköping University Electronic Press, 2019. s. 43
Serie
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1836
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-156151 (URN)10.3384/lic.diva-156151 (DOI)9789176850824 (ISBN)
Presentation
2019-06-14, Alan Turing, hus E, Campus Valla, Linköping, 10:15 (engelsk)
Opponent
Veileder
Merknad

In the printed version is the permanent link to this publication incorrect. The link is changecd in the online version.

Tilgjengelig fra: 2019-05-27 Laget: 2019-05-02 Sist oppdatert: 2019-05-27bibliografisk kontrollert

Open Access i DiVA

Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study(1285 kB)95 nedlastinger
Filinformasjon
Fil FULLTEXT02.pdfFilstørrelse 1285 kBChecksum SHA-512
6c42cc275d23e69c0ac064cb6d64d746bf44ed76a567e4d38742132300fbdc24b98c676319f300382eb3ca259046fc26e45b0613f1c0dd894012190fd7369196
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstScopus

Personposter BETA

Andersson, Dennis

Søk i DiVA

Av forfatter/redaktør
Granåsen, MagdalenaAndersson, Dennis
I samme tidsskrift
Cognition, Technology & Work

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 95 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 496 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf