liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
2016 (Engelska)Ingår i: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 18, nr 1, s. 121-143Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

In 2010, IT-security experts from northern European governments and organizations gathered to conduct the first of a series of NATO-led cyber-defense exercises in a pilot attempt of training cyber defense. To gain knowledge on how to assess team effectiveness in cyber-defense exercises, this case study investigates the role of behavioral assessment techniques as a complement to task-based performance measurement. The collected data resulted in a massive data set including system logs, observer reports, and surveys. Six different methods were compared for feasibility in assessing the teams’ performance, including automated availability check, exploratory sequential data analysis, and network intrusion detection system attack analysis. In addition, observer reports and surveys were used to collect aspects relating to team structures and processes, aiming to discover whether these aspects can explain differences in effectiveness. The crossdisciplinary approach and multiple metrics create possibilities to study not only the performance-related outcome of the exercise, but also why this result is obtained. The main conclusions found are (1) a combination of technical performance measurements and behavioral assessment techniques are needed to assess team effectiveness, and (2) cyber situation awareness is required not only for the defending teams, but also for the observers and the game control.

Ort, förlag, år, upplaga, sidor
Springer London, 2016. Vol. 18, nr 1, s. 121-143
Nyckelord [en]
Cyber-defense exercise, Cyber SA, Performance assessment, Team cognition, Team effectiveness
Nationell ämneskategori
Teknik och teknologier Produktionsteknik, arbetsvetenskap och ergonomi
Identifikatorer
URN: urn:nbn:se:liu:diva-156502DOI: 10.1007/s10111-015-0350-2ISI: 000368178300009Scopus ID: 2-s2.0-84954360683OAI: oai:DiVA.org:liu-156502DiVA, id: diva2:1306756
Tillgänglig från: 2019-04-24 Skapad: 2019-04-24 Senast uppdaterad: 2019-12-02Bibliografiskt granskad
Ingår i avhandling
1. Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
Öppna denna publikation i ny flik eller fönster >>Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
2019 (Engelska)Licentiatavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Modern societies are affected by various threats and hazards, including natural disasters, cyber-attacks, extreme weather events and inter-state conflicts. Managing these challenging situations requires immediate actions, suspension of ordinary procedures, decision making under uncertainty and coordinated action. In other words, challenging situations put high demands on the command and control (C2) capability. To strengthen the capability of C2, it is vital to identify the prerequisites for effective coordination and direction within the domain of interest. This thesis explores C2 capability and effectiveness in three domains: interorganizational crisis management, military command and control, and cyber defence operations. The thesis aims to answer three research questions: (1) What constitutes C2 capability? (2) What constitutes C2 effectiveness? and (3) How can C2 effectiveness be assessed? The work was carried out as two case studies and one systematic literature review. The main contributions of the thesis are the identification of perspectives of C2 capability in challenging situations and an overview of approaches to C2 effectiveness assessment. Based on the results of the three studies, six recurring perspectives of capability in the domains studied were identified: interaction (collaboration), direction and coordination, relationships, situation awareness, resilience and preparedness. In the domains there are differences concerning which perspectives that are most emphasized in order obtain C2 capability. C2 effectiveness is defined as the extent to which a C2 system is successful in achieving its intended result. The thesis discusses the interconnectedness of performance and effectiveness measures, and concludes that there is not a united view on the difference between measures of effectiveness and measures of performance. Different approaches to effectiveness assessment were identified, where assessment may be conducted based on one specific issue, in relation to a defined goal for a C2 function or using a more exploratory approach.

Ort, förlag, år, upplaga, sidor
Linköping: Linköping University Electronic Press, 2019. s. 43
Serie
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1836
Nationell ämneskategori
Datavetenskap (datalogi) Data- och informationsvetenskap Systemvetenskap, informationssystem och informatik med samhällsvetenskaplig inriktning Programvaruteknik Tvärvetenskapliga studier inom samhällsvetenskap
Identifikatorer
urn:nbn:se:liu:diva-156151 (URN)10.3384/lic.diva-156151 (DOI)9789176850824 (ISBN)
Presentation
2019-06-14, Alan Turing, hus E, Campus Valla, Linköping, 10:15 (Engelska)
Opponent
Handledare
Anmärkning

In the printed version is the permanent link to this publication incorrect. The link is changecd in the online version.

Tillgänglig från: 2019-05-27 Skapad: 2019-05-02 Senast uppdaterad: 2019-05-27Bibliografiskt granskad

Open Access i DiVA

Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study(1285 kB)102 nedladdningar
Filinformation
Filnamn FULLTEXT02.pdfFilstorlek 1285 kBChecksumma SHA-512
6c42cc275d23e69c0ac064cb6d64d746bf44ed76a567e4d38742132300fbdc24b98c676319f300382eb3ca259046fc26e45b0613f1c0dd894012190fd7369196
Typ fulltextMimetyp application/pdf

Övriga länkar

Förlagets fulltextScopus

Personposter BETA

Andersson, Dennis

Sök vidare i DiVA

Av författaren/redaktören
Granåsen, MagdalenaAndersson, Dennis
I samma tidskrift
Cognition, Technology & Work
Teknik och teknologierProduktionsteknik, arbetsvetenskap och ergonomi

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 102 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 498 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf