liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Drone Swarms in Forest Firefighting: A Local Development Case Study of Multi-Level Human-Swarm Interaction
Digital Systems, RISE Research Institutes of Sweden, Linköping, Sweden.ORCID iD: 0000-0001-7111-2964
Digital Systems, RISE Research Institutes of Sweden, Linköping, Sweden.
Aeronautics, Saab AB, Linköping, Sweden.
Linköping University, Department of Computer and Information Science, Human-Centered systems. Linköping University, Faculty of Arts and Sciences. (IxS)ORCID iD: 0000-0003-2919-098X
Show others and affiliations
2020 (English)In: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, New York, NY, USA: Association for Computing Machinery (ACM), 2020, article id 93Conference paper, Published paper (Refereed)
Abstract [en]

Swarms of autonomous and coordinating Unmanned Aerial Vehicles (UAVs) are rapidly being developed to enable simultaneous control of multiple UAVs. In the field of Human-Swarm Interaction (HSI), researchers develop and study swarm algorithms and various means of control and evaluate their cognitive and task performance. There is, however, a lack of research describing how UAV swarms will fit into future real-world domain contexts. To remedy this, this paper describes a case study conducted within the community of firefighters, more precisely two Swedish fire departments that regularly deploy UAVs in fire responses. Based on an initial description of how their UAVs are used in a forest firefighting context, participating UAV operators and unit commanders envisioned a scenario that showed how the swarm and its capabilities could be utilized given the constraints and requirements of a forest firefighting mission. Based on this swarm scenario description we developed a swarm interaction model that describes how the operators’ interaction traverses multiple levels ranging from the entire swarm, via subswarms and individual UAVs, to specific sensors and equipment carried by the UAVs. The results suggest that human-in-the-loop simulation studies need to enable interaction across multiple swarm levels as this interaction may exert additional cognitive strain on the human operator.

Place, publisher, year, edition, pages
New York, NY, USA: Association for Computing Machinery (ACM), 2020. article id 93
Keywords [en]
Human-Swarm Interaction, UAV swarm, Firefighting drones, Swarm applications
National Category
Human Computer Interaction Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:liu:diva-177633DOI: 10.1145/3419249.3421239ISI: 001334839200130Scopus ID: 2-s2.0-85123040721ISBN: 9781450375795 (print)OAI: oai:DiVA.org:liu-177633DiVA, id: diva2:1575727
Conference
NordiCHI '20
Funder
Swedish Foundation for Strategic Research, FID17-0030Available from: 2021-06-30 Created: 2021-06-30 Last updated: 2025-10-10Bibliographically approved
In thesis
1. Designing Human-Swarm Interaction Systems
Open this publication in new window or tab >>Designing Human-Swarm Interaction Systems
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Utformning av system för människa-svärminteraktion
Abstract [en]

Swarms of Unmanned Aerial Vehicles (UAVs, or drones) are envisioned to transform various fields, from emergency response to law enforcement and military operations. Drone swarms provide scalable, adaptable, and decentralized solutions for dynamic work environments. However, the successful integration of these multi-agent systems into real-world settings presents significant challenges, particularly in terms of how humans can safely and effectively interact with and control these systems. Human-Swarm Interaction (HSI) aims to address these challenges by exploring how human operators can manage multiple drones in a cohesive manner, even under highly complex, uncertain conditions.

This thesis studies the problem of designing effective interaction mechanisms and interfaces for human operators to command drone swarms, specifically addressing challenges such as managing a large number of drones, supporting operators’ situational awareness, and balancing between centralized and decentralized control. The research highlights the necessity of rethinking conventional approaches by introducing alternative conceptual models, such as the "choir" metaphor, which re-imagines drone swarms as coordinated, semi-centralized ensembles rather than purely emergent, decentralized collectives. This metaphor aims to balance the collective, often unpredictable behavior of drone swarms with the predictable, directed actions needed in operational environments. By demonstrating how this metaphor can be operationalized in an HSI system architecture, the thesis provides new avenues for conceptualizing human interaction with autonomous systems.

Using a design research approach incorporating multiple-case study and scenario-based design activities to envision future swarm application in dialogue with prospective end users, the thesis develops and evaluates prototypes that embody these nuanced HSI concepts. The interface prototypes draw design inspiration from Real-Time Strategy (RTS) games. These elements include group commands, high-level mission planning, and resource pooling to create a hybrid interaction model that allows operators to maintain both a broad overview and precise control of multiple autonomous and collaborating drones. Domain expert evaluations of these prototypes in contexts such as firefighting and airport management validate the practical utility of these concepts.

The findings emphasize the value of adopting a Human-Technology-Organization (HTO) perspective in the design of HSI systems. Rather than focusing solely on the interaction between humans and technology, this systems-thinking approach acknowledges that drone swarms must be integrated into larger organizational frameworks, such as emergency response command structures or airport ground operations teams. It demonstrates that successful deployment requires accounting for the broader organizational context, including roles, workflows, and coordination needs. This holistic approach to HSI system design ensures that drone swarms not only meet technical performance criteria, such as reliability, responsiveness, and scalability, but also align with human and organizational needs, facilitating their adoption and effective use in a wide range of real-world scenarios. Ultimately, these contributions are intended to bridge the gap between theoretical models of swarm control and practical deployment, advancing both the field of HSI and the broader adoption of drone swarm technologies.

Abstract [sv]

Svärmar av obemannade luftfarkoster (UAV, eller drönare) förväntas omvandla flera områden, exempelvis räddningsinsatser, brottsbekämpning, och militäroperationer. Drönarsvärmar innebar skalbara, anpassningsbara, och decentraliserade lösningar for dynamiska arbetsuppgifter. Den lyckade integreringen av dessa multi-agent-system i verkliga miljöer innebar dock betydande utmaningar, särskilt med avseende på hur människor säkert och effektivt interagerar med och kontrollerar dessa system. Forskningsfältet Människa-Svärm Interaktion (MSI) syftar till att möta dessa utmaningar genom att undersöka hur mänskliga operatorer kan hantera flera drönare på ett sammanhängande vis, även under komplexa och osäkra förhållanden.

Denna avhandling utreder problemet att utforma effektiva och säkra interaktionsmekanismer och gränssnitt for mänskliga operatorer att leda drönarsvärmar, specifikt genom att adressera utmaningar som att hantera ett stort antal drönare, stödja operatorers situationsmedvetenhet, och balansera mellan centraliserad och decentraliserad kontroll. Avhandlingen betonar vikten av att ifrågasatta konventionella tillvägagångssätt genom att introducera alternativa konceptuella modeller, såsom "kör"-metaforen, som omtolkar drönarsvärmar som koordinerade, semicentraliserade ensembler snarare än rent decentraliserade kollektiv. Denna metafor syftar till att balansera det kollektiva, ofta oförutsägbara beteendet hos drönarsvärmar med de förutsägbara, riktade handlingar som behövs i operativa miljöer. Genom att visa hur denna metafor kan operationaliseras i en MSI-systemarkitektur, erbjuder avhandlingen nya sätt att konceptualisera mänsklig interaktion med autonoma system.

Genom att tillämpa en designforskningsmetod som innefattar fallstudier och scenariobaserade designaktiviteter för att föreställa sig framtida svärmtillämpningar i dialog med potentiella slutanvändare, utvecklar och utvärderar avhandlingen prototyper som manifesterar dessa nyanserade MSI-koncept. Gränssnittens prototyper drar designinspiration från realtidsstrategispel (RTS). Dessa element inkluderar enhetshantering och kommandon på gruppnivå, strategisk uppdragsplanering, och resursdelning för att skapa en hybrid interaktionsmodell som gör det möjligt för operatörer att både bibehålla en bred lägesbild och utöva precis kontroll över flera autonoma och samverkande drönare. Domänexperters utvärderingar av dessa prototyper i arbetskontexter som brandbekämpning och flygplatsledning påvisar den praktiska användbarheten av dessa koncept.

Resultaten betonar värdet av att anta ett Människa-Teknik-Organisation (MTO)-perspektiv vid utformningen av MSI-system. Snarare än att enbart fokusera på interaktionen mellan människor och teknik, erkänner detta systemtänkande tillvägagångssätt att drönarsvärmar måste integreras i större organisatoriska ramar, såsom ledningsstrukturer for räddningsinsatser eller markoperativa team på flygplatser. Det visar att framgångsrik implementering av drönarsvärmar kräver att systemutvecklare tar hänsyn till det bredare organisatoriska sammanhanget, inklusive roller, arbetsflöden, och samverkansbehov. Detta holistiska tillvägagångssatt för utformningen av MSI-system säkerställer att drönarsvärmar inte bara uppfyller tekniska prestandakriterier, såsom tillförlitlighet, responsivitet, och skalbarhet, utan också överensstämmer med mänskliga och organisatoriska behov, vilket underlättar deras införande och effektiv användning i en mängd olika tillämpningsscenarier. Över lag är dessa forskningsbidrag avsedda att överbrygga gapet mellan teoretiska modeller för svärmstyrning och praktisk implementering, och därmed avancera och främja både MSI-området och den bredare användningen av svärmteknologier.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2025. p. 96
Series
Linköping Studies in Arts and Sciences, ISSN 0282-9800 ; 900
Keywords
Human-swarm interaction, Drone swarms, Cognitive systems, Interaction design, Människa-svärminteraktion, Drönarsvärmar, Kognitiva system, Interaktionsdesign
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:liu:diva-211761 (URN)10.3384/9789180759595 (DOI)9789180759588 (ISBN)9789180759595 (ISBN)
Public defence
2025-03-27, Ada Lovelace, B Building, Campus Valla, Linköping, 09:15 (English)
Opponent
Supervisors
Available from: 2025-02-20 Created: 2025-02-20 Last updated: 2025-02-20Bibliographically approved

Open Access in DiVA

fulltext(1515 kB)1306 downloads
File information
File name FULLTEXT02.pdfFile size 1515 kBChecksum SHA-512
8395b53ad44eaebb2c60d4097d31c148e5d8d761924b5fb3740ef7bf9863581710205f7fc39b5d0a988a5d5436557858fe4f4b7661f431fa5f29b4fcc173f4bf
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Arvola, MattiasZiemke, Tom

Search in DiVA

By author/editor
Bjurling, OscarArvola, MattiasZiemke, Tom
By organisation
Human-Centered systemsFaculty of Arts and SciencesFaculty of Science & Engineering
Human Computer InteractionComputer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar
Total: 1314 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 628 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf