liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Model Fidelity in Mission Scenario Simulations for Systems of Systems: A Case Study of Maritime Search and Rescue
Linköping University, Department of Management and Engineering, Fluid and Mechatronic Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-3383-279X
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Systems of Systems (SoS) represent a view where individual, independent systems named Constituent System (CS) collaborate to achieve overarching capabilities not attainable by a single CS alone. In cyberphysical systems, CS can be engineered entities like boats or aircraft, when they collaborate in an environment it can be viewed as an SoS. There is a large interest in modeling and simulation of phenomena present at different scales of SoS, which requires choosing appropriate model fidelity and resolution for the study. This thesis delves into the intricacies of modeling and simulation of mission scenarios within SoS, with a keen focus on engineered CS operating in physical environments. At the heart of the thesis lies the concept of model fidelity, examined through philosophical, scientific, and engineering perspectives.

A maritime search and rescue scenario by airborne search assets serves as case study, using Agent Based Simulation (ABS) to explore the Measures of Effectiveness (MoE) of the mission. Through a hierarchical viewpoint it is studied how the model fidelity on Sub-System (SS) level affects its performance and how it aggregates up to performance on the CS level and at last the MoE on SoS level. In the scenarios, manned assets utilize traditional search patterns that is used in present search and rescue operations. Concurrently, autonomous assets employ a belief map search strategy where the map is based on probability density functions underpinned by a Bayesian modeling approach to new observations as the search progresses.

The study shows that increasing the model fidelity at the SS level, particularly by refining the representation of the search sensor, can impact the MoE of the mission at the SoS level. However, this influence shows to be notably scenario-dependent, emphasizing the intricate relationship between model fidelity and system performance. The findings indicate that the relevance of model fidelity is tied to how measures of performance at lower levels aggregate to influence overarching mission outcomes. The thesis concludes by discussing validation and verification of the case study and ties encountered modeling difficulties to resolution and model fidelity aspects. Future work is suggested to be a deeper dive into mission engineering, where the mission itself is viewed as the system of interest, and how it could be combined with modeling and simulation in product development.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. , p. 85
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1975
National Category
Vehicle and Aerospace Engineering
Identifiers
URN: urn:nbn:se:liu:diva-198925DOI: 10.3384/9789180753944ISBN: 9789180753937 (print)ISBN: 9789180753944 (electronic)OAI: oai:DiVA.org:liu-198925DiVA, id: diva2:1809086
Presentation
2023-11-17, ACAS, A-building and online via Zoom (contact sofia.schon@liu.se), Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Funder
Vinnova, NFFP7/ 2017-04839Available from: 2023-11-02 Created: 2023-11-02 Last updated: 2026-03-12Bibliographically approved
List of papers
1. A System of Systems Approach for Search and Rescue Missions
Open this publication in new window or tab >>A System of Systems Approach for Search and Rescue Missions
Show others...
2020 (English)In: AIAA SCITECH 2020 FORUM, American Institute of Aeronautics and Astronautics , 2020Conference paper, Published paper (Refereed)
Abstract [en]

System-of-Systems Engineering (SoSE) has become a constantly growing field within product development for complex systems. Systems are becoming more and more connected with other systems and the operational environment in general. This takes the development process to new levels of complexity where high degrees of uncertainties are expected due to ever occurring changes in the operational environment, and other external factors such as politics, economy, and technology. This creates a need of being able to understand the influence of changes early in the development process and to facilitate the systems? perseverance. The focus of the development shifts from fulfilling specific requirements, to being able to meet needs and deliver capabilities over time. Additionally, modeling and simulation for complex systems and System-of-Systems (SoS) becomes a valued alternative to the economically prohibited and almost impossible prototype testing. In consideration of this problem, the presented work introduces a method for both modeling and simulation of a SoS. The method uses ontology with description logic reasoning to derive and narrow down a SoS design space which is further analyzed using Agent Based Simulation (ABS). A Search and Rescue (SAR) scenario is used as a case study to test the method. Measures of Effectiveness (MoE), based on the time it takes to find a rescue subject and the cost of doing so, are used to evaluate the SoS performances. The presented method is envisioned to be used early in the development of complex systems and SoS to increase the overall understanding of them.

Place, publisher, year, edition, pages
American Institute of Aeronautics and Astronautics, 2020
Keywords
Model Based System Engineering, Unified Modeling Language, Web Ontology Language, Extensible Markup Language, Ocean Currents, Helicopters, Air Vehicle, Probability Density Functions, Cyber Physical System
National Category
Vehicle and Aerospace Engineering
Identifiers
urn:nbn:se:liu:diva-175763 (URN)10.2514/6.2020-0455 (DOI)001327890907042 ()2-s2.0-85092352373 (Scopus ID)
Conference
AIAA Scitech 2020 Forum, Orlando, FL, JAN 06-10, 2020
Note

Funding Agencies|Swedish Innovation Agency (VINNOVA) [NFFP7/ 2017-04838, NFFP7/ 2017-04839]

Available from: 2021-05-19 Created: 2021-05-19 Last updated: 2026-03-12Bibliographically approved
2. Integration of Multi-Fidelity Models with Agent-Based Simulation for System of Systems
Open this publication in new window or tab >>Integration of Multi-Fidelity Models with Agent-Based Simulation for System of Systems
2021 (English)In: Proceedings of the AIAA Aviation 2021 Forum, Virtual Event, 2nd - 6th August, 2021., American Institute of Aeronautics and Astronautics , 2021Conference paper, Published paper (Other academic)
Abstract [en]

System of Systems (SoS) are everywhere, either created and directed by an organization or simply emerging to fulfill a need. SoS consist of many independent Constituent Systems (CS) with their own life cycles and behavior. One of the big challenges with studying SoS is building models to support the analysis of these large complex systems. For existent SoS, it may be tempting to use available models from subsequent levels and connect them in a common framework, rather than creating new models tailored for the SoS analysis. Typically, the already existing models often have a high level of fidelity and have been created from a certain point of view to best fit its purpose. This paper shows that a framework with higher fidelity models on Sub-Systems (SS) level will impact the performance on SoS level but also take longer time to converge and thus need more simulations in order for the results to be trusted. With an holistic approach to the development of SoS, we use hierarchical integration of CS and SS models to provide inputs to the simulation on SoS level. Using maritime Search and Rescue (SAR) as a case study, the mission performance of two aircraft searching for a lost life raft through Agent Based Simulation (ABS). Two cases are compared where one of them has a higher fidelity representation of the sensor model. Through the case study it is possible to investigate the impact of model fidelity on the SS level to the simulation results on SoS level. The two cases simulate the same scenario but still show a difference in mission performance. A convergence analysis show that with the the High Fidelity Models (HFM) the simulation takes slightly longer to converge. This paper is the beginning of a multi-fidelity model library that will be used to explore the impact of model fidelity on all the levels of SoS and from that find general methods for choosing model fidelity when analyzing SoS.

Place, publisher, year, edition, pages
American Institute of Aeronautics and Astronautics, 2021
National Category
Vehicle and Aerospace Engineering
Identifiers
urn:nbn:se:liu:diva-198920 (URN)10.2514/6.2021-2996 (DOI)001396224904058 ()2-s2.0-85123592112 (Scopus ID)
Conference
AIAA AVIATION 2021 FORUM August 2-6, 2021
Note

Funding Agencies|Swedish Innovation Agency (VINNOVA) [NFFP7/ 2017-04839]

Available from: 2023-11-01 Created: 2023-11-01 Last updated: 2026-03-12
3. Exploring the Impact of Model Fidelity Through Interactive Visualizations for System of Systems
Open this publication in new window or tab >>Exploring the Impact of Model Fidelity Through Interactive Visualizations for System of Systems
Show others...
2022 (English)In: AIAA SciTech 2022 Forum, January 3-7, 2022, San Diego, CA & Virtual, USA: American Institute of Aeronautics and Astronautics, 2022Conference paper, Published paper (Refereed)
Abstract [en]

Studying Systems of Systems (SoS) in relation to Measures of Effectiveness (MoE) is a difficult task. This is due to that SoSs include several system levels and operate in changing environments. There are also computational challenges related to modeling and simulation of SoSs and it is difficult to predict behaviors. Therefore, choosing model fidelity for system models and assessing their impact on MoE is of high relevance to the field. This paper illustrates an approach to modeling and simulation for SoSs that can be used to assess the impact of scenario parameters and to explore when level of fidelity on system level affects the MoE. This is made through a case study based on Search and Rescue (SAR) operations where a Design Of Experiments (DOE) of scenario parameters is performed and simulations of each scenario experiment is performed. The case study shows how Agent Based Simulations (ABS) can be used to obtain the MoE for different SAR missions and how the choice of model fidelity for one of the aircraft’s sensors has different effects for various scenarios. Additionally, a Visual Analytics (VA) approach is introduced and used to create a dashboard for visualizing the obtained simulation results in an interactive way. This allows users to make explorations on the resulting data and see how different scenarios influence the performance of each SoS. Furthermore, the results show that changes in scenario parameters impacts the MoE and that this is difficult to predict, at least using a quantitative method. The results point to the importance of exploration for both the scenario, using an interactive dashboard, but also to the importance of exploring the simulation model to study emerging phenomenon. The results of this approach have raised questions regarding if a more qualitative approach of studying SoSs could be beneficial to study MoE for SoSs and if inspiration could be transferred from a more scientific point of view of systems.

Place, publisher, year, edition, pages
USA: American Institute of Aeronautics and Astronautics, 2022
National Category
Vehicle and Aerospace Engineering
Identifiers
urn:nbn:se:liu:diva-191926 (URN)10.2514/6.2022-1467 (DOI)001409639600358 ()2-s2.0-85123597978 (Scopus ID)
Conference
AIAA SCITECH Forum
Projects
System-of-Systems Trade Space Exploration (S2TEP)
Funder
Vinnova, NFFP7/ 2017-04838
Available from: 2023-02-23 Created: 2023-02-23 Last updated: 2026-03-12

Open Access in DiVA

fulltext(9194 kB)842 downloads
File information
File name FULLTEXT01.pdfFile size 9194 kBChecksum SHA-512
6ccd6c86246e8b27e0b1a98a30f1b35cd3b4102f65a1084b58d49521632fd07215f9625953fcad3b34c6c627926327c145730b9a1fe0e2bdbf3e48f73262b23f
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Authority records

Schön, Sofia

Search in DiVA

By author/editor
Schön, Sofia
By organisation
Fluid and Mechatronic SystemsFaculty of Science & Engineering
Vehicle and Aerospace Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 844 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1322 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf