liu.seSearch for publications in DiVA
Change search
Link to record
Permanent link

Direct link
Rönnberg, Niklas
Publications (10 of 42) Show all publications
Elmquist, E., Enge, K., Rind, A., Navarra, C., Höldrich, R., Iber, M., . . . Rönnberg, N. (2024). Parallel Chords: an audio-visual analytics design for parallel coordinates. Personal and Ubiquitous Computing
Open this publication in new window or tab >>Parallel Chords: an audio-visual analytics design for parallel coordinates
Show others...
2024 (English)In: Personal and Ubiquitous Computing, ISSN 1617-4909, E-ISSN 1617-4917Article in journal (Refereed) Epub ahead of print
Abstract [en]

One of the commonly used visualization techniques for multivariate data is the parallel coordinates plot. It provides users with a visual overview of multivariate data and the possibility to interactively explore it. While pattern recognition is a strength of the human visual system, it is also a strength of the auditory system. Inspired by the integration of the visual and auditory perception in everyday life, we introduce an audio-visual analytics design named Parallel Chords combining both visual and auditory displays. Parallel Chords lets users explore multivariate data using both visualization and sonification through the interaction with the axes of a parallel coordinates plot. To illustrate the potential of the design, we present (1) prototypical data patterns where the sonification helps with the identification of correlations, clusters, and outliers, (2) a usage scenario showing the sonification of data from non-adjacent axes, and (3) a controlled experiment on the sensitivity thresholds of participants when distinguishing the strength of correlations. During this controlled experiment, 35 participants used three different display types, the visualization, the sonification, and the combination of these, to identify the strongest out of three correlations. The results show that all three display types enabled the participants to identify the strongest correlation — with visualization resulting in the best sensitivity. The sonification resulted in sensitivities that were independent from the type of displayed correlation, and the combination resulted in increased enjoyability during usage.

Place, publisher, year, edition, pages
Springer, 2024
National Category
Media Engineering
Identifiers
urn:nbn:se:liu:diva-203454 (URN)10.1007/s00779-024-01795-8 (DOI)
Funder
Knut and Alice Wallenberg Foundation, 2019.0024
Available from: 2024-05-13 Created: 2024-05-13 Last updated: 2024-05-28
Ziemer, T., Lenzi, S., Rönnberg, N., Hermann, T. & Bresin, R. (2023). Introduction to the special issue on design and perception of interactive sonification. Journal on Multimodal User Interfaces, 17, 213-214
Open this publication in new window or tab >>Introduction to the special issue on design and perception of interactive sonification
Show others...
2023 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 17, p. 213-214Article in journal, Editorial material (Other academic) Published
Place, publisher, year, edition, pages
Springer, 2023
Keywords
Sonification
National Category
Other Engineering and Technologies not elsewhere specified
Identifiers
urn:nbn:se:liu:diva-199882 (URN)10.1007/s12193-023-00425-6 (DOI)
Available from: 2024-01-02 Created: 2024-01-02 Last updated: 2024-01-03
Rönnberg, N., Ringdahl, R. & Fredriksson, A. (2023). Measurement and sonification of construction site noise and particle pollution data. Smart and Sustainable Built Environment, 12(4), 742-764
Open this publication in new window or tab >>Measurement and sonification of construction site noise and particle pollution data
2023 (English)In: Smart and Sustainable Built Environment, ISSN 2046-6099, E-ISSN 2046-6102, Vol. 12, no 4, p. 742-764Article in journal (Refereed) Published
Abstract [en]

Purpose – The noise and dust particles caused by the construction transport are by most stakeholders experienced as disturbing. The purpose of this study is to explore how sonification can support visualization in construction planning to decrease construction transport disturbances.

Design/methodology/approach – This paper presents an interdisciplinary research project, combining research on construction logistics, internet of things and sonification. First, a data recording device, including sound, particle, temperature and humidity sensors, was implemented and deployed in a development project. Second, the collected data were used in a sonification design, which was, third, evaluated with potential users.

Findings – The results showed that the low-cost sensors used could capture “good enough” data, and that the use of sonification for representing these data is interesting and a possible useful tool in urban and construction transport planning.

Research limitations/implications – There is a need to further evolve the sonification design and better communicate the aim of the sounds used to potential users. Further testing is also needed.

Practical implications – This study introduces new ideas of how to support visualization with sonification planning the construction work and its impact on the vicinity of the site. Currently, urban planning and construction planning focus on visualizing the final result, with little focus on how to handle disturbances during the construction process.

Originality/value – Showing the potentials of using low-cost sensor data in sonification, and using sonification together with visualization, is the result of a novel interdisciplinary research area combination.

Place, publisher, year, edition, pages
Bingley, United Kingdom: Emerald Group Publishing Limited, 2023
Keywords
Construction logistics, Urban planning, Sonification, IoT sensors, User evaluation
National Category
Construction Management Transport Systems and Logistics
Identifiers
urn:nbn:se:liu:diva-184432 (URN)10.1108/SASBE-11-2021-0189 (DOI)000784779700001 ()
Available from: 2022-04-20 Created: 2022-04-20 Last updated: 2023-11-28Bibliographically approved
Elmquist, E., Bock, A., Lundberg, J., Ynnerman, A. & Rönnberg, N. (2023). SonAir: the design of a sonification of radar data for air traffic control. Journal on Multimodal User Interfaces, 17(3), 137-149
Open this publication in new window or tab >>SonAir: the design of a sonification of radar data for air traffic control
Show others...
2023 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 17, no 3, p. 137-149Article in journal (Refereed) Published
Abstract [en]

Along with the increase of digitalization and automation, a new kind of working environment is emerging in the field of air traffic control. Instead of situating the control tower at the airport, it is now possible to remotely control the airport at any given location, i.e. in a remote tower center (RTC). However, by controlling the airport remotely, the situational awareness and sense of presence might be compromised. By using directional sound, a higher situational awareness could potentially be achieved while also offloading the visual perception which is heavily used in air traffic control. Suitable use cases for sonification in air traffic control were found through workshops with air traffic controllers. A sonification design named SonAir was developed based on the outcome of the workshops, and was integrated with an RTC simulator for evaluating to what degree SonAir could support air traffic controllers in their work. The results suggest that certain aspects of SonAir could be useful for air traffic controllers. A continuous sonification where the spatial positioning of aircraft were conveyed was experienced to be partially useful, but the intrusiveness of SonAir should be further considered to fit the air traffic controllers’ needs. An earcon that conveyed when an aircraft enters the airspace and from which direction was considered useful to support situational awareness.

Place, publisher, year, edition, pages
SPRINGER, 2023
Keywords
Sonification; Air traffic control; Situational awareness; User evaluation
National Category
Media Engineering
Identifiers
urn:nbn:se:liu:diva-196256 (URN)10.1007/s12193-023-00404-x (DOI)001021523300001 ()
Note

Funding: Swedish Transport Authority [TRV-2019/53555]; Knut and Alice Wallenberg Foundation [KAW 2019.0024]

Available from: 2023-07-08 Created: 2023-07-08 Last updated: 2023-12-07
Weger, M., Ziemer, T. & Rönnberg, N. (Eds.). (2023). Sonification for the Masses: Proceedings of the 28th Annual International Conference on Auditory Display. Paper presented at The 28th Annual International Conference on Auditory Display (ICAD2023), June 26 - July 1 2023, Norrköping, Sweden.. Georgia Institute of Technology
Open this publication in new window or tab >>Sonification for the Masses: Proceedings of the 28th Annual International Conference on Auditory Display
2023 (English)Conference proceedings (editor) (Refereed)
Place, publisher, year, edition, pages
Georgia Institute of Technology, 2023. p. 283
Keywords
Sonification
National Category
Other Engineering and Technologies not elsewhere specified
Identifiers
urn:nbn:se:liu:diva-199891 (URN)10.21785/icad2023.000 (DOI)0967090490 (ISBN)
Conference
The 28th Annual International Conference on Auditory Display (ICAD2023), June 26 - July 1 2023, Norrköping, Sweden.
Available from: 2024-01-03 Created: 2024-01-03 Last updated: 2024-01-08Bibliographically approved
Svoronos-Kanavas, I., Agiomyrgianakis, V. & Rönnberg, N. (2022). An exploratory use of audiovisual displays on oceanographic data. In: : . Paper presented at AVI 2022 Workshop on Audio-Visual Analytics (WAVA22), Frascati, Rome, Italy, 7 June 2022.
Open this publication in new window or tab >>An exploratory use of audiovisual displays on oceanographic data
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

The present study is an interdisciplinary endeavour that transmutes science, technology, and aesthetics into an audiovisual experience. The objective is to highlight the potential of combining sonification with visualisation in order to enhance the comprehension of extensive and complex sets of data. Moreover, this paper describes contemporary tools and methods for the implementation of the practice and suggests effective ways to monitor environmental changes. It can be regarded as an exploratory study for familiarisation with the potential of sonification and visualisation in the exploration of environmental data.

Keywords
Sonification, Visualization, Audiovisual display, Oceanographic data
National Category
Interaction Technologies
Identifiers
urn:nbn:se:liu:diva-185104 (URN)10.5281/zenodo.6555839 (DOI)
Conference
AVI 2022 Workshop on Audio-Visual Analytics (WAVA22), Frascati, Rome, Italy, 7 June 2022
Available from: 2022-05-17 Created: 2022-05-17 Last updated: 2022-05-30Bibliographically approved
Svensson, Å. & Rönnberg, N. (2022). Expected teamwork attributes between human operator and automation in air traffic control. In: : . Paper presented at 33rd Congress of the International Council of the Aeronautical Sciences (ICAS2022), Stockholm, Sweden, 4-9 September 2022.
Open this publication in new window or tab >>Expected teamwork attributes between human operator and automation in air traffic control
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

To meet the increasing demands within the air traffic control (ATC) industry, automation is seen as one solution to increase efficiency, safety, and capacity. In ATC, teamwork between air traffic controllers (ATCO) is a key component to safely direct the aircraft. With increasing automation, the human-automation teamwork will become even more important to keep the human operator in the loop and contribute to the operator’s involvement in decision-making. However, operators can be cautious to new automation due to experience has taught them to be cautious and the willingness to accept automation can relate to the purpose of the automation. Therefore, this study presents how ATCOs want to work with an automated tool in the future, what qualities the automation should have, and what the human should be able to do when working with an automated system. Through an online questionnaire, 113 operational ATCOs answered questions about ATCOs’ experiences and expectations of current and future ATM systems, as well as teamwork between the ATCO and automated systems. For this paper, the teamwork aspects of the questionnaire are presented and discussed. The ATCOs believed that they should be able to trust the automation, know the reasoning behind the automation’s suggestions and decisions, and be able to always take control of the situation from the automation. The results will be used in early development processes of automation, in both the ATM domain but also in other control domains, that faces similar challenges. 

Keywords
air traffic control, automation, teamwork
National Category
Interaction Technologies
Identifiers
urn:nbn:se:liu:diva-188689 (URN)
Conference
33rd Congress of the International Council of the Aeronautical Sciences (ICAS2022), Stockholm, Sweden, 4-9 September 2022
Available from: 2022-09-21 Created: 2022-09-21 Last updated: 2022-11-18
Rönnberg, N., Lenzi, S., Ziemer, T., Hermann, T. & Bresin, R. (Eds.). (2022). Psychoacoustics in the Loop: Proceedings of the 7th Interactive Sonification Workshop. Paper presented at ISon 2022, 7th Interactive Sonification Workshop (ISon 2022), Hanse Wissenschaftskolleg (HWK), Delmenhorst, Germany, September 22nd–23rd 2022. Bielefeld, Germany: CITEC, Bielefeld University
Open this publication in new window or tab >>Psychoacoustics in the Loop: Proceedings of the 7th Interactive Sonification Workshop
Show others...
2022 (English)Conference proceedings (editor) (Refereed)
Place, publisher, year, edition, pages
Bielefeld, Germany: CITEC, Bielefeld University, 2022. p. 104
Keywords
Sonification
National Category
Other Engineering and Technologies not elsewhere specified
Identifiers
urn:nbn:se:liu:diva-199873 (URN)10.5281/zenodo.7552268 (DOI)
Conference
ISon 2022, 7th Interactive Sonification Workshop (ISon 2022), Hanse Wissenschaftskolleg (HWK), Delmenhorst, Germany, September 22nd–23rd 2022
Available from: 2024-01-02 Created: 2024-01-02 Last updated: 2024-01-08Bibliographically approved
Rönnberg, N. & Forsell, C. (2022). Questionnaires assessing usability of audio-visual representations. In: : . Paper presented at AVI 2022 Workshop on Audio-Visual Analytics (WAVA22), Frascati, Rome, Italy, 7 June 2022.
Open this publication in new window or tab >>Questionnaires assessing usability of audio-visual representations
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

In this position paper we argue for the need of using standardized questionnaires for assessing usability in audio-visual representations. By using standardized measures of usability, comparability and validity of research studies in this field will be improved. However, it is not clear which questionnaire that is most suitable for assessing usability in audio-visual representations, neither when assessing the modalities individually or the combination. We present a variety of different questionnaires available, and argue for the need of combining different measures as well as developing new.

Keywords
User-centered evaluation, Questionnaires, Usability, Visualization, Sonification, Audio-visual representations
National Category
Interaction Technologies
Identifiers
urn:nbn:se:liu:diva-185101 (URN)10.5281/zenodo.6555676 (DOI)
Conference
AVI 2022 Workshop on Audio-Visual Analytics (WAVA22), Frascati, Rome, Italy, 7 June 2022
Available from: 2022-05-17 Created: 2022-05-17 Last updated: 2022-05-30Bibliographically approved
Andreopoulou, A., Walker, B. N., McMullen, K. & Rönnberg, N. (Eds.). (2022). Safe and Sound: Proceedings of the 27th Annual International Conference on Auditory Display. Paper presented at The 27th Annual International Conference on Auditory Display (ICAD2022), June 24-27. Online virtual conference.. Georgia Institute of Technology
Open this publication in new window or tab >>Safe and Sound: Proceedings of the 27th Annual International Conference on Auditory Display
2022 (English)Conference proceedings (editor) (Refereed)
Place, publisher, year, edition, pages
Georgia Institute of Technology, 2022. p. 179
Keywords
Sonification
National Category
Other Engineering and Technologies not elsewhere specified
Identifiers
urn:nbn:se:liu:diva-199893 (URN)10.21785/icad2022.000 (DOI)0967090482 (ISBN)
Conference
The 27th Annual International Conference on Auditory Display (ICAD2022), June 24-27. Online virtual conference.
Available from: 2024-01-03 Created: 2024-01-03 Last updated: 2024-01-08Bibliographically approved
Organisations

Search in DiVA

Show all publications