liu.seSearch for publications in DiVA
Change search
Link to record
Permanent link

Direct link
BETA
Rönnberg, Niklas
Publications (10 of 27) Show all publications
Hassan, K. A., Rönnberg, N., Forsell, C., Cooper, M. & Johansson, J. (2019). A Study on 2D and 3D Parallel Coordinates for Pattern Identification in Temporal Multivariate Data. In: : . Paper presented at 2019 23rd International Conference Information Visualization (IV) (pp. 145-150). IV 2019: IEEE conference proceedings
Open this publication in new window or tab >>A Study on 2D and 3D Parallel Coordinates for Pattern Identification in Temporal Multivariate Data
Show others...
2019 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Parallel coordinates are commonly used for non-temporal multivariate data, but there is little support for their usability for displaying temporal multivariate data. In this paper, we introduce a study evaluating the usability of 2D and 3D parallel coordinates for pattern identification in temporal multivariate data. The results indicate that 3D parallel coordinates have higher usability, as measured with higher accuracy and faster response time as well as subjective ratings, compared to 2D.

Place, publisher, year, edition, pages
IV 2019: IEEE conference proceedings, 2019
Series
IV 2019, ISSN 2375-0138
Keywords
Temporal Data, User Evaluation, 2D Parallel Coordinates, 3D Parallel Coordinates
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:liu:diva-159079 (URN)10.1109/IV.2019.00033 (DOI)
Conference
2019 23rd International Conference Information Visualization (IV)
Available from: 2019-07-22 Created: 2019-07-22 Last updated: 2019-07-22
Hassan, K. A., Rönnberg, N., Forsell, C., Cooper, M. & Johansson, J. (2019). A Study on 2D and 3D Parallel Coordinates for Pattern Identification in Temporal Multivariate Data. In: : . Paper presented at 2019 23rd International Conference Information Visualization (IV) (pp. 145-150). IV 2019: IEEE conference proceedings
Open this publication in new window or tab >>A Study on 2D and 3D Parallel Coordinates for Pattern Identification in Temporal Multivariate Data
Show others...
2019 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Parallel coordinates are commonly used for non-temporal multivariate data, but there is little support for their usability for displaying temporal multivariate data. In this paper, we introduce a study evaluating the usability of 2D and 3D parallel coordinates for pattern identification in temporal multivariate data. The results indicate that 3D parallel coordinates have higher usability, as measured with higher accuracy and faster response time as well as subjective ratings, compared to 2D.

Place, publisher, year, edition, pages
IV 2019: IEEE conference proceedings, 2019
Series
IV 2019, ISSN 2375-0138
Keywords
Temporal Data, User Evaluation, 2D Parallel Coordinates, 3D Parallel Coordinates
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:liu:diva-160960 (URN)
Conference
2019 23rd International Conference Information Visualization (IV)
Available from: 2019-10-16 Created: 2019-10-16 Last updated: 2019-10-16
Hassan, K. A., Liu, Y., Besançon, L., Johansson, J. & Rönnberg, N. (2019). A Study on Visual Representations for Active Plant Wall Data Analysis. DATA, 4(2), Article ID 74.
Open this publication in new window or tab >>A Study on Visual Representations for Active Plant Wall Data Analysis
Show others...
2019 (English)In: DATA, E-ISSN 2306-5729, Vol. 4, no 2, article id 74Article in journal (Refereed) Published
Abstract [en]

The indoor climate is closely related to human health, well-being, and comfort. Thus, an understanding of the indoor climate is vital. One way to improve the indoor climates is to place an aesthetically pleasing active plant wall in the environment. By collecting data using sensors placed in and around the plant wall both the indoor climate and the status of the plant wall can be monitored and analyzed. This manuscript presents a user study with domain experts in this field with a focus on the representation of such data. The experts explored this data with a Line graph, a Horizon graph, and a Stacked area graph to better understand the status of the active plant wall and the indoor climate. Qualitative measures were collected with Think-aloud protocol and semi-structured interviews. The study resulted in four categories of analysis tasks: Overview, Detail, Perception, and Complexity. The Line graph was found to be preferred for use in providing an overview, and the Horizon graph for detailed analysis, revealing patterns and showing discernible trends, while the Stacked area graph was generally not preferred. Based on these findings, directions for future research are discussed and formulated. The results and future directions of this research can facilitate the analysis of multivariate temporal data, both for domain users and visualization researchers.

Place, publisher, year, edition, pages
MDPI, 2019
Keywords
visualization; qualitative evaluation; temporal multivariate data; active plant walls, Visualisering; kvalitativ utvärdering; tidsvarierande multivariate data; active plant walls
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:liu:diva-157027 (URN)10.3390/data4020074 (DOI)000475303500028 ()
Available from: 2019-05-23 Created: 2019-05-23 Last updated: 2019-08-21Bibliographically approved
Rönnberg, N. (2019). Musical Elements in Sonification Support Visual Perception. In: Proceedings of the 31st European Conference on Cognitive Ergonomics (ECCE 2019): . Paper presented at 31st European Conference on Cognitive Ergonomics (ECCE 2019) (pp. 114-117). New York, NY, USA: Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Musical Elements in Sonification Support Visual Perception
2019 (English)In: Proceedings of the 31st European Conference on Cognitive Ergonomics (ECCE 2019), New York, NY, USA: Association for Computing Machinery (ACM), 2019, p. 114-117Conference paper, Published paper (Refereed)
Abstract [en]

Visual representations of data are commonly used to communicate research results. However, such representations might introduce several possible challenges for the human visual perception system, for example in perceiving brightness levels. Sonification, adding sound to the visual representation, might be used to overcome these challenges. As sonification provides additional information, sonification could be useful in supporting interpretations of a visual perception. In the present study, usefulness in terms of accuracy of sonification was investigated with an interactive sonification test. In the experiment, participants were asked to identify the highest brightness level in a monochrome visual representation. The task was performed in four conditions, one with no sonification and three with different sonification settings. The results show that sonification is useful, as measured by higher task accuracy.

Place, publisher, year, edition, pages
New York, NY, USA: Association for Computing Machinery (ACM), 2019
Keywords
interactive sonification, musical elements, visualization
National Category
Signal Processing
Identifiers
urn:nbn:se:liu:diva-160238 (URN)10.1145/3335082.3335097 (DOI)978-1-4503-7166-7 (ISBN)
Conference
31st European Conference on Cognitive Ergonomics (ECCE 2019)
Available from: 2019-09-12 Created: 2019-09-12 Last updated: 2019-09-18
Rönnberg, N. (2019). Musical sonification supports visual discrimination of color intensity. Behaviour & Information Technology, 1-11
Open this publication in new window or tab >>Musical sonification supports visual discrimination of color intensity
2019 (English)In: Behaviour & Information Technology, ISSN 0144-929X, p. 1-11Article in journal (Refereed) Epub ahead of print
Abstract [en]

Visual representations of data introduce several possible challenges for the human visual perception system in perceiving brightness levels. Overcoming these challenges might be simplified by adding sound to the representation. This is called sonification. As sonification provides additional information to the visual information, sonification could be useful in supporting the visual perception. In the present study, usefulness (in terms of accuracy and response time) of sonification was investigated with an interactive sonification test. In the test, participants were asked to identify the highest brightness level in a monochrome visual representation. The task was performed in four conditions, one with no sonification and three with different sonification settings. The results show that sonification is useful, as measured by higher task accuracy, and that the participant's musicality facilitates the use of sonification with better performance when sonification was used. The results were also supported by subjective measurements, where participants reported an experienced benefit of sonification.

Place, publisher, year, edition, pages
Taylor & Francis, 2019
Keywords
Interactive sonification, musical elements, multimodality, visual perception, visualisation
National Category
Other Engineering and Technologies
Identifiers
urn:nbn:se:liu:diva-159993 (URN)10.1080/0144929X.2019.1657952 (DOI)000484590300001 ()
Available from: 2019-09-01 Created: 2019-09-01 Last updated: 2019-11-22Bibliographically approved
Rönnberg, N. (2019). Sonification supports perception of brightness contrast. Journal on Multimodal User Interfaces, 13(13), 373-381, Article ID 4.
Open this publication in new window or tab >>Sonification supports perception of brightness contrast
2019 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 13, no 13, p. 373-381, article id 4Article in journal (Refereed) Published
Abstract [en]

In complex visual representations, there are several possible challenges for the visual perception that might be eased by adding sound as a second modality (i.e. sonification). It was hypothesized that sonification would support visual perception when facing challenges such as simultaneous brightness contrast or the Mach band phenomena. This hypothesis was investigated with an interactive sonification test, yielding objective measures (accuracy and response time) as well as subjective measures of sonification benefit. In the test, the participant’s task was to mark the vertical pixel line having the highest intensity level. This was done in a condition without sonification and in three conditions where the intensity level was mapped to different musical elements. The results showed that there was a benefit of sonification, with higher accuracy when sonification was used compared to no sonification. This result was also supported by the subjective measurement. The results also showed longer response times when sonification was used. This suggests that the use and processing of the additional information took more time, leading to longer response times but also higher accuracy. There were no differences between the three sonification conditions.

Place, publisher, year, edition, pages
Springer, 2019
Keywords
Interactive sonification, Music, Visual perception, Visualization
National Category
Media Engineering
Identifiers
urn:nbn:se:liu:diva-159026 (URN)10.1007/s12193-019-00311-0 (DOI)000492417900009 ()
Note

Funding agency:  Linkoping University

Available from: 2019-07-19 Created: 2019-07-19 Last updated: 2019-11-18Bibliographically approved
Rönnberg, N. & Löwgren, J. (2019). Traces Of Modal Synergy: Studying Interactive Musical Sonificationof Images in General-Audience Use. In: Vickers, Paul and Gröhn, Matti and Stockman, Tony (Ed.), The 25th International Conference on Auditory Display (ICAD 2019): . Paper presented at The 25th International Conference on Auditory Display (ICAD 2019), Newcastle upon Tyne, England, 23–27 June 2019. Newcastle upon Tyne, UK
Open this publication in new window or tab >>Traces Of Modal Synergy: Studying Interactive Musical Sonificationof Images in General-Audience Use
2019 (English)In: The 25th International Conference on Auditory Display (ICAD 2019) / [ed] Vickers, Paul and Gröhn, Matti and Stockman, Tony, Newcastle upon Tyne, UK, 2019Conference paper, Published paper (Refereed)
Abstract [en]

Photone is an interactive installation combining color images with musical sonification. The musical expression is generated based on the syntactic (as opposed to semantic) features of an image as it is explored by the userメs pointing device, intending to catalyze a holistic user experience we refer to as modal synergy where visual and auditory modalities multiply rather than add. We collected and analyzed two months' worth of data from visitorsメ interactions with Photone in a public exhibition at a science center. Our results show that a small proportion of visitors engaged in sustained interaction with Photone, as indicated by session times. Among the most deeply engaged visitors, a majority of the interaction was devoted to visually salient objects, i.e., semantic features of the images. However, the data also contains instances of interactive behavior that are best explained by exploration of the syntactic features of an image, and thus may suggest the emergence of modal synergy.

Place, publisher, year, edition, pages
Newcastle upon Tyne, UK: , 2019
National Category
Other Engineering and Technologies
Identifiers
urn:nbn:se:liu:diva-159112 (URN)10.21785/icad2019.010 (DOI)0-9670904-6-6 (ISBN)
Conference
The 25th International Conference on Auditory Display (ICAD 2019), Newcastle upon Tyne, England, 23–27 June 2019
Available from: 2019-07-26 Created: 2019-07-26 Last updated: 2019-09-05Bibliographically approved
Niklas, R. & Löwgren, J. (2018). Photone: Exploring modal synergy in photographic images and music. In: International Conference on Auditory Display, 2018 [30]: . Paper presented at The 24th International Conference on Auditory Display (ICAD2018), June 10-15, 2018, Michigan Technological University, Houghton, MI, USA. (pp. 73-79). Georgia Institute of Technology
Open this publication in new window or tab >>Photone: Exploring modal synergy in photographic images and music
2018 (English)In: International Conference on Auditory Display, 2018 [30], Georgia Institute of Technology , 2018, p. 73-79Conference paper, Published paper (Refereed)
Abstract [en]

We present Photone, an interactive installation combining photographic images and musical sonification. An image is displayed, and a dynamic musical score is generated based on the overall color properties of the image and the color value of the pixel under the cursor. Hence, the music changes as the user moves the cursor. This simple approach turns out to have interesting experiential qualities in use. The composition of images and music invites the user to explore the combination of hues and textures, and musical sounds. We characterize the resulting experience in Photone as one of modal synergy where visual and auditory output combine holistically with the chosen interaction technique. This tentative finding is potentially relevant to further research in auditory displays and multimodal interaction.

Place, publisher, year, edition, pages
Georgia Institute of Technology, 2018
National Category
Design Human Computer Interaction Interaction Technologies Music
Identifiers
urn:nbn:se:liu:diva-150181 (URN)10.21785/icad2018.022 (DOI)
Conference
The 24th International Conference on Auditory Display (ICAD2018), June 10-15, 2018, Michigan Technological University, Houghton, MI, USA.
Available from: 2018-08-15 Created: 2018-08-15 Last updated: 2019-05-16Bibliographically approved
Niklas, R. (2017). Sonification Enhances Perception of Color Intensity. In: : . Paper presented at IEEE Visualization Conference (VIS), Phoenix, AZ, USA, October 1-6, 2017 (pp. 1-2). Linköping: Linköping University Electronic Press
Open this publication in new window or tab >>Sonification Enhances Perception of Color Intensity
2017 (English)Conference paper, Poster (with or without abstract) (Other academic)
Abstract [en]

This poster presents an interactive sonification experiment, designed to evaluate possible benefits of sonification in information visual- ization. The aim of the present study was to explore the use of composed and deliberately designed musical sounds to enhance perception of color intensity in visual representations. It was hypoth- esized, that by using musical sounds for sonification perception of color intensity would be improved. In this evaluation, sonification was mapped to color intensity in visual representations, and the par- ticipants had to identify and mark the highest color intensity, as well as answer a questionnaire about their experience. Both quantitative and qualitative preliminary results suggest a benefit of sonification, and indicate that sonification is useful in data exploration. 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2017
National Category
Other Engineering and Technologies
Identifiers
urn:nbn:se:liu:diva-139710 (URN)
Conference
IEEE Visualization Conference (VIS), Phoenix, AZ, USA, October 1-6, 2017
Available from: 2017-08-12 Created: 2017-08-12 Last updated: 2019-03-27Bibliographically approved
Rönnberg, N. & Löwgren, J. (2016). The Sound Challenge to Visualization Design Research. In: Andreas Kerren, Daniel Cernea, Margit Pohl (Ed.), Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016: . Paper presented at EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016 (pp. 31-34). Linköping: Linköping University Electronic Press
Open this publication in new window or tab >>The Sound Challenge to Visualization Design Research
2016 (English)In: Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016 / [ed] Andreas Kerren, Daniel Cernea, Margit Pohl, Linköping: Linköping University Electronic Press, 2016, p. 31-34Conference paper, Published paper (Refereed)
Abstract [en]

This paper is an introduction to the emotional qualities of sound and music, and we suggest that the visual and the aural modalities should be combined in the design of visualizations involving emotional expressions. We therefore propose that visualization design should incorporate sonic interaction design drawing on musicology, cognitive neuroscience of music, and psychology of music, and identify what we see as key research challenges for such an approach.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2016
Series
Linköping Electronic Conference Proceedings, ISSN 1650-3686, E-ISSN 1650-3740 ; 103
Keywords
Emotion; music; sound; multimodal visualization design
National Category
Design Human Computer Interaction Interaction Technologies Music
Identifiers
urn:nbn:se:liu:diva-125755 (URN)10.3384/ecp10305 (DOI)9789176858172 (ISBN)
Conference
EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016
Available from: 2016-03-03 Created: 2016-03-03 Last updated: 2018-02-20Bibliographically approved
Organisations

Search in DiVA

Show all publications