liu.seSearch for publications in DiVA
Change search
Link to record
Permanent link

Direct link
Publications (10 of 12) Show all publications
Fujiwara, T., Kucher, K., Wang, J., Martins, R. M., Kerren, A. & Ynnerman, A. (2025). Adversarial Attacks on Machine Learning-Aided Visualizations. Journal of Visualization, 28(1), 133-151
Open this publication in new window or tab >>Adversarial Attacks on Machine Learning-Aided Visualizations
Show others...
2025 (English)In: Journal of Visualization, ISSN 1343-8875, E-ISSN 1875-8975, Vol. 28, no 1, p. 133-151Article in journal (Refereed) Published
Abstract [en]

Research in ML4VIS investigates how to use machine learning (ML) techniques to generate visualizations, and the field is rapidly growing with high societal impact. However, as with any computational pipeline that employs ML processes, ML4VIS approaches are susceptible to a range of ML-specific adversarial attacks. These attacks can manipulate visualization generations, causing analysts to be tricked and their judgments to be impaired. Due to a lack of synthesis from both visualization and ML perspectives, this security aspect is largely overlooked by the current ML4VIS literature. To bridge this gap, we investigate the potential vulnerabilities of ML-aided visualizations from adversarial attacks using a holistic lens of both visualization and ML perspectives. We first identify the attack surface (i.e., attack entry points) that is unique in ML-aided visualizations. We then exemplify five different adversarial attacks. These examples highlight the range of possible attacks when considering the attack surface and multiple different adversary capabilities. Our results show that adversaries can induce various attacks, such as creating arbitrary and deceptive visualizations, by systematically identifying input attributes that are influential in ML inferences. Based on our observations of the attack surface characteristics and the attack examples, we underline the importance of comprehensive studies of security issues and defense mechanisms as a call of urgency for the ML4VIS community.

Place, publisher, year, edition, pages
Springer, 2025
Keywords
ML4VIS, AI4VIS, Visualization, Cybersecurity, Neural networks, Parametric dimensionality reduction, Chart recommendation
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:liu:diva-207771 (URN)10.1007/s12650-024-01029-2 (DOI)001316813100001 ()
Funder
Knut and Alice Wallenberg Foundation, 2019.0024ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Note

Funding Agencies: Knut and Alice Wallenberg Foundation [KAW 2019.0024]; ELLIIT environment for strategic research in Sweden

Available from: 2024-09-21 Created: 2024-09-21 Last updated: 2025-04-22
Takahira, K., Kam-Kwai, W., Yang, L., Xu, X., Fujiwara, T. & Qu, H. (2025). TangibleNet: Synchronous Network Data Storytelling through Tangible Interactions in Augmented Reality. In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. Paper presented at ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025. ACM Digital Library
Open this publication in new window or tab >>TangibleNet: Synchronous Network Data Storytelling through Tangible Interactions in Augmented Reality
Show others...
2025 (English)In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, ACM Digital Library, 2025Conference paper, Published paper (Refereed)
Abstract [en]

Synchronous data-driven storytelling with network visualiza-tions presents significant challenges due to the complexity of real-time manipulation of network components. While existingresearch addresses asynchronous scenarios, there is a lack of effective tools for live presentations. To address this gap, we de-veloped TangibleNet, a projector-based AR prototype that allows presenters to interact with node-link diagrams using double-sided magnets during live presentations. The design process was informed by interviews with professionals experienced insynchronous data storytelling and workshops with 14 HCI/VISresearchers. Insights from the interviews helped identify key design considerations for integrating physical objects as interac-tive tools in presentation contexts. The workshops contributed to the development of a design space mapping user actions to interaction commands for node-link diagrams. Evaluation with 12 participants confirmed that TangibleNet supports intuitive in-teractions and enhances presenter autonomy, demonstrating its effectiveness for synchronous network-based data storytelling.

Place, publisher, year, edition, pages
ACM Digital Library, 2025
Keywords
data-driven storytelling, tangible interaction, augmented reality, network visualization
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:liu:diva-212090 (URN)
Conference
ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025
Funder
Knut and Alice Wallenberg Foundation, 2019.0024
Available from: 2025-03-05 Created: 2025-03-05 Last updated: 2025-03-20Bibliographically approved
Bae, S. S., Fujiwara, T., Tseng, C. & Szafir, D. (2025). Uncovering How Scatterplot Features Skew Visual Class Separation. In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. Paper presented at ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025. ACM Digital Library
Open this publication in new window or tab >>Uncovering How Scatterplot Features Skew Visual Class Separation
2025 (English)In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, ACM Digital Library, 2025Conference paper, Published paper (Refereed)
Abstract [en]

Multi-class scatterplots are essential for visually comparing data, such as examining class distributions in dimensionality reduction and evaluating classification models. Visual class separation (VCS) measures quantify human perception but are largely derived from and evaluated with datasets reflecting limited types of scatterplot features (e.g., data distribution, similar class densities). Quantitatively identifying which scatterplot features are influential to VCS tasks can enable more robust guidance for future measures. We analyze the alignment between VCS measures and people's perceptions of class separation through a crowdsourced study using 70 scatterplot features relevant to class separation. To cover a wide range of scatterplot features, we generated a set of multi-class scatterplots from 6,947 real-world datasets. Our results highlight that multiple combinations of features are needed to best explain VCS. From our analysis, we develop a composite feature model that identifies key scatterplot features for measuring VCS task performance.

Place, publisher, year, edition, pages
ACM Digital Library, 2025
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:liu:diva-212088 (URN)
Conference
ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025
Funder
Knut and Alice Wallenberg Foundation, 2019.0024
Available from: 2025-03-05 Created: 2025-03-05 Last updated: 2025-03-20Bibliographically approved
Jeon, H., Lee, H., Kuo, Y.-H., Yang, T., Archambault, D., Ko, S., . . . Seo, J. (2025). Unveiling High-dimensional Backstage: A Survey for Reliable Visual Analytics with Dimensionality Reduction. In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. Paper presented at ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025. ACM Digital Library
Open this publication in new window or tab >>Unveiling High-dimensional Backstage: A Survey for Reliable Visual Analytics with Dimensionality Reduction
Show others...
2025 (English)In: CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, ACM Digital Library, 2025Conference paper, Published paper (Refereed)
Abstract [en]

Dimensionality reduction (DR) techniques are essential for visually analyzing high-dimensional data. However, visual analytics using DR often face unreliability, stemming from factors such as inherent distortions in DR projections. This unreliability can lead to analytic insights that misrepresent the underlying data, potentially resulting in misguided decisions. To tackle these reliability challenges, we review 133 papers that address the unreliability of visual analytics using DR. Through this review, we contribute (1) a workflow model that describes the interaction between analysts and machines in visual analytics using DR, and (2) a taxonomy that identifies where and why reliability issues arise within the workflow, along with existing solutions for addressing them. Our review reveals ongoing challenges in the field, whose significance and urgency are validated by five expert researchers. This review also finds that the current research landscape is skewed toward developing new DR techniques rather than their interpretation or evaluation, where we discuss how the HCI community can contribute to broadening this focus.

Place, publisher, year, edition, pages
ACM Digital Library, 2025
Keywords
Dimensionality reduction, Multidimensional projection, Reliability, High-dimensional data, Literature analysis, Survey
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:liu:diva-212089 (URN)
Conference
ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Apr 26, 2025 - May 1, 2025
Funder
Knut and Alice Wallenberg Foundation, 2019.0024
Available from: 2025-03-05 Created: 2025-03-05 Last updated: 2025-03-20Bibliographically approved
Emmei, M., Okami, N., Fujiwara, T., Sakamoto, N. & Nonaka, J. (2025). Visual Analytics for Multivariate Time-Series Data Using Interactive Dimensionality Reduction Methods. In: : . Paper presented at IEEE PacificVis, Taipei, Taiwan, April 22-25, 2025. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Visual Analytics for Multivariate Time-Series Data Using Interactive Dimensionality Reduction Methods
Show others...
2025 (English)Conference paper, Published paper (Refereed)
Abstract [en]

One advancing machine-learning-based analysis approach for multivariate time-series data is representing data as a third-order tensor and then applying dimensionality reduction (DR) methods. In this work, we introduce a visual analytics method that employs multiple interactive DR methods to support both extraction and interpretation of latent patterns of multivariate time-series data. Our method first allows analysts to select an analysis focus from three axes: instance, variable, and time axes. Then, the method applies a multi-step DR method to produce a 2D scatterplot that depicts latent patterns of the selected axis's elements (e.g., time points). Afterward, the analysts interactively investigate data groups that appeared in the plot with a DR method designed for comparative analysis. The method can be further applied iteratively to perform more precise and detailed analyses. We implement a prototype system and demonstrate the effectiveness of our method by analyzing supercomputer log data.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Visualization, tensor data, dimensionality reduction, tensor decomposition, interpretation, comparative analysis
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-212091 (URN)
Conference
IEEE PacificVis, Taipei, Taiwan, April 22-25, 2025
Funder
Knut and Alice Wallenberg Foundation, 2019.0024
Note

Presented for PacificVis 2025 Visualization Meets AI Workshop

Available from: 2025-03-05 Created: 2025-03-05 Last updated: 2025-03-20Bibliographically approved
Jung, M., Fujiwara, T. & Jo, J. (2024). GhostUMAP: Measuring Pointwise Instability in Dimensionality Reduction. In: 2024 IEEE VISUALIZATION AND VISUAL ANALYTICS, VIS: . Paper presented at IEEE Visualization and Visual Analytics (VIS), St. Pete Beach, FL, USA, 13-18 October, 2024 (pp. 161-165). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>GhostUMAP: Measuring Pointwise Instability in Dimensionality Reduction
2024 (English)In: 2024 IEEE VISUALIZATION AND VISUAL ANALYTICS, VIS, Institute of Electrical and Electronics Engineers (IEEE), 2024, p. 161-165Conference paper, Published paper (Refereed)
Abstract [en]

Although many dimensionality reduction (DR) techniques employ stochastic methods for computational efficiency, such as negative sampling or stochastic gradient descent, their impact on the projection has been underexplored. In this work, we investigate how such stochasticity affects the stability of projections and present a novel DR technique, GhostUMAP, to measure the pointwise instability of projections. Our idea is to introduce clones of data points, "ghosts", into UMAP’s layout optimization process. Ghosts are designed to be completely passive: they do not affect any others but are influenced by attractive and repulsive forces from the original data points. After a single optimization run, GhostUMAP can capture the projection instability of data points by measuring the variance with the projected positions of their ghosts. We also present a successive halving technique to reduce the computation of GhostUMAP. Our results suggest that Ghost-UMAP can reveal unstable data points with a reasonable computational overhead.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Series
2024 IEEE Visualization and Visual Analytics (VIS), ISSN 2771-9537, E-ISSN 2771-9553
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:liu:diva-210371 (URN)10.1109/VIS55277.2024.00040 (DOI)001447839700033 ()2-s2.0-85215277968 (Scopus ID)9798350354867 (ISBN)9798350354850 (ISBN)
Conference
IEEE Visualization and Visual Analytics (VIS), St. Pete Beach, FL, USA, 13-18 October, 2024
Funder
Knut and Alice Wallenberg Foundation, t KAW 2019.0024
Note

Funding Agencies|Institute of Information & communications Technology Planning & Evaluation (IITP) - Korea government (MSIT) [2019-0-00421]; National Research Foundation of Korea (NRF) - Korea government (MSIT) [RS-2023-00221186]; Knut and Alice Wallenberg Foundation [KAW 2019.0024]

Available from: 2024-12-09 Created: 2024-12-09 Last updated: 2025-11-12Bibliographically approved
Nonaka, J., Fujita, K., Fujiwara, T., Sakamoto, N., Yamamoto, K., Terai, M., . . . Shoji, F. (2023). Reflections on the Developments of Visual Analytics Systems for the K Computer System Log Data. In: Gillmann, C.; Krone, M.; Reina, G.; Wischgoll, T. (Ed.), VisGap - The Gap between Visualization Research and Visualization Software: . Paper presented at VisGap - The Gap between Visualization Research and Visualization Software, Leipzig, Germany June 12, 2023 (pp. 11-18). Goslar: Eurographics - European Association for Computer Graphics
Open this publication in new window or tab >>Reflections on the Developments of Visual Analytics Systems for the K Computer System Log Data
Show others...
2023 (English)In: VisGap - The Gap between Visualization Research and Visualization Software / [ed] Gillmann, C.; Krone, M.; Reina, G.; Wischgoll, T., Goslar: Eurographics - European Association for Computer Graphics, 2023, p. 11-18Conference paper, Published paper (Refereed)
Abstract [en]

Flagship-class high-performance computing (HPC) systems, also known as supercomputers, are large, complex systems that require particular attention for continuous and long-term stable operations. The K computer was a Japanese flagship-class supercomputer ranked as the fastest supercomputer in the Top500 ranking when it first appeared. It was composed of more than eighty thousand compute nodes and consumed more than 12 MW when running the LINPACK benchmark for the Top500 submission. A combined power substation, with a natural gas co-generation system (CGS), was used for the power supply, and also a large air/water cooling facility was used to extract the massive heat generated from this HPC system. During the years of its regular operation, a large log dataset has been generated from the K computer system and its facility, and several visual analytics systems have been developed to better understand the K computer's behavior during the operation as well as the probable correlation of operational temperature with the critical hardware failures. In this paper, we will reflect on these visual analytics systems, mainly developed by graduate students, intended to be used by different types of end users on the HPC site. In addition, we will discuss the importance of collaborative development involving the end users, and also the importance of technical people in the middle for assisting in the deployment and possible continuation of the developed systems.

Place, publisher, year, edition, pages
Goslar: Eurographics - European Association for Computer Graphics, 2023
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-208784 (URN)10.2312/visgap.20231116 (DOI)9783038682264 (ISBN)
Conference
VisGap - The Gap between Visualization Research and Visualization Software, Leipzig, Germany June 12, 2023
Available from: 2024-10-24 Created: 2024-10-24 Last updated: 2025-11-14Bibliographically approved
Fujiwara, T. (2023). ニューラルネットワークを用いた可視化 [Visualizations Using Neural Networks]. Journal of The Japan Society for Simulation Technology, 42(2), 83-88
Open this publication in new window or tab >>ニューラルネットワークを用いた可視化 [Visualizations Using Neural Networks]
2023 (Japanese)In: Journal of The Japan Society for Simulation Technology, Vol. 42, no 2, p. 83-88Article in journal (Refereed) Published
Keywords
Data Visualization, Deep Learning, Chart Recommendation, Network Layout, Dimensionality Reduction
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-208785 (URN)
Available from: 2024-10-24 Created: 2024-10-24 Last updated: 2024-12-20Bibliographically approved
Fujita, K., Sakamoto, N., Fujiwara, T., Tsukamoto, T. & Nonaka, J. (2022). A Visual Analytics Method for Time-Series Log Data Using Multiple Dimensionality Reduction. Journal of Advanced Simulation in Science and Engineering, 9(2), 206-219
Open this publication in new window or tab >>A Visual Analytics Method for Time-Series Log Data Using Multiple Dimensionality Reduction
Show others...
2022 (English)In: Journal of Advanced Simulation in Science and Engineering, E-ISSN 2188-5303, Vol. 9, no 2, p. 206-219Article in journal (Refereed) Published
Abstract [en]

The size and complexity of supercomputer systems and their power and cooling facilities have continuously increased, thus posing additional challenge for long-term and stable operation. Supercomputers are shared computational resources and usually operate with different computational workloads at different locations (space) and timings (time). Better understanding of the supercomputer systems heat generation and cooling behavior is highly desired from the facility operational side for decision making and optimization planning. In this work, we present a dimensionality reduction-based visual analytics method for time-series log data, from supercomputer system and its facility, to capture characteristic spatio-temporal features and behaviors during the operation.

Place, publisher, year, edition, pages
JAPAN SOC SIMULATION TECHNOLOGY-JSST, 2022
Keywords
Visual analytics; time-series log data; dimensionality reduction; high performance computing
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-187947 (URN)10.15748/jasse.9.206 (DOI)000842936000001 ()
Note

Funding: JSPS KAKENHI [20H04194, 21H04903]

Available from: 2022-08-31 Created: 2022-08-31 Last updated: 2023-09-19
Fujiwara, T., Zhao, J., Chen, F., Yu, Y. & Ma, K.-L. (2022). Network Comparison with Interpretable Contrastive Network Representation Learning. Journal of Data Science, Statistics, and Visualisation, 2(5)
Open this publication in new window or tab >>Network Comparison with Interpretable Contrastive Network Representation Learning
Show others...
2022 (English)In: Journal of Data Science, Statistics, and Visualisation, ISSN 2773-0689, Vol. 2, no 5Article in journal (Refereed) Published
Abstract [en]

Identifying unique characteristics in a network through comparison with another network is an essential network analysis task. For example, with networks of protein interactions obtained from normal and cancer tissues, we can discover unique types of interactions in cancer tissues. This analysis task could be greatly assisted by contrastive learning, which is an emerging analysis approach to discover salient patterns in one dataset relative to another. However, existing contrastive learning methods cannot be directly applied to networks as they are designed only for high-dimensional data analysis. To address this problem, we introduce a new analysis approach called contrastive network representation learning (cNRL). By integrating two machine learning schemes, network representation learning and contrastive learning, cNRL enables embedding of network nodes into a low-dimensional representation that reveals the uniqueness of one network compared to another. Within this approach, we also design a method, named i-cNRL, which offers interpretability in the learned results, allowing for understanding which specific patterns are only found in one network. We demonstrate the effectiveness of i-cNRL for network comparison with multiple network models and real-world datasets. Furthermore, we compare i-cNRL and other potential cNRL algorithm designs through quantitative and qualitative evaluations.

Place, publisher, year, edition, pages
International Association for Statistical Computing (IASC), 2022
Keywords
Keywords: contrastive learning, network representation learning, interpretability, network comparison, visualization
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-187950 (URN)10.52933/jdssv.v2i5.56 (DOI)
Available from: 2022-08-31 Created: 2022-08-31 Last updated: 2023-09-19Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-6382-2752

Search in DiVA

Show all publications