liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Temporal Graph Neural Networks for Irregular Data
Linköping University, Department of Computer and Information Science, The Division of Statistics and Machine Learning. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-8201-0282
Linköping University, Department of Computer and Information Science, The Division of Statistics and Machine Learning. Linköping University, Faculty of Science & Engineering. Qualcomm Technologies, Sweden.
Linköping University, Department of Computer and Information Science, The Division of Statistics and Machine Learning. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0003-3749-5820
2023 (English)In: Proceedings of The 26th International Conference on Artificial Intelligence and Statistics / [ed] Francisco Ruiz, Jennifer Dy, Jan-Willem van de Meent, ML Research Press , 2023, Vol. 206, p. 4515-4531Conference paper, Published paper (Refereed)
Abstract [en]

This paper proposes a temporal graph neural network model for forecasting of graph-structured irregularly observed time series. Our TGNN4I model is designed to handle both irregular time steps and partial observations of the graph. This is achieved by introducing a time-continuous latent state in each node, following a linear Ordinary Differential Equation (ODE) defined by the output of a Gated Recurrent Unit (GRU). The ODE has an explicit solution as a combination of exponential decay and periodic dynamics. Observations in the graph neighborhood are taken into account by integrating graph neural network layers in both the GRU state update and predictive model. The time-continuous dynamics additionally enable the model to make predictions at arbitrary time steps. We propose a loss function that leverages this and allows for training the model for forecasting over different time horizons. Experiments on simulated data and real-world data from traffic and climate modeling validate the usefulness of both the graph structure and time-continuous dynamics in settings with irregular observations. 

Place, publisher, year, edition, pages
ML Research Press , 2023. Vol. 206, p. 4515-4531
Series
Proceedings of Machine Learning Research, ISSN 2640-3498
Keywords [en]
machine learning, graph, graph neural network, irregular data, time-continuous
National Category
Other Computer and Information Science
Identifiers
URN: urn:nbn:se:liu:diva-193682ISI: 001222727704032Scopus ID: 2-s2.0-85165169181OAI: oai:DiVA.org:liu-193682DiVA, id: diva2:1756610
Conference
The 26th International Conference on Artificial Intelligence and Statistics (AISTATS), Valencia, Spain, 2023
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile CommunicationsWallenberg AI, Autonomous Systems and Software Program (WASP)Swedish Research Council, 2020-04122Available from: 2023-05-12 Created: 2023-05-12 Last updated: 2025-06-26Bibliographically approved
In thesis
1. Modeling Spatio-Temporal Systems with Graph-based Machine Learning
Open this publication in new window or tab >>Modeling Spatio-Temporal Systems with Graph-based Machine Learning
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Most systems in the physical world are spatio-temporal in nature. The clouds move over our heads, vehicles travel on the roads and electricity is transmitted through vast spatial networks. Machine learning offers many opportunities to understand and forecast the evolution of these systems by making use of large amounts of collected data. However, building useful models of such systems requires taking both spatial and temporal correlations into account. We can not accurately forecast the weather in Linköping without knowing if there is hot air blowing in from the south. Similarly, we can not predict if a vehicle is about to make a left turn without knowing its position and velocity relative to other vehicles on the road. This thesis proposes a set of methods for accurately capturing such spatio-temporal dependencies in machine learning models. 

At the core of the thesis is the idea of using graphs as a way to represent the spatial relationships in spatio-temporal systems. Graphs offer a highly flexible framework for this purpose, in particular for situations where observation locations do not lie on a regular spatial grid. Throughout the thesis, spatial graphs are constructed by letting nodes correspond to spatial locations and edges the relationships between them. These graphs are then used to construct different machine learning models, including graph neural networks and probabilistic graphical models. Combining such graph-based components with machine learning methods for time series modeling then allows for capturing the full spatio-temporal structure of the data. 

The main contribution of the thesis lies in exploring a number of methods using graph-based modeling for spatio-temporal data. This includes extending temporal graph neural networks to handle data observed irregularly over time. Temporal graph neural networks are also used to develop a model for vehicle trajectory forecasting, where the edges of the graph correspond to interactions between traffic agents. The thesis additionally includes work on Bayesian modeling, where a connection between Gaussian Markov random fields and graph neural networks allows for building scalable probabilistic models for data defined using graphs. 

A motivation for the methods developed in this thesis is the increasing use of machine learning in earth science. Capturing relevant spatio-temporal relationships is central for building useful models of the earth system. The thesis includes numerous experiments making use of weather and climate data, as well as application-driven work specifically targeting weather forecasting. Recent years have seen rapid progress in using machine learning models for weather forecasting, and the thesis makes multiple contributions in this direction. A probabilistic weather forecasting model is developed by combining graph-based methods with a latent variable formulation. Lastly, machine learning limited area models are also explored, where graph neural networks are used for regional weather forecasting.   

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2025. p. 97
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2453
National Category
Computer Sciences Meteorology and Atmospheric Sciences
Identifiers
urn:nbn:se:liu:diva-215665 (URN)10.3384/9789181181173 (DOI)9789181181166 (ISBN)9789181181173 (ISBN)
Public defence
2025-08-22, Ada Lovelace, B-huset, Campus Valla, Linköping, 13:15
Opponent
Supervisors
Funder
Swedish Research Council, 2020-04122; 2024-05011Wallenberg AI, Autonomous Systems and Software Program (WASP)ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Available from: 2025-06-26 Created: 2025-06-26 Last updated: 2025-06-26Bibliographically approved

Open Access in DiVA

fulltext(653 kB)58 downloads
File information
File name FULLTEXT01.pdfFile size 653 kBChecksum SHA-512
4cea8a42bb54a037103804946605150c5eb56b978f3da14f607c88447fcc2e6b162eeef9dbd55fc02fa003fa5ed012af9b8600586fb42223274f165aa94975cb
Type fulltextMimetype application/pdf

Other links

ScopusPublisher's full text

Authority records

Oskarsson, JoelSidén, PerLindsten, Fredrik

Search in DiVA

By author/editor
Oskarsson, JoelSidén, PerLindsten, Fredrik
By organisation
The Division of Statistics and Machine LearningFaculty of Science & Engineering
Other Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 58 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 243 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf