liu.seSearch for publications in DiVA
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction With Neural ODEs
Linköpings universitet, Institutionen för systemteknik, Fordonssystem. Linköpings universitet, Tekniska fakulteten.ORCID-id: 0000-0001-9075-7477
Linköpings universitet, Institutionen för datavetenskap, Statistik och maskininlärning. Linköpings universitet, Tekniska fakulteten.ORCID-id: 0000-0002-8201-0282
Linköpings universitet, Institutionen för systemteknik, Fordonssystem. Linköpings universitet, Tekniska fakulteten. Department of Automatic Control, Lund University, Sweden.ORCID-id: 0000-0003-1320-032X
Linköpings universitet, Institutionen för systemteknik, Fordonssystem. Linköpings universitet, Tekniska fakulteten.ORCID-id: 0000-0001-7349-1937
2023 (engelsk)Inngår i: IEEE Transactions on Intelligent Vehicles, ISSN 2379-8858, E-ISSN 2379-8904, Vol. 8, nr 9, s. 4223-4236Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Enabling resilient autonomous motion planning requires robust predictions of surrounding road users’ future behavior. In response to this need and the associated challenges, we introduce our model titled MTP-GO. The model encodes the scene using temporal graph neural networks to produce the inputs to an underlying motion model. The motion model is implemented using neural ordinary differential equations where the state-transition functions are learned with the rest of the model. Multimodal probabilistic predictions are obtained by combining the concept of mixture density networks and Kalman filtering. The results illustrate the predictive capabilities of the proposed model across various data sets, outperforming several state-of-the-art methods on a number of metrics.

sted, utgiver, år, opplag, sider
IEEE, 2023. Vol. 8, nr 9, s. 4223-4236
Emneord [en]
Predictive models;Trajectory;Computational modeling;Mathematical models;Data models;Roads;Behavioral sciences;Graph neural networks;neural ODEs;trajectory prediction
HSV kategori
Identifikatorer
URN: urn:nbn:se:liu:diva-203164DOI: 10.1109/TIV.2023.3282308Scopus ID: 2-s2.0-8516155373OAI: oai:DiVA.org:liu-203164DiVA, id: diva2:1855333
Merknad

Fundng agencies: the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), in part by the Swedish Research Council through the Project Handling Uncertainty in Machine Learning Systems under Grant 2020-04122, and in part by the Knutand Alice Wallenberg Foundation through Wallenberg AI, Autonomous Systemsand Software Program (WASP)

Tilgjengelig fra: 2024-04-30 Laget: 2024-04-30 Sist oppdatert: 2025-06-26
Inngår i avhandling
1. Data-Driven Interaction-Aware Behavior Prediction for Autonomous Vehicles
Åpne denne publikasjonen i ny fane eller vindu >>Data-Driven Interaction-Aware Behavior Prediction for Autonomous Vehicles
2023 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Future progress toward the realization of fully self-driving vehicles still re-quires human-level social compliance, arguably dependent on the ability to accurately forecast the behavior of surrounding road users. Due to the inter-connected nature of traffic participants, in which the actions of one agent can significantly influence the decisions of others, the development of behavior pre-diction methods is crucial for achieving resilient autonomous motion planning. As high-quality data sets become more widely available and many vehicles already possess significant computing power, the possibility of adopting a data-driven approach for motion prediction is increasing. 

The first contribution is the design of an intention-prediction model based on autoencoders for highway scenarios. Specifically, the method targets the problem of data imbalance in highway traffic data using ensemble methods and data-sampling techniques. The study shows that commonly disregarded information holds potential use for improved prediction performance and the importance of dealing with the data imbalance problem. 

The second contribution is the development of a probabilistic motion pre-diction framework. The framework is used to evaluate various graph neural network architectures for multi-agent prediction across various traffic scenarios. The graph neural network computes the inputs to an underlying motion model, parameterized using neural ordinary differential equations. The method additionally introduces a novel uncertainty propagation approach by combining Gaussian mixture modeling and extended Kalman filtering techniques. 

The third contribution is attributed to the investigation of combing data-driven models with motion modeling and methods for numerical integration. The study illustrates that improved prediction performance can be achieved by the inclusion of differential constraints in the model, but that the choice of motion model as well as numerical solver can have a large impact on the prediction performance. It is also shown that the added differential constraints improve extrapolation properties compared to complete black-box approaches. 

The thesis illustrates the potential of data-driven methods and their usability for the behavior prediction problem. Still, there are additional challenges and interesting questions to investigate—the main one being the investigation of their use in autonomous navigation frameworks. 

sted, utgiver, år, opplag, sider
Linköping: Linköping University Electronic Press, 2023. s. 38
Serie
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1960
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-193083 (URN)10.3384/9789180751797 (DOI)9789180751780 (ISBN)9789180751797 (ISBN)
Presentation
2023-05-12, Ada Lovelace, B-building, Campus Valla, Linköping, 10:15 (engelsk)
Opponent
Veileder
Merknad

Funding agencies: This research was supported by the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), and the Wallenberg AI, Autonomous Sys-tems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation.

Tilgjengelig fra: 2023-04-13 Laget: 2023-04-13 Sist oppdatert: 2024-04-30bibliografisk kontrollert
2. Context-Aware Behavior Prediction for Autonomous Driving
Åpne denne publikasjonen i ny fane eller vindu >>Context-Aware Behavior Prediction for Autonomous Driving
2024 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Autonomous vehicles (AVs) are set to transform transportation by providing safer, more efficient, and accessible mobility solutions. However, deploying AV systems requires designers to ensure these vehicles can navigate complex, dynamic traffic environments safely and precisely. A vital component of this capability is the ability to predict the behavior of surrounding road users, yet achieving reliable predictions is a complex task. This thesis investigates several challenges in trajectory and intention prediction for autonomous driving, focusing on contextual awareness, probabilistic modeling, and differential motion constraints.

A primary focus of this thesis is context awareness, which includes interaction-aware (agent-to-agent) and environment-aware (road-to-agent) modeling. Early approaches to context awareness involved manually crafting interaction features. While effective, these methods rely on predefined heuristics and often scale poorly as environmental complexity increases. To address these limitations, the thesis adopts a graph-based approach that offers greater flexibility and expressiveness. By constructing relational graphs, graph neural networks can be used to learn agent interactions and environmental context in a data-driven manner. The thesis proposes several context-aware models and provides an extensive evaluation of their mechanisms, highlighting their overall impact on prediction performance.

Another core theme of this thesis is addressing the inherent uncertainty and non-determinism of traffic environments. This involves creating models that provide probabilistic predictions. Given the multimodal nature of road-traffic agent behavior, it is also important to design methods that offer multiple candidate predictions for a single condition, enabling AVs to account for different possible future outcomes. This thesis proposes several context-aware frameworks that leverage probabilistic modeling, illustrating how ensemble methods, mixture density networks, and diffusion-based generative models can be adapted to provide uncertainty estimates and multimodal predictions.

While neural networks are well-suited for capturing the complex dynamics of traffic, they do not inherently ensure that outputs conform to physical laws, which poses risks in safety-critical applications. To address this, the thesis incorporates differential motion constraints into the prediction framework to ensure that predicted trajectories are accurate, physically feasible, and robust to noise. In addition to improving prediction accuracy, it is demonstrated how this integration enhances interpretation, extrapolation, and generalization capabilities.

The use of neural ordinary differential equations is a central component of this thesis, providing a data-driven approach to modeling the motion of agents—such as pedestrians—that are challenging to describe using physical laws or rule-based methods. The thesis investigates their application beyond motion prediction to a wide array of sequence modeling tasks, analyzing the effects of numerical integration techniques, stability regions, and initialization methods on model performance. A key contribution is the proposal of a stability-informed initialization (SII) technique, which significantly enhances model convergence, training stability, and prediction accuracy across various learning benchmarks.

sted, utgiver, år, opplag, sider
Linköping: Linköping University Electronic Press, 2024. s. 76
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2419
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-210214 (URN)10.3384/9789180758956 (DOI)9789180758949 (ISBN)9789180758956 (ISBN)
Disputas
2025-01-10, Ada Lovelace, B-building, Campus Valla, Linköping, 10:15 (engelsk)
Opponent
Veileder
Merknad

Funding: This research was supported by the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), and the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation.

Tilgjengelig fra: 2024-12-03 Laget: 2024-12-03 Sist oppdatert: 2025-02-09bibliografisk kontrollert
3. Modeling Spatio-Temporal Systems with Graph-based Machine Learning
Åpne denne publikasjonen i ny fane eller vindu >>Modeling Spatio-Temporal Systems with Graph-based Machine Learning
2025 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Most systems in the physical world are spatio-temporal in nature. The clouds move over our heads, vehicles travel on the roads and electricity is transmitted through vast spatial networks. Machine learning offers many opportunities to understand and forecast the evolution of these systems by making use of large amounts of collected data. However, building useful models of such systems requires taking both spatial and temporal correlations into account. We can not accurately forecast the weather in Linköping without knowing if there is hot air blowing in from the south. Similarly, we can not predict if a vehicle is about to make a left turn without knowing its position and velocity relative to other vehicles on the road. This thesis proposes a set of methods for accurately capturing such spatio-temporal dependencies in machine learning models. 

At the core of the thesis is the idea of using graphs as a way to represent the spatial relationships in spatio-temporal systems. Graphs offer a highly flexible framework for this purpose, in particular for situations where observation locations do not lie on a regular spatial grid. Throughout the thesis, spatial graphs are constructed by letting nodes correspond to spatial locations and edges the relationships between them. These graphs are then used to construct different machine learning models, including graph neural networks and probabilistic graphical models. Combining such graph-based components with machine learning methods for time series modeling then allows for capturing the full spatio-temporal structure of the data. 

The main contribution of the thesis lies in exploring a number of methods using graph-based modeling for spatio-temporal data. This includes extending temporal graph neural networks to handle data observed irregularly over time. Temporal graph neural networks are also used to develop a model for vehicle trajectory forecasting, where the edges of the graph correspond to interactions between traffic agents. The thesis additionally includes work on Bayesian modeling, where a connection between Gaussian Markov random fields and graph neural networks allows for building scalable probabilistic models for data defined using graphs. 

A motivation for the methods developed in this thesis is the increasing use of machine learning in earth science. Capturing relevant spatio-temporal relationships is central for building useful models of the earth system. The thesis includes numerous experiments making use of weather and climate data, as well as application-driven work specifically targeting weather forecasting. Recent years have seen rapid progress in using machine learning models for weather forecasting, and the thesis makes multiple contributions in this direction. A probabilistic weather forecasting model is developed by combining graph-based methods with a latent variable formulation. Lastly, machine learning limited area models are also explored, where graph neural networks are used for regional weather forecasting.   

sted, utgiver, år, opplag, sider
Linköping: Linköping University Electronic Press, 2025. s. 97
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2453
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-215665 (URN)10.3384/9789181181173 (DOI)9789181181166 (ISBN)9789181181173 (ISBN)
Disputas
2025-08-22, Ada Lovelace, B-huset, Campus Valla, Linköping, 13:15
Opponent
Veileder
Forskningsfinansiär
Swedish Research Council, 2020-04122; 2024-05011Wallenberg AI, Autonomous Systems and Software Program (WASP)ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Tilgjengelig fra: 2025-06-26 Laget: 2025-06-26 Sist oppdatert: 2025-08-13bibliografisk kontrollert

Open Access i DiVA

fulltext(4243 kB)399 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 4243 kBChecksum SHA-512
0765e03764b9a292f2795b7f36f7837f68e6666a8dd5fba461aba25e906cc6deddabb1f5450000db6bca1e313ee236ce7f5a6be85c0be6b76494c801c1150020
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstScopus

Person

Westny, TheodorOskarsson, JoelOlofsson, BjörnFrisk, Erik

Søk i DiVA

Av forfatter/redaktør
Westny, TheodorOskarsson, JoelOlofsson, BjörnFrisk, Erik
Av organisasjonen
I samme tidsskrift
IEEE Transactions on Intelligent Vehicles

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 400 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 406 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf