liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Data-Driven Interaction-Aware Behavior Prediction for Autonomous Vehicles
Linköping University, Department of Electrical Engineering, Vehicular Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0001-9075-7477
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Future progress toward the realization of fully self-driving vehicles still re-quires human-level social compliance, arguably dependent on the ability to accurately forecast the behavior of surrounding road users. Due to the inter-connected nature of traffic participants, in which the actions of one agent can significantly influence the decisions of others, the development of behavior pre-diction methods is crucial for achieving resilient autonomous motion planning. As high-quality data sets become more widely available and many vehicles already possess significant computing power, the possibility of adopting a data-driven approach for motion prediction is increasing. 

The first contribution is the design of an intention-prediction model based on autoencoders for highway scenarios. Specifically, the method targets the problem of data imbalance in highway traffic data using ensemble methods and data-sampling techniques. The study shows that commonly disregarded information holds potential use for improved prediction performance and the importance of dealing with the data imbalance problem. 

The second contribution is the development of a probabilistic motion pre-diction framework. The framework is used to evaluate various graph neural network architectures for multi-agent prediction across various traffic scenarios. The graph neural network computes the inputs to an underlying motion model, parameterized using neural ordinary differential equations. The method additionally introduces a novel uncertainty propagation approach by combining Gaussian mixture modeling and extended Kalman filtering techniques. 

The third contribution is attributed to the investigation of combing data-driven models with motion modeling and methods for numerical integration. The study illustrates that improved prediction performance can be achieved by the inclusion of differential constraints in the model, but that the choice of motion model as well as numerical solver can have a large impact on the prediction performance. It is also shown that the added differential constraints improve extrapolation properties compared to complete black-box approaches. 

The thesis illustrates the potential of data-driven methods and their usability for the behavior prediction problem. Still, there are additional challenges and interesting questions to investigate—the main one being the investigation of their use in autonomous navigation frameworks. 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. , p. 38
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1960
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:liu:diva-193083DOI: 10.3384/9789180751797ISBN: 9789180751780 (print)ISBN: 9789180751797 (electronic)OAI: oai:DiVA.org:liu-193083DiVA, id: diva2:1750366
Presentation
2023-05-12, Ada Lovelace, B-building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Note

Funding agencies: This research was supported by the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), and the Wallenberg AI, Autonomous Sys-tems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation.

Available from: 2023-04-13 Created: 2023-04-13 Last updated: 2024-04-30Bibliographically approved
List of papers
1. Vehicle Behavior Prediction and Generalization Using Imbalanced Learning Techniques
Open this publication in new window or tab >>Vehicle Behavior Prediction and Generalization Using Imbalanced Learning Techniques
2021 (English)In: 24th IEEE International Intelligent Transportation Systems Conference (ITSC), 19-22 Sept. 2021, Institute of Electrical and Electronics Engineers (IEEE), 2021, p. 2003-2010Conference paper, Published paper (Refereed)
Abstract [en]

The use of learning-based methods for vehicle behavior prediction is a promising research topic. However, many publicly available data sets suffer from class distribution skews which limits learning performance if not addressed. This paper proposes an interaction-aware prediction model consisting of an LSTM autoencoder and SVM classifier. Additionally, an imbalanced learning technique, the multiclass balancing ensemble is proposed. Evaluations show that the method enhances model performance, resulting in improved classification accuracy. Good generalization properties of learned models are important and therefore a generalization study is done where models are evaluated on unseen traffic data with dissimilar traffic behavior stemming from different road configurations. This is realized by using two distinct highway traffic recordings, the publicly available NGSIM US-101 and I80 data sets. Moreover, methods for encoding structural and static features into the learning process for improved generalization are evaluated. The resulting methods show substantial improvements in classification as well as generalization performance.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021
Keywords
Behavior Prediction, Machine Learning, Autonomous Vehicles, Robotics
National Category
Computer Sciences Robotics and automation
Identifiers
urn:nbn:se:liu:diva-180481 (URN)10.1109/ITSC48978.2021.9564948 (DOI)000841862502003 ()2-s2.0-85118442722 (Scopus ID)9781728191423 (ISBN)9781728191430 (ISBN)
Conference
IEEE International Conference on Intelligent Transportation Systems - ITSC2021, Indianapolis, IN, USA, 19-22 Sept. 2021
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications, 101456
Note

Funding: Strategic Reseach Area at Linkoping-Lund in Information Technology (ELLIIT); Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2022-01-19 Created: 2022-01-19 Last updated: 2025-02-05
2. MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction With Neural ODEs
Open this publication in new window or tab >>MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction With Neural ODEs
2023 (English)In: IEEE Transactions on Intelligent Vehicles, ISSN 2379-8858, E-ISSN 2379-8904, Vol. 8, no 9, p. 4223-4236Article in journal (Refereed) Published
Abstract [en]

Enabling resilient autonomous motion planning requires robust predictions of surrounding road users’ future behavior. In response to this need and the associated challenges, we introduce our model titled MTP-GO. The model encodes the scene using temporal graph neural networks to produce the inputs to an underlying motion model. The motion model is implemented using neural ordinary differential equations where the state-transition functions are learned with the rest of the model. Multimodal probabilistic predictions are obtained by combining the concept of mixture density networks and Kalman filtering. The results illustrate the predictive capabilities of the proposed model across various data sets, outperforming several state-of-the-art methods on a number of metrics.

Place, publisher, year, edition, pages
IEEE, 2023
Keywords
Predictive models;Trajectory;Computational modeling;Mathematical models;Data models;Roads;Behavioral sciences;Graph neural networks;neural ODEs;trajectory prediction
National Category
Computer graphics and computer vision
Identifiers
urn:nbn:se:liu:diva-203164 (URN)10.1109/TIV.2023.3282308 (DOI)2-s2.0-8516155373 (Scopus ID)
Note

Fundng agencies: the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), in part by the Swedish Research Council through the Project Handling Uncertainty in Machine Learning Systems under Grant 2020-04122, and in part by the Knutand Alice Wallenberg Foundation through Wallenberg AI, Autonomous Systemsand Software Program (WASP)

Available from: 2024-04-30 Created: 2024-04-30 Last updated: 2025-06-26
3. Evaluation of Differentially Constrained Motion Models for Graph-Based Trajectory Prediction
Open this publication in new window or tab >>Evaluation of Differentially Constrained Motion Models for Graph-Based Trajectory Prediction
(English)Manuscript (preprint) (Other academic)
Abstract [en]

 Given their adaptability and encouraging performance, deep-learning models are becoming standard for motion prediction in autonomous driving. However, with great flexibility comes a lack of interpretability and possible violations of physical constraints.  Accompanying these data-driven methods with differentially-constrained motion models to provide physically feasible trajectories is a promising future direction. The foundation for this work is a previously introduced graph-neural-network-based model, MTP-GO.  The neural network learns to compute the inputs to an underlying motion model to provide physically feasible trajectories. This research investigates the performance of various motion models in combination with numerical solvers for the prediction task. The study shows that simpler models, such as low-order integrator models, are preferred over more complex ones, e.g., kinematic models, to achieve accurate predictions. Further, the numerical solver can have a substantial impact on performance, advising against commonly used first-order methods like Euler forward. Instead, a second-order method like Heun's can significantly improve predictions.

National Category
Computer graphics and computer vision
Identifiers
urn:nbn:se:liu:diva-193061 (URN)
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile CommunicationsWallenberg AI, Autonomous Systems and Software Program (WASP)
Available from: 2023-04-12 Created: 2023-04-12 Last updated: 2025-02-07

Open Access in DiVA

fulltext(6187 kB)1166 downloads
File information
File name FULLTEXT01.pdfFile size 6187 kBChecksum SHA-512
2d8ee3ec3883109c17b75d317525246667d4d6f3b066451d18db94652a7a0ef053969e3bc1cdf7034792803151fae2f4edd20f5c072d19bc6edc83697ce5414d
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Authority records

Westny, Theodor

Search in DiVA

By author/editor
Westny, Theodor
By organisation
Vehicular SystemsFaculty of Science & Engineering
Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 1168 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1751 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf