liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Vehicle Behavior Prediction and Generalization Using Imbalanced Learning Techniques
Linköping University, Department of Electrical Engineering, Vehicular Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0001-9075-7477
Linköping University, Department of Electrical Engineering, Vehicular Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0001-7349-1937
Linköping University, Department of Electrical Engineering, Vehicular Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0003-1320-032x
2021 (English)In: 24th IEEE International Intelligent Transportation Systems Conference (ITSC), 19-22 Sept. 2021, Institute of Electrical and Electronics Engineers (IEEE), 2021, p. 2003-2010Conference paper, Published paper (Refereed)
Abstract [en]

The use of learning-based methods for vehicle behavior prediction is a promising research topic. However, many publicly available data sets suffer from class distribution skews which limits learning performance if not addressed. This paper proposes an interaction-aware prediction model consisting of an LSTM autoencoder and SVM classifier. Additionally, an imbalanced learning technique, the multiclass balancing ensemble is proposed. Evaluations show that the method enhances model performance, resulting in improved classification accuracy. Good generalization properties of learned models are important and therefore a generalization study is done where models are evaluated on unseen traffic data with dissimilar traffic behavior stemming from different road configurations. This is realized by using two distinct highway traffic recordings, the publicly available NGSIM US-101 and I80 data sets. Moreover, methods for encoding structural and static features into the learning process for improved generalization are evaluated. The resulting methods show substantial improvements in classification as well as generalization performance.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021. p. 2003-2010
Keywords [en]
Behavior Prediction, Machine Learning, Autonomous Vehicles, Robotics
National Category
Computer Sciences Robotics and automation
Identifiers
URN: urn:nbn:se:liu:diva-180481DOI: 10.1109/ITSC48978.2021.9564948ISI: 000841862502003Scopus ID: 2-s2.0-85118442722ISBN: 9781728191423 (electronic)ISBN: 9781728191430 (print)OAI: oai:DiVA.org:liu-180481DiVA, id: diva2:1630101
Conference
IEEE International Conference on Intelligent Transportation Systems - ITSC2021, Indianapolis, IN, USA, 19-22 Sept. 2021
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications, 101456
Note

Funding: Strategic Reseach Area at Linkoping-Lund in Information Technology (ELLIIT); Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2022-01-19 Created: 2022-01-19 Last updated: 2025-02-05
In thesis
1. Data-Driven Interaction-Aware Behavior Prediction for Autonomous Vehicles
Open this publication in new window or tab >>Data-Driven Interaction-Aware Behavior Prediction for Autonomous Vehicles
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Future progress toward the realization of fully self-driving vehicles still re-quires human-level social compliance, arguably dependent on the ability to accurately forecast the behavior of surrounding road users. Due to the inter-connected nature of traffic participants, in which the actions of one agent can significantly influence the decisions of others, the development of behavior pre-diction methods is crucial for achieving resilient autonomous motion planning. As high-quality data sets become more widely available and many vehicles already possess significant computing power, the possibility of adopting a data-driven approach for motion prediction is increasing. 

The first contribution is the design of an intention-prediction model based on autoencoders for highway scenarios. Specifically, the method targets the problem of data imbalance in highway traffic data using ensemble methods and data-sampling techniques. The study shows that commonly disregarded information holds potential use for improved prediction performance and the importance of dealing with the data imbalance problem. 

The second contribution is the development of a probabilistic motion pre-diction framework. The framework is used to evaluate various graph neural network architectures for multi-agent prediction across various traffic scenarios. The graph neural network computes the inputs to an underlying motion model, parameterized using neural ordinary differential equations. The method additionally introduces a novel uncertainty propagation approach by combining Gaussian mixture modeling and extended Kalman filtering techniques. 

The third contribution is attributed to the investigation of combing data-driven models with motion modeling and methods for numerical integration. The study illustrates that improved prediction performance can be achieved by the inclusion of differential constraints in the model, but that the choice of motion model as well as numerical solver can have a large impact on the prediction performance. It is also shown that the added differential constraints improve extrapolation properties compared to complete black-box approaches. 

The thesis illustrates the potential of data-driven methods and their usability for the behavior prediction problem. Still, there are additional challenges and interesting questions to investigate—the main one being the investigation of their use in autonomous navigation frameworks. 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. p. 38
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1960
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:liu:diva-193083 (URN)10.3384/9789180751797 (DOI)9789180751780 (ISBN)9789180751797 (ISBN)
Presentation
2023-05-12, Ada Lovelace, B-building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Note

Funding agencies: This research was supported by the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), and the Wallenberg AI, Autonomous Sys-tems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation.

Available from: 2023-04-13 Created: 2023-04-13 Last updated: 2024-04-30Bibliographically approved
2. Context-Aware Behavior Prediction for Autonomous Driving
Open this publication in new window or tab >>Context-Aware Behavior Prediction for Autonomous Driving
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Autonomous vehicles (AVs) are set to transform transportation by providing safer, more efficient, and accessible mobility solutions. However, deploying AV systems requires designers to ensure these vehicles can navigate complex, dynamic traffic environments safely and precisely. A vital component of this capability is the ability to predict the behavior of surrounding road users, yet achieving reliable predictions is a complex task. This thesis investigates several challenges in trajectory and intention prediction for autonomous driving, focusing on contextual awareness, probabilistic modeling, and differential motion constraints.

A primary focus of this thesis is context awareness, which includes interaction-aware (agent-to-agent) and environment-aware (road-to-agent) modeling. Early approaches to context awareness involved manually crafting interaction features. While effective, these methods rely on predefined heuristics and often scale poorly as environmental complexity increases. To address these limitations, the thesis adopts a graph-based approach that offers greater flexibility and expressiveness. By constructing relational graphs, graph neural networks can be used to learn agent interactions and environmental context in a data-driven manner. The thesis proposes several context-aware models and provides an extensive evaluation of their mechanisms, highlighting their overall impact on prediction performance.

Another core theme of this thesis is addressing the inherent uncertainty and non-determinism of traffic environments. This involves creating models that provide probabilistic predictions. Given the multimodal nature of road-traffic agent behavior, it is also important to design methods that offer multiple candidate predictions for a single condition, enabling AVs to account for different possible future outcomes. This thesis proposes several context-aware frameworks that leverage probabilistic modeling, illustrating how ensemble methods, mixture density networks, and diffusion-based generative models can be adapted to provide uncertainty estimates and multimodal predictions.

While neural networks are well-suited for capturing the complex dynamics of traffic, they do not inherently ensure that outputs conform to physical laws, which poses risks in safety-critical applications. To address this, the thesis incorporates differential motion constraints into the prediction framework to ensure that predicted trajectories are accurate, physically feasible, and robust to noise. In addition to improving prediction accuracy, it is demonstrated how this integration enhances interpretation, extrapolation, and generalization capabilities.

The use of neural ordinary differential equations is a central component of this thesis, providing a data-driven approach to modeling the motion of agents—such as pedestrians—that are challenging to describe using physical laws or rule-based methods. The thesis investigates their application beyond motion prediction to a wide array of sequence modeling tasks, analyzing the effects of numerical integration techniques, stability regions, and initialization methods on model performance. A key contribution is the proposal of a stability-informed initialization (SII) technique, which significantly enhances model convergence, training stability, and prediction accuracy across various learning benchmarks.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2024. p. 76
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2419
National Category
Robotics and automation
Identifiers
urn:nbn:se:liu:diva-210214 (URN)10.3384/9789180758956 (DOI)9789180758949 (ISBN)9789180758956 (ISBN)
Public defence
2025-01-10, Ada Lovelace, B-building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Note

Funding: This research was supported by the Strategic Research Area at Linköping-Lund in Information Technology (ELLIIT), and the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation.

Available from: 2024-12-03 Created: 2024-12-03 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

fulltext(578 kB)411 downloads
File information
File name FULLTEXT02.pdfFile size 578 kBChecksum SHA-512
947fbf4a6252b21dd41d3c1874319a04b0f7a6bfe0eed08aeffdb36d8f42ead573e0cd0e488bcfc43477d427eb2958f8a7bbb015d9e39cb6c7192b8cc80e4041
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopusArxiv

Authority records

Westny, TheodorFrisk, ErikOlofsson, Björn

Search in DiVA

By author/editor
Westny, TheodorFrisk, ErikOlofsson, Björn
By organisation
Vehicular SystemsFaculty of Science & Engineering
Computer SciencesRobotics and automation

Search outside of DiVA

GoogleGoogle Scholar
Total: 411 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 571 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf