liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Machine Learning-Based Automated Vulnerability Classification in C/C++ Software: The Future of Automated Software Vulnerability Classification
Linköping University, Department of Computer and Information Science.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

The degree of impact caused by software vulnerabilities is escalating as software systems become increasingly integrated into the everyday lives of human beings. Different methods, such as static and dynamic analysis, are commonly used to classify software vulnerabilities. However, these methods are often plagued by certain limitations, including high false positive and false negative rates. It is crucial to examine C/C++ software vulnerabilities, as C/C++ is widely implemented in many industries and critical infrastructures, where software vulnerabilities could have catastrophic consequences if exploited by malicious actors. This thesis examines the feasibility of utilizing machine learning-based models for automated C/C++ software vulnerability classification. Additionally, the effect of hyperparameter tuning on the predictive performance of the utilized models is explored. The models investigated were divided into two main groups, namely, traditional machine learning models and transformer-based models. All models were trained, evaluated, and compared using a large and diverse C/C++ dataset. The findings suggest that autoregressive large language models, particularly Llama 2 and Code Llama utilizing a decoder-only transformer architecture, demonstrate significant potential for accurate C/C++ vulnerability classification, achieving F1-scores of 0.912 and 0.905, respectively. The results further indicate that hyperparameter tuning has a limited positive effect on predictive performance. Moreover, specific traditional machine learning models, like the SVM model, outperformed many of the transformer-based models, potentially indicating limitations in training procedures and the architectures of many pre-trained language models. Nevertheless, autoregressive large language models exhibit significant potential for precise C/C++ software vulnerability classification and should remain a focal point for future research.

Place, publisher, year, edition, pages
2024. , p. 52
Keywords [en]
Computer Science, Software Engineering, Machine Learning, Deep Learning, Natural Language Processing
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:liu:diva-204019ISRN: LIU-IDA/LITH-EX-A--24/030--SEOAI: oai:DiVA.org:liu-204019DiVA, id: diva2:1863755
External cooperation
Telefonaktiebolaget LM Ericsson
Subject / course
Computer science
Presentation
2024-05-29, Alan Turing, Olaus Magnus väg 37, Linköping, 13:15 (English)
Supervisors
Examiners
Available from: 2024-06-14 Created: 2024-05-31 Last updated: 2024-06-14Bibliographically approved

Open Access in DiVA

fulltext(909 kB)655 downloads
File information
File name FULLTEXT01.pdfFile size 909 kBChecksum SHA-512
832b0ab72a408545e357e1981784f1f9b63d4886a2ab3d529e1cc46ad9684ce830518c70626c2093270105334f36d6fb7eec95763c6268fba2966a172c66fcc8
Type fulltextMimetype application/pdf

By organisation
Department of Computer and Information Science
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 660 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 930 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf