liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Finding Balance in Neural Architecture Search: Towards Optimal and Resource-Efficient Task Branching in Multi-Task Networks
Linköping University, Department of Electrical Engineering, Computer Vision.
Linköping University, Department of Electrical Engineering, Computer Vision.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 28 HE creditsStudent thesis
Abstract [en]

Similar to how we humans use prior knowledge from one skill when learning new ones, multi-task networks can leverage similarities between different tasks to enhance learning speed. By acknowledging and leveraging common features across tasks, multi-task networks can be more efficient when learning and are able to generalize better. However, due to the technological advancements in deep learning, the modern architecture of such networks can be highly complex and vary significantly, so finding an optimal architecture is far from trivial. To handle this problem, we have utilized different methods to limit the search space and find the suitable architectural designs given a varying number of tasks. Through a comprehensive analysis of neural network structures and loss weighting strategies, the thesis contributes valuable insights into achieving a suitable trade-off between resource usage and task performance, paving the way for more effective and resource-conscious multi-task network designs.

Place, publisher, year, edition, pages
2024. , p. 38
Series
LiTH-ISY-EX--24/5650--SE
Keywords [en]
computer vision, multi-task learning, machine learning, neural architecture search, BMTAS, Shapley-NAS
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:liu:diva-205900OAI: oai:DiVA.org:liu-205900DiVA, id: diva2:1883281
External cooperation
Qualcomm
Subject / course
Computer Vision Laboratory
Presentation
2024-06-03, Transformen, Olaus Magnus väg, 583 30, Linköping, 10:15 (English)
Supervisors
Examiners
Available from: 2024-07-11 Created: 2024-07-09 Last updated: 2025-02-07Bibliographically approved

Open Access in DiVA

fulltext(7405 kB)373 downloads
File information
File name FULLTEXT01.pdfFile size 7405 kBChecksum SHA-512
5ae322a012c226421e8c0efd1a1bf6ca915e8d3e5f62617ca38afcd281b8977929101925136a5e4f0259dd65fd680f14b11a028af7f592fda2d9dbdfe8c63faf
Type fulltextMimetype application/pdf

By organisation
Computer Vision
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar
Total: 376 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 477 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf