Low-Power UAV Detection Using Spiking Neural Networks and Event Cameras
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 28 HE credits
Student thesis
Abstract [en]
The growing availability of UAVs has created a demand for drone detection systems. Several studies have used neuromorphic cameras to detect UAVs; however, a fully neuromorphic system remains to be explored. We present a fully neuromorphic system consisting of an event camera and a spiking neural network running on neuromorphic hardware. Two spiking neural network architectures have been evaluated and compared to a non-spiking artificial neural network. The spiking networks show promise and perform on par with the non-spiking network in a few scenarios. Spiking networks were deployed on the Synsense Speck, a neuromorphic system on a chip, and demonstrated increased performance compared to simulations. The deployed network is capable of detecting drones up to a distance of 20 meters with high probability while consuming less than 7.13 milliwatts. The system can operate for over a year powered by a small power bank. In contrast, the equivalent non-spiking network running on the NVIDIA Jetson would operate for a few hours. The use of neuromorphic hardware enables sustained UAV detection in remote and challenging environments previously deemed inaccessible due to power constraints.
Place, publisher, year, edition, pages
2024.
Keywords [en]
Spiking neural network, drone, detection, uav, neuromorphic, event camera, DVS, synsense speck
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:liu:diva-204179ISRN: LiTH-ISY-EX--24/5647--SEOAI: oai:DiVA.org:liu-204179DiVA, id: diva2:1865924
External cooperation
Totalförsvarets forskningsinstitut
Subject / course
Computer Engineering
Presentation
2024-05-31, 15:00 (Swedish)
Supervisors
Examiners
2024-06-102024-06-052025-02-07Bibliographically approved