Fusion of Acoustic and Optical Sensor Data for Automatic Fight Detection in Urban Environments
2010 (English)In: Information Fusion (FUSION), 2010 13th Conference on, IEEE conference proceedings, 2010, 1-8 p.Conference paper (Refereed)
We propose a two-stage method for detection of abnormal behaviours, such as aggression and fights in urban environment, which is applicable to operator support in surveillance applications. The proposed method is based on fusion of evidence from audio and optical sensors. In the first stage, a number of modalityspecific detectors perform recognition of low-level events. Their outputs act as input to the second stage, which performs fusion and disambiguation of the firststage detections. Experimental evaluation on scenes from the outdoor part of the PROMETHEUS database demonstrated the practical viability of the proposed approach. We report a fight detection rate of 81% when both audio and optical information are used. Reduced performance is observed when evidence from audio data is excluded from the fusion process. Finally, in the case when only evidence from one camera is used for detecting the fights, the recognition performance is poor.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2010. 1-8 p.
Abnormal behaviour detection, multiple sensor fusion, acoustic data, visual data, thermal imaging data, Hidden Markov Model
Computer Vision and Robotics (Autonomous Systems)
IdentifiersURN: urn:nbn:se:liu:diva-120525DOI: 10.1109/ICIF.2010.5712105ISBN: 978-0-9824438-1-1OAI: oai:DiVA.org:liu-120525DiVA: diva2:845916
13th International Conference on Information Fusion (FUSION), Edinburgh, Scotland, 26-29 July 2010