liu.seSearch for publications in DiVA
Change search
ReferencesLink to record
Permanent link

Direct link
Embodied Object Recognition using Adaptive Target Observations
Linköping University, Department of Electrical Engineering. Linköping University, The Institute of Technology.
Linköping University, Department of Electrical Engineering, Computer Vision. Linköping University, The Institute of Technology.ORCID iD: 0000-0002-5698-5983
2010 (English)In: Cognitive Computation, ISSN 1866-9964, Vol. 2, no 4, 316-325 p.Article in journal (Refereed) Published
Abstract [en]

In this paper, we study object recognition in the embodied setting. More specifically, we study the problem of whether the recognition system will benefit from acquiring another observation of the object under study, or whether it is time to give up, and report the observed object as unknown. We describe the hardware and software of a system that implements recognition and object permanence as two nested perception-action cycles. We have collected three data sets of observation sequences that allow us to perform controlled evaluation of the system behavior. Our recognition system uses a KNN classifier with bag-of-features prototypes. For this classifier, we have designed and compared three different uncertainty measures for target observation. These measures allow the system to (a) decide whether to continue to observe an object or to move on, and to (b) decide whether the observed object is previously seen or novel. The system is able to successfully reject all novel objects as “unknown”, while still recognizing most of the previously seen objects.

Place, publisher, year, edition, pages
Springer , 2010. Vol. 2, no 4, 316-325 p.
Keyword [en]
Object recognition - Attention - Visual search - Fixation - Object permanence
National Category
Engineering and Technology
URN: urn:nbn:se:liu:diva-63344DOI: 10.1007/s12559-010-9079-7OAI: diva2:378735
The original publication is available at Marcus Wallenberg and Per-Erik Forssén, Embodied Object Recognition using Adaptive Target Observations, 2010, Cognitive Computation, (2), 4, 316-325. Copyright: Springer Science Business Media Available from: 2010-12-16 Created: 2010-12-16 Last updated: 2015-12-10
In thesis
1. Components of Embodied Visual Object Recognition: Object Perception and Learning on a Robotic Platform
Open this publication in new window or tab >>Components of Embodied Visual Object Recognition: Object Perception and Learning on a Robotic Platform
2013 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Object recognition is a skill we as humans often take for granted. Due to our formidable object learning, recognition and generalisation skills, it is sometimes hard to see the multitude of obstacles that need to be overcome in order to replicate this skill in an artificial system. Object recognition is also one of the classical areas of computer vision, and many ways of approaching the problem have been proposed. Recently, visually capable robots and autonomous vehicles have increased the focus on embodied recognition systems and active visual search. These applications demand that systems can learn and adapt to their surroundings, and arrive at decisions in a reasonable amount of time, while maintaining high object recognition performance. Active visual search also means that mechanisms for attention and gaze control are integral to the object recognition procedure. This thesis describes work done on the components necessary for creating an embodied recognition system, specifically in the areas of decision uncertainty estimation, object segmentation from multiple cues, adaptation of stereo vision to a specific platform and setting, and the implementation of the system itself. Contributions include the evaluation of methods and measures for predicting the potential uncertainty reduction that can be obtained from additional views of an object, allowing for adaptive target observations. Also, in order to separate a specific object from other parts of a scene, it is often necessary to combine multiple cues such as colour and depth in order to obtain satisfactory results. Therefore, a method for combining these using channel coding has been evaluated. Finally, in order to make use of three-dimensional spatial structure in recognition, a novel stereo vision algorithm extension along with a framework for automatic stereo tuning have also been investigated. All of these components have been tested and evaluated on a purpose-built embodied recognition platform known as Eddie the Embodied.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2013. 64 p.
Linköping Studies in Science and Technology. Thesis, ISSN 0280-7971 ; 1607
computer vision, object recognition, stereo vision, classification
National Category
Signal Processing Computer Vision and Robotics (Autonomous Systems)
urn:nbn:se:liu:diva-93812 (URN)978-91-7519-564-3 (print) (ISBN)
2013-08-16, Visionen, Hus B, Campus Valla, Linköpings universitet, Linköping, 13:15 (English)
Embodied Visual Object Recognition
Swedish Research Council
Available from: 2013-07-09 Created: 2013-06-10 Last updated: 2015-12-10Bibliographically approved

Open Access in DiVA

fulltext(511 kB)298 downloads
File information
File name FULLTEXT01.pdfFile size 511 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Wallenberg, MarcusForssén, Per-Erik
By organisation
Department of Electrical EngineeringThe Institute of TechnologyComputer Vision
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 298 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 295 hits
ReferencesLink to record
Permanent link

Direct link