Curious George: An Attentive Semantic Robot
2008 (English)In: Robotics and Autonomous Systems, ISSN 0921-8890, E-ISSN 0921-8830, Vol. 56, no 6, 503-511 p.Article in journal (Refereed) Published
State-of-the-art methods have recently achieved impressive performance for recognising the objects present in large databases of pre-collected images. There has been much less focus on building embodied systems that recognise objects present in the real world. This paper describes an intelligent system that attempts to perform robust object recognition in a realistic scenario, where a mobile robot moving through an environment must use the images collected from its camera directly to recognise objects. To perform successful recognition in this scenario, we have chosen a combination of techniques including a peripheral-foveal vision system, an attention system combining bottom-up visual saliency with structure from stereo, and a localisation and mapping technique. The result is a highly capable object recognition system that can be easily trained to locate the objects of interest in an environment, and subsequently build a spatial-semantic map of the region. This capability has been demonstrated during the Semantic Robot Vision Challenge, and is further illustrated with a demonstration of semantic mapping. We also empirically verify that the attention system outperforms an undirected approach even with a significantly lower number of foveations.
Place, publisher, year, edition, pages
2008. Vol. 56, no 6, 503-511 p.
Object recognition, Visual attention, Saliency, Semantic robot vision, Object permanence
Engineering and Technology
IdentifiersURN: urn:nbn:se:liu:diva-44893Local ID: 78156OAI: oai:DiVA.org:liu-44893DiVA: diva2:265755
This system won the SRVC Comptetition at the AAAI07 conference in Vancouver.2009-10-102009-10-102015-12-10Bibliographically approved