Emotion Related Structures in Large Image Databases
2010 (English)In: CIVR 2010: 2010 ACM International Conference on Image and Video Retrieval / [ed] Chunna Tian, New York, USA: The Association for Computing Machinery , 2010, 398-405 p.Conference paper (Refereed)
We introduce two large databases consisting of 750 000 and 1.2 million thumbnail-sized images, labeled with emotion-related keywords. The smaller database consists of images from Matton Images, an image provider. The larger database consists of web images that were indexed by the crawler of the image search engine Picsearch. The images in the Picsearch database belong to one of 98 emotion related categories and contain meta-data in the form of secondary keywords, the originating website and some view statistics. We use two psycho-physics related feature vectors based on the emotional impact of color combinations, the standard RGB-histogram and two SIFT-related descriptors to characterize the visual properties of the images. These features are then used in two-class classification experiments to explore the discrimination properties of emotion-related categories. The clustering software and the classifiers are available in the public domain, and the same standard configurations are used in all experiments. Our findings show that for emotional categories, descriptors based on global image statistics (global histograms) perform better than local image descriptors (bag-of-words models). This indicates that content-based indexing and retrieval using emotion-based approaches are fundamentally different from the dominant object- recognition based approaches for which SIFT-related features are the standard descriptors.
Place, publisher, year, edition, pages
New York, USA: The Association for Computing Machinery , 2010. 398-405 p.
Image databases, image indexing, emotions
Computer Vision and Robotics (Autonomous Systems)
IdentifiersURN: urn:nbn:se:liu:diva-57927DOI: 10.1145/1816041.1816099ISBN: 978-1-4503-0117-6OAI: oai:DiVA.org:liu-57927DiVA: diva2:329085
ACM International Conference on Image and Video Retrieval
ProjectsVisuella Världar, financed by the Knowledge Foundation, Sweden