liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Structure and Motion Estimation from Rolling Shutter Video
Linköpings universitet, Institutionen för systemteknik, Datorseende. Linköpings universitet, Tekniska högskolan.
Linköpings universitet, Institutionen för systemteknik, Datorseende. Linköpings universitet, Tekniska högskolan.
Linköpings universitet, Institutionen för systemteknik, Datorseende. Linköpings universitet, Tekniska högskolan.ORCID-id: 0000-0002-5698-5983
Linköpings universitet, Institutionen för systemteknik, Datorseende. Linköpings universitet, Tekniska högskolan.ORCID-id: 0000-0002-6096-3648
2011 (Engelska)Ingår i: IEEE International Conference onComputer Vision Workshops (ICCV Workshops), 2011, IEEE Xplore , 2011, s. 17-23Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

The majority of consumer quality cameras sold today have CMOS sensors with rolling shutters. In a rolling shutter camera, images are read out row by row, and thus each row is exposed during a different time interval. A rolling-shutter exposure causes geometric image distortions when either the camera or the scene is moving, and this causes state-of-the-art structure and motion algorithms to fail. We demonstrate a novel method for solving the structure and motion problem for rolling-shutter video. The method relies on exploiting the continuity of the camera motion, both between frames, and across a frame. We demonstrate the effectiveness of our method by controlled experiments on real video sequences. We show, both visually and quantitatively, that our method outperforms standard structure and motion, and is more accurate and efficient than a two-step approach, doing image rectification and structure and motion.

Ort, förlag, år, upplaga, sidor
IEEE Xplore , 2011. s. 17-23
Nyckelord [en]
Structure and Motion, Rolling Shutter, Bundel Adjustment
Nationell ämneskategori
Datorseende och robotik (autonoma system)
Identifikatorer
URN: urn:nbn:se:liu:diva-75258DOI: 10.1109/ICCVW.2011.6130217ISBN: 978-1-4673-0062-9 (tryckt)OAI: oai:DiVA.org:liu-75258DiVA, id: diva2:505440
Konferens
2nd IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011,6-13 November,Barcelona, Spain
Tillgänglig från: 2012-03-01 Skapad: 2012-02-23 Senast uppdaterad: 2018-01-12Bibliografiskt granskad
Ingår i avhandling
1. Motion and Structure Estimation From Video
Öppna denna publikation i ny flik eller fönster >>Motion and Structure Estimation From Video
2012 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Digital camera equipped cell phones were introduced in Japan in 2001, they quickly became popular and by 2003 outsold the entire stand-alone digital camera market. In 2010 sales passed one billion units and the market is still growing. Another trend is the rising popularity of smartphones which has led to a rapid development of the processing power on a phone, and many units sold today bear close resemblance to a personal computer. The combination of a powerful processor and a camera which is easily carried in your pocket, opens up a large eld of interesting computer vision applications.

The core contribution of this thesis is the development of methods that allow an imaging device such as the cell phone camera to estimates its own motion and to capture the observed scene structure. One of the main focuses of this thesis is real-time performance, where a real-time constraint does not only result in shorter processing times, but also allows for user interaction.

In computer vision, structure from motion refers to the process of estimating camera motion and 3D structure by exploring the motion in the image plane caused by the moving camera. This thesis presents several methods for estimating camera motion. Given the assumption that a set of images has known camera poses associated to them, we train a system to solve the camera pose very fast for a new image. For the cases where no a priory information is available a fast minimal case solver is developed. The solver uses ve points in two camera views to estimate the cameras relative position and orientation. This type of minimal case solver is usually used within a RANSAC framework. In order to increase accuracy and performance a renement to the random sampling strategy of RANSAC is proposed. It is shown that the new scheme doubles the performance for the ve point solver used on video data. For larger systems of cameras a new Bundle Adjustment method is developed which are able to handle video from cell phones.

Demands for reduction in size, power consumption and price has led to a redesign of the image sensor. As a consequence the sensors have changed from a global shutter to a rolling shutter, where a rolling shutter image is acquired row by row. Classical structure from motion methods are modeled on the assumption of a global shutter and a rolling shutter can severely degrade their performance. One of the main contributions of this thesis is a new Bundle Adjustment method for cameras with a rolling shutter. The method accurately models the camera motion during image exposure with an interpolation scheme for both position and orientation.

The developed methods are not restricted to cellphones only, but is rather applicable to any type of mobile platform that is equipped with cameras, such as a autonomous car or a robot. The domestic robot comes in many  avors, everything from vacuum cleaners to service and pet robots. A robot equipped with a camera that is capable of estimating its own motion while sensing its environment, like the human eye, can provide an eective means of navigation for the robot. Many of the presented methods are well suited of robots, where low latency and real-time constraints are crucial in order to allow them to interact with their environment.

Ort, förlag, år, upplaga, sidor
Linköping: Linköping University Electronic Press, 2012. s. 42
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 1449
Nationell ämneskategori
Teknik och teknologier
Identifikatorer
urn:nbn:se:liu:diva-76904 (URN)978-91-7519-892-7 (ISBN)
Disputation
2012-05-16, Visionen, hus B, Campus Valla, Linköpings Universitet, Linköping, 13:15 (Engelska)
Opponent
Handledare
Projekt
Virtual Photo Set (VPS)
Tillgänglig från: 2012-04-24 Skapad: 2012-04-24 Senast uppdaterad: 2019-12-08Bibliografiskt granskad

Open Access i DiVA

fulltext(2743 kB)2254 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 2743 kBChecksumma SHA-512
a63ee4dd5cba10d06120d0d385530b83f372b35c4872e75013aec6781841b43710c929bfba5928da2b6f0102d3288aa2ec5f6dff50ace9f0e6d16384624b4294
Typ fulltextMimetyp application/pdf

Övriga länkar

Förlagets fulltext

Personposter BETA

Hedborg, JohanRingaby, ErikForssén, Per-ErikFelsberg, Michael

Sök vidare i DiVA

Av författaren/redaktören
Hedborg, JohanRingaby, ErikForssén, Per-ErikFelsberg, Michael
Av organisationen
DatorseendeTekniska högskolan
Datorseende och robotik (autonoma system)

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 2254 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 726 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf