TV-L1 optical flow for vector valued images

Lars Lau Rakêt, Lars Roholm, Mads Nielsen, Francois Bernard Lauze

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

18 Citations (Scopus)

Abstract

The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.
Original languageEnglish
Title of host publicationEnergy Minimization Methods in Computer Vision and Pattern Recognition : 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings
EditorsYuri Boykov, Fredrik Kahl, Victor Lempitsky, Frank R. Schmidt
Number of pages15
PublisherSpringer
Publication date2011
Pages329-343
ISBN (Print)978-3-642-23093-6
ISBN (Electronic)978-3-642-23094-3
DOIs
Publication statusPublished - 2011
Event8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition - Sankt Petersborg, Russian Federation
Duration: 25 Jul 201127 Jul 2011
Conference number: 8

Conference

Conference8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Number8
Country/TerritoryRussian Federation
CitySankt Petersborg
Period25/07/201127/07/2011
SeriesLecture notes in computer science
Volume6819
ISSN0302-9743

Cite this