Publications in the field of Stereo and 3D Reconstruction:



  Efficient Minimal-Surface Regularization of Perspective Depth Maps in Variational Stereo paper       software      
  Gottfried Graber, Jonathan Balzer, Stefano Soatto, Thomas Pock       CVPR 2015  
paper We propose a method for dense three-dimensional surface reconstruction that leverages the strengths of shapebased approaches, by imposing regularization that respects the geometry of the surface, and the strength of depthmap-based stereo, by avoiding costly computation of surface topology. The result is a near real-time variational reconstruction algorithm free of the staircasing artifacts that affect depth-map and plane-sweeping approaches. This is made possible by exploiting the gauge ambiguity to design a novel representation of the regularizer that is linear in the parameters and hence amenable to be optimized with state-of-the-art primal-dual numerical schemes.
Show Details Download Paper   (Downloads: 40747)


  Scene Flow Estimation from Light Fields via the Preconditioned Primal-Dual Algorithm paper              
  Stefan Heber, Thomas Pock       GCPR 2014  
paper In this paper we present a novel variational model to jointly estimate geometry and motion from a sequence of light fields captured with a plenoptic camera. The proposed model uses the so-called sub-aperture representation of the light field. Sub-aperture images represent images with slightly different viewpoints, which can be extracted from the light field. The sub-aperture representation allows us to formulate a convex global energy functional, which enforces multi-view geometry consistency, ...
Show Details Download Paper   (Downloads: 133715)
  Shape from Light Field meets Robust PCA paper              
  Stefan Heber, Thomas Pock       European Conference on Computer Vision 2014  
paper In this paper we propose a new type of matching term for multi-view stereo reconstruction. Our model is based on the assumption, that if one warps the images of the various views to a common warping center and considers each warped image as one row in a matrix, then this matrix will have low rank. This also implies, that we assume a certain amount of overlap between the views after the warping has been performed. Such an assumption is obviously met in the case of light field data ...
Show Details Download Paper   (Downloads: 100565)


  Variational Shape from Light Field paper              
  Stefan Heber, Rene Ranftl, Thomas Pock       EMMCVPR 2013  
paper In this paper we propose an efficient method to calculate a high-quality depth map from a single raw image captured by a light field or plenoptic camera. The proposed model combines the main idea of Active Wavefront Sampling (AWS) with the light field technique, i.e. we extract so-called sub-aperture images out of the raw image of a plenoptic camera, in such a way that the virtual view points are arranged on circles around a fixed center view. By tracking an imaged scene point over a sequence of sub-aperture images corresponding to a common circle, one can observe a virtual rotation of the scene point on the image plane. Our model is able to measure a dense field of these rotations, which are inversely related to the scene depth.
Hide Details Download Paper   (Downloads: 159446) Bibtex
  Minimizing TGV-based Variational Models with Non-Convex Data Terms paper              
  Rene Ranftl, Thomas Pock, Horst Bischof       SSVM 2013  
paper We introduce a method to approximately minimize variational models with Total Generalized Variation regularization (TGV) and non-convex data terms. Our approach is based on a decomposition of the functional into two subproblems, which can be both solved globally optimal. Based on this decomposition we derive an iterative algorithm for the approximate minimization of the original non-convex problem. We apply the proposed algorithm to a state-of-the-art stereo model that was previously solved using coarse-to-fine warping, where we are able to show significant improvements in terms of accuracy.
Show Details Download Paper   (Downloads: 188780)


  Realtime 3D Reconstruction paper   videos   software      
  Gottfried Graber       Masters Thesis  
paper Reconstruction of 3D geometry from 2D images is one of the most fundamental challenges in computer vision. In the past decade, numerous algorithms have been developed to solve this problem in an offline fashion. Only recently, the availability of cheap processing power in the form of GPUs and appropriate parallel algorithms made it possible to tackle this problem in a novel way and present results to the user in realtime.
Show Details Download Paper   (Downloads: 226921)
  Pushing the Limits of Stereo Using Variational Stereo Estimation paper   videos          
  Rene Ranftl, Stefan Gehrig, Thomas Pock, Horst Bischof       IEEE Intelligent Vehicles Symposium 2012  
paper We examine high accuracy stereo estimation for binocular sequences that where obtained from a mobile platform. The ultimate goal is to improve the range of stereo systems without altering the setup. Based on a well-known variational optical flow model, we introduce a novel stereo model that features a second-order regularization, which both allows sub-pixel accurate solutions and piecewise planar disparity maps.
Show Details Download Paper   (Downloads: 221835)
  Online 3D reconstruction using Convex Optimization paper   videos          
  Gottfried Graber, Thomas Pock, Horst Bischof       1st Workshop on Live Dense Reconstruction From Moving Cameras, ICCV 2011  
paper We present a system that is capable of interactively reconstructing a scene from a single live camera. We use a dense volumetric representation of the surface, which means there are no constraints concerning the 3D-scene topology. Reconstruction is based on range image fusion using a total variation formulation, where the surface is represented implicitly by a signed distance function.
Show Details Download Paper   (Downloads: 227042)
  A convex approach to minimal partitions (revised version) paper              
  Antonin Chambolle, Daniel Cremers, Thomas Pock       SIAM Journal on Imaging Sciences  
paper We describe a convex relaxation for a family of problems of minimal perimeter partitions. The minimization of the relaxed problem can be tackled numerically, we describe an algorithm and show some results. In most cases, our relaxed problem finds a correct numerical approximation of the optimal solution.
Show Details Download Paper   (Downloads: 204326)


  TGV-Fusion paper              
  Thomas Pock and Lukas Zebedin and Horst Bischof       C.S. Calude, G. Rozenberg, A. Salomaa (Eds.): Maurer Festschrift, LNCS 6570  
paper Location awareness on the Internet and 3D models of our habitat (as produced by Microsoft (Bing) or Google (Google Earth)) are a major driving force for creating 3D models from image data. A key factor for these models are highly accurate and fully automated stereo matching pipelines producing highly accurate 3D point clouds that are possible due to the fact that we can produce images with high redundancy...
Show Details Download Paper   (Downloads: 232068)


  Exploiting Redundancy for Aerial Image Fusion using Convex Optimization paper              
  Stefan Kluckner and Thomas Pock and Horst Bischof       DAGM 2010, Annual Symposium of the German Association for Pattern Recognition  
paper This paper proposes a variational formulation for a tight integration of redundant image data showing urban environments. We introduce an efficient wavelet regularization which enables a natural-appearing recovery of fine details in the images by performing joint inpainting and denoising from a given set of input observations ...
Show Details Download Paper   (Downloads: 292632)
  Global Solutions of Variational Models with Convex Regularization paper              
  Thomas Pock, Daniel Cremers, Horst Bischof, Antonin Chambolle       Accepted to SIIMS  
paper We propose an algorithmic framework to compute global solutions of variational models with convex regularity terms that permit quite arbitrary data terms. While the minimization of variational problems with convex data and regularity terms is straight forward (using for example gradient descent), this is no longer trivial for functionals with non-convex data terms...
Show Details Download Paper   (Downloads: 313548)


  A Variational Approach to Semiautomatic Generation of Digital Terrain Models paper              
  Markus Unger, Thomas Pock, Markus Grabner, Andreas Klaus, Horst Bischof       5th Int. Symp. on Visual Computing, Las Vegas, USA  
paper We present a semiautomatic approach to generate high quality digital terrain models (DTM) from digital surface models (DSM). A DTM is a model of the earths surface, where all man made objects and the vegetation have been removed. In order to achieve this, we use a variational energy minimization approach. The proposed energy functional incorporates Huber regularization to yield piecewise smooth surfaces...
Show Details Download Paper   (Downloads: 293478)


  A Convex Formulation of Continuous Multi-Label Problems paper              
  Thomas Pock, Thomas Schoenemann, Gottfried Graber, Horst Bischof, Daniel Cremers       European Conference on Computer Vision 2008  
paper We propose a spatially continuous formulation of Ishikawa's discrete multi-label problem.We show that the resulting non-convex variational problem can be reformulated as a convex variational problem via embedding in a higher dimensional space.
Show Details Download Paper   (Downloads: 369865)
  Fast Total Variation for Computer Vision paper              
  Thomas Pock       Phd Thesis 2008  
paper Motivated by statistical inference methods, variational methods are among the most successful methods to solve a number of different Computer Vision problems. Variational methods aim to minimize an energy functional...
Show Details Download Paper   (Downloads: 511967)


  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration paper              
  Christopher Zach, Thomas Pock, Horst Bischof       International Conference on Computer Vision 2007  
paper Robust integration of range images is an important task for building high-quality 3D models. Since range images may have a substantial amount of outliers, any integration approach aimed at high-quality models needs an increased level of robustness...
Show Details Download Paper   (Downloads: 405029)
  Mumford-Shah Meets Stereo: Integration of Weak Depth Hypotheses paper              
  Thomas Pock, Christopher Zach, Horst Bischof       Conference on Computer Vision and Pattern Recognition 2007  
paper Recent results on stereo indicate that an accurate segmentation is crucial for obtaining faithful depth maps. Variational methods have successfully been applied to both image segmentation and computational stereo. In this paper we propose a combination...
Show Details Download Paper   (Downloads: 400547)