Learning to Solve Nonlinear Least Squares for Monocular Stereo

Ronald Clark, Michael Bloesch, Jan Czarnowski, Stefan Leutenegger, Andrew J. Davison ; The European Conference on Computer Vision (ECCV), 2018, pp. 284-299

Abstract


Sum-of-squares objective functions are very popular in computer vision algorithms. However, these objective functions are not always easy to optimize. The underlying assumptions made by solvers are often not satisfied and many problems are inherently ill-posed. In this paper, we propose a neural nonlinear least squares optimization algorithm which learns to effectively optimize these cost functions even in the presence of adversities. Unlike traditional approaches, the proposed solver requires no hand-crafted regularizers or priors as these are implicitly learned from the data. We apply our method to the problem of motion stereo ie. jointly estimating the motion and scene geometry from pairs of images of a monocular sequence. We show that our learned optimizer is able to efficiently and effectively solve this challenging optimization problem.

Related Material


[pdf]
[bibtex]
@InProceedings{Clark_2018_ECCV,
author = {Clark, Ronald and Bloesch, Michael and Czarnowski, Jan and Leutenegger, Stefan and Davison, Andrew J.},
title = {Learning to Solve Nonlinear Least Squares for Monocular Stereo},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}
}