Learning to Adapt for Stereo

Alessio Tonioni, Oscar Rahnama, Tom Joy, Ajanthan Thalaiyasingam, Luigi Di Stefano and Philip H S Torr

🏢Conference on Computer Vision and Pattern Recognition (CVPR), June 2019


learningtoadapt.jpg

 
 

Abstract. Real world applications of stereo depth estimation require models that are robust to dynamic variations in the environment. Even though deep learning based stereo methods are successful, they often fail to generalize to unseen variations in the environment, making them unattractive to practical applications such as autonomous driving. In this work, we introduce a learning-to-adapt framework that enables deep stereo methods to continuously adapt to new target domains in an unsupervised manner. Specifically, our approach incorporates the adaptation procedure into the learning objective to obtain a base set of parameters that are better suited for unsupervised online adaptation. To further improve the quality of the adaptation, we learn a confidence measure that effectively masks the errors introduced during the unsupervised adaptation. We evaluate our method on synthetic and real-world stereo datasets and our experiments evidence that learning-to-adapt is, in fact, beneficial for online adaptation on vastly different domains.

Download the full paper

View all research publications