Skip to Main content Skip to Navigation
Conference papers

Online Depth Learning Against Forgetting in Monocular Videos

Abstract : Online depth learning is the problem of consistently adapting a depth estimation model to handle a continuously changing environment. This problem is challenging due to the network easily overfits on the current environment and forgets its past experiences. To address such problem , this paper presents a novel Learning to Prevent Forgetting (LPF) method for online mono-depth adaptation to new target domains in unsupervised manner. Instead of updating the universal parameters, LPF learns adapter modules to efficiently adjust the feature representation and distribution without losing the pre-learned knowledge in online condition. Specifically, to adapt temporal-continuous depth patterns in videos, we introduce a novel meta-learning approach to learn adapter modules by combining online adaptation process into the learning objective. To further avoid overfitting, we propose a novel temporal-consistent regu-larization to harmonize the gradient descent procedure at each online learning step. Extensive evaluations on real-world datasets demonstrate that the proposed method, with very limited parameters, significantly improves the estimation quality.
Document type :
Conference papers
Complete list of metadatas

Cited literature [63 references]  Display  Hide  Download

https://hal.telecom-paris.fr/hal-02941952
Contributor : Stéphane Lathuilière <>
Submitted on : Thursday, September 17, 2020 - 2:34:50 PM
Last modification on : Friday, October 16, 2020 - 10:30:54 AM

File

Zhang_Online_Depth_Learning_Ag...
Publisher files allowed on an open archive

Identifiers

  • HAL Id : hal-02941952, version 1

Collections

Citation

Zhenyu Zhang, Stéphane Lathuilière, Elisa Ricci, Nicu Sebe, Yan Yan, et al.. Online Depth Learning Against Forgetting in Monocular Videos. IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2020, Seattle, United States. ⟨hal-02941952⟩

Share

Metrics

Record views

16

Files downloads

26