Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Conference papers

Online Depth Learning Against Forgetting in Monocular Videos

Zhenyu Zhang Stéphane Lathuilière 1, 2 Elisa Ricci Nicu Sebe yan yan Jian yang 
1 MM - Multimédia
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract : Online depth learning is the problem of consistently adapting a depth estimation model to handle a continuously changing environment. This problem is challenging due to the network easily overfits on the current environment and forgets its past experiences. To address such problem , this paper presents a novel Learning to Prevent Forgetting (LPF) method for online mono-depth adaptation to new target domains in unsupervised manner. Instead of updating the universal parameters, LPF learns adapter modules to efficiently adjust the feature representation and distribution without losing the pre-learned knowledge in online condition. Specifically, to adapt temporal-continuous depth patterns in videos, we introduce a novel meta-learning approach to learn adapter modules by combining online adaptation process into the learning objective. To further avoid overfitting, we propose a novel temporal-consistent regu-larization to harmonize the gradient descent procedure at each online learning step. Extensive evaluations on real-world datasets demonstrate that the proposed method, with very limited parameters, significantly improves the estimation quality.
Document type :
Conference papers
Complete list of metadata

Cited literature [63 references]  Display  Hide  Download
Contributor : Stéphane Lathuilière Connect in order to contact the contributor
Submitted on : Thursday, September 17, 2020 - 2:34:50 PM
Last modification on : Wednesday, November 3, 2021 - 6:17:47 AM
Long-term archiving on: : Thursday, December 3, 2020 - 9:44:05 AM


Publisher files allowed on an open archive


  • HAL Id : hal-02941952, version 1



Zhenyu Zhang, Stéphane Lathuilière, Elisa Ricci, Nicu Sebe, yan yan, et al.. Online Depth Learning Against Forgetting in Monocular Videos. IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2020, Seattle, United States. ⟨hal-02941952⟩



Record views


Files downloads