HyperAIHyperAI
8 days ago

A Novel Unsupervised Domain Adaption Method for Depth-Guided Semantic Segmentation Using Coarse-to-Fine Alignment

{Dinh Viet Sang, Nguyen Thi-Oanh, Muriel Visani, Trinh Van Dieu, Nguyen Minh Tu, Kieu Dang Nam}
Abstract

Domain adaptation methods in machine learning deal with the domain shift issue by aligning source and target data representation. This paper proposes a novel domain adaptation method for semantic segmentation that exploits the Fourier transform on chromatic space to improve the quality of style transfer, and generates pseudo-labels for self-training by combining the results from different teachers obtained at different rounds of self-training. Our method also applies class-level adversarial learning to achieve a more fine-grained alignment between the two domains, and a late fusion with a depth-estimation model to improve its segmentation outputs. Experiments show that our method yields superior performance in terms of accuracy compared to other existing state-of-the-art methods.