SAM-driven MAE pre-training and background-aware meta-learning for unsupervised vehicle re-identification
Dong Wang , Qi Wang , Weidong Min , Di Gai , Qing Han , Longfei Li , Yuhan Geng
Published In
Computational Visual Media
Accepted Date
March 3, 2024
Venue Type
Journal
Venue Level
CCF-B
Publication Date
Volume
10
Issue
4
Pages
771–789
Abstract
This paper addresses background interference in unsupervised vehicle re-identification by combining SAM-driven masked autoencoder pre-training with background-aware meta-learning. The method first uses SAM to separate vehicle identity regions from background regions, and further introduces a spatially constrained background segmentation strategy to handle difficult cases such as occlusion and ambiguous vehicle boundaries. Based on the optimized segmentation results, SAM-driven MAE pre-training selectively preserves vehicle-related patches and masks background regions, encouraging the encoder to learn identity-sensitive representations in a self-supervised manner. To improve robustness under varying scene conditions, the paper further proposes a background-aware meta-learning strategy that constructs meta-training and meta-testing splits according to different background region ratios. Experiments on VeRi-776 and VeRi-Wild demonstrate that the proposed method effectively reduces background interference and improves unsupervised vehicle Re-ID performance.
BibTeX
@article{Wang2024SAMReID,
title = {{SAM}-driven {MAE} pre-training and background-aware meta-learning for unsupervised vehicle re-identification},
author = {Wang, Dong and Wang, Qi and Min, Weidong and Gai, Di and Han, Qing and Li, Longfei and Geng, Yuhan},
journal = {Computational Visual Media},
year = {2024},
month = aug,
volume = {10},
number = {4},
pages = {771--789},
publisher = {Tsinghua University Press},
doi = {10.1007/s41095-024-0424-2},
url = {https://doi.org/10.1007/s41095-024-0424-2}
}