Communication Dans Un Congrès Année : 2024

Beyond Internet Images: Evaluating Vision-Language Models for Domain Generalization on Synthetic-to-Real Industrial Datasets

Résumé

Vision Language Foundation Models (VLFMs) have shown impressive generalization capabilities, making them suitable for Domain Generalization (DG) tasks, such as training on synthetic images and testing on real data. However, existing evaluations predominantly use academic benchmarks constructed from internet images, akin to the datasets used for training VLFMs. This paper assesses the performance of VLFM-based DG algorithms on two synthetic-to-real classification datasets, Rareplanes-tiles and Aerial Vehicles, designed to emulate industrial contexts. Our findings reveal that while VLFMs excel on academic benchmarks, outperforming randomly initialized networks, their advantage is significantly diminished on these industrial-like datasets. This study underscores the importance of evaluating models on diverse, representative data to understand their real-world applicability and limitations.
Fichier principal
Vignette du fichier
CVPR_workshop_CLIP.pdf (436.37 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04889782 , version 1 (15-01-2025)

Identifiants

  • HAL Id : hal-04889782 , version 1

Citer

Louis Hémadou, Héléna Vorobieva, Ewa Kijak, Frédéric Jurie. Beyond Internet Images: Evaluating Vision-Language Models for Domain Generalization on Synthetic-to-Real Industrial Datasets. Synthetic Data for Computer Vision Workshop @ CVPR 2024, Jun 2024, Seattle, Washington, United States. ⟨hal-04889782⟩
0 Consultations
0 Téléchargements

Partager

More