Colección SciELO Chile

Departamento Gestión de Conocimiento, Monitoreo y Prospección
Consultas o comentarios: productividad@anid.cl
Búsqueda Publicación
Búsqueda por Tema Título, Abstract y Keywords



Refining Triplet Sampling for Improved Self-Supervised Representation Learning
Indexado
Scopus SCOPUS_ID:85202015531
DOI
Año 2024
Tipo

Citas Totales

Autores Afiliación Chile

Instituciones Chile

% Participación
Internacional

Autores
Afiliación Extranjera

Instituciones
Extranjeras


Abstract



Self-supervised representation learning extracts meaningful features from data without explicit supervision, building a space with desired properties. Contrastive learning has emerged as the predominant approach to clustering similar data points and separating dissimilar ones within the embedding space. Although creating different views of the same data (e.g., cropping, rotation) emphasizes similarities without labels, current methods struggle to define negative examples. Several algorithms only consider positive examples or integrate dissimilarity measures into their loss functions by computing average distances within the same batch. However, they do not capture nuanced differences effectively, risking collapsing data points in a single location. In this paper, we propose a novel technique, termed “Refined Triplet Sampling” (ReTSam), to generate synthetic negative vectors for contrastive learning. Mechanically, for each element in the batch, we identify its k-nearest neighbors and designate the centroid as a hard negative for a triplet loss methodology. We test ReTSam on two widely used image datasets, namely CIFAR-10 and SVHN, considering content-based image retrieval and classification tasks. Our findings demonstrate that, despite its simplicity, ReTSam not only promotes the learning of similarity but also significantly improves that of dissimilarity (with a +5% increase in Mean Average Precision on CIFAR10), resulting in superior performance in practical scenarios.

Disciplinas de Investigación



WOS
Sin Disciplinas
Scopus
Sin Disciplinas
SciELO
Sin Disciplinas

Muestra la distribución de disciplinas para esta publicación.

Publicaciones WoS (Ediciones: ISSHP, ISTP, AHCI, SSCI, SCI), Scopus, SciELO Chile.

Colaboración Institucional



Muestra la distribución de colaboración, tanto nacional como extranjera, generada en esta publicación.


Autores - Afiliación



Ord. Autor Género Institución - País
1 Goyo, Manuel - Universidad Técnica Federico Santa María - Chile
2 Frisoni, Giacomo - Alma Mater Studiorum Università di Bologna - Italia
3 Moro, Gianluca - Alma Mater Studiorum Università di Bologna - Italia
4 Sartori, Claudio - Alma Mater Studiorum Università di Bologna - Italia

Muestra la afiliación y género (detectado) para los co-autores de la publicación.

Financiamiento



Fuente
Universidad Técnica Federico Santa María
Agenția Națională pentru Cercetare și Dezvoltare

Muestra la fuente de financiamiento declarada en la publicación.

Agradecimientos



Agradecimiento
This research received partial support through an agreement with Scotiabank and Federico Santa Mar\u00EDa Technical University, as well as via a scholarship for international visits provided by Federico Santa Mar\u00EDa Technical University and the National Agency for Research and Development (doctoral scholarship 2022/21221059).

Muestra la fuente de financiamiento declarada en la publicación.