Colección SciELO Chile

Departamento Gestión de Conocimiento, Monitoreo y Prospección
Consultas o comentarios: productividad@anid.cl
Búsqueda Publicación
Búsqueda por Tema Título, Abstract y Keywords



A deep learning approach to photo–identification demonstrates high performance on two dozen cetacean species
Indexado
WoS WOS:001027333900001
Scopus SCOPUS_ID:85164831825
DOI 10.1111/2041-210X.14167
Año 2023
Tipo artículo de investigación

Citas Totales

Autores Afiliación Chile

Instituciones Chile

% Participación
Internacional

Autores
Afiliación Extranjera

Instituciones
Extranjeras


Abstract



Researchers can investigate many aspects of animal ecology through noninvasive photo–identification. Photo–identification is becoming more efficient as matching individuals between photos is increasingly automated. However, the convolutional neural network models that have facilitated this change need many training images to generalize well. As a result, they have often been developed for individual species that meet this threshold. These single-species methods might underperform, as they ignore potential similarities in identifying characteristics and the photo–identification process among species. In this paper, we introduce a multi-species photo–identification model based on a state-of-the-art method in human facial recognition, the ArcFace classification head. Our model uses two such heads to jointly classify species and identities, allowing species to share information and parameters within the network. As a demonstration, we trained this model with 50,796 images from 39 catalogues of 24 cetacean species, evaluating its predictive performance on 21,192 test images from the same catalogues. We further evaluated its predictive performance with two external catalogues entirely composed of identities that the model did not see during training. The model achieved a mean average precision (MAP) of 0.869 on the test set. Of these, 10 catalogues representing seven species achieved a MAP score over 0.95. For some species, there was notable variation in performance among catalogues, largely explained by variation in photo quality. Finally, the model appeared to generalize well, with the two external catalogues scoring similarly to their species' counterparts in the larger test set. From our cetacean application, we provide a list of recommendations for potential users of this model, focusing on those with cetacean photo–identification catalogues. For example, users with high quality images of animals identified by dorsal nicks and notches should expect near optimal performance. Users can expect decreasing performance for catalogues with higher proportions of indistinct individuals or poor quality photos. Finally, we note that this model is currently freely available as code in a GitHub repository and as a graphical user interface, with additional functionality for collaborative data management, via Happywhale.com.

Métricas Externas



PlumX Altmetric Dimensions

Muestra métricas de impacto externas asociadas a la publicación. Para mayor detalle:

Disciplinas de Investigación



WOS
Ecology
Scopus
Sin Disciplinas
SciELO
Sin Disciplinas

Muestra la distribución de disciplinas para esta publicación.

Publicaciones WoS (Ediciones: ISSHP, ISTP, AHCI, SSCI, SCI), Scopus, SciELO Chile.

Colaboración Institucional



Muestra la distribución de colaboración, tanto nacional como extranjera, generada en esta publicación.


Autores - Afiliación



Ord. Autor Género Institución - País
1 Patton, Philip T. Hombre Hawaiʻi Institute of Marine Biology - Estados Unidos
NOAA Pacific Islands Fisheries Science Center - Estados Unidos
Univ Hawaii Manoa - Estados Unidos
NOAA Fisheries Pacific Isl Fisheries Sci Ctr - Estados Unidos
2 Cheeseman, Ted - Southern Cross University - Australia
Happywhale.com - Estados Unidos
Southern Cross Univ - Australia
Happywhale com - Estados Unidos
3 Abe, Kenshin - Preferred Networks, Inc. - Japón
Preferred Networks Inc - Japón
4 Yamaguchi, Taiki Hombre Preferred Networks, Inc. - Japón
Preferred Networks Inc - Japón
5 Reade, Walter Hombre Google LLC - Estados Unidos
Google - Estados Unidos
6 Southerland, Ken - Happywhale.com - Estados Unidos
Happywhale com - Estados Unidos
7 Howard, Addison - Google LLC - Estados Unidos
Google - Estados Unidos
8 Oleson, Erin M. Mujer NOAA Pacific Islands Fisheries Science Center - Estados Unidos
NOAA Fisheries Pacific Isl Fisheries Sci Ctr - Estados Unidos
9 Allen, Jason B. Hombre Mote Marine Laboratory - Estados Unidos
Chicago Zool Soc Sarasota Dolphin Res Program - Estados Unidos
Mote Marine Laboratory & Aquarium - Estados Unidos
10 Ashe, Erin Mujer Oceans Initiative - Estados Unidos
Oceans Initiat - Estados Unidos
11 Athayde, Aline Mujer Projeto Baleia à Vista (ProBaV) - Brasil
Projeto Baleia Vista ProBaV - Brasil
12 Baird, Robin W. Hombre Cascadia Research Collective - Estados Unidos
Cascadia Res Collect - Estados Unidos
13 Basran, Charla Mujer Haskoli Islands - Islandia
Univ Iceland - Islandia
14 CABRERA-VICENCIO, ENRIQUE SEGUNDO Mujer Centro de Conservación Cetacea - Chile
Ctr Conservac Cetacea CCC - Chile
15 Calambokidis, John Hombre Cascadia Research Collective - Estados Unidos
Cascadia Res Collect - Estados Unidos
16 Cardoso, Júlio Hombre Projeto Baleia à Vista (ProBaV) - Brasil
Projeto Baleia Vista ProBaV - Brasil
17 Carroll, Emma L. Mujer School of Biological Sciences - Nueva Zelanda
Univ Auckland Waipapa Taumata Rau - Nueva Zelanda
18 Cesario, Amina Mujer Tethys Research Institute - Italia
The University of Hong Kong, Swire Institute of Marine Science - Hong Kong
Tethys Res Inst - Italia
Univ Hong Kong - China
19 Cheney, Barbara J. Mujer University of Aberdeen - Reino Unido
UNIV ABERDEEN - Reino Unido
20 Corsi, Enrico Hombre Cascadia Research Collective - Estados Unidos
Cascadia Res Collect - Estados Unidos
21 Currie, Jens Hombre Hawaiʻi Institute of Marine Biology - Estados Unidos
Pacific Whale Foundation - Estados Unidos
Univ Hawaii Manoa - Estados Unidos
Pacific Whale Fdn - Estados Unidos
22 Durban, John W. Hombre SeaLife Response - Estados Unidos
SR3 SeaLife Response Rehabil & Res - Estados Unidos
23 Falcone, Erin A. Mujer Marine Ecology and Telemetry Research - Estados Unidos
Marine Ecol & Telemetry Res - Estados Unidos
24 Fearnbach, Holly Mujer SeaLife Response - Estados Unidos
SR3 SeaLife Response Rehabil & Res - Estados Unidos
25 Flynn, Kiirsten - Cascadia Research Collective - Estados Unidos
Cascadia Res Collect - Estados Unidos
26 Franklin, Trish Mujer Southern Cross University - Australia
The Oceania Project - Australia
Southern Cross Univ - Australia
Oceania Project - Australia
27 Franklin, Wally Hombre Southern Cross University - Australia
The Oceania Project - Australia
Southern Cross Univ - Australia
Oceania Project - Australia
28 Vernazzani, B. G. Mujer Centro de Conservación Cetacea - Chile
Pacific Whale Foundation - Estados Unidos
Ctr Conservac Cetacea CCC - Chile
Pacific Whale Fdn - Estados Unidos
29 Genov, Tilen Hombre Morigenos - Slovenian Marine Mammal Society - Eslovenia
University of St Andrews - Reino Unido
Morigenos Slovenian Marine Mammal Soc - Eslovenia
Univ St Andrews - Reino Unido
30 Hill, Marie Mujer NOAA Pacific Islands Fisheries Science Center - Estados Unidos
School of Ocean and Earth Science and Technology - Estados Unidos
NOAA Fisheries Pacific Isl Fisheries Sci Ctr - Estados Unidos
Res Corp Univ Hawaii - Estados Unidos
31 Johnston, David R. Hombre University of Otago - Nueva Zelanda
UNIV OTAGO - Nueva Zelanda
32 Keene, Erin L. Mujer Marine Ecology and Telemetry Research - Estados Unidos
Marine Ecol & Telemetry Res - Estados Unidos
33 Mahaffy, Sabre D. - Cascadia Research Collective - Estados Unidos
Cascadia Res Collect - Estados Unidos
34 McGuire, Tamara L. Mujer The Cook Inlet Beluga Whale Photo-ID Project - Estados Unidos
Cook Inlet Beluga Whale Photoid Project - Estados Unidos
35 McPherson, Liah - Hawaiʻi Institute of Marine Biology - Estados Unidos
Univ Hawaii Manoa - Estados Unidos
36 Meyer, Catherine Mujer School of Biological Sciences - Nueva Zelanda
UNIV AUCKLAND - Nueva Zelanda
37 Michaud, Robert Hombre Groupe de Recherche et d’Éducation sur les Mammifères Marins (GREMM) - Canadá
Grp Rech & Educ Mammiferes Marins GREMM - Canadá
38 Miliou, Anastasia Mujer Archipelagos Institute of Marine Conservation - Grecia
Archipelagos Inst Marine Conservat - Grecia
39 Orbach, Dara N. Mujer Texas A and M University - Corpus Christi - Estados Unidos
Texas A&M Univ Corpus Christi - Estados Unidos
40 Pearson, Heidi C. Mujer University of Alaska Southeast - Estados Unidos
Univ Alaska Southeast - Estados Unidos
41 Rasmussen, Marianne H. Mujer Haskoli Islands - Islandia
Univ Iceland - Islandia
42 Rayment, William J. Hombre University of Otago - Nueva Zelanda
UNIV OTAGO - Nueva Zelanda
43 Rinaldi, Caroline Mujer Association Evasion Tropicale - Guadalupe
Assoc Evas Tropicale - Francia
44 Rinaldi, Renato Hombre Association Evasion Tropicale - Guadalupe
Assoc Evas Tropicale - Francia
45 Siciliano, Salvatore Hombre Fundacao Oswaldo Cruz - Brasil
Escola Nacl Saude Publ FIOCRUZ - Brasil
46 Stack, Stephanie Mujer Pacific Whale Foundation - Estados Unidos
Pacific Whale Foundation Australia - Australia
Pacific Whale Fdn Australia - Australia
47 Tintore, Beatriz Mujer Archipelagos Institute of Marine Conservation - Grecia
Archipelagos Inst Marine Conservat - Grecia
48 Torres, Leigh G. Mujer Oregon State University - Estados Unidos
Oregon State Univ - Estados Unidos
49 Towers, Jared R. Hombre Bay Cetology - Canadá
Bay Cetol - Canadá
50 Trotter, Cameron Hombre Newcastle University - Reino Unido
Newcastle Univ - Reino Unido
51 Tyson Moore, Reny Mujer Mote Marine Laboratory - Estados Unidos
Chicago Zool Soc Sarasota Dolphin Res Program - Estados Unidos
Mote Marine Laboratory & Aquarium - Estados Unidos
52 Weir, Caroline R. Mujer Falklands Conservation - Islas Malvinas
Falklands Conservat - Islas Malvinas
53 Wellard, Rebecca Mujer Curtin University - Australia
Project ORCA - Australia
Curtin Univ - Australia
54 Wells, Randall Hombre Mote Marine Laboratory - Estados Unidos
Chicago Zool Soc Sarasota Dolphin Res Program - Estados Unidos
Mote Marine Laboratory & Aquarium - Estados Unidos
55 Yano, Kymberly M. Mujer NOAA Pacific Islands Fisheries Science Center - Estados Unidos
University of Otago - Nueva Zelanda
NOAA Fisheries Pacific Isl Fisheries Sci Ctr - Estados Unidos
UNIV OTAGO - Nueva Zelanda
56 Zaeschmar, Jochen R. Hombre Far Out Ocean Research Collective - Nueva Zelanda
Far Out Ocean Res Collect - Nueva Zelanda
57 Bejder, Lars Hombre Hawaiʻi Institute of Marine Biology - Estados Unidos
Aarhus Universitet - Dinamarca
Univ Hawaii Manoa - Estados Unidos
Aarhus Univ - Dinamarca

Muestra la afiliación y género (detectado) para los co-autores de la publicación.

Financiamiento



Fuente
National Science Foundation
National Oceanic and Atmospheric Administration
NOAA Fisheries QUEST
University of Hawaii Information Technology Services
NOAA Fisheries QUEST Fellowship

Muestra la fuente de financiamiento declarada en la publicación.

Agradecimientos



Agradecimiento
We thank the countless individuals who collected and/or processed the nearly 85,000 images used in this study and those who assisted, particularly those who sorted these images from the millions that did not end up in the catalogues. Additionally, we thank the other Kaggle competitors who helped develop the ideas, models and data used here, particularly those who released their datasets to the public. The graduate assistantship for Philip T. Patton was funded by the NOAA Fisheries QUEST Fellowship. This paper represents HIMB and SOEST contribution numbers 1932 and 11679, respectively. The technical support and advanced computing resources from University of Hawaii Information Technology Services—Cyberinfrastructure, funded in part by the National Science Foundation CC* awards # 2201428 and # 2232862 are gratefully acknowledged. Every photo–identification image was collected under permits according to relevant national guidelines, regulation and legislation.
National Oceanic and Atmospheric Administration; NOAA Fisheries QUEST Fellowship; University of Hawaii Information Technology Services; National Science Foundation, Grant/Award Number: 2232862 and 2201428

Muestra la fuente de financiamiento declarada en la publicación.