Researchers build first AI tool capable of identifying individual birds in the wild
An international team, including researchers from the University of Konstanz and co-located Max Planck Institute of Animal Behavior, trains computers to tell individual birds apart—a task humans cannot do—overcoming one of the greatest limitations in the study of wild birds.
New research demonstrates for the first time that artificial intelligence (AI) can be used to train computers to recognise individual birds in the wild, a task humans are unable to do. The research – with participation of the Cluster of Excellence “Centre for the Advanced Study of Collective Behaviour” at the University of Konstanz – is published in the British Ecological Society journal Methods in Ecology and Evolution.
“We show that computers can consistently recognise dozens of individual birds, even though we cannot ourselves tell these individuals apart. In doing so, our study provides the means of overcoming one of the greatest limitations in the study of wild birds – reliably recognising individuals,” said Dr André Ferreira at the Center for Functional and Evolutionary Ecology (CEFE), France, and lead author of the study.
Tracking wild birds without marking them
The tool will allow studies previously only possible in the laboratory—where people have tracked individuals using these methods for a number of years—to be replicated in the wild. “The ability to track wild birds without having to mark them represents perhaps the greatest single methodological advance in recent decades, at least since the miniaturisation of GPS tags that can be carried by migrating birds,” says Dr Damien Farine, a group leader at the University of Konstanz and co-located Max Planck Institute of Animal Behavior, who is a co-author on the study.
In the study, researchers from institutes in France, Germany, Portugal and South Africa describe the process for using AI to individually identify birds. This involves collecting thousands of labelled images of birds and then using this data to train and test AI models. This study represents the first successful attempt to do this in birds.
Accuracy of 90 percent
The researchers trained the AI models to recognise images of individual birds in wild populations of great tits and sociable weavers and a captive population of zebra finches, some of the most commonly studied birds in behavioural ecology. After training, the AI models were tested with images of the individuals they had not seen before and had an accuracy of over 90% for the wild species and 87% for the captive zebra finches.
In animal behaviour studies, individually identifying animals is one of the most expensive and time-consuming factors, limiting the scope of behaviours and the size of the populations that researchers can study. Current identification methods like attaching colour bands to birds’ legs can also be stressful to the animals.
These issues could be solved with AI models. Dr André Ferreira said: “The development of methods for automatic, non-invasive identification of animals completely unmarked and unmanipulated by researchers represents a major breakthrough in this research field. Ultimately, there is plenty of room to find new applications for this system and answer questions that seemed unreachable in the past.”
Training artificial intelligence
For AI models to be able to accurately identify individuals they need to be trained with thousands of labelled images. Social media companies are able to do this for human recognition because they have access to millions of pictures of different people that are voluntarily tagged by users. But, acquiring such labelled photographs of animals is difficult and has created a bottleneck in research.
The researchers were able to overcome this challenge by building feeders with camera traps and sensors. Most birds in the study populations carried a passive integrated transponder (PIT) tag, similar to the microchips implanted in pet cats and dogs. Antennae on the bird feeders were able to read the identity of the bird from these tags and trigger the cameras.
Solving image classification problems
Being able to distinguish individual animals from each other is important for the long-term monitoring of populations and protecting species from pressures such as climate change. While some species such as leopards have distinct patterns that allow humans to recognise them by eye, most species require additional visual identifiers, such as colour bands attached to birds’ legs, for us to tell them apart. Even then, methods like this are extremely time consuming and error prone.
AI methods like the one shown in this study use a type of deep learning known as convolutional neural networks, these are optimal for solving image classification problems. In ecology, these methods have previously been used to identify animals at a species levels and individual primates, pigs and elephants. However, until now it hasn’t been explored in smaller animals like birds.
The authors caution that the AI model is only able to re-identify individuals it has been shown before. “The model is able to identify birds from new pictures as long as the birds in those pictures are previously known to the models. This means that if new birds join the study population the computer will not be able to identify them.” said Dr André Ferreira.
The appearance of individual birds can change over time, for instance moulting, and it’s not known how the performance of the AI model will be affected. Images of the same bird taken months apart could be mistakenly identified as different individuals.
The authors add that both these limitations can be overcome with large enough datasets containing thousands of images of thousands of individuals over long periods of time, which they are currently trying to collect.
Facts:
- Researchers used AI techniques to train computers to recognise individual birds in the wild, a task humans are unable to do.
- Researchers include Damien Farine and Hanja Brandle, both from the Cluster of Excellence “Centre for the Advanced Study of Collective Behaviour” at the University of Konstanz and the co-located Max Planck Institute of Animal Behavior.
- AI models were trained on data from wild populations of great tits and sociable weavers and a captive population of zebra finches, some of the most commonly studied birds in behavioural ecology.
- Original Publication: Deep learning-based methods for individual recognition in small birds. Methods in Ecology and Evolution. Andre Ferreira, Liliana Silva, Francesco Renna, Hanja Brandl, Julien Renoult, Damien Farine, Rita Covas, Claire Doutrelant.
- DOI: https://doi.org/10.1111/2041-210X.13436
- Link: https://besjournals.onlinelibrary.wiley.com/doi/10.1111/2041-210X.13436
- List of institutions involved in the research: Centre for Functional and Evolutionary Ecology, University of Porto, Max Planck Institute of Animal Behavior, University of Paris-Saclay, University of Konstanz, UCT FitzPatrick Institute of African Ornithology