Snap a Bird Photo and This App Tells You the Species – Seeker
Backyard birders have another tool in their arsenal, with a newly updated smartphone app that can recognize a bird species by analyzing a photo.
Much like facial recognition systems, the app – The Merlin Bird Photo ID, created by researchers from Caltech and Cornell University – only needs a clear, quality photo to begin matching the picture against a database of 650 North American bird species it currently stores.
Users simply show the app their bird photo, tell the program where and in what time of year the winged wonder was spotted, and then wait a moment to see if Merlin comes up with an answer.
If it thinks it’s identified the bird, the app supplies one or more possible suspects, with details about the bird’s markings, behavior and breeding. Also supplied are juvenile and adult photos, sample calls from the bird, and a map showing the animal’s year-round, breeding, migrating and non-breeding ranges throughout North America.
The researchers say, in a press release, that the program will be correct about 90 percent of the time, assuming a quality picture and, of course, that the bird is present in the database.
Does it work as advertised? This author supplied the app with a picture of a sharp-skinned hawk taken in his backyard and the program indeed returned the correct hawk species as a potential identification, along with a second possibility, a Cooper’s hawk, which looks a lot like a sharp-skinned. The picture was somewhat dark, originally taken by smartphone at “web photo” image quality, so at least in that case the app seemed pretty agile.
If it finds your bird, the Merlin Bird Photo ID tells you all you need to know about it.
To build the app’s database of species, computer scientists from Cornell and Caltech fed it almost 1 million photos of birds, including data about species and key physical characteristics such as wings, claws and beak. The Merlin system draws on that information and also considers the bird’s reported location and the time of year – with help from eBird’s vast store of data – to supply its answers.
Caltech engineering professor Petro Perona said the app is part of a wider vision centered around machine learning and visual classification.
“Ultimately,” Perona said, “we want to create an open platform that any community can use to make a visual classification tool for butterflies, frogs, plants, or whatever they need.”
Perona co-founded Visipedia a project funded by Google that works to improve the identification of objects in photos.
“A machine that recognizes objects in images, like humans do, was a distant dream when I was a graduate student and now it’s finally happening,” said Perona.
The Merlin Bird Photo ID is free to download on iOS and Android through Apple iTunes and Google Play. It’s an upgrade to the first Merlin bird app from 2014, which walked users through a series of questions to try to identify a bird they had seen.
WATCH VIDEO: Why Birds Can’t Stop Flying Into Things