Game-changing technology to protect global fish stocks.

On 26 October 2016 our FishFace project was announced winner of the popular vote for the 2016 Google Impact Challenge: Australia. As a result, we were awarded $750,000 to develop this game-changing technology to protect global fish stocks, the livelihoods of coastal communities and provide a sustainable food source for billions of people.

Fish caught by the fishermen on Tetap Setia, a boat participating in TNC's fish tracking program use a measuring board to record the length of the fish at Kema, North Sulawesi, Indonesia October 4, 2017. The pictures will later be scanned and the data organized by species.

So what is FishFace?

FishFace is an idea for a machine learning device that will use facial recognition technology to automate the collation, at sea, of information on the species and numbers of fish caught, and use these data to inform management decisions. Initially FishFace is being developed and will be trialled in Indonesia’s deep-water snapper and grouper fisheries with the potential to be rolled out for fisheries around the world.

Through FishFace, The Nature Conservancy hopes to make a massive positive difference for global fisheries by collecting, organising, sharing and utilising the data essential for sustainable fisheries management. It will reduce overfishing and sustain the livelihoods of coastal communities worldwide.

Once developed, the FishFace device will be operated by the crew of a fishing vessel, typically at the moment that the fish is transferred from the chiller to the hold of the vessel for storage.

The machine learning engine that powers FishFace is being developed by Refind Technologies. Refind is a Swedish company providing intelligent sorting solutions using machine vision and deep learning. Refind’s aim is to reduce waste through automation, not only in the seas but also in the used electronics industry.

Why do we need FishFace?

The world is running out of fish. Global peak fish catch occurred in the 1980s and the global catch has been declining ever since. In fact, 64% of fisheries are now overfished and 90% of all fisheries have no effective management in place. The reason? Insufficient data. We simply don’t know which species are being caught where and in what quantities to inform sustainable management.

Rapidly rising demand combined with falling fish stocks risks a fisheries crisis, which would be a planetary disaster: one in 12 people on Earth depend on fisheries and aquaculture for their livelihood, and three billion people rely on seafood as their primary source of animal protein.

What progress has been made since FishFace won the 2016 Google Impact Challenge: Australia?

In the 12 months since winning the Google Impact Challenge, with partners we have been developing the machine learning algorithms to power FishFace. For example, FishFace has been successfully tested under laboratory conditions and we’ve developed a ‘starter’ algorithm that does a good job of identifying basics such as whether or not there is a fish present in an image. Development is ongoing to evolve the algorithm to identify species with high accuracy.

We’ve also been working a lot with fishermen in Indonesia to make sure we develop and test a FishFace device for deployment onboard mid-sized fishing vessels. For example, the device must take computer readable images of fish at high speed, must be able to withstand the stresses of a moving fishing vessel amidst the frequent spray of seawater and chemicals used in cleaning and disinfecting, and must be capable of begin powered by a wide range of voltage, current and frequency. And of course, FishFace needs to be able to identify a wide range of fish species and sizes.

Deny Tacalao, the captain of the Tetap Setia, a boat participating in TNC's fish tracking program takes a picture of fish caught by the boat, using a digital camera and a special measuring board to record the length of the fish at Kema, North Sulawesi, Indonesia October, 2017. The pictures will later be scanned and the data organised by species.
Captain Wempi Vanduim chats with TNC's Dieri Tarau after bringing in his camera with pictures of all the fish he caught on his last trip laid out on the measuring board which Dieri will identify by species at the TNC office in Kema, North Sulawesi, Indonesia October, 2017.
Fish landing site in Brondong, Lamongan, East Java, Indonesia October, 2017.