Fish caught by the fishermen on Tetap Setia, a boat participating in TNC's FishFace program, are photographed on a measuring board in Indonesia
FishFace Fish caught by the fishermen on Tetap Setia, a boat participating in TNC's fish tracking program use a measuring board to record the length of the fish at Kema, North Sulawesi © Ed Wray

Food & Water Stories

FishFace

Using game-changing technology to protect global fish stocks

On 26 October 2016, our FishFace project was announced the winner of the popular vote for the 2016 Google Impact Challenge: Australia. As a result, we were awarded $750,000 to develop this game-changing technology to protect global fish stocks, the livelihoods of coastal communities and provide a sustainable food source for billions of people.

So what is FishFace?

FishFace is an idea for a machine learning device that will use facial recognition technology to automate the collation, at sea, of information on the species and numbers of fish caught, and use these data to inform management decisions. Initially, FishFace is being developed and will be trialed in Indonesia’s deep-water snapper and grouper fisheries with the potential to be rolled out for fisheries around the world.

Through FishFace, The Nature Conservancy hopes to make a massive positive difference for global fisheries by collecting, organising, sharing and utilising the data essential for sustainable fisheries management. It will reduce overfishing and sustain the livelihoods of coastal communities worldwide.

Once developed, the FishFace device will be operated by the crew of a fishing vessel, typically at the moment that the fish is transferred from the chiller to the hold of the vessel for storage.

The machine learning engine that powers FishFace is being developed by Refind Technologies. Refind is a Swedish company providing intelligent sorting solutions using machine vision and deep learning. Refind’s aim is to reduce waste through automation, not only in the seas but also in the used electronics industry.

a man on a boat stands over some caught fish as they're being measured
Kema, North Sulawesi, Indonesia Deny Tacalao, the captain of the Tetap Setia, takes a picture of caught fish using a digital camera and a special measuring board. © Ed Wray

Why do we need FishFace?

The world is running out of fish. Global peak fish catch occurred in the 1980s and the global catch has been declining ever since. In fact, 64% of fisheries are now overfished and 90% of all fisheries have no effective management in place. The reason? Insufficient data. We simply don’t know which species are being caught where and in what quantities to inform sustainable management.

Rapidly rising demand combined with falling fish stocks risks a fisheries crisis, which would be a planetary disaster: one in 12 people on Earth depend on fisheries and aquaculture for their livelihood, and three billion people rely on seafood as their primary source of animal protein.

a man pointing to a chart of fish
Identifying fish for FishFace TNC has been working with fishermen aboard midsize fishing boats to develop FishFace technology. © Ed Wray

What progress has been made since FishFace won the 2016 Google Impact Challenge: Australia?

In the 12 months since winning the Google Impact Challenge, with partners we have been developing the machine learning algorithms to power FishFace. For example, FishFace has been successfully tested under laboratory conditions and we’ve developed a ‘starter’ algorithm that does a good job of identifying basics such as whether or not there is a fish present in an image. Development is ongoing to evolve the algorithm to identify species with high accuracy.

We’ve also been working a lot with fishermen in Indonesia to make sure we develop and test a FishFace device for deployment onboard mid-sized fishing vessels. For example, the device must take computer readable images of fish at high speed, must be able to withstand the stresses of a moving fishing vessel amidst the frequent spray of seawater and chemicals used in cleaning and disinfecting, and must be capable of begin powered by a wide range of voltage, current and frequency. And of course, FishFace needs to be able to identify a wide range of fish species and sizes.

a man up to his waist in water near some fishing boats.
Brondong, Indonesia A fishermen brings a boat into the port at Brondong, Lamongan, East, Java, Indonesia. © Ed Wray