From gaming consoles to the deep ocean: Gamers train AI for underwater missions
Researchers at the Monterey Bay Aquarium Research Institute (MBARI) in California have developed FathomVerse, a game that challenges players to identify unknown sea creatures. The aim is to train the artificial intelligence of the yellow MiniROV robot used to explore the deep ocean.
Remotely operated by scientists such as Kakani Katija, MiniROV films and collects data on marine life such as rare jellyfish. The recorded images and videos of the organisms are uploaded to the FathomNet database, which forms the basis of the FathomVerse game. Gamers immerse themselves in a virtual ocean world, viewing images of real sea creatures, classifying them and earning points.
Their input improves the artificial intelligence, which is then able to better identify marine life in the real world. To date, more than 17,500 gamers have analysed nearly 48,000 images, representing about 14 percent of the FathomNet database. In one success story, the participants identified an orange creature with yellow spots and green eyes as a type of bony fish that the AI had previously failed to recognise.
Gamers are familiarized with training modules before the game starts
However, in order to correctly identify the life forms, a tutorial is required: In training modules, gamers learn to recognise various sea creatures - from jellyfish to rare deep-sea dwellers. Then they start missions where they have to identify and classify unknown organisms. Their entries are then compared with those of other gamers to reach a consensus. The data collected by the participants is reviewed by the researchers and used to improve the AI algorithms.
The long-term goal is to train artificial intelligence to the point where it can not only identify living creatures on its own, but robots like MiniROV can operate in the ocean completely autonomously without human control. This is not yet possible because AI often makes mistakes during identification. For example, the robot often confuses black coral or anemones with other organisms.
Thanks to the gamers, the AI is now improving its ability to distinguish between these species. And as MiniROV evolves, the FathomVerse continues to grow - a win-win for both science and gaming. The collaboration between gamers and scientists is accelerating ocean exploration and increasing our understanding of climate change.
Source(s)
