BSC’s Saint George on a Bike AI Project Launches Crowdsourcing Campaign

BSC's Saint George on a Bike AI Project Launches Crowdsourcing Campaign

April 26, 2022 – Automatic Image Captions is a process that allows already trained models running on commodity computers to create text descriptions from an image. So far, no artificial intelligence system has been built and trained to help describe images of cultural heritage, taking into account the rules of scene formation and the time period of sacred icons from the 12th to the 18th centuries.

BSC's Saint George on a Bike AI Project Launches Crowdsourcing Campaign
Barcelona’s Supercomputing Center leads St. George on the bike project.

The Saint George on a Bike project, led by the Barcelona Supercomputing Center in collaboration with the Europeana Foundation, aims to provide metadata enrichment capabilities to the cultural heritage field by leveraging High Performance Computing (HPC) resources for training artificial intelligence models. The basic idea is to use natural language processing and deep learning algorithms to train a caption generation model based on tens of thousands of images and text descriptions; As a result, descriptions of hundreds of thousands of images from different European cultural heritage repositories can be automatically generated, which will reflect an understanding of culture, symbols and historical context.

The results of the project will be useful to both specialists in cultural heritage and the public in general. Rich annotations will allow for good indexing, which translates to better access to collections and a better experience for navigating through collection catalogs. These results can be used for educational, creative or tourism projects.

In this regard, the project launched a crowdsourcing campaign in Zooniverse, a citizen science portal based on peer-to-peer collaboration, in order to collect as many manual annotations as possible to train the automatic caption generator and, eventually, create natural language descriptions for the visual content of artworks . The ultimate goal of this campaign is to take a step forward in making art more understandable and accessible by suggesting the automatic generation of rich descriptions of paintings.

Everyone is invited to participate in this crowdsourcing campaign. To do this, participants can access the Zooniverse using this link. BSC and Saint George’s bike project helped make culture and history accessible to people.


Source: Barcelona Supercomputing Center

Source link

Leave a Comment