Brainstorm promotes AI and machine learning in the European Emerald project

Funded by the European Commission, This project in which he participates Brainstorm focuses on the development and demonstration of AI tools, machine learning (ML) and Big Data for the Digital Entertainment and Media Industries.

Brainstorm, specialized in real-time 3D graphics, Virtual Sets & Augmented Reality Solutions, Participate in the European project Emerald Process Automation and AI for Entertainment and Sustainable Media, funded by the European Commission Under the program Horizon Europe.

The interdisciplinary consortium of Seven Partners Includes leading companies in live entertainment technology, streaming, Streaming & Cinema, as the British Broadcasting Corporation, Brainstorm Multimedia, Disguise Systems, Filmlight & MOG Technologies, and backed by two European Universities.

"Emerald strives to be a pioneer in Innovative Tools for the Digital Entertainment and Media Industries, Harnessing the Potential of Artificial Intelligence Technologies, machine learning and big data," he explains Francisco Ibanez, R+D project manager at Brainstorm-. The goal is to revolutionize processing, Improve production efficiency, minimise energy consumption and raise the quality of content with innovation".

As this manager points out, "There is currently amassive increase in the volume of video and extended reality-based content, with an unsustainable demand for trained human resources, Data Processing & Energy. This project aims to address this challenge by Development of process automation for the creation of sustainable means".

Javier Montesa, technical coordinator of R+D at Brainstorm, adds that, in collaboration with the Pompeu Fabra University (UPF), Deep learning-based methods and tools are being developed to separate video into two or more layers (Matting).

"The main goal is to produce high-quality results," he stresses- for the Automatic real-time integration of remote presenters or performers into scenes and virtual sets for broadcast and streaming media using deep learning, without the need for a trimap. With InfinitySet's AI enhancement, we'll bring the quality of green screen methods to simpler settings.".

Brainstorm has plans to integrate InfinitySet with UPF's deep learning systems for the estimation of head and body pose, This will allow the operator to activate content that will be automatically displayed in different parts of the scene, Virtual Screens, 3D graphics placeholders, or, simply, in front of the presenter as they move.

Thanks to this, "new ways to improve the insertion of the presenter will be explored, change your silhouette and calculate your shadow more accurately and realistically", Ensures.

In addition, The company will participate in the Creation of tools designed for automatic color balancing and the coincidence of shots. Color manipulations are necessary in post-production, in virtual productions and in virtual studios.

"The integration of this automatic color correction into InfinitySet will simplify the use of the tool and improve presenter-scene integration when lighting conditions are not controlled or when the virtual scene is destined to vary during a program.", Concludes.

Other articles on Brainstorm, Brainstorm Multimedia, European Commission Horizon Programme 2020, Emerald Project, Pompeu Fabra University