Fraunhofer-Gesellschaft
Fraunhofer-Gesellschaft

Research and Projects

Research and Development for the Future of Media

The institutes of the Fraunhofer Business Area Digital Media are working in various research project on international, european and national levels for new production, distribution and projection technologies.

Current Projects

 

© Mediteraneo - stock.adobe.com

Allinga: Data-secure speech solutions for professional environments

Voice assistants play a key role in the digitalization of business and society. The technology simplifies interaction between humans and machines and saves valuable time which can be used for other tasks. Allinga is a joint development by the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS and the Fraunhofer Institute for Integrated Circuits IIS, using the latest AI technology. Two modules, namely speech recognition and speech synthesis are currently available.

 

© Nürnberger Symphoniker/ Fraunhofer IIS

SocialSTAGE-VR

Public events are a vital part of cultural life as they provide significantly more sensory sensations than just watching and listening to what happens on the stage. An important part of the individual experience is the presence of others in the audience with whom the evoked emotions can be shared. Due to personal reasons such as physical distance or global reasons a pandemic, this is not always possible, so a contemporary technical solution that goes beyond traditional formats is needed.  

 

© Paul Hahn/ Fraunhofer FOKUS

Virtual LiVe

The Virtual LiVe project aims to digitize physical event formats through the use of new immersive media formats (e.g. 3D audio, 360° video, light fields, volumetric video). Virtual LiVe is funded as part of the Fraunhofer-Gesellschaft's SME acute program "Research for SMEs".
Fraunhofer FOKUS, Fraunhofer HHI and Fraunhofer IIS are working together to find applicable high-end solutions for the event streaming needs of various players from different industries.

 

© Fraunhofer IIS

KISS Project

The KISS Project aims to develop and offer methods and tools for Deep Learning. It researches tools that generate better and more complete training data and allow for a more efficient training process. A second goal is the development of tools to transform trained deep neuronal networks into an efficient implementation on different possible hardware architectures. The joint project of Fraunhofer IIS and the Friedrich-Alexander-University Erlangen-Nürnberg is funded by the federal Ministry of Education and Research.

 

© Fraunhofer IIS

Dialog+

Dialog+ provides a solution for hard-to-understand speech overly loud background noise on TV. It is based on artificial intelligence and reduces the volume of music, sound effects or background noise to put spoken dialogue in the foreground. Developed by Fraunhofer IIS, the technology is easy to integrate into existing production processes.It does not replace the original audio mix, but instead offers an alternative that viewers can switch to if they so choose.

 

EN 17650 – The new standard for digital preservation of cinematographic works

EN17650 is a new European Standard from the CEN TC457 committee for the digital preservation of cinematographic works. It allows organising of their assets in a systematic way, the so called Cinema Preservation Package (CPP). This allows an easy exchange of content between archives, an unambiguous interpretation of metadata and the use of a well defined set technical and descriptive metadata.

 

© Fraunhofer FOKUS

FAMIUM DEEP ENCODE

The “FAMIUM Deep Encode” project is an automated approach to the per-title encoding process by leveraging machine learning techniques in order to avoid computationally heavy test encodes. The scalable architecture is made up of machine learning models, API’s and workers, of which, customers receive a content-tailored encoding ladder as an output. With this video analysis software, customers can experience an end-to-end codec-agnostic solution – from video upload to production encoding.

Concluded Projects

Orpheus

Key tools and apps for implementing object-based media for audio content have been developed by ORPHEUS, an EU-funded research project performed by ten major European media industry players.

SpatialAV

Development of an intelligent, modular, multi-sensory recording and production system for immersive audiovisual media.

PRIME

Production and projection technologies for immersive media; funded by the German Ministry of Economics and Technology.

Paper

Click here to read our White Papers and technical Papers:

Research Paper

Contact

For more Information, requests for projects or questions, you can contact us via E-Mail:

Back to our home page

Business Area Digital Media