idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
Today, the Fraunhofer Institute for Digital Media Technology IDMT is able to announce that Active Ambient Lighting with Sound Visualisation, developed by Mercedes-Benz AG in cooperation with the German research institute, has been integrated into its 2023 E-Class series of automobiles. With the new tool, the lighting mood in the vehicle adapts to the music and sounds being played.
Thanks to the new Active Ambient Lighting, passengers can now experience music with three senses: they hear the music, they "feel" the music by means of integrated sound resonating transducers in the car seats, and, as of this year, they "see" the music thanks to the matching lighting control add-on by Fraunhofer IDMT. For this novel visual experience, the light strips are used which are installed in the instrument panel and in the front door panels.
+++Fraunhofer IDM T's know-how for a new music experience in the car+++
For the development and technical implementation of the new interior feature, the German automaker relied on the Ilmenau research institute's years of expertise in the field of real-time processing of audio data. Fraunhofer IDMT is internationally renowned for its audio signal processing and music analysis know-how using Artificial Intelligence (AI) and has already been a research and development partner for various interactive music applications.
There were several challenges to overcome when implementing the sound-controlled light adaptation. For example, the spectral and dynamic characteristics of various audio signals – from speech to hip-hop, classical, smooth jazz, and heavy metal – had to be transformed into a beat-synchronized color visualization in real-time.
+++Time-synchronous music visualization+++
"Correlated visualization with low latency is enormously important for the synchronous experience of sound and light. This is quite crucial for the emotional effect", explains Holger Grossmann, principal researcher at Fraunhofer IDMT´s Semantic Music Technologies group.
With the new audio-driven light rendering technology, time-synchronous music visualization is made possible. For example, fast sequences of beats are visualized by means of rapid changes of light, and flowing rhythms tend to be depicted with softly merging light moods.
Another challenge was that the sound-matched light rendering had to work for both loud and soft sounds, even when the differences between the sounds of a piece of music are very small.
"Thus, our intelligent signal analysis installed in the car has to adapt very flexibly to the respective audio data", says Holger Grossmann.
+++Balanced visualization of sounds+++
For safe use in the vehicle, it was also important to ensure a balanced visualization of the sounds so as not to distract the driver from what is happening on the road.
"We are proud that we can now tell another success story of our intelligent music analysis with the sound visualization for the new generation E-Class-cars, and we look forward to future next-generation collaborations”, says Holger Grossmann.
Holger Großmann
holger.grossmann@idmt.fraunhofer.de
https://www.idmt.fraunhofer.de/en/Press_and_Media/press_releases/2023/Fraunhofer... - Link to the press release on the Fraunhofer IDMT website
In the new E-Class from Mercedes-Benz AG, music can also be experienced visually thanks to intellige ...
Mercedes-Benz AG
Merkmale dieser Pressemitteilung:
Journalisten, Wirtschaftsvertreter, jedermann
Elektrotechnik, Informationstechnik
überregional
Buntes aus der Wissenschaft, Forschungsergebnisse
Englisch
In the new E-Class from Mercedes-Benz AG, music can also be experienced visually thanks to intellige ...
Mercedes-Benz AG
Sie können Suchbegriffe mit und, oder und / oder nicht verknüpfen, z. B. Philo nicht logie.
Verknüpfungen können Sie mit Klammern voneinander trennen, z. B. (Philo nicht logie) oder (Psycho und logie).
Zusammenhängende Worte werden als Wortgruppe gesucht, wenn Sie sie in Anführungsstriche setzen, z. B. „Bundesrepublik Deutschland“.
Die Erweiterte Suche können Sie auch nutzen, ohne Suchbegriffe einzugeben. Sie orientiert sich dann an den Kriterien, die Sie ausgewählt haben (z. B. nach dem Land oder dem Sachgebiet).
Haben Sie in einer Kategorie kein Kriterium ausgewählt, wird die gesamte Kategorie durchsucht (z.B. alle Sachgebiete oder alle Länder).
