idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
For many years, we have relied on cameras, lidar, and radar to detect the environment around passenger cars. However, the perception of external sounds has been lacking, even regarding automated driving. That is why Fraunhofer IDMT-HSA is researching the integration of acoustic sensor technology in the KI4BoardNet project with The Hearing Car. The Oldenburg branch has now equipped research vehicles with new microphones and specially developed measurement technology. To test both, the team traveled to a test site in Sweden in spring together with project partner CARIAD SE.
Acoustic sensor systems and Fraunhofer measurement technology for automated driving in practical testing
Every day, we humans perceive different sounds. At an intersection, an electric vehicle drives past pedestrians, a dog barks on the other side of the street, and a cyclist rings his bell. An ambulance approaches in the distance. External microphones on cars are intended to help automated vehicles recognize emergency vehicles in traffic. However, other scenarios are also conceivable. For example, acoustic sensor technology can be combined with speech recognition systems to interact with the vehicle from outside via voice commands.
Robust technologies for use in wet, frosty, or hot conditions
A test drive in Sweden was conducted to determine how the newly developed and integrated measurement technology performs in terms of reliability and usability. The researchers wanted to find out how the microphones perform under different weather conditions and degrees of contamination.
“Together with CARIAD, the Volkswagen Group's automotive software company, we are testing and developing algorithms and microphone hardware at Fraunhofer IDMT in Oldenburg to prepare acoustic sensor technology for series production,” explains Moritz Brandes, project manager for The Hearing Car at the Fraunhofer Institute for Hearing, Speech and Audio Technology HSA. The researchers are applying their expertise in acoustic pattern recognition and sensor data fusion, as well as important domain knowledge. In addition to cold weather testing, regular tests are also carried out in southern Europe to investigate the influence of heat.
Some developments are part of the larger research project “KI4BoardNet”, which defines and further develops acoustic environment detection and board network architecture in modern vehicles, among other things. “Our tests show that exterior microphones can change the way we interact with our cars and, in combination with optical sensors, improve safety for automated driving functions,” says Hagen Jaeger, Product Owner Exterior Acoustic Perception at CARIAD. Initial analyses of data from road tests under various conditions – from snow and ice to heat and wet weather – show positive results.
Fraunhofer IDMT is now publishing documentary videos on its LinkedIn channel (https://www.linkedin.com/company/fraunhofer-idmt/) at regular intervals to document the journey of The Hearing Car to Sweden.
The vehicle electrical system as an intelligent component
The aim of the “KI4BoardNet” project is to develop the architectures, components, and design tools for the vehicle electrical system of the future. The project involves joint research and implementation of dynamic, AI-supported design processes and maximum automation in the development and production of vehicle electrical systems.
This is necessary because vehicle design increasingly involves digital components. The data for these components usually has to be processed in real time, which places high demands on the vehicle electrical system. At the same time, the number of electrical consumptions is increasing, as the requirements for the quality of the power supply. Fraunhofer IDMT is helping to define requirements for AI-enabled control units and the energy system for supplying power to AI-driven sensor technology. Vehicle information, such as the power consumption of an electric vehicle or its speed, will be combined with the recorded microphone data to open up new areas of application.
The technology development for The Hearing Car is funded by the Lower Saxony Ministry of Science and Culture and the Volkswagen Foundation in the “Vorab” program, as well as by the Federal Ministry of Research, Technology and Space (BMFTR) (https://www.bmbf.de/EN/) in the research project “Integrated agile E/E development for merged and standardized energy and data networks” – KI4BoardNet for short.
Hearing, Speech and Audio Technology HSA at Fraunhofer IDMT
in Oldenburg
Founded in 2008 by Prof. Dr. Dr. Birger Kollmeier and Dr. Jens-E. Appell, the Fraunhofer Institute for Digital Media Technology IDMT’s Branch for Hearing, Speech and Audio Technology HSA stands for market-oriented research and development with a focus on the following areas:
- Speech and event recognition
- Sound quality and speech intelligibility
- Mobile neurotechnology and systems for networked healthcare
With in-house expertise in the development of hardware and software systems for audio system technology and signal enhancement, the employees at the Oldenburg site are responsible for transferring scientific findings into practical, customer-oriented solutions.
Through scientific cooperation, the institute is closely linked to the Carl von Ossietzky University, Jade University of Applied Sciences, and the University of Applied Sciences Emden/Leer. Fraunhofer IDMT is a partner in the »Hearing4all« cluster of excellence and in the Collaborative Research Centre »Hearing Acoustics«.
Further information on https://www.idmt.fraunhofer.de/hsa
Contact for the media:
Christian Colmer
Head of Marketing and Communication
Fraunhofer-Institute for Digital Media Technology IDMT
Oldenburg Branch for Hearing, Speech and Audio Technology HSA
Marie-Curie-Str. 2
26129 Oldenburg
Phone +49 441 2172-436
christian.colmer@idmt.fraunhofer.de
http://www.idmt.fraunhofer.de/hsa
https://www.idmt.fraunhofer.de/hsa
Test vehicles of Fraunhofer IDMT and CARIAD SE are on the road to test new sensor and measurement te ...
Copyright: Fraunhofer IDMT
For the first time, Fraunhofer measurement technology developed in-house has been integrated into th ...
Copyright: Fraunhofer IDMT/Leona Hofmann
Criteria of this press release:
Business and commerce, Journalists, all interested persons
Economics / business administration, Information technology, Mechanical engineering, Social studies, Traffic / transport
transregional, national
Research projects, Transfer of Science or Research
English
You can combine search terms with and, or and/or not, e.g. Philo not logy.
You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).
Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.
You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).
If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).
