idw – Informationsdienst Wissenschaft

Nachrichten, Termine, Experten

Grafik: idw-Logo
Science Video Project
idw-Abo

idw-News App:

AppStore

Google Play Store



Instance:
Share on: 
06/02/2025 12:18

Audiovisual art project lets you experience “hearing with light”

Lena Bösch Stabsstelle Unternehmenskommunikation
Universitätsmedizin Göttingen - Georg-August-Universität

    Under the leadership of the University Medical Center Göttingen (UMG), researchers from Göttingen, together with audiologists and artists from the fields of film and music, have translated the sound experience with an optogenetic cochlear implant into image and sound. The music video artistically conveys the restoration of “hearing with light”, a technology that promises an improved hearing experience compared to conventional cochlear implants.

    What does it sound like when someone hears again for the first time after years of profound hearing loss or deafness? How does it feel when new technologies make the world of sound clearer and more differentiated than before? These are the questions addressed by the audiovisual music project “KLANGLICHT - sound of light”, an animated video in the style of a music video, created under the auspices of the University Medical Center Göttingen (UMG) in collaboration with scientists, audiologists and artists from the fields of music and film. The aim is to give the audience a tangible understanding of current Göttingen research into restoring “hearing with light”.

    According to the World Health Organization (WHO), 466 million people worldwide suffer from hearing loss that requires treatment, including around 16 million people with hearing loss and 80,000 deaf people in Germany. Those who have little hearing or are deaf from birth only learn to speak with difficulty, if at all. To date, hearing impairments in the inner ear can be partially corrected using electrical cochlear implants (eCI). These enable those affected to understand speech in a quiet environment, but the auditory impression is still far removed from natural hearing. Further development of hearing with a cochlear implant (CI) is required for complex auditory perception that allows speech to be understood in background noise, the emotional tone of speech to be interpreted or melodies in music to be enjoyed.

    Göttingen scientists from the Institute of Auditory Neuroscience at the University Medical Center Göttingen (UMG), the Else Kröner Fresenius Center for Optogenetic Therapies (EKFZ OT), the Cluster of Excellence “Multiscale Bioimaging: From Molecular Machines to Networks of Excitable Cells” (MBExC), the Collaborative Research Center (CRC) 1690 ‘Disease Mechanisms and Functional Recovery of Sensory and Motor Systems’ and the German Primate Center - Leibniz Institute for Primate Research (DPZ). They are developing novel optogenetic cochlear implants (oCI) that respond to finely dosed light stimuli.

    The audiovisual art project

    The specially composed piece of music begins with an explosion of initially fragmented sounds, rhythms and distorted speech passages, symbolizing the recovery of hearing through an eCI. In the course of the piece, these sounds change into a much clearer and more emotional musical part, whereby the listener experiences a completely new sensory world. This is intended to illustrate the possibilities of “hearing with light” through the oCI, which is currently being developed in Göttingen. Combined with an animation of pulsating light forms, flowing colors and rhythmic dance interludes, the music is brought to life (choreography and dance: Marie Zechiel). Around 2,500 hand-drawn images were required for the about two-minute video. The impression is created that music and speech are not only audible, but also visible.

    “This is where innovative research and art come together to communicate the new concept of optogenetic hearing restoration to society,” says Jenny Blum, audiologist at the Department of Otorhinolaryngology at the UMG and clinical contact for patients with cochlear implants. She was the initiator of the audiovisual music project and the driving force behind the artistic idea for many years.

    “This exciting project has succeeded in a unique way in capturing the fresh courage, drive and joyful anticipation of the researchers for better hearing,” says Prof. Dr. Tobias Moser, director of the Institute of Auditory Neuroscience at the UMG and spokesperson for the EKFZ OT and the MBExC.

    The film was directed by award-winning video artist Boris Seewald, with internationally renowned composer Ralf Hildenbeutel responsible for the music. Together they created a work that combines research, technology and emotion in an intense visual and auditory experience. The project was funded by the MBExC and the EKFZ OT.

    About the artists

    Boris Seewald is an award-winning video director. He treats film as visual choreography and composes images in a rhythmic flow that complements and expands music and sound. With a penchant for the experimental, he combines a wide variety of film techniques and combines abstract animation and painting with live-action film. His work has received numerous awards, including the Cinedans Dioraphte Jury Award, the Promax Gold Award and a nomination for the German Camera Award.

    Ralf Hildenbeutel is a producer and film composer whose eclectic style is characterized by his classical training and his passion for electronic music. In the nineties, he was instrumental in the emergence of the trance music style, worked with Sven Väth on his most important albums and toured Europe with his electronic project “Earth Nation”, performing at the Montreux Jazz Festival and London's Brixton Academy, among other venues. His focus has been on film music for years and he has worked on countless national and international productions such as “Vincent will meer”, “Maltese” (RAI), “Supersex” (Netflix) and “Everybody Loves Diamonds” (Amazon Prime).

    The Göttingen Cluster of Excellence MBExC

    The Göttingen Cluster of Excellence “Multiscale Bioimaging: From Molecular Machines to Networks of Excitable Cells” (MBExC) has been funded since January 2019 as part of the Excellence Strategy of the German federal and state governments. With a unique research approach, MBExC investigates the disease-relevant functional units of electrically active heart and nerve cells, from the molecular to the organ level, using innovative imaging techniques such as optical nanoscopy, X-ray imaging and electron tomography. To this end, MBExC brings together numerous university and non-university Göttingen Campus partners. The overarching goal: to understand the connection between heart and brain diseases, to carry out basic and clinical research and to develop new methods.

    The Else Kröner Fresenius Center for Optogenetic Therapies (EKFZ OT)

    The new Else Kröner Fresenius Center for Optogenetic Therapies at the UMG is funded by the Else Kröner-Fresenius Foundation, the state of Lower Saxony and the UMG. It develops innovative therapies for patients with deafness, blindness, movement disorders or gastric paralysis. Optogenetic therapies combine gene therapy with optical medical technology and promise more precise and effective treatment than conventional approaches - including in the area of hearing.


    Contact for scientific information:

    Prof. Dr. Tobias Moser, Institute of Auditory Neuroscience, Phone +49 551 / 39-63071, tobias.moser@med.uni-goettingen.de, www.auditory-neuroscience.uni-goettingen.de


    More information:

    - Music project “KLANGLICHT - sound of light”
    http://www.mbexc.de - Cluster of Excellence “Multiscale Bioimaging: From Molecular Machines to Networks of Excitable Cells” (MBExC)
    https://ekfz.uni-goettingen.de/ - Else Kröner Fresenius Center for Optogenetic Therapies (EKFZ OT)


    Images

    Composer Ralf Hildenbeutel, audiologist Jenny Blum, director of the Institute of Auditory Neuroscience Prof. Dr. Tobias Moser and video artist Boris Seewald.
    Composer Ralf Hildenbeutel, audiologist Jenny Blum, director of the Institute of Auditory Neuroscien ...

    umg/frank stefan kimmel


    Criteria of this press release:
    Journalists
    Biology, Medicine, Music / theatre
    transregional, national
    Cooperation agreements, Research projects
    English


     

    Composer Ralf Hildenbeutel, audiologist Jenny Blum, director of the Institute of Auditory Neuroscience Prof. Dr. Tobias Moser and video artist Boris Seewald.


    For download

    x

    Help

    Search / advanced search of the idw archives
    Combination of search terms

    You can combine search terms with and, or and/or not, e.g. Philo not logy.

    Brackets

    You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).

    Phrases

    Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.

    Selection criteria

    You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).

    If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).