idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
Berlin, November 23, 2022 -- The Fraunhofer Heinrich Hertz Institute (HHI) has developed NNCodec, a new software that allows compressing neural networks to a fraction of their size without loss of accuracy. For non-commercial use only, NNCodec is now available as a free download via the software development platform GitHub. NNCodec specifically addresses research groups and development teams in the field of Artificial Intelligence (AI), as it provides a powerful and standard-compliant solution.
Artificial Intelligence (AI), as it provides a powerful and standard-compliant solution.
NNCodec is an open-source, user-friendly software that includes encoder and decoder modules for neural network compression. This software implements the new MPEG standard "Neural Network Coding (NNC - ISO/IEC 15938-17:2022)", significantly co-developed by Fraunhofer HHI and formally approved by ISO/IEC in August 2022.
Neural networks are the backbone in most AI technologies and have become essential for many applications. As a result, different neural network architectures have emerged for various use cases. Simultaneously, these networks are becoming increasingly complex, i.e. the number of layers, links and parameters has increased dramatically. Thus, neural networks require fast-growing computing power and memory. Without efficient compression, neural networks can hardly be integrated into mobile phones. At the same time, complex neural networks require a high data transmission rate.
With NNCodec, an efficient software solution is now available, which compresses trained neural networks to 5-10% of their original size, while maintaining their inference accuracy. This allows neural networks to be efficiently stored and transferred to other AI applications. Among the many scenarios that benefit from using the NNC standard are 5G applications, image and video compression, 3D reconstruction and coding methods, as well as AI technologies for mobility, such as autonomous driving. Especially in distributed learning environments, e.g., federated learning, neural network updates need to be sent regularly between participating devices. Here, the NNC standard allows for significantly reducing the required communication bit rate.
"We are proud to have contributed major technologies for the NNC standard and to release NNCodec, an open-source and user-friendly software realization of NNC, just a few months after the formal approval of the standard," says Dr. Detlev Marpe, head of the department "Video Communication and Applications" at Fraunhofer HHI. Prof. Wojciech Samek, head of the "Artificial Intelligence" department at Fraunhofer HHI further comments: "We are happy to serve a wide range of applications for the latest AI developments and neural networks, such as CNNs, auto-encoders or transformer networks with this optimized software solution."
The NNCodec software with encoder and decoder modules is available on GitHub since 21/11/2022. More detailed information can be found at: Neural Network Codec (see link below).
About the Fraunhofer Heinrich Hertz Institute
Driving digitization forward and making it as resource-efficient as possible is a guiding principle of research and development work at Fraunhofer HHI. Divided into seven research departments, around 570 employees in Berlin and Goslar work on various digitization topics. The scientists are concerned with optical networks and systems, photonic components, fiber optic sensor systems, wireless communication and networks, video communication and applications, vision and imaging technologies, and artificial intelligence. Thematically, Fraunhofer HHI is broadly positioned to help shape societal progress in multiple areas.
Dr. Detlev Marpe | detlev.marpe@hhi.fraunhofer.de | Phone +49 30 31002-619
Prof. Wojciech Samek | wojciech.samek@hhi.fraunhofer.de | Phone +49 30 31002-417
https://www.hhi.fraunhofer.de/nnc
NNCodes Logo
© Fraunhofer HHI
Merkmale dieser Pressemitteilung:
Journalisten, Wirtschaftsvertreter, Wissenschaftler
Elektrotechnik, Informationstechnik
überregional
Forschungs- / Wissenstransfer, Forschungsergebnisse
Englisch
NNCodes Logo
© Fraunhofer HHI
Sie können Suchbegriffe mit und, oder und / oder nicht verknüpfen, z. B. Philo nicht logie.
Verknüpfungen können Sie mit Klammern voneinander trennen, z. B. (Philo nicht logie) oder (Psycho und logie).
Zusammenhängende Worte werden als Wortgruppe gesucht, wenn Sie sie in Anführungsstriche setzen, z. B. „Bundesrepublik Deutschland“.
Die Erweiterte Suche können Sie auch nutzen, ohne Suchbegriffe einzugeben. Sie orientiert sich dann an den Kriterien, die Sie ausgewählt haben (z. B. nach dem Land oder dem Sachgebiet).
Haben Sie in einer Kategorie kein Kriterium ausgewählt, wird die gesamte Kategorie durchsucht (z.B. alle Sachgebiete oder alle Länder).
