idw – Informationsdienst Wissenschaft

Nachrichten, Termine, Experten

Grafik: idw-Logo
Science Video Project
idw-Abo

idw-News App:

AppStore

Google Play Store



Instance:
Share on: 
03/20/2023 11:45

Digital Restoration: AI Algorithm Puts the Colour Back in Black and White Films

Susanne Filzwieser Kommunikation und Marketing
Technische Universität Graz

    TU Graz has developed an AI-based algorithm that colours black-and-white images realistically. This is particularly interesting for the restoration of historical recordings.

    Countless historical photographs are stored in black and white in the world’s archives. Today, these cultural assets and contemporary documents are conserved by means of digitisation and (partially) improved through digital restoration. Efforts have been made since the 1970s to colourise this film footage. However, there was no real progress – the effort and the associated costs for manual or semi-automatic colouring techniques were too high. It is possible in principle to colour films fully automatically. However, this has the disadvantage that the colours may be nice to look at, but they are not true to reality.

    This is exactly where the project “RE:Color: Efficient colouring of films in cinema quality based on novel machine learning methods” at Graz University of Technology (TU Graz) came in. Computer scientists led by Thomas Pock from the Institute of Computer Graphics and Vision together with the Graz-based company specialised in the restoration of historical films HS-ART (https://www.hs-art.com) have developed an integrated software application that combines interactive and automated colouring techniques with deep learning technologies. The result is an algorithm for a predominantly automatic, yet fully user-controlled colouring process.

    Realistic colouring

    According to Pock, it is essential that humans can influence the colouring process: “You always need someone who is familiar with the historical traditions who can say what the clothes, the facades, etc. looked like back then. Was the soldier’s uniform green or blue? No algorithm can decide that, but it can learn from it.” The algorithm must therefore be fed with a sufficiently large collection of training samples in order to then automatically take over the colouring of historical films. “It’s about colouring the films as efficiently as possible with as little user input as possible. This can mean, for instance, that a person specifies the colouring for a film frame and the software then takes over the colouring of further frames,” explains Pock. This central requirement of user-guided control is only fulfilled thanks to pre-trained neural networks that can be dynamically influenced by user interaction.

    For this purpose, the researchers have developed different novel approaches in the field of automated colouring based on artificial intelligence (AI). Together with the developers of HS-Art, they then implemented the most efficient approach in a prototype application and generated a sufficiently powerful collection of training samples. Then the implementation of human-guided control took place to obtain authentic and appropriate colour schemes.

    Authentic image noise

    With the algorithms developed, the films can be restored extremely cleanly and also coloured – but this is not always necessarily desirable. Pock: “With historical footage and cinema films in general, you need a certain amount of noise, so-called “film grain”, otherwise it doesn’t look authentic to the audience. For this reason, the software can also artificially generate and add this noise again after restoration and colouring.”

    The core algorithm was published at a major international symposium, and the source code is freely available. For efficient use, however, software based on this, which was developed by the project partner HS-Art and is in their product portfolio, is necessary. The “Diamant film colorizer” was used, for example, in the ZDFzeit documentary series “Hitler’s Power” to colour historical footage true to the original.


    Contact for scientific information:

    Thomas POCK
    Univ.-Prof. Dipl.-Ing. Dr.techn.
    TU Graz | Institute of Computer Graphics and Vision
    Tel.: +43 316 873 5056
    thomas.pock@tugraz.at


    More information:

    Showreel Diamant-Film Colorizer (YouTube)


    Images

    Criteria of this press release:
    Journalists, Scientists and scholars
    Art / design, Cultural sciences, Information technology
    transregional, national
    Cooperation agreements, Research projects
    English


     

    Help

    Search / advanced search of the idw archives
    Combination of search terms

    You can combine search terms with and, or and/or not, e.g. Philo not logy.

    Brackets

    You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).

    Phrases

    Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.

    Selection criteria

    You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).

    If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).