idw – Informationsdienst Wissenschaft

Nachrichten, Termine, Experten

Grafik: idw-Logo
Science Video Project
idw-Abo

idw-News App:

AppStore

Google Play Store



Instance:
Share on: 
01/20/2025 14:11

AI-Powered Data Analysis Uncovers Issues in Scientific Publications

Christine Xuan Müller Stabsstelle Kommunikation und Marketing
Freie Universität Berlin

    Study Reveals: Chemical Research Reports Often Contain Inaccurate Measurement Data

    AI-powered data analysis tools have the potential to significantly improve the quality of scientific publications. A new study by Professor Mathias Christmann, a chemistry professor at Freie Universität Berlin, has uncovered shortcomings in chemical publications. Using a Python script developed with the help of modern AI language models, Christmann analyzed more than 3,000 scientific papers published in the prestigious organic chemistry journal Organic Letters over the past two years. The analysis revealed that only forty percent of the chemical research papers contained error-free mass measurements.

    The AI-based data analysis tool used for this purpose could be created without any prior programming knowledge.

    “The results demonstrate how powerful AI-powered tools can be in everyday research. They not only make complex analyses accessible but also improve the reliability of scientific data,” explains Christmann. Advanced large language models such as ChatGPT (OpenAI), Gemini (Google), and Claude (Anthropic) now allow natural language to be translated directly into computer languages like Python. This enables researchers without coding backgrounds to create applications that, for instance, search through large datasets for specific text components or measurement values. The data obtained in this way can then be automatically processed further and checked for plausibility.

    Christmann’s study, “What I Learned from Analyzing Accurate Mass Data of 3000 Supporting Information Files,” used an AI-powered data analysis tool to uncover previously unknown systematic errors. It also identified instances where miscalculated values appeared to be validated by measurements. “These observations raise the question of whether some measurements may have been fabricated,” the researcher emphasizes.

    This study, published as an open-access paper, demonstrates how AI tools can enhance scientific integrity through automated quality control and systematic error detection.
    As part of an “AI in Education” initiative, Freie Universität Berlin’s Department of Biology, Chemistry, Pharmacy plans to integrate these and similar tools into its curriculum. “They will help students develop strong data analysis skills and critical thinking abilities,” says Christmann. “AI tools will be valuable in preparing students for their research careers.”


    Contact for scientific information:

    Prof. Dr. Mathias Christmann, Department of Biology, Chemistry, Pharmacy, Freie Universität Berlin, Email: mathias.christmann@fu-berlin.de
    Homepage of Professor Mathias Christmann: https://www.bcp.fu-berlin.de/en/chemie/chemie/forschung/OrgChem/christmann/index...


    Original publication:

    https://pubs.acs.org/doi/10.1021/acs.orglett.4c03458


    Images

    Chemistry Lab and a Python code on a screen.
    Chemistry Lab and a Python code on a screen.

    Mathias Christmann


    Criteria of this press release:
    Journalists, Scientists and scholars, Students, all interested persons
    Chemistry, Information technology, Language / literature
    transregional, national
    Research results, Scientific Publications
    English


     

    Chemistry Lab and a Python code on a screen.


    For download

    x

    Help

    Search / advanced search of the idw archives
    Combination of search terms

    You can combine search terms with and, or and/or not, e.g. Philo not logy.

    Brackets

    You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).

    Phrases

    Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.

    Selection criteria

    You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).

    If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).