idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
Since programs such as ChatGPT and Dall-E have become available to the general public there has been intense discussion about the risks and opportunities of generative Artificial Intelligence (AI). These AI applications can greatly benefit people’s everyday lives, but can also be misused to create deep fakes or propaganda. In addition, all forms of generative AI reflect the data used to train them. There are now some strategies to counteract the lack of transparency and objectivity of generative AI. However, the authors of the discussion paper, published today in English by the German National Academy of Sciences Leopoldina, warn against placing too much faith in these strategies.
In “Generative AI – Beyond Euphoria and Simple Solutions” they take a realistic look at the possibilities and challenges regarding the development and application of generative AI.
The authors of the discussion paper argue for a nuanced view of technologies and tools that make generative AI more transparent and aim to discover and minimise distortions. They discuss dealing with bias as an example: Without an active attempt to counteract it, AI systems reflect the respective societal and cultural relations of their database and the values and inequalities contained therein. However, according to the authors, deciding whether and how to actively counteract this bias in the programming is no trivial matter. It requires technological and mathematical, as well as political and ethical expertise and should not be the sole responsibility of developers.
Strategies used to date to counteract the lack of transparency of generative AI also offer only a rather superficial solution. Users are often unable to understand how generative AI works. The still-new research field known as explainable AI develops procedures that aim to make AI-generated suggestions and decisions comprehensible retrospectively. However, the authors point out that the resulting explanations are also not reliable, even if they sound logical. It is even possible to deliberately manipulate explainable AI systems. The authors thus stress that generative AI should be used and developed with the utmost caution in cases where transparency is essential (for example in legal contexts).
They also elucidate the various possibilities for deception with respect to generative AI, for example when users are unaware that they are communicating with AI, or when they do not know what AI is or is not capable of. Users often attribute human capabilities such as consciousness and comprehension to AI. The quality, ease, and speed with which texts, images, and videos can now be generated creates new dimensions for possible misuse, for example when generative AI is used for propaganda or criminal purposes.
The discussion paper also addresses the issue of data protection. The success of generative AI is based partly on gathering and analysing users’ personal data. However, to date there is no convincing approach to ensure that users have the final say when it comes to the sharing and use of their data. The discussion paper has been published on the Leopoldina website: https://www.leopoldina.org/en/generative-ai
Publications in the series “Leopoldina Discussion” are contributions by the authors named. The Academy’s discussion papers offer scientists the opportunity to present thought-provoking ideas and to encourage and guide discussions flexibly and outside of formal working group processes.
The discussion paper was published in German on 17 October 2024 and an English translation is now available. It was created by the philosopher Professor Dr Judith Simon, Professor of Ethics in Information Technology at the University of Hamburg/Germany, the law expert Professor Dr Indra Spiecker gen. Döhmann, Professor of Digitalisation Law at the University of Cologne/Germany, and Leopoldina Member Professor Dr Ulrike von Luxburg, computer scientist and Professor of the Theory of Machine Learning at the University of Tübingen/Germany. The three researchers are members of the Leopoldina Focus Group “Digitalisation”. The focus group: https://www.leopoldina.org/en/policy-advice/focus-groups/digitalisation/
The Leopoldina on Bluesky: https://bsky.app/profile/leopoldina.bsky.social
The Leopoldina on X: https://www.twitter.com/leopoldina
The Leopoldina on YouTube: https://www.youtube.com/@nationalakademieleopoldina
About the German National Academy of Sciences Leopoldina:
As the German National Academy of Sciences, the Leopoldina provides independent science-based policy advice on matters relevant to society. To this end, the Academy develops interdisciplinary statements based on scientific findings. In these publications, options for action are outlined; making decisions, however, is the responsibility of democratically legitimized politicians. The experts who prepare the statements work in a voluntary and unbiased manner. The Leopoldina represents the German scientific community in the international academy dialogue. This includes advising the annual summits of Heads of State and Government of the G7 and G20 countries. With around 1,700 members from more than 30 countries, the Leopoldina combines expertise from almost all research areas. Founded in 1652, it was appointed the National Academy of Sciences of Germany in 2008. The Leopoldina is committed to the common good.
Media Contact:
Julia Klabuhn
Acting Head of the Press and Public Relations Department
Tel: +49 (0)345 472 39-800
Email: presse@leopoldina.org
https://www.leopoldina.org/en/leopoldina-home/
Criteria of this press release:
Journalists
Information technology, Philosophy / ethics, Social studies
transregional, national
Science policy
English
You can combine search terms with and, or and/or not, e.g. Philo not logy.
You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).
Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.
You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).
If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).
