idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
idw - Informationsdienst
Wissenschaft
Report: Baden-Wuerttemberg Cooperative State University
A recent study by the DHBW Stuttgart at the Service Management Study Center (ZMM) investigated the ability of Artificial Intelligence (AI) to recognize discriminatory content in images and advertisements, showing both impressive progress as well as existing limitations.
In this comprehensive study, AI was confronted with a variety of images and advertisements and asked to evaluate them. This included 60 advertisements, among others, that the German Advertising Council had recently criticized. The results show that AI has an astonishing ability to identify discriminations in advertisements with impressive accuracy (F1 Score: 0.949). As a result, the AI generally assessed the advertisements criticized by the German Advertising Council as potentially discriminatory. At the same time, in most cases, non-discriminatory advertisements did not receive such a warning.
This is particularly impressive considering that just ten years ago, AI had significant
difficulties in correctly classifying objects depicted in an image. In the meantime, and thanks to millions of images, AI has learned to largely accurately distinguish between a dog and a cat. The rapid progress of AI raises the question of where its current limits lie. "We wanted to know to what extent AI recognizes discriminatory behaviour when it is only presented with an advertisement and asked to evaluate it," explains student Helen Beckers about the approach of the study.
Algorithmic Discrimination
This is of particular relevance in light of the massive increase in discrimination by algorithms that can disadvantage people based on gender, religion, ideology, racism, or origin. This aspect is becoming more important as discrimination by algorithms is increasingly becoming a serious problem affecting various areas such as application processes, credit allocation, medicine, and the calculation of the recidivism probability of offenders.
ChatGPT's Ability to Uncover Sexualization and Stereotypes
The insight that ChatGPT can detect sexualization and stereotypical thinking is particularly revealing. A modified advertisement with swapped gender roles showed that AI can also identify discrimination in reversed situations. "This different evaluation by ChatGPT in the two scenarios highlights the ability to identify discrimination even in reversed situations," says student Sven Peter, sharing another finding from the study.
Limits and Challenges in Discrimination Recognition by AI
However, AI reached its limits in identifying other forms of discrimination, such as objectification, disrespect, and abuse of power. "The results of the study underscore the need to further develop AI systems to recognize discrimination more effectively and prevent it," reports student Marius Funk. The study raises important questions about how AI technologies can be used in the future to combat discrimination in various areas and promote equality.
Service Management Study Center
The study was conducted under the leadership of Prof. Dr. U. Bucher at the Service Management Study Center (ZMM) at the DHBW Stuttgart. The Service Management Study Center prepares students for responsible business roles in innovative and customer-oriented projects as well as in various functional and Service areas of service companies.
DHBW Stuttgart
The Baden-Wuerttemberg Cooperative State University Stuttgart, with around 8,000 students in bachelor's and master's degree programs, is one of the largest higher education institutions in the Stuttgart and Upper Neckar regions. In cooperation with around 2,000 selected companies and social institutions, it offers more than 60 nationally and internationally recognized, work-integrated study programs in the fields of business, engineering, social work, and health. Bachelor students alternate every three months between the university and the training company, their dual partner. In this way, they gain professional experience during their studies. Financial independence, secure job market opportunities due to exceptionally high recruitment rates, small class sizes, and an international orientation offer tremendous advantages to students. Beyond the bachelor's degree, DHBW offers a dual master's program.
More information at: www.dhbw-stuttgart.de
Prof. Dr. Ulrich Bucher
Baden-Wuerttemberg Cooperative State University Stuttgart (DHBW Stuttgart)
Theodor-Heuss-Str. 2
70174 Stuttgart
Germany
E-Mail: ulrich.bucher@dhbw-stuttgart.de
mobile: +49 177 / 2307 364
Merkmale dieser Pressemitteilung:
Journalisten, Wirtschaftsvertreter, Wissenschaftler
Gesellschaft, Informationstechnik, Medien- und Kommunikationswissenschaften, Wirtschaft
überregional
Forschungs- / Wissenstransfer, Forschungsergebnisse
Englisch
Sie können Suchbegriffe mit und, oder und / oder nicht verknüpfen, z. B. Philo nicht logie.
Verknüpfungen können Sie mit Klammern voneinander trennen, z. B. (Philo nicht logie) oder (Psycho und logie).
Zusammenhängende Worte werden als Wortgruppe gesucht, wenn Sie sie in Anführungsstriche setzen, z. B. „Bundesrepublik Deutschland“.
Die Erweiterte Suche können Sie auch nutzen, ohne Suchbegriffe einzugeben. Sie orientiert sich dann an den Kriterien, die Sie ausgewählt haben (z. B. nach dem Land oder dem Sachgebiet).
Haben Sie in einer Kategorie kein Kriterium ausgewählt, wird die gesamte Kategorie durchsucht (z.B. alle Sachgebiete oder alle Länder).
