idw – Informationsdienst Wissenschaft
Nachrichten, Termine, Experten
Nachrichten, Termine, Experten
idw - Informationsdienst
Wissenschaft
AI-generated images are widespread on social media. Starting in August 2026, platforms will be required under the EU AI Act to label certain types of such content. A study by CISPA researcher Sandra Höltervennhoff investigates how users perceive these so-called AI labels and how they influence the credibility of information. The paper, “That’s another doom I haven’t thought about”: A User Study on AI Labels as a Safeguard Against Image-Based Misinformation, was presented at the Conference on Human Factors in Computing Systems (CHI 2026) and received an Honorable Mention.
AI-generated images play an increasingly important role in the spread of misinformation on social media. As a result, regulators and companies worldwide are introducing AI labels intended to mark content as “AI-generated.” A recent study by researchers from CISPA Helmholtz Center for Information Security, Ruhr University Bochum (RUB), and the Max Planck Institute in Bochum is the first to comprehensively examine how users react to such labels. The researchers combined qualitative focus groups with a large-scale online survey involving over 1,300 participants from the United States and Europe.
In the focus groups, participants discussed their general perceptions and expected usefulness of AI labels. The online survey, in contrast, aimed to measure their actual effect on information evaluation. “We simulated social media posts resembling news content,” explains Sandra Höltervennhoff, co-first author of the study together with Jonas Ricker from RUB. “Participants saw a text message paired with an image. The image was either AI-generated or real, and the text was either true or false. AI-generated images were labeled accordingly. This resulted in four conditions that allowed us to examine how AI labels influence perception.”
AI Labels: High Expectations, Limited Practical Benefit
Focus group results show that participants generally perceive AI labels as a helpful tool for identifying AI-generated images and avoiding deception. However, they also express strong concerns regarding implementation. Key issues include a lack of standardization, potential power concentration among platforms, and the reliability of technical solutions. A particularly important concern is mislabeling: Incorrect or missing labels are seen as a major risk that could undermine trust in the entire system. Despite these concerns, most participants support the introduction of AI labels.
The survey results paint a more ambivalent picture. AI labels can reduce belief in false content accompanied by AI-generated images. However, they also produce unintended side effects. Participants tended to rely heavily on the presence or absence of a label. As a result, unlabeled content was more likely to be perceived as true—even when it was false. Conversely, true content accompanied by an AI label was more often doubted. Overall, this reduced participants’ ability to reliably distinguish between true and false information.
Transparency Is Only One Component in Combating Misinformation
The findings suggest that labeling does not simply increase “truthfulness,” but instead changes how people evaluate information. Labels function as cognitive shortcuts: They guide attention and shape trust—often more strongly than the content itself. This shifts evaluation away from the actual information toward its label. “One possible explanation is that AI labels generally trigger skepticism,” says Höltervennhoff. “People become more cautious, but not necessarily more accurate in their judgments. In addition, there is currently a strong societal focus on warning about AI, which may cause other forms of misinformation to be overlooked. Yet misinformation existed long before AI.” Transparency thus provides orientation but does not replace critical engagement with information.
Toward a More Effective Design: A Combined Approach
For platforms, this presents a clear challenge: Labeling systems must not only be technically reliable but also designed in a way that avoids misinterpretation. “Transparency alone is not sufficient,” Höltervennhoff emphasizes. “What matters is how users understand and use this information. Therefore, labels can only be one component in dealing with AI-generated content.” To be effective, labels should be combined with additional measures such as educational campaigns, contextual information, and complementary verification mechanisms. In light of upcoming EU AI Act regulations, the study provides important practical insights: Labeling AI-generated content does not only affect transparency, but also fundamentally shapes how people perceive truth.
Sandra Höltervennhoff, Jonas Ricker, Maike M. Raphael, Charlotte Schwedes, Rebecca Weil, Asja Fischer, Thorsten Holz, Lea Schönherr, and Sascha Fahl. 2026. "That's another doom I haven't thought about": A User Study on AI Labels as a Safeguard Against Image-Based Misinformation. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26). Association for Computing Machinery, New York, NY, USA, Article 38, 1–32. https://doi.org/10.1145/3772318.3791006
Visualization to the paper "That’s another doom I haven’t thought about": A User Study on AI Labels ...
Copyright: CISPA
Criteria of this press release:
Journalists
Information technology
transregional, national
Research results, Transfer of Science or Research
English
You can combine search terms with and, or and/or not, e.g. Philo not logy.
You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).
Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.
You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).
If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).
