New research by ESMT Berlin and Politecnico di Milano explores how non-experts assess scientific research proposals and reveals key implications for public participation in science funding. The study shows that while citizens value both social impact and scientific merit, their judgments can be shaped by personal interests, income, and education.
The paper, published in Research Policy, is co-authored by Henry Sauermann (ESMT Berlin), Chiara Franzoni, and Diletta Di Marco (both of Politecnico di Milano). It involved more than 2,300 citizen evaluators who assessed four real research proposals using both a recommendation mechanism (advising a funding agency) and a crowdfunding mechanism (donating their own money). The proposals covered a diverse range of topics including COVID-19 drug discovery, Alzheimer’s, otter-human conflict in Florida, and economic preferences across demographic groups.
Each participant read a real research proposal from the science crowdfunding platform experiment.com and then assessed it based on three core criteria:
• Scientific merit, the extent to which the project would advance academic knowledge
• Social impact, the project’s potential to benefit society, health, or the environment
• Team qualifications, the perceived ability of the research team to deliver on the project
The researchers found that when making their final funding decisions, participants weighed social impact and scientific merit nearly equally, while team qualifications played a smaller but still important role. “Our findings challenge the simplistic idea that nonscientists care only about feel-good impacts,” said Henry Sauermann, professor of strategy at ESMT. “People care whether the science is solid, and the researchers are credible, even if they also prioritize relevance to real world problems.”
The choice of evaluation mechanism strongly influenced who participated. Crowdfunding, which required participants to contribute their own money, gave greater voice to more affluent and educated individuals. The recommendation mechanism, in contrast, enabled broader and more inclusive engagement. This suggests that the choice of funding mechanism strongly shapes whose voices are heard. Personal connection also shaped perceptions. Participants who had a direct link to the topic were more likely to support the proposal and rate its potential impact higher. This suggests that self-interest or wishful thinking may influence public judgments. “Involving the public in science can democratize decision making, but it can also introduce new biases,” said Chiara Franzoni, professor at Politecnico di Milano. “Evaluation processes must be carefully designed if we want to include citizen input in meaningful and responsible ways.”
The researchers emphasize that evaluation patterns varied across topics, and different citizens prioritized different criteria. This variability presents a challenge for science governance: The processes of citizen involvement are difficult to manage and their outcomes difficult to predict.
Rather than choosing between expert review and public input, the authors propose hybrid systems that integrate both. While experts bring technical knowledge and methodological rigor, citizens may better reflect societal needs and priorities. Combining the two could strengthen both the quality and legitimacy of research funding decisions.
As policymakers and funding bodies consider expanding the role of citizen input in science, the authors call for thoughtful process design. “We should embrace public engagement not as a slogan,” said Sauermann, “but as a complex process that requires careful scaffolding, evaluation, and reflection.”
Henry Sauermann (henry.sauermann@esmt.org)
https://www.sciencedirect.com/science/article/pii/S0048733325000435
DOI:10.1016/j.respol.2025.105214
Criteria of this press release:
Journalists, Scientists and scholars
interdisciplinary
transregional, national
Research results, Transfer of Science or Research
English
You can combine search terms with and, or and/or not, e.g. Philo not logy.
You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).
Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.
You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).
If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).