Partially Randomized Procedure - Lottery and Peer Review

Since 2017, the Volkswagen Foundation is testing a new selection procedure for project applications: In the funding initiative "Experiment!", part of the funded projects are selected by an independent jury. Additionally, further projects are drawn from those applications that are suitable for the program and eligible for funding. Background and reactions to a new and unusual selection procedure.

Quality assurance is and remains absolutely indispensable for science. However, the limitations of peer review are becoming increasingly evident. New approaches are therefore urgently needed – such as the partially randomized selection of funded projects by lot. 19.11.2020

In our interview "High Level of Acceptance for Project Selection by Lot", Dr. Dagmar Simon and Dr. Martina Röbbecke from Evaconsult report on initial results from their accompanying research project on the partially randomized procedure applied in the "Experiment!" funding initiative. 12.11.2020

In our infographic, we explain the various stages in the selection of funded projects for the initiative "Experiment! - In Search of Bold Research Ideas". 10.12.2018

Selection processes in research funding are known to be unreliable, costly and prone to bias. Injecting some randomness into the process may improve science while improving fairness and efficiency, says Dorothy Bishop, a neuropsychologist in Oxford, who started a lively online-discussion among researchers. 08.11.2018

For the first time, the lot luck decides in the funding initiative "Experiment!" on the eligibility of project applications. With this procedure, the Volkswagen Foundation enters new territory in the funding landscape. 22.05.2018

Im Gespräch: Ulrike Bischler und Pavel Dutow, Koordinatoren der Förderinitiative "Experiment! – Auf der Suche nach gewagten Forschungsideen" der VolkswagenStiftung, erläutern das neue teil-randomisierte Auswahlverfahren. 21.06.2017

In addition to the jury decisions, a partially randomized procedure is employed by the Volkswagen Foundation in the funding initiative "Experiment!". An accompanying research project compares the two procedural elements "jury decision" and "lottery".