In the case of highly competitive procedures, the lottery relieves the burden on reviewers faced with the problem of differentiating quality among a large number of equally high-ranking proposals.
Decisions by lot are free of any bias and of any influences caused by group dynamics.
The lot is blind to quality. To work properly, therefore, the process requires an initial quality assurance.
In the event where a reviewer panel does not cover all topics equally well, such a procedure ensures fairness among eligible applications.
Regarding the outcome, diversity is enhanced by drawing lots. Often, procedures based on consensus tend to favor established topics and conventional methods ("mainstreaming").
Accompanying research shows that the partially randomized selection, i.e. including a lottery, encourages the submission of risk-taking research proposals.
The introduction of a randomized element is broadly welcomed by the scientific community, including reviewers, and by an increasing number of funding organizations.
Selection by lot has to be regarded as a useful supplement – but not an alternative – to peer review and cannot replace scientific discourse.
You can download a printable version of the 8 theses here (PDF).
The accompanying research project
The lottery as a new selection element and the entire selection process are being evaluated. In our interview "High level of acceptance for project selection by lot", Dr. Dagmar Simon and Dr. Martina Röbbecke (Evaconsult) report on initial results from their accompanying research project.
Infographic on the selection of funded projects for the 'Experiment!' initiative.
Free Download (English abstract): "Die Macht des Zufalls - Neue Wege für die Förderung riskanter Forschungsideen?" (PDF) by Martina Röbbecke and Dagmar Simon, from: Fo 1+2, 2020, Universitätsverlag Webler.