The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

Schweinsberg, M and Madan, N and Vianello, M (2016) The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. Journal of Experimental Social Psychology, 66. 55 - 67.

Full text not available from this repository. (Request a copy)


This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40 of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed.

Affiliation: Indian School of Business
ISB Creiators:
ISB Creators
Madan, N
Item Type: Article
Additional Information: The research paper was published by the author with the affiliation of INSEAD
Uncontrolled Keywords: Crowdsourcing science, Replication, Reproducibility, Research transparency, Methodology, Meta-science
Subjects: Outsourcing
Depositing User: Gurusrinivasan K
Date Deposited: 13 Oct 2019 17:36
Last Modified: 13 Oct 2019 17:36
Publisher URL:
Publisher OA policy:
Related URLs:

Actions (login required)

View Item View Item
Statistics for DESI ePrint 1296 Statistics for this ePrint Item