Investigating Variation in Replicability

Richard Klein(University of Florida), Kate A. Ratliff(University of Florida), Michelangelo Vianello(University of Padua), Reginald B. Adams(Pennsylvania State University), Štěpán Bahník(University of Würzburg), Michael J. Bernstein(Pennsylvania State University), Konrad Bocian(Uniwersytet SWPS), Mark J. Brandt(Tilburg University), Beach Smith Brooks(University of Florida), Claudia Chloe Brumbaugh(City University of New York), Zeynep Cemalcılar(Koç University), Jesse Chandler(University of Michigan), Winnee Cheong(HELP University), William E. Davis(Texas A&M University), Thierry Devos(San Diego State University), Matthew Eisner(University of Michigan), Natalia Frankowska(Uniwersytet SWPS), David Furrow(Mount Saint Vincent University), Elisa Maria Galliani(University of Padua), Fred Hasselman(Radboud University Nijmegen), Joshua A. Hicks(Texas A&M University), James F. Hovermale(Virginia Commonwealth University), S. Jane Hunt(East Texas A&M University), Jeffrey R. Huntsinger(Loyola University Chicago), Hans IJzerman(Tilburg University), Melissa-Sue John(Worcester Polytechnic Institute), Jennifer A. Joy-Gaba(Virginia Commonwealth University), Heather Barry Kappes(London School of Economics and Political Science), Lacy E. Krueger(East Texas A&M University), Jaime L. Kurtz(James Madison University), Carmel Levitan(Occidental College), Robyn K. Mallett(Loyola University Chicago), Wendy L. Morris(McDaniel College), Anthony J. Nelson(Pennsylvania State University), Jason A. Nier(Connecticut College), Grant Packard(Wilfrid Laurier University), Ronaldo Pilati(Universidade de Brasília), Abraham M. Rutchick(California State University, Northridge), Kathleen Schmidt(University of Virginia), Jeanine Skorinko(Worcester Polytechnic Institute), Robert W. Smith(The Ohio State University), Troy G. Steiner(Pennsylvania State University), Justin Storbeck(City University of New York), Lyn M. Van Swol(University of Wisconsin–Madison), Donna Thompson(Mount Saint Vincent University), Anna van 't Veer(Tilburg University), Leigh Ann Vaughn(Ithaca College), Marek Vranka(Charles University), Aaron L. Wichman(Western Kentucky University), Julie A. Woodzicka(Washington and Lee University), Brian A. Nosek(Center for Open Science)
Social Psychology
May 1, 2014
10.1027/1864-9335/a000178
Cited by 1,242Open Access
Full Text

Abstract

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

Related Papers

No related papers found

Powered by citation graph analysis