Investigating the reproducibility of the social and behavioural sciences

Authors and Affiliations

1. Center for Open Science Charlottesville, Charlottesville, VA, USA

   Olivia Miske, Mason Daley, Mirka Dirzo, Nicholas Fox, Noah Haber, Krystal M. Hahn, Brinna Mawhinney, Theresa Stankov, Andrew H. Tyner, Brian A. Nosek & Timothy M. Errington

2. Wageningen University and Research, Wageningen, The Netherlands

   Anna Lou Abatayo

3. Massachusetts Institute of Technology, Cambridge, MA, USA

   Melissa Kline Struhl

4. University of Coimbra, Coimbra, Portugal

   Priya Silverstein

5. Institute for Globally Distributed Open Research and Education, Stockholm, Sweden

   Priya Silverstein & Elisabeth Julie Vargo

6. Slovak Academy of Sciences, Bratislava, Slovakia

   Matúš Adamkovič

7. University of Jyväskylä, Jyväskylä, Finland

   Matúš Adamkovič & Marcel Martončik

8. Charles University, Prague, Czech Republic

   Matúš Adamkovič & Ivan Ropovik

9. Stanford University, Stanford, CA, USA

   Shilaan Alzahawi

10. Budapest University of Technology and Economics, Budapest, Hungary

    Saule Anafinova

11. Kazakh National University of Water Management and Irrigation, Taraz, Kazakhstan

    Saule Anafinova

12. University of Cincinnati, Cincinnati, OH, USA

    Eli Awtrey

13. Hendrix College, Conway, AR, USA

    Erick Axxe

14. Providence College, Providence, RI, USA

    James Bailey & Christopher Limnios

15. University of Amsterdam, Amsterdam, The Netherlands

    Bert N. Bakker, František Bartoš & Alexander O. Savi

16. Monk Prayogshala, Mumbai, India

    Akshaya Balaji, Hansika Kapoor, Nikita Mehta, Arathy Puthillam & Anirudh Tagat

17. Pavol Jozef Safarik University, Kosice, Slovakia

    Gabriel Banik

18. University of Auckland, Auckland, New Zealand

    Henk Berkman

19. University of Southern California, Los Angeles, CA, USA

    Zachariah Berry

20. Peace Research Institute Frankfurt (PRIF), Hesse, Germany

    Felix S. Bethke

21. University of California, San Diego, La Jolla, CA, USA

    Timothy F. Brady

22. German Institute for Adult Education—Leibniz Institute for Lifelong Learning, Bonn, Germany

    Nate Breznau

23. Swedish University of Agricultural Sciences, Uppsala, Sweden

    Sara Capitan & Tabaré Capitán

24. Karolinska Institutet, Stockholm, Sweden

    Laura Caquelin & Gustav Nilsonne

25. University of Massachusetts Boston, Boston, MA, USA

    Kent Jason Cheng

26. Michigan State University, East Lansing, MI, USA

    William J. Chopik, Katelin E. Leahy & Richard E. Lucas

27. Osaka University, Ibaraki, Japan

    Gwen-Jiro Clochard

28. University of Canterbury, Christchurch, New Zealand

    Tom Coupé, Jianhua Duan, Sanghyun Hong & W. Robert Reed

29. UCMeta, Christchurch, New Zealand

    Tom Coupé, Nicholas Gunby, W. Robert Reed & Diem Thi Hong Vo

30. University of Bern, Bern, Switzerland

    Jamie Cummins & Radoslaw Panczak

31. University of Oklahoma, Norman, OK, USA

    Elif Gizem Demirag Burak

32. Stats NZ, Christchurch, New Zealand

    Jianhua Duan

33. University of California Riverside, Riverside, CA, USA

    Kevin M. Esterling

34. University of Greenwich, London, UK

    Thomas R. Evans

35. University of Connecticut, Storrs, CT, USA

    Nathan Fiala, Hansika Kapoor & Victor Volkman

36. West Virginia University, Morgantown, WV, USA

    James Field

37. Toulouse School of Economics, Toulouse, France

    Victor Gay

38. Virginia Tech, Blacksburg, VA, USA

    Jing Geng & Nathaniel D. Porter

39. University of Mannheim, Mannheim, Germany

    Johanna Gereke & Nan Zhang

40. Federal Institute for Population Research (BiB), Wiesbaden, Germany

    Johanna Gereke

41. London School of Economics, London, UK

    Ilka Helene Gleibs

42. Kingston University London, London, UK

    Amélie Gourdon-Kanhukamwe

43. King’s College London, London, UK

    Amélie Gourdon-Kanhukamwe

44. HSE University, Moscow, Russia

    Dmitry Grigoryev

45. Contact Energy, Wellington, New Zealand

    Nicholas Gunby

46. University of Essex, Colchester, UK

    Paul H. P. Hanel

47. Dartmouth College, Hanover, NH, USA

    Sean Dae Houlihan

48. Seattle University, Seattle, WA, USA

    Nick Huntington-Klein

49. SWPS University, Warszawa, Poland

    Kamil Izydorczak

50. University of Kassel, Kassel, Germany

    Kristin Jankowsky

51. Maastricht University, Maastricht, The Netherlands

    Kai Jonas

52. Faculty of Arts, Pavol Jozef Šafárik University in Košice, Košice, Slovakia

    Pavol Kačmár

53. Syracuse University, Syracuse, NY, USA

    Sebastian Karcher, Michael C. McCall & Jeewon Oh

54. Institute of Political Studies of the Polish Academy of Sciences, Warszawa, Poland

    Marta Kołczyńska

55. University of Oxford, Oxford, UK

    David Kretschmer

56. Faculty of Philosophy, University of Belgrade, Belgrade, Serbia

    Ljiljana Lazarevic, Zoran Pavlović & Zorana Zupan

57. University of Sydney, Sydney, New South Wales, Australia

    Jessica C. Lee

58. University of New South Wales, Sydney, New South Wales, Australia

    Jessica C. Lee

59. Utrecht University, Utrecht, The Netherlands

    An-Chiao Liu & Marco Ramljak

60. University of Virginia, Charlottesville, VA, USA

    John Wills Lloyd, Ke Wang & Brian A. Nosek

61. University of Murcia, Murcia, Spain

    Ruben Lopez-Nicolas

62. University of Victoria, Victoria, British Columbia, Canada

    Nigel Mantou Lou

63. University College London, London, UK

    Maximilian Maier

64. Penn State Harrisburg, Middletown, PA, USA

    Daniel J. Mallinson

65. Institute of Social Sciences CSPS SAS, Košice, Slovakia

    Marcel Martončik

66. Central Bank of Costa Rica, San José, Costa Rica

    Esteban Méndez

67. Witten/Herdecke University, Witten, Germany

    Johannes Michalak, Thomas Ostermann & Jan Philipp Röer

68. Northwestern University, Evanston, IL, USA

    Daniel C. Molden

69. University of Leeds, Leeds, UK

    Faisal Mushtaq

70. University of Potsdam, Potsdam, Germany

    Claudia Neuendorf

71. University of Tübingen, Tübingen, Germany

    Claudia Neuendorf & Yuri G. Pavlov

72. Central European University, Vienna, Austria

    Austin Lee Nichols

73. Stockholm University, Stockholm, Sweden

    Gustav Nilsonne

74. Indiana University, Bloomington, IN, USA

    Ernest O’Boyle

75. Policy Innovation Center, Abuja, Nigeria

    Abiola Oyebanjo

76. University of Groningen, Groningen, The Netherlands

    Noemi Peter

77. University of Exeter, Exeter, UK

    Kim Peters

78. Union College, Schenectady, NY, USA

    Mariah Purol

79. UC San Diego, La Jolla, CA, USA

    Arathy Puthillam & Jamal R. Williams

80. Zeppelin Universität, Friedrichshafen, Germany

    Marco Ramljak & Ferdinand Wintermantel

81. University of Stirling, Stirling, UK

    Arran T. Reader

82. Czech Academy of Sciences, Prague, Czech Republic

    Ivan Ropovik

83. University of Presov, Presov, Slovakia

    Ivan Ropovik

84. Southern Illinois University, Carbondale, IL, USA

    Kathleen Schmidt

85. Ashland University, Ashland, OH, USA

    Kathleen Schmidt

86. Cornell University, Ithaca, NY, USA

    Landon Schnabel

87. Georgia State University, Atlanta, GA, USA

    Eric L. Sevigny

88. Ariel University, Ariel, Israel

    Samuel Shaki

89. Appalachian State University, Boone, NC, USA

    Shishir Shakya

90. Ateneo de Manila University, Quezon City, Philippines

    Andrew Soh

91. San Diego State University, San Diego, CA, USA

    Angela Somo

92. Muş Alparslan University, Muş, Turkey

    Fatih Sonmez

93. Western Norway University of Applied Sciences, Bergen, Norway

    Eirik Strømland

94. Stevens Institute of Technology, Hoboken, NJ, USA

    Jordan W. Suchow

95. Psychological Science Accelerator, Ashland, OH, USA

    Anna Szabelska

96. Independent Researcher, Quezon City, Philippines

    Melba Verra Tutor

97. Independent Researcher, Sheffield, UK

    Karolina Urbanska

98. Ghent University, Ghent, Belgium

    Pieter Van Dessel

99. RMIT University Vietnam, Ho Chi Minh City, Vietnam

    Diem Thi Hong Vo

100. Western Kentucky University, Bowling Green, KY, USA

     Aaron L. Wichman

101. University of Zurich, Zurich, Switzerland

     Fabian Winter

102. Humboldt-Universität zu Berlin, Berlin, Germany

     Ferdinand Wintermantel & Ignazio Ziano

103. Università degli Studi di Milano-Bicocca, Milan, Italy

     Cristina Zogmaister

Contributions

Conceptualization: M.K.S., A.H.T., W.J.C., E.G.D.B., K.E.L., B.A.N. and T.M.E. Data curation: A.L.A., A.H.T., S. Anafinova, K.M.E., D.G. and J.W.L. Formal analysis: M.K.S., A.H.T., M.A., S. Alzahawi, S. Anafinova, E. Axxe, A.B., F.B., Z.B., F.S.B., T.F.B., T. Capitán, L.C., K.J.C., W.J.C., G.-J.C., T. Coupé, J.D., T.R.E., N. Fiala, J.F., V.G., J. Gereke, I.H.G., D.G., N.G., P.H.P.H., S.H., S.D.H., K.I., K. Jankowsky, P.K., M.K., D.K., K.E.L., J.C.L., C.L., A.-C.L., R.L.-N., N.M.L., M. Maier, D.J.M., M. Martončik, N.M., E.M., D.C.M., F.M., C.N., J.O., T.O., A.O., R.P., Y.G.P., Z.P., N.P., N.D.P., M.P., M.R., A.T.R., W.R.R., J.P.R., I.R., A.O.S., K.S., L.S., E.L.S., S. Shaki, A. Somo, F.S., A. Szabelska, A.T., K.U., P.V.D., D.T.H.V., V.V., K.W., A.L.W., J.R.W., F. Wintermantel and N.Z. Funding acquisition: B.A.N. and T.M.E. Investigation: O.M., A.L.A., M. Daley, N. Fox, K.M.H., M.K.S., B.M., A.H.T., M.A., S. Alzahawi, E. Axxe, J.B., G.B., F.B., Z.B., T.F.B., N.B., S.C., T. Capitán, K.J.C., W.J.C., T. Coupé, J.C., E.G.D.B., J.D., T.R.E., N. Fiala, J.F., V.G., J. Gereke, I.H.G., P.H.P.H., S.H., S.D.H., N.H.-K., K. Jankowsky, M.K., C.L., A.-C.L., R.L.-N., D.J.M., M. Martončik, J.M., D.C.M., E.O., J.O., T.O., Y.G.P., Z.P., N.P., N.D.P., M.P., A.P., A.T.R., W.R.R., J.P.R., I.R., A.O.S., K.S., L.S., E.L.S., A. Soh, A. Somo, J.W.S., A. Szabelska, A.T., M.V.T., K.U., P.V.D., D.T.H.V., V.V., K.W., A.L.W., J.R.W., F. Winter, N.Z. and T.M.E. Methodology: O.M., A.L.A., N. Fox, M.K.S., B.M., P.S., A.H.T., M.A., S. Alzahawi, E. Axxe, J.B., F.B., Z.B., T.F.B., N.B., S.C., T. Capitán, W.J.C., T. Coupé, K.M.E., T.R.E., N. Fiala, J.F., V.G., J. Gereke, I.H.G., P.H.P.H., S.D.H., K. Jankowsky, K.E.L., J.C.L., C.L., A.-C.L., R.L.-N., M. Maier, D.J.M., D.C.M., C.N., A.L.N., J.O., Y.G.P., Z.P., N.D.P., M.P., M.R., A.T.R., J.P.R., I.R., A.O.S., K.S., L.S., E.L.S., S. Shaki, S. Shakya, A. Somo, F.S., J.W.S., A. Szabelska, A.T., D.T.H.V., K.W., A.L.W., J.R.W., B.A.N. and T.M.E. Project administration: O.M., A.H.T., B.A.N. and T.M.E. Software: A.L.A., M.K.S., T.S., A.H.T., S. Alzahawi, E. Axxe, J.B., A.B., F.B., T.F.B., N.B., T. Coupé, T.R.E., J.F., V.G., J. Geng, I.H.G., D.G., P.H.P.H., S.D.H., K. Jankowsky, P.K., D.K., K.E.L., C.L., A.-C.L., R.L.-N., D.J.M., N.M., D.C.M., F.M., T.O., A.O., Y.G.P., Z.P., N.D.P., M.P., A.P., M.R., J.P.R., I.R., A.O.S., L.S., E.L.S., S. Shakya, A. Somo, F.S., J.W.S., A.T., M.V.T., D.T.H.V., V.V., K.W., A.L.W., F. Winter and F. Wintermantel. Supervision: O.M., K.M.H., M.K.S., A.H.T., B.N.B., T. Capitán, W.J.C., E.G.D.B., K.M.E., N. Fiala, I.H.G., A.G.-K., K. Jonas, J.W.L., R.E.L., G.N., J.O., N.D.P., W.R.R., J.P.R., S. Shaki, F. Wintermantel, C.Z., B.A.N. and T.M.E. Validation: O.M., A.L.A., N.H., P.S., A.H.T., S. Anafinova, E. Awtrey, E. Axxe, J.B., B.N.B., H.B., N.B., T. Capitán, L.C., W.J.C., J.C., E.G.D.B., K.M.E., I.H.G., A.G.-K., D.G., N.H.-K., K. Jonas, H.K., S.K., K.E.L., C.L., J.W.L., R.E.L., M. Maier, M.C.M., C.N., A.L.N., G.N., J.O., T.O., N.P., K.P., N.D.P., A.T.R., J.P.R., L.S., S. Shaki, E.S., A. Szabelska, A.T., K.U., E.J.V., V.V., F. Wintermantel, I.Z., C.Z., Z.Z. and T.M.E. Visualization: N.H., B.M., A.H.T., N.B., M.R., S. Shaki and B.A.N. Original draft: O.M., B.M., A.H.T., S. Anafinova, W.J.C., N. Fiala, K.E.L., J.O., M.P., S. Shaki, V.V., B.A.N. and T.M.E. Review and editing: O.M., M. Daley, M. Dirzo, B.M., P.S., A.H.T., S. Anafinova, B.N.B., G.B., N.B., W.J.C., J.C., E.G.D.B., N. Fiala, J.F., D.G., P.H.P.H., K. Jankowsky, P.K., S.K., L.L., K.E.L., R.L.-N., N.M.L., M. Maier, M. Martončik, C.N., T.O., R.P., Y.G.P., Z.P., N.P., M.P., A.T.R., J.P.R., I.R., L.S., E.L.S., S. Shaki, S. Shakya, E.S., J.W.S., V.V., K.W., A.L.W., B.A.N. and T.M.E.

Corresponding author

Correspondence to
Brian A. Nosek.