SIPS Products

SIPS 2021

Data Management for Psychological Science: A Crowdsourced Syllabus

This syllabus provides detailed descriptions of data management topics, resources, and activities that can be used to create a course or workshop on data management. It is based on a session facilitated by DeBolt, M., Herrera-Bennett, A., Lawson, K. M., Schiavone, S., & Wysocki, A. (please see the end of the document for a complete list of contributors)

Embedding open and reproducible science into teaching: A bank of lesson plans and resources

Shared bank of teaching resources and lesson plans on the broad topics of open scholarship, open science, replication, and reproducibility. Pownall, M., Azevedo, F., Aldoh, A., Elsherif, M., Vasilev, M., Pennington, C. R., Robertson, O., Vel Tromp, M., Liu, M., Makel, M. C., Tonge, N. A., Moreau, D., Horry, R., Shaw, J., Tzavella, L., McGarrigle, R., Talbot, C., & Parsons, S. https://psyarxiv.com/fgv79

Missing Data and Multiple Imputation Decision Tree

Practical guidelines for researchers when examining their data for missingness and making decisions about how to handle that missingness. Woods, A. D.,  Davis-Kean, P., Halvorson, M., King, K., Logan, J., Xu, M., Bainter, S., Brown, D., Clay, J. M., Cruz, R. A., Elsherif, M. M., Gerasimova, D., Joyal-Desmarais, D., Moreau, D., Nissen, J., Schmidt, K., Uzdavines, A., Van Dusen, B., & Vasilev, M. https://psyarxiv.com/mdw5r/

SIPS 2020

Teaching and Mentoring Open Science

A mentoring statement and syllabus modules for teachers and mentors who want to teach and model open science to their students. Kim, M. H., Woods, A. D., Ellis, A., & Davis-Kean, P.

SIPS 2019

Global Engagement Task Force Report

This report makes recommendations for improving inclusion and access for scholars from regions outside the United States, Canada, and Western Europe. Steltenpohl, C. N., Doble, L. J. M., Basnight-Brown, D., Dutra, N. B., Belaus, A., Kung, C. C., Onie, S. Seernani, D., Chen, S.-C., Burin, D., & Darda, K. M. (2021). Society for the Improvement of Psychological Science Global Engagement Task Force Report. https://psyarxiv.com/4upqd/

Nudging Open Science

A toolbox of resources and nudges for advancing open-science practices. Robson, S. G., Baum, M. A., Beaudry, J., Beitner, J., Brohmer, H., Chin, J. M., Jasko, K., Kouros, C. D., Laukkonen, R. E., Moreau D., Searston R. A., Slagter, H. A., Steffens N. K., & Tangen, J. M. https://psyarxiv.com/zn7vt/

Tenzing: Documenting contributorship with CRediT

A web application for reporting which people made which contributions to a scientific project using the Contributor Roles Taxonomy. Holcombe, A., Kovacs, M., Aust, F., & Aczel, B. https://doi.org/10.31222/osf.io/b6ywe.

A product developed out of the SIPS 2019 conference session “Replace journals’ writing-based authorship guidelines with a contributorship model.” Holcombe, A.O., Vazire, S., Chartier, C., Ebersole, C., Giner-Sorolla, R., Haroz, S., Moreau, D., Primbs, M., Ling, M., Werner, K., Schnyder, N., Adie, J., Crook, Z., Smout, C., Ribeiro, G., Tangen, J., Aczel, B., Thibault, R., Searston, R.,Van ‘t Veer, A., Schmalz, X.(2019). https://osf.io/pzyn3/

Non-Interventional, Reproducible, and Open (NIRO) Systematic Reviews

Guidelines for preparing and preregistering a systematic review protocol of non-interventional studies.
Pickering, J.S., Topor, M., Barbosa Mendes, A., Bishop, D. V. M., Büttner, F. C., Henderson, E. L., … Kothe, E.J. (2020). Non-Interventional, Reproducible, and Open (NIRO) Systematic Review Guidelines v0.1. https://osf.io/f3brw/wiki/home/

A Crowdsourced Effort to Develop a Lab Manual Template

A large hackathon group has developed a template to help researchers develop their own lab manuals. https://bit.ly/2FdVt8F

Editorial: Rule out conflicts of interest in psychology awards.

Stoevenbelt, A. H., Nuijten, M. B., Pauli, B. E., & Wicherts, J. M. (2019) Nature 572, 312. doi: 10.1038/d41586-019-02429-3

Tool: BrainPower – Resources for power analysis in neuroimaging

A hackathon group continues its work to develop tools for power analysis in neuroimaging. Read more here: https://brainpower.readthedocs.io/en/latest/index.html

Blog: A fruitful rendevous at SIPS: Neuroimagers meet study preregistration advocates

Algermissen, J., Bartlett, J., Gau, R., Heunis, S., Klapwijk, E., Mazor, M., Paul, M., Schettino, A., & Mehler, D. (2019). Blog post featuring resources for neuroimagers on preregistration, power analysis, and more.

Curation: Free, Open Datasets

Brick, C., Botzet, L., Costello, C. K., Batruch, A., Arslan, R. C., Kline, M., Sommet, N., Green, J., Nuijten, M. B., Conley, M. A., Richardson, T., Sorhagen, N., Collentine, A. O., Feldman, G., Feingold, F., Manley, H., & Mullarkey, M. C. (2019). Directory of free, open psychological datasets. https://doi.org/10.17605/OSF.IO/TH8EW

SIPS 2018

Tutorial: Secondary Data Analysis Pre-Registration

Van den Akker, O., Weston, S. J., Campbell, L., Chopik, W. J., Damian, R. I., Davis-Kean, P., Hall, A., Kosie, J. E., Kruse, E., Olsen, J., Ritchie, S. J.,  Valentine, K. D., van ‘t Veer, A. E., & Bakker, M. (2019, November 20). Preregistration of secondary data analysis: A template and tutorial. https://doi.org/10.31234/osf.io/hvfmr

Template: Secondary Data Analysis Pre-Registration

Weston, S. J., Mellor, D. T., Bakker, M., Van den Akker, O., Campbell, L., Ritchie, S. J., Chopik, W. J., Damian, R. I., Kosie, J., Soderberg, C. K., Ebersole, C. R., Brown, B., Davis-Kean, P., Hall, A., Kruse, E., Olsen, J., Valentine, K. D., & Nguyen, T. T. (2018). Secondary data preregistration. Retrieved from https://osf.io/x4gzt

Paper: 7 Easy Steps to Open Science: An Annotated Reading List

Crüwell, S., Van Doorn, J., Etz, A., Makel, M. C., Moshontz, H., Niebaum, J. C., Orben, A., Parsons, S., Schulte-Mecklenbeck, M. (In press). Zeitschrift für Psychologie. Preprint retrieved from https://psyarxiv.com/cfzyx.

Paper: The emerging relationship between clinical psychology and the credibility movement

Reardon, K. W., Corker, K. S., & Tackett, J. L. (In press). The emerging relationship between clinical psychology and the credibility movement. The Behavior Therapist. [Preprint at https://psyarxiv.com/46rk5]

Media training materials

How to communicate with journalists: https://osf.io/2dk6x/

Responsible communication with the public (including discussion of how to handle preprints): https://osf.io/7g8et/

Five questions to ask when reading science news

Strategies to identify research that is reliable: https://osf.io/qxv4n/

Tools & Tips to Manage Your Lab

A list of tools for researchers to use to help manage their students, projects, and writing reports: https://osf.io/r5my6/

Psych-DS

Psych-DS is an in-progress community attempt to define a standard way of formatting and documenting scientific datasets.

SIPS 2017

Psychological Science Accelerator

The Psychological Science Accelerator is a decentralized, massive, international collaboration of psychological researchers; read more here.

Open Science Video Series (2017, with COS and SPSP)

During SIPS 2017, 5 short videos were recorded that served as an introduction to major topics within the area of open science. http://spsp.org/resources/multimedia/experts/openscience

Paper: Pros and cons of replication research

Zwaan, R. A., Etz, A., Lucas, R. E., & Donnellan, M. B. (2017). Making replications mainstream. Brain and Behavioral Sciences. doi: https://doi.org/10.1017/S0140525X17001972

OA version: https://psyarxiv.com/4tg9c/

Paper: Improving peer review

Davis, W. E., Giner-Sorolla, R., Stephen Lindsay, D., Lougheed, J. P., Makel, M. C., Meier, M. E., Sun, J., Vaughn, L. A., & Zelenski, J. M. (2018). Peer-review guidelines promoting replicability and transparency in psychological science. Advances in Methods and Practices in Psychological Science1(4), 556–573. doi: https://doi.org/10.1177/2515245918806489

OA version: https://kar.kent.ac.uk/69135/

Paper: Increasing transparency of analysis for pre-existing data

Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019). Recommendations for increasing the transparency of analysis of preexisting data sets. Advances in Methods and Practices in Psychological Science2(3), 214-227.

OA version: https://psyarxiv.com/zmt3q/

Taxonomy for PsyArXiv Preprints

Brown, B. T., Eerland, A., Condon, D. M., Pfeiffer, N., Hoplock, L., Columbus, S., Kline, M. E., Moshontz, H., Binion, G., Iskiwitch, C., & Forscher, P. S. (2017). Retrieved from link.

SIPS 2016

PsyArXiv

PsyArXiv is a preprint server for psychology; read more here.

StudySwap

StudySwap is community “swap board” for researchers to connect to share/trade resources, including study participants; read more here.

Paper: Constraints on generality (COG)

Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on Generality (COG): A proposed addition to all empirical papers. Perspectives on Psychological Science, 12, 1123-1128. doi: https://doi.org/10.1177/1745691617708630 OA version: https://psyarxiv.com/w9e3r/

Paper: Experiences from the first ever SIPS meeting

Wyble, B. (2016). How to win friends and improve science: Notes from the first meeting of SIPS (the Society for the Improvement of Psychological Science). Attention, Perception, & Psychophysics, 78, 1529-1530. doi: 10.3758/s13414-016-1180-x