Intro to open science
The paper that started it all:
Ioannidis JPA (2005) Why Most Published Research Findings Are False. PLoS Med 2(8): e124. https://doi.org/10.1371/journal.pmed.0020124 pmid:16060722
A multi-lab replication of 100 psychology studies:
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.
Whitaker, K., & Guest, O. (2020). # bropenscience is broken science: Kirstie Whitaker and Olivia Guest ask how open ‘open science’really is. The Psychologist, 33, 34-37.
Below are two 1.5-2 hour long lectures providing a comprehensive introduction to the history of the replication crisis and open science, originally presented to a 2nd year undergraduate class in Fall 2022.
Use and misuse of the scientific method, p-hacking and misunderstanding of p values, misleading figures and misunderstanding of statistics, fraudsters, the replication crisis
Open science principles in the research plan, preregistrations, registered reports, using open science principles in all stages of research, materials and data sharing, importance of scientific diversity and inclusion, bropenscience
Intro to scientific thinking
aka "the methods of rationality"
What does it take to be a scientist? What skills do they have? In fact, every scientist has diverse strengths, and nobody has quite the same skillset. Scientists are, to different extents:
(they have big ideas and come up with new theories)
(they organize project timelines and feasibility)
(they build experiments, learn programming languages, and analyze data)
(they can illustrate their results elegantly and succinctly)
(they find collaborators, bringing people and ideas together)
(they paint a narrative for their research in manuscripts and funding proposals)
(they can describe their work both formally and informally - showmanship)
(they pass the knowledge on to the next generation of scientists)
Taught as part of a new MSc program, Fall 2021
The goal of this module is to discover your own strengths, work with people who have different strengths, and also add a little bit of everything to your scientific toolbox.
This module is about thinking like a scientist. You need to draw inspiration from all the above parts to be a good scientist, but the one thing they all have in common is a good understanding of the scientific method that can be applied in the real world.
Below, you will find materials I created for four lectures on scientific thinking. Clicking on the link will open a PowerPoint in a new window.
Lecture 1: Introduction to scientific thinking
Lecture 2: What makes a good research question?
Lecture 3: How to design an experiment and project planning
Lecture 4: Interpreting results and the replicability crisis
BONUS MATERIAL: EXERCISES AND HOMEWORK
Clicking the links below will open a document in a new window.
What kind of scientist are you?
Questions to help you read a scientific paper (with lecturer notes)
Questions to help you read a scientific paper (for students)
Coming up with Literature Review topics
Highly recommended reading for…
…developing excellent research questions:
Alvesson, M. & Sandberg, J. (2013). Constructing research questions: Doing Interesting Research. London: Sage.
…thinking like a scientist:
Yudkowsky, E. (2015). Harry Potter and the Methods of Rationality. https://www.hpmor.com/
…changing the way you think about how you learn:
Dweck, C. S. (2008). Mindset: The New Psychology of Success. Random House Digital, Inc.
…understanding how statistics can be used and abused:
Huff, D. (1993). How to Lie with Statistics. WW Norton & Company.