Category: Metascience
-
[Guest post] How Twitter made me a better scientist
I’m a big fan of Twitter and have learned so much from the people on there[note]Thank you![/note], so I’m always happy to share someone singing it’s praises. This article was written by Jean-Jacques Orban de Xivry[note]Who is a serious contender for having the greatest name of all time[/note] for the University of Leuven’s blog. He…
PsychBrief
-
Prediction markets and how to power a study
Do you think you know which studies will replicate? Would you put money on it? Camerer et al. (2018) tested how accurate scientists were at predicting which studies (21 papers from the journals Science and Nature) would replicate. They found researchers were pretty good at guessing which papers would replicate (a roughly .8 correlation between…
-
Credit where credit is due
There has been a lot of tension in the psychological community recently. Replications are becoming more prevalent and many of them are finding much smaller effects or none at all. This then raises a lot of uncomfortable questions: is the studied effect real? How was it achieved in the first place? Were less than honest…
-
The replication crisis, context sensitivity, and the Simpson’s (Paradox)
The Reproducibility Project: Psychology The Reproducibility Project: Psychology (OSC, 2015) was a huge effort by many different psychologists across the world to try and assess whether the effects of a selection of papers could be replicated. This was in response to the growing concern about the (lack of) reproducibility of many psychological findings with some high profile…
-
In defence of preregistration
This post is a response to “Pre-Registration of Analysis of Experiments is Dangerous for Science” by Mel Slater (2016). Preregistration is stating what you’re going to do and how you’re going to do it before you collect data (for more detail, read this). Slater gives a few examples of hypothetical (but highly plausible) experiments and…
PsychBrief 