Tag: Power

• Does calling a study “under powered” help or hinder criticism?

  

  A common criticism of research (past and present) is that it’s “under powered” or “has low power”. What this typically means is the study doesn’t have many participants (typically between 5 and 40) and so has low statistical power for most effect sizes in psychology . But something being “under powered” only makes sense when…

  PsychBrief

  October 17, 2019

  Statistics

  NHST, Power

• The positive predictive value/false discovery rate are fundamentally flawed

  The positive predictive value (PPV) was brought to a wider audience by John Ioannidis in his famous 2005 paper ‘Why Most Published Research Findings Are False’. The related concept false discovery rate (FDR) was popularised by Colquhoun (2014), though the idea it’s based on dates back to Jeffreys (1939). They have become very popular in recent…

  PsychBrief

  May 17, 2018

  Metascience, Statistics

  Criticism, NHST, Power, Probability

• Notes on Paul Meehl’s “Philosophical Psychology Session” #08

  These are the notes I made whilst watching the video recording of Paul Meehl’s philosophy of science lectures. This is the eighth episode (a list of all the videos can he found here). Please note that these posts are not designed to replace or be used instead of the actual videos (I highly recommend you…

  PsychBrief

  April 12, 2018

  Meehl lectures

  NHST, Power, Scientific culture, Theory

• Replication and Reproducibility Event II: Moving Psychological Science Forward

  On Friday 26th of January at the Royal Society there was a series of talk on how psychology could progress as a science, with an emphasis on replication and reproducibility. I’m going to summarise the key points from the individual talks and make a few comments. A collection of all the individual videos of the…

  PsychBrief

  February 15, 2018

  Metascience, Philosophy of Science, Statistics

  Methodology, NHST, Open science, Power, Replication, Replication crisis, Scientific culture

• Notes on Paul Meehl’s “Philosophical Psychology Session” #06

  These are the notes I made whilst watching the video recording of Paul Meehl’s philosophy of science lectures. This is the sixth episode (a list of all the videos can he found here). Please note that these posts are not designed to replace or be used instead of the actual videos (I highly recommend you watch…

  PsychBrief

  October 24, 2017

  Meehl lectures

  Lakatos, Logic, Power, Theory

• Assessing the validity of labs as teaching methods and controlling for confounds

  Anyone who has taken one of the harder sciences at university or knows someone who has will know what “labs” are. You are given practical assignments to complete that are meant to consolidate what you’ve learnt in the lecture/seminar. They are almost ubiquitous in physics after becoming widespread by the beginning of the 20th century…

  PsychBrief

  September 5, 2017

  Metascience

  Academic achievement, Power

• Prediction markets and how to power a study

  Do you think you know which studies will replicate? Would you put money on it? Camerer et al. (2018) tested how accurate scientists were at predicting which studies (21 papers from the journals Science and Nature) would replicate. They found researchers were pretty good at guessing which papers would replicate (a roughly .8 correlation between…

  PsychBrief

  October 24, 2016

  Metascience

  NHST, Power, Prediction, Replication