Peter likes this piece from The Conversation: The 10 stuff-ups we all make when interpreting research
.
What do we actually mean by research and how does it help inform our understanding of things? Understanding what’s being said in any new research can be challenging and there are some common mistakes that people make.
1. Wait! That’s just one study!
2. Significant doesn’t mean important
3. And effect size doesn’t mean useful
4. Are you judging the extremes by the majority?
5. Did you maybe even want to find that effect?
6. Were you tricked by sciencey snake oil?
.
.
7. Qualities aren’t quantities and quantities aren’t qualitites
8. Models by definition are not perfect representations of reality
One that Peter particularly likes:
9. Context matters
To ponder this we can look at bike helmet laws. It’s hard to deny that if someone has a bike accident and hits their head, they’ll be better off if they’re wearing a helmet.
But if we are interested in whole-of-society health benefits, there is research suggesting that a subset of the population will choose not to cycle at all if they are legally required to wear a helmet.
Balance this against the number of accidents where a helmet actually makes a difference to the health outcome, and now helmet use may in fact be negatively impacting overall public health.
Valid, reliable research can find that helmet laws are both good and bad for health.
10. And just because it’s peer reviewed that doesn’t make it right
.
All the details here.
