Register | Sign In

Understanding through Discussion

EvC Forum active members: 51 (9179 total)
3 online now:
Newest Member: Jorge Parker
Post Volume: Total: 918,200 Year: 5,457/9,624 Month: 482/323 Week: 122/204 Day: 22/16 Hour: 2/1

Thread  Details

Email This Thread
Newer Topic | Older Topic
Author Topic:   Failure to Replicate
Tempe 12ft Chicken
Member (Idle past 447 days)
Posts: 438
From: Tempe, Az.
Joined: 10-25-2012

Message 1 of 2 (767321)
08-28-2015 10:39 AM

A new study that is being released soon in Science discusses how reproducible 100 different studies in the field of Psychology are. The final results were not very good for the field and could possibly lead to several retractions.
According to the researchers:
Cathleen O'Grady writes:
Of the 100 original studies, 97 had results that were statistically significant; only a third of the replications, however, had statistically significant results. Around half of the replications had effect sizes that were roughly comparable to the original studies. The teams conducting the replications reported whether they considered the effect to be replicated, and only 39 percent of them said it did. These criteria suggest that fewer than half of the originals were successfully replicated.
Now, I have always heard that psychology and social science is less structured than some of the more rigorous fields, such as physics or geology, but the question is what, if any, takeaways should we find for the scientific community from these results. Should certain areas of science be required to increase repeat experiments to avoid this statistical error or should this new paradigm be applied across the board for all sciences. If it is for all sciences, what methods can be undertaken to ensure that journals print more repeat experiments and failures to replicate instead of only focusing on the "sexy" new ideas?
I was thinking either "Is it Science" or Miscellaneous, but will defer to moderator decision.
100 Psychology Experiments Repeated Less Than Half Successful

The theory of evolution by cumulative natural selection is the only theory we know of that is in principle capable of explaining the existence of organized complexity. - Richard Dawkins
Creationists make it sound as though a 'theory' is something you dreamt up after being drunk all night. - Issac Asimov
If you removed all the arteries, veins, & capillaries from a person’s body, and tied them end-to-endthe person will die. - Neil Degrasse Tyson
What would Buddha do? Nothing! What does the Buddhist terrorist do? Goes into the middle of the street, takes the gas, *pfft*, Self-Barbecue. The Christian and the Muslim on either side are yelling, "What the Fuck are you doing?" The Buddhist says, "Making you deal with your shit. - Robin Williams

Posts: 4754
From: Vancouver, BC, Canada
Joined: 11-11-2003

Message 2 of 2 (767324)
08-28-2015 10:55 AM

Thread Copied to Is It Science? Forum
Thread copied to the Failure to Replicate thread in the Is It Science? forum, this copy of the thread has been closed.

Newer Topic | Older Topic
Jump to:

Copyright 2001-2023 by EvC Forum, All Rights Reserved

™ Version 4.2
Innovative software from Qwixotic © 2024