Register | Sign In


Understanding through Discussion


EvC Forum active members: 63 (9162 total)
2 online now:
Newest Member: popoi
Post Volume: Total: 916,332 Year: 3,589/9,624 Month: 460/974 Week: 73/276 Day: 1/23 Hour: 0/0


Thread  Details

Email This Thread
Newer Topic | Older Topic
  
Author Topic:   most scientific papers are wrong?
randman 
Suspended Member (Idle past 4917 days)
Posts: 6367
Joined: 05-26-2005


Message 1 of 113 (239329)
09-01-2005 1:22 AM


Most published scientific research papers are wrong, according to a new analysis. Assuming that the new paper is itself correct, problems with experimental and statistical methods mean that there is less than a 50% chance that the results of any randomly chosen scientific paper are true.
John Ioannidis, an epidemiologist at the University of Ioannina School of Medicine in Greece, says that small sample sizes, poor study design, researcher bias, and selective reporting and other problems combine to make most research findings false. But even large, well-designed studies are not always right, meaning that scientists and the public have to be wary of reported findings.
Page has gone | New Scientist
True or not?

Replies to this message:
 Message 2 by AdminJar, posted 09-01-2005 10:30 AM randman has not replied
 Message 7 by PaulK, posted 09-02-2005 2:19 PM randman has not replied
 Message 14 by Rahvin, posted 09-02-2005 3:07 PM randman has not replied
 Message 25 by inkorrekt, posted 02-04-2006 7:17 PM randman has replied
 Message 29 by macaroniandcheese, posted 02-04-2006 9:51 PM randman has not replied

  
AdminJar
Inactive Member


Message 2 of 113 (239475)
09-01-2005 10:30 AM
Reply to: Message 1 by randman
09-01-2005 1:22 AM


rejected as it stands.
Highly likely it is true but...
so what? What is there here to discuss?
Did you even read the paragraph following the two you quoted?
Do you even have a clue what the scientific method entails?
I'm sorry randman but you have never been able to show that you have the basic knowledge to even discuss something like this intellegently. I will allow you to try a revision of your OP to show an understanding of the basics but before this is considered for promotion you will have to demonstrate the ability to deal with scientific issues. This is something that would need to be discussed on the science side and at the current time you have not shown either a willingness to learn or the basic understanding of methodology needed.

New Members should start HERE to get an understanding of what makes great posts.
Comments on moderation procedures (or wish to respond to admin messages)? - Go to:
Message 1
Thread Reopen Requests
Considerations of topic promotions from the "Proposed New Topics" forum
Other useful links:
Forum Guidelines, Style Guides for EvC and Assistance w/ Forum Formatting

This message is a reply to:
 Message 1 by randman, posted 09-01-2005 1:22 AM randman has not replied

Replies to this message:
 Message 3 by AdminNosy, posted 09-01-2005 10:45 AM AdminJar has replied

  
AdminNosy
Administrator
Posts: 4754
From: Vancouver, BC, Canada
Joined: 11-11-2003


Message 3 of 113 (239480)
09-01-2005 10:45 AM
Reply to: Message 2 by AdminJar
09-01-2005 10:30 AM


Re: rejected as it stands.
I think I'm inclinded to promote it in a few dasy when I get back. I don't expect that Randman will be able to actually participate since he will have to be suspended pretty quickly for the reasons you've given. However, I would like to see the topic discussed.

This message is a reply to:
 Message 2 by AdminJar, posted 09-01-2005 10:30 AM AdminJar has replied

Replies to this message:
 Message 4 by AdminJar, posted 09-01-2005 10:50 AM AdminNosy has not replied

  
AdminJar
Inactive Member


Message 4 of 113 (239483)
09-01-2005 10:50 AM
Reply to: Message 3 by AdminNosy
09-01-2005 10:45 AM


Re: rejected as it stands.
No problem. I think it could be worthy of discussion in the science area but it simply highlights the need for replication and that has been a foundation of science for some time.
Cold Fusion.

This message is a reply to:
 Message 3 by AdminNosy, posted 09-01-2005 10:45 AM AdminNosy has not replied

  
AdminNosy
Administrator
Posts: 4754
From: Vancouver, BC, Canada
Joined: 11-11-2003


Message 5 of 113 (239979)
09-02-2005 1:58 PM


Thread moved here from the Proposed New Topics forum.

Replies to this message:
 Message 6 by NosyNed, posted 09-02-2005 2:05 PM AdminNosy has not replied

  
NosyNed
Member
Posts: 9003
From: Canada
Joined: 04-04-2003


Message 6 of 113 (239985)
09-02-2005 2:05 PM
Reply to: Message 5 by AdminNosy
09-02-2005 1:58 PM


Read carefully first
The news article is very short on details but it seems this "conclusion" is based on a rather odd sort of analysis. I suggest that before jumping onto this topic one should read the article carefully and attempt to describe what they believe it is saying.
That aside and as has been noted: one main message is the replication of results is required. If one actually follows leading edge scienctitic developments one phrase that often prelogues many scientists comments is "If this is replicated...". That is one answer to the analysis discussed here.
With a family member in the medical profession it is not a surprise to me that there are many poorly done studies with utterly nonsensical statistics. It is no big news at all. (Of course, a significant part in this problem is played by the drug companies).
The ability to read with comprehension, understanding and a critical mind is required whatever the source of information. The advantage of using scientific materials is that there is usually enough information to allow for a critical analysis (sample sizes for example).
However, I think the conclusions draw here may be off the mark and/or not applicable to ALL published papers (they are not all of a single type).

This message is a reply to:
 Message 5 by AdminNosy, posted 09-02-2005 1:58 PM AdminNosy has not replied

Replies to this message:
 Message 22 by nator, posted 10-18-2005 8:16 AM NosyNed has not replied

  
PaulK
Member
Posts: 17825
Joined: 01-10-2003
Member Rating: 2.2


Message 7 of 113 (239991)
09-02-2005 2:19 PM
Reply to: Message 1 by randman
09-01-2005 1:22 AM


Of course it's not really that surprising that many published papers have errors. All the more reason to be conservative and not race after new ideas, sticking isntead with ideas that have stood the test of time. Like evolution.

This message is a reply to:
 Message 1 by randman, posted 09-01-2005 1:22 AM randman has not replied

  
randman 
Suspended Member (Idle past 4917 days)
Posts: 6367
Joined: 05-26-2005


Message 8 of 113 (239992)
09-02-2005 2:23 PM


wow!
Why is the following allowed on this forum, from a mod no less?
Highly likely it is true but...
so what? What is there here to discuss?
Did you even read the paragraph following the two you quoted?
Do you even have a clue what the scientific method entails?
I'm sorry randman but you have never been able to show that you have the basic knowledge to even discuss something like this intellegently.
Obviously I hit a nerve, but that rant is totally off-topic, unsubstiated BS.
One particular relevance of the study, imo, as far as relating to evolutionists, is that we often see with the result of even one finding and study by evos a major rush to publicize the finding as accurate.
We saw this recently with the study linking a gene expressed in gills and the parathyroid, and we saw that with the initial discovery of the skull of pakecitus.
Off that one skull, we had a full-page spread in national geographic, countless references in educational material, etc,...and frequently with the wrong information attributed by showing webbed feet and stuff like that.
Within evolutionism, this rush to judgment can result in false ideas stubbornly clung to, since they initially were accepted in such a widespread manner. It may be that the situation is better today, especially considering the public pressure put on evolutionists through their critics, but nonetheless, the saga of Haeckel's ideas and drawings are a good historical example of how something incorrect, and in Haeckel's case, fraudulent, are passed off as true and not easily dismissed with once embedded within ToE proponents.
I think we saw a similar pattern with the peppered moth experiments and their use as evidence of evolution. We now know that the moths don't typically rest on trees and that the moths shown were glued to the trees, but it takes awhile for some data so embedded in the consciousness of evos to be dismissed.
Same thing with Neanderthals. The initial claims were based on an old man with arthritis, and since the 50s, we knew the initial claims of Neanderthals being subhuman was incorrect, but it's only been in the past few years that Neanderthals have been presented as people instead of subhumans.
Recently, someone posited here very assuredly in an arrogant tone on transitionals and listed Cro-Magnon man as a transitional. This, imo, is borne out of the same faulty approach of evos of rushing to judgment. Cro-magnon man is not a separate or transitional species at all to modern man, but because he was presented at one time as transitional, the myth has stuck in the minds of evolutionists.
It would be funny if it was not so sad, but the evo making that claim was disparaging me, as if I was ignorant, as if don't you know Cro-Magnon man is one of the "missing links", a transitional. In fact, I am not even sure if I posted a mountain of data that I could convince the guy that Cro-Magnon man is nothing more than an ancient tribe of modern humans, that he had the same anatomical features and is identical to people today, except the Cro-Magnons were taller on average, just as by the way some ethnic groups are taller than others today.
So imo, this rush to judgment is a systemic problem and erroneous use of data within the evo community, and it creates problems not easily solved where false concepts are stubbornly clung to by evo proponents.
So I would argue this idea of most scientific papers being wrong is an important principle to consider before making claims within evos of how things are. I have argued consistently that many claims of evos need much more detailed and comprehensive studies before giving the merit they are generally within evolutionist.
Some of those areas are to properly understand the mechanisms involved in mutations before declaring the mutations are random. In fact, it is hard to tell sometimes what evos mean by random mutations, and to what degree mutations are random and non-random. I think understanding this has somewhat extreme ramifications for specific analysis.
For example, if it can be seen that certain genetic combinations tend to produce similar mutations, then we might see in a creature like Pakicetus, a feature emerging that is whale-like but which did not lead to whales evolving from them. This also gets into the nature and limits of convergent evolution.
As I stated on another thread, another example is that I think more studies and research need to be done on fossil rarity before we can safely state the fossil record is not strong evidence against ToE.
This message has been edited by randman, 09-02-2005 02:32 PM
This message has been edited by randman, 09-02-2005 02:35 PM

Replies to this message:
 Message 9 by PaulK, posted 09-02-2005 2:33 PM randman has replied
 Message 11 by jar, posted 09-02-2005 2:42 PM randman has not replied
 Message 13 by AdminNosy, posted 09-02-2005 3:04 PM randman has not replied
 Message 15 by nwr, posted 09-02-2005 3:21 PM randman has not replied
 Message 18 by Nuggin, posted 09-02-2005 7:44 PM randman has replied

  
PaulK
Member
Posts: 17825
Joined: 01-10-2003
Member Rating: 2.2


Message 9 of 113 (239996)
09-02-2005 2:33 PM
Reply to: Message 8 by randman
09-02-2005 2:23 PM


Re: wow!
Most of your claims are pretty dubious but this paragraph is very bad
quote:
I think we saw a similar pattern with the peppered moth experiments and their use as evidence of evolution. We now know that the moths don't typically rest on trees and that the moths shown were glued to the trees, but it takes awhile for some data so embedded in the consciousness of evos to be dismissed.
There was never a claim that the moths typically rested on trunks. Nor was there any claim that the photograph in question was anything other than what it was - a staged photograph taken for illustrative purposes, placing the two morphs together on the same surface for comparison.
Wells, of course, in his attempt to smear his opponents tried to spin this into claims of dishonesty. But the real dishonesty was his.

This message is a reply to:
 Message 8 by randman, posted 09-02-2005 2:23 PM randman has replied

Replies to this message:
 Message 10 by randman, posted 09-02-2005 2:37 PM PaulK has replied

  
randman 
Suspended Member (Idle past 4917 days)
Posts: 6367
Joined: 05-26-2005


Message 10 of 113 (240002)
09-02-2005 2:37 PM
Reply to: Message 9 by PaulK
09-02-2005 2:33 PM


Re: wow!
It's not dishonest. That's the distinct impression I remember when taught of the peppered moths as evidence for evolution.
Can you prove what I stated is false?
Before you mouth off claims of dishonesty, I suggest you take the time to be willing to prove it.

This message is a reply to:
 Message 9 by PaulK, posted 09-02-2005 2:33 PM PaulK has replied

Replies to this message:
 Message 12 by PaulK, posted 09-02-2005 2:49 PM randman has not replied

  
jar
Member (Idle past 412 days)
Posts: 34026
From: Texas!!
Joined: 04-20-2004


Message 11 of 113 (240003)
09-02-2005 2:42 PM
Reply to: Message 8 by randman
09-02-2005 2:23 PM


Re: wow!
What rant?
There is no rant there. It's questions that you should have considered before even posting the thread as a PNT.
All of the questions are still valid and YOU need to answer them.
It appears that you are simply going to use this thread to return to your assertions of old pet predudices of yours that you have never been able to support.
Sorry, but so far all you're doing is whining. Try answering the questions.
Highly likely it is true but...
so what? What is there here to discuss?
Did you even read the paragraph following the two you quoted?
Do you even have a clue what the scientific method entails?

Aslan is not a Tame Lion

This message is a reply to:
 Message 8 by randman, posted 09-02-2005 2:23 PM randman has not replied

  
PaulK
Member
Posts: 17825
Joined: 01-10-2003
Member Rating: 2.2


Message 12 of 113 (240006)
09-02-2005 2:49 PM
Reply to: Message 10 by randman
09-02-2005 2:37 PM


Re: wow!
This topic should be restricted to the contents of the new article and the study that it reports. DO NOT CONTINUE ON SPECIFIC ISSUES THAT HAVE BEEN DEALT WITH ELSEWHERE.
I didn't accuse you of dishonesty, I accused Wells. Why do you think he picked on the peppered moth in the first place ? Only the most fanatic creationists would object to the idea of a simple colour change spreading through natural selection.
The basic peppered moth story is that industrial pollution turned tree bark darker (through soot and through killing lichens), and thus the darker moths were favoured and spread. What is wrong with that ? THe first part is known to be true and the second is strognly supported by the evidence (for isntance the spread of the dark-coloured moths).
This message has been edited by AdminNosy, 09-02-2005 03:06 PM

This message is a reply to:
 Message 10 by randman, posted 09-02-2005 2:37 PM randman has not replied

  
AdminNosy
Administrator
Posts: 4754
From: Vancouver, BC, Canada
Joined: 11-11-2003


Message 13 of 113 (240012)
09-02-2005 3:04 PM
Reply to: Message 8 by randman
09-02-2005 2:23 PM


Way off topic and typical
I have removed your permissions for "Is it Science". This is indefinite and will be applied to each forum in which you demonstrate such an inability to stay on topic and focus your posts.

This message is a reply to:
 Message 8 by randman, posted 09-02-2005 2:23 PM randman has not replied

  
Rahvin
Member
Posts: 4039
Joined: 07-01-2005
Member Rating: 8.0


Message 14 of 113 (240013)
09-02-2005 3:07 PM
Reply to: Message 1 by randman
09-01-2005 1:22 AM


Did you even read the contents of this article?!
quote:
John Ioannidis, an epidemiologist at the University of Ioannina School of Medicine in Greece, says that small sample sizes, poor study design, researcher bias, and selective reporting and other problems combine to make most research findings false. But even large, well-designed studies are not always right, meaning that scientists and the public have to be wary of reported findings.
quote:
Odds get even worse for studies that are too small, studies that find small effects (for example, a drug that works for only 10% of patients), or studies where the protocol and endpoints are poorly defined, allowing researchers to massage their conclusions after the fact
Emphasis mine.
This article is primarily about the pharmaceutical industry. We are talking about studies involving efects on human beings, and more importantly, studies that have a direct financial impact on the companies who pay for them.
This is the actual paper published, rather than the acrticle about it.
Please note that this is from the Public Library of Science Medicine journal.
Here's a bit of their "Example:"
quote:
Let us assume that a team of investigators performs a whole genome association study to test whether any of 100,000 gene polymorphisms are associated with susceptibility to schizophrenia.
Studies based on pharmaceuticals, or psychology, or other studies that involve interaction with humans as test subjects, can easily reach inaccurate conclusions. Human beings are incredibly complex, and drugs can cause side effects only in a tiny poulation and thereby pass through regulations testing. The bias of the company who pays for a study (in the case where there is a direct financial benefit for a certain outcome) can also cause inaccurate results.
However, the paper's point is valid - scientific papers begin as simply hypotheses - they have been put foprward with supporting evidence but have not yet been fully tested by other research groups. Of course most of them are falisfied - that's the entire point of the scientific method!
Those hypotheses that are held to be true by the majority of scientists, however, like, say, Evolution for example, have been rigorously tested by many reasearch groups and have still not been falsified. That fact that most initial research papers are wrong simply provides additional credibility to Theories, like Evolution, which have not been falsified despite the rigorous testing imposed by the peer review process.

Every time a fundy breaks the laws of thermodynamics, Schroedinger probably kills his cat.

This message is a reply to:
 Message 1 by randman, posted 09-01-2005 1:22 AM randman has not replied

  
nwr
Member
Posts: 6409
From: Geneva, Illinois
Joined: 08-08-2005
Member Rating: 5.3


Message 15 of 113 (240021)
09-02-2005 3:21 PM
Reply to: Message 8 by randman
09-02-2005 2:23 PM


Re: wow!
randman writes:
One particular relevance of the study, imo, as far as relating to evolutionists, is that we often see with the result of even one finding and study by evos a major rush to publicize the finding as accurate.
All scientists want to have their results published as soon as possible. This is not restricted to evolutionists.
I'm not sure why you are making a fuss about this. Most scientists are well aware that the conclusions of many reports will not stand up to further studies. One of the reasons that research is reported, is so that other scientists can attempt to replicate the results, or perhaps challenge them.

This message is a reply to:
 Message 8 by randman, posted 09-02-2005 2:23 PM randman has not replied

  
Newer Topic | Older Topic
Jump to:


Copyright 2001-2023 by EvC Forum, All Rights Reserved

™ Version 4.2
Innovative software from Qwixotic © 2024