Most Clinical Research is Useless – But Not All

Clinical research is crucial for healthcare to improve.

Clinical research concerns us all.

Clinical research costs a lot of money.

Clinical research is most often useless – but not always.

It is Time to improve.

Zignifica Most Clinical Research is Useless

 

We do know how to improve the usefulness of clinical research; the challenge is that it requires a changed mindset not just from healthcare professionals, but also from the industry, politicians, and from users of healthcare – that is you and me. Clinicians and their patients often find themselves frustrated that they do not get expected results from a therapeutic intervention. This relates to the reproduction challenge in clinical research. I June 2005 wrote Professor John Ioannidis from University of Stanford a paper about this with the title “Why Most Published Research Findings Are False”, it has since been the most downloaded technical paper from the journal PLoS Medicine.

In the paper, Ioannidis wrote

There is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims. However, this should not be surprising. It has been proven that most claimed research findings are false. Here I will examine the key factors that influence this problem and some corollaries thereof.

What he refers to is the kind of research only looking at statistical significance

…ill-founded strategy of claiming conclusive research findings solely by a single study assessed by formal statistical significance, typically for a p-value less than 0.05.

Now Ioannidis has published a new paper with the title Why Most Clinical Research is Useless. I had the pleasure of hearing Ioannidis talk about this paper at the EvidenceLive16 conference just after the paper was published. In this new landmark study Ioannidis argue, that much research that aims to improve outcomes in the clinic falls short, in part, because it isn’t designed to lead to improvements.

In order to be useful, clinical research should be true, but this is not sufficient.

Say Ioannidis in the paper, and follow up by a list of key features of useful clinical research. This include:

Problem base: that the problem is big/important enough to fix Context placement:
Has prior evidence been systematically assessed to inform
Information gain: Is the proposed study large and long enough to be sufficiently informative
Pragmatism: Does the research reflect real life. If it deviates, does this matter?
Value for money: Is the research worth the money
Feasibility: Can the research be done Transparency: Are methods, data, and analyses verifiable and unbiased
Ioannidis’ research has estimated, that following these key features are low, and that less than 1% of published research is relevant regarding “information gain”, “pragmatism”, and “value for money”.

Surprised? You shouldn’t be. Here is Ioannidis conclusion

Conclusion Overall, not only are most research findings false, but, furthermore, most of the true findings are not useful. Medical interventions should and can result in huge human benefit. It makes no sense to perform clinical research without ensuring clinical utility. Reform and improvement are overdue.

Sure “reform and improvement are overdue”, but with conflicts of interests and the need for not just deciding to do better, but for changing the mindset, it is a slow process, however, crucial.

 

The big challenge is to distinguish between useful and useless clinical research

 

You can see Ioannidis presentation from EvidenceLive16 here:

 

 

822 comments on “Most Clinical Research is Useless – But Not All”

  1. Pingback: Reproducing Scientific Findings - a Corner Stone in Clinical Research - Zignifica

  2. frolep rotrem
    frolep rotrem:

    Magnificent web site. A lot of useful info here. I’m sending it to a few friends ans also sharing in delicious. And naturally, thanks for your effort!

  3. frolep rotrem
    frolep rotrem:

    My programmer is trying to convince me to move to .net from PHP. I have always disliked the idea because of the expenses. But he’s tryiong none the less. I’ve been using Movable-type on a variety of websites for about a year and am nervous about switching to another platform. I have heard very good things about blogengine.net. Is there a way I can import all my wordpress posts into it? Any kind of help would be really appreciated!

  4. JerryHon
    JerryHon:

    Знаете ли вы?
    Согласно мифу, Марута Сар пыталась примирить Арарат и Арагац, но не смогла.
    Искусствоведы спорили, смирилась ли со скорой смертью неизлечимо больная женщина на картине русского художника, а она прожила ещё 37 лет.
    Канадский солдат в одиночку освободил от немцев нидерландский город.
    Во время немецкой оккупации Украины радио на украинском языке вещало из Саратова и Москвы.
    Команды тренера года АБА и НБА ни разу не стали в них финалистками.

    arbeca.net

  5. web hosting companies
    web hosting companies:

    Excellent post. I was checking continuously this blog and
    I am impressed! Extremely helpful information specifically the
    last part 🙂 I care for such information much.
    I was looking for this certain information for a very long time.
    Thank you and good luck.

  6. web hosting services
    web hosting services:

    It is perfect time to make some plans for the future and it is time to be happy.
    I’ve read this post and if I could I wish to suggest you some interesting things or tips.
    Perhaps you can write next articles referring to this
    article. I want to read more things about it!

  7. frolep rotrem
    frolep rotrem:

    Hello! I could have sworn I’ve been to this blog before but after browsing through some of the post I realized it’s new to me. Anyways, I’m definitely happy I found it and I’ll be book-marking and checking back frequently!

  8. 더킹카지노
    더킹카지노:

    Wonderful work! This is the type of info that should be shared across the internet.
    Shame on the search engines for no longer positioning this post higher!
    Come on over and consult with my website . Thank you =)