Skip to main content

Medical Statistics - The Art of Deception

Image
By
“There are three kinds of lies: lies, damned lies and statistics.”   There is much truth in this quotation of uncertain provenance.  We see this phenomenon regularly in the medical profession.  We see it in medical journals when statistics are presented in a manner that exaggerates the benefit of a treatment or a diagnostic test.  Massaging numbers is raised to an art form by the pharmaceutical companies who will engage in numerical gymnastics to shine a favorable light on their product.   It’s massaging, not outright mendacity.   The promotional material that pharmaceutical representatives present to doctors is riddled with soft deception.

A favorite from their bag of tricks is to rely upon relative value rather than absolute value.  Here’s how this works in this hypothetical example.

A drug named Profitsoar is tested to determine if it can reduce the risk of a heart attack.  Two thousand patients are participating in the study.  Each patients receives either Profitsoar or a placebo at  random.  Here are the results.

                                1000 Profitsoar Patients      1000 Placebo Patients

# Heart Attacks                     4                                           6

As is evident,  only 2 patients were spared a heart attack by the drug.   This is a trivial benefit as only 6 of 1000 patients in the placebo group suffered a heart attack.  This means that taking the drug provides no meaningful protection for an individual patient.  However, the drug companies will highlight the results in relative terms to package the results differently.   They will claim that Profitsoar reduced heart attack rates by 33%, which would lure many patients, and a few doctors to drink the Kool Aid. 

Check out this promotional piece below which was recently mailed to me about Uceris, a steroid that I use at times for colitis patients.




See how low the actual remission rates are for the drug.  Only 18% of patients responded to the drug, a small minority, and the placebo rate was 6%.  No worries.   Just brag that Uceris is 3 times more effective than placbo!

Is this a lie?  Not exactly.  Is it the truth?  Technically yes.  

Most physicians are tuned into this deception.  I know from my own patients that the public is easily seduced by this slick presentation of data.  The next time you see a TV ad for a medication, which will be about 5 minutes after you turn on the TV, see if you can spot the illusion.  You'll have to watch quickly and repeatedly.  Like all skilled magicians, these guys are expert at distraction and sleight of hand.  Hint: Whenever you hear the word 'percent', as in "35% of patients responded...", you should pay particular attention.  

When we used to see a woman sawed in half on stage, we knew it was a trick even if we couldn't explain how it was done.  I've taken you behind the curtain here.  Let's make it a fair fight between us and illusionists.
Labels:

Comments

Post a Comment

Popular posts from this blog

Why Most Doctors Choose Employment

By
Increasingly, physicians today are employed and most of them willingly so.  The advantages of this employment model, which I will highlight below, appeal to the current and emerging generations of physicians and medical professionals.  In addition, the alternatives to direct employment are scarce, although they do exist.  Private practice gastroenterology practices in Cleveland, for example, are increasingly rare sightings.  Another practice model is gaining ground rapidly on the medical landscape.   Private equity (PE) firms have   been purchasing medical practices who are in need of capital and management oversight.   PE can provide services efficiently as they may be serving multiple practices and have economies of scale.   While these physicians technically have authority over all medical decisions, the PE partners can exert behavioral influences on physicians which can be ethically problematic. For example, if the PE folks reduce non-medical overhead, this may very directly affe
44 comments
Read more

Should Doctors Wear White Coats?

By
Many professions can be easily identified by their uniforms or state of dress. Consider how easy it is for us to identify a policeman, a judge, a baseball player, a housekeeper, a chef, or a soldier.  There must be a reason why so many professions require a uniform.  Presumably, it is to create team spirit among colleagues and to communicate a message to the clientele.  It certainly doesn’t enhance professional performance.  For instance, do we think if a judge ditches the robe and is wearing jeans and a T-shirt, that he or she cannot issue sage rulings?  If members of a baseball team showed up dressed in comfortable street clothes, would they commit more errors or achieve fewer hits?  The medical profession for most of its existence has had its own uniform.   Male doctors donned a shirt and tie and all doctors wore the iconic white coat.   The stated reason was that this created an aura of professionalism that inspired confidence in patients and their families.   Indeed, even today
36 comments
Read more

Electronic Medical Records vs Physicians: Not a Fair Fight!

By
Each work day, I enter the chamber of horrors also known as the electronic medical record (EMR).  I’ve endured several versions of this torture over the years, monstrosities that were designed more to appeal to the needs of billers and coders than physicians. Make sense? I will admit that my current EMR, called Epic, is more physician-friendly than prior competitors, but it remains a formidable adversary.  And it’s not a fair fight.  You might be a great chess player, but odds are that you will not vanquish a computer adversary armed with artificial intelligence. I have a competitive advantage over many other physician contestants in the battle of Man vs Machine.   I can type well and can do so while maintaining eye contact with the patient.   You must think I am a magician or a savant.   While this may be true, the birth of my advanced digital skills started decades ago.   (As an aside, digital competence is essential for gastroenterologists.) During college, I worked as a secretary
6 comments
Read more