Skip to main content

Don't slam Canada for mammogram study

By H. Gilbert Welch
February 19, 2014 -- Updated 1242 GMT (2042 HKT)
STORY HIGHLIGHTS
  • A recent Canadian study found that mammogram screenings don't reduce cancer deaths
  • Mammographers slammed it, saying researchers cheated and screening machines were old
  • Gilbert Welch: Cheating charges unfounded, and pro-screening studies used older machines
  • Welch: The real problem is that mammography results in women getting treatment they don't need

Editor's note: H. Gilbert Welch is a professor of medicine at the Dartmouth Institute for Health Policy and Clinical Practice and author of "Should I Be Tested for Cancer? Maybe Not and Here's Why" (University of California Press) and co-author of "Overdiagnosed: Making People Sick in the Pursuit of Health."

(CNN) -- We all like to think medical care is about science, but too often it's about professional interests.

Last week, a 25-year follow-up of the Canadian National Breast Screening Study was published -- one of the eight major randomized trials of screening mammography. The headline was simple: Mammogram screenings don't reduce cancer death rates.

The reaction by some American mammographers was predictable -- discredit the study. It's predictable because it is exactly what they did when they didn't like the first findings of the study published more than 20 years ago.

The effort by the American College of Radiology to discredit the Canadian trial relies on two allegations:

H. Gilbert Welch
H. Gilbert Welch

The investigators were cheating: Let's look at the background on this. Randomized trials are a critical tool for clinical researchers. Study participants are placed at random in either one group (in this case those who get mammograms) or the other (those who do not). Who is in which group is solely based on the play of chance -- a flip of a coin.

The allegation of cheating -- purposely putting women whom researchers knew had advanced cancers in the mammography group -- is an incredibly serious one. It sure was taken seriously by Canada's National Cancer Institute. It launched a two-year independent review of the entire randomization process. In 1997, the review found no credible evidence of cheating.

But that didn't stop the allegation from being trotted out last week. The new study provides evidence that randomization did exactly what it is supposed to do: It created two identical groups of women. The rate of death in the two groups was exactly the same, every year, for 25 years. That can't happen by cheating -- that can only happen when the groups are formed solely by chance.

It sounded as if Canada were Botswana. Like the nation had only recently gotten electric power and was still struggling to train doctors.
Gilbert Welch

Canada is a Third World country: More specifically, the Canadians used old mammography machines that produced inadequate images, interpreted by inadequate mammographers.

It sounded as if Canada were Botswana, as if the nation had only recently gotten electric power and was still struggling to train doctors.

For mammographers who need to point to the benefits demonstrated by earlier trials of mammography, this is an odd allegation. Why? Because the other trials used even older technology. In fact, one of the trials most favorable to screening -- the Health Insurance Plan of New York's -- dates from two decades before Canada's, in the early 1960s, when mammography technologies were primitive.

Yet, in both New York and Canada, outmoded technology did exactly what it was supposed to do. It found small breast cancers.

Armed with these two allegations, the mammographers followed a well-worn strategy: Make the allegations often and loudly enough and maybe they will stick.

To be clear, not all mammographers share this view. A new generation has openly acknowledged the problems of mammography. But many in the old guard are more likely to attack any suggestion that screening doesn't work as well as advertised, characterizing researchers who raise the possibility as "malicious" or "dangerous" and questioning the editorial policies of the journals that publish their work.

It's time to stop the unfounded allegations. It might be standard procedure for politics but not for science. Too much energy has been devoted to discrediting the Canadian study and not enough to understanding it.

To make sense of information the Canadian trial offers, you need to understand its unique design -- specifically what is being compared with what. Most of the other randomized trials simply compared regular mammography with doing nothing.

In the Canadian trial, one group received a regular physical exam of the breast -- a very careful exam performed by specially trained nurses. The other group received the same regular physical exam plus regular mammography. In other words, the trial tested the usefulness of adding mammography to a physical exam in an effort to detect abnormalities that are too small to feel.

And the trial showed that finding these "too small to feel" abnormalities doesn't help women live longer.

That's really important information. It doesn't mean that mammography can't help at all -- it is extremely challenging to standardize a physical exam of the breast across an entire population. It does mean, however, that if we are going to do mammography, we should be using it to find big, important things -- not small, unimportant things.

Further, the Canadian trial confirms that the harm of being overdiagnosed by screening mammography is real: One in five invasive cancers found by screening represents overdiagnosis. Overdiagnosis happens when cellular abnormalities meet the pathologic definition of "cancer," yet never progress to cause clinical disease. Overdiagnosed women are told they have cancer, are treated for cancer, yet their "cancer" is not destined to cause them any problems.

It is important to recognize this estimate doesn't include the smallest, earliest form of breast cancer found only by mammography -- ductal carcinoma in situ or DCIS.

If overdiagnosis is a problem in invasive cancer, you can imagine it might be a greater problem for a smaller, earlier form of cancer. Even mammography's old guard objects to having DCIS included in estimates of the amount of overdiagnosis.

Why do they object? Because so much of DCIS represents overdiagnosis, including it makes the estimate even higher.

It's time to get the science back in screening mammography and to recognize that mammographers may not be the ideal source for balanced information. It's too much like asking the dentists for balanced information about routine dental X-rays.

Follow us on Twitter @CNNOpinion.

Join us on Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of H. Gilbert Welch.

ADVERTISEMENT
Part of complete coverage on
April 16, 2014 -- Updated 1201 GMT (2001 HKT)
Rick McGahey says Rep. Paul Ryan is signaling his presidential ambitions by appealing to hard core Republican values
April 16, 2014 -- Updated 1539 GMT (2339 HKT)
Paul Saffo says current Google Glasses are doomed to become eBay collectibles, but they are only the leading edge of a surge in wearable tech that will change our lives
April 15, 2014 -- Updated 1849 GMT (0249 HKT)
Kathleen Blee says the KKK and white power or neo-Nazi groups give haters the purpose and urgency to use violence.
April 16, 2014 -- Updated 1156 GMT (1956 HKT)
Sen. Sheldon Whitehouse and Rep. Henry Waxman say read deep, and you'll see the federal Keystone pipeline report spells out the pipeline is bad news
April 16, 2014 -- Updated 1153 GMT (1953 HKT)
Frida Ghitis says President Obama needs to stop making empty threats against Russia and consider other options
April 15, 2014 -- Updated 2129 GMT (0529 HKT)
Peter Bergen and David Sterman say the Kansas Jewish Center killings are part of a string of lethal violence in the U.S. that outstrips al Qaeda-influenced attacks. Why don't we pay more attention?
April 15, 2014 -- Updated 1641 GMT (0041 HKT)
Danny Cevallos says families of the passengers on Malaysian Airlines Flight 370 need legal counsel
April 14, 2014 -- Updated 1523 GMT (2323 HKT)
David Frum says Russia is on a rampage of mischief while Western leaders and Western alliances charged with keeping the peace hem and haw
April 14, 2014 -- Updated 1156 GMT (1956 HKT)
Most adults make the mistakes of hitting the snooze button and of checking emails first thing in the morning, writes Mel Robbins
April 14, 2014 -- Updated 1754 GMT (0154 HKT)
David Wheeler says as middle-class careers continue to disappear, we need a monthly cash payment to everyone
April 14, 2014 -- Updated 1155 GMT (1955 HKT)
Democrats need to show more political spine when it comes to the issue of taxes.
April 14, 2014 -- Updated 1555 GMT (2355 HKT)
Donna Brazile recalls the 50th Anniversary of the Civil Rights Act as four presidents honored the heroes of the movement and Lyndon Johnson, who signed the law
April 14, 2014 -- Updated 1317 GMT (2117 HKT)
Elmer Smith remembers Chuck Stone, the legendary journalist from Philadelphia who was known as a thorn in the side of police and an advocate for the little guy
April 13, 2014 -- Updated 1856 GMT (0256 HKT)
Al Franken says Comcast, the nation's largest cable provider, wants to acquire Time Warner Cable, the nation's second-largest cable provider. Should we be concerned?
April 11, 2014 -- Updated 1522 GMT (2322 HKT)
Philip Cook and Kristin Goss says the Pennsylvania stabbing attack, which caused grave injury -- but not death, carries a lesson on guns for policymakers
April 11, 2014 -- Updated 1906 GMT (0306 HKT)
Wikipedia lists 105 football movies, but all too many of them are forgettable, writes Mike Downey
April 11, 2014 -- Updated 1432 GMT (2232 HKT)
John Sutter and hundreds of iReporters set out to run marathons after the bombings -- and learned a lot about the culture of running
April 11, 2014 -- Updated 1649 GMT (0049 HKT)
Timothy Stanley says it was cowardly to withdraw the offer of an honorary degree to Ayaan Hirsi Ali. The university should have done its homework on her narrow views and not made the offer
April 11, 2014 -- Updated 1416 GMT (2216 HKT)
Al Awlaki
Almost three years after his death in a 2011 CIA drone strike in Yemen, Anwar al-Awlaki continues to inspire violent jihadist extremists in the U.S, writes Peter Bergen
April 12, 2014 -- Updated 0121 GMT (0921 HKT)
David Bianculli says Colbert is a smart, funny interviewer, but ditching his blowhard persona to take over the mainstream late-night role may cost him fans
April 10, 2014 -- Updated 1731 GMT (0131 HKT)
Rep. Paul Ryan says the Republican budget places its trust in the people, not in Washington
April 10, 2014 -- Updated 2128 GMT (0528 HKT)
Aaron David Miller says Obama isn't to blame for Kerry's lack of progress in resolving Mideast talks
April 14, 2014 -- Updated 1522 GMT (2322 HKT)
David Weinberger says beyond focusing on the horrors of the attack a year ago, it's worth remembering the lessons it taught about strength, the dangers of idle speculation and Boston's solidarity
April 10, 2014 -- Updated 1632 GMT (0032 HKT)
Katherine Newman says the motive for the school stabbing attack in Pennsylvania is not yet known, but research on such rampages turns up similarities in suspects and circumstances
April 11, 2014 -- Updated 1103 GMT (1903 HKT)
Simon Tisdall: Has John Kerry's recent track record left Russia's wily leader ever more convinced of U.S. weakness?
April 10, 2014 -- Updated 1640 GMT (0040 HKT)
Mel Robbins says Nate Scimio deserves credit for acting bravely in a frightening attack and shouldn't be criticized for posting a selfie afterward
April 9, 2014 -- Updated 1839 GMT (0239 HKT)
Wendy Townsend says the Rattlesnake Roundup -- where thousands of pounds of snakes are killed and tormented -- is barbaric
April 10, 2014 -- Updated 1345 GMT (2145 HKT)
Dr. Mary Mulcahy says doctors who tell their patients the truth risk getting bad ratings from them
April 9, 2014 -- Updated 1328 GMT (2128 HKT)
Peggy Drexler says the married Rep. McAllister, caught on video making out with a staffer, won't get a pass from voters who elected him as a Christian conservative with family values
April 9, 2014 -- Updated 1143 GMT (1943 HKT)
David Frum says the president has failed to react strongly to crises in Iran, Syria, Ukraine and Venezuela, encouraging others to act out
April 9, 2014 -- Updated 2057 GMT (0457 HKT)
Eric Liu says Paul Ryan gets it very wrong: The U.S.'s problem is not a culture of poverty, it is a culture of wealth that is destroying the American value linking work and reward
April 9, 2014 -- Updated 1151 GMT (1951 HKT)
Frida Ghitis writes: "We are still seeing the world mostly through men's eyes. We are still hearing it explained to us mostly by men."
April 10, 2014 -- Updated 1408 GMT (2208 HKT)
Chester Wisniewski says the Heartbleed bug shows how we're all tangled together, relying on each other for Internet security
April 9, 2014 -- Updated 1926 GMT (0326 HKT)
Danny Cevallos says an Ohio school that suspended a little kid for pointing his finger at another kid and pretending to shoot shows the growth in "zero tolerance" policies at school run amok
ADVERTISEMENT