Skip to main content

Why FBI and CIA didn't connect the dots

By Bruce Schneier, Special to CNN
May 2, 2013 -- Updated 1437 GMT (2237 HKT)
Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer. Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer.
HIDE CAPTION
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
<<
<
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
>
>>
STORY HIGHLIGHTS
  • FBI, CIA criticized for not keeping better track of Tamerlan Tsarnaev before attack
  • Bruce Schneier: Connecting the dots seems easy in hindsight, but in real life, it's not
  • He says there are an enormous number of potential bad guys
  • Schneier: If a terrorist plot succeeds, it doesn't mean law enforcement systems failed

Editor's note: Bruce Schneier is a security technologist and author of "Liars and Outliers: Enabling the Trust Society Needs to Survive."

(CNN) -- The FBI and the CIA are being criticized for not keeping better track of Tamerlan Tsarnaev in the months before the Boston Marathon bombings. How could they have ignored such a dangerous person? How do we reform the intelligence community to ensure this kind of failure doesn't happen again?

It's an old song by now, one we heard after the 9/11 attacks in 2001 and after the Underwear Bomber's failed attack in 2009. The problem is that connecting the dots is a bad metaphor, and focusing on it makes us more likely to implement useless reforms.

Connecting the dots in a coloring book is easy and fun. They're right there on the page, and they're all numbered. All you have to do is move your pencil from one dot to the next, and when you're done, you've drawn a sailboat. Or a tiger. It's so simple that 5-year-olds can do it.

Bruce Schneier
Bruce Schneier

But in real life, the dots can only be numbered after the fact. With the benefit of hindsight, it's easy to draw lines from a Russian request for information to a foreign visit to some other piece of information that might have been collected.

Opinion: Agencies often miss warning signs of attacks

In hindsight, we know who the bad guys are. Before the fact, there are an enormous number of potential bad guys.

How many? We don't know. But we know that the no-fly list had 21,000 people on it last year. The Terrorist Identities Datamart Environment, also known as the watch list, has 700,000 names on it.

We have no idea how many potential "dots" the FBI, CIA, NSA and other agencies collect, but it's easily in the millions. It's easy to work backwards through the data and see all the obvious warning signs. But before a terrorist attack, when there are millions of dots -- some important but the vast majority unimportant -- uncovering plots is a lot harder.

Rather than thinking of intelligence as a simple connect-the-dots picture, think of it as a million unnumbered pictures superimposed on top of each other. Or a random-dot stereogram. Is it a sailboat, a puppy, two guys with pressure-cooker bombs or just an unintelligible mess of dots? You try to figure it out.

It's not a matter of not enough data, either.

Piling more data onto the mix makes it harder, not easier. The best way to think of it is a needle-in-a-haystack problem; the last thing you want to do is increase the amount of hay you have to search through.

The television show "Person of Interest" is fiction, not fact.

There's a name for this sort of logical fallacy: hindsight bias.

First explained by psychologists Daniel Kahneman and Amos Tversky, it's surprisingly common. Since what actually happened is so obvious once it happens, we overestimate how obvious it was before it happened.

We actually misremember what we once thought, believing that we knew all along that what happened would happen. It's a surprisingly strong tendency, one that has been observed in countless laboratory experiments and real-world examples of behavior. And it's what all the post-Boston-Marathon bombing dot-connectors are doing.

Before we start blaming agencies for failing to stop the Boston bombers, and before we push "intelligence reforms" that will shred civil liberties without making us any safer, we need to stop seeing the past as a bunch of obvious dots that need connecting.

Kahneman, a Nobel prize winner, wisely noted: "Actions that seemed prudent in foresight can look irresponsibly negligent in hindsight." Kahneman calls it "the illusion of understanding," explaining that the past is only so understandable because we have cast it as simple inevitable stories and leave out the rest.

Nassim Taleb, an expert on risk engineering, calls this tendency the "narrative fallacy." We humans are natural storytellers, and the world of stories is much more tidy, predictable and coherent than the real world.

Millions of people behave strangely enough to warrant the FBI's notice, and almost all of them are harmless. It is simply not possible to find every plot beforehand, especially when the perpetrators act alone and on impulse.

We have to accept that there always will be a risk of terrorism, and that when the occasional plot succeeds, it's not necessarily because our law enforcement systems have failed.

Follow @CNNOpinion on Twitter.

Join us at Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of Bruce Schneier.

ADVERTISEMENT
Part of complete coverage on
August 27, 2014 -- Updated 1626 GMT (0026 HKT)
The death of Douglas McAuthur McCain, the first American killed fighting for ISIS, highlights the pull of Syria's war for Western jihadists, writes Peter Bergen.
August 26, 2014 -- Updated 2242 GMT (0642 HKT)
Former ambassador to Syria Robert Ford says the West should be helping moderates in the Syrian armed opposition end the al-Assad regime and form a government to focus on driving ISIS out
August 27, 2014 -- Updated 1321 GMT (2121 HKT)
Ruben Navarrette says a great country does not deport thousands of vulnerable, unaccompanied minors who fled in fear for their lives
August 27, 2014 -- Updated 1319 GMT (2119 HKT)
Robert McIntyre says Congress is the culprit for letting Burger King pay lower taxes after merging with Tim Hortons.
August 26, 2014 -- Updated 2335 GMT (0735 HKT)
Wesley Clark says the U.S. can offer support to its Islamic friends in the region most threatened by ISIS, but it can't fight their war
August 27, 2014 -- Updated 1126 GMT (1926 HKT)
Jeff Yang says the tech sector's diversity numbers are embarrassing and the big players need to do more.
August 26, 2014 -- Updated 2053 GMT (0453 HKT)
America's painful struggle with racism has often brought great satisfaction to the country's rivals, critics, and foes. The killing of Michael Brown and its tumultuous aftermath has been a bonanza.
August 26, 2014 -- Updated 2019 GMT (0419 HKT)
Ed Bark says in this Emmy year, broadcasters CBS, ABC and PBS can all say they matched or exceeded HBO. These days that's no small feat
August 26, 2014 -- Updated 1919 GMT (0319 HKT)
Rick Martin says the death of Robin Williams brought back memories of his own battle facing down depression as a young man
August 26, 2014 -- Updated 1558 GMT (2358 HKT)
David Perry asks: What's the best way for police officers to handle people with psychiatric disabilities?
August 25, 2014 -- Updated 1950 GMT (0350 HKT)
Julian Zelizer says it's not crazy to think Mitt Romney would be able to end up at the top of the GOP ticket in 2016
August 25, 2014 -- Updated 2052 GMT (0452 HKT)
Roxanne Jones and her girlfriends would cheer from the sidelines for the boys playing Little League. But they really wanted to play. Now Mo'ne Davis shows the world that girls really can throw.
August 25, 2014 -- Updated 1629 GMT (0029 HKT)
Peter Bergen and Emily Schneider say a YouTube video apparently posted by ISIS seems to show that the group has a surveillance drone, highlighting a new reality: Terrorist groups have technology once only used by states
August 25, 2014 -- Updated 2104 GMT (0504 HKT)
Kimberly Norwood is a black mom who lives in an affluent neighborhood not far from Ferguson, but she has the same fears for her children as people in that troubled town do
August 22, 2014 -- Updated 2145 GMT (0545 HKT)
It apparently has worked for France, say Peter Bergen and Emily Schneider, but carries uncomfortable risks. When it comes to kidnappings, nations face grim options.
August 26, 2014 -- Updated 1727 GMT (0127 HKT)
John Bare says the Ice Bucket Challenge signals a new kind of activism and peer-to-peer fund-raising.
August 22, 2014 -- Updated 1231 GMT (2031 HKT)
James Dawes says calling ISIS evil over and over again could very well make it harder to stop them.
August 24, 2014 -- Updated 0105 GMT (0905 HKT)
As the inquiry into the shooting of Michael Brown continues, critics question the prosecutor's impartiality.
August 22, 2014 -- Updated 2247 GMT (0647 HKT)
Newt Gingrich says it's troubling that a vicious group like ISIS can recruit so many young men from Britain.
August 21, 2014 -- Updated 1450 GMT (2250 HKT)
David Weinberger says Twitter and other social networks have been vested with a responsibility, and a trust, they did not ask for.
August 22, 2014 -- Updated 1103 GMT (1903 HKT)
John Inazu says the slogan "We are Ferguson" is meant to express empathy and solidarity. It's not true: Not all of us live in those circumstances. But we all made them.
August 22, 2014 -- Updated 1223 GMT (2023 HKT)
Retired Lt. Gen. Mark Hertling says he learned that the territory ISIS wants to control is amazingly complex.
August 20, 2014 -- Updated 1951 GMT (0351 HKT)
Cerue Garlo says Liberia is desperate for help amid a Ebola outbreak that has touched every aspect of life.
August 21, 2014 -- Updated 1742 GMT (0142 HKT)
Eric Liu says Republicans who want to restrict voting may win now, but the party will suffer in the long term.
August 21, 2014 -- Updated 1538 GMT (2338 HKT)
Jay Parini: Jesus, Pope and now researchers agree: Wealth decreases our ability to sympathize with the poor.
August 21, 2014 -- Updated 1200 GMT (2000 HKT)
Judy Melinek offers a medical examiner's perspective on what happens when police kill people like Michael Brown.
August 19, 2014 -- Updated 2203 GMT (0603 HKT)
It used to be billy clubs, fire hoses and snarling German shepherds. Now it's armored personnel carriers and flash-bang grenades, writes Kara Dansky.
August 20, 2014 -- Updated 1727 GMT (0127 HKT)
Maria Haberfeld: People who are unfamiliar with police work can reasonably ask, why was an unarmed man shot so many times, and why was deadly force used at all?
ADVERTISEMENT