Skip to main content

Why FBI and CIA didn't connect the dots

By Bruce Schneier, Special to CNN
May 2, 2013 -- Updated 1437 GMT (2237 HKT)
Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer. Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer.
HIDE CAPTION
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
<<
<
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
>
>>
STORY HIGHLIGHTS
  • FBI, CIA criticized for not keeping better track of Tamerlan Tsarnaev before attack
  • Bruce Schneier: Connecting the dots seems easy in hindsight, but in real life, it's not
  • He says there are an enormous number of potential bad guys
  • Schneier: If a terrorist plot succeeds, it doesn't mean law enforcement systems failed

Editor's note: Bruce Schneier is a security technologist and author of "Liars and Outliers: Enabling the Trust Society Needs to Survive."

(CNN) -- The FBI and the CIA are being criticized for not keeping better track of Tamerlan Tsarnaev in the months before the Boston Marathon bombings. How could they have ignored such a dangerous person? How do we reform the intelligence community to ensure this kind of failure doesn't happen again?

It's an old song by now, one we heard after the 9/11 attacks in 2001 and after the Underwear Bomber's failed attack in 2009. The problem is that connecting the dots is a bad metaphor, and focusing on it makes us more likely to implement useless reforms.

Connecting the dots in a coloring book is easy and fun. They're right there on the page, and they're all numbered. All you have to do is move your pencil from one dot to the next, and when you're done, you've drawn a sailboat. Or a tiger. It's so simple that 5-year-olds can do it.

Bruce Schneier
Bruce Schneier

But in real life, the dots can only be numbered after the fact. With the benefit of hindsight, it's easy to draw lines from a Russian request for information to a foreign visit to some other piece of information that might have been collected.

Opinion: Agencies often miss warning signs of attacks

In hindsight, we know who the bad guys are. Before the fact, there are an enormous number of potential bad guys.

How many? We don't know. But we know that the no-fly list had 21,000 people on it last year. The Terrorist Identities Datamart Environment, also known as the watch list, has 700,000 names on it.

We have no idea how many potential "dots" the FBI, CIA, NSA and other agencies collect, but it's easily in the millions. It's easy to work backwards through the data and see all the obvious warning signs. But before a terrorist attack, when there are millions of dots -- some important but the vast majority unimportant -- uncovering plots is a lot harder.

Rather than thinking of intelligence as a simple connect-the-dots picture, think of it as a million unnumbered pictures superimposed on top of each other. Or a random-dot stereogram. Is it a sailboat, a puppy, two guys with pressure-cooker bombs or just an unintelligible mess of dots? You try to figure it out.

It's not a matter of not enough data, either.

Piling more data onto the mix makes it harder, not easier. The best way to think of it is a needle-in-a-haystack problem; the last thing you want to do is increase the amount of hay you have to search through.

The television show "Person of Interest" is fiction, not fact.

There's a name for this sort of logical fallacy: hindsight bias.

First explained by psychologists Daniel Kahneman and Amos Tversky, it's surprisingly common. Since what actually happened is so obvious once it happens, we overestimate how obvious it was before it happened.

We actually misremember what we once thought, believing that we knew all along that what happened would happen. It's a surprisingly strong tendency, one that has been observed in countless laboratory experiments and real-world examples of behavior. And it's what all the post-Boston-Marathon bombing dot-connectors are doing.

Before we start blaming agencies for failing to stop the Boston bombers, and before we push "intelligence reforms" that will shred civil liberties without making us any safer, we need to stop seeing the past as a bunch of obvious dots that need connecting.

Kahneman, a Nobel prize winner, wisely noted: "Actions that seemed prudent in foresight can look irresponsibly negligent in hindsight." Kahneman calls it "the illusion of understanding," explaining that the past is only so understandable because we have cast it as simple inevitable stories and leave out the rest.

Nassim Taleb, an expert on risk engineering, calls this tendency the "narrative fallacy." We humans are natural storytellers, and the world of stories is much more tidy, predictable and coherent than the real world.

Millions of people behave strangely enough to warrant the FBI's notice, and almost all of them are harmless. It is simply not possible to find every plot beforehand, especially when the perpetrators act alone and on impulse.

We have to accept that there always will be a risk of terrorism, and that when the occasional plot succeeds, it's not necessarily because our law enforcement systems have failed.

Follow @CNNOpinion on Twitter.

Join us at Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of Bruce Schneier.

ADVERTISEMENT
Part of complete coverage on
December 19, 2014 -- Updated 1022 GMT (1822 HKT)
President Obama has been flexing his executive muscles lately despite Democrat's losses, writes Gloria Borger
December 18, 2014 -- Updated 1951 GMT (0351 HKT)
Jeff Yang says the film industry's surrender will have lasting implications.
December 18, 2014 -- Updated 2113 GMT (0513 HKT)
Newt Gingrich: No one should underestimate the historic importance of the collapse of American defenses in the Sony Pictures attack.
December 10, 2014 -- Updated 1255 GMT (2055 HKT)
Dean Obeidallah asks how the genuine Stephen Colbert will do, compared to "Stephen Colbert"
December 18, 2014 -- Updated 1734 GMT (0134 HKT)
Some GOP politicians want drug tests for welfare recipients; Eric Liu says bailed-out execs should get equal treatment
December 18, 2014 -- Updated 1342 GMT (2142 HKT)
Louis Perez: Obama introduced a long-absent element of lucidity into U.S. policy on Cuba.
December 16, 2014 -- Updated 1740 GMT (0140 HKT)
The slaughter of more than 130 children by the Pakistani Taliban may prove as pivotal to Pakistan's security policy as the 9/11 attacks were for the U.S., says Peter Bergen.
December 17, 2014 -- Updated 1600 GMT (0000 HKT)
The Internet is an online extension of our own neighborhoods. It's time for us to take their protection just as seriously, says Arun Vishwanath.
December 16, 2014 -- Updated 2154 GMT (0554 HKT)
Gayle Lemmon says we must speak out for the right of children to education -- and peace
December 17, 2014 -- Updated 1023 GMT (1823 HKT)
Russia's economic woes just seem to be getting worse. How will President Vladimir Putin respond? Frida Ghitis gives her take.
December 17, 2014 -- Updated 0639 GMT (1439 HKT)
Australia has generally seen itself as detached from the threat of terrorism. The hostage incident this week may change that, writes Max Barry.
December 12, 2014 -- Updated 2020 GMT (0420 HKT)
Thomas Maier says the trove of letters the Kennedy family has tried to guard from public view gives insight into the Kennedy legacy and the history of era.
December 15, 2014 -- Updated 1456 GMT (2256 HKT)
Will Congress reform the CIA? It's probably best not to expect much from Washington. This is not the 1970s, and the chances for substantive reform are not good.
December 15, 2014 -- Updated 2101 GMT (0501 HKT)
From superstorms to droughts, not a week goes by without a major disruption somewhere in the U.S. But with the right planning, natural disasters don't have to be devastating.
December 15, 2014 -- Updated 1453 GMT (2253 HKT)
Would you rather be sexy or smart? Carol Costello says she hates this dumb question.
December 14, 2014 -- Updated 2253 GMT (0653 HKT)
A story about Pope Francis allegedly saying animals can go to heaven went viral late last week. The problem is that it wasn't true. Heidi Schlumpf looks at the discussion.
December 14, 2014 -- Updated 1550 GMT (2350 HKT)
Democratic leaders should wake up to the reality that the party's path to electoral power runs through the streets, where part of the party's base has been marching for months, says Errol Louis
December 13, 2014 -- Updated 2123 GMT (0523 HKT)
David Gergen: John Brennan deserves a national salute for his efforts to put the report about the CIA in perspective
December 12, 2014 -- Updated 1426 GMT (2226 HKT)
Anwar Sanders says that in some ways, cops and protesters are on the same side
December 11, 2014 -- Updated 1439 GMT (2239 HKT)
A view by Samir Naji, a Yemeni who was accused of serving in Osama bin Laden's security detail and imprisoned for nearly 13 years without charge in Guantanamo Bay
December 14, 2014 -- Updated 1738 GMT (0138 HKT)
S.E. Cupp asks: How much reality do you really want in your escapist TV fare?
December 11, 2014 -- Updated 1828 GMT (0228 HKT)
Rip Rapson says the city's 'Grand Bargain' saved pensions and a world class art collection by pulling varied stakeholders together, setting civic priorities and thinking outside the box
December 13, 2014 -- Updated 2310 GMT (0710 HKT)
Glenn Schwartz says the airing of the company's embarrassing emails might wake us up to the usefulness of talking in-person instead of electronically
December 12, 2014 -- Updated 2233 GMT (0633 HKT)
The computer glitch that disrupted air traffic over the U.K. on Friday was a nuisance, but not dangerous, says Les Abend
ADVERTISEMENT