Skip to main content

Why FBI and CIA didn't connect the dots

By Bruce Schneier, Special to CNN
May 2, 2013 -- Updated 1437 GMT (2237 HKT)
Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer. Dias Kadyrbayev, left, with Boston Marathon bombing suspect Dzhokhar Tsamaev in a picture taken from the social media site VK.com. Kadyrbayev is expected to plead guilty August 21 to charges in connection with removing a backpack and computer from Tsamaev's dorm room after the April 2013 bombing, according to a defense lawyer.
HIDE CAPTION
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
<<
<
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
>
>>
STORY HIGHLIGHTS
  • FBI, CIA criticized for not keeping better track of Tamerlan Tsarnaev before attack
  • Bruce Schneier: Connecting the dots seems easy in hindsight, but in real life, it's not
  • He says there are an enormous number of potential bad guys
  • Schneier: If a terrorist plot succeeds, it doesn't mean law enforcement systems failed

Editor's note: Bruce Schneier is a security technologist and author of "Liars and Outliers: Enabling the Trust Society Needs to Survive."

(CNN) -- The FBI and the CIA are being criticized for not keeping better track of Tamerlan Tsarnaev in the months before the Boston Marathon bombings. How could they have ignored such a dangerous person? How do we reform the intelligence community to ensure this kind of failure doesn't happen again?

It's an old song by now, one we heard after the 9/11 attacks in 2001 and after the Underwear Bomber's failed attack in 2009. The problem is that connecting the dots is a bad metaphor, and focusing on it makes us more likely to implement useless reforms.

Connecting the dots in a coloring book is easy and fun. They're right there on the page, and they're all numbered. All you have to do is move your pencil from one dot to the next, and when you're done, you've drawn a sailboat. Or a tiger. It's so simple that 5-year-olds can do it.

Bruce Schneier
Bruce Schneier

But in real life, the dots can only be numbered after the fact. With the benefit of hindsight, it's easy to draw lines from a Russian request for information to a foreign visit to some other piece of information that might have been collected.

Opinion: Agencies often miss warning signs of attacks

In hindsight, we know who the bad guys are. Before the fact, there are an enormous number of potential bad guys.

How many? We don't know. But we know that the no-fly list had 21,000 people on it last year. The Terrorist Identities Datamart Environment, also known as the watch list, has 700,000 names on it.

We have no idea how many potential "dots" the FBI, CIA, NSA and other agencies collect, but it's easily in the millions. It's easy to work backwards through the data and see all the obvious warning signs. But before a terrorist attack, when there are millions of dots -- some important but the vast majority unimportant -- uncovering plots is a lot harder.

Rather than thinking of intelligence as a simple connect-the-dots picture, think of it as a million unnumbered pictures superimposed on top of each other. Or a random-dot stereogram. Is it a sailboat, a puppy, two guys with pressure-cooker bombs or just an unintelligible mess of dots? You try to figure it out.

It's not a matter of not enough data, either.

Piling more data onto the mix makes it harder, not easier. The best way to think of it is a needle-in-a-haystack problem; the last thing you want to do is increase the amount of hay you have to search through.

The television show "Person of Interest" is fiction, not fact.

There's a name for this sort of logical fallacy: hindsight bias.

First explained by psychologists Daniel Kahneman and Amos Tversky, it's surprisingly common. Since what actually happened is so obvious once it happens, we overestimate how obvious it was before it happened.

We actually misremember what we once thought, believing that we knew all along that what happened would happen. It's a surprisingly strong tendency, one that has been observed in countless laboratory experiments and real-world examples of behavior. And it's what all the post-Boston-Marathon bombing dot-connectors are doing.

Before we start blaming agencies for failing to stop the Boston bombers, and before we push "intelligence reforms" that will shred civil liberties without making us any safer, we need to stop seeing the past as a bunch of obvious dots that need connecting.

Kahneman, a Nobel prize winner, wisely noted: "Actions that seemed prudent in foresight can look irresponsibly negligent in hindsight." Kahneman calls it "the illusion of understanding," explaining that the past is only so understandable because we have cast it as simple inevitable stories and leave out the rest.

Nassim Taleb, an expert on risk engineering, calls this tendency the "narrative fallacy." We humans are natural storytellers, and the world of stories is much more tidy, predictable and coherent than the real world.

Millions of people behave strangely enough to warrant the FBI's notice, and almost all of them are harmless. It is simply not possible to find every plot beforehand, especially when the perpetrators act alone and on impulse.

We have to accept that there always will be a risk of terrorism, and that when the occasional plot succeeds, it's not necessarily because our law enforcement systems have failed.

Follow @CNNOpinion on Twitter.

Join us at Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of Bruce Schneier.

ADVERTISEMENT
Part of complete coverage on
September 13, 2014 -- Updated 1620 GMT (0020 HKT)
Joe Torre and Esta Soler say much has been achieved since a landmark anti-violence law was passed.
September 12, 2014 -- Updated 2055 GMT (0455 HKT)
David Wheeler wonders: If Scotland votes to secede, can America take its place and rejoin England?
September 12, 2014 -- Updated 2207 GMT (0607 HKT)
Jane Stoever: Society must grapple with a culture in which 1 in 3 teen girls and women suffer partner violence.
September 12, 2014 -- Updated 2036 GMT (0436 HKT)
World-famous physicist Stephen Hawking recently said the world as we know it could be obliterated instantaneously. Meg Urry says fear not.
September 12, 2014 -- Updated 2211 GMT (0611 HKT)
Bill Clinton's speech accepting the Democratic nomination for president in 1992 went through 22 drafts. But he always insisted on including a call to service.
September 12, 2014 -- Updated 2218 GMT (0618 HKT)
Joe Amon asks: What turns a few cases of disease into thousands?
September 12, 2014 -- Updated 1922 GMT (0322 HKT)
A Scottish vote for independence next week could trigger wave of separatist tension in Europe, says Frida Ghitis.
September 12, 2014 -- Updated 2212 GMT (0612 HKT)
You couldn't call him a "Bond villain" in the grand context of Dr. No or Auric Goldfinger. They were twisted visionaries of apocalypse whose ideas were to be played out at humanity's expense.
September 12, 2014 -- Updated 1705 GMT (0105 HKT)
As a Latina activist I was hurt to hear the President would delay executive action to keep undocumented immigrants with no criminal record from getting deported.
September 11, 2014 -- Updated 1721 GMT (0121 HKT)
Sally Kohn says bombing ISIS will worsen instability in Iraq and strengthen radical ideology in terrorist groups.
September 11, 2014 -- Updated 2224 GMT (0624 HKT)
Stevan Weine says the key is to stop young people from acquiring radicalized beliefs in the first place.
September 11, 2014 -- Updated 1730 GMT (0130 HKT)
Analysts weigh in on the president's plans for addressing the threat posed by the Islamic State of Iraq and Syria.
September 11, 2014 -- Updated 1227 GMT (2027 HKT)
US Currency is seen in this January 30, 2001 image. AFP PHOTO/Karen BLEIER (Photo credit should read KAREN BLEIER/AFP/Getty Images)
Lisa Gilbert says a million people have asked the SEC to make corporations disclose political contributions.
September 11, 2014 -- Updated 0455 GMT (1255 HKT)
Christi Paul says unless you've walked in an abused woman's shoes, don't judge her, help her get answers to the right questions: Why does he get to hit her? And why does nobody do anything to stop him?
September 10, 2014 -- Updated 1932 GMT (0332 HKT)
Mel Robbins says several other NFL players arrested recently in domestic violence are back on the field. Roger Goodell has shown he is clueless on abuse. He must go.
September 10, 2014 -- Updated 1759 GMT (0159 HKT)
Newt Gingrich says President Obama has a remarkable opportunity Wednesday night to mobilize support for a coalition against ISIS.
September 11, 2014 -- Updated 0041 GMT (0841 HKT)
The Texas senator says Obama should seek congressional authorization for a major bombing campaign vs. ISIS.
September 11, 2014 -- Updated 1327 GMT (2127 HKT)
Artist Prune Nourry's project reinterprets the terracotta warriors in an exhibition about gender preference in China.
September 10, 2014 -- Updated 1336 GMT (2136 HKT)
The Apple Watch is on its way. Jeff Yang asks: Are we ready to embrace wearables technology at last?
ADVERTISEMENT