Wednesday, January 13, 2010

Obama: Software Flaws Let Christmas Bomber Get Through

We are being told that institutional failure or human failure (i.e. "someone needs to pay") is responsible for the inability to connect the dots between intelligence fragments, and therefore a dangerous person with explosives being allowed to board Northwest Airlines flight 253. But according to Danger Room blog, it is really a simple matter of crappy software:

Obama: Software Flaws Let Christmas Bomber Get Through: "
Crappy government software — and failure to use that software right — almost got 289 people killed in the botched Christmas day bombing.

“Information sharing does not appear to have contributed to this intelligence failure; relevant all-sources analysts as well as watchlisting personnel who needed this information were not preventing from accessing it,” the White House noted in its review of the incident. The problem was in the databases, and in the data-mining software. “Information technology within the CT [counterterrorism] community did not sufficiently enable the correlation of data that would have enable analysts to highlight the relevant threat information.”

You bet it didn’t. Government search tools weren’t even flexible enough to handle simple misspellings. As the White House review notes:

A misspelling of Mr. Abdulmutallab’s name initially resulted in the State Department believing he did not have a valid U.S. visa. A determination to revoke his visa however would have only occurred if there had been a successful integration of intelligence by the CT [counterterrorism] community, resulting in his being watchlisted.

This is a problem that commercial software firms largely solved years ago. (Try typing “Noa Schactmann” into Google, and see what comes up.) How it could persist in the CT community, I just don’t understand.

In a memo to his agency chiefs, President Obama ordered the Director of National Intelligence to “accelerate information technology enhancement, to include knowledge discovery, database integration, cross-database search, and the ability to correlate biographic information with terrorism-related intelligence.”

All of which will be helpful. But analysts have to actually use the tools. That didn’t happen in the Christmas attack. “NCTC and CIA personnel who are responsible for watchlisting did not search all available databases,” the White House noted.

The Department of Homeland Security did run Northwest Airlines flight 253’s passenger manifest against terrorism databases. But only after the flight took off. Ugh.

[Photo: U.S. Marshalls]"


Is there some reason we can't get this right??? Do we need to point our fingers in the wrong direction in order to score political points? Let's fix this problem and get it right this time.

2 comments:

  1. It's not that easy. For one the spelling of these folks names doesn't always translate into English all that well. There are several ways to spell the same name. How many spellings of bin laden have you seen? Lots, and how do you know that John Smith is really John Smythe even if you have software to figure out the spelling issue. This is not just a problem within the Government. This is a communication issue among lots of people in 16 different organizations spread across the world. Not a trivial probelm. Not excusing what happened just commenting on the difficulties.

    ReplyDelete
  2. It probably is indeed more complicated than Danger Room bloggers imply, though it seems that Google can do a lot better than our counterterrorism software. That doesn't mean Google can catch terrorists, though. But there may be something to learn here. The White House report itself pointed to software issues as the main cause of failing to "connect the dots." There is obviously room for improvement.

    ReplyDelete