Post by WaTcHeR on Aug 30, 2006 12:30:36 GMT -5
08.30.2006 - The FBI has built a database with more than 659 million records -- including terrorist watch lists, intelligence cables and financial transactions -- culled from more than 50 FBI and other government agency sources. The system is one of the most powerful data analysis tools available to law enforcement and counterterrorism agents, FBI officials said yesterday.
The FBI demonstrated the database to reporters yesterday in part to address criticism that its technology was failing and outdated as the fifth anniversary of the Sept. 11, 2001, terrorist attacks nears.
Privacy advocates said the Investigative Data Warehouse, launched in January 2004, raises concerns about how long the government stores such information and about the right of citizens to know what records are kept and correct information that is wrong.
The data warehouse is an effort to "connect the dots" that the FBI was accused of missing in the months before the 2001 attacks, bureau officials said. About a quarter of the information comes from the FBI's records and criminal case files. The rest -- including suspicious financial activity reports, no-fly lists, and lost and stolen passport data -- comes from the Treasury, State and Homeland Security departments and the Federal Bureau of Prisons.
"That's where the real knowledge comes from . . . sharing information," said Gurvais Grigg, acting director of the FBI's Foreign Terrorist Tracking Task Force, who helped develop the system.
In a demonstration, Grigg sat at a computer and typed in the name "Mohammad Atta," one of the 19 hijackers in 2001. The system can handle variants of names and up to 29 variants on birth dates. He typed "flight training" in the query box and pulled up 250 articles relating to Atta.
The system, designed by Chiliad Inc. of Amherst, Mass., can be programmed to send alerts to agents on new information, Grigg said. Names, Social Security numbers and driver's license details can be linked and cross-matched across hundreds of millions of records.
No top secret information is in the system, officials said.
Grigg said that before 2002, it would take 32,222 hours to run 1,000 names and birth dates across 50 databases. Now agents can make such a search in 30 minutes or less, he said.
The 13,000 agents and analysts who use the system make an average 1 million queries a month, Grigg said. The system does not reach into the databases themselves but mines copies that are updated regularly, he said.
Irrelevant information can be purged or restricted, and incorrect information is corrected, he said. Willie T. Hulon, executive assistant director of the FBI's National Security Branch, said that generally information is not removed from the system unless there is "cause for removal."
Every data source is reviewed by security, legal and technology staff members, and a privacy impact statement is created, Grigg said. The FBI conducts in-house auditing so that each query can be tracked, he said.
David Sobel, senior counsel of the Electronic Frontier Foundation, said the Federal Register has no record of the creation of such a system, a basic requirement of the Privacy Act. He also said the FBI's use of an internal privacy assessment undercuts the intent of the privacy law.
FBI officials said the database is in "full compliance" with the law.
Sobel said he learned under a Freedom of Information Act disclosure last week that the system includes 250 million airline passenger records, stored permanently.
"It appears to be the largest collection of personal data ever amassed by the federal government," he said. "When they develop the capability to cross-reference and data-mine all these previously separate sources of information, there are significant new privacy issues that need to be publicly debated."
Michael Morehart, chief of the FBI's Terrorist Financing Operations Section, has testified to Congress about some aspects of the system. He said that Treasury Department documents included in the database have helped counterterrorism investigations significantly.
www.rawstory.com/showarticle.php?src=http%3A%2F%2Fwww.washingtonpost.com%2Fwp-dyn%2Fcontent%2Farticle%2F2006%2F08%2F29%2FAR2006082901520_pf.html
The FBI demonstrated the database to reporters yesterday in part to address criticism that its technology was failing and outdated as the fifth anniversary of the Sept. 11, 2001, terrorist attacks nears.
Privacy advocates said the Investigative Data Warehouse, launched in January 2004, raises concerns about how long the government stores such information and about the right of citizens to know what records are kept and correct information that is wrong.
The data warehouse is an effort to "connect the dots" that the FBI was accused of missing in the months before the 2001 attacks, bureau officials said. About a quarter of the information comes from the FBI's records and criminal case files. The rest -- including suspicious financial activity reports, no-fly lists, and lost and stolen passport data -- comes from the Treasury, State and Homeland Security departments and the Federal Bureau of Prisons.
"That's where the real knowledge comes from . . . sharing information," said Gurvais Grigg, acting director of the FBI's Foreign Terrorist Tracking Task Force, who helped develop the system.
In a demonstration, Grigg sat at a computer and typed in the name "Mohammad Atta," one of the 19 hijackers in 2001. The system can handle variants of names and up to 29 variants on birth dates. He typed "flight training" in the query box and pulled up 250 articles relating to Atta.
The system, designed by Chiliad Inc. of Amherst, Mass., can be programmed to send alerts to agents on new information, Grigg said. Names, Social Security numbers and driver's license details can be linked and cross-matched across hundreds of millions of records.
No top secret information is in the system, officials said.
Grigg said that before 2002, it would take 32,222 hours to run 1,000 names and birth dates across 50 databases. Now agents can make such a search in 30 minutes or less, he said.
The 13,000 agents and analysts who use the system make an average 1 million queries a month, Grigg said. The system does not reach into the databases themselves but mines copies that are updated regularly, he said.
Irrelevant information can be purged or restricted, and incorrect information is corrected, he said. Willie T. Hulon, executive assistant director of the FBI's National Security Branch, said that generally information is not removed from the system unless there is "cause for removal."
Every data source is reviewed by security, legal and technology staff members, and a privacy impact statement is created, Grigg said. The FBI conducts in-house auditing so that each query can be tracked, he said.
David Sobel, senior counsel of the Electronic Frontier Foundation, said the Federal Register has no record of the creation of such a system, a basic requirement of the Privacy Act. He also said the FBI's use of an internal privacy assessment undercuts the intent of the privacy law.
FBI officials said the database is in "full compliance" with the law.
Sobel said he learned under a Freedom of Information Act disclosure last week that the system includes 250 million airline passenger records, stored permanently.
"It appears to be the largest collection of personal data ever amassed by the federal government," he said. "When they develop the capability to cross-reference and data-mine all these previously separate sources of information, there are significant new privacy issues that need to be publicly debated."
Michael Morehart, chief of the FBI's Terrorist Financing Operations Section, has testified to Congress about some aspects of the system. He said that Treasury Department documents included in the database have helped counterterrorism investigations significantly.
www.rawstory.com/showarticle.php?src=http%3A%2F%2Fwww.washingtonpost.com%2Fwp-dyn%2Fcontent%2Farticle%2F2006%2F08%2F29%2FAR2006082901520_pf.html