28 June Briefing CIO Council

Rapid Overview of Large Volumes of Text: 

Rapid Overview of Large Volumes of Text Presented by: Roger Bradford 28 June, 2005

Workflow Environment – Inserting Conceptual Processing: 

Workflow Environment – Inserting Conceptual Processing Alias Detection Alert Generation New Entity Identification Entity Extraction Machine Translation Users Novelty Ranking Taxonomy Generation Categorization Other Software Content Analyst Data Acquisition Systems Stored Data

Scenario: 

Scenario Analyst Reviewing Newly Acquired Data Topic of Interest = A Specific Terrorist Group – Salafist Group for Call and Combat (GSPC)

Data Used: 

Data Used 1M News Articles: 900K Analyzed 100K New Processing Time on a Single PC: 900K ~ <24 Hrs 100K ~ <3 Hrs NO Auxiliary Structures: Taxonomies Ontologies Grammars

Slide5: 

Incoming Document Stream Content Analyst Categorized Items Alerts Taxonomic Overview Relevant And Unique Items Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim Possible Aliases Rapid Information Overview New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque

Slide6: 

Incoming Document Stream Content Analyst Alerts Taxonomic Overview Relevant And Unique Items Menad Benchellali  Abdel Hakim Laurent Mourad  Djamel Beghal Possible Aliases Alerts Chemical Nuclear Bioterrorism Categorized Items New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Slide7: 

Newly Acquired Document(s) being Relevant to Designated Topic  Associated Country Highlighted Alert Generation Analysts Indicate High-interest Topics using Example Documents: Xxxxxxxxx Xxxxxxxxx ..smallpox.. Xxxxxxxxx ..anthrax… Documents like this Relate to Biological Warfare…Alert me if Anything Else like this Comes in

Slide8: 

Israel Warns of Nuke Development in Iran and Syria Israel has stepped up its warnings in recent weeks of the potential dangers posed by Iran and Syria. In particular, Israeli officials warn that Iran could soon develop nuclear weapons and they object to what they say were Syrian attempts to purchase upgraded missiles from Russia. Earlier this week, the chief of Israel's Mossad intelligence agency told a parliamentary committee that by the end of 2005 Iran will have the technology needed to develop nuclear weapons within several years after that. The head of Israel's parliamentary security and foreign affairs committee, Yuval Steinitz told VOA, the warnings are urgent. "The Iranian very ambitious nuclear program is combined with a very ambitious ballistic missile program and the real aim of this is not becoming a regional nuclear power, but a global nuclear superpower and if this will happen a dark curtain will cover the Middle East and Europe and the rest of the world." The U.N. nuclear watchdog agency, the I.A.E.A. has been looking into Iran's nuclear program, but has yet to find clear evidence that Tehran intends to make nuclear weapons. Iran's Foreign Ministry spokesman rejected the Israeli allegations and accused Israel of simply trying to divert attention from its own nuclear program. Israel is widely believed to have nuclear weapons, but will neither confirm nor deny their existence and has not signed on to the international nuclear non-proliferation treaty. Israeli officials have also recently raised alarm bells about what they say were plans by Syria to purchase upgraded weapons from Russia, in particular the SA-18 Igla shoulder-fired surface to air missile. The Israeli warning came prior to a visit to Moscow this week by Syrian President Bashar al-Assad. In Moscow, President Assad denied that the issue was under discussion, but also defended his country's right to buy what he called "defensive" weapons. Israeli security analyst, Shlomo Brum of Tel Aviv's Jaffee Center for Strategic Studies says the SA-18 missile is not really new. He says he inspected one of them 15 years ago. "When I was Israeli Defense Attache in South Africa and the South Africans had captured some of these missiles in Angola. We know it for the last 15 years and so I presume we are quite capable of developing countermeasures against Shlomo Brum says, however, such missiles in the hands of Syria or Syrian-supported terrorist groups such as Hizbollah would present a challenge though it would not likely change the balance of military power between Syria and Israel. But, Yuval Steinitz says there is information that Syria is also attempting to acquire nuclear capability. Example – Top Priority (Red) = WMD-related

Slide9: 

Iraq Insurgents Seeking Chemical, Germ Weapons Insurgent networks across Iraq are increasingly trying to acquire and use toxic nerve gases, blister agents and germ weapons against U.S. and coalition forces, according to a CIA report. Investigators said one group recruited scientists and sought to prepare poisons over seven months before it was dismantled in June. U.S. officials say the threat is especially worrisome because leaders of the previously unknown group, which investigators dubbed the "Al Abud network," were based in Fallujah close to insurgents aligned with fugitive militant Abu Musab al-Zarqawi. The CIA says al-Zarqawi, who is blamed for numerous attacks on U.S. forces and beheadings of hostages, has long sought to get chemical and biological weapons for use against targets in Europe as well as Iraq. An exhaustive report released last week by Charles Duelfer, the CIA's chief weapons investigator in Iraq, concluded that deposed Iraqi President Saddam Hussein destroyed his stockpiles of chemical and biological weapons in the early 1990s and never tried to rebuild them. But a little-noticed section of the 960-page report warns that the danger of a "devastating" attack with unconventional weapons has grown since the U.S.-led invasion and occupation of Iraq last year. The Bush administration, which went to war primarily to disarm the Baghdad regime of suspected illicit stockpiles, has not previously disclosed that the insurgent groups that have emerged and steadily expanded since Saddam's ouster now are seeking to develop their own crude supplies of such deadly agents as mustard gas, ricin and the nerve gas tabun. Neither of the two chemists who worked for Al Abud had any ties to Saddam's long-defunct weapons programs, and Duelfer's investigators found no evidence that the group's poison project was part of a "prescribed plan by the former regime to fuel an insurgency." For now, the leaders and financiers of the network "remain at large, and alleged chemical munitions remain unaccounted," the report said. It added that other insurgent groups are "planning or attempting to produce or acquire" chemical and biological agents throughout Iraq, and warned that the availability of chemicals and munitions, as well as sympathetic former Iraqi weapons scientists, "increases the future threat." Example – Top Priority (Red) = WMD-related (Cont’d)

Slide10: 

Iran Denies Smuggling Uranium from Monitored Site TEHRAN (Reuters) - Iran denied Wednesday a report that it may have secretly moved some sensitive nuclear material from a site being monitored by the U.N.'s atomic watchdog. Diplomats told Reuters Tuesday that the International Atomic Energy Agency (IAEA) was taking an inventory of processed uranium at the Isfahan uranium conversion facility in central Iran amid concerns some may have been moved. The diplomats said one intelligence agency had accused Iran of spiriting an unspecified amount of processed uranium, which could be processed further and enriched for weapons purposes, out of Isfahan to an unknown location. Iran says its nuclear program is exclusively for generating electricity, not making bombs. Foreign Ministry spokesman Hamid Reza Asefi denied Iran had smuggled any uranium out of Isfahan. "Our nuclear activities are transparent and under the supervision of the IAEA," the official IRNA news agency quoted him as saying. "Iran seeks nuclear technology for peaceful purposes. It would be meaningless for Iran to smuggle" uranium from Isfahan, he added. Iran agreed last November to freeze work at Isfahan and all other nuclear fuel-related activities while it tries to reach agreement with the European Union over the future of its nuclear program. Diplomats say Britain, Germany and France, who are leading the EU talks with Iran, are currently considering an Iranian proposal to allow Tehran to keep a pilot uranium enrichment facility under IAEA supervision. But Iran's chief nuclear negotiator Hassan Rohani on Wednesday denied that any limitations on Iran's nuclear program were being considered. Example – Top Priority (Red) = WMD-related (Cont’d)

Conceptual Generalization: 

Conceptual Generalization BW Alert Exemplars Mentioned: Dhori Virus Hemorrhagic Fever West Nile Virus Cholera Marburg Virus Typhoid Rabies Bovine Brucellosis Rift Valley Fever Diptheria Foot-and-mouth Disease Smallpox Plague Anthrax Alerts Generated Covered:

Slide12: 

X Djamel Beghal Djamel Begal Jamal Baghal Jamal Begal Djamel Baghal Gemal Baqqal Terminology Variant Clustering        Jamal Beghal Djamal Beghal Djamel Beghal

Can deal Effectively with Text that is Highly Corrupted: 

Can deal Effectively with Text that is Highly Corrupted

Slide14: 

Incoming Document Stream Content Analyst Alerts Taxonomic Overview Relevant And Unique Items Possible Aliases Taxonomic Overview Chemical Nuclear Bioterrorism Categorized Items New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Taxonomy of New Documents: 

Taxonomy of New Documents

Taxonomy (Enlarged): 

Taxonomy (Enlarged)

Taxonomy – Second Level: 

Taxonomy – Second Level

Taxonomy – Individual Document Titles: 

Taxonomy – Individual Document Titles

Drill Down to Individual Documents: 

Drill Down to Individual Documents A chechen lead has emerged in the case of discovery of ricin poison Antiterrorist police have focused on an alleged Algerian-dominated network whose operatives are believed to have received specialized training with biological and chemical weapons at Al Qaeda camps in the Russian republic of Chechnya. One of the suspected leaders is Abu Musab Zarqawi, a veteran terrorist who has operated in iraq, according to US officials. In January, British police arrested suspected members of the so-called ''Chechen network'' during a raid on a makeshift ricin lab in London. That group was linked to cells previously dismantled in the Paris suburbs of Romainville and La Courneuve. The arrests were part of a crackdown in Britain, France, and Spain that may well have averted cyanide gas attacks on the Russian Embassy here and on the London subway, French officials said. France's interior minister said yesterday that the new ricin case probably involves the same network. ''One can think that there are ties, without being certain, to the Al Qaeda movement and the teams that were arrested in Romainville and La Courneuve,'' Interior Minister Nicolas Sarkozy said. ''But no information at our disposal leads us to affirm that France was targeted.'' ...One flask was labeled ''X-4 Pakistan.''

Slide20: 

Incoming Document Stream Content Analyst Chemical Nuclear Bioterrorism Categorized Items Alerts Taxonomic Overview Relevant And Unique Items Possible Aliases Relevant and Unique Documents New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Slide21: 

Lists Tables Draft Report Previously Reviewed Documents Text Analyst’s Notes: Documents In Relevance Order  Documents In Novelty Order Highlighting Novel Information Previously Seen Information

Novel Item: 

Novel Item UK: Roque Fernandes and Dominic Martins named in London dirty bomb arrests Three men accused of taking part in a terrorist plot were today remanded in custody. The men, charged with offences under the Terrorism Act, were arrested following information from the News of the World, which claimed it had uncovered a plan to supply radioactive material for a dirty bomb. Roque Flaviano Fernandes, 43, of De Havilland Road, Edgware; Dominic Agnello Martins, 44, of Du Cros Drive, Stanmore, both north-west London and Abdurahman Kanyare, 52, of Milling Road, also Edgware, appeared at a brief hearing at Horseferry Road Magistrates' Court. The court heard that all three faced charges under Section 17 of the Terrorism Act and are accused of having involvement in a plot to supply dangerous radioactive material to a third party between July and September this year.

Relevant Term Highlighting: 

Relevant Term Highlighting

Summarization: 

Summarization Although Gulf Islamists have long criticized their Algerian brothers for being too talkative and careless, they regard with respect militants of the GSPC [Salafist Group for Preaching and Combat], a breakaway group from the GIA [Armed Islamic Group], headed by Emir Hassan Hattab. Despite the latest discoveries, they believe that London will remain a rear base, perhaps even a "terrorism laboratory" where explosives and chemicals destined for the continent are stored. There were recently contacts in Algeria between Hassan Hattab and a Yemenite emissary of al-Qa'ida, Emad Abdelwahid Ahmed Alwan, killed this fall by government forces.

Slide25: 

……….             "If I was thinking like al-Qaida, the prize would not be Mali or Chad, but Nigeria," said Lyman, listing its history of corruption, massive Muslim population and religious tensions as evidence.          Lyman said though he "gets mixed reports of al-Qaida's established presence in the area," Nigeria is ripe for ideological entrepreneurs who exploit poverty-stricken areas and popular discontent with governments.          Nigeria's 120 million people are almost evenly divided between the Muslim-dominated north and the Christian south, though much intermingling goes on. The adoption of strict Islamic law in some northern provinces has sparked outbreaks of violence in which thousands have died.          Many analysts fear the growth of Al-Sunnah wal Jama'ah, an extremist group that has attacked authorities and stirred sectarian unrest with the goal of creating a "Taliban-style" state in the north.          Believing West Africa to be the new front in the global war on terror, U.S. military officials have been engaged in the Pan-Sahel Initiative, a low-profile $7.75 million military program that began in 2004 to improve border security throughout the region.          PSI-trained troops of the Chadian army reportedly killed 43 GSPC militants in a cross-border firefight last March. Since then, the improved efforts of Algerian and Malian troops are said to have critically undermined GSPC activities. But more preventive measures are now under way.          The PSI will morph into the Trans-Saharan Counter Terrorism Initiative in June, the Pentagon announced this week. The beefed up $125 million initiative, which may draw more federal funding, will deploy U.S. special operations forces to train counterparts in Morocco, Algeria, Mauritania, Chad, Tunisia, Senegal, Nigeria, Mali and Niger and facilitate better collaboration on regional security.          "Everyone agrees the holistic approach is most effective," said Crisis Group's McGovern, adding he was satisfied that Washington had reached a decision and moved to push it forward.          "West Africa is not a hotbed of terrorism, but a place we want to sure up so it doesn't become one in the future," he said. "I think that's worth the investment of a few hundred million dollars." ………… Relevant Segment Relevant Segment Identification

Dealing with New Terminology: 

Dealing with New Terminology Today MOX is widely used in Europe and is planned to be used in Japan. Currently over 30 reactors in Europe (Belgium, Switzerland, Germany and France) are using MOX and a further 20 have been licensed to do so. Japan also plans to use MOX in around a third of its reactors by 2010. Most reactors use it as about one third of their core, but some will accept up to 50% MOX assemblies. France aims to have all its 900 MWe series of reactors running with at least one third MOX. Japan aims to have one third of its reactors using MOX by 2010, and has

Slide27: 

Today MOX is widely used in Europe and is planned to be used in Japan. Currently over 30 reactors in Europe (Belgium, Switzerland, Germany and France) are using MOX and a further 20 have been licensed to do so. Japan also plans to use MOX in around a third of its reactors by 2010. Most reactors use it as about one third of their core, but some will accept up to 50% MOX assemblies. France aims to have all its 900 MWe series of reactors running with at least one third MOX. Japan aims to have one third of its reactors using MOX by 2010, and has uranium-plutonium mixed-oxide bnfl reactor reactor's plutonium-uranium bnfl's nuclear-fuel vver Instant Context Display

Slide28: 

Incoming Document Stream Content Analyst Categorized Items Alerts Taxonomic Overview Relevant And Unique Items New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Possible Aliases New Entities Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

New Entities List: 

New Entities List Abdelouahab Djouba Mourad Merabet Venissieux network URSSAF mosque

Most Relevant Terms Display: 

Most Relevant Terms Display Omar Teguer Vaux-en-velin Belmehel Beddaidj Maamar Bedderar Menad Benchellali Mohammed Naouars Venisseux Belmehel Venissuex Abdelouahab Djouba Mourad Merabet Venissieux network URSSAF mosque Vennissieux network

New Entities – Exploration: 

Omar Teguer Vaux-en-velin Belmehel Beddaidj Maamar Bedderar Menad Benchellali Mohammed Naouars Venisseux Belmehel Venissuex Vennissieux network New Entities – Exploration

Vennissieux Network: 

Vennissieux Network Menad Benchellali Maamar Bedderar Belmehel Beddaidj Omar Teguer Mohammed Naouars

Slide33: 

Incoming Document Stream Content Analyst Categorized Items Alerts Taxonomic Overview Relevant And Unique Items Possible Aliases Categorization Chemical Nuclear Bioterrorism New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Slide34: 

Incoming Document Stream Content Analyst Categorized Items Xxxxxxxxx Xxxxxxxxx ..smallpox.. Xxxxxxxxx ..anthrax… Exemplars Chosen by Analyst Categorization Approach

Slide35: 

Chemical Biological Nuclear IAEA: Traces of enriched uranium found in Libya A leaked report from the International Atomic Energy Agency says that highly enriched uranium was found in centrifuges in Libya's nuclear facilities, a diplomat who has seen the document said Friday. The report was given to the 35 member countries of the IAEA's governing board ahead of a meeting scheduled for Tuesday to consider Libya's nuclear program. Details of the IAEA reports often are leaked after they have been handed to member countries. "The report says low and high enriched uranium was found in centrifuges in Libyan nuclear facilities but there is no determination as to the source of the uranium," the diplomat said. The diplomat, familiar with recent IAEA programs, said the findings were similar to recent controversial infringements found in centrifuges in Iran. Iran claimed the traces of uranium were on recently imported equipment obtained from the black market. "As far as is known, Libya has not enriched any uranium itself so a similar explanation may be feasible," the diplomat said. The diplomat said the report did not mean Libya had breached the commitments it recently made to end its weapons of mass destruction programs. Categorization – Nuclear Example

Slide36: 

Chemical Biological Nuclear Arrests foil new ricin poison plot POLICE and the intelligence services were on alert last night after the discovery of ricin and explosives revealed the extent of the threat to Britain from the expanding terror network in Europe. Spanish authorities launched dawn raids on 12 addresses in Barcelona and on the Costa Brava, following tip-offs from France and Britain. They discovered substantial quantities of the deadly toxic agent ricin. In Italy, police uncovered Semtex explosives. Both operations were linked to the discovery of traces of ricin in a house in London this month. Spanish police arrested at least 16 people and seized two barrels of ricin as well as bomb detonators and a number of false passports and credit cards. The Spanish operation involved more than 150 officers, while members of anti-terrorist forces from other countries, including Scotland Yard’s SO13, flew to Spain prior to the operation. The arrests - in Barcelona, Gerona and the Costa Brava resort town of Bagnols - came barely 24 hours after Italian police detained five terror suspects believed to have been plotting an attack on central London. The men, all of Moroccan origin, were arrested after 2.2lbs of plastic explosive and detailed maps of the London Underground were found in a farmhouse near Venice. Scotland Yard sources expressed concerns that the arrests of the terrorist suspects in Spain may point to a larger plot to target the two million British tourists who visit the Spanish Costas each summer. Gerona is the main air travel hub for tourists visiting the popular holiday resorts of Salou and Sitges. A Scotland Yard source said: "These arrests were directly linked to information we received following last weekend’s arrests in west London. The location of the Spanish arrests causes us obvious concern, especially when you consider how many British tourists travel through Gerona airport en route to the Costas. There is a large Arab population along Spain’s Mediterranean coast and the area’s geographical location makes it the perfect enclave for terrorist cells originating out of North Africa." It is understood that most of those detained yesterday were Algerian nationals known to be members of the Salafist Group for Combat and Preaching (GSPC), an Islamic fundamentalist extremist group active in Algeria’s bloody 11-year-old civil war and with close connections with al-Qaeda. Of the 200 men arrested by western intelligence agencies in Europe in the past 15 months on suspicion of terrorist offences, about 80 per cent have been of Algerian origin. geographical location makes it the perfect enclave for terrorist cells originating out of North Africa." Categorization – Biological Example

Slide37: 

Chemical Biological Nuclear Israel fears chemical attack by Hamas suicide bombers Israeli Intelligence chiefs believe that Palestinian bomb-makers are trying to acquire lethal toxins to use in future suicide attacks. It is believed that leaders of the military wing of Hamas, the radical Islamist group, living abroad in Qatar, Syria and Jordan have decided to include chemical weapons in their arsenal. According to Israeli Intelligence, Hamas first added poisonous chemicals to home-made bombs in 1997. "They used pesticides and other poisons that are relatively easy to get hold of," a senior security source said. "The concern is that they are becoming ambitious and are trying to get hold of sarin and other nerve gases." Categorization – Chemical Example

Exemplar Document - GSPC: 

Exemplar Document - GSPC The Salafist Group for Call and Combat

Leveraging Analysis Artifacts: 

Leveraging Analysis Artifacts Lists Tables Notes Draft Report Documents for Review

Slide40: 

Documents for Review Content Analyst Dynamic Class Exemplar Extracted Information Items Automatic Updates to Classification Exemplar Analyst’s Working Notes Dynamic Exemplar Update

Slide41: 

Incoming Document Stream Content Analyst Chemical Nuclear Bioterrorism Categorized Items Alerts Taxonomic Overview Relevant And Unique Items Possible Aliases Possible Aliases New Entities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Possible Aliases - List: 

Possible Aliases - List Menad Benchellali  Abdel Hakim Laurent Mourad  Djamel Beghal

Possible Alias #1 – Closest Names: 

Laurent Mourad Djamel Beghal Djamel Loiseau Yacine Akhnouche Brahim Yadel Meroine Berrahal Slimane Khalafaoui Menad Benchellali  Abdel Hakim Laurent Mourad  Djamel Beghal Possible Alias #1 – Closest Names

Slide44: 

Laurent Mourad Djamel Beghal Djamel Loiseau Yacine Akhnouche Brahim Yadel Meroine Berrahal Slimane Khalafaoui Laurent Mourad Closest Names to Laurent Mourad

Possible Alias #2 – Closest Names: 

Possible Alias #2 – Closest Names Menad Benchellali Abdel Hakim Imad Kanouni Ridouane Khalid Youcef Abou el Bassir Djamel Beghal Ammar Saaefi Menad Benchellali  Abdel Hakim Laurent Mourad  Djamel Beghal

Closest Names Exploration: 

Closest Names Exploration Menad Benchellali Abdel Hakim Imad Kanouni Ridouane Khalid Youcef Abou el Bassir Djamel Beghal Ammar Saaefi Menad Benchellali

Slide47: 

No Auxiliary Structures Required

New Information Discovery: 

New Information Discovery 40% 60% 80% 500K 1M Efficiency Comprehensiveness       Database Size ( # of Documents) 40% 60% 80% 500K 1M

Multilingual Processing: 

Multilingual Processing Korean Russian Chinese Farsi Arabic Doc Content Analyst Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Slide50: 

Incoming Documents in: Content Analyst Xxxxxxxxx Xxxxxxxxx ..smallpox.. Xxxxxxxxx ..anthrax… English-Language Exemplars Chosen by Analyst Cross-lingual Capabilities Mourad Merabet Abdelouahab Djouba Venissieux network URSSAF mosque Laurent Mourad  Djamel Beghal Menad Benchellali  Abdel Hakim

Summary: 

Summary Highlighted Priority Items Generated Taxonomy of New Documents Summarized Lengthy Documents Ranked New Documents by their Novelty Provided Context for All Entities Placed Documents in Appropriate Folders Identified Possible Aliases ONE Software Package, with ONE Index, ONE User Interface, And NO Auxiliary Structures, Completely Automatically:

Unique Features of Content Analyst: 

Unique Features of Content Analyst Comprehensive Information Overview from a Single Tool Deep Conceptual Generalization Highly Tolerant of Data Errors and Inconsistencies No Auxiliary Structures Required Instant Context for All Items Novelty-based Ranking Cross-lingual Operation (without Requiring Translation) Automatic identification of Possible Aliases

Questions / Comments: 

Questions / Comments Contact: Frank Atwood Content Analyst Company, LLC 703-391-8700  x 126 frankatwood@contentanalyst.com GSA Schedule Number: GS35F-4461G