http://www.data-tactics.com Data Tactics Corporation Proprietary Material Future Concepts in Intelligence: Multi-Discipline Intelligence Production Teams Bruce Goldfeder, CSSLP September 26, 2012
Data Tactics Corporation Proprietary Material
http://www.data-tactics.com
Data Tactics Corporation Proprietary Material
Future Concepts in Intelligence:
Multi-Discipline Intelligence Production Teams
Bruce Goldfeder, CSSLPSeptember 26, 2012
Data Tactics Corporation Proprietary Material
• Data Deluge– Sensors and Sensor Data are increasing at exponential rates– Move beyond traditional sources of data– “The storm of data is 1500% heavier than it was just five years ago while our ability to
process, exploit and disseminate has increased about 30%” Gen Robert Kehler, USSTRATCOM, 2011
Paradigm Shift in the Intel Ecosystem
Data Tactics Corporation Proprietary Material
Big Data Opportunities
Bruce Weed, IBM Corporation
Data Tactics Corporation Proprietary Material
• $600 to buy a disk drive that can store all of the world’s music
• 5 billion mobile phones in use in 2010
• 30 billion pieces of content shared on Facebook every month
• 40% projected growth in global data generated per year vs. 5% growth in global IT spending
• 235 terabytes data collected by the US Library of Congress by April 2011
• 15 out of 17 sectors in the United States have more data stored per company than the US Library of Congress
Big data—a growing torrent
McKinsey, Big Data Report, 2011
Data Tactics Corporation Proprietary Material
“There’s a method to solving data problems that avoids the big, heavyweight solution, and instead, concentrates building something quickly and iterating. Smart data scientists don’t just solve big, hard problems; they also have an instinct for making big problems small.
We call this Data Jujitsu: the art of using multiple data elements in clever ways to solve iterative problems that, when combined, solve a data problem that might otherwise be intractable.”
DJ Patil, Data Jujitsu: The Art of Turning Data into Product, 2012
Work Smartly with Data
Data Tactics Corporation Proprietary Material
Knowledge Pyramid
Traditional Knowledge Pyramid Path to Actionable InsightsDr. Caron Kogan
Data Tactics Corporation Proprietary Material
Technical Team Members
Data Tactics Corporation Proprietary Material
• Intelligence teams tackling the hard problems– Senior members– Mixture of IT, Software, Statistics, and Intelligence
SMEs– Serve as the Vanguard for creating new • Processes• Actionable Data Products• IT Tools• Visualizations
Integrated Data Team
Data Tactics Corporation Proprietary Material
• Disciplined methods of traditional data mining accelerated with iterative and rapid “what ifs”
• Requirement for unreasonable input – challenge existing truths to find new patterns
• Intimate knowledge of the mission problems that analytics or predictive analysis are addressing
• Ability to communicate findings using the customers language
• Original visualizations required to convey abstract and complicated results
Left and Right Brain
Data Tactics Corporation Proprietary Material
New Visualizations
Data Tactics Corporation Proprietary Material
• Integrated Team Supporting Theater Commander– Retired Special Operator– Social Scientist– Quantitative Mathematicians– Software Developer– Data Scientist– IT, Database, and UI personnel
DARPA Example
Data Tactics Corporation Proprietary Material
Who Is Interested?• CJ-2/CJIOC-A
– Direction from BG Fogarty to support ATFC and Shafafiyat (Jan 2011)
• Afghan Threat Finance Cell– DEA-led fusion center, Treasury and DoD are
deputy leads– Active feedback loop with DEA Office of
Financial Operations• CJIATF-SHAFAFIYAT (BG McMaster)• NSA FTM Analysts
State of the Art• Highly manual analysis• No single agency has full picture• Technologies are limited
Threat Finance Analytics
04/10/2023 12
Automated tools for rapid analysis with massive multi-int
data
Threat Finance
CorruptionForeign Aid
Drug Economy
State Sponsorship
Capital FlightViolence
Data Tactics Corporation Proprietary Material
Conduit Description Accts Interval Records Refine Stage
Shaheen Exchange (aka Central Accounts) Physical storefronts of the
exchange. Branches in and out of Afghanistan.
95 2001-2010~1.2 million
Two stages of data cleaning complete; third stage necessary
Shaheen Exchage Daily Balances ~1.8 million First stage of data clean in
progress
Hawala Accounts (aka “B” Computer)
Dubai-based hawala accounts, centrally maintained. 390 1998-2010 434, 401 Two stages of data
cleaning complete
Western Union Shaheen Exchange is a Western Union sub-agent. UNK 2001-2010 106, 176 Two stages of data
cleaning complete
“T” AccountsT accounts are debits, loans and payables to the Shaheen Exchange in Dubai
555 2000-2010 ~421,575 Initial specs and setup – high priority
“L” AccountsL accounts are bank accounts associated with the Sherkhan group of companies
86 2000-2010 ~337,260 Initial specs and setup – high priority
AFRATRecords and stores transactions of international exchange branch locations
UNK 2004-2010 Unknown Not started
ATFC Data
04/10/2023 13
80,000+ spreadsheets
Millions of records with variable structure
Data Tactics Corporation Proprietary Material
• Toolset for faster DEA Shaheen Exchange data analysis• Geolocated 9 additional branches in AfPak region that DEA did
not know existed; and 45 overall worldwide• DEA work results from using our data
– Identified transactions with several banks in violation of OFAC sanction designation
– Known cash courier Mr. X (name classified) under investigation as a result
Accomplishments
04/10/2023 14
Data Tactics Corporation Proprietary Material
• Fast query of stacked large data sets with a user-friendly search and visualization tool
• Tools immediately put to use by DEA/ATFC in support of active and historical criminal cases
• Saved one 24/7 man-year of work that would have been spent simply scanning records
Data Resolution• Cleaned 14,538
spreadsheets – 20% of the data– Sheets prioritized by
user interest– Orders of magnitude
faster processing for threat finance analysis
• Resolved ~88k entities – 12% improvement
Accomplishments (cont.)
04/10/2023 15
Technique Rows Modified
Neighbor 55K – 52%
Ngram 10K – 9%
Metaphone 97K – 92%
Country: 947 -> 490Western Union: Original number of unique entries in the “country” field was
4.5 times the actual number of countries in
the world!
Proving capabilities to partners in theater and in CONUS has enabled trust
and data acquisition