Top Banner
Investigating the Panama Papers with Open2Source Tools like Neo4j [email protected] JUG Saxony Camp Leipzig March 2017
126

Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j [email protected] JUG6Saxony6Camp6Leipzig March62017

Jul 07, 2018

Download

Documents

docong
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Investigating*the*Panama*Paperswith*Open2Source*Tools*like*Neo4j

[email protected]

Page 2: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

(Michael Hunger)2[:WORKS_FOR]2>(Neo4j)

[email protected] |*@mesirii*|*github.com/jexp*|*jexp.de/blog

Michael*Hunger**2 Head*of Developer*Relations*@Neo4j

Page 3: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 4: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Disclaimer

Offshore*Companies*have legal*uses.

There is no suggestion that parties listed in*the documents have broken the law or

acted improperly.

Page 5: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Former&EU&Official&Among&Politicians&Named&in&New&Leak&of&Offshore&Files&from&The&BahamasA&cache&of&leaked&documents&provides&names&of&politicians&and&others&linked&

to&more&than&175,000&Bahamian&companies&registered&between&1990&and&2016

For$years,$Neelie Kroes traveled$Europe$as$one$of$the$continent’s$senior$officials,$warning&big&corporations that$they$couldn’t$“run$away”$from$the$European$Union’s$rules.$

The$Dutch$politician$sympathized$with$average$citizens$who$worried$they’d$been$left$to$pay$the$bills$“as$infringers$cream$off$the$extra$profits.”

As$the$EU’s$commissioner$for$competition$policy$from$2004$until$2010,$she$was$Europe's$top&corporate&enforcer and$made$Forbes magazine’s$annual$list$of$the$“World’s$100$Most$Powerful$Women”$five$times.

What$Kroes never$told$audiences$– and$didn’t$tell$European$Commission$officials$in$mandatory$disclosures$– was$that$she&had&been&listed&as&a&director&of&an&offshore&company&in&the&Bahamas,$the$Caribbean$tax$haven$whose$secrecy$and$tax$structures$have$attracted$multinational$companies$and$criminals$alike.

https://www.icij.org/offshore/former2eu2official2among2politicians2named2new2leak2offshore2files2bahamas

Page 6: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 7: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 8: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Initial*Findings

• Jürgen<Mossack,<German,<father SS,<switched sides,<moved to Panama• Ramon<Fonseca<– Panamaian politician,<influencer,<rich elite• Company<since 1977• Data<from 1977<to 2015

• Siemens<South2America Funds• Ex.<Argentina President Kirchner• Syria – Assad‘s helpers the Makhlouf brothers /<sanction lists• Commerzbank<and many other German<Banks• Iceland 2 Sigmundur Gunnaugson• MosFon Operations – pretense• Russia:<Roldugin 2 Putin

Page 9: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 10: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 11: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

INSIDE THE 2.6 TBInside*the 2.6*TB*of Data

Page 12: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Organization of ca. 200 journalistsBased in 65 countries

“Our aim is to bring journalists from different countries together in teams - eliminating rivalry and promoting

collaboration. Together, we aim to be theworld’s best cross-border investigative team.”

icij.org/about

Page 13: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Panama*Papers*series named

Investigation6of the YearThu,*June*16th*2016,*Vienna,*Austria

Project*by International*Consortium of Investigative*Journalists wins Data*Journalism Award

Page 14: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

You may remember them from...

#BahamasLeak

Page 15: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Core*Team*of the ICIJ

ICIJ*leadership

US2based*team

Data*&*Research*Unit

Africa*desk

Page 16: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

+370 journalists in 80 countries

Page 17: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 18: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

While*this*might*not*be*“Big*Data”*for*us*

it*definitely*is*forJournalists

Big*Data*?

Page 19: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

+370*journalists+100*media*organizations

80*countries1*Year

Data*Team:*3*Data*Journalists*+

3*Developers*!

Who*is working on*it?

Page 20: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

1)*CollaborationSupported*by*OSS*Tools*&*Encryption

Page 21: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 22: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

2)*Using*OSS*to*allow*non2developers

to*make*sense*ofhighly*connected*data

Page 23: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

POWER

RawFiles

Meta2Data

Database

Search Discovery

Data*Processing

Page 24: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

3 million filesx

10 seconds per file=

1 yr / 35 servers = 1.5 weeks Nuix

Investigator

Page 25: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Lucene syntax queries with proximity matching!

400 users

Page 26: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Data<extraction● Nuix Investigator<OCR service● ICIJ<Extract<(open<source,<Java:<https://github.com/ICIJ/extract),<leverages<Apache<Tika,<Tesseract<OCR<and<JBIG22ImageIO.

● Python<scripts<for<structured<data<extraction

Databases● Apache<Solr (open<source,<Java)● Redis (open<source,<C)●Neo4j*(open*source,*Java)

Applications● Blacklight (open<source,<Rails)● Linkurious (closed<source,<JS)

Technology*Stacks

Page 27: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 28: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Exposed the offshore<holdings of 12<current andformer world leaders.

Dealings of 128<more politicians and public officialsaround the world.

Exposure of hidden secrets

Page 29: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

#panamapapers

Page 30: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 31: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Main*goals,*achieved:1) Uncover*the*truth

2) Assure*whistle*blower*safety

Page 32: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 33: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Context*is*King name:<“John”last:<„Miller“role:<„Negotiator“

name:<"Maria"last:<"Osara"name:<“Some Media<Ltd”

value:<“$70M”

PERSON

PERSON

PERSON

PERSON

name:<”Jose"last:<“Pereia“position:<“Governor“

name:<“Alice”last:<„Smith“role:<„Advisor“

Page 34: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Context*is*King

MENTIONS

name:<“John”last:<„Miller“role:<„Negotiator“

name:<"Maria"last:<"Osara"

since:<Jan<10,<2011

name:<“Some Media<Ltd”value:<“$70M”

PERSON

PERSON

PERSON

PERSON

name:<”Jose"last:<“Pereia“position:<“Governor“

name:<“Alice”last:<„Smith“role:<„Advisor“

Page 35: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*world*is*a*graph*– everything*is*connected

• people,<places,<events• companies,<markets• countries,<history,<politics• sciences, art,<teaching• technology,<networks,<machines,<applications,<users

• software,<code,<dependencies,<architecture,<deployments

• criminals,<fraudsters<and<their<behavior

Page 36: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Why*Graphs*?*The*World*is*a*Graph

Page 37: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 38: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 39: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Relational*DBs*Can’t*Handle*Data*Relationships*Well

• Cannot6model6or6store6data6and6relationships6without<complexity

• Performance6degrades6with<number<and<levels<of<relationships,<and<database<size• Query6complexity6grows6with<need<for<JOINs

• Adding6new6types6of66data6and6relationships6requires<schema<redesign,<increasing<time<to<market

…<making<traditional<databases<inappropriatewhen<data<relationships<are<valuable<in<real2time

Slow<developmentPoor<performanceLow<scalabilityHard<to<maintain

Page 40: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

MATCH&(boss)%[:MANAGES*0..3]%>(sub),(sub)%[:MANAGES*1..3]%>(report)

WHERE&boss.name?=?“John?Doe”RETURN sub.name AS Subordinate,?count(report)?AS Total

Express*Complex*Relationship*Queries*Easily

Find<all<reports<and<how<many<people<they<manage,<up<to<3<levels<down

Cypher*Query

SQL*Query

Page 41: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

NODE

key:<“value”properties

Property*Graph*Model

Nodes• The<entities<in<the<graph• Can<have<name2value<properties• Can<be<labeled

Relationships• Relate<nodes by<type<and<direction• Can<have<name2value properties

RELATIONSHIPNODE NODE

key:<“value”properties

key:<“value”properties

key:<“value”properties

Page 42: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j

A<native6graph6database• Manage*and*store your<connected*data*as<a<graph

• Query*relationshipseasily<and<quickly

• Evolve*model*and*applications*to<support<new<requirements<and<insights

• Built<to<solve<relational*pains*

Page 43: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

What*is*Neo4j?

A<native6graph6database

• Built*for*Connected*Data• Easy*to*use• Optional*Schema• Highly*Scalable*Performance• Transactional*ACID2Database• Clustering*for*High*Availability*and*Scale• Built*in*Security

Page 44: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Value*from*Data*RelationshipsSome Use-Cases

Internal*ApplicationsMaster<Data<Management<

Network<and<IT<Operations

Fraud*Detection

Customer2Facing*ApplicationsReal2Time<Recommendations

Graph2Based*SearchIdentity<and<

Access<Management

http://neo4j.com/use2cases

Page 45: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Whiteboard*to*Graph

Page 46: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j:*All*about Patterns

(:Person<{<name:"Dan"}<)<2[:KNOWS]2><(:Person {name:"Ann"})

KNOWS

Dan Ann

NODE NODE

LABEL PROPERTY

http://neo4j.com/developer/cypher

LABEL PROPERTY

Page 47: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j:*Create*Patterns

CREATE*(:Person<{<name:"Dan"}<)<2[:KNOWS]2><(:Person {name:"Ann"})

KNOWS

Dan Ann

NODE NODE

LABEL PROPERTY

http://neo4j.com/developer/cypher

LABEL PROPERTY

Page 48: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Cypher:*Find*Patterns

MATCH (:Person<{<name:"Dan"}<)<2[:KNOWS]2><(who:Person) RETURN who

KNOWS

Dan ???

LABEL

NODE NODE

LABEL PROPERTY ALIAS ALIAS

http://neo4j.com/developer/cypher

Page 49: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Cypher:*Clauses

CREATE*(:Intermediary {name:“Deutsche*Bank“})2[:REPRESENTS]2>(e:Entity {name:“...“})2[:LOCATED]2>(:Address {address:“...“})2[:IN]2>(:Country*{name:“PAN“})

Page 50: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Cypher:*Clauses

MATCH(o:Officer)5[owns]5>(e:Entity)<55(a:Address)WHERE a.address CONTAINS „Munich“RETURN o.name,-owns.shares,-e.name

Page 51: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Cypher:*Clauses

WITH<expression AS<alias,<...UNWIND<list AS<itemLOAD CSV<FROM<„url“<AS<row

Page 52: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Getting*Data*into*Neo4j

• Bulk<Load<from<CSV<Files

• Update<Graph<from• Web<APIs<(JSON,XML)• Other<Databases• CSV<Files• User<Activity<(Logs,<Callbacks)

,,,

Page 53: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Getting*Data*into*Neo4j

Cypher2Based*“LOAD*CSV”• Transactional<(ACID)<writes• Initial<and<incremental<loads<of<up<to<10<million<nodes and<relationships

,,,

LOAD?CSV?WITH?HEADERS?FROM?"url"?AS?rowMERGE?(:Person?{name:row.name,?

age:toInt(row.age)});

Page 54: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Getting*Data*into*Neo4j

Load*JSON*with*Cypher• Load<JSON<via<procedure• Deconstruct<the<document• Into<a<non2duplicated<graph<model

{}{}{}

CALL?apoc.load.json("url")?yield value as docUNWIND?doc.items as itemMERGE?(:Contract {title:item.title,?

amount:toFloat(item.amount)});

Page 55: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Getting*Data*into*Neo4j

CSV*Bulk*Loader****neo4j5import• For<initial<database<population• For<loads<with<10B+<records• Up<to<1M<records<per<second

,,,,,,,,,

bin/neo4j%import?–%into people.db%%nodes:Person people.csv%%nodes:Company companies.csv%%relationship:STAKEHOLDER stakeholders.csv

Page 56: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Import*Demo==>?/Users/mh/Downloads/panama/import/Addresses.csv <==

address,icij_id,valid_until,country_codes,countries,node_id:ID,sourceID

27?ROSEWOOD?DRIVE?#16%19?SINGAPORE?737920,6991059DFFB057DF310B9BF31CC4A0E6,The?Panama?Papers??data is current through2015,SGP,Singapore,14000001,Panama?Papers

==>?/Users/mh/Downloads/panama/import/Entities.csv <==

name,original_name,former_name,jurisdiction,jurisdiction_description,company_type,address,internal_id,incorporation_date,inactivation_date,

struck_off_date,dorm_date,status,service_provider,ibcRUC,country_codes,countries,note,valid_until,node_id:ID,sourceID

"TIANSHENG?INDUSTRY?AND?TRADING?CO.,?LTD.","TIANSHENG?INDUSTRY?AND?TRADING?CO.,?LTD.",,SAM,Samoa,,ORION HOUSE?SERVICES?(HK)?LIMITED?ROOM?1401;?

14/F.;?WORLD?COMMERCE??CENTRE;?HARBOUR?CITY;?7%11?CANTON?ROAD;?TSIM?SHA?TSUI;?KOWLOON;?HONG?KONG,1001256,23%MAR%2006,

18%FEB%2013,15%FEB%2013,,Defaulted,Mossack?Fonseca,25221,HKG,Hong?Kong,,The Panama?Papers?data is current through 2015,10000001,Panama?Papers

==>?/Users/mh/Downloads/panama/import/Intermediaries.csv <==

name,internal_id,address,valid_until,country_codes,countries,status,node_id:ID,sourceID

"MICHAEL?PAPAGEORGE,?MR.",10001,MICHAEL?PAPAGEORGE;?MR.?106?NICHOLSON?STREET?BROOKLYN?PRETORIA?0002;?GAUTENG?(PWV)?SOUTH?AFRICA,

The?Panama?Papers??data is current through 2015,ZAF,South?Africa,ACTIVE,11000001,Panama?Papers

==>?/Users/mh/Downloads/panama/import/Officers.csv <==

name,icij_id,valid_until,country_codes,countries,node_id:ID,sourceID

KIM?SOO?IN,E72326DEA50F1A9C2876E112AAEB42BC,The?Panama?Papers?data is current through 2015,KOR,"Korea,?Republic of",12000001,Panama?Papers

==>?/Users/mh/Downloads/panama/import/all_edges.csv <==

node_id:START_ID,rel_type:TYPE,node_id:END_ID

11000001,intermediary?of,10208879

Page 57: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Import*Demo

IMPORT?DONE?in?20s?747ms.?Imported:839434?nodes1253582?relationships8211010?properties

+%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+|?labels(n)????????|?count(*)?|+%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+|?["Officer"]??????|?344455???||?["Entity"]???????|?319150???||?["Address"]??????|?151054???||?["Intermediary"]?|?23636????|+%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+

Page 58: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

POWER

RawFiles

Meta2Data

DataBase

Search Discovery

Steps involved in****************************Document Analysis

PERSONOther<Sources

Page 59: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Steps Involved in*the Document Analysis

1. Acquire documents

1. Classify documents• Scan</<OCR<• Extract document metadata

2. Whiteboard<domain and questions,<determine• entities and their relationships• potential<entity and relationship properties• sources for those entities and their properties

Page 60: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Steps Involved in*the Document Analysis

4. Develop analyzers,<rules,<parsers and named entity recognition

5. Parse<and store metadata,<document and entity relationships

• Parse<by author,<named entities,<dates,<sources and classifications

6. Infer entity relationships

7. Compute similarities,<transitive<cover and triangles

8. Analyze data using graph queries and visualizations

Page 61: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Journalists say:*„It‘s like*Magic“

Page 62: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Journalists say:*„It‘s like*Magic“

• Find<interesting spots with full2text<and fuzzy search

• See<neighbourhoods of suspects and interesting facts

• Find<connections and shortest paths between seemingly disconnected

information

• Jointly add new knowledge as relationships

• Stories<emerge from the collaboration

• Add<more information from other sources

Page 63: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

We need a*Data*Model

Meta Data*Entities• Document,<Email,<Contract,<DB2Record

• Meta:<Author,<Date,<Source,<Keywords

• Conversation:<Sender,<Receiver,<Topic

• Money<Flows

Actual Entities• Person• Representative (Officer)• Address• Client• Company• Account

Either based on<our use cases &<questionsOn<the entities present in<our meta2data and data.

Page 64: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Data*Model*– Relationships

Meta2Data• sent,<received,<cc‘ed• mentioned,<topic2of• created,<signed• attached• roles• family relationships

Activities• open<account• manage<• has shares• registered<address• money flow

Page 65: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Basic*ICIJ*Data*Model

Page 66: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Basic*ICIJ*Data*Model

Page 67: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Real ICIJ*Data*Model

Page 68: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*ICIJ*Data*Model

• Simplistic Datamodel<with 4<Entities and 5<Relationships• We only know the published model• Missing• Documents,<Metadata• Family<Relationships• Connections<to Public<Record Databases

• Contains Duplicates• Relationship<information stored on<entities• Could use richer labeling

Page 69: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 70: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Data*initially exposed as interactive Visualization

• Public<figures and leaders• Different<shell companies &<involvements

Page 71: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 72: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

People*Love*the #PanamaPapers Database*!

Since May<9,<2016:

• 7.4<million sessions• 44.2<million page views• Visitors coming from (top<5<countries):<

US,<Japan,<Spain,<Canada,<UK

Page 73: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j*ICIJ*Distribution

We have also<made a<distribution of Neo4j<available with the data in<it.<This<will<allow you to query the database tofully explore from your computer theconnections between people and companies.<The<package also<includes a<guide that explainshow to use Neo4j.

Page 74: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Let‘s go,*get it!

Page 75: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017
Page 76: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Put it on*a*Map

• Ingredients• Neo4j• Cypher• Javascript Driver• geocode procedure• MapBox

https://github.com/jexp/panama2map

Page 77: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Steps

GeocodeMATCH?(a:Address)?WHERE?a.country_codes =?"DEU"?CALL?apoc.spatial.geocodeOnce(a.address)?YIELD?locationSET?a?+=?location

Query*+*RenderMATCH?(a:Address)<66(officer:Officer)6[role]6>(entity:Entity)WHERE?a.country_codes =?"DEU"?

AND?distance(pos,?point(a))?<?{distanceInKm}RETURN?a.latitude,?a.longitude,?{officer :&officer.name,&entity:&entity.name,&role:&type(role),&address :&a.address,& country:&entity.country_codes}&AS?data

Page 78: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Next*steps for the ICIJ*and all*of us

• Data<integration with other sources• Entity<extraction• Email<pattern analysis• Content<&<Data<mining• Machine learning• Alerts with real<time<news /<social media• Investigative<recommendations• Active search for new sources ...

Page 79: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The6TrumpWorld Graph

Entangled6Network6ofUS6Politicis

Page 80: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

https://www.theguardian.com/commentisfree/2017/jan/24/panama2papers2media2investigation2next2donald2trump2hold2accountable

Page 81: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Research*by Public*Integrity

https://www.publicintegrity.org/2016/10/07/20305/robert2mercer2connections2stephen2k2bannon

Page 82: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Buzzfeed:*Help*us map Trumpworld

• Now we are asking the public to use our data to find<connections wemay have missed,<and to give us context we don’t currentlyunderstand.<We hope you will<help us — and the public — learn moreabout TrumpWorld and how this unprecedented array of businessesmight affect public policy

• Published ties betweenOrganizations &<People<asPublic*Dataset

https://www.buzzfeed.com/johntemplon/help2us2map2trumpworld/

Page 83: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j:*Trumpworld Graph

• Load<public data as CSV• Enrich dataset• Run<queries• Run<graph algorithms• Visualization

DEMO<TIME

https://neo4j.com/blog/buzzfeed2trumpworld2dataset2neo4j/

Page 84: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Kim*Albrecht:*Trumpworld Viz

https://www.wired.com/2017/01/kim2albrecht2trump2data2viz/ http://trump.kimalbrect.com

Page 85: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Connect*All2The2Things*!

• Federal<Election Campaign Finance Data• OpenCorporates – Open<Company<Registry• LittleSis.org• CitizenAudit.org (non2profit<financial declarations)• Panama<Papers• ...• US<Legislative<(Senate,<House,<State)

Page 86: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Let6it6be6known6that6Neo6Technology6stands6firmly6against6the6xenophobia6and6religious6discrimination6of6Trump’s6executive6order

U Emil6Eifrem,6CEO6&6Founder

https://neo4j.com/emil/help2world2make2sense2news2data/

Page 87: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Let‘s not*stop here!Engage!

Support*the work oforganizations

that make a*differencefor all*of us

Page 88: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Summary

Page 89: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Discrete*DataMinimally-

connected data

Graph*Databases*are designed*for*data*relationships

Summary*2 Use the*Right*Database*for*the*Job

Other*NoSQL Relational*DBMS Graph*DBMS

Connected DataFocused-on

Data-Relationships

Development BenefitsEasy<model<maintenance

Easy<query

Deployment*BenefitsUltra<high<performanceMinimal<resource<usage

Page 90: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Real2Time*Query*PerformanceGraph-Versus-Relational-and-Other-NoSQL Databases

Connectedness<and<Size<of<Data<Set

Respon

se<Tim

e

0<to<2<hops0<to<3<degreesThousands<of<connections

Tens<to<hundreds<of<hopsThousands<of<degreesBillions< of<connections

Relational<andOther<NoSQLDatabases

Neo4j

Neo4j*is*1000x*faster“Minutes-to-milliseconds”

Page 91: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Users*Love*Neo4j

�We<found<Neo4j<to<be<literally<thousands*of*times*faster*than<our<prior<MySQL<solution,<with<queries<that<require<10*to*100*times*less*code.<Today,<Neo4j<provides<eBay<with<functionality<that<was<previously*impossible.�

Volker-PacherSenior-Developer

Performance"The<Neo4j<graph<database<gives<us<drastically<improved<performance<and<a<simple<language<to<query<our<connected<data”<5 Sebastian-Verheugher,-Telenor

Scale*and*Availability

"As<the<current<market<leader<in<graph<databases,<and<with<enterprise<features<for<scalability<and<availability,<Neo4j<is<the<right<choice<to<meet<our<demands.”5 Marcos-Wada,-Walmart

Page 92: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Users*Love*Neo4j*– Will*you*too?*

Page 93: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

What will*YOU*connect?*

• User<and Social Networks<?•Money,<Accounts,<Contracts ?• Products,<Prices,<Reviews,<Tags<?• Software,<Dependencies,<Services<?•Machines,<Devices,<Sensors<?• Genes,<Proteins,<Reactions ?• Laws,<Regulations ?

Page 94: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

What will*YOU*connect?*

• Literature,<Works,<Authors ?• Language,<Words,<Phonemes ?• Resarch(ers),<Publications,<Citation ?• History,<Events,<Places<?• Catalogues,<Items,<Keywords,<Annotations ?• Images,<Documents,<Letters,<Books<?• Ontologies,<Vocabulary,<Translations ?• ...

Page 95: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Get*started*with*Neo4j*today*–Discover*Value*in*Your*Relationships

neo4j.com/developer

Page 96: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

neo4j.com/books

The*Story*of*Panama*Papers

Want*to learn more?

Free*e2book*download

Page 97: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

http://bit.ly/neo4j_ddj

Page 98: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

More*Insight

• Neo4j<Blog• http://neo4j.com/blog/panama2papers/• http://neo4j.com/blog/analyzing2panama2papers2neo4j/

• ICIJ• https://panamapapers.icij.org/• https://panamapapers.icij.org/the_power_players/• https://panamapapers.icij.org/graphs/

• SZ• http://panamapapers.sueddeutsche.de/en/

• Guardian• http://www.theguardian.com/news/series/panama2papers

Page 99: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Source*Material

taken<from<• the<ICIJ<presentation• the<Reddit<AMA• online<publications<(SZ,<Guardian,<TNW<et.al.)• the<ICIJ<website• https://panamapapers.icij.org/• The<Power<Players• Key<Numbers<&<Figures

Page 100: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Thanks!*Questions?

Learn6more:6neo4j.com/developerMe:6@mesirii |6@neo4j

Page 101: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Visual6Graph6Search

Make6data6accessiblefor6nonUdevelopers

Page 102: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Background

Business<problem Solution<&<Benefits

©<All<Rights<Reserved<2014<|<Neo<Technology,<Inc.

• JS<library based on<sigma.js• Integrates with Neo4j<usingCypher

Linkurious.js

https://github.com/Linkurious/linkurious.js/

Page 103: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Background

Business<problem Solution<&<Benefits

©<All<Rights<Reserved<2014<|<Neo<Technology,<Inc.

• JS<library based on<d3.js•Uses Graph<Metadatato offer visual search•Categories to filterInstances•Component basedextensions•Zero<Config withWeb<Extension

Popoto.js

http://www.popotojs.com/

Page 104: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Background

Business<problem Solution<&<Benefits

©<All<Rights<Reserved<2014<|<Neo<Technology,<Inc.

Visual*Search*Bar

•Based on<visualsearch.js•Uses graph metadata for parametrization•Limit<suggestions by selected items

maxdemarzi.com/2013/07/03/the2last2mile/

Page 105: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Background

Business<problem Solution<&<Benefits

©<All<Rights<Reserved<2014<|<Neo<Technology,<Inc.

•Natural<Language<to Cypher•Ruby<TreeTop Gem for NLP<•Convert phrases to Cypher<Fragments

Facebook*Graph*Search

maxdemarzi.com/2013/01/28/facebook2graph2search2with2cypher2and2neo4j/

Page 106: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Graphs6in6Humanities

The6Human6World6is6connected

Page 107: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The*Codex*– Iian D.*Neil

• Research<tool for source material• Entity,<Date,<Keyword,<Place<extraction• Rich<visualization• Timeline• Maps• Profiles

• Interview

Page 108: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

The<Codex<is<a<digital<humanities<project<built<in<Neo4j<and<.NET<that<breaks<history<down<into<a<series<of<semantically2tagged<events.

It<is<an<‘atlas’<of<history<because<it<enables<events<to<be<viewed<and<contrasted<in<various<ways,<by<subject,<by<person,<and<by<place.

Relationships<between<historical<figures<and<their<semantic<attributes<are<also<recorded.

An*atlas*of*history

Page 109: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

● Refactoring<of<project<to<be<more<collaborative<&<XML<standards2compliant

● Public<API<to<enable<querying<of<events<by<time,<place,<person,<etc.

● Data<entry/classification:<expansion<beyond<Italian<Renaissance<to<19th<century<England<&<other<information2rich<periods

● Integration<of<diverse<data<sets

○ astronomical<events,<census<data,<climate

● Want<to<be<involved?<I’m<looking<for<designers,<history<buffs,<or<anyone<interested<in<the<concept<of<using<Neo4j<to<map<history

Goals of the Codex

Page 110: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Literature Studies*– Vanderbilt*University

• Analysing literary works• Analysing lives of artists• Student<practices /<thesis• Visual<appeal• Workshops<for students and staff• Related projects• Interview

http://gallery.library.vanderbilt.edu/exhibits/show/artists2books/neo4j

Page 111: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Historiana.eu

Your Portal<to the Past is an<on2line<educational multimedia tool thatoffers students multi2perspective,<cross2border and comparativehistorical sources to supplement their national<history textbooks.<

Historiana might be considered as a<digital<alternative<to a<European<textbook,<however the website does not<attempt to present a<comprehensive …

Page 112: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Libraries*and Museums

• D:Swarm• Open<source library managementsystem

• Initial<work on<dataimport /<modeling

• SLUB<+<Avantgarde<Labs<• dswarm.org

• Natural<History Museum<London• Example for asset portalneo4j.com/blog/graphstarter2neo4j2rails2application

Page 113: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4Art*– Lorenzo*Speranzoni

• Started Mapping<Vincent<Van<Goghs<journey• dd• Places• Influence(r)s• Art• People

Page 114: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Example Connections

Page 115: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Color*Analysis

Page 116: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Life<journey van<Gogh

Page 117: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Medieval Research

• Graphdatenbanken für<Historiker.<Netzwerke<in<den<Registern<der<Regesten<Kaiser<Friedrichs<III.<mit<neo4j<und<Gephi

• Andreas<Kuczera• http://mittelalter.hypotheses.org/5995• 3rd<step after<image digitization and fulltext document search

Page 118: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

GraphCommons

• Graph<based modeling forresearchers and journalists

• Intuitive,<collaborativeGraph<creation

• Embedding<in<WebsitesEncourage Sharing

Page 119: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Onodo

• Interactive<GraphCreation

• Graph<basedstorytelling

• Tabular DataEntry

• Embedding<in<WebsitesEncourage Sharing

Page 120: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Why should I*care?

Because RelationshipsMatter

Page 121: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

What*is*it*with*Relationships?

• World<is<full<of<connected<people,<events,<things• There<is<“Value<in<Relationships”<!• What<about<Data<Relationships?• How<do<you<store<your<object<model?• How<do<you<explain<JOIN<tables<to<your<boss?

Page 122: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Neo4j*– allows*you*to*connect*the*dots

• Was<built<to<efficiently<• store,<• query and<• manage highly<connected<data

• Transactional,<ACID• Real2time<OLTP• Open<source• Highly<scalable<already<on<few<machines

Page 123: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

NoSQL Databases*Don’t Handle*Data*Relationships

• No6data6structures6to<model<or<store<relationships

• No6query6constructs6to<support<data<relationships

• Relating6data6requires6“JOIN6logic”6in<the<application

• Additionally,<no6ACID6support6fortransactions

…<making<NoSQL databases<inappropriate when<data<relationships<are<valuable<in<real2time

Page 124: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Largest*Ecosystem*of*Graph*Enthusiasts

• 1,000,000+<downloads• 27,000+<education<registrants• 25,000+<Meetup members<in<29<countries• 100+<technology<and<service<partners• 170+<enterprise<subscription<customers<including<50+<Global<2000<companies

Page 125: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Value*from*Data*RelationshipsCommon-Use-Cases

Internal*ApplicationsMaster<Data<Management<

Network<and<IT<Operations

Fraud<Detection

Customer2Facing*ApplicationsReal2Time<Recommendations

Graph2Based<SearchIdentity<and<

Access<Management

Page 126: Investigating the Panama Papers Connections with Neo4jthe*Panama*Papers with*Open2Source*Tools*like*Neo4j Michael.Hunger@neo4j.com JUG6Saxony6Camp6Leipzig March62017

Graph*Database*Fundamentals