Top Banner
Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.
21

Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Mar 26, 2015

Download

Documents

Brian Peterson
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Leveraging Commercial Graph DB Technologies in Open Source and

Polyglot Application Environments

Brian Clark, VP Product ManagementObjectivity, Inc.

Page 2: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Objectivity, Inc.

• Who we are – Objectivity, Inc.• What we do - InfiniteGraph.• Why InfiniteGraph?• Open Source Polyglot Use Cases.• Other uses of open source in Objectivity, Inc.

Page 3: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Objectivity, Inc.

• The world today is about big data, distributed objects and connections between them.

• Objectivity/DB™ Distributed big data and object management.

• InfiniteGraph™ Connects the dots on a global scale.

Page 4: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Why We’re Different

• Relational databases are not optimized to understand objects or connections.

• Objectivity/DB™ is all about objects and relationships.

• InfiniteGraph™ is all about the connections as first class citizens.

Page 5: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Find Complex Answers Faster with InfiniteGraph’s Distributed Graph

Database• InfiniteGraph is optimized for high speed

traversal of complex relationships.• Return results faster by several orders of

magnitude compared to other technologies.• Performance will not degrade or suddenly

drop-off.

Internal, Confidential

Page 6: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

InfiniteGraph in the “NOSQL” Market

Page 7: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

InfiniteGraph™

• Connects the dots on a global scale.• InfiniteGraph™ finds connections in big data.

Page 8: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

InfiniteGraph Values• Connects the dots on a global scale.

– It’s all about finding, persisting and navigating relationships in big data.

• You can download, develop, deploy at no cost.– InfiniteGraph starts at $0.– You can build for free, and expand as needed.

• Leading the data and graph markets.– No other graph product today can serve the requirements

of enterprise, government and large scale online ventures, as we can.

– InfiniteGraph is the commercial leader in graph technologies for these markets. Our customers are proof.

Page 9: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

• Supports large scale and distributed systems.

• Proven technology and deployments.

• Flexible and Easy: • Distributed and cloud ready, Java on interoperable

platforms, integrates with most other data stores, supports ACID to flexible modes.

InfiniteGraph’s Unique Advantages

Page 10: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Relationships are everywhere

Page 11: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Open Source Polyglot Applications

• Where does the graph data come from?• Extracting data from other sources, relational

databases (join tables); key-value stores such as MongoDB; social networks, e.g. Facebook, LinkedIn through public APIs; the Web, e.g. Wikipedia, RDF.

• Using open source to store external keys (e.g. GUID, URI) to InfiniteGraph element ids mapping for very large graphs –billions of nodes and edges.

Page 12: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

InfiniteGraph Basic Architecture

Copyright © InfiniteGraph

InfiniteGraph - Core/API

ConfigurationNavigation Execution

Management Extensions

BlueprintsUser Apps

Distributed Object and Relationship Persistence LayerDistributed Object and Relationship Persistence Layer

Session / TX ManagementPlacement

Page 13: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Parallel Ingest

Copyright © InfiniteGraph

InfiniteGraph - Core/API

ConfigurationNavigation Execution

Management Extensions

Session / TX ManagementPlacement

Placement (MDP Plugin)

Distributed Object and Relationship Persistence Layer

App-1(Ingest V1)

App-2(Ingest V2)

App-3(Ingest V3)

App-1(E1 2{ V1V2})

App-2(E23{ V2V3})

App-3

V1V1 V2

V2 V3V3E12

E12 E23E23

Page 14: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Zone 2Zone 1

HostA

Distributed Placement

Copyright © InfiniteGraph

IG Core/API

Distributed Object and Relationship Persistence Layer

ADP Placement

HostB HostC HostX

AddVertex()

Page 15: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Distributed Placement & Pipelining

Copyright © InfiniteGraph

IG Core/API

ConfigurationNavigation Execution

Management Extensions

Session / TX Management

Placement(MDP)

Placement(ADP)

C1C1

C2C2

C3C3

E12E12

E23E23

Targ

et C

onta

iner

s

Pipeline Containers

E(1->2)

E(3->1)

E(2->3)

E(2->1)

E(2->3)E(3->1)

E(1->2)

E(3->2)

E(1->2)

E(2->3)

E(3->1)

E(2->1)

E(2->3)

E(3->1)

E(3->2)

E(1->2)

Pipeline

Agent

Page 16: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Parallel Processing and Storage

Apache HADOOP• Map/reduce

– Distributed processing.

• HDFS– Distributed file system.

• HBase– Distributed storage for large

tables.

• Cassandra– Multi-master database with

no single point of failure.

InfiniteGraph• Distributed processing

– Peer-to-peer servers and clients anywhere in the network.

• Distributed data– Federation of databases

anywhere in the network.

• Single logical view of all data in the federation– Any client anywhere can

access server anywhere.

Page 17: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

InfiniteGraph™

• Technical specifications:– Written in: Java (core C++) .– Platforms: Windows (32-bit and 64-bit), Linux (32-

bit and 64-bit), Mac (64-bit).– Graph-Model: Labeled directed multigraph.– API/Protocols: Java, Tinkerpop (which provides

Gremlin, REST, Frames, Ripple and Linked Process).

– Consistency: Flexible (from ACID, to relaxed).– Indexing: Flexible (from automatic to manual)– Persistence: Java class based.

Page 18: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Comprehensive Online Resources

Page 19: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Other uses of Open Source

• Eclipse– IDE for development and samples;– Plug-ins (browsers/visualizer);– SWTBot - UI testing of Visualizer and Assist.

• Apache Ant, Maven, Tycho - build.• Junit – test.• SL4J - plug into log4j and apache logging.• Lucene – text indexing.

Page 20: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

Other uses of Open Source

• Xerces C++ – C++ Parser in XML tool suite.• PCRE --> C++ Parser Generator• zlib --> C++ compression• cppcheck - check memory leaks, etc.• ANTLR 3 –Predicate Query Language (parser).• unixODBC – SQL++ access to database.

Page 21: Leveraging Commercial Graph DB Technologies in Open Source and Polyglot Application Environments Brian Clark, VP Product Management Objectivity, Inc.

We’re exhibiting – Booth #708

Brian ClarkVP Product Marketing