Top Banner
A scalable blockchain database Dimitri De Jonghe [email protected]
38

BigchainDB - Big Data meets Blockchain

Apr 16, 2017

Download

Internet

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: BigchainDB - Big Data meets Blockchain

A scalable blockchain database

Dimitri De [email protected]

Page 2: BigchainDB - Big Data meets Blockchain

Your assets, your claims

Page 3: BigchainDB - Big Data meets Blockchain
Page 4: BigchainDB - Big Data meets Blockchain

Trust by Institutions & Intermediaries

Page 5: BigchainDB - Big Data meets Blockchain

$ ping www.google.com< PING www.google.com (172.217.17.36)

Digital Trust by Institutions & Intermediaries

Page 6: BigchainDB - Big Data meets Blockchain

Her

e’s

your

pers

onal

data

Page 7: BigchainDB - Big Data meets Blockchain

2008 - Bitcoin

Page 8: BigchainDB - Big Data meets Blockchain

Blockchain DisruptionShared single source of

truth and conduct

Inter-mediary

Trusted third parties

peer to peerdecentralizedcentralized

Page 9: BigchainDB - Big Data meets Blockchain

Blockchain: a special “spreadsheet in the sky”

What’s special?

● Not a single instance owns it● Members/clients can add to it● If they follow the rules● Rules are an integral part● No one can change the history

(immutable)

● Writing to a blockchain is like etching into stone

● Which allows us to issue assets and transfer them

Page 10: BigchainDB - Big Data meets Blockchain

Shades of trust, reputation, blockchain...

Public: Open networks

Writers: Everyone can participate

Trust: World consensus

Applications:

● Decentralized apps

● Cryptocurrencies, programmable money

● Smart contracts

Private: Ecosystems, federations

Writers: Participants known/reputation

Trust: Federated consensus (eg

voting)

Applications:

● Disintermediation: Clearing & settlement

● Transparency: Supply chain, AML, audit

trails, provenance

● Ownership: exchange, partial, trustless

Page 11: BigchainDB - Big Data meets Blockchain

Internet of value: a programmable economy

Page 12: BigchainDB - Big Data meets Blockchain

To develop shared global compute infrastructure,

we must first understand the status quo of infrastructure,

…and how to change it accordingly.

Page 13: BigchainDB - Big Data meets Blockchain

Status quo compute infrastructureModern apps use processing, file system, database

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

Page 14: BigchainDB - Big Data meets Blockchain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDBBitcoin Blockchain?

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

Page 15: BigchainDB - Big Data meets Blockchain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

e-Cash/e-GoldBitcoin

Page 16: BigchainDB - Big Data meets Blockchain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

led

ger

ILP

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

Page 17: BigchainDB - Big Data meets Blockchain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDB

???

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

ledg

er IL

P

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

Page 18: BigchainDB - Big Data meets Blockchain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDBBigchainDB, IPDB

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

ledg

er IL

P

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

Page 19: BigchainDB - Big Data meets Blockchain

70 GB3 tx/s

What about planetary scale?

Page 20: BigchainDB - Big Data meets Blockchain

Netflix uses 37% of Internet bandwidthUsing a modern distributed “big data” database

http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html

Writes / s vs. # nodes

Page 21: BigchainDB - Big Data meets Blockchain

What’s the difference between a database and a csv file?Querying. From M’s of records, find the relevant ones.

1 Line of standard code, optimizedvs

50-500 lines of slow custom code, unoptimized

Page 22: BigchainDB - Big Data meets Blockchain

How do “big data” databases scale? Answer: Distribute storage across many machines, i.e. sharding

A “consensus” algorithm keepsdistributed nodes in sync.

Page 23: BigchainDB - Big Data meets Blockchain

Native assets

How to build a scalable blockchain database (BigchainDB)1. Start with an enterprise-grade distributed DB, e.g. MongoDB2. Engineer in blockchain characteristics

• Each DB node is a federation nodeDecentralized / Shared Control

• Append-only• Chain hashes

Immutable / Audit Trails

• “Own” = have private key• Asset lives on the database

Page 24: BigchainDB - Big Data meets Blockchain

Federated Consensus Architecture

Blockchain Consensus

Database Consensus

IMPLEMENT A 2 PHASE CONSENSUS

FEDERATION

Single Database

or

MongoDB RethinkDB

Database Options

Page 25: BigchainDB - Big Data meets Blockchain

Decentralized programming

Page 26: BigchainDB - Big Data meets Blockchain

BigchainDB: Big Data meets Blockchain- a blockchain database

Immutability

Decentralized Control

Native Assets

Scalable

Queryability

Operationalized

TraditionalDatabases

Traditional blockchains

BigchainDB

Page 27: BigchainDB - Big Data meets Blockchain

Blockchain as a DB - Applications

Page 28: BigchainDB - Big Data meets Blockchain

Vertical:IP – Music rights

Value proposition:A streaming service owned by all

Page 29: BigchainDB - Big Data meets Blockchain

Vertical:IP – Digital art

Value proposition:Enables creators of digital art to get compensated, via claiming attribution & licensing

ascribe

Page 30: BigchainDB - Big Data meets Blockchain

Vertical:Identity

Value proposition:Low-friction assurance, sovereign personal data

Authenteq

©ITU/L.Berney, (CC BY 2.0)

Page 31: BigchainDB - Big Data meets Blockchain

Vertical:Government – Land Registry

Value proposition:Low-cost registry, less risk of corruption

BenBen

©ITU/L.Berney, (CC BY 2.0)

Page 32: BigchainDB - Big Data meets Blockchain

Vertical:ID - Education Credentials

Value proposition:reduce fraudulent degrees, lower HR friction

Recruit

Page 33: BigchainDB - Big Data meets Blockchain

Vertical:Energy

Value proposition:manage $ flow in energy deregulation

Page 34: BigchainDB - Big Data meets Blockchain

Vertical:Supply Chain / Health

Value proposition:government-mandatedtransparent $ flow

Page 35: BigchainDB - Big Data meets Blockchain

Generating Opportunities: Vertical x Benefit

Decentralized /Shared Control

Immutability / Audit trail

Tokens /Exchanges

Intellectual Property

Identity

Finance

Energy

Government

Dig art – ascribe

Supply Chain

R3

Retail marketplace - OpenBazaar

RWE You?

You?

You?

Res( )nate

Tangent90 Everledger

Recruit

BenBen

Page 36: BigchainDB - Big Data meets Blockchain

• For everyone, everywhere

• Free until heavy usage, then pay web service style

• Initial tech is BigchainDB

• Member caretakers will operate validating nodes

Page 37: BigchainDB - Big Data meets Blockchain

IPDB Caretakes (so far)

BlockstackCOALA

Dyne.orgInternet Archive

OpenMediaUnMonastery

ascribe / BigchainDBConsensys

Eris/Monax IndustriesProtocol Labs (IPFS)SmartContract.com

SynereoTendermint

Page 38: BigchainDB - Big Data meets Blockchain

Dimitri De Jonghe

[email protected]@DimitriDeJonghehttps://be.linkedin.com/in/dimitridejonghe

+32 496 80 94 14

My projects:https://ascribe.iohttps://bigchaindb.comhttps://ipdb.foundationhttps://github.com/bigchaindbhttps://interledger.orghttp://datanews.knack.be/ict/nieuws/bigchaindb-maakt-blockchain-principe-schaalbaar/article-normal-720789.html

Thanks for listening