Top Banner
Database for the Internet Why Blockchain Matters to Big Data Big Data Meetup London Nov. 3, 2016 Bruce Pon @brucepon
40

Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Apr 16, 2017

Download

Technology

BigchainDB
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Database for the Internet

Why Blockchain Matters to Big Data

Big Data Meetup LondonNov. 3, 2016Bruce Pon

@brucepon

Page 2: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

What is a Blockchain? Global View

Business LegalTechnical

All-in-one system that unlocks immense value -value exchange, database, validation mechanism

Page 3: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

What is a Blockchain? Component View

Database EncryptionConsensus

Page 4: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

What Is a Blockchain? Feature View

Decentralized AssetAutonomyImmutable

A pragmatic definition that allows for an expanded opportunity surface and blue ocean thinking

Page 5: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

The First Use Case for Blockchain

Bitcoin is a cryptocurrency, that uses the underlying characteristics of blockchain to issue a digital currency

= BlockchainBitcoin is an implementation

of the technologyBlockchain is the core

technology

Page 6: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Blockchain Disrupts Centralized Parties

Trusted Third Parties • Shared Single Source of Truth• Conducted via consensus rules• Enforced with transparency

Page 7: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Centralized Blockchain Model

Centralized to Decentralized

Strengths:1. Lower coordination overhead2. Efficient

Weaknesses:1. Centralized power2. Silos3. Hackable

Page 8: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Centralized Model Decentralized

Centralized to Decentralized

Strengths:1. Real-time Processing2. Hack-resistant3. Asset autonomy

Weaknesses:1. Performance & Scalability2. Governance & Security

Page 9: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Blockchain technology allows

The Digitization of Value• Next wave of digitization

• Weave into the fabric of our society

• Larger than the internet

Page 10: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

The Internet Drove the Digitization of Information

Knowledge freely shareable for the world

spawned billion dollar companies:

- Amazon

- Google

- Facebook

Gave voice to the powerless

Connected the powerful

Page 11: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

The blockchain is a truly open, distributed, global platform that fundamentally changes what we can do online, how we do it, and who can participate.

Call it the world wide ledger.

The Internet of Everything needs a Ledger of Everything.

- Don & Alex Tapscott

Page 12: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Image Credits: Ripple

Blockchain Technology will Impact $100 Trillion in Value

Page 13: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

The “Real” First Use Case for Blockchain

Source: http://www.looiconsulting.com/wp-content/uploads/2014/08/Four-Vs.png

Page 14: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

3 Ways to Unlock Big Data with Blockchains

Decentralized AssetAutonomyImmutable

SharedControl

UniversalExchange

AuditTrails

Page 15: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

3 Ways to Unlock Big Data with Blockchains

SharedControl

UniversalExchangeAudit

Trails

Page 16: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

3 Ways to Unlock Big Data with Blockchains

SharedControl

UniversalExchangeAudit

Trails

Page 17: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Audit Trails for Big Data Using Blockchain

Page 18: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Audit Trails for Big Data Using BlockchainSource: http://www.bloomberg.com/news/articles/2011-09-01/the-f-35-s-global-supply-chain

Page 19: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Global Database

Page 20: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

3 Ways to Unlock Big Data with Blockchains

SharedControl

UniversalExchangeAudit

Trails

Page 21: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Example: Data Pipeline

IoTSensors HDFS

StorageCleaning

NormalizationMongoDBStorage

Analytics

Page 22: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Creating Immutable, Time-Stamped Data

CreateTx

Write toDB

SignTx

Or if you’re already using a distributed database that BigchainDB wraps, then simply swap out that database with it’s blockchainified version.

Page 23: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

BACK OFFICE EFFICIENCY SUPPLY CHAIN RISK MODELS

Unlocks Data Lakes and Big Data Tools

Data Transparency

Page 24: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

3 Ways to Unlock Big Data with Blockchains

SharedControl

UniversalExchangeAudit

Trails

Page 25: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Digital Assets

Digital assets which have value and can’t be copied.

TOKENS TICKETS SECURITIES CREDIT CURRENCY

Page 26: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Asset Sovereignty

$

BANK

COURT

EXCHANGE

Own your private data, intellectual property, financial assets, land property without the

reliance on others to secure it.

A truly global world where no government can take away what is yours

Page 27: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Assets “Live” in the Network

Page 28: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016
Page 29: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

A scalable blockchain database for the decentralized enterprise

Anatomy of a Diamond FraudProof-of-Concept

January 2016

Page 30: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Case Study: The Diamond Supply Chain

30

• Conducted 6 week Proof-of-Concept

• Entered 1 Mio diamonds into BigchainDB from multiple data sources – Certification Labs, pricing services, and marketplaces

• Developed custom analytics and machine learning tools to understand and assess the data

How much fraud is there on a major diamond marketplace?

Conclusion: 7% of all listings have RED flags and are most likely fraudulent. This works out $750 Million per year of fraud on a single marketplace

Page 31: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

What is Diamond Fraud?

Page 32: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

How Detect Fraud?

Page 33: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Let’s Scrape for Data

Page 34: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Anatomy of a Diamond Fraud

34

Page 35: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016
Page 36: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Anatomy of a Diamond Fraud

36

• Diamond listing identified• Three fraud indicators are found:

1. Offer price is suspiciously low2. Is the Certification Lab

trustworthy?3. “Appraisal” value serves as a

mental anchor to convince buyers that they’re getting a deal

Page 37: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Anatomy of a Diamond Fraud

37

• Ascribe’s GemInSights is a backend prototype to monitor and track diamonds entering the supply chain – with a Rating scorecard that flags suspicious diamonds

• Findings - RED Flags:1. DGI lab

• Online Diamond ID Lookup function finds no diamond correlating to cert# on listing

• No sample certificates to show buyers authentic certificates

2. Price Estimator• List price is 70% less than

expected based on analytics it’s “too good to be true”

3. Related Sightings• Exact same listing has shown up

multiple occasions – once stored in BigchainDB, it’s immutable

Page 38: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

To get started with blockchain apps and use cases,Sign up for early access at:

https://ipdb.foundation/ipdb-testnet

Page 39: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

- Erik Brynjolfsson

Electricity is an example of a general purpose technology, like the steam engine before it. General purpose technologies drive most economic growth, because they unleash cascades of complementary innovations, like lightbulbs and, yes, factory redesign.

Page 40: Why Blockchain Matters to Big Data - Big Data London Meetup - Nov 3, 2016

Thank You

@brucepon

[email protected]