MySQL as a Document Store - Meetupfiles.meetup.com/2855062/MySQL as a Document Store.pdfcommitment to deliver any material, code, ... –Implemented by X Plugin to Extend MySQL Server

MySQL as a Document Store

Ted Wennmark ted.wennmark@oracle.com

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Program Agenda

MySQL Document Store

MySQL Future

Program Agenda

MySQL Future

Today’s Challenges

• Developers want to move faster

• Time to market has a premium value

• Rapid prototyping, iterate fast…

Today’s Challenges (cont.)

• Relational databases ask for schema up front – Potentially saving you time in the future

– Less variations; less code to handle edge cases

– Added cost with each schema change

• NoSQL databases do not ask for schema – Saving you time up front

– But potentially adding operational costs over time

–No cost per schema change

Why can you not…

• Have both schema-less and schema in the same technology stack?

• One that checks all the boxes of all stakeholders:

Developers: [ x ] Schemaless [ x ] Rapid Prototyping/Simpler APIs [ x ] Document Model

Operations: [ x ] Performance Management/Visibility [ x ] Robust Replication, Backup, Restore [ x ] Comprehensive Tooling Ecosystem

Business Owner: [ x ] Don’t lose my data = ACID transactions [ x ] Capture all my data = Extensible/Schemaless [ x ] Products On Schedule/Time to Market = Rapid Development

NEW! MySQL Document Store

• Native JSON Documents in MySQL 5.7 – Schema-less Document Storage

• X Protocol (MySQL 5.7.12 DMR) – Implemented by X Plugin to Extend MySQL Server as a Document Store

• X Dev API

– SQL and Document CRUD Operations

– Implemented in Connector/Node.js, Connector/J, Connector/Net

• MySQL Shell – Javascript, Python, SQL modes

Architecture

Plugins

X Protocol Plugin Memcached Plugin Core

X Protocol Std Protocol

X Protocol 33060

Std Protocol 3306

SQL API CRUD API

X and Std Protocols

MySQL Shell

New! MySQL X DevAPI

• Modern: fluent API, method chaining

• Stateless sessions enable transparent scaling to multi-server environments

• SQL support

• CRUD for Collections of Documents and Tables

–Documents as simple basic domain objects

– Search expressions match SQL SELECT expressions

• Implemented in MySQL Shell & MySQL Connectors – NEW! MySQL Connector/node.js

– MySQL Connector/J

– MySQL Connector/Net

New! MySQL Shell

• Integrated Development and Administration Shell

• Exposes New X DevAPI

• Multi-Language scripting

– JavaScript, Python, and SQL

• Configurable results formats

– Traditional Table, JSON, Tab Separated

tomas@localhost $ mysqlsh --uri root@localhost/test

Creating an X Session to root@localhost:33060/test

Enter password:

Default schema ̀ test` accessible through db.

Currently in JavaScript mode. Use \sql to switch to SQL mode and execute queries.

mysql-js> db.createCollection("posts");

<Collection:posts>

mysql-js> db.posts.add({"title":"Hello World", "text":"First post!"})

Query OK, 1 item affected (0.03 sec)

mysql-js> db.posts.find("title = 'Hello World'").sort(["title"]);

"_id": "8202bda28206e611140b3229389b6526",

"text": "First post!",

"title": "Hello World"

1 document in set (0.01 sec)

Under the Hood

Collections are tables

Tables with: - JSON column - Generated Column

Create a Collection

Under The Hood II

• X-Plugin translates CRUD -> SQL

• No code changes in core parts of MYSQL

Create Document (CRUD)

Look inside general-log

Under The Hood III

Read Document (CRUD)

Look inside general-log

CRUD Operations – NoSQL/Document and SQL/Relational

Operation Document Relational

Create Collection.add() Table.insert()

Read Collection.find() Table.select()

Update Collection.modify() Table.update()

Delete Collection.remove() Table.delete()

CRUD Operations NoSQL/Document Javascript Java

C# NodeJS

CRUD Operations SQL/Relational

Javascript Java

C# NodeJS

✔ Built on Proven SQL/InnoDB/Replication

✔ Schema-less/Relational/Hybrid

✔ ACID/Transactions

✔ CRUD/JSON/Documents

✔ Modern Dev API

✔ Modern/Efficient Protocol

✔ SQL Queries/Analytics over JSON Documents

✔ Transparent and Easy HA/Scaling/Sharding

New! Documentation

• Developer Guides

• Lots of examples

New Style - Developer Focused

http://dev.mysql.com/doc/dev/mysqlsh-api-javascript/

Program Agenda

MySQL Future

Vision

“Be the most popular open source database for scale-out”

3 MySQL will focus on three things.

Scale-Out

Ease-of-Use

Out-of-Box Solution

Ease-of-Use

• Download, Install, HA & Scale-Out in 15 minutes

• Single Interface for Everything MySQL

• Easy to Setup, Scale-Out, Manage & Monitor

• Excellent Quality

Out-of-Box Solution

• Integrated Solution vs. Individual Components

• Designed & Developed Together

• Tested & Delivered Together

• Managed & Monitored Together

Scale-Out

• Maintain World-Class Performance

• Rock Solid, Server-Side HA With Auto-Failover

• Read Scale-Out With Replication

• Write Scale-Out With Sharding

4 Rollout will happen in four steps.

Read Scale-Out

Async Replication + Auto Failover

Write Scale-Out

Sharding

MySQL Vision – 4 Steps

Timeline

Relational & Document Model

MySQL HA

Out-Of-Box HA

Introducing …

Scale-Out High Performance

Ease-of-Use Built-in HA

Out-of-Box Solution Everything Integrated

MySQL InnoDB

cluster

A single product: MySQL • All components created together

• Tested together

• Packaged together

Flexible and Modern • C++ 11

• Protocol Buffers

• Developer friendly

MySQL InnoDB Cluster – Goals

Easy to use • A single client: MySQL Shell

• Easy packaging

• Homogenous servers

Scale-out • Sharded clusters

• Federated system of N replica sets

• Each replica set manages a shard

InnoDB cluster

MySQL InnoDB Cluster – Architecture - S2

MySQL Connector

Application

MySQL Router

MySQL Connector

Application

MySQL Router

MySQL Shell

Group Replication

S1 S2 S3 S4 S…

MySQL Connector

Application

MySQL Router

MySQL Connector

Application

MySQL Router

MySQL Shell

MySQL InnoDB Cluster – Architecture - S3 MySQL

InnoDB cluster

Read-Only Slaves

S1 S2 S3 S4 S…

MySQL Connector

Application

MySQL Router

MySQL Connector

Application

MySQL Router

MySQL Shell

S1 S2 S3 S4 S…

MySQL Connector

Application

MySQL Router

S1 S2 S3 S4

MySQL Connector

Application

MySQL Router

MySQL InnoDB Cluster – Architecture - S4 MySQL

InnoDB cluster

MySQL Connector

Application MySQL Connector

Application

MySQL Shell

MySQL Connector

Application MySQL Connector

Application

MySQL InnoDB Cluster – Architecture

MySQL InnoDB

cluster MySQL Enterprise Monitor

InnoDB cluster

MySQL InnoDB Cluster – DEMO

Application

MySQL Router

MySQL Connector

Applicaion

MySQL Shell

Group Replication

3320 3330

The Demo Showed…

• MySQL HA in 4 minutes

• Very easy, even for somebody new to MySQL

• Everything managed through MySQL Shell

• Convenient, easy-to-use AdminAPI

InnoDB cluster

1 One seamless solution for HA: Easy-to-Use, Out-of-Box, Scale-Out.

InnoDB cluster

What’s next?

Read Scale-Out

Async Replication + Auto Failover

Write Scale-Out

Sharding

MySQL Vision – 4 Steps

Timeline

Download Preview Release from labs.mysql.com

Relational & Document Model

MySQL HA

Out-Of-Box HA

Resources

Topic Link(s)

MySQL as a Document Database http://dev.mysql.com/doc/refman/5.7/en/document-database.html

MySQL Shell http://dev.mysql.com/doc/refman/5.7/en/mysql-shell.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html

X Dev API http://dev.mysql.com/doc/x-devapi-userguide/en/

X Plugin http://dev.mysql.com/doc/refman/5.7/en/x-plugin.html

MySQL JSON http://mysqlserverteam.com/tag/json/ https://dev.mysql.com/doc/refman/5.7/en/json.html https://dev.mysql.com/doc/refman/5.7/en/json-functions.html

Thank you!

MySQL as a Document Store - Meetupfiles.meetup.com/2855062/MySQL as a Document Store.pdfcommitment to deliver any material, code, ... –Implemented by X Plugin to Extend MySQL Server

Documents

MySQL Installer Release Notes · 2020-07-15 · MySQL...

MySQL Enterprise Backup 8.0 Release Notes - Oracle ·...

Document d'aide phpMyAdmin et MySQL -...

MySQL 5.0 Release Notes · 1 MySQL 5.0 Release Notes...

Scaling - Meetupfiles.meetup.com/107604/MySQL...

MySQL Document Store: Under the Hood

Relational and Document Database with MySQL

Mysql Informational Document

MySQL 5.7 como Document Store

Presentación - Meetupfiles.meetup.com/19109162/Vertica vs.....

MySQL Tutorial · 2013. 10. 28. · MySQL Tutorial Abstract...

Using the MySQL Document Store - Percona – The … ·...

MySQL 5.1 Release Notes - Downloads · PDF file1 MySQL 5.1.....

MySQL como Document Store PHP Conference 2017

What's new in MySQL 5.7.5? -...

MySQL 5.1 Release Notes - MySQL Community Downloads · 1...