MySQL as a Document Store

IntroducingtheMySQLDocumentStore

MarkSwarbrickPrinciplePresalesConsultantUK&Imark.swarbrick@oracle.com

OracleConfidenOal–Internal/Restricted/HighlyRestricted

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirecOon.ItisintendedforinformaOonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncOonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andOmingofanyfeaturesorfuncOonalitydescribedforOracle’sproductsremainsatthesolediscreOonofOracle.

Today’sAgenda

RelaOonalDatabases,DocumentDatabasesandMySQL

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

Ge\ngitallworkingtogether

RelaOonalDatabases• DataIntegrity– NormalizaOon– Constraints(foreignkeysetc)

• Atomicity,Consistency,IsolaOon,Durability-ACID– TransacOons

•  SQL– Powerful,OpOmizableQueryLanguage– DeclarewhatyouwantandtheDBwillfindoutthemostefficientwaytogetittoyou

OracleConfidenOal–Restricted 4

Plus…• MySQLhasbeenaroundsince1995• Ubiquitous• Pregymuchastandard•  Scalable• Whenthereareissues,theyareknownandunderstood•  Largebodyofknowledge,fromsmalltoBIGdeployments

DocumentDatabases

•  Schemaless– noschemadesign,normalizaOon,foreignkeys,constraints,datatypesetc– fasteriniOaldevelopment

•  Flexibledatastructures– nestedarraysandobjects– somedataissimplynaturallyunstructuredorcannotbemodeledefficientlyintherelaOonalmodel(hierarchies,productDBetc)– persistobjectswithoutORMs

DocumentDatabases(Cont.)

•  JSON– Closertothefrontend– "naOve"inJavaScript– Node.jsandfullstackJavaScript

•  Easytolearn,easytouse

RelaOonalvsDocumentDatabases

Whynotboth?

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

MySQL5.7:JSONSupport• NaOveJSONdatatype•  StoreJSONvalues(objects,arraysandsimplevalues)inMySQLtables• BinaryJSONstorageformat• Conversionfrom"naOve"SQLtypestoandfromJSONvalues•  JSONManipulaOonfuncOons– Extractcontents(JSON_EXTRACT,JSON_KEYSetc)– Inspectcontents(JSON_CONTAINSetc)– Modifycontents(JSON_SET,JSON_INSERT,JSON_REMOVEetc)– Createarraysandobjects(JSON_ARRAY,JSON_OBJECT)– Searchobjects(JSON_SEARCH)

MySQL5.7:JSONSupport(cont.)•  InlineSQLJSONpathexpressionsSELECT doc->'$.object.array[0].item' FROM some_table

• Booleanoperators(compareJSONvaluesetc)– foo=doc->'$.field'

MySQL5.7:JSONSupport(cont.)• Plus…• Generated/VirtualColumns– IndexJSONdata– ForeignkeystoJSONdata– SQLviewsforJSONdata

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

ExtracOngJSONfromaRelaOonalDBRela+onalIn,Rela+onal+DocumentOut

• DatastoredinrelaOonaltables,butfrontendusesJSON•  JSONdirectlymapstonaOvedatastructuresinmanylanguages– OxeneasierforapplicaOoncodetouse– JavaScript,Python,Rubyetc– InbrowserJavaScript

ExtracOngJSONfromaRelaOonalDBRela+onalIn,Rela+onal+DocumentOut

•  SQLFuncOonstoconstructJSON– JSON_OBJECT(),JSON_ARRAY()

•  Ex.:SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) FROM customer;

CREATE VIEW customer_json AS

SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) as doc FROM customer;

SELECT * FROM customer_json;

• UpdatesandinsertssOllhappenthroughthetablecolumns

UsingMySQLasaJSONDocumentContainerDocumentIn,Rela+onal+DocumentOut

• VirtuallySchemaless– Unstructureddata– Noclear,fixedstructureforthedata…recordscanhavedifferentfields– Oxendatathatisnotinvolvedinbusinessrules– Examples:"product_info","properOes","opOons"etc

• DatadoesnotmapcleanlyintoarelaOonalmodel(arrays,hierarchicaldataetc)• Prototyping

MySQLasaJSONDocumentContainer

Example:"product_info"tableproduct_id a<ribute value

9 size M

9 color red

9 fabric cogon

11 flavour strawberry

12 capacity 128GB

12 speedclass class10

13 connecOvity Wi-Fi

13 storage 64GB

13 screensize 8.9"

13 resoluOon 2560x1600(339ppi)

13 bagerylife 12hours

{"product_id":9,"size":"M","color":"red","fabric":"cogon"},{"product_id":11,"flavour":"strawberry"},{"product_id":12,"capacity":"128GB","speedclass":"class10"},{

MySQLasaJSONDocumentContainerDocumentIn,Rela+onal+DocumentOut

• AnordinaryMySQLtablewithasingleJSONdatacolumn• GeneratedcolumnsallowSQLenginetolookinsidetheJSONdata– Virtualcolumns– PrimaryKeys– Indexes– ForeignKeys

• WritesontheJSONcolumn• ReadsprimarilyfromtheJSONcolumns

HybridRelaOonalandJSONRela+onal+DocumentIn,Rela+onal+DocumentOut

• DatabaseismostlyrelaOonal•  SomepartsofthedatabaseareunstructuredordoesnotmodelcleanlyasrelaOonal•  JSONcolumnsinrelaOonaltables• QueriescanmixandmatchJSONandcolumndata•  EvoluOonpathforDocumentbasedapplicaOons

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

DocumentOperaOonsviaSQL• Powerful• Allowscomplexqueries• But…sOlldifficulttouse

DocumentOperaOonsviaSQL

CREATE TABLE product (

id VARCHAR(32) GENERATED ALWAYS AS (JSON_EXTRACT(doc, '$.id')) STORED,

doc JSON

INSERT INTO product VALUES (1, '{…}');

SELECT * FROM product WHERE JSON_EXTRACT(doc, '$.field') = value;

TheXDevAPI• AbstracOonoverSQL•  Focusedon4basicCRUDoperaOons(Create,Read,Update,Delete)•  Fluent,NaOveLanguageAPI• NoknowledgeofSQLneeded• XProtocol– CRUDrequestsencodedatprotocollevel– Requestdetails"visible"(vs"opaque"SQLstrings)

CollecOonandSchemaOperaOons• GetahandletoaSchemamydb = session.getSchema("mydb");

• CreateaCollecOonmydb.createCollection("products");

• Geta(local)referencetoaCollecOonproducts = mydb.getCollection("products");

AddDocument

products.add({"name":"bananas", "color":"yellow"}).execute();

FindDocuments

products.find("color = 'yellow'").sort(["name"]).execute();

ModifyDocuments

products.modify("product_id = 123").set("color", "red").execute();

RemoveDocuments

products.remove("product_id = 123").execute();

XDevAPISessions• XSession– Stateless– CRUDonly,noSQL– AbstractstheconnecOon

• NodeSession– DirectconnecOontoadatabasenode– AllowsCRUDandSQL

OtherOperaOonsonCollecOons• CreateanIndexdb.post.createIndex("email").field("author.email","text(30)",false)

CRUDOperaOons–NoSQL/DocumentandSQL/RelaOonal

Opera+on Document Rela+onalCreate CollecOon.add() Table.insert()Read CollecOon.find() Table.select()Update CollecOon.modify() Table.update()Delete CollecOon.remove() Table.delete()

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

5.7.12DevelopmentPreviewRelease• MySQL5.7.12withDocumentStoreplugin• MySQLShell1.0.3• Connector/J7.0• Connector/Net7.0• Connector/Node.js1.0

MySQL5.7,Connectors,Drivers,andProtocols

Plugins

XProtocolPlugin MemcachedPluginCore

MySQLConnectorsandDrivers

XProtocolStdProtocol

Memcacheddriver

XProtocol33060

StdProtocol3306

SQLAPI CRUDandSQLAPIs

MemcacheProtocol

XandStdProtocols

MySQLShell

MySQLPluginforVisualStudio

ResourcesTopic Link(s)

MySQLasaDocumentDatabase hgp://dev.mysql.com/doc/refman/5.7/en/document-database.html

MySQLShell hgp://dev.mysql.com/doc/refman/5.7/en/mysql-shell.htmlhgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.htmlhgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html

XDevAPI hgp://dev.mysql.com/doc/x-devapi-userguide/en/

XPlugin hgp://dev.mysql.com/doc/refman/5.7/en/x-plugin.html

MySQLJSON hgp://mysqlserverteam.com/tag/json/hgps://dev.mysql.com/doc/refman/5.7/en/json.htmlhgps://dev.mysql.com/doc/refman/5.7/en/json-funcOons.html

Blogs hgp://mysqlserverteam.com/category/docstore/

ThankYou!

MySQL as a Document Store

Technology

MySQL developing Store Procedure

MySQL 5.7 - NoSQL - JSON, Protocol X, Document Store /...

Optimize MySQL Workloads with Amazon Elastic Block Store -.....

Site Store Proâ„¢ INSTALLATION GUIDE - PHP/MYSQL VERSION

MySQL Server Version Reference · 2020-02-21 · MySQL...

Introducing the MySQL Document Store

Document d'aide phpMyAdmin et MySQL -...

MySQL 8 : The Best gets even better · 2018-07-27 · MySQL...

1 / 71 - Percona · Percona University, Ghent, Belgium June...

Jamf Pro Installation and Configuration Guide for Mac ·...

Relational and Document Database with MySQL

MySQL Connector/NET Release Notes · 1 MySQL Connector/NET....

MySQL Document Store: Under the Hood · • MySQL...

Introducing the MySQL Document Store · Title: How to Use.....

NoSQL + SQL MySQL Sr. Sales Vittorio Cioe MySQL Document...

MYSQL DOCUMENT STORE€¦ · MYSQL DOCUMENT STORE UNDER THE...