MySQL as a Document Store

Copyright©2014Oracleand/oritsaffiliates.Allrightsreserved.|

IntroducingtheMySQLDocumentStore

MarkSwarbrickPrinciplePresalesConsultantUK&[email protected]

OracleConfidenOal–Internal/Restricted/HighlyRestricted


SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirecOon.ItisintendedforinformaOonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncOonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andOmingofanyfeaturesorfuncOonalitydescribedforOracle’sproductsremainsatthesolediscreOonofOracle.

2


Today’sAgenda

RelaOonalDatabases,DocumentDatabasesandMySQL

MySQLJSONSupport

DocumentUseCases

TheXDevAPI

Ge\ngitallworkingtogether

1

2

3

4

3

5


RelaOonalDatabases• DataIntegrity– NormalizaOon– Constraints(foreignkeysetc)

• Atomicity,Consistency,IsolaOon,Durability-ACID– TransacOons

•  SQL– Powerful,OpOmizableQueryLanguage– DeclarewhatyouwantandtheDBwillfindoutthemostefficientwaytogetittoyou

OracleConfidenOal–Restricted 4


Plus…• MySQLhasbeenaroundsince1995• Ubiquitous• Pregymuchastandard•  Scalable• Whenthereareissues,theyareknownandunderstood•  Largebodyofknowledge,fromsmalltoBIGdeployments



DocumentDatabases


•  Schemaless– noschemadesign,normalizaOon,foreignkeys,constraints,datatypesetc– fasteriniOaldevelopment

•  Flexibledatastructures– nestedarraysandobjects– somedataissimplynaturallyunstructuredorcannotbemodeledefficientlyintherelaOonalmodel(hierarchies,productDBetc)– persistobjectswithoutORMs


DocumentDatabases(Cont.)


•  JSON– Closertothefrontend– "naOve"inJavaScript– Node.jsandfullstackJavaScript

•  Easytolearn,easytouse


RelaOonalvsDocumentDatabases

Whynotboth?




MySQLJSONSupport

DocumentUseCases

TheXDevAPI


9

1

2

3

4

5


MySQL5.7:JSONSupport• NaOveJSONdatatype•  StoreJSONvalues(objects,arraysandsimplevalues)inMySQLtables• BinaryJSONstorageformat• Conversionfrom"naOve"SQLtypestoandfromJSONvalues•  JSONManipulaOonfuncOons– Extractcontents(JSON_EXTRACT,JSON_KEYSetc)– Inspectcontents(JSON_CONTAINSetc)– Modifycontents(JSON_SET,JSON_INSERT,JSON_REMOVEetc)– Createarraysandobjects(JSON_ARRAY,JSON_OBJECT)– Searchobjects(JSON_SEARCH)



MySQL5.7:JSONSupport(cont.)•  InlineSQLJSONpathexpressionsSELECT doc->'$.object.array[0].item' FROM some_table

• Booleanoperators(compareJSONvaluesetc)– foo=doc->'$.field'



MySQL5.7:JSONSupport(cont.)• Plus…• Generated/VirtualColumns– IndexJSONdata– ForeignkeystoJSONdata– SQLviewsforJSONdata




MySQLJSONSupport

DocumentUseCases

TheXDevAPI


13

1

2

3

4

5


ExtracOngJSONfromaRelaOonalDBRela+onalIn,Rela+onal+DocumentOut

• DatastoredinrelaOonaltables,butfrontendusesJSON•  JSONdirectlymapstonaOvedatastructuresinmanylanguages– OxeneasierforapplicaOoncodetouse– JavaScript,Python,Rubyetc– InbrowserJavaScript



ExtracOngJSONfromaRelaOonalDBRela+onalIn,Rela+onal+DocumentOut

•  SQLFuncOonstoconstructJSON– JSON_OBJECT(),JSON_ARRAY()

•  Ex.:SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) FROM customer;

CREATE VIEW customer_json AS

SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) as doc FROM customer;

SELECT * FROM customer_json;

• UpdatesandinsertssOllhappenthroughthetablecolumns



UsingMySQLasaJSONDocumentContainerDocumentIn,Rela+onal+DocumentOut

• VirtuallySchemaless– Unstructureddata– Noclear,fixedstructureforthedata…recordscanhavedifferentfields– Oxendatathatisnotinvolvedinbusinessrules– Examples:"product_info","properOes","opOons"etc

• DatadoesnotmapcleanlyintoarelaOonalmodel(arrays,hierarchicaldataetc)• Prototyping



MySQLasaJSONDocumentContainer


Example:"product_info"tableproduct_id a<ribute value

9 size M

9 color red

9 fabric cogon

11 flavour strawberry

12 capacity 128GB

12 speedclass class10

13 connecOvity Wi-Fi

13 storage 64GB

13 screensize 8.9"

13 resoluOon 2560x1600(339ppi)

13 bagerylife 12hours

{"product_id":9,"size":"M","color":"red","fabric":"cogon"},{"product_id":11,"flavour":"strawberry"},{"product_id":12,"capacity":"128GB","speedclass":"class10"},{


MySQLasaJSONDocumentContainerDocumentIn,Rela+onal+DocumentOut

• AnordinaryMySQLtablewithasingleJSONdatacolumn• GeneratedcolumnsallowSQLenginetolookinsidetheJSONdata– Virtualcolumns– PrimaryKeys– Indexes– ForeignKeys

• WritesontheJSONcolumn• ReadsprimarilyfromtheJSONcolumns



HybridRelaOonalandJSONRela+onal+DocumentIn,Rela+onal+DocumentOut

• DatabaseismostlyrelaOonal•  SomepartsofthedatabaseareunstructuredordoesnotmodelcleanlyasrelaOonal•  JSONcolumnsinrelaOonaltables• QueriescanmixandmatchJSONandcolumndata•  EvoluOonpathforDocumentbasedapplicaOons




MySQLJSONSupport

DocumentUseCases

TheXDevAPI


1

2

3

4

20

5


DocumentOperaOonsviaSQL• Powerful• Allowscomplexqueries• But…sOlldifficulttouse



DocumentOperaOonsviaSQL

CREATE TABLE product (

id VARCHAR(32) GENERATED ALWAYS AS (JSON_EXTRACT(doc, '$.id')) STORED,

doc JSON

);

INSERT INTO product VALUES (1, '{…}');

SELECT * FROM product WHERE JSON_EXTRACT(doc, '$.field') = value;

etc.



TheXDevAPI• AbstracOonoverSQL•  Focusedon4basicCRUDoperaOons(Create,Read,Update,Delete)•  Fluent,NaOveLanguageAPI• NoknowledgeofSQLneeded• XProtocol– CRUDrequestsencodedatprotocollevel– Requestdetails"visible"(vs"opaque"SQLstrings)



CollecOonandSchemaOperaOons• GetahandletoaSchemamydb = session.getSchema("mydb");

• CreateaCollecOonmydb.createCollection("products");

• Geta(local)referencetoaCollecOonproducts = mydb.getCollection("products");



AddDocument

products.add({"name":"bananas", "color":"yellow"}).execute();



FindDocuments


products.find("color = 'yellow'").sort(["name"]).execute();


ModifyDocuments


products.modify("product_id = 123").set("color", "red").execute();


RemoveDocuments


products.remove("product_id = 123").execute();


XDevAPISessions• XSession– Stateless– CRUDonly,noSQL– AbstractstheconnecOon

• NodeSession– DirectconnecOontoadatabasenode– AllowsCRUDandSQL



OtherOperaOonsonCollecOons• CreateanIndexdb.post.createIndex("email").field("author.email","text(30)",false)



CRUDOperaOons–NoSQL/DocumentandSQL/RelaOonal

Opera+on Document Rela+onalCreate CollecOon.add() Table.insert()Read CollecOon.find() Table.select()Update CollecOon.modify() Table.update()Delete CollecOon.remove() Table.delete()

31



MySQLJSONSupport

DocumentUseCases

TheXDevAPI


1

2

3

4

32

5


5.7.12DevelopmentPreviewRelease• MySQL5.7.12withDocumentStoreplugin• MySQLShell1.0.3• Connector/J7.0• Connector/Net7.0• Connector/Node.js1.0



MySQL5.7,Connectors,Drivers,andProtocols

34

MySQL

Plugins

XProtocolPlugin MemcachedPluginCore

MySQLConnectorsandDrivers

XProtocolStdProtocol

Memcacheddriver

XProtocol33060

StdProtocol3306

SQLAPI CRUDandSQLAPIs

MemcacheProtocol

XandStdProtocols

MySQLShell


MySQLShell



MySQLPluginforVisualStudio



ResourcesTopic Link(s)

MySQLasaDocumentDatabase hgp://dev.mysql.com/doc/refman/5.7/en/document-database.html

MySQLShell hgp://dev.mysql.com/doc/refman/5.7/en/mysql-shell.htmlhgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.htmlhgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html

XDevAPI hgp://dev.mysql.com/doc/x-devapi-userguide/en/

XPlugin hgp://dev.mysql.com/doc/refman/5.7/en/x-plugin.html

MySQLJSON hgp://mysqlserverteam.com/tag/json/hgps://dev.mysql.com/doc/refman/5.7/en/json.htmlhgps://dev.mysql.com/doc/refman/5.7/en/json-funcOons.html

Blogs hgp://mysqlserverteam.com/category/docstore/

37


ThankYou!

MySQL as a Document Store

Technology