Java and Mongo

Proprietary & Confidential. © 2012 R/GA All rights reserved.

Java and MongoDB

/** * @author: marcio garcia * @contact: [email protected] **/

3Proprietary & Confidential. © 2012 R/GA All rights reserved. /

Agenda

• Introduction - 6 min.

• WHAT?

• Motivations - 6 min.

• WHY?

• Coding - 12 min.

• HOW?

/

Proprietary & Confidential. © 2012 R/GA All rights reserved. 4/

01Introduction


What is? and what is not


it is….

• NoSQL Database • Document based• Cross-platform• Written in C++• BSON (JSON like) - Structure• License: GNU• “Join-less” DB – Performance• Master slave failover – Availability

Sharding – Scalability


it is….

• NoSQL Database • Document based• Cross-platform• Written in C++• BSON (JSON like) - Structure• License: GNU• “Join-less” DB – Improve High Performance• Master slave failover – Improve availability

Sharding – Improve scalability


it is…. NoSQL DB Document based

Fields name value

Fields key value

String, Integer, Float, Timestamp, Binary, ArrayDocument (do you remember: joinless?)

Database Database A file in your disk

Tablespace Collection Bunch of Documents

Tables Documents Group of fields


it is…. BSON (JSON like) - Structure


it is…. Sharding – Improving scalability

Sharding function:

Shard1: first=“A* to G*Shard2: first=“H* to M*”Shard3: first=“N* to S*”Shard4: first=“T* to Z*”

Sample Document with 2 fields: first and last


it is not….

• Query based database• All purpose database• ACID (just between documents at the same hierarchy)• Fixed schema • Unlimited storage database• OLAP – it’s not a DW DB!


BONUS!

• 60mi of records• JSON format• Circa 2 hours• 15GB database• Circa 40 min to create an index• Finding

• find().count() < 18 milliseconds – first time• find({“area”:”11”, “phone_number”:”88888881”})

/


02Motivation


Why?


YES you should use it if…..

• Fast response for queries (SELECT)• First database• Store Temporary Data• Share data between apps with different flavors (Java, Shell, Javascript - Node.js)• Data Warehouse Cube• File storage (GridFS)• Horizontally scaling – sharding • Web application


YES … examples

• Portal Home page• App on Facebook, share data• Delivering content to different clients.

• Web browser, iTunes, Mobile, DTV• Delivering content through a Web Server

• Storage device, balancing


Not convinced yet? Doubts?

• Drivers (Python, Django, Java, Spring, .Net, PHP, Ruby, Rails, Node.js)• Tools

• MongoHub - MacOS• Meclipse – Eclipse Plugin• JMongoBrowser – no restrictions

• Monitoring• Munin• Cacti• Ganglia

• Serving content from Mongo• NGINX and Lighttp


Not convinced yet?

/


03Tech Stuff


How?


Connecting…. Drivers

Spring Data for MongoDB

DataNucleos

Complete list: http://www.mongodb.org/display/DOCS/Java+Language+Center


Connecting…. Drivers

• Annotation based• Validation JSR303• Type-safe• DAO<T,V> access abstraction• Easy to implement• Fast• Lightweight• Source code easy to understand


Installing….


Connecting….

Source: BaseApp.java


Annotations

• Entity• Id• Property

Class LevelMaps the class to the collectionCan define the name of collection as param

Field LevelDefines the PK of a collectionIt’s n ObjectId classField LevelDefines a field.

• Serialized• Transient• NotSaved

Field level annotation

Stored in a binary fieldLoaded but not storedNot Loaded and not saved

• Indexed


Create an index with the field


Annotations

• Entity• Id• Property

• PrePersist• PostPersist• PreLoad• PostLoad

• Reference• Embedded

• Serialized• Transient• NotSaved


FK, stores the ObjectID

• Indexed


Store the Object

Before and After actionsPersisting and Loading


Mapping

Define a collection: cities

Create the PK (ObjectId)

Could use @Property to redefine the column name

Store the ObjectID from State document outside this

Store a list of Neighborhood objects inside the City document


Collectiondb.states.find() db.cities.find()

@Reference

@Embedded

@Id

FK Detected!


Creating

Create the object

Datastore.save(object)

Database


Deleting

Find the Record

Datastore.delete(object | Query)


Querying / Updating

Find the objects

Apply the update rule

Execute


Pre/Post … Persist/Load

Pre/Post Persist

Pre/Post Load


Concluding Remarks

Java• Powerful language, powerful VM• Available on Heroku, GAE• JVM BONUS: JRuby, Groovy, Scala

MongoDB• NoSQL – Document Based• Schema-less• JSON like “multi language”• Horizontally scale - Sharding


Links

Delicious Stack:

http://www.delicious.com/stacks/view/GmHJ5R





Thanks!

Java and Mongo

Technology

proprietary

regular sql

proprietary

proprietary

sql statements

rights reserved

high volume

regular rdbms