DBD lection 4. Big Data, NoSQL. In Russian.

3. Big Data. NoSQL BD. NoSQL.

big data? (.big data) - , , , , 2000- , Business Intelligence.

, GoogleTrends big data.* - *

big data? ;GPS- ;, ; ; ; .

big data . , , . , 2 2 .2. . , . , . - .3. . . , . BigData- , .

big data SQL BD . ? 5 , .

BD Google 2004 , MapReduce. : https://ru.wikipedia.org/wiki/MapReduce Google: http://research.google.com/archive/mapreduce.html

MapReduce . ( ) BD

,

6

!!

7

big data MapReduceMapReduce , Google .

:http://habrahabr.ru/post/103467/:http://habrahabr.ru/company/bitrix/blog/218003/ :http://habrahabr.ru/post/74792/ :https://msdn.microsoft.com/ru-ru/magazine/mt147240.aspx :http://www.ibm.com/developerworks/ru/library/bd-mapreduce/index.html

8

MapReduce. MR .

MapReduce.

MapReduce. Map. Map. map(), . . .

map() -. .. , , -. , , reduce.

MapReduce. Map. . . Python - Map :

def, , - (!):the quick brown fox jumps over the lazy dog

MapReduce. Shuffle. Shuffle. . map map. reduce. Map shuffle. Map Shuffle. : http://datacentric.ru/#blog, :

.

MapReduce. Reduce. Reduce. , shuffle, reduce(). reduce . , reduce(), MapReduce-., Reduce , .

Reduce :

MapReduce. Reduce. Reduce :

BigData MapReduce , Data Scientist . MR , IT .

bigdata - : http://www.slideshare.net/Data-Centric_Alliance/big-data-is-the-new-oil

BigData:http://www.slideshare.net/Data-Centric_Alliance/ss-55342365

MapReduce. MR . Big Data MapReduce Hadoop Apache.

, MapReduce Hadoop . . Hadoop, : http://habrahabr.ru/company/dca/blog/268277/

big data NoSQL .

NoSQL(not only SQL, SQL), , , , , SQL. NoSQL ACID BASE: (basic availability)- ( ). (soft state)- , , . (eventual consistency)- , .

noSQL 1. .2. .3. .4. ( ).5. : SQL .6. 7. : .

noSQL -

-

-1. - - : major keys minor keys;- .

2. : Smith/John/-/phonenumber/home- major key: 1 (Smith/John) - ();- minor key: 0 (phonenumber/home) , major key .

3. : 555 5555- , ;- , , .

-{Smith/Bob/-/phonenumber/home: 555 5555}{Smith/Bob/-/phonenumber/mobile: 333 3333}

Smith Bob phonenumber home: 555 5555 mobile: 333 3333Major keyMinor keyValue ()

, . -, , , .

(-) ( ) , () .1. Column () - (key-value).2. Column Family ( ) - , , , , .3. Keyspace ( ) - .4. SuperColumn () - , .

users:{ "1": { "firstName": "John", "lastName": "Smith", "phoneNumbers": { "home": "555 5555", "mobile": "333 3333"} }, "2": }

Get ({firstName, lastName}, "1)

- XML ., (). (). . , , () . -, . () .

JSON (JavaScript Object Notation).

- . JSON. JSON :- :, {}. , :. - .()- . []. . ,,,, :true, falsenull. - , . , \.

JSONXML

NoSQL