Top Banner
Big Data from Space Le Big Data et les satellites d’Observation de la Terre Jérôme GASPERI CUSI - Toulouse, France - 12 novembre 2015
57

2015.11.12 big data from space - cusi toulouse

Jan 21, 2018

Download

Technology

Gasperi Jerome
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 2015.11.12   big data from space - cusi toulouse

Big Data from SpaceLe Big Data et les satellites d’Observation de la Terre

Jérôme GASPERI CUSI - Toulouse, France - 12 novembre 2015

Page 2: 2015.11.12   big data from space - cusi toulouse

Partie IQ u ’ e s t c e q u e l e B i g D a t a

Page 3: 2015.11.12   big data from space - cusi toulouse

BIGD A T A

Page 4: 2015.11.12   big data from space - cusi toulouse

Volume Variété Vitesse

€Valeur

Page 5: 2015.11.12   big data from space - cusi toulouse

Volume

Page 6: 2015.11.12   big data from space - cusi toulouse

L’ère du pétaoctet

Page 7: 2015.11.12   big data from space - cusi toulouse

1 PETAOCTET

13.3 ANNEES DE VIDEO HD

1.5 PETAOCTET

TAILLE DES 10 MILLIARDS DE PHOTOS SUR FACEBOOK

20 PETAOCTETS

LA PRODUCTION MONDIALE DE DISQUES DURS EN 1995

50 PETAOCTETS

L’INTEGRALITE DE TOUTE LA PRODUCTION ECRITE DE L’HUMANITE DEPUIS L’INVENTION DE L’ECRITURE DANS TOUTES LES LANGUES

Page 8: 2015.11.12   big data from space - cusi toulouse

1 p

etao

ctet

= 2

00 0

00 D

VD

s

Page 9: 2015.11.12   big data from space - cusi toulouse

Variété Vitesse

Page 10: 2015.11.12   big data from space - cusi toulouse
Page 11: 2015.11.12   big data from space - cusi toulouse

€Valeur

Page 12: 2015.11.12   big data from space - cusi toulouse

Brett Ryder - http://www.economist.com/node/15579717

Extraire l’information

Page 13: 2015.11.12   big data from space - cusi toulouse

http://fivethirtyeight.com/datalab/this-algorithm-knows-you-better-than-your-facebook-friends-do/

Page 14: 2015.11.12   big data from space - cusi toulouse

Deep learning

Page 15: 2015.11.12   big data from space - cusi toulouse

http://techcrunch.com/2014/08/15/google-buys-jetpac-to-give-context-to-visual-searches/

Deep learning+ =

Page 16: 2015.11.12   big data from space - cusi toulouse

Big Data...Big Problem ?

Page 17: 2015.11.12   big data from space - cusi toulouse
Page 18: 2015.11.12   big data from space - cusi toulouse

1 m i l l i a rd d e m i l l i a rd d ’ o p é r a t i o n s p a r s e c o n d e e n 2 0 2 4

1,000,000,000,000,000,000

Page 19: 2015.11.12   big data from space - cusi toulouse

vs

~ 30W ~ 30MW1x 3x

Page 20: 2015.11.12   big data from space - cusi toulouse

36 37 36

Your Online World: Green IRL, or #dirty?

While the companies assessed in this report own

or operate their own data centers, most companies

either rent server space in colocation facilities, host

their operations with cloud computing vendors and

content delivery networks, and many employ some

combination of these options.

Outside of the colocation companies, no company could

do more to make our favorite sites green than Amazon Web Services. AWS is the dominant player in cloud computing, owning over one fourth of the market by one

estimate, over triple the market share of Microsoft, its

nearest competitor.105 AWS customers should push the company to become more transparent about its energy

footprint, and to make clear what strategies and principles

it is using to reach its 100% renewable energy goal,

particularly in its dirtiest regions, like Virginia.

While these customers may not operate the mega data

centers that Google, Amazon and Microsoft do, their role in building a greener internet is just as important.

Data center operators and cloud computing vendors will

prioritize powering with renewable energy only when their

customers demand it, and those customers need to step

up to the challenge.

The graphic on this page offers a sampling of where some

of the internet’s most popular sites and services are being

hosted – and the relative greenness of the energy that

those data centers are using. Energy demand symbols

are not drawn to scale and are meant to offer a relative

indication.

AmazonWeb

Services

DigitalRealty

DupontFabros

Ebay

Google

FacebookOracle

HP

Yahoo

IBM

Microsoft

Apple

Salesforce

Rackspace

Equinix

Telecity

http://www.greenpeace.org/usa/clickclean/#report

2014

Page 21: 2015.11.12   big data from space - cusi toulouse

Partie IIB i g D a t a f ro m s p a c e

Page 22: 2015.11.12   big data from space - cusi toulouse

Doter l'Europe d'une capacité opérationnelle et autonome d'observation de la Terre en tant que « services d’intérêt général européen, à accès libre, plein et entier »

Le programme Copernicus

Page 23: 2015.11.12   big data from space - cusi toulouse

Land monitoring

Page 24: 2015.11.12   big data from space - cusi toulouse

Marine monitoring

Page 25: 2015.11.12   big data from space - cusi toulouse

Atmosphere monitoring

Page 26: 2015.11.12   big data from space - cusi toulouse

Security

Page 27: 2015.11.12   big data from space - cusi toulouse

Emergency

Page 28: 2015.11.12   big data from space - cusi toulouse

Climate Change

Page 29: 2015.11.12   big data from space - cusi toulouse

Sentinel-1RADAR

S1A - April 2014 S1B mid 2016

Sentinel-2OPTICAL

S2A - June 2015 S2B mid 2016

Sentinel-3ALTIMETER / SEA SURFACE

S3A - Summer 2015 S3B mid 2016

Sentinel-4ATMOSPHERE

2018

Sentinel-5PATMOSPHERE

End 2015Sentinel-5ATMOSPHERE

2020

Sentinel-6?

SentinelLe volet spatial du programme

Copernicus

Page 30: 2015.11.12   big data from space - cusi toulouse

Sentinel 1Radar en bande C

Orbite Héliosynchrone Altitude 693 km

Page 31: 2015.11.12   big data from space - cusi toulouse

Optique Orbite Héliosynchrone Altitude 786 km

Sentinel 2

Page 32: 2015.11.12   big data from space - cusi toulouse
Page 33: 2015.11.12   big data from space - cusi toulouse

Des millions d’images ?

Page 34: 2015.11.12   big data from space - cusi toulouse

ex. Dans le cadre d’une étude d’impact sur l’augmentation du niveau des océans, je cherche des images sans nuage de villes côtières situées en Asie

Page 35: 2015.11.12   big data from space - cusi toulouse

Sven Sachsalber | http://www.palaisdetokyo.com/fr/events/sven-sachsalber

Page 36: 2015.11.12   big data from space - cusi toulouse

Sven Sachsalber | http://www.palaisdetokyo.com/fr/events/sven-sachsalber

17 hours 45 minutes

Page 37: 2015.11.12   big data from space - cusi toulouse

Métadonnées

Page 38: 2015.11.12   big data from space - cusi toulouse

Quand Où Comment

Page 39: 2015.11.12   big data from space - cusi toulouse

Contenu de l’image ?

Quoi

Page 40: 2015.11.12   big data from space - cusi toulouse

Du pixel...Image satellitaire

...à l’informationCarte d’occupation du sol

Cultures

Bâtiment Forêt

Page 41: 2015.11.12   big data from space - cusi toulouse

Emprise de l’image

Bords de côtes

Toponymes(Continents, Pays, Régions, Etats)

Densité de population

Occupation du sol

…etc…

Couches d’informations

[…etc…] { "name":"Europe", "id":"continent:europe",

"countries":[ {

"name":"Italy", "id":"country:italy", "pcover":37.02,

"regions":[ {

"name":"Valle d'Aosta", "id":"region:valle-d-aosta",

"states":[ {

"name":"Aoste", "id":"state:aoste",

"pcover":37.02, "toponyms":[] } ] } ] }, […etc…]

github.com/jjrom/itag

iTag

Page 42: 2015.11.12   big data from space - cusi toulouse

Métadonnées « améliorées »

Métadonnées « traditionnelles »

Page 43: 2015.11.12   big data from space - cusi toulouse

Recherche « sémantique »

github.com/jjrom/restoresto

Page 44: 2015.11.12   big data from space - cusi toulouse

California

Coastal

town

spring

without clouds

github.com/jjrom/restoresto

Page 46: 2015.11.12   big data from space - cusi toulouse

20177 PO

Volume stocké au CNES Toulouse fin 2017

DV

Ds

Page 48: 2015.11.12   big data from space - cusi toulouse

https://peps.cnes.fr

Page 49: 2015.11.12   big data from space - cusi toulouse

Applicationshttps://www.theia-land.fr

Page 50: 2015.11.12   big data from space - cusi toulouse

AgricultureSuivi des cultures, sécurité alimentaire, variables biophysiques, etc.

Page 51: 2015.11.12   big data from space - cusi toulouse

BiomasseSuivi de la déforestation, estimation des puits de carbone, etc.

Page 52: 2015.11.12   big data from space - cusi toulouse

LittoralSuivi et quantification des évolutions

Page 53: 2015.11.12   big data from space - cusi toulouse

Surface enneigéeEvolutions du niveau des mers, réserves en eau, risques d’avalanches, etc.

Page 54: 2015.11.12   big data from space - cusi toulouse

Risques naturelsPrévention, réponse, post événement

Page 55: 2015.11.12   big data from space - cusi toulouse

SantéCartographie des risques de maladies infectieuses

Page 56: 2015.11.12   big data from space - cusi toulouse

etc.

Page 57: 2015.11.12   big data from space - cusi toulouse