May 26, 2010Stockage mutualisé HDB – TDB The world of the Database.

May 26, 2010 Stockage mutualisé

HDB – TDB

The world of the Database

• Plan :– HDB size– TDB size– Infrastucture & security strategy

May 26, 2010 TANGO MEETING

HDB size

• 8835 attributs are in archiving

• 250 inserts per second

Period Quantity

> 1 hour 962

30 minutes 137

16 minutes 187

15 minutes 1208

10 minutes 452

8 minutes 1

6 minutes 1

5 minutes 12

3 minutes 50

1 minute 3650

30 secondes 463

10 secondes 1712

May 26, 2010 TANGO MEETING

evolution

May 26, 2010 TANGO MEETING

• Grows 40G per month

HDB size

• Database size 1.1 To (1.7 To used)

May 26, 2010 TANGO MEETING

TDB size

• 6512 attributs are in archiving

• Should have 6400 inserts per second, but we use temporary files.

Period Quantity

> 1 hour 254

15 minutes 203

10 minutes 545

1 minute 333

30 secondes 1

10 secondes 317

5 secondes 5

4 secondes 197

2 secondes 645

1 seconde 2116

500 ms 1886

100 ms 10

May 26, 2010 TANGO MEETING

TDB size

• TDB database : – Grows 21G per day– 31 days kept online– 78 000 files inserted per day (~3 sec

for a file containing 70000 rows).

May 26, 2010 TANGO MEETING

Architecture

• Before :

May 26, 2010 TANGO MEETING

HDBTDB

TemporaryDataBase

HdbArchiversTdbArchivers

HistoricalDataBase

May 26, 2010 TANGO MEETING

EMC disk array

Futur NAS EMC CelerraSecours

Réseau RCM

NAS EMC CelerraPrimaire

Réseaux RES & REEMC Clariion

Contrôleurs de disque

FC et SATA

EMC ClariionTiroirs de

disques SATA

EMC ClariionTiroirs de

disques FC

Switchs EMC FC

RGI1 room

NAS EMC CelerraPrimaire

Réseau RCM

NAS EMC CelerraSecondaire

Réseaux RES & REEMC Clariion

Contrôleurs de disque

FC et SATA

EMC ClariionTiroirs de

disques SATA

EMC ClariionTiroirs de

disques FC

Switchs EMC FC

RGI2 room

Racks EMCRacks EMCClariion CX4-240 + 1 x NAS Celerra NS42GClariion CX4-240 + 1 x NAS Celerra NS42G

+ 2 x switchs FC+ 2 x switchs FC

Racks EMCRacks EMCClariion CX4-240 + 2 x NAS Celerra NS42GClariion CX4-240 + 2 x NAS Celerra NS42G

+ 2 x switchs FC+ 2 x switchs FC

SAN FC & NAS SATA

Disk Array

• New storage configuration :– SAN (Fiber Channel 400Go disks)

• HDB : 3 To RAID5 (11 disks)• TDB : 1,5 To RAID10 (10 disks)• TEST : 1 To RAID4 (5 disks)

– NAS (SATA 1To disks)

• BACKUP : 3 To RAID6 (~ 8 disks)

– NAS (Fiber Channel 400Go disks)

• TDB_files : 1 To RAID5 (~ 6 disks)

May 26, 2010 TANGO MEETING

Cluster OracleCluster Oracle

Actual Architecture

• Now :

May 26, 2010 TANGO MEETING

Futur NAS EMC CelerraSecours

Réseau RCM

NAS EMC CelerraPrimaire

Réseaux RES & REEMC Clariion

Contrôleurs de disque

FC et SATA

EMC ClariionTiroirs de

disques SATA

EMC ClariionTiroirs de

disques FC

Switchs EMC FC

NAS EMC CelerraPrimaire

Réseau RCM

NAS EMC CelerraSecondaire

Réseaux RES & REEMC Clariion

Contrôleurs de disque

FC et SATA

EMC ClariionTiroirs de

disques SATA

EMC ClariionTiroirs de

disques FC

Switchs EMC FC

NAS

TEST (1To) TDB_files (1To) BACKUP (3To)HDB (3To)TDB (1.5To)

SAN

RCM networkRCM network

HdbArchivers TdbArchivers Degrad server

ADT-APT-AMT

HDB Backup strategy

• Logical Backup :– Every 4 hours : synchronisation between HDB and

degrad databases (configuration tables)– Every day : Export (Dumpfile) of configuration

tables (ADT,APT,AMT)

• Physical Backup :– RMAN (Recovery Manager)

• Every day, Bkp RW, 15 Go (40 minutes)• every 2 months, Bkp full, 300 Go (5 hours)

– Copy Backup• Ponctually, copy the backup to another media

(band)

– Test backup• Ponctually, I restore the backup on test server. (3/4

times per year)

May 26, 2010 TANGO MEETING

Question ?

May 26, 2010 TANGO MEETING