EMC Data Domain for Archiving Are You Kidding?...May 31 10.6 TB 19x 554 GB June 30 15.4 TB 21x 706 GB TOTAL 15.4 TB 21x 706 GB April 7 2.2 TB 8x 288 GB Week 2 Week 3 Month 1 Month

1

EMC Data Domain for Archiving – Are You Kidding?

Bill Roth / Bob Spurzem EMC

EMC

SYMANTEC VISION 2012

Agenda

• EMC Introduction

• Data Domain Enterprise Vault Integration

• Data Domain NetBackup Integration

• Q & A

2 EMC


EMC Introduction

3 EMC


Data Domain:

Leadership and Innovation A history of industry firsts

First deduplication NAS

First deduplication volume replication

Largest deduplication

array

First deduplication directory replication

First deduplication virtual tape library

First deduplication nearline storage

Fastest backup controller

Cascaded replication

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012

First distributed processing

First long-term retention

system for backup and

archive

First inline deduplication for

compliant archiving


Deduplication Dramatically Reduces Storage Capacity Requirements

Deduplication 10–30 times less data stored versus fulls + incrementals with typical retention policies

0

10

20

30

1 5 10 15 20

Weeks in Use

Dat

a St

ore

d

Deduplication storage

Traditional storage


Backup Data Reduction/Deduplication Time series of large enterprise implementation

48%

46%

40%

27%

24%

15%

7%

6%

4%

8%

12%

15%

16%

14%

14%

15%

16%

14%

7%

17%

22%

25%

28%

31%

10% 13%

18%

20%

26%

21%

25%

1H '11

1H '10

2H '09

1H '09

2H '08

2H '07

In Use Now In Pilot/Evaluation In Near-term Plan In Long-term Plan Past Long-term Plan Not in Plan

Over three years, in-use rates for backup with deduplication have risen from 15% to 48%

Source: Wave 15 Storage Study – Q2 2011, published 5/16/11, large-enterprise sample; H ‘07, n=151; 2H ‘08, n=127; 1H ‘09, n=147; 2H ‘09, n=182; 1H ‘10, n=146; 1H ‘11, n=31;TheInfoPro (www.theinfopro.com)

http://www.theinfopro.com/


Data Domain Basics Easy integration with existing environment

Replication

CIFS, NFS, NDMP

Ethernet

Virtual Tape Library (VTL) over

Fibre Channel

DD890 appliance

Control Tier

Target Tier Disaster Recovery Tier

DD890 appliance

Backup and Archive Applications

EMC

Symantec

CommVault

IBM

HP

Veeam

Quest


Second Friday Full Backup

B C D E F L G H

Data Deduplication: Technology Overview Store more backups in a smaller footprint

A B C D E F G H I J

Friday Full Backup

A B C D A E F G

Mon Incremental A B H

Tues Incremental C B I

Thurs Incremental A C K

Weds Incremental E G J

Backup Estimated

Data Logical Reduction Physical

Monday Incremental 50 GB 7–10x 5 GB

Tuesday Incremental 50 GB 7–10x 5 GB

K L

Wednesday Incremental 50 GB 7–10x 5 GB

Thursday Incremental 50 GB 7–10x 5 GB

Second FRIDAY FULL 1 TB 50–60x 18 GB

TOTAL 2.2 TB 7.6x 288 GB

FRIDAY FULL 1 TB 2–4x 250 GB


Retain: Store More for Longer with Less Over one year of retention in 3U of Data Domain deduplication storage

Week 1

Backup Cumulative Estimated Physical

Data Logical Reduction

April 14 3.4 TB 10x 326 GB

April 21 4.6 TB 13x 364 GB

April 28 5.8 TB 14x 402 GB

May 31 10.6 TB 19x 554 GB

June 30 15.4 TB 21x 706 GB

TOTAL 15.4 TB 21x 706 GB

April 7 2.2 TB 8x 288 GB

Week 2

Week 3

Month 1

Month 2

Month 3

First Full 1 TB 4x 250 GB


Data Integrity: Data Invulnerability Architecture

Other RAID 6 NVRAM Snapshots

End-to-end data verification Checksum Deduplication, write to disk Verify

Self-healing file system Cleaning Expired data Defrag Verify

Deduplication

Local Compression

RAID

File System

Generate Checksum

Verify Data

Verify the file system metadata integrity

Verify user data integrity

Verify stripe integrity

End-to-end data verification


Data Domain Infrastructure and Ecosystem Supports a variety of workloads and data types

VMware Microsoft Exchange Microsoft SharePoint Oracle, SAP Other

Application Servers Midrange and Mainframe

EMC DLm1000

Application Storage

NAS, SAN, DAS

Symantec NetBackup Symantec Backup Exec

Backup Applications

Symantec Enterprise Vault

Archive Applications

Primary storage

Network

Disaster Recovery

Replication over WAN

IBM i


EMC Data Domain Enterprise Vault Integration

12 Presentation Identifier Goes Here


• Support for E-Mail, SharePoint, and File-System Archiving (FSA)

• EV 8 Introduced new “Data Domain” storage type

– Makes EV8 aware that the DDR appliance provides compression, deduplication, & retention-lock features (as of SP3)

• Supports EV Collections

– Recommended w/DD to reduce total file count

– New “collection-focused” integration guide published

• DD qualified on Symantec EV Support matrix

– For both EV8 & EV9, EV10 pending

• Archive data from Symantec Enterprise Vault can be co-located next to backup data on the same Data Domain platforms

Symantec Enterprise Vault Solution Highlights


• Direct write of EV savesets to DD share

– many small files written ( < 100K typical for email archiving, CIFS)

– one email may produce several small files

– DD may not be able to support total # files, or ingest rate

• Collections

– Savesets are written to DD share, then collected at a later date

– same performance issues as direct write + incur a re-read of all the data

Collections w/Migration (recommended)

– this is a multistep process – with DD being the “secondary storage”

– collects these small savesets into .cab files (10MB)

– moves collections to DD according to schedule

– Cannot be used with Retention Lock

Symantec Enterprise Vault Recommended method of writing data to DD


Enterprise Vault with Collections/Migration

Exchange Server

Primary storage: Collection process: • “collects” EV savesets into 10MB

.cab files on TEMP storage • deletes original savesets

SQL server

File Server

LAN

Directory Vault Store Group Vault Store Audit Monitoring Reporting

Secondary Storage: DD CIFS Share Migration Process: • .cab files moved to DD

according to migration schedule

EV server


Symantec Enterprise Vault Integration Details –Setup Temp Storage for Vault Store Partition


Symantec Enterprise Vault Integration Details – Select device settings and choose collection software


Symantec Enterprise Vault Integration Details – Set collection schedule and size, Select “Migrate”


Symantec Enterprise Vault Integration Details – Select Migration software and Schedule


Symantec Enterprise Vault Integration Details – Point to DD CIFS share, ENABLE “Migrate all Files”


EMC Data Domain NetBackup Integration



EMC Data Domain Integration

• Distributed Segment Processing

– Executes On Backup Servers & Data Domain systems

– Segments Incoming Backup Streams

– Fingerprints Segments

– Identifies Unique Segments

– Unique Segments Are Compressed

– Compressed Segments Are Written To The Data Domain System

• Advanced Load Balancing & Failover

– Interface Group Feature

• Optimized Duplication

– Low Bandwidth Managed File Replication Feature

– Encrypted Managed File Replication Feature



Distributed Segment Processing


Fingerprint

NetBackup Media Server

A B C D E B D Segment

Unique?

Compress

A B C E D

Data Domain System

Write


Optimized Duplication

• Managed File Replication: Low Bandwidth Replication

– The low-bandwidth Replicator option reduces the WAN bandwidth utilization

– This option is useful if optimized duplication is being performed over a low-bandwidth network (WAN) link

– This option provides additional compression during data transfer and is recommended only for optimized duplication jobs that occur over WAN links that have fewer than 6 Mb/s of available bandwidth



Advanced Load Balancing & Failover


NetBackup

Media

Server


Streams Load Balanced Across Network Links In Interface Group

All Backup Servers Connect To The Same Registered Interface

Transparent Link Failover For Network Failures

NetBackup

Media

Server

NetBackup

Media

Server



Presentation Identifier Goes Here

NIC NIC

NetBackup Media Servers

Failed Link Will

Not Be Used

For New Jobs

Active Job

Transparent

Failover To An

Operational Link

NIC NIC

NetBackup Media Servers

Operational

Link Used For

An Active Job


Data Domain VTL

• Support for up to 64 concurrently active VTLs per Data Domain system

• Support for 1 to 256 tape drives per Data Domain system depending on the model number

• Up to 32000 slots per VTL

• Up to 64000 slots per Data Domain system

• Up to 100 CAPs (Cartridge Access Ports) per VTL

• Up to 2000 CAPs per Data Domain system


Thank you!

Copyright © 2012 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.

Presentation Identifier Goes Here 28

EMC Data Domain for Archiving Are You Kidding?...May 31 10.6 TB 19x 554 GB June 30 15.4 TB 21x 706 GB TOTAL 15.4 TB 21x 706 GB April 7 2.2 TB 8x 288 GB Week 2 Week 3 Month 1 Month

Documents