Next Generation of Data Recovery with TSM 6 Shawn Jaques, Manager, Tivoli Storage Product Management © 2009 IBM Corporation
Next Generation of Data Recovery with TSM 6Shawn Jaques, Manager, Tivoli Storage Product Management
© 2009 IBM Corporation
1
Abstract
Tivoli Storage Manager 6 delivers new levels of Scalability, Tiered Recovery, Data Reduction, Windows Recovery, and Server Virtualization support. Add to this Tivoli Storage Manager’s improved time to value and you will see that Tivoli Storage Manager is delivering a new generation of data recovery. This session is a TSM 6 update, going over all the value, solutions and features
2
Agenda
• Leading the way in Storage and Data Management
• Tivoli Storage Manager 6– Improved Scalability, Availability and Performance
– Built in Data Deduplication
– Simplified Management and Deployment
– Improved integration with VMware and NetApp / N series NAS Filers
– Other enhancements
• Conclusion
3
Data Protection and Retention Dynamics
New Data GrowthNew Data Growth
Longer
Retention Periods
Longer
Retention Periods
Cost of DiskCost of Disk
Data Reduction
Technologies
Data Reduction
Technologies
4
Managing Data Through the Lifecycle
Time
Value
Dynamic Data
Persistent Data
Lifecycle of different data types
Protect Delete or ArchiveMove
Protect• Match technology to recovery
objectives and cost
• Consider data in Data Centers, ROBOs, laptops
� TSM cost effectively helps protect
data and manage recovery
across the full environment
Protect• Match technology to recovery
objectives and cost
• Consider data in Data Centers, ROBOs, laptops
� TSM cost effectively helps protect
data and manage recovery
across the full environment
Move• Move data through storage
hierarchy based on policy
• Keep high end disk for high priority applications
� TSM automatically moves
data based on policy to cost
effective tiers
Move• Move data through storage
hierarchy based on policy
• Keep high end disk for high priority applications
� TSM automatically moves
data based on policy to cost
effective tiers
Delete or Archive• Delete unneeded data freeing
capacity
• Archive selected records based on retention policy
� TSM can manage retention of
records to help meet business
and regulatory requirements.
Delete or Archive• Delete unneeded data freeing
capacity
• Archive selected records based on retention policy
� TSM can manage retention of
records to help meet business
and regulatory requirements.
5
Leading the Way in Data Protection and Recovery
Tivoli Storage Manager has been a leader in helping organizations protect, retain and assure availability of their most important asset, their data, for more than 15 years.
Comprehensive Solution
• Backup / Restore
• Archive / Retrieve
• Continuous Data Protection (CDP)
• Disaster Recovery
• HSM / ILM
• Application Protection
• Database Protection
• Bare Machine Recovery
• Robust Remote Office Recovery
• Innovation:
• 1st disk-based backup solution
• optimized over 15 years
• The original data reduction - Progressive Incremental
• Market:
• More than 20,000 loyal customers
• 60% of fortune 500
• Above market growth three consecutive years*
• Unified recovery across:
• The broadest range of OS and HW platforms: from laptop to mainframe
• All storage tiers
* Source: IDC, Jan. 2009 (TBD)
6
Continuing to Lead the Way
Tivoli Storage Manager 6 is designed to address our customers’ most challenging issue: the continuing tidal wave of data growth.
Net Result = Unified Recovery Management
Improved Quality of Service
NewNew Simplified deployment and management
NewNew Improved scalability, availability and performance
NewNew Improved integration with VMware, NetApp and Microsoft
Storage Manager 6
NewNew Built-in Data Deduplication
7
History: Why is TSM’s Internal DB Important?
• From inception Tivoli Storage Manager has managed data with an internal database.– Allows for rapid modification to policies to reflect changes in
regulations or business rules.Example: New requirement that data be retained for 5 years instead of 7.
– Easy policy change in TSM can be applied FORWARD AND BACKWARD
– Helps you easily manage unanticipated changes
• However, there were some costs – More difficult to get reports
– Required some downtime to do periodic database administration
8
What’s New: Integrated DB2 Database
• “Under the covers” in TSM 6– No DB2 admin skills required
• Enables next-generation management, scalability, availability and performance
• Rock solid reliability; industry’s best security, scalability and performance
• DB2 customers include:– 59 of the top 59 banks in the world
– 9 of the top 10 global life & health insurance companies
– 23 of the top 25 U.S. retailers
Powered by
Storage Manager 6
Deployment & ManagementScalability, Availability & Performance
9
• Exploitation of autonomic computing concepts
– A self-tuning database buffer pool
– Online database reorganization enables changes and tuning of thedatabase while the system remains operational
Customer Benefits of DB2 inside:
• More reliable backup and recovery
– Run-time data validity checks
– Errors are immediately detected and corrected
• Improved Availability
– The Tivoli Storage Manager 6 server does not need to be taken "offline" for database repair actions
10
• Can manage twice* as many objects as compared to powerful TSM 5.5– Can double the internal database size (from 512GB to 1TB, minimum)
– Can support 1 billion objects* with a single TSM server
– TSM is ready for the wave of remote office data (from TSM FastBack)
• Run an increased number of concurrent operations*
– 9x increase in the size of the internal Recovery Log enables running more backup jobs from a greater number of clients, and/or an increase in the size of existing backup jobs
– Faster backups = shorter required backup windows
Scalability!
TSM 6 can effectively help
meet the challenges of the
‘tidal wave of data’
Storage Manager 6
* Results will vary depending on user’s environment, systems/processors, type of data, expiration
policies, data change rates, etc.
11
• Can significantly improve backup and restore throughput– Reduces backup windows and/or increases the workload being managed– Reduces recovery times– 400% improvement in backup performance demonstrated in the lab (under optimal
conditions)
• Helps Improve Recovery Point Objectives for DR planning– Addition of Active Data Pools to Disaster Recovery Manager (DRM) in Tivoli
Storage Manager 6 Extended Edition
– Track, manage and recycle active-data pools as required by policies
• Enables faster expiration processing than prior TSM releases– New granular expiration process and parallel process execution
– Fine-tune expiration policies by specific client nodes, node groups, or nodes
belonging to a specified domain
– Over 50% improvement* in expiration processing demonstrated in the lab
Performance!
* Results will vary depending on user’s environment, systems/processors, type of data, expiration
policies, data change rates, etc.
12
Agenda
• Leading the way in Storage and Data Management
• Tivoli Storage Manager 6– Enhanced Scalability, Availability and Performance
– Built in Data Deduplication– Simplified Deployment and Management
– Improved integration with VMware and NetApp / N series NAS Filers
– Other enhancements
• Conclusion
13
How Much Can You Save?
0
500
1000
1500
2000
2500
Mon Tue Wed Thu Fri Wkend Mon Tue Wed Thu Fri WkEnd
Week 1 Week 2
Capacity Requirements Comparison
Vendor A: Full+Differential Vendor B: Full+Incremental TSM Progressive Incremental
Backup Capacity Needed for 1 Month:
Vendor A: 26TB
Vendor B: 14TB
IBM TSM: 7TB
Assumes: Full backup completed, 2TB data to start, 26% annual growth rate, 10% new/changed data per day
Gig
abyte
sData Reduction: Progressive Incremental Backup
14
• Tivoli Storage Manager 6 Extended Edition includes data de-duplication for disk storage pools, at no extra charge
• Improves recovery times as many more recovery points can be stored on disk; or reduces the amount of capacity needed
• Operates as a post-process / no impact on backup performance / automatic space reclamation
NewNew Built-in Data De-Duplication
Next Step in Data Reduction…
Tivoli Storage Manager 6, combining progressive incremental data capture with data deduplication, can do a better job of reducingstorage capacity requirements than pure data deduplication solutions
15
• Increase* the amount of data available for recovery from disk (compared to TSM 5.5)
– Adds to the benefits of progressive incremental data capture and data compression technologies
• Effective with data from any source,
– including: API, backup, HSM, archive
• Built into Tivoli Storage Manager 6
– At no additional charge
• Post-process does not impact backup operations
* Results will vary depending on user’s environment, systems/processors, type of data, expiration policies, data change rates, etc.
Customer Benefits of Data De-Duplication
16
When Do I Use ProtecTIER vs TSM 6 Built-in Deduplication?
Complementary Solutions Today!Can be used together but don’t deduplicate the same data twice
Both Solutions Offer the Benefits of Target side Deduplication:• Greatly reduced storage capacity requirements • Lower operational costs, energy usage and TCO• Faster recoveries with more data on disk
Use ProtecTIER When:• Highest performance and capacity scaling are required!
• Up to 500 MB/sec (1GB/s with 2 node) deduplication rates are needed
• Deduplicated capacities up to 25 PB are required• You desire deduplication be done inline during data ingest• A VTL appliance model is desired• Deduplicating across multiple TSM (or other backup) servers
Use TSM 6 Built-in Deduplication When:• Sufficient TSM server resources can be made available and you desire
deduplication operations be completely integrated within TSM• The benefits of deduplication are desired without separate hardware or software
dependencies or licenses (ships with TSM Extended Edition)• You desire end to end data lifecycle management with minimized data store
TSM
IBM ProtecTIER
17
Agenda
• Leading the way in Storage and Data Management
• Tivoli Storage Manager 6– Improved Scalability, Availability and Performance
– Built in Data Deduplication
– Simplified Management and Deployment– Improved integration with VMware and NetApp / N series NAS
Filers
– Other enhancements
• Conclusion
18
Simplified Management: Reporting and Monitoring
Powered byPowered by
• Customizable reporting and near real-time monitoring – Wide range of pre-configured ‘out-of-the-box’ reports; reports are fully-
customizable – Near real-time monitoring via a customizable dashboard– Integrates with Tivoli Monitoring data to enable end-to-end performance analytics– Included at no additional charge
19
Redesigned Reporting and Monitoring
Client backup Activity
Server Activity
Client Restore Activity
Help project my future storage requirements
Customizable ReportsCustomizable Reports
Included in TSM – no additional licensingIncluded in TSM – no additional licensing
Customizable dashboardCustomizable dashboard
Storage Manager 6
Deployment & Management
20
Near Real Time Monitoring
Customizable end-user "dashboard“
Delivers graphical representation and monitoring of
trends and current status
� Scheduled Client Activity
� Scheduled Server Activity
� Client Current Activity
� Server Current Activity
� Current Errors
� TSM Database Status
� Tape Device Status
� Storage Pool Status
� Client Backup Status
Server Operation byte count
– DB Backup
– Expiration
– Migration
– Reclamation
Server Operation duration
– DB Backup
– Expiration
– Migration
– Reclamation
Storage Manager 6
Deployment & Management
21
‘Out of the Box’ Historical Reporting - Server
Server ReportsServer Reports
� Server Job status
� Server Throughput
� Server Resource Usage
� Database Details
� Disk & File Usage
� Tape Usage
� Other Storage Usage
� Tape Volume Usage Analysis
� Tape Capacity Analysis
� Tape Device Errors
� Device Usage History
� Server Machine Utilization
Storage Manager 6
Deployment & Management
22
‘Out of the Box’ Historical Reporting - Client
Client ReportsClient Reports
� Client Job status
� Client Backup Currency
� Storage Capacity Projection
� Backup Details
� Top 10 Backups
� Backup Missed files
� Backup History
� Restore Details
� Top 10 Restores
� Restore History
� Archive details
� Top 10 Archives
� Archive History
� Retrieve Details
� Top 10 Retrieves
� Retrieve History
Storage Manager 6
Deployment & Management
23
Leveraging Proven IBM Components
• IBM Tivoli Monitoring • IBM Tivoli Enterprise Portal
• IBM Tivoli Enterprise Management Server• Tivoli Data Warehouse
• IBM DB2 • Stores historical data
obtained from TSM servers that are monitored using IBM Tivoli Monitoring.
• TSM monitoring agent• Queries and formats data
to be presented reports and monitors
• Tivoli Common Reporting– Uses Business Intelligence and
Reporting Tools (BIRT) to create custom reports
Storage Manager 6
Deployment & Management
24
Administration Center
New, lighter-weight version of Integrated
Solutions Console (ISC) infrastructure
• Improved Performance– Reduced time for initial page load and
page switches
– Enhanced processing of large queries– Progress indicators– Provides response time enhancements
• Easy UI navigation of backup sets, client nodes, and client node groups
• Easy configuration of server actions with a consolidated, central local location for managing server actions
• ISC is a key technology component for IBM's strategic management portal
Reduced Footprint by 30%Reduced Footprint by 30%
Faster Installation < 30 MinFaster Installation < 30 Min
Storage Manager 6
Deployment & Management
25
Ease of Upgrade to TSM6
• Prepare
– Install the V6 server
– Install the upgrade utilities on the original server
• Upgrade, using one of the following methods:
– Upgrade wizard
– Manually using utilities
• Restart the server once upgrade is complete
– Register licenses
– Verify the upgraded server
– Update automation
* The process is highly dependant on the system it runs on, in particular the disk subsystem.
Storage Manager 6
26
Agenda
• Leading the way in Storage and Data Management
• Tivoli Storage Manager 6– Improved Scalability, Availability and Performance
– Built in Data Deduplication
– Simplified Deployment and Management
– Improved integration with VMware and NetApp / N series NAS Filers
– Other enhancements
• Conclusion
27
Enhanced support for VMware
• Provides enhanced business continuity and disaster recovery
• New VM-friendly, virtualization pricing model
• Builds on TSM 5.5 support
NewNew Full image backup of Virtual Machines
- VCB support
- Single agent on proxy
server vs. agent on
every VM- Reduced load on ESX
server
- Faster recovery
- Eliminates LAN traffic
Storage Manager 6
RTO, RPO & Business Continuity
28
VMware Consolidated Backup Full Image Backup
‘Near Zero Impact Backup’ on
ESX Servers by using proxy
backup server
• Builds on TSM 5.5 Support– VCB support– Single agent on proxy server vs. agent
on every VM– Can reduce load on ESX server– Fast recovery
– Helps eliminate LAN traffic
Full image backup of virtual
machines for enhanced
business continuity and
disaster recovery Integrated approach that
significantly reduces impact of
backup on ESX Servers which
can allow it to run more virtual
machines
Image level virtual machine
backups are OS neutral
Storage Manager 6
RTO, RPO & Business Continuity
29
• Extremely fast incremental backup– IBM’s ‘First-to-Market’ integration with NetApp that
helps eliminate the need to scan the file system looking for changed files
– Enables fast and more frequent backups
Enhanced support for IBM nSeries and NetApp Filers
IBM System
Storage N6000
• Fast full image backup with new Network Data Management Protocol (NDMP) integration– SnapMirror to Tape integration enables
backup of large NetApp filesystems to secondary media for disaster recovery
Storage Manager 6
PerformanceRTO, RPO & Business Continuity
30
SnapMirror to Tape Support
Fast storage system image creation for IBM N series / NetApp
Disaster Recovery
• TSM integrates to issue the NDMP commands to move the SnapMirror image from the NetApp filer to a TSM server managed storage target for fast creation of a DR image
Storage Manager 6
PerformanceRTO, RPO & Business Continuity
Storage Manager 6
31
Enhanced Incremental Backup File Selection
Fast incremental Backup of
IBM N series / NetApp filers
• TSM BA client to use NetApp API to identify new, changed, deleted files
• Eliminates the traditional TSM incremental backup file scan
• Provides provide progressive incremental backup with file level recovery
Avoid time consuming scan of
filer to determine backup
candidates
File level recoverability
Storage Manager 6
PerformanceRTO, RPO & Business Continuity
TSM Client
Storage Manager 6
TSM Server
32
Agenda
• Leading the way in Storage and Data Management
• Tivoli Storage Manager 6– Improved Scalability, Availability and Performance
– Built in Data Deduplication
– Simplified Deployment and Management
– Improved integration with VMware and NetApp / N series NAS Filers
– Other enhancements• MS Exchange and Active Directory Item Level Recovery
• Advanced Copy Services
• IBM General Parallel File System and IBM XIV support
• DR Planner enhancements
• Conclusion
33
Item Level Recovery for Microsoft Exchange
Fast, easier way to recover
individual mail items:Entire inbox, deleted items, email drafts,
journal, calendar, notes, tasks, and user
folders
• TSM 6 supports restore of a user’s mailbox that may have been accidentally deleted as well as restoration of the mailbox as it existed at a previous point in time
Leverages the Microsoft
Exchange Recovery Storage
Group and standard Microsoft
interfaces
Microsoft Exchange
2003 and 2007 support
Storage Manager 6
PerformanceRTO, RPO & Business Continuity
TSM for Mail
34
• Individual object recovery from System State backups of user andgroup objects
– For Windows Server 2008 Active Directory environments.
– An example is the restoration of an individual or group that may have been deleted from the Active Directory
• Support for un-deletion (reanimation) of objects from the Active Directory's tombstone
Granular Support for Windows Active Directory
– Assists in manual recovery of individual objects
– Recovery and reanimation is accomplished without having to shut down or restart the Active Directory server
• Leverages standard Microsoft programming interfaces
• Fully integrated into the Client Restore Tree View
Storage Manager 6
RTO, RPO & Business Continuity
35
Advanced Replication TechnologiesSnapshot Exploitation Topology
Application
SystemApplication
Data
Local Snapshot Versions Backup System
Snapshot Creation
Policy-based snapshot
management
TSM Server
Disk
Copy Disk
On-site Tape
DVD/CD
Optical
Copied to
Offsite Tape
Other
Storage Hierarchy
Restore from
TSM Server
• Fast non-disruptive Backups
– Perform on-line backups of database applications at snapshot speed with virtually zero impact to the application.
– Transfer data to the TSM Server storage pools from a secondary machine.
• Super Fast Recovery
– Restore from local disk avoiding media mounts
– Restore through volume snapshot
• Integrated Management of Backups
– Support multiple persistent snapshots
– Integrate snapshot operations and legacy backup API operations
– Manage both through TSM server policy
TSM for Advanced Copy Services
TSM for Copy Services
NewNew IBM XIV storage system snapshot support
IBM XIV storage system snapshot support
Storage Manager 6
RTO, RPO & Business Continuity
36
• Tivoli CDP for Files: Continuous data protection for desktops & mobile users
• TSM FastBack: Block Level CDP protection for critical Windows servers
– Robust remote office data protection & replication
– Near-instant recovery of any data, anywhere
Data Center
Tivoli Storage Manager 6 is the core component of an integrated, end-to-end data protection and unified recovery
management solution
37
IBM Tivoli Storage Manager 6 can help clients:
+ Reduce infrastructure costs – servers, storage,
bandwidth
+ Reduce operational expenses
+ Improve application availability and reduce downtime
+ Reduce risk associated with data loss
+ Achieve regulatory and corporate compliance
+ Manage data throughout its lifecycle
= Future-proof data management processesStorage Manager 6
Tivoli Storage Manager 6 keeps IBM on the leading edge of
enterprise-class data protection and recovery management, staying
ahead of the ever-increasing growth in digital information, no matter
where it resides.
39
Trademarks and disclaimers
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries./ Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind.
The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.
Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.
Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Photographs shown may be engineering prototypes. Changes may be incorporated in production models.
© IBM Corporation 1994-2009. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.
Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.
40
Enhanced Disaster Recovery Manager support for active-data pools
Disaster Recovery Manager
can systematically rebuild the
TSM server environment
• Specify the names of active-data pools to be managed by disaster recovery manager
• Recycle on-site and off-site active-data pool volumes according to server policies and processes
• Include active-data pool volumes in the scripts, macros, and documentation that are part of the recovery plan file
• Track and manage active-data pool media as required by your operations
• DRM is included with TSM Extended Edition
Helps ensure that current
application data for the entire
enterprise, including active
data pools, is available for
recovery.
Storage Manager 6
PerformanceRTO, RPO & Business Continuity
41
Tivoli Storage Manager 6 for Advanced Copy ServicesEnhanced Oracle application snapshot support
• Enhanced Oracle application snapshot support when used in conjunction with:– IBM System Storage SAN Volume Controller (SVC)
– IBM System Storage DS6000
– IBM System Storage DS8000
– IBM N series Network Attached Storage (NAS), and NetApp Network Attached Storage
– IBM XIV Storage System
• Enhancements include: – Support for multiple snapshot versions
– Support for FlashCopy of a single mirror set in LVM mirrored environments
Storage Manager 6
RTO, RPO & Business Continuity
42
Tivoli Storage Manager 6 for Advanced Copy Services
• Supports FlashCopy restore onto a Peer to Peer Remote Copy (PPRC) source volume.
– PPRC is a continuous disk-based mirroring function typically used for environments requiring high availability disaster recovery
• Enhanced snapshot support for SAP environments
– Through integration with the Backint interface, integration of Tivoli Storage Manager snapshot functionality into conventional backup procedures in SAP is simplified
• Can improve backup performance via incremental FlashCopy support for the IBM SAN Volume Controller
– Can eliminate the need to perform a full background copy of the source data for each FlashCopy image that is created. After the initial FlashCopy image is created, only the changed blocks will be copied to the same set of target volumes improving backup performance
• Support for IBM XIV snapshots
Storage Manager 6
RTO, RPO & Business Continuity
43
• Support added for the IBM General Parallel File System (GPFS) for storage pool usage and LAN-free access
General Parallel File System Support
• Takes backup traffic off of the LAN and moved to a SAN environment, which helps to:
– Reduce backup windows
– Improve both RPO and RTO
– Reduce CPU utilization on the server
– Allow for more concurrent operations by spreading them across multiple storage agents
• TSM for Space Management integrates with GPFS to expedite identification of migration candidates without file scanning
GPFS Storage Pool
FILE Deviceclass
Storage Manager 6
RTO, RPO & Business Continuity
44
Enhanced Disaster Recovery Manager support for active-data pools
Disaster Recovery Manager
can systematically rebuild the
TSM server environment
• Specify the names of active-data pools to be managed by disaster recovery manager
• Recycle on-site and off-site active-data pool volumes according to server policies and processes
• Include active-data pool volumes in the scripts, macros, and documentation that are part of the recovery plan file
• Track and manage active-data pool media as required by your operations
• DRM is included with TSM Extended Edition
Helps ensure that current
application data for the entire
enterprise, including active
data pools, is available for
recovery.
Storage Manager 6
PerformanceRTO, RPO & Business Continuity