Storage Edition Storage Edition for for Oracle Oracle Storage Management Software Storage Management Software Suite Suite for Oracle Databases on HP Servers for Oracle Databases on HP Servers Melissa Stein Melissa Stein Product Management Product Management October 1999 October 1999
Storage Edition for Oracle Storage Management Software Suite for Oracle Databases on HP Servers Melissa Stein Product Management October 1999. Agenda. VERITAS Product Overview DBA’s Challenges VERITAS Storage Edition for Oracle Enhanced Performance High Availability - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Storage Edition Storage Edition for Oraclefor Oracle Storage Management Software Suite Storage Management Software Suite for Oracle Databases on HP Serversfor Oracle Databases on HP Servers
Optimal database performanceOptimal database performance24x7 availability of mission-critical databases24x7 availability of mission-critical databases
Continuous database accessContinuous database access Fast recoveryFast recovery Restore from consistent backupsRestore from consistent backups
Increasing management complexityIncreasing management complexity High growth in data volumeHigh growth in data volume
• Complex data types (e.g., video, sound)Complex data types (e.g., video, sound)
Increasing number of usersIncreasing number of users Diverse database server configurations (e.g. replication Diverse database server configurations (e.g. replication
servers)servers)
4
Storage Edition for Oracle enables DBAs to meet their top priorities:
optimal performance, availability, recoverability, and manageability of databases
Storage Edition Storage Edition for Oraclefor Oracle
VERITAS Storage Edition VERITAS Storage Edition for Oraclefor Oracle enables enables database administrators to manage Oracle7 database administrators to manage Oracle7 and Oracle8 environments with the flexibility and Oracle8 environments with the flexibility of file systems at raw disk performance.of file systems at raw disk performance.
Its data redundancy techniques and online Its data redundancy techniques and online administration features increase data administration features increase data reliability and availability.reliability and availability.
Quick I/OQuick I/O Raw device performance with File System Raw device performance with File System
manageabilitymanageability
Asynchronous I/O support Asynchronous I/O support
Online administration of database storageOnline administration of database storageStorage CheckpointsStorage Checkpoints
Enable Block-level Incremental BackupEnable Block-level Incremental Backup Enable Storage Rollback for immediate “point-in-Enable Storage Rollback for immediate “point-in-
time” recovery from on-disk imagestime” recovery from on-disk imagesHP-UX 11.0 supportHP-UX 11.0 support
Storage Edition Storage Edition for Oraclefor Oracle
Enhanced PerformanceEnhanced Performance
8
Storage Edition Storage Edition for Oraclefor OraclePerformancePerformance
Increased performanceIncreased performance increased productivity increased productivity Equal to raw device performance using Quick I/OEqual to raw device performance using Quick I/O
Large I/O optimizationLarge I/O optimization Accelerated I/O performance for large files (e.g., video, Accelerated I/O performance for large files (e.g., video,
images)images)
9
Database Performance Issues with Database Performance Issues with Conventional File SystemsConventional File Systems
Redundant data bufferingRedundant data buffering System buffer cache Database buffer cacheSystem buffer cache Database buffer cache Redundant buffer copyingRedundant buffer copying Inefficient use of memoryInefficient use of memory
Single writer lock per file at UNIX file system levelSingle writer lock per file at UNIX file system level UNIX file-level lock RDBMS row- or page-level UNIX file-level lock RDBMS row- or page-level
locklock Serialized write operationsSerialized write operations Impact on performance in multi-user client/server Impact on performance in multi-user client/server
environmentsenvironments
Asynchronous I/OAsynchronous I/O Supported only on raw devices, not on regular filesSupported only on raw devices, not on regular files
10
Building Oracle Databases onBuilding Oracle Databases onRaw Disks vs. File SystemsRaw Disks vs. File Systems
Unique, total storage foundation solution to Unique, total storage foundation solution to deliver the best of both worldsdeliver the best of both worlds
Manageability “Invisible” locations for tablespaces Difficult to grow tablespaces
Storage Edition for Oracle
Performance Best OLTP
performanceDataReliability No potential
for data losswith datawritten todisks directly
DisadvantagesAdvantagesRaw Disks
Performance Lower database
throughput (30-90% of
raw disk) Higher CPU
overheadData Reliability Potential
data loss
AdvantagesManageability Tablespace
organization System-wide
backup and restorepolicies
Easy to create and expandfiles for Oracle
DisadvantagesConventional File Systems
11
Raw Disk PerformanceRaw Disk PerformanceQuick I/O Database AcceleratorQuick I/O Database Accelerator
Break-through VERITAS File System interface technologyBreak-through VERITAS File System interface technologyPresents regular VERITAS File System files to Oracle as Presents regular VERITAS File System files to Oracle as raw character devicesraw character devices
Allows parallel updates to database files for increased Allows parallel updates to database files for increased throughputthroughput
Oracle handles locking for data integrityOracle handles locking for data integrity
Eliminates traditional UNIX file system overheadEliminates traditional UNIX file system overhead Removes single-writer lock at file levelRemoves single-writer lock at file level Bypasses redundant data bufferingBypasses redundant data buffering
Quick I/O
regularfile
rawdevice
OracleServer
12
Quick I/O PerformanceQuick I/O PerformanceComparison to Raw I/OComparison to Raw I/O
Storage Edition has equal to raw performanceStorage Edition has equal to raw performance 160% performance improvement over traditional file systems160% performance improvement over traditional file systems
Tested configurationincluded:
•HP K570 (4 CPUs and 1 GB of RAM) •HP-UX 11.0 (64-bit)•Storage Edition 2.0 for Oracle•Oracle 8.0.5 (64-bit)•TPC-C scale factor of 100 warehouses
0%
20%
40%
60%
80%
100%
Perc
enta
ge o
f Raw
I/O
Per
form
ance
Raw
= 1
00%
50 MB 100 MB 200 MB 300 MB 400 MB 500 MB
Oracle Buffer Cache Size
Raw DiskStorage Edition
Buffered IO
Direct IO
13
Large I/O OptimizationLarge I/O Optimization
VERITAS File System allocates disk space in VERITAS File System allocates disk space in groups of contiguous blocks or “extents”groups of contiguous blocks or “extents”Extent-based allocation can accelerate I/O by Extent-based allocation can accelerate I/O by increasing the I/O transfer size in the File increasing the I/O transfer size in the File SystemSystemOptimal for large filesOptimal for large files
Large Oracle tablespacesLarge Oracle tablespaces Binary Large Objects (BLOBs)Binary Large Objects (BLOBs)
Downtime impacts business operationsDowntime impacts business operationsRevenue, customer service, and productivity Revenue, customer service, and productivity at riskat risk
17
Application Industry Average HourlyCost
Brokerage Operations Finance $6.45 Million
Credit Card/Sales Auth. Finance $2.6 Million
Pay-per-View
Home Shopping (TV)
Catalog Sales
Airline Reservations
Tele-Ticket Sales
Package Shipping
ATM Fees
Media
Retail
Retail
Transportation
Media
Transporation
Finance
$150 Thousand
$113 Thousand
$90 Thousand
$89.5 Thousand
$69 Thousand
$28 Thousand
$14.5 Thousand
Source: Contingency Planning Research
Financial Impact of System Financial Impact of System FailureFailure
18
Storage Edition Storage Edition for Oraclefor OracleAvailabilityAvailability
Online administrationOnline administration Storage reconfiguration and maintenance without Storage reconfiguration and maintenance without
downtimedowntime
Automated, proactive monitoring of file Automated, proactive monitoring of file system to avoid unexpected “out-of-space” system to avoid unexpected “out-of-space” conditionsconditions
19
Online AdministrationOnline Administration
Enables DBAs and system administrators to Enables DBAs and system administrators to meet changing database storage meet changing database storage requirements without database downtimerequirements without database downtime
Supports online tablespace growthSupports online tablespace growth• Online resizing of file systemsOnline resizing of file systems
• Lack of file system free space can cause widespread Lack of file system free space can cause widespread application failureapplication failure
How ?How ?• Included Agent monitors average available free space Included Agent monitors average available free space
of VERITAS File Systemof VERITAS File System
• If average free space falls below threshold set by the If average free space falls below threshold set by the administrator, the agent will automatically grow the File administrator, the agent will automatically grow the File System and underlying volume if need be to enforce System and underlying volume if need be to enforce free space policyfree space policy
Configured via VxDBA utilityConfigured via VxDBA utility
Storage Edition Storage Edition for Oraclefor Oracle
Faster RecoverabilityFaster Recoverability
23
Storage Edition Storage Edition for Oraclefor Oracle RecoverabilityRecoverability
Fast database recovery from system crashFast database recovery from system crash Fast file system recovery through journalingFast file system recovery through journaling
Database recovery from consistent, stable Database recovery from consistent, stable backupsbackups
File System snapshots for system and database File System snapshots for system and database backupsbackups
Virtually eliminate database backup windowVirtually eliminate database backup window Enables block-level incremental backup to back up Enables block-level incremental backup to back up
only changed data blocksonly changed data blocks
Faster database Recovery from logical errorFaster database Recovery from logical error Enables point-in-time recovery from on-disk imageEnables point-in-time recovery from on-disk image
24
Database RecoveryDatabase Recovery
Database recovery begins only after file Database recovery begins only after file system recoverysystem recoveryJournaling File System minimizes database Journaling File System minimizes database downtimedowntime
File system recovery only requires replaying the intent File system recovery only requires replaying the intent loglog
File system recovery time does not depend on file File system recovery time does not depend on file system sizesystem size
Large file system (over 100 GB) usually takes only Large file system (over 100 GB) usually takes only seconds to verify / recoverseconds to verify / recover
End tablespace backup Mount snapshot file system(s)
Snapshot
Perform backup
A couple of seconds of changes to apply
at recovery
Hot Database Backups withHot Database Backups withFile System SnapshotFile System Snapshot
Hot database backup (or on-line backup)Hot database backup (or on-line backup) Reduces recovery window with fewer Reduces recovery window with fewer
changes to applychanges to apply
29
Key Differentiator:Key Differentiator:VERITAS Storage CheckpointsVERITAS Storage CheckpointsPoint-in-time snapshot of databasePoint-in-time snapshot of databaseStorage Checkpoints maintain changed Storage Checkpoints maintain changed data blocks data blocks asas database is being updated database is being updated
Uses efficient copy-on-write techniqueUses efficient copy-on-write technique No post-processing needed to scan forNo post-processing needed to scan for
changed data blockschanged data blocks
30
Create a Checkpoint..Create a Checkpoint..
Simplified illustration of initializing a storage checkpoint
AABB
CC
DD
EE
Primary File SystemPrimary File System Storage Checkpoint (empty)Storage Checkpoint (empty)
The storage checkpoint presents an exact image of the primary file system.
31
and update the filesystemand update the filesystem
Simplified illustration of initializing a storage checkpoint
Primary File SystemPrimary File System Storage CheckpointStorage Checkpoint
As the primary file system is updated, the original data is copied to the storage checkpoint before the new data is written. As the primary file system continues to change, the storage checkpoint accumulates the original data blocks
EE
AABB
CC
DD
EEEE11
32
and again..and again..
Simplified illustration of initializing a storage checkpoint
Primary File SystemPrimary File System Storage CheckpointStorage Checkpoint
And so the process continues until the next checkpoint is created
EE
AABB
CC
DD
EEEE11
CCCC11
33
Benefits of Storage CheckpointsBenefits of Storage Checkpoints
Block-Level Incremental Backup: Block-Level Incremental Backup: NetBackup manages Storage Checkpoints and NetBackup manages Storage Checkpoints and
extracts only the changed blocksextracts only the changed blocksStorage Rollback: Storage Rollback:
VxDBA utility manages Storage Checkpoints VxDBA utility manages Storage Checkpoints for faster database recoverability from on-disk for faster database recoverability from on-disk backup imagebackup image
34
Traditional Backup Traditional Backup ApproachesApproaches
Full backupsFull backups Shrinking backup windowsShrinking backup windows Approaches to minimize downtimeApproaches to minimize downtime
• Hot database backupsHot database backups
• Third mirror break-offThird mirror break-off
• Rolling backups (full + tables)Rolling backups (full + tables)
File-level incremental backupsFile-level incremental backups Poor fit for database environmentsPoor fit for database environments
Storage Edition:Storage Edition:Block-Level Incremental BackupsBlock-Level Incremental BackupsBack up only changed data blocks!Back up only changed data blocks!Higher data availabilityHigher data availability
Virtually eliminates backup windowsVirtually eliminates backup windows Allows more frequent backup schedulesAllows more frequent backup schedules Backups contain up-to-date dataBackups contain up-to-date data
Enhanced performanceEnhanced performance Significantly lowers CPU and network resource drain Significantly lowers CPU and network resource drain
during backupsduring backups Faster recovery from backups (less redo logs to apply)Faster recovery from backups (less redo logs to apply)
Requires NetBackup Server engine 3.2 and Requires NetBackup Server engine 3.2 and and database server to be backed up to be a and database server to be backed up to be a NetBackup clientNetBackup client
Enables database access and backup in Enables database access and backup in parallel with minimal interruptionparallel with minimal interruptionCold database backup (or off-line backup) Cold database backup (or off-line backup) with a couple of seconds of downtimewith a couple of seconds of downtime
A couple of seconds of downtime
Shutdown database
Start the database
Storage Checkpoint
Resume operation
Perform backup
Managed by NetBackup
38
Hot Database BackupsHot Database Backupswith Storage Checkpointswith Storage Checkpoints
Hot database backup (or on-line backup)Hot database backup (or on-line backup) Reduces recovery window with fewer Reduces recovery window with fewer
changes to applychanges to apply
A couple of seconds of
changes to apply at recovery
Begin tablespace backup
End tablespace backup
Storage Checkpoint
Perform backup
Managed by NetBackup
39
Full Backup with Storage Full Backup with Storage CheckpointCheckpoint
• Bring the database into a consistent state
/oradata
A
B
H
G
D
C
E
F
storage checkpoint at 1:00AM
• Take a storage checkpoint• Resume database operation
• Back up from the storage checkpoint
• The storage checkpoint presents a “frozen” image of the file system
A B C
40
During Full BackupDuring Full Backup
/oradata
A
B
H
G
D
C
E
F
• During backup, the database is accessible and being updated
• The storage checkpoint continues to present a “frozen” image of the file system
HGDA B C E F
A’
G’
storage checkpoint at 1:00AM
G
A
41
After Full BackupAfter Full Backup
/oradata
A
B
H
G
D
C
E
F
storage checkpoint at 1:00AM
H’
D’
• After the full backup, the database continues to be updated
So… Which blocks have changed since the full backup?
• Resume database operation• Back up using the storage
checkpoints• Before-images saved on the
first storage checkpoint indicate which blocks have changed since the full backup
• Changed data is read from /oradata
A’ D’
A
H
G
D
First storage checkpoint at
1:00AM • Take a second storage chkpt
Second storage checkpoint at
12:00PM
43
During Block-Level During Block-Level Incremental BackupIncremental Backup
/oradata
A’
B
H’
G’
D’
C
E
F
A
H
G
D
First storage checkpoint at
1:00AM
Second storage checkpoint at
12:00PM
H*
D* D’
H’
• During backup, the database is being updated
• Changes after 12:00PM are saved on the second storage checkpoint
• The second storage checkpoint presents a “frozen” image of /oradata at 12:00PM
• Changed data is read from the second storage checkpoint or /oradata
A’ D’ G’ H’
C’ C
44
Restore from BLI BackupRestore from BLI Backup
Restoring incremental image requires Restoring incremental image requires restoring full backup plus all incrementals to restoring full backup plus all incrementals to get to desired point in time.get to desired point in time.
Benefit: BLI Backup enables more frequent backupsBenefit: BLI Backup enables more frequent backups
More up-to-date backup imagesMore up-to-date backup images Less logs to apply upon restoreLess logs to apply upon restore Faster database recoveryFaster database recovery
+ BlockLevel
Incrementals
PreviousFull
Backup
FullRestore
45
Storage RollbackStorage Rollback
Storage Checkpoints are on-disk backup imagesStorage Checkpoints are on-disk backup images Consistent, stable images of a file system at a Consistent, stable images of a file system at a
particular point in timeparticular point in time
Storage Rollback is “restore” from the on-disk Storage Rollback is “restore” from the on-disk backup images or Storage Checkpointsbackup images or Storage Checkpoints
Copies before-images of data blocks back to the live Copies before-images of data blocks back to the live file systemfile system
Restores without going to tapesRestores without going to tapes
46
Storage RollbackStorage Rollback
Recovery from Storage Checkpoints=
Simply write back changed (blue) blocks to previous state and then apply redo logs to bring database to desired point in time
47
Storage Rollback ExampleStorage Rollback Example
/oradata
A’
B
H*
G’
D*
C’
E
F
A
H
G
D
H’
D’
C
First storage checkpoint at
1:00AM
Second storage checkpoint at
12:00PMImages of /oradata and its Storage Checkpoints
48
Storage Rollback ExampleStorage Rollback Example
/oradata at 1:00AM
A
B
H
G
D
C
E
F
/oradata at 12:00 PM
A’
B
H’
G’
D’
C
E
F
49
Storage Rollback to 12:00PMStorage Rollback to 12:00PM
Before-images on the 12:00PM Storage Checkpoint are copied back to the live file system, /oradata
/oradata
A’
B
H*
G’
D*
C’
E
F
H’
D’
C
Second storage checkpoint at
12:00PM/oradata at 12:00 PM
A’
B
H’
G’
D’
C
E
F
H’
D’
C
50
Storage Rollback to 1:00 AMStorage Rollback to 1:00 AM
/oradata
A’
B
H*
G’
D*
C’
E
F
A
H
G
D
First storage checkpoint at
1:00AM
H’
D’
C
Second storage checkpoint at
12:00PM
C
A
HG
D
Before-images from 1:00AM and 12:00PM Storage Checkpoints are copied.
File System SnapshotFile System Snapshot Full onlyFull only TransientTransient UnawareUnaware Separate storage poolSeparate storage pool Mount empty diskMount empty disk
Storage CheckpointStorage Checkpoint Block-levelBlock-level PersistentPersistent Aware of each otherAware of each other Shared storage poolShared storage pool Coordinate with Oracle Coordinate with Oracle
statesstates• NetBackup for BLI BackupNetBackup for BLI Backup
• VxDBA utility for Storage VxDBA utility for Storage RollbackRollback
Storage Edition Storage Edition for Oraclefor Oracle
Improved ManageabilityImproved Manageability
54
Storage Edition Storage Edition for Oraclefor OracleManageabilityManageability
Familiar file system administration for Oracle Familiar file system administration for Oracle database filesdatabase files
Combines raw I/O performance and ease of file Combines raw I/O performance and ease of file system managementsystem management
Large database configuration supportLarge database configuration support Supports large file systems to simplify Supports large file systems to simplify
managementmanagementGuide to simplify administration of database Guide to simplify administration of database storage storage Integration with familiar System Administration Integration with familiar System Administration Manager (SAM) interfaceManager (SAM) interface
55
Ease of File System Ease of File System ManagementManagement
Administrative comfortsAdministrative comforts Familiar naming conventions and utilities to Familiar naming conventions and utilities to
manage Oracle database filesmanage Oracle database files Datafiles can be grouped together for storage Datafiles can be grouped together for storage
hierarchy hierarchy Common backup strategies for database and Common backup strategies for database and
non-database filesnon-database files
56
Large DatabaseLarge Database Configuration Support Configuration Support
Storage Edition can support file systems up Storage Edition can support file systems up to 2 TB in sizeto 2 TB in sizeFile system sizes are not limited to File system sizes are not limited to underlying device sizesunderlying device sizes
No longer need to manage multiple file systems per No longer need to manage multiple file systems per databasedatabase
Online resizing further simplifies file system Online resizing further simplifies file system managementmanagement
Cookbook for setting up and tuning database Cookbook for setting up and tuning database environmentsenvironmentsTailored for DBAs to optimize database Tailored for DBAs to optimize database storage layoutsstorage layouts
Presents various storage configuration optionsPresents various storage configuration options Recommends optimal configurations specific to Recommends optimal configurations specific to
Storage Edition 2.0 Storage Edition 2.0 for Oraclefor OracleSummarySummary
Enhanced PerformanceEnhanced Performance Raw disk performance with ease of file system managementRaw disk performance with ease of file system management Increased throughput for OLTP applicationsIncreased throughput for OLTP applications
High AvailabilityHigh Availability Proactive, automated file system monitoring agentProactive, automated file system monitoring agent Increased data reliability and availability for mission-critical Increased data reliability and availability for mission-critical
databasesdatabases Online administrationOnline administration Fast database backup and recoveryFast database backup and recovery
Improved ManagementImproved Management Simplified administration for large databasesSimplified administration for large databases Simplified management through SAM integrationSimplified management through SAM integration