Exadata MAA Best Practices Series Session 10: Exadata MAA Lawrence To Senior Manager, Exadata and MAA Best Practices
<Insert Picture Here>
Exadata MAA Best Practices Series
Session 10: Exadata MAA
Lawrence To
Senior Manager, Exadata and MAA Best Practices
2
<Insert Picture Here>
Exadata MAA Best Practices Series
1. E-Business Suite on Exadata
2. Siebel on Exadata
3. PeopleSoft on Exadata
4. Exadata and OLTP Applications
5. Using Resource Manager on Exadata
6. Migrating to Exadata
7. Using DBFS on Exadata
8. Exadata Monitoring
9. Exadata Backup & Recovery
10. Exadata MAA
11. Troubleshooting Exadata
12. Exadata Patching & Upgrades
13. Exadata Health Check
3
Assumptions and Terminology
• General Oracle HA Knowledge expected
• High Availability Overview documentation
• Terminology• MAA – Oracle Maximum Availability Architecture
• HA – High Availability
• RAC – Oracle Real Application Clusters
• ASM – Oracle Automatic Storage Management
• Flashback – Oracle Flashback Database Technology
• HARD – Hardware Assisted Resilient Data
• RMAN – Oracle Recovery Manager
• ASR – Automated Service Request
• EM – Oracle Enterprise Manager
• MOS – My Oracle Support Note
6
Exadata MAA
1. MAA is Oracle’s availability blueprint
2. Exadata Database Machine is MAA’s main platform
7
Exadata MAA
1. MAA is Oracle’s availability blueprint
2. Exadata Database Machine is MAA’s main platform
3. Exadata MAA is fastest and best availability solution
8
MAA is Oracle’s availability blueprint
Oracle’s application-oriented High Availability, Data
Protection, and Disaster Recovery solution for customers
9
Oracle’s Database HA Solution SetDatabase Integration Unique in the Industry!
Server
Failures
Data
Failures
System
Changes
App
Changes
Unplanned
Downtime
Planned
Downtime
Real Application Clusters
Flashback
RMAN & Oracle Secure Backup
ASM
Data Guard and GoldenGate
Online Reconfiguration
Rolling Upgrades
Edition-based Redefinition
Ora
cle
MA
A B
es
t Pra
ctic
es
Online RedefinitionData
Changes
10
MAA is Oracle’s Availability Blueprint
• Validated in our labs and proven with customers
• Operational and Configuration Practices needed for
• Fault tolerance and fast repair
• Online changes and rolling upgrade
• Lowest downtime and highest availability
11
Generic MAA Practices
• MAA evolved with each release and with new feature
enhancements
• Challenges
1. Hardware may not be optimized or fault tolerant
2. Software requirements may not present
3. Customers may not have the skills or resources to execute
practices
Resulting in HA gaps and risks
12
Exadata Database Machine is MAA’s
Reference Platform
More testing, optimization and integration by Oracle.
Less work and higher availability for customers.
13
Extreme performance in a highly-available, highly-secure environment
• Best for Data Warehouse
• Best for OLTP
• Best for consolidation
Exadata Storage Server Grid
• 14 high-performance storage servers
• 5TB flash storage
• Fault tolerance for both cell and disk
failures using ASM redundancy
• Exadata storage built-in corruption
checks
Oracle Database Server Grid
• 8 high-performance RAC
compute servers
• Protection from server failures
InfiniBand Network
• 40 Gb/sec fault-tolerant unified
server and storage network
• Multiple switches for HA
• Redundant ports on Host
Channel Adapters
Exadata Database MachineBest Availability Solution (Hardware, Software, Complete)
14
Exadata Database MachineBest Availability Solution (Hardware, Software, Complete)
1. Built-in hardware and component redundancy
15
Exadata Database MachineBest Availability Solution (Hardware, Software, Complete)
1. Built-in hardware and component redundancy
2. Oracle software enabled application availability
16
Exadata Database MachineBest Availability Solution (Hardware, Software, Complete)
1. Built-in hardware and component redundancy
2. Oracle software enabled application availability
3. Documented and validated application and database
MAA best practices
17
Exadata Database MachineBest Availability Solution (Hardware, Software, Complete)
1. Built-in hardware and component redundancy
2. Oracle software enabled application availability
3. Documented and validated application and database
MAA best practices
4. Integrated MAA practices at deployment
5. Comprehensive monitoring
19
Pop Quiz
• How long does it take to deploy, validate and optimize
MAA on a different platform?
• With Exadata Database Machine
• 3-5 days to deploy
• Installed with recommended software and firmware
• Running test system with database cluster, storage pool and
configuration practices (ASM and database settings)
• MAA blueprint and software optimized for Exadata Database
Machine
20
Exadata MAA is the Best Availability
Solution
Applicable for OLTP, data warehouse, and consolidated
system
Major $$$ savings
Reduced MAA deployment and configuration time
Much lower downtime
21
Examples of High PerformanceMAA Best Practice Benchmark Tests and Customer Experiences
HA Tests Non-Exadata Exadata
Archiving
8 X
30 MB/sec per instance 214 MB/sec per instance
5.8 TB/hour for full rack
Redo Apply
6-10 X
30 MB/sec OLTP
100 MB/sec Loads
200-300 MB/sec OLTP
600+ MB/sec Loads
Local Disk Backups
and Restores
5-6 X
< 3 TB/hour 17-18 TB/hour
22
3TB/Hour Load in a MAA ConfigurationUsing Complete MAA Best Practices
• 3 TB/hour
• Archivelog mode
• Force logging
• Flashback Database
• Corruption protection
• db_block_checksum=typical, db_block_checking=off,
db_lost_write_protect=TRUE
• Real Application Clusters
• ASM redundancy
• Data Guard ASYNC redo transport
23
MAA Configuration Best PracticesValidated and optimized for Exadata Database Machine
• Starting Point
• ASM and Disk Groups
• Flashback
• Corruption Protection
• Data Guard
• Planned Maintenance
24
Starting Point
1. Recommended software (MOS 888828.1)
2. Exadata testing and patching practices (MOS 1262380.1)
3. Hub of MAA and Exadata best practices (MOS 757552.1)
4. Exadata MAA HealthCheck (MOS 1070954.1)
5. Exadata Monitoring (MOS 1110675.1) and ASR (OTN)
6. MAA and Exadata OTN websites
26
ASMDisk Group Configuration and Deployment
1. Disk Group striped across all cells and disks
2. High Redundancy Disk Group
27
ASMDisk Group Configuration and Deployment
1. Disk Group striped across all cells and disks
2. High Redundancy Disk Group
3. Optimal file placement
28
ASMDisk Group Configuration and Deployment
1. Disk Group striped across all cells and disks
2. High Redundancy Disk Group
3. Optimal file placement
4. Included in standard deployment
http://www.oracle.com/technetwork/database/features/
availability/exadata-maa-131903.pdf
29
Flashback DatabaseConfigure for all Applications
• Enable Flashback Database
• Minimum impact to OLTP workloads (< 2%)
• On primary: 3 TB/hour DW load in 11.2.0.2
• On standby: 1.7 TB/hour redo apply rate
• Operational best practices required
• 20% overhead for heavy loads during flashback ramp up
eliminated in 11.2.0.2
• MOS 565535.1
30
Data Corruption ProtectionConfiguration Best Practices
• ASM auto repair, Exadata HARD compliant checks and
Active Data Guard auto-block repair are transparent
31
Data Corruption ProtectionConfiguration Best Practices
• ASM auto repair, Exadata HARD compliant checks and
Active Data Guard auto-block repair are transparent
• Set DB_BLOCK_CHECKSUM=TYPICAL | FULL and
DB_LOST_WRITE_PROTECT=TYPICAL
• Less than 5% performance impact for DW and OLTP workloads
• Evaluate DB_BLOCK_CHECKING = MEDIUM | FULL
• Deployment defaults: ASM, Exadata HARD,
db_block_checksum, db_lost_write_protect
32
<Insert Picture Here>
Data Guard on Exadata
• Standby Instantiation
• MOS 1206603.1
• 11.7 TB/hour with RMAN backup as copy
• Network Configuration
• MOS 960510.1 and MOS 951152.1
• Use GigE, 10GigE or IB
33
Data Guard Enhanced HA
• Auto Block Repair - zero application downtime for physical
block corruptions
• HA and DR solution when primary goes awry
• Enhanced planned maintenance
• Upgrades and migrations to Exadata Database Machine
• Simplified database rolling upgrade with Data Guard
• Data Guard Standby-First Patch Apply (MOS 1265700.1)
http://www.oracle.com/technetwork/database/features/availability/maa-
wp-dr-dbm-130065.pdf
34
Planned Maintenance
• Strategy to minimize risk (MOS 1262380.1)
1. Validate in TEST (Functionality, Performance, HA)
2. Patch Data Guard (Standby-First Patch) and validate
a) Snapshot Standby for best validation
b) Transient Logical
c) Active Data Guard
3. Patch production or Data Guard switchover
• Rolling Upgrade
1. Exadata, Oracle Grid Infrastructure (Oracle Clusterware, ASM),
RAC Rolling Upgrade
2. Standby-First Patch, Transient Logical Standby
36
Business Value Take-AwaysExadata MAA
• Best availability solution
• Highest availability and lowest downtime
• Significant risk reduction
37
Business Value Take-AwaysExadata MAA
• Best availability solution
• Highest availability and lowest downtime
• Significant risk reduction
• Significant time and cost savings in deployment and
configuration of MAA
39
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
40
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
41
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
3. Hub of MAA and Exadata Best Practices (MOS 757552.1)
42
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
3. Hub of MAA and Exadata Best Practices (MOS 757552.1)
4. Exadata “MAA” Health Checker (MOS 1070954.1)
43
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
3. Hub of MAA and Exadata Best Practices (MOS 757552.1)
4. Exadata “MAA” Health Checker (MOS 1070954.1)
5. Exadata Monitoring (MOS 1110675.1) and ASR (OTN)
44
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
3. Hub of MAA and Exadata Best Practices (MOS 757552.1)
4. Exadata “MAA” Health Checker (MOS 1070954.1)
5. Exadata Monitoring (MOS 1110675.1) and ASR (OTN)
6. Storage Grid High Redundancy and file placement (http://www.oracle.com/technetwork/database/features/
availability/exadata-maa-131903.pdf)
45
Best Practice Take-AwaysExadata MAA
1. Recommended Software (MOS 888828.1)
2. Exadata Testing and Patching Practices (MOS 1262380.1)
3. Hub of MAA and Exadata Best Practices (MOS 757552.1)
4. Exadata “MAA” Health Checker (MOS 1070954.1)
5. Exadata Monitoring (MOS 1110675.1) and ASR (OTN)
6. Storage Grid High Redundancy and file placement (http://www.oracle.com/technetwork/database/features/
availability/exadata-maa-131903.pdf)
7. Data Guard practices http://www.oracle.com/technetwork/database/features/availability/maa-wp-dr-dbm-130065.pdf
• Exadata MAA best practices paper coming soon
46
Oracle MAA with Database MachineHardware, Software, Complete Availability Solution
• Comprehensive protection from failures: server, storage, network, site, corruptions
• Correction from human errors: database, table, row, transaction
• Active DR: Real-time remote standby open for query offload
• Online indexing and table redefinition
• Online patching and upgrades
WAN
Real
Application
Clusters
ASM
Fast
Recovery Area
Active
Data Guard
Oracle Secure Backup
• Exadata MAA: optimized and validated for Database Machine
48
Best PracticesAdditional Resources sponsored by MAA and X-Team
• MAA and Exadata OTN website contains best practices and different
architectural solutions
• MAA OTN website:
http://www.oracle.com/technetwork/database/features/availability/maa-090890.html
• Sun Oracle Database Machine and Exadata OTN website
http://www.oracle.com/technetwork/database/exadata/index-089737.html
• Openworld presentations
• http://openworld.vportal.net
49
SponsorsExadata MAA Team and X Team
• Operational and Configuration best practices
• Optimized and integrated for Exadata
• Generic practices for other platforms
• Examples: Migration, Backup/Recovery, Monitoring,
Troubleshooting, Patching, MAA, Consolidation, Active Data
Guard, Cloning/Reporting, Application Failover
• Applications MAA and Scalability
• Optimized and integrated for Exadata and Exalogic
• Examples: E-Business Suite, Siebel, Peoplesoft, Fusion
Middleware
• Exadata Strategic Reference Program