Deep-Dive into the Oracle Database Appliance Architecture · Deep-Dive into the Oracle Database Appliance Architecture ... /u01/app/oracle/fast_recovery_area/< db unique name >

Copyright©2015,Oracleand/oritsaffiliates.Allrightsreserved.|

Deep-DiveintotheOracleDatabaseApplianceArchitecture

TammyBednarOracleDatabaseApplianceProductDevelopmentNovember17,2015

OracleConfidenJal–Internal/Restricted/HighlyRestricted

@OracleODA@TammyBednar

https://www.linkedin.com/groups/Oracle-Database-Appliance UserGroup-4348075/about


SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirecJon.ItisintendedforinformaJonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncJonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andJmingofanyfeaturesorfuncJonalitydescribedforOracle’sproductsremainsatthesolediscreJonofOracle.

OracleConfidenJal–Internal/Restricted/HighlyRestricted 3


ProgramAgenda

OracleDatabaseApplianceOverview

ODATechnicalDeepDives(ODAStorage,Security,Monitoring,Patching,etc.)

Q&A

1

2

3



OracleDatabaseAppliance

EngineeredSystemopJmizedtoruntheOracleDatabaseanddatabase-centricapplicaJons•  CompletehighavailabilitydatabasesoluJoninasingleappliance

•  SimpletodeployandmanagebothdatabasesandapplicaJonstoimproveJmetovalueandreduceoperaJonalexpense

•  ReliablesystemtoensuredatabaseandapplicaJonavailability

•  AffordableCapacityonDemand(CoD)licensingtomanagecapitalexpense

5

Complete,Simple,Reliable,Affordable


SimpletoInstall,Manage,andMaintain

• AutomatedDeployment• AutomatedPatching• “Zero-Admin”Storage•  IntegratedVMManagement• SingleVendorSupport


•  Twodual-socketOracleLinuxservers•  Redundantprivateinterconnect•  Redundantpublicnetworks•  Double-mirroringortriple-mirroringstorageredundancy

•  Redundanthot-swappablepower,cooling,andfans

•  OracleDatabase12c&11gR2EnterpriseEdiJon– RealApplicaJonClusters– RACOneNode– SingleInstance

•  OracleGridInfrastructure– AutomaJcStorageManagement– OracleClusterware

•  OracleLinuxandOracleVM

•  OracleApplianceManager

Reliable

Hardware So@ware

HighlyAvailable


AffordableManageCapExusingCapacityOn-Demand

8

BuildYourOwnOpJon1:License72CoresforAn/cipatedGrowth

BuyOracleDatabaseApplianceOpJon2:LicenseasYouGrowandSaveSignificantly

72Cores

60Cores

48Cores

36Cores

24Cores

12Cores

6Cores

Year1 Year2 Year3 Year1 Year2 Year3

or

ManageOpEx–Saving2000Hours

TheOracleDatabaseAppliancesimplifiesJme-consumingDBAtasksandsaves:

•  828hoursinfirstyear

•  637hourseachsubsequentyear


DatabasePlaMorm

•  BusinesscriJcaldatabases–  OLTPanddatawarehouses–  RunsOracle’shighavailabilitysojwaresuiteincludingOracleRealApplicaJonClusters

•  Consolidateddatabases–  SupportsMulJtenantandIn-MemorydatabaseopJons

•  Testanddevelopmentdatabases–  Quicklyandefficientlyprovisiondatabasesnapshots

ApplicaNonPlaMorm

•  IntegratedvirtualizaJonsupportshosJngallJersonasinglesystem

•  SoluJon-in-a-BoxautomaJonandbestpracJcesforOracleproducts–  OracleE-BusinessSuite,JDEdwards,PeopleSoj

–  OracleWebLogicServer–  OracleEnterpriseManager

•  CerJfiedwithhundredsofISVapplicaJons

OracleDatabaseAppliance


OracleDatabaseApplianceX5-2

•  2x1RUx86Servers.EachServerContains:–  2x18-core2.3GHzIntelXeonProcessorsE5-2699v3–  256GBMemory(8x32GB),expandableupto768GB–  Mirrored600GBlocalstorage–  RedundantInfiniBandInterconnect–  OpJonal10GBase-Tor10GbESFP+PublicNetwork

•  1x4RUStorageShelf–Direct-Arached:– 800GBrawSSDstorageforredologs

– 1.6TBrawSSDstoragefordatabasecache,tablespaces,temporaryfiles

–  128TBrawHDDstoragefordata,archivelogs,backups

•  SupportStorageExpansionShelf–AlsoDirect-Arached(doublestoragecapacityandperformance)

HardwareSpecificaNons


TechnicalDeepDive• OracleDatabaseApplianceX5-2Enhancements

– ACFSIntegraJon– SharedFlashCache– In-memoryFaultTolerantopJon

•  InfinibandandExafusion

•  SecurityEnhancements• MonitoringODA• Patchingenhancements

– RollingUpgrade• BackupandRecovery



StorageArchitecture•  EachServerNode

–  2xHBA– IncaseofHBAfailure

•  MulJpathsojwaretransparentlymanagesbothpathsforthedatabase

•  StorageShelf–  2xIOModules(Controllers)

•  Eachconnectstoall24diskstoprotectagainstfailure

– RedundantHDDsandSSDs•  ASMstripesdataacrossdiskstoprotectagainstfailure

Node0HBA HBA HBA HBA

IOModule

Node1

P0 P1IOModule

Slot20

Slot16

Slot12

Slot8

Slot4

Slot0

Slot21

Slot17

Slot13

Slot9

Slot5

Slot1

Slot22

Slot18

Slot14

Slot10

Slot6

Slot2

Slot23

Slot19

Slot15

Slot11

Slot7

Slot3


•  Provideanintegratedvolumemanagerandfilesystem

•  StripeandmirrorfilesacrossdisksinaASMDiskGroup

•  OnlineRebalanceajerstorageconfiguraJonchanges

•  BuiltontheOracleinstancearchitecture•  I/OoperaJonsDONOTgothroughtheASMinstance!

•  ManagestorageasaclusterofsharedDiskGroups


ASMandODA

Operating System

DiskGroups

Oracle Database

ASM File System &

Volume Management

Operating System

Disks

Logical Volume Manager

File System

Oracle Database


ASM•  Stripes&Mirrordataacrossalldisks• HelprealizefullbandwidthandIOPSofallthedisks


Disk 1 Disk 2 Disk 3 Disk 4 Disk 5 Disk 6 Disk 7

DATA DG RECO DG

File 1 File 2 File 3 File 4

ASM Cluster Pool of Storage


ASMonODA

• Newdiskgrouparribute:content.type•  Possiblevalues:data,recovery

• DiskGroupPrimary/SecondaryallocaJonchangeswithcontent.type– DecreaseslikelihoodthatmulJplefailurescausedatalossacrossmulJplediskgroups

ContentType


•  PreservesallthebenefitsofASM•  AddsClusterFilesystemlayertoprovide

–  Spaceefficientsnapshots–  ReplicaJon–  AdvancedsecurityandencrypJon

• Databaseaware– DirectIOsupport

•  Fullyintegrated-GridInfrastructure•  SupportsCachednon-databasefiles•  SupportsSparsefiles


ASM-ACFS

Operating System

DiskGroups

Oracle Database

ASM File System &

Volume Management

Operating System

Disks

Logical Volume Manager

File System

Oracle Database

ACFS


ACFSConfiguraJonforODA•  StarJngversion12.1.2.XofApplianceManager

– DatabasestoragedefaultisinACFS– AutomaJcallycreatestheproperfilesystemsfor

•  DATA,REDO,RECOandFLASH– Nospacemanagementortuningtobedone

•  AutoextentstheFilesystemasitgrows•  Correctlytunedfordatabaseusage

– Implementsspaceefficientsnapshotsforthedatabase•  11.2&12.1NonCDBDatabasesnapshots•  12.1PDBSnapshots



OracleDatabaseApplianceX5-2StorageArchitectureDisk Disk

GroupVolumes UsedFor

HDDOuterRings +DATA data Databasedatafiles

HDDOuterRings +DATA Repo1..repoN

SharedRepositoryforVMs,VDisk

HDDInnerRings +RECO reco Databasearchivelogs,RMANbackups(FastRecoveryArea)

HDDInnerRings +RECO Repo1..repoN

SharedRepositoryforVMs,VDisk

HDDInnerRings +RECO cloudfs Clusteredfilesystem–filesthatneedtobeaccessedbyeitherservernode

SSD +REDO redo Databaseredologs

SSD +FLASH flash Frequentlyaccesseddata

ASMDiskGroups+DATA,+RECO,+REDO,+FLASH

ASMClusterFileSystem(ACFS)

data reco redo repo1..N

HDDs LogSSDs

CacheSSDs

flash

OutoftheboxconfiguraNon


ApplianceManager12.1.2Deployment

• ACFSFilesystemsarecreatedwith50%availablestorageinDATA,REDO,RECODiskgroups

• AutomaJcallyextendswithdatabasegrowth•  Foreachdatabasefollowingdirectorystructuresarecreatedfor


NonCDBDatabaseStructure

ASM Disk Group ACFS File System

+DATA (Datafiles) /u02/app/oracle/oradata/datastore/.ACFS/snaps/<db unique name>

+RECO (backup/archivelog) /u01/app/oracle/fast_recovery_area/< db unique name >

+REDO(online redo logs) /u01/app/oracle/oradata/datastore/< db unique name >

+FLASH(shared flash cache) /u01/app/oracle/oradata/datastore/< db unique name >


ApplianceManager12.1.2Deployment

•  ForeachCDBanACFSFilesystemiscreatedinDATA,REDO,RECO,FLASHDiskgroups

• AllPDB’sandit’ssnapshotsarecontainedinsameFilesystem• CDBdirectorystructure


CDBDatabaseStructure

ASM Disk Group ACFS File System

+DATA (Datafiles) /u02/app/oracle/oradata/<db unique name>

+RECO (backup/archivelog) /u01/app/oracle/fast_recovery_area/< db unique name >

+REDO(online redo logs) /u01/app/oracle/oradata/datastore/< db unique name >

+FLASH(shared flash cache) /u01/app/oracle/oradata/datastore/< db unique name >


ODASharedFlash

• ODAFlashCache– FlashCachesharedacrossnodes– IncreasescachehitrateforyourapplicaJons

– Upto6xfasterthannocache• ODAOLTPdatabasewillautomaJcallyconfigureSharedFlashcache

•  4xthesizeofSGA OracleConfidenJal–Internal/Restricted/HighlyRestricted 21

ImprovesReadIOperformance

NoCache

LocalCache

ODAFlashCache

AccessTim

e


OracleDatabaseIn-Memory12.1OpJon

•  RealTimeAnalyJcs• Which:Productswithhighmargin• Who:Top10salespersons• Whatif:Give10%discount

•  InsamedatabaseOLTP&AnalyJcs•  TransacJonallyconsistent•  OLTPdatainrowformat•  AnalyJcsin-memorycolumnformat

•  NoApplicaJonchangeandEasytoImplement•  InitParam:inmemory_size=XXXGB•  Altertable!ParJJon<tab_name>inmemory;•  DropanalyJcindexes

Benefits


Breakthrough:DualFormatDatabase

•  BOTHrowandcolumnformatsforsametable

•  SimultaneouslyacJveandtransacJonallyconsistent

•  AnalyJcs&reporJngusenewin-memoryColumnformat•  Compressesdataforefficiency

•  OLTPusesprovenrowformat

23

NormalBufferCache

NewIn-MemoryFormat

SALES SALES

RowFormat

ColumnFormat

SALES


ODAX5-2:In-MemoryFaultToleranceHighestAvailabilityforDatabaseIn-MemoryOpNon

24

•  Similartostoragemirroring

•  Duplicatein-memorycolumnsonanothernode-  Enabledpertable/parJJon- ApplicaJontransparent

•  DownJmeeliminatedbyusingduplicateajerfailure


InfiniBandExafusionDirecttoWireOLTPProtocol

•  InfiniBandhasgreatthroughput–  ButOSnetworkstackpermessageoverheadlimitssmallmessagerate

•  Exafusionre-implementsRACCacheFusion

•  DatabasedirectlycallsInfiniBandhardware–  Bypassesnetworkingsojwarestack,interrupts,scheduling

25

8KOLTPBlockTransfers/sec

InfiniBandExafusion

InfiniBand

10 Gb

Ethernet

3XSpeedup

OracleEngineeredSystemsOnly–NotAvailableElsewhere


ODAIn-MemoryOpJon• OAKCLICreateDatabaseprovidesopJontocreateinmemorydatabase

•  Setsupinmemory_sizevalueforappropriatetemplate


oakclicreatedatabase-dbmydb-ohOraDb12102_home1Pleaseenterthe'root'password……..PleaseselectoneofthefollowingforDatabasetype[1..3]:1=>OLTP2=>DSS3=>In-MemorySelectedvalueis:In-Memory

DatabaseClass CPUCores InmemorySize

Odb-01s 1 1GB

Odb-01 1 2GB

Odb-02 2 4GB

Odb-04 4 8GB

Odb-06 6 12GB

Odb-12 12 24GB

Odb-16 16 32GB

Odb-24 24 48GB

Odb-32 32 64GB

Odb-36 36 64GB


SecurityEnhancements• ApplianceManager12.1.2.4nowchecksforSSHEquivalence

– Noneedforroot,oracle,gridpasswordsfordatabasecreaJonandpatchingifSSHEquivalenceexists

•  FullSUDOsupport


##Cmnd_AliasOAKCLI_CMDS=/opt/oracle/oak/bin/oakclicreatedatabase*,/opt/oracle/oak/bin/oakclideletedatabase*jdoeALL=OAKCLI_CMDS

[jdoe@servernode1~]$sudo/opt/oracle/oak/bin/oakclishowdatabaseSorry,userjdoeisnotallowedtoexecute'/opt/oracle/oak/bin/oakclishowdatabase'asrootonservernode1.

[jdoe@servernode1~]$sudo/opt/oracle/oak/bin/oakclicreatedatabasePleaseenterthe'SYSASM'password:(DuringdeploymentwesettheSYSASMpasswordto'welcome1'):

Example:setupuserjdoetobeabletorunonly“selected”oakclicommands

jdoecancreateadatabase

Butjdoecannotruntheshowdatabasecommand


MonitoringODA•  SetupASR(AutoServiceRequest)orphonehometomonitor

– CPU,server,temperature,etc.– ODA-specificdiskalerts

• Deephardwaremonitoring– ConJnuouslymonitorhealthofthehardwarecomponentsinODAservernodes


$oakclishow–h…server-Detailsofserversub-systemprocessor-Detailsofprocessorsub-systemmemory-Detailsofmemorysub-systempower-Detailsofpowersupplysub-systemcooling-Detailsofcoolingsub-systemnetwork-Detailsofnetworksub-system


MonitorODA(s)withEnterpriseManagerPlug-In

•  ExposeallODAfuncJonalitythroughOracleEnterpriseManager(EM)

•  CentralizedconsoletomonitorandmanageODA

•  Simple,intuiJvetagbasedmodeltocreateODAgroups

•  AcJonablecomponentlevelanalyJcsacrossODAgroups

•  HierarchicalviewertoshowtherelaJonship•  FullsupportforbothBareMetalandVirtualizedODA

•  FullsupportforallODAhardwareversions–  V1,X3-2,X4-2andX5-2


Patching

• Patchesallthecomponents– Allsystemfirmware– OperaJngSystem– Systemmanagementsojware(ASR)– ApplianceManager– GridInfrastructure– Database

DesignedtoaddressenNresystemupdateseamlessly


ODAPatching

• PatchingprocessissimilarforbaremetalandVirtualizedPla�orm

PatchedwithcurrentPatchset,PSUandallcriNcalone-offs

Complete

Unpackthepatchfile

21

DownloadBundlePatch

3

UpdateOS,Storage,FW,ILOM,BIOS

Complete4

UpdateGridInfrastructure

5

UpdateDatabase(s)


SimpleCommandstoPatchSystem

• Updatesysteminfrastructure– Updatesallfirmware,OS,ILOM,ApplianceManager,andASR–  oakcli update –patch 12.1.2.4 –-infra – UpdatesGridInfrastructure–  oakcli update –patch 12.1.2.4 –-gi

• Patchdatabases– Updateone,setoralldatabasestothelatestPSU –  oakcli update –patch 12.1.2.4 –-database

OAKCLIInterface


ODARollingUpgrades–ComingSoon!• PatchingODAsystemwithoutODAdownJme•  SpecialoakclicommandopJon–localallowspatchingonenodeataJme

– oakcliupdate–patch12.1.2.6.0–local– Allthreecomponents(infrastructure,grid,anddatabase)willbepatchedinonerun– AjerthefirstnodedraintheconnecJonsfromtheothernodeandstartpatchingthesecondnode

• AvailablestarJngApplianceversion12.1.2.6



Backupandrecovery–ComingSoon!

• BackuptolocalandOraclePublicCloud• Backupdatabaseandsystemcomponents

– OS– GridandDBSojwareHomes– Database

• Recoveryfordatabaseandsystemcomponents•  FullreporJngofbackupandrestoreacJviJes•  Easytoconfigureandchange


OAKCLIintegraNon


Databasebackup• Dailyincrementallevel1backup• AutomaJcallybackedupatsetintervals• Requiredmanualbackupcanbetaken

– oakcli create backup –tag <tag name) • AutodeletebackupoutsideoftheretenJonJme•  FlexibleconfiguraJonopJontostorethebackupin

– OracleBackupCloudService– LocalFRA– BothLocalandCloud



Systemcomponentsbackup• AllSystemcomponentsarebackedup

– OperaJngSystem– GridInfrastructuresojware– DatabaseSojware– ConfiguraJonfiles

•  AllowflexibleconfiguraJon– ScheduleDaily|Weekly|MonthlyJmeframe

•  Supportformanualsystembackup



Recovery• DatabaseRecovery

– Fullrecovery– PointinJmerecovery

•  SCN•  Timestamp

– MediaRecovery– Recoverybackupinadifferentdatabase

•  RMANClone

•  SystemRecovery– RestoreanycomponentOS,GIandOracleHomesasneeded



ReporJng• ComprehensivereporJngofbackupandrestoreacJviJes• BackupReporJng

– oakcli list backup – oakcli list backup –tag <tag name> – oakcli list backup –id <backupid>

• RestorereporJng– oakcli list restore – oakcli list restore –tag <tag name> – oakcli list restore –id <backupid>



IntegraJonwithOraclePublicCloud•  IntegratedwithOPCbackupmodule• ApplianceManagerConfiguratorgatherstheOPCBackupServicecredenJals•  SecurelystoresthecredenJalsintheOracleWallet



Summary

•  Easytodeployandmaintain– SimpleOneCommandupdate– RollingpatchapplicaJon

• Reliableandaffordable•  SpaceefficientsnapshotsforDatabaseandVM’s•  IntegratedmonitoringfortheenJreappliance• CloudenabledbackupandrecoveryopJons


Copyright©2015,Oracleand/oritsaffiliates.Allrightsreserved.| OracleConfidenJal–Internal/Restricted/HighlyRestricted 41

Deep-Dive into the Oracle Database Appliance Architecture · Deep-Dive into the Oracle Database Appliance Architecture ... /u01/app/oracle/fast_recovery_area/< db unique name >

Documents