<Insert Picture Here> Oracle ASM Cluster File System (ACFS)- See What’s New Ara Shakian Principle Product Manager
Oracle Confidential
THE FOLLOWING IS INTENDED TO OUTLINE OUR GENERAL PRODUCT DIRECTION. IT IS INTENDED FOR INFORMATION PURPOSES ONLY, AND MAY NOT BE INCORPORATED INTO ANY CONTRACT. IT IS NOT A COMMITMENT TO DELIVER ANY MATERIAL, CODE, OR FUNCTIONALITY, AND SHOULD NOT BE RELIED UPON IN MAKING PURCHASING DECISION. THE DEVELOPMENT, RELEASE, AND TIMING OF ANY FEATURES OR FUNCTIONALITY DESCRIBED FOR ORACLE'S PRODUCTS REMAINS AT THE SOLE DISCRETION OF ORACLE.
Oracle Confidential
*
Oracle Confidential
Table of Contents
Storage management challengesOracle Cluster File System Cloud EditionASM and ACFS overviewACFS new features in 11.2.0.2 patch set ACFS use casesASM as an integrated solutionASM reference customersOracle Confidential
*
Oracle Confidential
Challenges of Managing
Data Explosion
Oracle Confidential
*
FS in the past have difficulties with initial space allocation, robustness and reliability.
Provisioning type of stuff.
Oracle Cluster File System-
Cloud Edition
Oracle Confidential
Oracle Confidential
Oracle Cluster File System-
Cloud Edition
Applications
Middleware
Database
Oracle Cluster File SystemCloud Edition
Oracle VM (optional)
3rd Party FS
Application
Managing ALL Data within the Cloud
Oracle Cluster File System Cloud Edition
Automatic Storage Management (ASM)
ASM Cluster & Single Node File System (ACFS)
Database RAC
ASM Files
DB Datafiles
DB Datafiles
DB Datafiles
OCR & Voting files
ASM
Disk
Group
Dynamic Volume Manager
Dynamic Volumes
ACFS FS
Oracle Bin
3rd Party
FS
Tagging
Replication
Security
Encryption
Snapshot
Oracle Confidential
Automatic Storage Management Overview
File system and volume manger for all data Storage pool for provisioning and consolidation Dynamic rebalancing for even distribution of IO Flexible Striping and mirroring for performanceand availability
ASM
Disk Group
Key Benefits
Key Features
ASM Disk
ASM Disk
ASM Disk
ASM Disk
ASM Disk
Oracle Confidential
Sales Pool
Sales Clients
Back Office Clients
Most Critical
Least Critical
Back Office Pool
Oracle Automatic Storage Management
Enables Elastic Storage
Alert: Disk space low Add more storage.
Action: Storage added rebalancing started.
*
Slide Goal: To provide a virtual demonstration of the product in action.
SLIDE IS ANIMATED
Modern application performance is made up of several interlocking pieces that span the technology stack. Much effort has been focused on delivering and deploying an application. However, this is not ultimately what an end-user sees. The end-user experience is defined by the runtime performance of an application. While many tools allow for monitoring an applications this, it is not enough. What is required is Active runtime quality of service management that can both identify bottlenecks and adjust resources to ensure the most important applications maintain their required levels across ever-changing demand.
Here we have an RTI datacenter with 3-tier and 2-tier systems operating within their response time objectives. We have 3 Pools in each of the top three tiers and a common storage pool for a total of 10 managed pools.
Demand for the EMEA Sales application rises the SLO is violated.2. The QoS system compensates by adjusting a resource such as CPU shares while still meeting objectives.
3. Suddenly our most important DB server pool goes red for all Sales apps.
4. Resources, such as a server, are reallocated from our least important DB server group to restore performance
We are instrumenting the entire Oracle stack to enable us to provide true QoS management thereby allowing you in the end to effectively run your applications on cruise control.
Oracle Confidential
ASM Dynamic Volume Manager
New general purpose volume platformSupports ACFS and 3rd party file systemsEliminates the need for 3rd party VMgrs New ASM volume management serviceCluster and single host volumesLoadable kernel driverDynamic Volume is an ASM file+DATA/volume1 /dev/asm/volume1-123Leverages ASM featuresEasy on line provisioning Cross platform (Linux, Windows, UNIX)Managed using ASMCMD, EM and SQLNote: An AVD volume device may not be used as an OS boot or swap device, nor used as a root file system of the OS
ASM DG
/dev/asm/volume1-123
+DATA/volume1
OS
Oracle Confidential
*
The ASM Dynamic Volume Manager is a kernel loadable device driver and services that provides volume management services and a standard device driver (ASM device driver (AVD)) interface to clients (i.e. ACFS). File systems or other user processes can do I/O to this device driver as they would to any other disk device driver on the system. AVD is the primary I/O interface for ACFS to perform I/O and build a file system leveraging ASM as a volume manager. DVM is loaded upon ASM start up. The device driver is cluster aware and communicates with ASM for extent map information, extent rebalancing and I/O failures.
An OS device file is created automatically when a dynamic volume is created in an ASM disk group.
Oracle Confidential
General purpose file system for non-DB filesJournaling, extent basedPOSIX, X/OPEN file system solution for UNIX/LinuxWindows file system solution for Windows platforms Single node and clusterScalable and high performanceSupports NFS and CIFS protocolsMulti OS platform - Linux, Windows, Solaris and AIXIntegrated with Oracle system mgt toolsOracle installation/configuration, EM and native OS toolsSupports advanced data servicesSnapshot, Replication, Tagging, Security and EncryptionWhat is ASM Cluster File System (ACFS)
Oracle Confidential
*
The ASM Cluster File System,(ACFS), extends Automatic Storage Management (ASM) by providing a robust, modern general purpose extent-based and journaling file system for files beyond the Oracle database files. ACFS provides support for files such as Oracle binaries, report files, trace files, alert logs and other application data files. With the addition of the ACFS, ASM becomes a complete storage management solution for both Oracle database and non-database file. ACFS scales from small files to very large files (exabytes) and supports large numbers of nodes in a cluster. ACFS is an extent-based file system to provide high performance and a utilizes a log based metadata transaction engine for file system integrity and fast recovery. The ACFS on-disk structure supports endian neutral metadata[u1]. ACFS file systems can be exported to remote clients through industry standard protocols such as NFS and CIFS.
ACFS eliminates the need for expensive 3rd party cluster file system solutions while streamlining, automating and simplifying all file type management in a single node as well as RAC and Grid computing environments. ACFS supports dynamic file system expansion and contraction without any downtime. ACFS is highly available leveraging the ASM mirroring and striping features in addition to leveraging hardware RAID functionality. [u1]Need to say why and benefit
Journaling:
ACFS metadata is logged
Extent based:
File system is allocated and managed as extents
Oracle Confidential
Whats New in
Oracle ASM 11g 11.2.0.2 - Patch Set 1
Oracle Confidential
Comments/Harsha
Just want to confirm. Is the name 11.2.0.2 or 11g 2.0.2 is also fine as used here?New Features for Linux and Windows. We do not support new features on Windows now.ACFS Unified Security Infrastructure We used to call the project (encryption + security combined) with this name. We use ACFS Security to refer to Realm-based security.*
Oracle Confidential
ACFS Tagging
ACFS Tagging allows group operations on files spread throughout your file systemsACFS Tagging assigns a common naming attribute to a group of filesFile operations can be performed based on tagging attributesTagging is configured and managed by acfsutil tag command lineSpecify tag names for directories and files$ /sbin/acfsutil tag set r resume /dev/asm/acfsvol- 302/test/resumes
Oracle Confidential
Comments/Harsha
1) Last bullet:- Security and Encryption do not really leverage ACFS Tagging
*
Oracle Confidential
ACFS Replication
Compliments Data Guard and provides a complete DR solution for all filesEnables replication of ACFS file systems across the network to a remote siteReplication logs are used to replicate from primary to standby asynchronouslyOracle Confidential
*
Oracle Confidential
Key Drivers for Data Security &
Encryption
Sarbanes-Oxley (SOX), J-SOX, HIPAA
GLBA
Payment Card Industry (PCI)
EU Privacy Directives, CA SB 1386.
Adequate IT controls, COSO, COBIT
Separation of duty, Proof of compliance, Risk Assessment and Monitoring
Regulatory Compliance
Oracle Confidential
*
*
The need for Data Security solutions is being driven by two business challenges; regulatory compliance and insider threats.
Regulatory Compliance affects virtually every public company, especially those in highly regulated industries such as the financial sector. I'm sure everyone has heard of Sarbanes-Oxley. Others include the Payment Card Industry (PCI) and the Health Insurance Portability and Accountability Act (HIPAA). One of the really good things that has come out of the regulatory compliance push is that it has given organizations time and budget to go back and look at the internal processes.
The second factor driving is security is the desire to reduce the risk associated with insider threats. Some studies have concluded that upward of 80% of all threats originate from inside the organization. The issue takes on even greater significance when you consider the trend to outsourcing/offshore more IT functions.
Comment/Harsha Just want to mention that we mainly address insider threats and encryption with our featuresnot so much the other topics mentioned in this slide
Oracle Confidential
ACFS Security
Fine grained access control in addition to OS ACLsEnforces security policies through realms, rules, rule sets and command rules Realm is a group of files/directories secured for access by usersRule sets are collection of rulesCommand rules use rule sets to allow/disallow operationsIntegrated with Oracle system mgt toolsASMCA support for basic configurationsExtensions to ACFS command line tools for easy use via acfsutilOracle Confidential
Comments/Harsha
ACFS Unified Security Infrastructure ACFS SecurityNit: thru throughASMCA support for installation and configuration ASMCA support for basic configuration*
Oracle Confidential
ACFS Encryption
Protects data-at-rest through encryptionPrevents unauthorized use of data in case of data loss or theftSecure encryption keys to decode dataFlexibility to encrypt the entire file system and/or just individual files and directoriesTransparent to users and applicationsUsers and apps get decrypted data High level protection using two keysFile Encryption Key (FEK) to encrypt file dataVolume Encryption Key (VEK) to encrypt FEKOracle Confidential
*
*
ACFS Use Cases
ACFS file systems exported thru NFS/CIFSACFS file systems exported thru NFS/CIFSSingle node or cluster ACFS file systemsSingle node or cluster ACFS file systemsData Type
Data Model
ACFS
ACFS
ACFS
Personal files
Home directories, documents, etc...System and application files
System filesApplication binariesBusiness data
Business files not stored in the databaseBusiness critical dataStore Personal Files on ACFS
Configure ACFS as a Network File ServerSingle node or cluster for HAEasy provisioningSimple managementClient computers can mount ACFS NFS/CIFS file systemsHome directories, documents, photos and personal dataNFS or CIFS
Network Protocols
ACFS Network File Server
(NFS/CIFS)
ACFS FS
mount points
System & Application Files on ACFS
ACFS configuration alternativesACFS single node or cluster serverACFS Network File ServerData types on ACFSSystem files (not including boot FS and Grid Infrastructure home)System files, trace files, log files, import/export files, system and application dump files, etcApplication files and binariesOracle database home (Shared or node-local)Oracle and 3rd party application binaries and supporting files I.e. SAP, Siebel, PeopleSoft, etcASM Disk Group
Oracle DB
Binaries
SAP
Application
Binaries
Siebel
Application
Binaries
ACFS
File Systems
Oracle
EBusiness
Suite
3rd Party
File System
Business Data on ACFS
Database external files may be stored in an ACFS clusterData typesFiles or data managed by business applications not stored in databaseImages, manuals, reports, contracts, external tables, and BFILEsBusiness critical dataApplication data with true cluster file system functionality requirements (cache coherency, shared read/write, etc)ASM Disk Group
BFILEs
Reports
ACFS File Systems
External
tables
Photos
Images
Medical
Images
"Oracles new security feature in ACFS gives us fine-grain and
secure control over sensitive data that needs the extra
protection.In addition, ACFS replication coupled with Oracle Data
Guard provide a complete Disaster recovery solution for database
files, external files and all other general purpose files in the
OS".
Daniel Smith
Senior DBA, Carfax Inc.
*
"Oracle Database 11g Release 2 (11.2.0.2) takes us a step closer to Cloud Computing and Cost Optimization. The new RAC Quality of Service Management (QoS) coupled with wider platform support for ASM Cluster File System (ACFS) and RAC One node enable predictable performance and higher availability, both essential in consolidated environments."
NTT Data Interlink
*
Oracle Confidential
One Integrated Solution for ALL Data
Always On-Line
Optimal Utilization
Scalable
High Performance
Low Cost
Simple
One Vendor for Support
One Management Interface
One Clusterware Framework
One Install and Configure
Cross Platform
Linux, Windows, Solaris,
HP-UX, AIX
Structured
Data
Un-structured
Data
ASM
ACFS
&
Dynamic Volumes
Oracle Clusterware
Oracle Database
&
RAC
Snapshot
Replication
Tagging
Security
Encryption
RAC One
Oracle Confidential
*
Add application layer on ACFS
Breakout slide for management
Oracle Confidential
ASM adoption
De-facto standard for RAC and grid deployments, >65%De-facto standard for VLDB deploymentsLarge and growing adoption for single instance deployments, >20%Thousands of customers using ASMOne of the most popular features in the databaseUpdate stats
Oracle Confidential
*
Oracle Confidential
Some ASM Reference Customers In Production
Update customer list
Oracle Confidential
*
Oracle Confidential
Oracle Confidential
*
Storage Cloud
Storage serviceCharacteristicsStorage poolingNetwork accessible storage, files, and dataElastic storage poolCloud Computing Infrastructure
Application Cloud
Database Cloud
Storage Cloud
The data center has evolved. Mainstream customers have left the world of dedicated silos, with their physical, dedicated hardware, peak load sizing, and expensive management paradigms. Theyve moved to grids, virtualizing their resources to provide enhanced flexibility, better utilization and improved efficiencies. Now leading customers are taking the next stepconsolidating their workloads into clouds, where they can rapidly provision elastic and scalable resources for workloads, and provide higher service levels even in the face of peaks in demand, and external failures.
Were not going to spend a lot of time defining the database cloud, as there are many other presentations that tackle that topic, and theres not yet a clear consensus on the exact definition of a cloud. In general, clouds are pools of resources, that is, hardware, software, and storage, into which you can deploy applications. The resources are shared across multiple applications. Weve known this as consolidation and shared infrastructures, and in the cloud world its referred to as multi-tenancy. Resources in a cloud can be rapidly provisioned, often via a self-service infrastructure. This makes it simple to quickly deploy applications, test beds, and development platforms, increasing an organizations agility. The resources themselves appear to be elastic. They can grow and shrink on demand, appearing infinitely scalable. Management costs are kept low via centralized management and features to automate meeting QoS objectives. End-users need not be concerned with managing the resourcesrather they interact with managed services that allow them to focus on their core business. A final characteristic of the database cloud is pay-for-use-pricing. This lowers the entry cost for users, enabling new use cases that previously may have been economically unfeasible. One last pointa database cloud need not be deployed in a server virtualization environment. We will see there are multiple deployment models for the database cloud, which allow for deployment in both physical and virtual environments
*
Production Site
Sales DB Pool
Sales Clients
Back Office Clients
Most Critical
Least Critical
Back Office DB Pool
Oracle ASM Cluster File System
Replicates Files for Disaster Protection
Oracle Homes, DB Files, Logs, Applications
DR Site
Oracle Homes, DB Files, Logs, Applications
Oracle DataGuard
Sales App Pool
Back Office App Pool
Sales DB Pool
Sales Clients
Back Office Clients
Most Critical
Least Critical
Back Office DB Pool
Sales App Pool
Back Office App Pool
Oracle ACFS Replication
*
Show Whole site DR failover
Oracle ASM Cluster File System
Highly available general purpose cluster file systemSupports all ASM automatic featuresAdvanced Management FeaturesRecover from accidents with point-in-time snapshotsSupports Flexible Continuous ReplicationManage file access policies with ACFSs Security InfrastructureSupports encryption at file or volume levelsEasily aggregate operations across files and types with annotationsExample of automatic operations Backup of entire set of application files with a single
\
command
*