Top Banner
<Insert Picture Here> Oracle ASM Cluster File System (ACFS)- See What’s New Ara Shakian Principle Product Manager
30
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
  • Oracle Confidential

    THE FOLLOWING IS INTENDED TO OUTLINE OUR GENERAL PRODUCT DIRECTION. IT IS INTENDED FOR INFORMATION PURPOSES ONLY, AND MAY NOT BE INCORPORATED INTO ANY CONTRACT. IT IS NOT A COMMITMENT TO DELIVER ANY MATERIAL, CODE, OR FUNCTIONALITY, AND SHOULD NOT BE RELIED UPON IN MAKING PURCHASING DECISION. THE DEVELOPMENT, RELEASE, AND TIMING OF ANY FEATURES OR FUNCTIONALITY DESCRIBED FOR ORACLE'S PRODUCTS REMAINS AT THE SOLE DISCRETION OF ORACLE.

    Oracle Confidential

    *

  • Oracle Confidential

    Table of Contents

    Storage management challengesOracle Cluster File System Cloud EditionASM and ACFS overviewACFS new features in 11.2.0.2 patch set ACFS use casesASM as an integrated solutionASM reference customers

    Oracle Confidential

    *

  • Oracle Confidential

    Challenges of Managing
    Data Explosion

    What problem are we trying to solve?Lack of a single solution for all dataLack of automation in storage provisioningComplexity of managing performanceMulti-vendor support logistics and finger pointingReducing Storage Total Cost of Ownership

    Oracle Confidential

    *

    FS in the past have difficulties with initial space allocation, robustness and reliability.

    Provisioning type of stuff.

  • Oracle Cluster File System-
    Cloud Edition

    What is it?Automatic Storage Management (ASM) ASM Dynamic Volume Manager (ADVM)ASM Cluster File System (ACFS)ACFS data services (snapshot, replication tagging, security, encryption)LicensingIncluded and free with all editions of the database for storing:Oracle Database files, Oracle application binaries, Oracle homesOracle software administrative and diagnostics filesLicense fee required for all non-Oracle database and non-Oracle application files

    Oracle Confidential

    Oracle Confidential

  • Oracle Cluster File System-
    Cloud Edition

    Simplifies pooling of storage across databases, middleware, and applications in a cloudProvides network accessible storage with unified namespace for databases and filesSupports rapid elasticity through online storage provisioning

    Applications

    Middleware

    Database

    Oracle Cluster File SystemCloud Edition

    Oracle VM (optional)

  • 3rd Party FS

    Application

    Managing ALL Data within the Cloud

    Oracle Cluster File System Cloud Edition

    Automatic Storage Management (ASM)

    ASM Cluster & Single Node File System (ACFS)

    Database RAC

    ASM Files

    DB Datafiles

    DB Datafiles

    DB Datafiles

    OCR & Voting files

    ASM

    Disk

    Group

    Dynamic Volume Manager

    Dynamic Volumes

    ACFS FS
    Oracle Bin

    3rd Party
    FS

    Tagging

    Replication

    Security

    Encryption

    Snapshot

  • Oracle Confidential

    Automatic Storage Management Overview

    File system and volume manger for all data Storage pool for provisioning and consolidation Dynamic rebalancing for even distribution of IO Flexible Striping and mirroring for performance

    and availability

    ASM
    Disk Group

    Simplifies and automates file management Reduces complexity and overhead Provides best performance Reduces total cost of ownership

    Key Benefits

    Key Features

    ASM Disk

    ASM Disk

    ASM Disk

    ASM Disk

    ASM Disk

    Oracle Confidential

  • Sales Pool

    Sales Clients

    Back Office Clients

    Most Critical

    Least Critical

    Back Office Pool

    Oracle Automatic Storage Management
    Enables Elastic Storage

    Alert: Disk space low Add more storage.

    Action: Storage added rebalancing started.

    *

    Slide Goal: To provide a virtual demonstration of the product in action.

    SLIDE IS ANIMATED

    Modern application performance is made up of several interlocking pieces that span the technology stack. Much effort has been focused on delivering and deploying an application. However, this is not ultimately what an end-user sees. The end-user experience is defined by the runtime performance of an application. While many tools allow for monitoring an applications this, it is not enough. What is required is Active runtime quality of service management that can both identify bottlenecks and adjust resources to ensure the most important applications maintain their required levels across ever-changing demand.

    Here we have an RTI datacenter with 3-tier and 2-tier systems operating within their response time objectives. We have 3 Pools in each of the top three tiers and a common storage pool for a total of 10 managed pools.

    Demand for the EMEA Sales application rises the SLO is violated.

    2. The QoS system compensates by adjusting a resource such as CPU shares while still meeting objectives.

    3. Suddenly our most important DB server pool goes red for all Sales apps.

    4. Resources, such as a server, are reallocated from our least important DB server group to restore performance

    We are instrumenting the entire Oracle stack to enable us to provide true QoS management thereby allowing you in the end to effectively run your applications on cruise control.

  • Oracle Confidential

    ASM Dynamic Volume Manager

    New general purpose volume platformSupports ACFS and 3rd party file systemsEliminates the need for 3rd party VMgrs New ASM volume management serviceCluster and single host volumesLoadable kernel driverDynamic Volume is an ASM file+DATA/volume1 /dev/asm/volume1-123Leverages ASM featuresEasy on line provisioning Cross platform (Linux, Windows, UNIX)Managed using ASMCMD, EM and SQL

    Note: An AVD volume device may not be used as an OS boot or swap device, nor used as a root file system of the OS

    ASM DG

    /dev/asm/volume1-123

    +DATA/volume1

    OS

    Oracle Confidential

    *

    The ASM Dynamic Volume Manager is a kernel loadable device driver and services that provides volume management services and a standard device driver (ASM device driver (AVD)) interface to clients (i.e. ACFS). File systems or other user processes can do I/O to this device driver as they would to any other disk device driver on the system. AVD is the primary I/O interface for ACFS to perform I/O and build a file system leveraging ASM as a volume manager. DVM is loaded upon ASM start up. The device driver is cluster aware and communicates with ASM for extent map information, extent rebalancing and I/O failures.

    An OS device file is created automatically when a dynamic volume is created in an ASM disk group.

  • Oracle Confidential

    General purpose file system for non-DB filesJournaling, extent basedPOSIX, X/OPEN file system solution for UNIX/LinuxWindows file system solution for Windows platforms Single node and clusterScalable and high performanceSupports NFS and CIFS protocolsMulti OS platform - Linux, Windows, Solaris and AIXIntegrated with Oracle system mgt toolsOracle installation/configuration, EM and native OS toolsSupports advanced data servicesSnapshot, Replication, Tagging, Security and Encryption

    What is ASM Cluster File System (ACFS)

    Oracle Confidential

    *

    The ASM Cluster File System,(ACFS), extends Automatic Storage Management (ASM) by providing a robust, modern general purpose extent-based and journaling file system for files beyond the Oracle database files. ACFS provides support for files such as Oracle binaries, report files, trace files, alert logs and other application data files. With the addition of the ACFS, ASM becomes a complete storage management solution for both Oracle database and non-database file. ACFS scales from small files to very large files (exabytes) and supports large numbers of nodes in a cluster. ACFS is an extent-based file system to provide high performance and a utilizes a log based metadata transaction engine for file system integrity and fast recovery. The ACFS on-disk structure supports endian neutral metadata[u1]. ACFS file systems can be exported to remote clients through industry standard protocols such as NFS and CIFS.

    ACFS eliminates the need for expensive 3rd party cluster file system solutions while streamlining, automating and simplifying all file type management in a single node as well as RAC and Grid computing environments. ACFS supports dynamic file system expansion and contraction without any downtime. ACFS is highly available leveraging the ASM mirroring and striping features in addition to leveraging hardware RAID functionality. [u1]Need to say why and benefit

    Journaling:

    ACFS metadata is logged

    Extent based:

    File system is allocated and managed as extents

  • Oracle Confidential

    Whats New in
    Oracle ASM 11g 11.2.0.2 - Patch Set 1

    LinuxWindowsSolaris/AIXBug FixesYesYesYes, + PortSnapshotYesYesYes + PortTagging, Replication, Security, EncryptionYesFutureFuture

    Oracle Confidential

    Comments/Harsha

    Just want to confirm. Is the name 11.2.0.2 or 11g 2.0.2 is also fine as used here?New Features for Linux and Windows. We do not support new features on Windows now.ACFS Unified Security Infrastructure We used to call the project (encryption + security combined) with this name. We use ACFS Security to refer to Realm-based security.

    *

  • Oracle Confidential

    ACFS Tagging

    ACFS Tagging allows group operations on files spread throughout your file systemsACFS Tagging assigns a common naming attribute to a group of filesFile operations can be performed based on tagging attributesTagging is configured and managed by acfsutil tag command lineSpecify tag names for directories and files

    $ /sbin/acfsutil tag set r resume /dev/asm/acfsvol- 302/test/resumes

    Oracle Confidential

    Comments/Harsha

    1) Last bullet:- Security and Encryption do not really leverage ACFS Tagging

    *

  • Oracle Confidential

    ACFS Replication

    Compliments Data Guard and provides a complete DR solution for all filesEnables replication of ACFS file systems across the network to a remote siteReplication logs are used to replicate from primary to standby asynchronously

    Oracle Confidential

    *

  • Oracle Confidential

    Key Drivers for Data Security &
    Encryption

    Sarbanes-Oxley (SOX), J-SOX, HIPAA

    GLBA

    Payment Card Industry (PCI)

    EU Privacy Directives, CA SB 1386.

    Adequate IT controls, COSO, COBIT

    Separation of duty, Proof of compliance, Risk Assessment and Monitoring

    Regulatory Compliance

    Oracle Confidential

    *

    *

    The need for Data Security solutions is being driven by two business challenges; regulatory compliance and insider threats.

    Regulatory Compliance affects virtually every public company, especially those in highly regulated industries such as the financial sector. I'm sure everyone has heard of Sarbanes-Oxley. Others include the Payment Card Industry (PCI) and the Health Insurance Portability and Accountability Act (HIPAA). One of the really good things that has come out of the regulatory compliance push is that it has given organizations time and budget to go back and look at the internal processes.

    The second factor driving is security is the desire to reduce the risk associated with insider threats. Some studies have concluded that upward of 80% of all threats originate from inside the organization. The issue takes on even greater significance when you consider the trend to outsourcing/offshore more IT functions.

    Comment/Harsha Just want to mention that we mainly address insider threats and encryption with our featuresnot so much the other topics mentioned in this slide

  • Oracle Confidential

    ACFS Security

    Fine grained access control in addition to OS ACLsEnforces security policies through realms, rules, rule sets and command rules Realm is a group of files/directories secured for access by usersRule sets are collection of rulesCommand rules use rule sets to allow/disallow operationsIntegrated with Oracle system mgt toolsASMCA support for basic configurationsExtensions to ACFS command line tools for easy use via acfsutil

    Oracle Confidential

    Comments/Harsha

    ACFS Unified Security Infrastructure ACFS SecurityNit: thru throughASMCA support for installation and configuration ASMCA support for basic configuration

    *

  • Oracle Confidential

    ACFS Encryption

    Protects data-at-rest through encryptionPrevents unauthorized use of data in case of data loss or theftSecure encryption keys to decode dataFlexibility to encrypt the entire file system and/or just individual files and directoriesTransparent to users and applicationsUsers and apps get decrypted data High level protection using two keysFile Encryption Key (FEK) to encrypt file dataVolume Encryption Key (VEK) to encrypt FEK

    Oracle Confidential

    *

    *

  • ACFS Use Cases

    ACFS file systems exported thru NFS/CIFSACFS file systems exported thru NFS/CIFSSingle node or cluster ACFS file systemsSingle node or cluster ACFS file systems

    Data Type

    Data Model

    ACFS

    ACFS

    ACFS

    Personal files

    Home directories, documents, etc...

    System and application files

    System filesApplication binaries

    Business data

    Business files not stored in the databaseBusiness critical data
  • Store Personal Files on ACFS

    Configure ACFS as a Network File ServerSingle node or cluster for HAEasy provisioningSimple managementClient computers can mount ACFS NFS/CIFS file systemsHome directories, documents, photos and personal data

    NFS or CIFS

    Network Protocols

    ACFS Network File Server

    (NFS/CIFS)

    ACFS FS

    mount points

  • System & Application Files on ACFS

    ACFS configuration alternativesACFS single node or cluster serverACFS Network File ServerData types on ACFSSystem files (not including boot FS and Grid Infrastructure home)System files, trace files, log files, import/export files, system and application dump files, etcApplication files and binariesOracle database home (Shared or node-local)Oracle and 3rd party application binaries and supporting files I.e. SAP, Siebel, PeopleSoft, etc

    ASM Disk Group

    Oracle DB

    Binaries

    SAP

    Application

    Binaries

    Siebel

    Application

    Binaries

    ACFS

    File Systems

    Oracle

    EBusiness

    Suite

    3rd Party

    File System

  • Business Data on ACFS

    Database external files may be stored in an ACFS clusterData typesFiles or data managed by business applications not stored in databaseImages, manuals, reports, contracts, external tables, and BFILEsBusiness critical dataApplication data with true cluster file system functionality requirements (cache coherency, shared read/write, etc)

    ASM Disk Group

    BFILEs

    Reports

    ACFS File Systems

    External

    tables

    Photos

    Images

    Medical

    Images

  • "Oracles new security feature in ACFS gives us fine-grain and secure control over sensitive data that needs the extra protection.In addition, ACFS replication coupled with Oracle Data Guard provide a complete Disaster recovery solution for database files, external files and all other general purpose files in the OS".

    Daniel Smith

    Senior DBA, Carfax Inc.

    *

  • "Oracle Database 11g Release 2 (11.2.0.2) takes us a step closer to Cloud Computing and Cost Optimization. The new RAC Quality of Service Management (QoS) coupled with wider platform support for ASM Cluster File System (ACFS) and RAC One node enable predictable performance and higher availability, both essential in consolidated environments."

    NTT Data Interlink

    *

  • Oracle Confidential

    One Integrated Solution for ALL Data

    Always On-Line

    Optimal Utilization

    Scalable

    High Performance

    Low Cost

    Simple

    One Vendor for Support

    One Management Interface

    One Clusterware Framework

    One Install and Configure

    Cross Platform
    Linux, Windows, Solaris,
    HP-UX, AIX

    Structured
    Data

    Un-structured
    Data

    ASM

    ACFS

    &

    Dynamic Volumes

    Oracle Clusterware

    Oracle Database

    &

    RAC

    Snapshot

    Replication


    Tagging

    Security

    Encryption

    RAC One

    Oracle Confidential

    *

    Add application layer on ACFS

    Breakout slide for management

  • Oracle Confidential

    ASM adoption

    De-facto standard for RAC and grid deployments, >65%De-facto standard for VLDB deploymentsLarge and growing adoption for single instance deployments, >20%Thousands of customers using ASMOne of the most popular features in the database

    Update stats

    Oracle Confidential

    *

  • Oracle Confidential

    Some ASM Reference Customers In Production

    Update customer list

    Oracle Confidential

    *

  • Oracle Confidential

    Oracle Confidential

    *

  • Storage Cloud

    Storage serviceCharacteristicsStorage poolingNetwork accessible storage, files, and dataElastic storage pool

    Cloud Computing Infrastructure

    Application Cloud

    Database Cloud

    Storage Cloud

    The data center has evolved. Mainstream customers have left the world of dedicated silos, with their physical, dedicated hardware, peak load sizing, and expensive management paradigms. Theyve moved to grids, virtualizing their resources to provide enhanced flexibility, better utilization and improved efficiencies. Now leading customers are taking the next stepconsolidating their workloads into clouds, where they can rapidly provision elastic and scalable resources for workloads, and provide higher service levels even in the face of peaks in demand, and external failures.

    Were not going to spend a lot of time defining the database cloud, as there are many other presentations that tackle that topic, and theres not yet a clear consensus on the exact definition of a cloud. In general, clouds are pools of resources, that is, hardware, software, and storage, into which you can deploy applications. The resources are shared across multiple applications. Weve known this as consolidation and shared infrastructures, and in the cloud world its referred to as multi-tenancy. Resources in a cloud can be rapidly provisioned, often via a self-service infrastructure. This makes it simple to quickly deploy applications, test beds, and development platforms, increasing an organizations agility. The resources themselves appear to be elastic. They can grow and shrink on demand, appearing infinitely scalable. Management costs are kept low via centralized management and features to automate meeting QoS objectives. End-users need not be concerned with managing the resourcesrather they interact with managed services that allow them to focus on their core business. A final characteristic of the database cloud is pay-for-use-pricing. This lowers the entry cost for users, enabling new use cases that previously may have been economically unfeasible. One last pointa database cloud need not be deployed in a server virtualization environment. We will see there are multiple deployment models for the database cloud, which allow for deployment in both physical and virtual environments

    *

  • Production Site

    Sales DB Pool

    Sales Clients

    Back Office Clients

    Most Critical

    Least Critical

    Back Office DB Pool

    Oracle ASM Cluster File System
    Replicates Files for Disaster Protection

    Oracle Homes, DB Files, Logs, Applications

    DR Site

    Oracle Homes, DB Files, Logs, Applications

    Oracle DataGuard

    Sales App Pool

    Back Office App Pool

    Sales DB Pool

    Sales Clients

    Back Office Clients

    Most Critical

    Least Critical

    Back Office DB Pool

    Sales App Pool

    Back Office App Pool

    Oracle ACFS Replication

    *

    Show Whole site DR failover

  • Oracle ASM Cluster File System

    Highly available general purpose cluster file systemSupports all ASM automatic featuresAdvanced Management FeaturesRecover from accidents with point-in-time snapshotsSupports Flexible Continuous ReplicationManage file access policies with ACFSs Security InfrastructureSupports encryption at file or volume levelsEasily aggregate operations across files and types with annotations

    Example of automatic operations Backup of entire set of application files with a single

    \

    command

    *