8/12/2019 Storage Overview & Architecture
1/57
Storage Overview AndArchitecture
Arvind Shrivastava
8/12/2019 Storage Overview & Architecture
2/57
8/12/2019 Storage Overview & Architecture
3/57
Direct Attached Storage(DAS)
Low Cost Solution
Simple to Configure
De-Centralized Storage
No Storage Consolidation
No High Availability
Low Performance
8/12/2019 Storage Overview & Architecture
4/57
Network Attached Storage(NAS)
Heterogeneous Environment
Centralized Storage
Low Performance
Limited scalability
Network Congestion during backups & Restore
Ethernet Limitations
8/12/2019 Storage Overview & Architecture
5/57
Storage Area Network
Heterogeneous environment
Centralized Storage Management
High Degree of Fault Tolerance
Best and superior performance
Storage Consolidation
Fast and efficient backups and restores
Dynamic Scalability
Expensive solution for small setups
8/12/2019 Storage Overview & Architecture
6/57
8/12/2019 Storage Overview & Architecture
7/57
Mid-Range Storage Features
Excellent ease of use Virtualization Dynamic virtual disk expansion
Business Copy functions Continuous Access functions High availability features
High, middle*, and low models and configurations Multiple operating system support Single pathing support for all operating systems Coexistence with heterogeneous configurations
8/12/2019 Storage Overview & Architecture
8/57
8/12/2019 Storage Overview & Architecture
9/57
8/12/2019 Storage Overview & Architecture
10/57
8/12/2019 Storage Overview & Architecture
11/57
Continuous Access-Overview
8/12/2019 Storage Overview & Architecture
12/57
Flex Copy Concept
Features Allows use of low end storage
for low-cost point-in-time copiesof production data
Point-in-time copy to and restorefrom Low end storage
CLI or GUI ConfigurationBenefits
Reduced TCO in mixedproduct/non-production
Offloads production data fromsecondary operations
Allows for distributed remotedata and hi performance two-stage backup/archiveconfigurations
Cost-effective, externalpoint-in-time copies
Low endstorage
P
C1
Enterprisestorage
8/12/2019 Storage Overview & Architecture
13/57
Product Positioning
8/12/2019 Storage Overview & Architecture
14/57
8/12/2019 Storage Overview & Architecture
15/57
8/12/2019 Storage Overview & Architecture
16/57
Additional Features EVA4000/6000/8000
Additional features unique to the second generation EVA
New controllers with improved performance, higher capacity support, larger cache, more FC ports Up to 200TB of presented capacity (versus 35TB for the first generation EVA)
Support for 1024 LUNs (first generation EVA was 512) Support for active -active failover using multipath softwarefor all operating systems Increased support for boot from SAN (AIX, Solaris) Direct Connect support for Windows Additional CA functionality Support for native HBAs and HBA drivers Additional snapshot and snapclone functionality
8/12/2019 Storage Overview & Architecture
17/57
Useful Links
Information sources :-
HP Enterprise Virtual Arrayhttp://h18006.www1.hp.com/storage/arraysystems.html
HP Command View EVAhttp://h18006.www1.hp.com/products/storage/softwar e/cmdvieweva/index.htm
Whitepapershttp://h18006.www1.hp.com/storage/arraywhitepapers.html
8/12/2019 Storage Overview & Architecture
18/57
Storage backup OverviewAnd Architecture
Arvind Shrivastava
8/12/2019 Storage Overview & Architecture
19/57
BACKUP SOFTWARE
What is it? Software that provides automated data protection for businesseswith 24x7 availability needs.
What does it do? Data Protection : copies data onto a storage device, so that in
case of a need (loss, corruption, disaster), data can be easilyrecovered and made accessible.
Media management: easily manages the library catalogues tokeep track of all media and copies of data for fast recovery.
Most important features: Automated backups that scale from small workgroups to multi-
site, heterogeneous SAN & NAS environments with thousands ofservers.
Fully-integrated Zero-Downtime backup with Instant-Recovery .
8/12/2019 Storage Overview & Architecture
20/57
Architecture Components
manager ofmanagers
distributedGUI
operationsconsole
cellmanager
cellclients
8/12/2019 Storage Overview & Architecture
21/57
Client-Server Modules
media agent(MA)
disk agent(DA)
cell console(CC)cell manager(CM)
8/12/2019 Storage Overview & Architecture
22/57
Inter-process Communication (IPC)
sessionmanager
cell manager
tcp/ip
tcp/ip
tcp/ip
disk agent
media agent
disk agent
media agent
tcp/ip
tcp/ip
scheduler
cell console
networkbackup/restore
localbackup/restore
sharedmemory
sessionmanager
8/12/2019 Storage Overview & Architecture
23/57
How to choose between tape drives and tape librariesservers
Tape drives Autoloaders Tape Libraries
Servers are configuredindividually andbackup device is
connected directly tothe server
Disk capacity to bebacked up is less than200 GB
Cost consciouscustomer
Single/Multiple servers Unattended backup LAN based Backup Disk capacity to be
backed up is 200 GBto 1 TB
Consolidation isrequired
Multiple servers areconfigured together
Unattended backup LAN or SAN based
backup Disk capacity to be
backed up is morethan 1 TB
Consolidation andcentralizedmanagement isrequired
Storage external toservers in JBOD ordisk arrays
8/12/2019 Storage Overview & Architecture
24/57
25GB
100GB
50GB
6 10025 50 200Speed GB/hour (compressed)12
C a p a c
i t y
( c o m p r e s s e
d )
Relative Performance
Ultrium 215
Ultrium 230
DAT 40
Ultrium 460SDLT 320
DAT 24
400GB
200GB
DLT VS80
Workstations
Office Servers
Departmental/
local network
Corporate/networked
backup
DAT 72
8/12/2019 Storage Overview & Architecture
25/57Complied by Ranganath Sadasiva
Tape DeviceN a tive Com pressed N a tive Com pressed N a tive Com pressed
DAT 12/ 24 1.2 2.4 12 24 4.32 8.64DAT 20/ 40 2.4 4.8 20 40 8.64 17.28DAT 72 3 6 32 72 10.8 21.6DLTvs80 3 6 40 80 10.8 21.6DLTvs160 8 16 80 160 28.8 57.6
DLT 80 (obs) 6 12 40 80 21.6 43.2SDLT 110/ 220(obs) 11 22 110 220 39.6 79.2Ultrium 215 7.5 15 100 200 27 54Ultrium 230 15 30 100 200 54 108SDLT 160/ 320 16 32 160 320 57.6 115.2SDLT 600 36 72 300 600 129.6 259.2Ultrium 448 24 48 400 800 86.4 172.8Ultrium 460 30 60 200 400 108 216Ultrium 960 80 160 400 800 288 576
Date Transfer Speed MB/ Sec Data Capaci ty in GB
Ba ck up capa city GB / hour-
m a x
Tape drives Speeds and feeds - Comparison
8/12/2019 Storage Overview & Architecture
26/57
Features
Features Required in any Backup software Advanced backup to disk Oracle/SAP Integrations Zero Downtime Backup
Split mirror Snapshot Snapclone Filesystem / application backup on inactive MC/SG node
8/12/2019 Storage Overview & Architecture
27/57
Overview Advanced backup to disk
Why backup to disk?Benefits
Fast random access allowing: Fast single file restore Space efficient backup
Instant recovery e.g. switching for recovery instead of restoring
data from tape Faster restore of backup chains No tape streaming problems Ideal for RAID 5 Easy to detect disk failures More protected, e.g. it s not easy to steal a disk
8/12/2019 Storage Overview & Architecture
28/57
Advantages of ZDB
The advantages of using Data Protector Oracle ZDB
integration are the following: ZDB reduces the performance degradation of theapplication system. The tablespaces are in backup mode (online backup) or
the database is shut down (offline backup) only during theshort period required to create a replica (split the mirrordisks or create snapshots). The time to create a replica is significantly reduced.
Following its creation, tape backup can be created on thecopied data, at leisure , using a separate backup system.The Data Protector Oracle ZDB integration offers onlineand offline backup of your Oracle Server System(application system).
8/12/2019 Storage Overview & Architecture
29/57
BACKUP CONCEPT-SPLIT MIRROR BACKUP
8/12/2019 Storage Overview & Architecture
30/57
ZDB Setup
P
P primary LDEV
M mirror copy (MU0-2)
True online backup for
integrated applications Split mirrors may used for
instant recovery or resynced
No performance impact onapplications during backup
Mirror synchronization beforeor after backup
Automatic mirror rotation
API based integration
Backup host
Application host
MM
XP
M0 21
8/12/2019 Storage Overview & Architecture
31/57
Backup Software and Storage Integration Concept
Client 1 Client 2
8/12/2019 Storage Overview & Architecture
32/57
8/12/2019 Storage Overview & Architecture
33/57
Questions?
8/12/2019 Storage Overview & Architecture
34/57
New HP Storage Products
Arvind Shrivastava
8/12/2019 Storage Overview & Architecture
35/57
RISS
Introducing
HP StorageWorksReference InformationStorage System
What is RISS is and who wants it?
Th HP St g W k
8/12/2019 Storage Overview & Architecture
36/57
The HP StorageWorksReference Information Storage System (RISS)
A cornerstone of HP ILM
(Information LifecycleManagement )A fully integrated and uniquely
scalable system for access to
reference information that reduces Total cost of
Ownership, mitigates risk andturns data into information
HP St g W k
8/12/2019 Storage Overview & Architecture
37/57
HP StorageWorksReference Information Storage System
Manage Costs Remove static data from application
servers/storage Shorten backup windows
Eradicate duplicate data objects
Mitigate Risks Automated retention of messages &
attachments Data is digitally signed, time stamped &
protected Assist customers to meet their compliance
requirements
Exploit Data Assets Power indexing!
Grid computing for fast search/retrieval
8/12/2019 Storage Overview & Architecture
38/57
AB C
AB C A
B C
AB C
As the number of information objects grows
cost of management increases accessibility to the information decreases
Scale is the Problem
TCO $
# of content objects managed
Access
Time
TCO
Performance
HP StorageWorks RISS
8/12/2019 Storage Overview & Architecture
39/57
HP StorageWorks RISSarchitectural benefits
back end '
front end'
Modular, redundant, self healing gridcomputing and storage (smart cells)
Application-independent indexing, search andretrieval of information
Objects in the RISS cannot be modified or deleted
until end of retention period
Content is digitally signed and time stampedfor regulatory compliance
User Application
Application Integration
RISS
Open protocol API
Clients
smart cell
Application integrationwith e-mail and MS Office
Client applications get added archive functionality(architecture transparent to them)
smart cell
8/12/2019 Storage Overview & Architecture
40/57
hp StorageWorksFile System Extender (FSE)
A General Overview
Arvind Shrivastava
8/12/2019 Storage Overview & Architecture
41/57
What is FSE?
HP StorageWorks File System
Extender (FSE) is new-generationdata management software that ispart of the HP InformationLifecycle Management portfolio. Enables automatic andtransparent data movementbetween production (primary)storage media and secondarystorage media, using simple user-defined rules.
8/12/2019 Storage Overview & Architecture
42/57
Changing digital storage demands
Time
S t o r e
d d a
t a
Reference
Operational
Majority is reference
information
FSE attacks thecosts of
reference data
8/12/2019 Storage Overview & Architecture
43/57
FSE Basics
Based on Client/Server architecture.
Infinite File System FSE software supports LTO drive technologies for
LTO Ultrium 1 and LTO Ultrium 2 media.
WORM Support. Automatic error detection FSE automatically detects drive and mediahardware errors. NFS & CIFS support
8/12/2019 Storage Overview & Architecture
44/57
Managing storage spaces
FSE storage spaces
8/12/2019 Storage Overview & Architecture
45/57
MSA/EVA & FSE
productionstorage SCSI
disk
MSA1500/EVA
secondary
storageSATA/FATA disk
secondarystorage
MSL tape library
1. Inactivefiles movedfrom SCSI toSATA disk
2. Optionalsecond copyto tape
3. Automatic &transparentrecall ofmigrated files
4. File recallfrom second
copy if firstunavailable
8/12/2019 Storage Overview & Architecture
46/57
HP EFS WAN Accelerator
8/12/2019 Storage Overview & Architecture
47/57
HP EFS WAN AcceleratorHow Does it Work?
Removes All Redundant TCP Traffic on WANs
Files, Emails, Backup, Web Traffic, FTP, Applications Stores All TCP Traffic On Disk Never Send The Same Data Twice Reduces WAN Traffic By Up To 98%
Optimizes Application Protocol Behavior Removes Most Round Trips for Chatty Apps Like Windows Highly Effective for the Most Common Applications
Optimizes the Behavior of TCP Reduces Chattiness in TCP Implements Latest TCP Optimizations
Up to 100 Times Faster Throughput
HP EFS WAN Accelerator
8/12/2019 Storage Overview & Architecture
48/57
HP EFS WAN AcceleratorThree-part Solution
The Problem HPs Solution What it Does
1. Not EnoughBandwidth
Scalable DataReferencing (SDR)
Remove repeatedbytes from the WAN forall TCP traffic
2. TCP Chattinessand Inefficiency
Virtual WindowExpansion (VWE)
Optimizes performanceof TCP
High speed TCPoptimizations
Enables much higherthroughput on LFNs
3. ApplicationChattiness andInefficiency
Transaction Prediction(CIFS, MAPI)
Optimizes theperformance of specificapplications
HP EFS WAN Accelerator
8/12/2019 Storage Overview & Architecture
49/57
HP EFS WAN AcceleratorManagement Features Overview
EFS WAN Accelerator Manager
Provides central management of up to 500 appliances Provides fleet management
Monitors health, throughput & acceleration done Performs SW updates to groups of nodes
Separate product packaged as an appliance
HP Proliant Management HP Systems Insight Manager
Full Integrated Lights-out (iLO) support
8/12/2019 Storage Overview & Architecture
50/57
HP Storage Essentials Suite
Storage Software DivisionHewlett-Packard
Unified Management of Server and Storage
8/12/2019 Storage Overview & Architecture
51/57
Unified Management of Server and StorageInfrastructure
Storage Island
Efficiency
Consolidate infrastructuremgmt tools
Centralize and automate
routine tasksImprove deployment costs
Lower training costs
Deploy resources faster andmore reliably
Enable IT agility
Single point of integrationbetween business process and ITinfrastructure
Specify SLAs across entireinfrastructure
Consistent security model forentire infrastructure
Quick access to businessoperation metrics (e.g., audit andusage reports)
Increase availability
Quicker time to problemresolution
Manage systems remotelyfrom any location
Server Island
http://www.skyscraperpicture.com/gg3.jpg8/12/2019 Storage Overview & Architecture
52/57
Introducing HP Storage Essentials
Chargeback
OracleViews
CustomizeReports
ExchangeViews
File SystemViewsProvisioning
Capacity Performance TopologyMaps
SybaseViews
CentralizedReporting
Policy Mgr GUI & CLUI
3 rd Party/HP Developed
Main console for open , he terogeneousSAN management
Enterprise Edition
Provisioning Mgr
Chargeback Mgr
Oracle Viewer
Main console for o pen ,heterogeneousSAN management
Heterogeneous host to array pathp rov is ion ing wizard
Asset based chargebackmanagement . Assig n t ie rs
Oracle database availability andperformance v iews
Exchange d atabase avai lab i l i ty andperform ance v iews
Exchange Viewer
Sybase database availability andperform ance v iews
File System Viewer
Global Reporter
Report Designer
Sybase Viewer
File sys tem scannin g rec la imwasted space
Rollup report ing o f mult ip le StorageEssent ia ls Server ins tances
Develop cust om repor ts for s torageinfras truc ture
8/12/2019 Storage Overview & Architecture
53/57
HP St g E ti l O l Vi
8/12/2019 Storage Overview & Architecture
54/57
HP Storage Essentials Oracle Viewer
Capabilities:
Discovers databaseinstances, hosts,databases &tablespaces
SAN dependency &path management
Closed loop capacitymanagement
Real-time performancemonitoring
Role-based securityPolicies, events,
reports
Extends StorageEssentials capabilities
"inside" Oracle databasesto ensure availability and performance of databaseapplications
Wh i h P i ?
8/12/2019 Storage Overview & Architecture
55/57
Where is the Pain ?
Under-utilized assets
Storage infrastructure IT staff
Cost of heterogeneous management isexpensive and inefficient
Application down time issues angers thecustomer
Troubleshooting is time consuming Help desks are flooded
Server consolidation/data center movesdrives the budgetOn-going justification of the budget
What happened to all the storage? Why do we need more now? When
again?
Key Qualification Questions
8/12/2019 Storage Overview & Architecture
56/57
y Q QIdent i fy ing the Pain Poin ts
How do you manage increasing storage capacity with flat or shrinkingIT headcount?
Do you have a SAN? Can you tell what the impact of a lost SANelement will be on your applications and users?
How do you keep your staff trained on a wide range of device-specificelement managers and tactical SRM tools that, right now, only addcomplexity?
Do you want to replace the whiteboards and spreadsheets yourecurrently using for SAN management with something that is morescalable and reliable?
How do you avoid vendor lock-in and heavy, proprietary agents thatcome with other solutions?
Can you provision storage in real time to support new applications andprojects?
How do you comply with SAN change control and internal audits?
8/12/2019 Storage Overview & Architecture
57/57