-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
WelcometoISPTIsilon
Fundamentals.Copyright1996,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013EMCCorporation.AllRightsReserved.EMCbelievestheinformationinthispublicationisaccurateasofitspublicationdate.Theinformationissubject
tochangewithoutnotice.THEINFORMATIONINTHISPUBLICATIONISPROVIDEDASIS.EMCCORPORATIONMAKESNOREPRESENTATIONSORWARRANTIESOFANYKINDWITHRESPECTTOTHEINFORMATIONINTHISPUBLICATION,ANDSPECIFICALLYDISCLAIMSIMPLIEDWARRANTIESOFMERCHANTABILITYORFITNESSFORAPARTICULARPURPOSE.
Use,copying,anddistributionofanyEMCsoftwaredescribedinthispublicationrequiresanapplicablesoftwarelicense.EMC2,EMC,DataDomain,RSA,EMCCentera,EMCControlCenter,EMCLifeLine,EMCOnCourse,EMCProven,EMCSnap,EMCSourceOne,EMCStorageAdministrator,Acartus,AccessLogix,AdvantEdge,AlphaStor,ApplicationXtender,ArchiveXtender,Atmos,Authentica,AuthenticProblems,AutomatedResourceManager,AutoStart,AutoSwap,AVALONidm,Avamar,Captiva,CatalogSolution,CClip,Celerra,Celerra
Replicator,Centera,CenterStage,CentraStar,ClaimPack,ClaimsEditor,CLARiiON,ClientPak,CodebookCorrelationTechnology,CommonInformationModel,ConfigurationIntelligence,Configuresoft,Connectrix,CopyCross,CopyPoint,Dantz,DatabaseXtender,DirectMatrixArchitecture,DiskXtender,DiskXtender
2000,DocumentSciences,Documentum,elnput,ELab,EmailXaminer,EmailXtender,Enginuity,eRoom,EventExplorer,FarPoint,FirstPass,FLARE,FormWare,Geosynchrony,GlobalFileVirtualization,GraphicVisualization,Greenplum,HighRoad,HomeBase,InfoMover,Infoscape,Infra,InputAccel,InputAccel
Express,Invista,Ionix,ISIS,MaxRetriever,MediaStor,MirrorView,Navisphere,NetWorker,nLayers,OnAlert,OpenScale,PixTools,Powerlink,PowerPath,PowerSnap,QuickScan,Rainfinity,RepliCare,RepliStor,ResourcePak,Retrospect,RSA,theRSAlogo,SafeLine,SANAdvisor,SANCopy,SANManager,Smarts,SnapImage,SnapSure,SnapView,SRDF,StorageScope,SupportMate,SymmAPI,SymmEnabler,Symmetrix,Symmetrix
DMX,Symmetrix
VMAX,TimeFinder,UltraFlex,UltraPoint,UltraScale,Unisphere,VMAX,Vblock,Viewlets,VirtualMatrix,VirtualMatrixArchitecture,VirtualProvisioning,VisualSAN,VisualSRM,Voyence,VPLEX,VSAMAssist,WebXtender,xPression,xPresso,YottaYotta,theEMClogo,andwhereinformationlives,areregisteredtrademarksortrademarksofEMCCorporationintheUnitedStatesandothercountries.
Allothertrademarksusedhereinarethepropertyoftheirrespectiveowners.
Copyright2013EMCCorporation.Allrightsreserved.PublishedintheUSA.
RevisionDate:November2013RevisionNumber:MR7WPISPTISIF_1.0
1ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
This coursecoversEMCIsilons
ScaleoutStoragePlatformpoweredbytheOneFSoperatingsystem.
ItalsocoversEMCIsilons productlinesand
broadrangeofoptionsandsoftwareapplications.ThiscourseisintendedforanyoneseekingtoestablishabasicunderstandingoftheEMCIsilonplatform.
2ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
This moduledescribesEMC Isilons
scaleoutsolution.BusinessrequirementsbyindustryarealsopresentedalongwithinformationonhowEMCIsilonmeets
theserequirements.
ISPT Isilon Fundamentals 3
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
LetsstartwithLifeSciencesresearch.Capacityandperformancearetwokeyconsiderations.Researchersplanforhundredsofterabytestopetabytes.Storagesystemscanbecomearesearchbottleneckwithouttherightlevelofperformance.Theabilitytodeliverhighperformancedataaccessinparalleltoalargeaggregateofclientsistypicallythedeterminingfactorfortotalprocessingtime.Mostresearchfacilitiessimplydonthavethestafftomanagecomplexstoragesolutions.Themanagementofanidealstoragesystemshouldnotrequireanyadditionalordedicatedworkers.Thesurveillanceindustryisinterestedindatasecurity,inadditiontomassivestoragecapacityrequirements.Protectingvideosurveillancedatafromaccidentalormaliciousalterationordeletionisamust.Videostreams,especiallyhigherresolutionandwithlongerretentionperiods,canconsumestoragerapidly,whichmeansstorageAdministratorsmustbeabletoscaletheirstorageinfrastructurequicklyandnondisruptively.Avideosurveillancestoragesystemcanquicklybecomeoverloadedasmorecamerasarebroughtonline.Systemsthatcannotkeepupwithagrowingsurveillanceworkloadwillcausedatatobedropped.
ISPT Isilon Fundamentals 4
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Whenitcomestofinancialinstitutions,speedanddepthforperformingquantitativeanalysisisvitalingainingacompetitiveedge.Theseanalysisrequirehighperformanceandscalability.Companiesoftencantaffordworkstoppagesorslowdownstoupgradeequipment.Themediaandentertainmentindustryismadeupofavarietyoforganizationsandworkflows.Broadcastorganizationsneedtoreducecapitalandoperationalexpensesforstorageequipment.Postproductioncompaniesneedtostorevideoandaudiomodelswiththousandsofframesresultinginhundredsofterabytesofdata.Thereisconstantpressuretomeetaggressivetimetoproductiondeadlines,whichaddscomplexitytomanagement.Today,mediafilesizescontinuetoincreaseasresolutionsgrowfromHDto2K,4K,and8K,makingscalabilityanimportantissuetoconsider.
ISPT Isilon Fundamentals 5
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
WiththetechnologicaladvancesinHealthcareapplications,thedatabeinggeneratedisgrowingatanunprecedentedrate.Applicationsareincreasinglydensewithmillionsofslidesand3Drendering.Havingastoragesystemthatcangrowlargeenoughtosupporttheseapplicationsischallenging.ThedifferentrequirementsforstoragewithintheHealthcareenvironmentareoftensolvedbycreatingmultiple"silos"ofstorage.Datawithdifferentretentionguidelinesorperformanceneedscannotexistwithinthesamestoragesystemintraditionalenvironments.Managingmultiple,differentiatedstoragesolutionsfordifferentdepartmentsrequiresalargeITworkforceandisbecomingincreasinglydifficulttomanage.ThereisahugeamountofdatagrowthintheOilandGasindustryasdemandforenergyhasneverbeenhigher.Inordertomakethemassiveamountsofdatauseful,therearetwokeychallenges;processingthedatainanadequate,timelymannerandenablingmoredetaileddatatobeavailableandcorrelatedwhennecessary.Thesearetechnical,algorithmicandorganizationchallengesandleadtolargeexpendituresofcompute,storage,andnetworkpower.
ISPT Isilon Fundamentals 6
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
In
ordertomeetallthepreviousbusinessrequirements,asolutionshouldbedesignedwith
thecapabilitytoscalecapacity,memory,CPUsandnetworkingbysimplyaddingnodestoacluster.Nodescanbeaddedtotheclusterwhenevermoreperformance,connectivity,orcapacityisneeded.Theresourcesofallnodesarepooledtocreateapowerfulaggregatesystem.
ISPT Isilon Fundamentals 7
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilonprovideshighlyscalable,ultrahighperformance,modularstoragesystems.Instoragesystemswithlimitedprocessingcapabilities,thereisacleartradeoffintermsofIOPSorthroughput.InascaleoutsystemsuchasIsilon,atradeoffisnotnecessary;filesanddirectorieswhichrequirehighIOPScanbeoptimizedforsuch,whereasotherswhichrequirehighthroughputcanbeoptimizedforthroughput.EMCIsiloncancontrolperformanceandlayoutcharacteristicsonaperfile,perdirectorybasisaswellasscaleoutbothCPU,cachememory,anddiskinasinglevolume.EMCIsilonscaleoutstoragesolutionsprovidesignificantvalueintheareasofsimplicity,scalability,performance,efficiency,dataprotectionandsecurity.Pleasetakeamomenttoreviewtheseareasdisplayedontheslide.
ISPT Isilon Fundamentals 8
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilonwillmeetanyofthebusinessandtechnicalrequirements.Scalability
Manyorganizations faceunpredictable storage and
capacityrequirements. EMCIsilon scaleout
NASsolutionsprovidenondisruptivescaleperformanceandcapacityintherightcombination,dependingontheusageaccesspatternorcontenttype.Availability
EMCIsilonofferstheindustry'shighestlevelofendtoenddataprotection.Byofferinguptoquadruplefailureprotection,EMCIsilonensuresthatevenifuptofournodesordrivesfailsimultaneously,100%ofyourdataisstillavailable.Automaticreplicationofdatatoremotesitescanbeperformedwithoutimpactonothernetworkresources.ComplexityoftheEnvironment
EMCIsilonissimpletobuy,build,maintain,andgrow.ItseasytomanagescaleoutNASsignificantlyreducesTCO.AdministrationoftheEnvironment
WithEMCIsilonscaleoutNASyoudon'tneedtoaddstorageadministratorsasyourstoragegrows.Onepersoncanmanagepetabytesofdata,minimizingoperatingexpendituresandkeepingtheITstafffocusedonmanagingtheirdata,andnottheirstorage.
ISPT Isilon Fundamentals 9
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ScaleupNetworkAttachedStorageisthetraditionalfilebasedstorageplatform.InaScaleuptechnology,scalabilityisachievedbyaddingmoredisks.ThereisaphysicallimitationtonumberofdisksthatonecanaddtoScaleupNASplatform.ThereperformanceofascaleupNASplatformcanbeimprovedonlybyreplacingtheprocessingsytems
(NAShead/filer).EMCofferstwoscaleupNASdevices.TheEMCVNXesystemisaunifiedblockandfileplatform,specificallyIPstorage,i.e.iSCSIandtheNASprotocols.EMCVNXconfigurationsmaybefileonly,blockonly,orunified.CoreITapplicationswithtransactionalworkloads,suchasOracle,SQL,Exchange,orSharePointareagoodfit.AnothergoodfitforVNXistier1or2servervirtualization&endusercomputing/VDI.EMCIsilonfallsintolargescalefileonlyenvironments,startingatgreaterthan50terabytesorsupportinggreaterthanonehundredterabytehomedirectories.Wheneverafilesystemlargerthan16terabytesisneeded,EMCIsilonwouldbethecorrectoption.EMCIsilonisveryeffectiveasalargeNASarchiveorsupportingbigdataneeds.
ISPT Isilon Fundamentals 10
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThismodulecoveredthebenefitsandusesofanEMCIsilonsolution.
ISPT Isilon Fundamentals 11
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThismoduledescribesEMCIsilons networkarchitecture
andprovidesanintroductionoftheOneFSoperating system.
12ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Thislessoncovers
anoverviewofeachlayeroftheEMCIsilonclusteringarchitecture,includingEMCIsilons
networktopology.
13ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilon's
distributedscaleoutstoragesolutioncontainsclusterednodesencapsulatedinaprivatenetwork.Inatruescaleoutarchitecture,thetasksaredistributeduniformlyacrossallnodes
enhancingscalability,accesstodata,performance,andavailability.TheEMCIsilonclusteringarchitectureconsistsoffourlayers:theclient/applicationlayer,theexternalnetworklayer,thestoragelayer,andtheinternalnetworklayer.Inthefollowingslideswewillrevieweachlayer.
14ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilonsupportsseveralclientaccessprotocolsenablinguseraccesstothefilesstoredonacluster.Multipleaccessprotocolscanbeconfiguredifanetworksupportsmanytypesofclients.EMCIsilonprovidesoperationalflexibilitythat
includesintegratedsupportforawiderangeofindustrystandardprotocolssuchasNFS,SMB,HTTP,FTP,andHDFS.Theoperationalflexibilityalsoallowsforflexibleclientconnectioncapabilitieswithoutclientsidedrivers.VMware
integration,includingVASAandVAAIAPIstosimplifystoragemanagementinyourvirtualizedinfrastructureenvironmentisalsopartoftheflexibility.Asis,aPlatformRESTAPItoenableintegrationwithawiderangeofthirdpartyapplications.
15ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheExternalNetworklayer,alsoknownasthefrontendnetwork,providescommunicationbetweenclientsandclusternodes.EMCIsilon
nodessupport1GigabitEthernetand10GigabitEthernetconnectionstothecluster.TheInternalNetworkLayer,alsoknownasthebackendnetwork,enablescommunicationbetweennodesinacluster.CommunicationovertheinternalnetworkoccursthroughInfiniBandconnections.InfiniBand
isacopperbased,pointtopoint,interconnectavailablein10gigabitspersecond,20gigabitspersecond,and40gigabitspersecond.InfiniBand
deliverstheextremelylowlatencythatenablesthenodestoseamlesslyfunctioninasinglechassis.Usingaswitchedstartopology,eachnodeintheclusterisonlyonehopawayfromanyothernode.WhiletheclustercanoperateononeInfiniBand
switch,twoswitchesarerecommendedforhighavailability.
16ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Theinternalnetworkactsasthebackplaneofthecluster,enablingeachnodetobepartofthecluster.Theexternalnetworkenablesclientstoaccessanode.OneFSsupportsnetworksubnets,IPaddresspools,andnetworkprovisioningrulestofacilitatetheexternalnetworkconfigurationprocess.OneFSsupportsbothIPv4andIPv6addressschemes.However,therearesomeexternalservicessuchasActiveDirectoryauthenticationandtheinternalInfiniBand
networkthatstillsupportonlyIPv4.Redundantinternalandexternalnetworksshouldbeusedforhighavailability.TheprimaryinternalInfiniBand
networkusesasecondInfiniBand
switchasastandby.Failovertothestandbyinternalnetworktakesplaceintheeventofprimaryinternalnetworkfailureoranytimeapartona
nodeisdisconnected.
17ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilonStorageincludesallIsilonseriesnodesinacluster.Eachnodeinanclusterisapeertoeveryothernodeinthecluster.Aseachnodeisaddedtoacluster,itincreasestheaggregatedisk,RAM,CPU,andnetworkcapacityofthecluster.Thenodesaddressfilerequestsfromclients.ThekeytoEMCIsilon's
storageclustersolutionisthearchitectureofOneFS,whichisadistributedclusteredfilesystem.Asinglefilesystemspansacrosseverynodeinastorageclusterand,asnoesareadded,thatfilesystemautomaticallyredistributescontentacrosstheentirecluster.Thereisnosinglemasterdevicethatcontrolsthecluster.Asthesystemwritesdata,italsoprotectsthedataatthespecifiedprotectionlevel.Thesystemcontinuouslyrebalancesdatabetweenthenodeswhichmakestoragespacemoreefficient.
18ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThislessoncoversthebasicsofEMCIsilons
OneFSdistributedfilesystem.
19ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
InscaleupNASsystems,thefilesystem,volumemanager,andtheimplementationofRAIDareallseparateentities.Thefilesystemisresponsibleforthehigherlevelfunctionsofauthenticationandauthorization.ThevolumemanagercontrolsthelayoutofthedatawhileRAIDcontrolsprotectionofthedata.OneFScreatesasinglefilesystemfortheclusterthatalsoperformsthedutiesofthevolumemanagerandappliesprotectiontothedata.EMCIsilonusessoftwarebaseprotectionalgorithmsinsteadofhardwarebasedRAID.Thereisnopartitioning,andnoseparatevolumes.Theentirefilesystemisaccessiblebyclientsconnectingtoanynodeinthecluster.Bycombiningthefilesystem,volumemanagement,dataprotection,intooneunifiedsoftwarelayer,managementoftheNASenvironmentissimplified.Sincethesinglefilesystemspanstheentirecluster,managementofasinglenamespacealsosimplifiesadministrativetaskslikemanuallymigrating
datatorebalancecontent.
20ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Therearetwowaystoaccessthecluster.Thefirstisthewebadministrationinterface
andthesecondistheCLI.Bothallowtheadministratortomonitorandmanagethecluster.Ifusingthewebadministrationinterface,allanadministratormustdoisentertheIPaddressofoneofthenodesintoawebbrowser.ThenameoftheclustercanalsobeusedinsteadoftheIPaddress.Onceinthewebadministrationinterface,theadministratorisablethemonitor,configure,andmanagetheentireclusterfromasingleinterface.Throughthecommandlineinterface,anadmininstrator
hasaccesstothesuiteofisicommandsusedtomonitorandconfigurethecluster.TheOneFSsystemisafreeBSDbasedUnixoperatingsystem.
21ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TraditionalRAIDsystemsareaggregatedforscaleup,theycompromiseondataprotectionbynotbeingabletoscaleavailabilityalongwithcapacitygrowth.EMCIsilonusesaproprietarysystemjobcalledFlexProtect,whichdetectsandrepairsfilesanddirectoriesthatareinadegradedstate.Protectionisappliedatthefilelevel,nottheblocklevel.FlexProtect
distributesalldataandprotectioninformationacrosstheentireclusterandensuresthatalldataremainsintactandaccessibleevenintheeventofoneormoresimultaneousdrivefailures.Protectionsettingscanbechangedwithouttakingtheclusterorfilesystemoffline.OneFSallowsdifferentprotectionlevelsonfiles,directoriesandnodepools.Ifadrivefailuredoesoccur,FlexProtect
willonlyreprotect
theactualdataondiskandnotthediskitself.Thissignificantlyimprovesrecoverytime.OneFSoffersN+1throughN+4dataprotection.AnN+4schememeansthatupto4drivesornodesoracombinationofbothcanfailwithoutdataloss.
22ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
DataandmetadatainOneFSarestripedormirroredacrossallnodesinaclusterornodepool,whichprovidesredundancy,availability,andinsomecasesperformancebenefits.TherearetwotypesofprotectionthatcomeswithFlexProtect.DatamaybeprotectedusingFEC(ForwardErrorCorrection)ormirroring.FECissimilartohowparityisusedintraditionalstorageenvironmentsbutisdifferent.FECinformationisdistributedacrossnodesandacrossdrives.Intheeventofadriveornodefailure,themissingdataisrebuiltfromthemirrororcalculatedusingtheFECandtheremainingdata.Mirroringcopiesdatato
multiplelocationsthereforecreating redundancy.
Withmirroring,youcanhaveupto8copiesofdatainasinglecluster,comparedtoonly1withthetraditionalRAID1.BothmirroringandFECprotectiongenerateadditionalstorageoverhead.ThepercentageofFECoverheadcandeclineastheclusterbecomeslarger,especiallyforlargerfiles.EMCIsilonallowsyoutodefineprotectiononanodepool(groupofsimilarnodes),adirectoryorevenanindividualfile,aswellashavemultipleprotectionlevelsconfiguredthroughoutthecluster.Thisfeaturemakesitpossibletomatchtheprotectionleveltothevalueofthedatathatisbeingprotected.
23ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
OneFSusesthebackendInfiniBand
networktoautomaticallyallocateandstripedataverticallyacrossallnodesinthecluster.Asthesystemwritesthedata,itisalsoprotectingthedataatthespecifiedlevel.Noseparateactionisnecessarytoprotectthedata.Thesystembreaksfilesintosmallerlogicalchunkscalledstripesunitsbeforewritingthemtodisk.EachOneFSblockis8KBandastripeunitconsistsof16blocksforatotalof128KBperstripeunit.Asthesystemwritesdataacrossthecluster,itfillsthestripeunitsuntilthemaximumwidthoftheclusterisreachedandaprotectionstripeunitiscreated.Thestripewidthisdeterminedbythenumberofnodesandtheprotectionsetting.Withsmallfiles,duetothewaythatOneFSappliesprotectioninaclusterwithN+1protection,filesthatare128KBorsmalleraremirrored;inaclusterwithN+2protection,filesaretriplemirrored;andsoon.
24ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Theprocessofstripingspreadsallwritesfromaclientacrossthenodesofacluster.Eventhoughaclientisconnectedtoonlyonenode,whenthatclientwritesdatatothecluster,thewriteoperationtakes
place onmultiplenodes.Thewriteprocessfollowsacertainflow:
First,theClientsendsfiledataasawrite,whichisreceivedbythewritecoalescer
ontheclient
connectednode. Then,thenodebreaksthefileinupto128KBstripeunits
anda writeplandetermineshowto
aggregatethedatastripeunitsandcalculatesprotectionstripeunits.
Finally,stripeunitsaresenttoparticipantnodesovertheInfiniBand
networktodistributethe
stripeandawriteoccur
oneachnode.TheexampleonthisslidedemonstrateshowafileisbrokendownintostripeunitsafterwhichitisstripedacrossdisksintheclusteralongwithFECalsoknownasprotection.
25ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Whenafilereadisinitiatedbyaclient,thepiecesofthefilesarefetchedfromthenodeswheretheyarestored.Aclientisconnectedtoonlyonenodeatatime;howeverthedataisdistributedacrossnodesonthecluster.Theclient'snoderetrievesandrebuildsthefileacrossthebackendInfiniBand
network.Thereassembledfiledataisthensentfromtheclientsnodetotherequestingclientthroughtheexternalnetwork.
26ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheOneFSAutoBalance
featureenablesadministratorstoaddcapacityorperformancenodestoanexistingclusterwhilethesystemisonlineandinproduction.IncreasingthecapacityorperformanceofaclusterisasimplethreestepprocessFirst,InstallthenewnodeintherackSecond,AttachtheInfiniBand
networkcableconnectingthenodesLastly,EnteracommandforOneFStoaddthenewnodetotheclusterTheAutobalance
featurethenautomaticallybalancesthenodecapacityacrosstheInfiniBand
network.Nointerruptionofserviceorperfromance
isexperiencedbytheuser.
27ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
EMCIsilonsystemscanbeaccessedbyuserson
differentplatforms,withWindowsandUNIX/Linuxbeingthemostcommon.EachOShasitsownmechanismforassigninguseridentities,andassigningrightsandpermissionstousers.Asystemcapableofmultiprotocolaccessmustbeabletoallowsimultaneousaccesstofilesfromdifferentplatforms,andcorrectlydeterminewhichactionsindividualusersarepermittedtoperform.OneFSisoptimizedforamixedenvironmentinwhichanyfileordirectorycanbegovernedbyeitheraWindowsaccesscontrollist(ACL)orUNIXpermissions.Regardlessofthesecuritymodel,accessrightsareenforcedconsistentlyacrossaccessprotocols;thatis,auserisgranted(ordenied)thesamerightstoafilewhenusingSMB(Windowsfilesharing)astheywouldwhenusingNFS(POSIXfilesharing).OneFScanconfigurebothUNIXandWindowspermissionsontheclusteratthesametimeforthesamedatabystoringWindowsACLsandPOSIXmodebitsnatively.
28ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThismodulecoveredtheEMCIsilonclusteringarchitectureincludingthenetworktopologyandtheOneFSoperatingsystem.
29ISPT Isilon Fundamentals
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
This moduledescribesEMCIsilons
hardware,whichincludesstoragenodesandacceleratornodes.
ISPT Isilon Fundamentals 30
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Thearethree
differenttypesofstoragenodes:theSSeries,theXSeries,andtheNLSeries.SSeriesnodesareultraperformanceprimarystorageforhightransactionalandIOPsintensiveapplicationsthatarefortier0andtier1workflows.XSeriesnodesmakeabalancebetweenlargecapacityandhighperformancestorage.Thesenodesarebestforhighthroughputandhighconcurrencyapplicationsfortier1andtier2workflows.NLSeriesnodesaredesignedtoprovideacosteffectivehighdensitystoragesolutionfortier3workflowsthatareaccessedinfrequently,butstillmustbestoredandprotected.Inadditiontothestoragenodes,EMCIsilonofferstwoacceleratornodes:PerformanceandBackupAcceleratornodes.TheformeraddsCPU,memoryandnetworkresourcestothecluster,whilethelatteraddsCPU,memory,andFibreChannelconnectivityforconnectiontotapebackupdevices.
ISPT Isilon Fundamentals 31
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Storagesolutionscanbeexpensive.Tiering
classifiesdatasothatitcanbestoredintheappropriatecostefficientmanner.
Inatieredsystem,timelydatathatneedshighertiersneedsfaster,andmoreexpensive,storage.Inasimple3tieredsystem,tier1dataisaccessedoftenandismissioncritical.Tier2datamaybeusedlessfrequentlyormayhavefewerusers,butitisstillimportantdatathatusersneedinatimelymanner.Tier3dataisdefinedasseldomaccesseddatathatisarchivedforhistoricalorregulationpurposes.Additionally,astheuseofsolidstatedrives,orSSDs,increasesthereisalsoatypeofdatathatissotimesensitiveandcriticaltothebusinessthatitneedsthemostefficientstoragetype.InanEMCIsilonstoragecluster,youcancombineSSDandSASorSSDandSATAdrivesinonechassistomeetspecificstoragerequirements.YoucanconfigureaclustertokeepmetadataordataonSSDs,andeventouseSSDsinonepartoftheclustertostoremetadatafornodesthathavenoSSDdrives.
ISPT Isilon Fundamentals 32
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheSSeriesispurposebuiltforIOPSintensiveapplications.Itprovidesfastprimarystorageformissioncritical,hightransactionalandrandomaccessfilebasedapplications.SSeriesnodescanuseSSDstostorefilesystemmetadata,whichimprovesperformanceformetadataintensiveoperations,andtostorelatencysensitivefiledata.YoucancombineSSDandSASdrivesinonechassistomeetspecificstoragerequirementsandcreateatier0fordatatiering.EMCIsilonSSeriesnodesaresuitablefordigitalmediacompaniesand
financialinstitutionsthatneedhightransactionalIOPsforeditingandpostproduction,aswellascalculationsforbusinessanalysis.EnergyandsurveillanceorganizationswouldalsobenefitfromtheSseriesbyusingnodesforperformanceapplicationsthatneedtier0and1storage.
ISPT Isilon Fundamentals 33
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheEMCIsilonXSeriesisaflexibleandcomprehensiveseriesthatstrikestherightbalancebetweenlargecapacityandhighperformancestorage.TheEMCIsilonXSeriesaccelerateshighconcurrentandsequentialthroughputapplications,speedingaccesstomassiveamountsofcriticaldata,dramaticallyreducingthecostandcomplexityofmanagingandstoringdata.Therearetwotypesavailable;
the4UX400andthe2UX200platforms.The X400
providesmorecapacityatagivenperformancelevel.Thisnodewouldbeidealforsomeonewhoneedsmorecapacitythenperformanceaccordingtotherequirementstheyhaveprovided.
IntheX200space,thisnodeispurchasedbecausethere
aremoreperformancerequirementsthancapacity.WiththeX200thereisalsoupgradability,SSDscanbeaddedafterthefact,andmemorycanbeupgradedaswell.TheX400cannotbeupgraded
orusedwithSSDs.TheEMCIsilonXSeriessuitableforhomedirectoriesandhealthcareenvironmentsthathavelargefiles.XSeriesnodesarewellsuitedforcompaniesthatproducedigitalmediaordelivervideo,audio,andimageservices.XSeriesnodesarebestusedfororganizationsthatperformheavycomputationsuchaslifesciencecompaniesorenergyorganizations.
ISPT Isilon Fundamentals 34
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheNLSeriesispurposebuiltforlargecapacitystorage,enablingnearlinestorageperformanceatneartapestoragecosts.Highdensity,massivecapacityandmaximumcostperTBarethestrengthsoftheNLseries.NoSSDsaresupportedonthisplatform.TheEMCIsilonNLSeriesisidealforcomplementingandimprovingacompanysexistingtapebackup,archiving,dataprotectionstrategies,andprovideseconomicalstorage.ThisseriesuseslowcostSATAdrives.NLSeriesproductshavetheflexibilitytoconfiguredifferentdrivesizes,memory,andnetworkinterfacesgivingcustomerstheabilitytocustomizetheEMCIsilonproductbasedontheenvironment.
ISPT Isilon Fundamentals 35
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
PerformanceAcceleratorsaredisklessnodeswhichincreaseoverallthroughput,CPUmemory,andnetworkingsupportthroughputworkflows.ByseamlesslyaddingaPerformanceAcceleratortoanexistingEMCIsilonSSeriesorXSeriescluster,youcanaddmorethan400MB/sofsinglestreamthroughoutandupto700MB/sofconcurrentthroughput.Typically,onePerformanceAcceleratorperstoragenodeisrecommendedforsupportingwriteintensiveapplications.Forreadintensiveapplications,uptothreeAcceleratorsperstoragenodeisrecommended.BackupAcceleratorsenablehighspeedbackupoffilesystemdatatolocallyattachedtapelibrariesormediachangerdevices.TheBackupAcceleratorcanbeseamlesslyaddedtoanyexistingEMCIsilonclustertodeliverupto480MB/sofperformanceacrossfourconcurrentstreams,speedingbackupoperationsandreducingtheriskofbusinesscriticaldataloss.ItisusedtoprefetchdatafromthefilesystemandacrosstheInfiniBand
networkefficientlypushthedatatotape.EachBackupAcceleratorcansupportuptofourpathsviaFiberChannelports.WhileEMCIsilonsupportstheuseofNetworkDataManagementProtocol(NDMP)forbackups,theuseofaBackupAcceleratorenablessignificantlyfasterbackups.
ISPT Isilon Fundamentals 36
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Withgreatercapacity,usuallycomesgreaterperformancerequirementsacrossallstorage.Forunstructuredanddynamicdata,EMCIsilons
clusteredstorageprovidespredictablegrowthwithpredictableperformance.TheSseriesplatformistheanswerforultraperformanceprimarystorage,purposebuiltforhighIOPSintensiverandomaccessfilebasedapplications.TheEMCIsilonXSeries,isthemostflexibleandcomprehensivestorageproductline,strikingtherightbalancebetweenlargecapacityandhighperformancestorage.TheNLseriesfocusesoncostandcapacitywithmuchlessattentionpaidtoperformance.TheNLSeriescombineshighdensityandefficiency,withmassivecapacitycapabilities.
ISPT Isilon Fundamentals 37
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThismodulecoveredEMCIsilonstorageandacceleratornodes.Nodetypesmaybemixedinacluster,andoftenwillbeinordertoachievethedesiredbalanceofperformanceandcapacity.PerformancemayalsobeimprovedthroughtheuseofSSDsinsomenodes.
ISPT Isilon Fundamentals 38
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
This modulefocusesonEMCIsilons
OneFSsoftwaremoduleswhichprovidearobustsuiteofmanagementapplications.
ISPT Isilon Fundamentals 39
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SmartPoolsisasoftwaremodulethatenablesadministratorstodefinesubgroupsofnodeswithinaOneFScluster.UsingSmartPools,multipletiersofEMCIsilonstoragenodescanallcoexistwithinasinglefilesystem,withasinglepointofmanagement.ByusingSmartPools,administratorscanspecifyexactlywhichfilestheywanttoliveonwhichparticularnodesanddisks.SmartPools
maincomponentsarenodepoolsandfilepools.Nodepoolsareasetofnodesthatyoucangroupintoasinglepoolofstorage.Filepoolsenableyoutofilterfilesanddirectoriesintospecificnodepools.Filepoolpoliciesalloweasyandpowerfulfiledistributionamongthetiers,costalignmentwithagingorinfrequentlyusedcontent,andeliminatetheneedfordatamigrations.
ISPT Isilon Fundamentals 40
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SmartPoolsisrecommendedfororganizationswhohavemultiplestoragetierswhowishtoachievecostefficiencyintheirstoragesystem.Also,companieswithmultiplestorageperformancerequirementsandwhowanttheabilitytohaveindividualfilesorsetsofdataonaspecificstoragetier.Forexample,clientsthatwanttohaveolderfilesoncheaper,slower,storageandnewer,frequentlyaccessedfilesonfaststorage.
ISPT Isilon Fundamentals 41
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SnapshotIQisalicenseddataprotectionsoftwaremoduleforEMCIsilon's
OneFSoperatingsystem.Asnapshotrecordsapointintimesnapshotofthedata.Unlikearegularcopyofdatawhichtakessignificantspace,snapshotsonlykeeptrackofchangeddatablocks.Inaddition,SnapshotIQhasunlimitednumberofsnapshotsgivingadministratorsanotheroptiontomeettheirorganization'srecoverypointandrecoverytimeobjectives.SnapshotIQ
allowsforthedeletionofoutofordersnapshotsandhasbeenintegratedwithSmartPoolsgivingtheadministratortheabilitytostoresnapdataonlowercosttiersofstorage.WindowsusersmayalsousetheShadowCopy
servicetorecoverdeletedfilesordirectories.
ISPT Isilon Fundamentals 42
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SnapshotIQallowsuserstoeasilyrecoverfilesthemselves.
Wealsofindusecaseswherecustomershavestringentdatarecoveryrequirementsandwantlowimpactdataprotection.SnapshotIQisacomplementtoatapeorarchivesolution,butshouldnotbeconsideredasubstitute.
ISPT Isilon Fundamentals 43
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SyncIQisasimpletomanagefileasynchronousreplicationtoolthatenablesadministratorstosynchronize
missioncriticaldatathroughoutagloballydistributednetwork.SyncIQdeliversreplicationoffilesacrossmultipleEMCIsilonclustersovertheWANorLAN.SyncIQ
istheindustry'sonlypolicybasedfilereplicationsystemdesignedexclusivelyforscaleoutstorage,combiningarichsetofpoliciesforcreatingandschedulingstoragereplicationjobswithbandwidththrottlingandclusterutilizationcapabilities.Replicationpoliciescanbesetatthecluster,directory,orfilelevels.
ISPT Isilon Fundamentals 44
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SyncIQusecasesincludedisasterrecover,orDR,wherewehaveahighspeedbackupgoingacrossaWANlink,andavailabilitywheretwoormorecopiesofdataarerequiredacrosssites.Thisisoftenusedforarchivingwheretheproductiondataisreplicatedtoanoffsitelocation,andtieredtotapefromthere.Anotherusecaseiscontentdistributionwheredataissharedbetweensites.
ISPT Isilon Fundamentals 45
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SmartConnectisaclientconnectionmanagementmodulethatenablesclientconnectionstobebalancedacrossallnodeswithinanEMCIsilonclusteroracrossselectednodesforsecurityorperformancereasons.Itprovidesasinglevirtualhostnameforclientstoconnect.SmartConnects
roundrobinmethodworksonarotatingbasis.AsonenodeIPaddressishandedout,itmovestotheendofthelist;thenextnodeIPaddressistheused,andsoon.TheadvancedversionofSmartConnectallowsmultiplenetworkpoolswithinonesubnet.ItsupportsDynamicIPallocationandNFSfailover.ItallowsforpolicydrivenconnectionandfailoverbasedonmetricssuchasCPUutilization,throughput,andconnectioncount.
ISPT Isilon Fundamentals 46
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Inthisexample,allnodesareofonetype.Wellconfiguredifferentaccesszones,andcreateaperformancezonesimplybycreatingapoolwiththeinterfacesfromthefirstsetofnodesandgivingitadifferentname.Thehighperformanceclientsthenconnecttoanameassociatedwiththatpool,sayperformance.isilon.com.Wethencreateanotherpoolassociatingtheinterfacesfromthenodesonthebottom,andcallthatdesktop.isilon.com,whichwillbeusedforgeneralclients.Wenowhavetheabilitytosegmenttheloadfromdifferenttypesofclients;theideabeingtonotallowdesktopusagetoimpedeanyperformancetothehighperformanceclients.
ISPT Isilon Fundamentals 47
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SmartQuotas
isafeaturethatcanprovision,monitor,andreportdiskstorageusageattheuser,group,anddirectorylevels.Administratorscommonlyusefilesystemquotasasamethodoftracking,andsometimeslimiting,theamountofstoragethatauser,group,oraprojectisallowedtoconsume.SmartQuotas
cansendautomatednotificationswhenstoragelimitsareexceededorapproached.SmartQuotas
allowsforthinprovisioning(alsoknownasoverprovisioning),enablingadministratorstoassignquotasabovetheactualclustersize.Withthinprovisioning,theclustercanbefullwhilesomeusersordirectoriesarewellundertheirquotalimit.
ISPT Isilon Fundamentals 48
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
Quotasareausefulwaytoensurethatauserordepartmentdoesnotinfringeontheamountofstoragethatisallocatedtootherusersordepartments.Quotasareusefulinenforcinganinternalchargebacksystem,whichisoftenfoundinthegovernmentandeducationindustries.SmartQuotas
containflexiblereportingoptionsthatcanhelpadministratorsanalyzedatausagestatisticsfortheircluster.Bothenforcementandaccountingquotasaresupported,andavarietyofnotificationmethodsareavailable.
ISPT Isilon Fundamentals 49
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
SmartLockprovidespolicybasedretentionandprotectionagainstaccidentaldeletions.Manybanksandfinancialinstitutionsusethisfeature.BecauseSmartLockisasoftwarebasedapproachtoanenterprisefilelevelretentionsolution,youcanstoreSmartLockprotecteddataalongsideotherdatatypeswithnoeffectonperformanceoravailability,andwithouttheaddedcostofpurchasingandmaintainingspecialtyfilelevelretentioncapablehardware.SmartLockisstoredatthedirectorylevelandsetsdefaultretentiontimesonce.
ISPT Isilon Fundamentals 50
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
TheusecasesforSmartLockarewhenorganizationsneeddatatoremainavailablebutunchangedoverextendedperiodsoftime.Examplesincludecorerevenueproducingworkflows,productdesigns,softwareschemas,andproductcomponentelementssuchasimagefiles,digitalmasters,legaldocuments,andcriticalcommunications.Legislationmayalsorequirethatdatabekeptunchangedforaspecifictimeperiod.
ISPT Isilon Fundamentals 51
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
InsightIQprovidesperformanceandfilesystemanalyticstooptimizeapplications,correlateworkflowandnetworkevents,andaccuratelyforecastfuturestorageneeds.Itelaboratesondrilldownsandbreakoutsandprovidesbothhistoricalandneartimedata.ItisastandalonevirtualapplicationthatisnotpartofOneFSbutsellsasaseparateproduct.
ISPT Isilon Fundamentals 52
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
InsightIQisusefulfororganizationswhowantaneasytouse,yetpowerfulanalyticstool.CompanieswhowanttooptimizetheirEMCIsilonstorageclustersandtheapplicationsthatusethemwithoutrequiringprofessionalservices,andwhowanttooffloadprocessingofanalyticsfromthestoragesystemtoavirtualappliance.
ISPT Isilon Fundamentals 53
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThismodulecoveredtheadditionalsoftwaremodulessupportedbyOneFSandtheirvarioususes.
ISPT Isilon Fundamentals 54
-
Copyright 2013 EMC Corporation. Do not copy - All Rights
Reserved.
ThiscoursecoveredtheEMCIsilonscaleoutStoragePlatformpoweredbytheOneFSoperatingsystem.ItintroducedtheEMCIsilonproductlinesanddescribedthebroadrangeofEMCIsilonoptionsandsoftwareapplications.Thisconcludesthetraining.
ISPT Isilon Fundamentals 55