Cluster RH SAP

7/23/2019 Cluster RH SAP

1/67

Deploying

Highly Available SAP Servers

using Red Hat Clustering

Martin Tegtmeier, Realtech

Alfredo Moraleo, Senior Consultant !"M"A #PS$

%ran& Danapfel, Soft'are "ngineer !on(site at SAP$

)ohn Herr, Senior Soft'are "ngineer !Solutions Architecture$

*ersion +-

)anuary +./0


2/67

1801 Varsity DriveRaleigh NC 27606-2072 USAPhone !1 "1" 7#$ %700Phone 888 7%% $281&a' !1 "1" 7#$ %701P( )o' 1%#88Resear*h +riangle Par, NC 2770" USA

in.' is a registere/ tra/ear, o in.s +orval/s Re/ 3at4 Re/ 3at 5nterrise in.' an/ the Re/ 3atSha/oan logo are registere/ tra/ear,s o Re/ 3at4 9n* in the Unite/ States an/ other*o.ntries

A:D is a tra/ear, o A/van*e/ :i*ro Devi*es4 9n*

SAP an/ SAP Net;eaver are registere/ tra/ear,s o SAP A< in e /istri>.te/ only s.>@e*t to the ters an/ *on/itions setorth in the (en P.>li*ation i*ense4 V10 or later the latest version is resently availa>le athttBBoen*ontentorgBoen.>B

+he inoration *ontaine/ herein is s.>@e*t to *hange itho.t noti*e Re/ 3at4 9n* shall not >e lia>leor te*hni*al or e/itorial errors or oissions *ontaine/ herein

Distri>.tion oo/iie/ versions o this /o*.ent is rohi>ite/ itho.t the e'li*it erission o Re/3at 9n*

Distri>.tion o this or, or /erivative o this or, in any stan/ar/ aer >oo, or or *oer*ial.roses is rohi>ite/ .nless rior erission is o>taine/ ro Re/ 3at 9n*

+he a*, torear*h-ee/>a*,re/hat*o

'''redhatcom ii refarch(feedbac&1redhatcom
http://www.opencontent.org/openpub/mailto:[email protected]:[email protected]?subject=Feedback%20on%20Deploying%20Highly%20Available%20SAP%20Servers%20using%20Red%20Hat%20Clusteringmailto:[email protected]?subject=Feedback%20on%20Deploying%20Highly%20Available%20SAP%20Servers%20using%20Red%20Hat%20Clusteringhttp://www.opencontent.org/openpub/mailto:[email protected]:[email protected]?subject=Feedback%20on%20Deploying%20Highly%20Available%20SAP%20Servers%20using%20Red%20Hat%20Clustering


3/67

Table of Contents

1 5'e*.tive S.ary 1

2 9ntro/.*tion 221 A./ien*e 2

22 A*ronys %

% +e*hnology (vervie $

%1 Re/ 3at 5nterrise in.' 3A A//-(n $

%2 SAP *oonents overvie $

%% 9leenting SAP servi*es in Re/ 3at Cl.stering 7

$ ReE.ireents 8

$1 Server 3ar/are 8

$2 Netor, 8

# 5nvironent "

#1 Re/ 3at 5nterrise in.' # "

#2 Re/ 3at 5nterrise in.' 6 10

6 Cl.ster )asi*s 11

61 C:AN 11

62 Cl.ster Reso.r*e :anager 11

6% F.or. 12

6%1 F/is, 12

6%2 A//itional he.risti*s 1%

6$ &en*ing 1$

6$1 Poer &en*ing Systes 1$

6$2 SAN Sit*h )ase/ &en*ing 1$

6$% SCS9 &en*ing 1$6$$ Virt.al :a*hine &en*ing 1#

6# Storage Prote*tion 1#

6#1 3A-V:4 CV: 1#

6#2


4/67

66 (S Deen/en*ies 16

67 Stret*h Cl.sters 17

671 Netor, inrastr.*t.re reE.ireents 18

672 Storage reE.ireents 18

67% F.or. in stret*h *l.sters 18

67$ Data reli*ation ith V: 18

67# Stret*h *l.ster liitations 1"

676 Site ail.re anageent 1"

677 Site re*overy anageent 1"

678 Stret*h *l.sters ar*hite*t.re revie 20

7 (erating Syste 9nstallation 21

71 (S 9nstallation overvie 21

711 Core Cl.ster Sotare 9nstallation 21

72 (S C.stoiGations 22

721 SAP se*ii* (S *.stoiGation 22

722 N+P 22

72% ACP9 22

72$ &ireall 2%

7% Netor, Conig.ration 2%

7%1 P.>li*BPrivate Netor,s 2%

7%2 )on/ing 2%

7%% 3osts ile 2$

7$ Storage Conig.ration 2$

7$1 :.ltiathing 2$

7$2 Devi*e :aer :.ltiath 2$

7$% V: 2#

7$%1 V: Conig.ration 26

7$%2 Vol.e Conig.ration 26

7# Cl.ster Core Conig.ration 27

7#1 C:AN B (enA9S 28

7#2 F/is, 2"

7#% &en*ing %0

7#$ Cl.ster No/es %1

8 SAP 9nstallation %2

81 SAP Ar*hite*t.re %2

82 Virt.al 9P A//resses an/ 3ostnaes %2

'''redhatcom iv refarch(feedbac&1redhatcom


5/67

8% &ile Systes %%

8%1 o*al &ile Systes %%

8%2 9nstan*e se*ii* &ile Systes %%

8%% Share/ &ile Systes %%

8$ SAP 9nstallation %$

8$1 9nstallation ith sainst %$

8# lnstallation Post-Pro*essing %$

8#1 Users4


6/67

1022 *l.sv*a/ #2

102% rgHtest #%

11 Closing tho.ghts #$

Aen/i' A Cl.ster Conig.ration &iles ##

Aen/i' ) Reeren*e Do*.entation #"

Aen/i' C Revision 3istory 61

'''redhatcom vi refarch(feedbac&1redhatcom


7/67

1 Executive Summary+his aer /es*ri>es the /eloyent o a highly availa>le SAP lan/s*ae on Re/ 3at5nterrise in.' R35 # or Re/ 3at 5nterrise in.' 6 ith the R35 3igh Availa>ility A//-(n Ater an intro/.*tion to the >asi* *on*ets an/ syste reE.ireents4 this /o*.entrovi/es /etaile/ inoration a>o.t the R35 3A A//-(n4 SAP Net;eaver 3A installations4an/ *l.ster *onig.ration otions

refarch(feedbac&1redhatcom / '''redhatcom


8/67

2 IntroductionA *l.ster is essentially a gro. o to or ore *o.ters or,ing together hi*h4 ro an en/.serIs erse*tive4 aear as one server Cl.stering *an >e .se/ to ena>le storage*l.stering4 >alan*e loa/ aong *l.ster e>ers4 arallel ro*essing4 an/ high-availa>ility3A +he Jhighly availa>leK ase*t o any *l.ster servi*e in/i*ates that it is *onig.re/ in aanner s.*h that the ail.re o any one *l.ster e>er4 or a s.>syste ail.re ithin ae>er4 /oes not revent the *ontin.e/ availa>ility o the servi*e itsel

5ns.ring the highest ossi>le availa>ility o SAP systes is essential or s.**ess +heavaila>ility o an SAP ali*ation tyi*ally /een/s on an SAP ali*ation server hi*h in t.rnrelies on otial availa>ility o an .n/erlying /ata>ase +his layere/ sotare sta*, sits on too an even ore *ole' har/are inrastr.*t.re 9n or/er to in*rease the availa>ility o SAPsotare4 re/.n/ant har/are an/ a//itional *l.ster sotare is reE.ire/

+o a*hieve highest availa>ility4 every single-oint-o-ail.re has to >e eliinate/ hi*h *reatesthe reE.ireent or every har/are *oonent to >e re/.n/ant +his in*l./es netor,s4

netor,-intera*e-*ar/s4 ro.ters an/ netor,-sit*hes over storage arrays4 storage netor,san/ storage intera*es to servers4 oer s.lies4 oer *ir*.its4 air *on/itioning an/ hole/ata*enters /een/ing on the /esire/ level o availa>ility

+he *l.ster sotare onitors the stat.s o all anage/ servi*es an/ initiates a ailover tore/.n/ant server inrastr.*t.re i ro>les are /ete*te/ +he R35 3A A//-(n rovi/es theeat.res ne*essary to a,e *riti*al SAP servi*es on R35 highly availa>le +his /o*.entill.strates the re*oen/e/ highly availa>le R35 inrastr.*t.re or SAP

;hen *onig.ring 3A or an SAP environent4 all the sotare an/ har/are layers .st >eta,en into *onsi/eration Re/ 3at an/ R5A+5C34 ith g.i/an*e ro SAP4 have *on/.*te//eveloent or, in or/er to rovi/e a reeren*e ar*hite*t.re or 3igh Availa>ility or SAP

Net;eaver .sing the R35 3A A//-(n +he res.lting ileentation is *oliant ith SAPre*oen/ations +ogether ith the reso.r*e agent s*rits availa>le in the Re/ 3at5nterrise in.' 3igh Availa>ility A//-(n or R35# an/ R3564 this reeren*e ar*hite*t.re*an serve as a g.i/e to /eloying highly availa>le SAP ali*ations the a@ority o the SAPro/.*t ortolio in*l./ing 5CC4 SC:4 SR:4 et* >ase/ .on SAP Net;eaver te*hnology 9tis rovi/e/ as is itho.t s.ort or lia>ility stateents 5'erts at the reE.ire/ te*hnologiesay ollo this g.i/e hen ileenting highly availa>le4 Re/ 3at 5nterrise in.' >ase/SAP systes

Note that *l.ster sotare has .ll *ontrol o all servi*es in*l./ing the starting an/ stoing oSAP sotare N.ero.s *.stoer *ases have roven ho a oorly *onig.re/ 3Aenvironent *an ina/vertently /e*rease the availa>ility o *riti*al SAP systes As s.*h4

*ons.lting servi*es ailiar ith >oth SAP an/ R35 3A A//-(n o.l/ >e a *ost ee*tiveinvestent

2.1 Audience+his /o*.ent a//resses SAP *ertiie/ te*hni*al *ons.ltants or SAP Net;eaver ithe'erien*e in 3A systes A**ess to SAP an/ Re/ 3at inoration reso.r*es s.*h as SAPServi*e :ar,etla*e an/ the Re/ 3at C.stoer Portal is an/atory

'''redhatcom + refarch(feedbac&1redhatcom


9/67

2.2 AcronymsCoon a*ronys reeren*e/ ithin this /o*.ent are liste/ >elo

AAS SAP A//itional Ali*ation Server

ADA SAP Data>ase +ye :a'D)

AP2 Ali*ation Prograing 9ntera*eASCS SAP A)AP Central Servi*es 9nstan*e

C3*M Cl.ster ogi*al Vol.e :anager

CMA4 Cl.ster :anager

D56 SAP Data>ase +ye D)2 on in.'

D3M Distri>.te/ o*, :anager

"RS SAP 5nE.e.e Reli*ation Server

#%S al &ile Syste

HA 3igh-Availa>ility

2P 9nternet Proto*ol

3*M ogi*al Vol.e :anager

4AS Netor, Atta*he/ Storage

4%S Netor, &ile Server

42C Netor, 9ntera*e Car/

4TP Netor, +ie Proto*ol

4760. SAP Net;eaver 200$ ,ernel 6$0

478. SAP Net;eaver 70

9C% (en Cl.ster &raeor,

9RA SAP Data>ase +ye (ra*le

9S (erating Syste

PAS SAP Priary Ali*ation Server

P9S2: Porta>le (erating Syste 9ntera*e

;D2S< F.or. Dis,

;D2S


10/67

3 Technology Overview

3.1 Red Hat Enterprise Linux HA Add-On&or ali*ations that reE.ire a'i. syste .tie4 a Re/ 3at 5nterrise in.' R35

*l.ster ith R35 3A A//-(n is the sol.tion +he R35 3A A//-(n rovi/es to /istin*ttyes o *l.stering

Ali*ationBServi*e &ailover - Create n-no/e server *l.sters or ailover o ,ey

ali*ations an/ servi*es

9P oa/ )alan*ing - oa/ >alan*e in*oing 9P netor, reE.ests a*ross a ar o

servers

;ith R35 3A A//-(n4 ali*ations *an >e /eloye/ in 3A *onig.rations so that they arealays oerational4 >ringing s*ale-o.t *aa>ilities to Re/ 3at 5nterrise in.' /eloyentsR35 ith the R35 3A A//-(n rovi/es a *olete4 rea/y-to-.se ailover sol.tion or SAPNet;eaver

3.2 SAP components overview9n an SAP Net;eaver environent4 these servi*es .st >e *onsi/ere/

Data>ase

SAP Central Servi*es 9nstan*e SAP enE.e.e an/ essage server

SAP Syste :o.nt Dire*tory BsantBMS9D

SAP 9nstan*es B Ali*ation Servers

A**or/ing ith SAP ar*hite*t.re an/ *aa>ilities4 high availa>ility or ea*h *oonentin*l./e/ in a SAP syste *an >e a*hieve/ >y /ierent strategies Soe *oonents4*onsi/ere/ SINGLEPOINTSOFFAILUREor the hole syste reE.ire a inrastr.*t.re *l.sterAvaila>ility or other *oonents *an >e rovi/e/ >y .sing several a*tive instan*es

'''redhatcom 0 refarch(feedbac&1redhatcom


11/67

+he olloing ta>le shos the ain SAP *oonents or A)AP systes an/ ho highavaila>ility ay >e alie/

Component 4umber of components High Availability

D):S 1 or SAP Syste 9nrastr.*t.re Cl.ster

5nE.e.eServer

1 or SAP Syste in*l./e/ inASCS instan*e 5nE.e.eReli*ation Server rovi/es .rtherenE.e.e server resilien*e

9nrastr.*t.re Cl.ster

:essageServer

1 or SAP Syste in*l./e/ inASCS instan*e


Dialog or,ro*ess

1 or ore or A)AP instan*e9nrastr.*t.re Cl.ster or ServeralA*tive A)AP 9nstan*es

U/ate or,ro*ess


)at*h or,ro*ess

0 or ore or A)AP instan*e 9nrastr.*t.re Cl.ster or ServeralA*tive A)AP 9nstan*es

Sool or,ro*ess


le N&S Servi*e or Disat*her

1 or several ;e> Disat*herro*esses

9nrastr.*t.re Cl.ster or ServeralA*tive 9nstan*es ith loa/>alan*ing

Table 3.2.1: Critical components in ABAP stack

refarch(feedbac&1redhatcom - '''redhatcom


12/67

+he olloing ta>le shos the ain SAP *oonents or LAVA systes an/ ho highavaila>ility ay >e alie/

Component 4umber of components High Availability

D):S 1 or SAP Syste 9nrastr.*t.re Cl.ster

5nE.e.eServer

1 or SAP Syste in*l./e/ inSCS instan*e 5nE.e.eReli*ation Server rovi/es .rtherenE.e.e server resilien*e


:essageServer

1 or SAP Syste in*l./e/ inSCS instan*e


LavaDisat*her

1 or Lava instan*e9nrastr.*t.re Cl.ster or SeveralA*tive Lava 9nstan*es

Lava ServerPro*ess

1 or Lava instan*e9nrastr.*t.re Cl.ster or SeveralA*tive Lava 9nstan*es

SAP Syste:o.ntDire*tory

1 or SAP Syste9nrastr.*t.re Cl.ster 3ighlyAvaila>le N&S Servi*e or


13/67

3.3 mp!ementin" SAP services in Red Hat #!usterin"+he olloing ig.re shos /etails a>o.t the ileentation o SAP *oonents in a singlesta*, .t.al ailover *l.ster in a to no/e *l.ster in*l./ing D):S4 Central Servi*es45nE.e.e Reli*ation Server an/ Ali*ation instan*e

Altho.gh they are .s.ally not single-oints-o-ail.re4 the 5nE.e.e Reli*ation Servers 5RSan/ the SAP Ali*ation 9nstan*es are *ontrolle/ >y the *l.ster sotare +o *reate a

or,ing 5nE.e.e Reli*ation4 it is iortant that the 5RS /oes not r.n on the sae *l.sterno/e as the ASCS +his is >e*a.se the original enE.e.e ta>le lies ithin the sae share/eory segent as the reli*ate/ ta>le

;hen the ASCS ails an/ a ailover is triggere/ >y the *l.ster sotare4 the ne ASCS.st start on the no/e here the 5RS is r.nning ;hen ASCS *oes .4 it sh.ts /on the5RS instan*e itho.t *leaning its share/ eory an/ atta*hes itsel to the share/ eorysegent here the 5RS ha/ store/ the reli*ate/ enE.e.e ta>le No the reli*ate/enE.e.e ta>le has >e*oe the ne original enE.e.e ta>le

+o ens.re that the ASCS ollos the 5RS instan*e4 the ollo-servi*e /een/en*y asileente/ in the R35 3A A//-(n

+he SAP Syste :o.nt Dire*tory sho.l/ >e e'orte/ >y a highly availa>le N&S server

refarch(feedbac&1redhatcom 8 '''redhatcom

Figure 3.3.1: SAP Cluster


14/67

4 Requirements

$.1 Server Hardware

+he server har/are reE.ireents *an >e .lille/ >y alost any enterrise gra/e server +hes.orte/ ar*hite*t.res are single or .lti-*ore '86H6$ ro*essors +yi*ally4 SAP serversare eE.ie/ ith a air ao.nt o eory starting at 8 giga>ytes an/ are .s.ally liite/ only>y the har/are se*ii*ation +he *l.ster no/es nee/ to >e atta*he/ to a en*inge*hanis Please reer to the %encingse*tion later in this /o*.ent or .rther inoration

$.2 %etwor&+here sho.l/ >e at least to Netor, 9ntera*e Car/s N9C4 hether e>e//e/ or a//e/ toea*h server 9 ore netor, intera*es are availa>le4 N9C >on/ing *an >e ileente/ ora//itional availa>ility an/ is *.rrently the only etho/ rovi/ing N9C ailover a>ility (ne

>on/e/ netor, /evi*e is *onig.re/ ith an e'ternal 9P a//ress hile the other is *onig.re/as an inter*onne*t >eteen *l.ster e>ers .sing a searate netor,

Cl.sters are highly /een/ent on *onstant *o.ni*ation >eteen no/es hi*h areaintaine/ a*ross the lo*al inter*onne*t 9t is highly re*oen/e/ that a /e/i*ate/ non-ro.te/ rivate netor, sho.l/ >e .se/ or all intra-*l.ster *o.ni*ation

Re/ 3at re*oen/s .sing 9P .lti*ast or *l.ster inrastr.*t.re trai* in Re/ 3at 5nterrisein.' # Soe netor, sit*hes ay reE.ire se*ial *onig.ration settings to ena>le.lti*ast oeration Please reer to the har/are ven/orIs *onig.ration g.i/e or *orre*t.lti*ast *onig.rations Sin*e version #64 >roa/*ast is .lly s.orte/ as an alternative to.lti*ast in sit.ations here .lti*ast *an not >e ileente/

'''redhatcom > refarch(feedbac&1redhatcom


15/67

5 Environment+he olloing ta>les rovi/e inoration a>o.t the har/are an/ sotare .se/ to >.il/ thehighly availa>le SAP systes /is*.sse/ in this aer

'.1 Red Hat Enterprise Linux 'System Specifications

Cl.sterServersO9): i-series'86H6$

(erating Syste

Re/ 3at 5nterrise in.' #6

atest ./ates via Re/3at Netor, R3Ns.>s*rition to*hannels

Re/ 3at 5nterrisein.' Server

R35 3A A//-(n

R35 or SAPAli*ations

Cl.ster Sotare

R35 3A A//-(n or R35 #6

atest ./ates viaR3N s.>s*ritions to*hannels

R35 Server 3ighAvaila>ility

Resol.tions to theolloing ).gGillaiss.es

6%71#$ -httsBB>.gGillare/hat*

oBshoH>.g*giQi/6%71#$

677$%0 -httsBB>.gGillare/hat*oBshoH>.g*giQi/677$%0

SAP 9nstallation

SAP Net;eaver 70 5hP 1

(ra*le D) 11202

Storage Fogi* 3)AsDellB5:C &i>reChannel SAN storage array

Table .1.1: !"#$ S%stem Con&iguration

refarch(feedbac&1redhatcom ? '''redhatcom


16/67

'.2 Red Hat Enterprise Linux (System Specifications

Cl.sterServersO9): i-series'86H6$

(erating Syste

Re/ 3at 5nterrise in.' 61

atest ./ates via Re/3at Netor, R3Ns.>s*rition to*hannels

Re/ 3at 5nterrisein.' Server

R35 3A A//-(n

R35 or SAPAli*ations

Cl.ster Sotare

R35 3A A//-(n or R35 61

atest ./ates viaR3N s.>s*ritions to

*hannels

R35 Server 3igh

Availa>ility

Resol.tions to theolloing ).gGillaiss.es

6%"2#2 -httsBB>.gGillare/hat*oBshoH>.g*giQi/6%"2#2

86"6"# -httsBB>.gGillare/hat*oBshoH>.g*giQi/86"6"#

SAP 9nstallation

SAP Net;eaver 70 5hP 1

(ra*le D) 11202

StorageFogi* 3)As

DellB5:C &i>reChannel SAN storage array

Table .2.1: !"#$ ' S%stem Con&iguration

'''redhatcom /. refarch(feedbac&1redhatcom


17/67

6 Cluster Basics

(.1 #)A%

Cl.ster :anager C:AN is a Re/ 3at se*ii* servi*e o/.le that anages the *l.ster*o.ni*ation inrastr.*t.re 9t rovi/es a .ser AP9 that is .se/ >y Re/ 3at layere/ *l.ster*oonents C:AN also rovi/es a//itional .n*tionality s.*h as AP9s or a E.or. /is,4 theE.or. itsel4 *on/itional sh.t/on4 an/ >arriers

(.2 #!uster Resource )ana"er+he Cl.ster Reso.r*e :anager rgmanager anages an/ rovi/es ailover *aa>ilities or

*l.ster reso.r*e gro.s 9t *ontrols the han/ling o .ser reE.ests in*l./ing servi*e start4restart4 /isa>le4 an/ relo*ate

+he servi*e anager /aeon also han/les restarting an/ relo*ating servi*es in the event oail.res rgmanager.ses (en Cl.ster &raeor, (C& *oliant reso.r*e agents to

*ontrol an/ onitor reE.ire/ reso.r*es SAPInstancean/ SAPDatabaseare (C& *oliantreso.r*e agents rovi/e/ >y Re/ 3at

Starting ith Re/ 3at 5nterrise in.' #64 rganager in*l./es an event /riven s*ritinge*hanis *alle/ R9ND Rin/ 9s Not Deen/en*ies R9ND *an >e .se/ to *reate *ole'event /riven servi*e /een/en*ies &or a.toati* enE.e.e reli*ation ailover s*enarios4 theR9ND >ase/ follow_service/een/en*y is reE.ire/

refarch(feedbac&1redhatcom // '''redhatcom


18/67

(.3 *uorumA *l.ster tyi*ally .ses share/ /ata reso.r*es s.*h as a *l.ster ile syste eg4 y the *l.ster reso.r*e anageent syste eg4 rganager+he *l.ster .st >e aare o the *.rrent state o the share/ reso.r*es at all ties +hereore4

it .st >e g.arantee/ that every *riti*al transition ithin the *l.ster *annot *oroise /ataintegrity

9n the event o a a@or netor, ro>le4 *l.ster artitioning a,a slit->rain sit.ation *ano**.r 5a*h artition *an no longer *o.ni*ate ith no/es o.tsi/e its on artition A Re/3at *l.ster reE.ires the E.or. reE.ireent >e .lille/ >eore a stat.s *hange in the *l.steris alloe/ &or e'ale4 E.or. is reE.ire/ >y the reso.r*e anageent syste to relo*ate*l.ster reso.r*es or or the C:AN o/.le to reove no/es ro the *l.ster +he *l.sterartition is *onsi/ere/ E.orate i ore than hal o all votes ithin the entire *l.ster >elong thethe *l.ster artition F.or. in C:AN *an >e /eine/ .sing the olloing or.la

F VB2 ! 1

here F is the reE.ire/ n.>er o votes or E.or. an/ V is the total n.>er o votesithin the *l.ster

Altho.gh the E.or. reE.ireents *al*.lation >ase/ on the a*tive no/es in a *l.ster or,ell or vario.s *l.ster *onig.rations4 se*ii* *ases e'ist here the *l.ster *annot /e*i/e orin*orre*t /e*isions have >een a/e

+o avoi/ s.*h sit.ations the .se o a E.or. /is, E/is, has >een reintro/.*e/

6.3.1 Qdisk9n se*ii* *ases4 the E.or. reE.ireent >ase/ on the n.>er o a*tive no/es >elonging to

a *l.ster is ins.i*ient 9n a to no/e *l.ster4 the stan/ar/ E.or. *al*.lation F VB2 !1o.l/ res.lt in to4 *onsi/ering one vote er *l.ster no/e 9n the *ase o a highly availa>le*l.ster4 this o.l/ a,e no sense sin*e it reE.ires >oth no/es to >e online +hereore4 theto no/e *l.ster is *onsi/ere/ a se*ial *ase an/ >y .sing the MtoHno/e *onig.rationotion4 E.or. *an >e re/.*e/ to one 9n this anner4 E.or. is aintaine/ even i one no/eails +he reaining no/e hosts all servi*es anage/ >y the *l.ster

(ne a@or *on*ern ith this sol.tion is in the *ase o a netor, loss >eteen no/es4 ea*hno/e interrets the la*, o *onne*tivity as a ail.re o the other no/e +his ro>le is ost*oonly reerre/ as a Jslit >rainK sit.ation4 as ea*h no/e is E.orate >y itsel an/ ass.esit is the s.rvivor +o ,ee >oth no/es ro si.ltaneo.sly a**essing share/ reso.r*es that.st not >e a*tive on ore than one no/e at any tie4 ea*h no/e attets to en*e the other

no/e to revent .n*ontrolle/ a**ess to the share/ reso.r*es 9n this instan*e4 hi*h everno/e s.**ess.lly en*es the other irst >e*oes the s.rviving e>er

A E.or. /is, E/is, *an >e .se/ to revent this sit.ation4 >olstering the E.or. >y a//ingan a//itional vote or votes to the *l.ster

9n a to no/e *l.ster *onig.ration ith a E/is,4 the total e'e*te/ votes o.l/ >e three itha E.or. o to

9n sall .lti-no/e *l.ster *onig.rations4 other tyes o ro>les *an o**.r 9n a three or

'''redhatcom /+ refarch(feedbac&1redhatcom


19/67

o.r no/e *l.ster4 E.or. is to or three rese*tively4 an/ losing to no/es ill *a.se a losso E.or. +he loss o E.or. res.lts in all servi*es >eing ta,en oline

+o resolve the sall *l.ster E.or. ro>le4 a E.or. /is, ith a vote *o.nt eE.al to then.>er o *l.ster no/es in.s one >olsters the E.or. eno.gh to ena>le the *l.ster tos.rvive ith only one reaining no/e

+he E.or. /is, /aeon qdiskd r.ns on ea*h no/e in the *l.ster4 erio/i*ally eval.atingits on health an/ then la*ing its state inoration into an assigne/ ortion o the share//is, area 5a*h qdiskdthen loo,s at the state o the other no/es in the *l.ster as oste/ in

their area o the FDis, artition ;hen in a healthy state4 the E.or. o the *l.ster a//s thevote *o.nt or ea*h no/e l.s the vote *o.nt o the E/is, artition 9n the a>ove e'ale4 thetotal vote *o.nt is ive one or ea*h no/e an/ to or the E/is, artition

94 on any no/e4 E/is,/ is .na>le to a**ess its share/ /is, area ater several attets4 thenqdiskdon another no/e in the *l.ster attets to en*e the tro.>le/ no/e to ret.rn it to an

oerational state

6.3.2 Additional heuristicsRe/ 3at a//e/ an a//itional eat.re to the E.or. /is, e*hanis (tionally4 one or orehe.risti*s *an >e a//e/ to the E/is, *onig.ration 3e.risti*s are tests erore/ >y the E/is,/aeon to veriy the health o the no/e on hi*h it r.ns +yi*al e'ales are verii*ations onetor, *onne*tivity s.*h as the serverIs a>ility to ing netor, ro.ters 3e.risti*s *an also>e .se/ to ileent netor, tie>rea,er .n*tionality

refarch(feedbac&1redhatcom /= '''redhatcom


20/67

(.$ +encin"

6.4.1 Power Fencing Systems+he oer en*ing s.>syste allos oerational *l.ster no/es to *ontrol the oer o aile/

no/es to ens.re that they /o not a**ess storage in an .n*oor/inate/ anner :ost oer*ontrol systes are netor, >ase/ +hey are availa>le ro syste ven/ors as a//-in *ar/sor integrate/ into the other>oar/ 5'ternal oer en*ing /evi*es are also availa>le +heseare tyi*ally ra*, or *a>inet o.nte/ oer sit*hes that *an *.t the oer s.ly on anygiven ort

Note that this en*ing etho/ reE.ires a or,ing Ja/inK netor, *onne*ting to the en*e/evi*e to s.**ess.lly trigger the en*e a*tion &en*ing /evi*es are re*oen/e/ to >e onthe sae netor, that is .se/ or *l.ster *o.ni*ation

9 the oer en*ing etho/ .ses a reote *onsole 9): RSA Reote S.ervisor A/ater4&.@its. iR:C 9ntegrate/ Reote :anageent Controller4 3P i( integrate/ lights-o.t4 et*

e'tensive testing o the en*ing e*hanis is re*oen/e/ +hese en*ing e*hanisshave a short tie ga >eteen iss.ing the JresetK *oan/ on the reote *onsole an/ thea*t.al reset ta,ing la*e 9n a sit.ation hen >oth no/es o a 2-no/e *l.ster are trying toen*e ea*h other4 soeties the tie ga is long eno.gh or >oth no/es to s.**ess.lly sen/the JresetK *oan/ >eore the resets are e'e*.te/ +his res.lts in a oer *y*le o >othno/es

6.4.2 SAN Switch Based Fencing;hile it is reera>le to eloy a oer en*ing sol.tion or the ro>.stness a syste re>ootrovi/es4 SAN sit*h en*ing is also ossi>le As ith Poer &en*ing4 the nee/ is to rote*t

share/ /ata SAN sit*h en*ing or,s >y reventing a**ess to storage UNs on the SANsit*h

6.4.3 SCSI FencingSCS9-% ersistent reservations *an >e .se/ or 9B( en*ing All no/es in the *l.ster .stregister ith the SCS9 /evi*e to >e a>le to a**ess the storage 9 a no/e has to >e en*e/4 theregistration is revo,e/ >y the other *l.ster e>ers

Reeren*e the en*eHs*si8 anage or .rther /etails Please note that the SCS9 en*inge*hanis reE.ires SCS9-% rite-e'*l.sive4 registrants-only ersistent reservation as ell ass.ort o the reet-an/-a>ort *oan/ on all /evi*es anage/ or a**esse/ >y the

*l.ster Please *onta*t Re/ 3at te*hni*al s.ort to /eterine i yo.r sotare an/ har/are*onig.ration s.orts ersistent SCS9 reservations

+he 3o to Control A**ess to Share/ Storage Devi*es Using SCS9 Persistent Reservationsith Re/ 3at 5nterrise in.' Cl.stering an/ 3igh Availa>ilityte*hni*al >rie /is*.sses thisore

'''redhatcom /0 refarch(feedbac&1redhatcom
https://access.redhat.com/knowledge/techbriefs/how-control-access-shared-storage-devices-using-scsi-persistent-reservations-rehttps://access.redhat.com/knowledge/techbriefs/how-control-access-shared-storage-devices-using-scsi-persistent-reservations-rehttps://access.redhat.com/knowledge/techbriefs/how-control-access-shared-storage-devices-using-scsi-persistent-reservations-rehttps://access.redhat.com/knowledge/techbriefs/how-control-access-shared-storage-devices-using-scsi-persistent-reservations-re


21/67

6.4.4 Virtual Machine FencingV: en*ing .ses the virt.al a*hine hyervisor to reset or oer o a single V: Pleasereer to httsBBa**essre/hat*oB,>B/o*sBD(C-$6%7#an/SAP note 1##2"2# - Jin.' 3ighAvaila>ility Cl.ster Sol.tionsKregar/ing the s.ort stat.s o virt.al a*hine en*e /evi*es

At the tie o .>li*ation V:are vShere $1!4 V:are vCenter $1!4 V:are 5S= $1!

an/ V:are 5S=i $1! are s.orte/ >y R35 #7 an/ later

(.' Stora"e Protection

6.5.1 HA-LVM, CLVMData *onsisten*y .st >e ens.re/ in all *l.ster *onig.rations ogi*al vol.e *onig.rations*an >e rote*te/ >y the .se o 3A-V: or CV: CV: is an e'tension to stan/ar/ ogi*alVol.e :anageent V: that /istri>.tes V: eta/ata ./ates to the *l.ster +he CL!DAE!ONclvmd .st >e r.nning on all no/es in the *l.ster an/ ro/.*es an error i any no/e

in the *l.ster /oes not have this /aeon r.nning 3A V: ioses the restri*tion that alogi*al vol.e *an only >e a*tivate/ e'*l.sively that is4 a*tive on only one a*hine at a tieRe/ 3at 5nterrise in.' #6 intro/.*e/ the otion to .se 3A-V: ith CV:D4 hi*hileents e'*l.sive a*tivation o logi*al vol.es Previo.s releases /i/ ileent 3A-V:

itho.t CV:D .sing V: tags iltering

6.5.2 GFSRe/ 3atIs al &ile Syste lo*, /evi*e or logi*al vol.e )y .tiliGing the in.' /istri>.te/ lo*,anager to syn*hroniGe *hanges to the ile syste4 le to rovi/e a *a*he-*oherent4*onsistent vie o a single ile syste a*ross .ltile hosts

refarch(feedbac&1redhatcom /- '''redhatcom
https://access.redhat.com/kb/docs/DOC-46375https://service.sap.com/sap/support/notes/1552925https://service.sap.com/sap/support/notes/1552925https://service.sap.com/sap/support/notes/1552925https://service.sap.com/sap/support/notes/1552925https://access.redhat.com/kb/docs/DOC-46375https://service.sap.com/sap/support/notes/1552925https://service.sap.com/sap/support/notes/1552925


22/67

6.5.3 Storage Mirroring9n /isaster tolerant *onig.rations4 storage irroring te*hniE.es are .se/ to rote*t /ata an/ens.re availa>ility in the event o a storage array loss Storage irroring is norallyerore/ in to /ierent ays

5nterrise storage arrays tyi*ally oer a e*hanis to irror all /ata ro one storage arrayto one or ore other arrays 9n the *ase o a /isaster4 reote /ata *oies *an >e .se/ ;hen.sing array->ase/-irroring also ,non as SAN->ase/-irroring the *l.ster no/es nee/a**ess to all irrors .s.ally thro.gh .ltiath *onig.rations 3oever4 only one array is.se/ >y the *l.ster at one tie a*tive array the other array is .se/ or reli*ation an/ siteailover .roses assive array 9 the a*tive storage array ails4 *l.ster servi*es halt an/ the*l.ster .st >e an.ally stoe/ an/ re*onig.re/ to .se assive array

9n Re/ 3at 5nterrise in.' #64 Re/ 3at oers the ossi>ility to *reate host->ase/-irroring*onig.rations ith the logi*al vol.e anager V: Servers in the *l.ster are a>le toasse>le in/een/ent storage /evi*es UNs on searate storage arrays to a sot-rai/logi*al vol.e in or/er to revent /ata loss an/ ens.re availa>ility in *ase o a ail.re on oneo the hysi*al arrays V: si.ltaneo.sly rea/s an/ rites to to or ore UNs on searatestorage arrays an/ ,ees the syn*hroniGe/

(.( OS ,ependenciesAll *hanges to the oerating syste environent have to >e rolle/ o.t to all no/esarti*iating in the *l.ster +his in*l./es *hanges to

*onig.ration iles

"etc"lv#"lv#$conf

Bet*B*l.sterB/a/*on "etc"services

"etc"%osts

"etc"#&lti'at%$conf

"etc"#&lti'at%$bin(in)

os a*,ages an/ at*hes

os .sers an/ gro.s

hoe-/ire*tories

.ser settings an/ logon s*rits

'''redhatcom /6 refarch(feedbac&1redhatcom


23/67

(. Stretc #!ustersRe/ 3at Cl.stering *an >e .se/ to rovi/e /isaster re*overy *aa>ilities in or/er to iniiGeservi*e /ontie in hysi*al site ail.re s*enarios Stret*h *l.sters san to sites an/ haveAN-li,e laten*y >eteen sites via site-to-site interlin, Re/ 3at s.orts /ierent stret*h

*l.ster ar*hite*t.res /een/ing on the the storage inrastr.*t.re reE.ireents an/ /atareli*ation te*hnologies as shon in Tnole/ge )ase arti*le JS.ort or Re/ 3at 5nterrisein.' Cl.ster an/ 3igh Availa>ility Stret*h Ar*hite*t.resK +his se*tion ill o*.s on the J&.lly9nter*onne*te/ SAN ith V: :irroringK .se *ase4 /es*ri>e/ in olloing /iagra

refarch(feedbac&1redhatcom /8 '''redhatcom

Figure '.(.1: Full% )nterconnecte* SA+ ,it-$/ /irroring
https://access.redhat.com/kb/docs/DOC-58412https://access.redhat.com/kb/docs/DOC-58412https://access.redhat.com/kb/docs/DOC-58412https://access.redhat.com/kb/docs/DOC-58412


24/67

6.7.1 Network infrastructure requirements9n this *onig.ration *l.ster no/es are /istri>.te/ >eteen to sites )oth sites .st >e*onne*te/ >y a netor, inter*onne*t that rovi/es a AN-li,e laten*y M 2s ro.n/ tri ingtie4 an/ share logi*al netor,s :.lti*ast or >roa/*ast .st or, >eteen the no/es in the/ierent sites

6.7.2 Storage requirements+his sol.tion reE.ires at least to storage arrays4 one at ea*h hysi*al site4 ith .ll SAN*onne*tivity >eteen all arrays an/ all no/es at ea*h site

6.7.3 Quorum in stretch clusters+here are several te*hniE.es or E.or. anageent /een/ing on the n.>er an//istri>.tion o no/es4 these are liste/ >elo A E.or. /is, .se/ in any o these te*hniE.es.st >e a single /is, in the *l.ster an/ *an not >e reli*ate/

+o no/es *l.sters *an .se to-no/e o/e ith en*ing /elays A FENCINGLOOPthat*a.ses the no/es to en*e ea*h other ay o**.r an/ .st >e ta,en into *onsi/eration

An iSCS9 >ase/ E.or. /is, is re*oen/e/ or *l.sters ith ore than three no/es

an/ *an >e .se/ in to no/e *l.sters

&or evenly /istri>.te/ *l.sters4 a tie>rea,er no/e at a thir/ site *an >e .se/

A F.or. /is, or a tie>rea,er no/e *an >e lo*ate/ in one o the *l.ster sites

3oever4 an.ally e/iting the *l.ster e'e*te/ votes is reE.ire/ /.ring ailover in siteail.re *ases i tie>rea,er no/e or E.or. /is, is lo*ate/ in the ae*te/ site

6.7.4 Data replication with LVMV: irror is .se/ to syn*hrono.sly reli*ate storage >eteen the to arrays Several oints.st >e *onsi/ere/ hen *onig.ring V: irror in stret*h *l.sters

V: tags >ase/ 3A-V: is reE.ire/ in this *ase to ens.re /ata *onsisten*y

;hen *reating V: irrors4 the irror legs .st >e *reate/ in storage arrays at

/ierent hysi*al sites

+o avoi/ irror resyn*hroniGation on re>oot4 /is, >ase/ irrorlog .st >e .se/ Sin*e

R35 #64 irrorlog *an >e irrore/ itsel

'''redhatcom /> refarch(feedbac&1redhatcom


25/67

6.7.5 Stretch cluster limitations+he .se o stret*h *l.sters iose soe restri*tions hen *onig.ring Re/ 3at Cl.stering

A a'i. o to sites are s.orte/ +his /oes not in*l./e a thir/ site4 hi*h ay >e

.se/ or a//itional E.or. inoration via a E.or. /is,

CV:D is not s.orte/ in stret*h *l.sters 3A-V: ith tags .st >e .se/ to ens.re

/ata *onsisten*y in share/ vol.es

Cl.ster aare irroring *irror4 ehavior in a site ail.re s*enario .st >e *are.lly

analyGe/

9n to no/e *l.sters ith to-no/e o/e ena>le/4 ea*h no/e *an grant E.or. >y

itsel4 so the *l.ster ill never lose E.or.

9n the event o a /ata*enter ail.re4 i the *l.sters are evenly /istri>.te/ ith the

E.or. /is, at a thir/ site4 the no/es at the healthy site ill aintain E.or. hile*onne*tivity to the thir/ site is not lost

Site ail.re s*enarios that lea/ to E.or. /is, loss hen E.or. /is, is lo*ate/ in one

o the /ata*enters setting the e'e*te/ votes an.ally ill >e reE.ire/ to gainE.or.

(n*e E.or. is restore/4 the a/inistrator .st overri/e the no/e en*ing .singen*eHa*,Han.al (n*e an.al en*ing a*,nole/gent has >een erore/4 the servi*esr.nning in the aile/ site ill >e relo*ate/ to the s.rviving site

Desite >oth no/es >eing E.orate4 re*overy still aits or en*ing to *olete +his ens.resthe reservation o /ata integrity

6.7.7 Site recovery management;hen a site ail.re o**.rs4 V: irror reli*ation >e*oes >ro,en ;hen a site is re*overe/4irror re*overy .st >e /one an.ally +his ro*e/.re .st >e erore/ hile the irror is

not >eing a**esse/ >y a live servi*e Peroring a irror re*overy hile the irror is in .se>y the *l.ster or >y the *l.ster servi*es is not s.orte/

refarch(feedbac&1redhatcom /? '''redhatcom


26/67

6.7.8 Stretch clusters architecture reviewStret*h *l.sters .st >e *are.lly /esigne/ an/ ileente/ to ens.re roer >ehavior in allail.re s*enarios Stret*h *l.sters reE.ire o>taining a oral revie ro Re/ 3at S.ort as/es*ri>e/ in ,nole/ge >ase arti*le JAr*hite*t.re Revie Pro*ess or Re/ 3at 5nterrise

in.' 3igh Availa>ility4 Cl.stering4 an/


27/67

7 Operating System InstallationReeren*e the Re( *at Enter'rise Lin&+ Installation G&i(eor the se*ii* /etails regar/ingthe a*E.isition an/ installation o Re/ 3at 5nterrise in.' +he g.i/e in*l./es inorationse*ii* to the lator on hi*h the installation ta,es la*e '864 A:D6$4 9ntel 6$ an/9tani.4 >e s.re to rea/ the aroriate se*tion or yo.r lator

(n*e the lator se*ii* inoration has >een .n/erstoo/ an/ the har/are *onig.rationhas >een erore/ to a**oo/ate a *l.ster4 install Re/ 3at 5nterrise in.' #6 on theservers .sing the reerre/ etho/

+he installation assistant g.i/es the .ser thro.gh the (S installation +he Re/ 3at 5nterrisein.' 9nstallation e erore/on every *l.ster no/e

1 9nstall the Re/ 3at 5nterrise in.' oerating syste

2 9nstall the reE.ire/ *l.ster a*,ages

% Peror the reE.ire/ (S *.stoiGations

$ Peror the reE.ire/ netor, *onig.ration

# Peror the lo*al storage *onig.ration ro*e/.re

6 (n one no/e only4 *reate a *l.ster *onig.ration ile an/ *oy the ile to all other *l.stere>ers

7 Start the *l.ster /aeons on all no/es

7.1.1 Core Cluster Software Installation1 S.>s*ri>e all *l.ster no/es to the JR35 Cl.steringK *hannel on R3N or yo.r lo*al

R3N Satellite Server

2 9nstall the reE.ire/ RP:s ith the olloing yum*oan/

R35#

# yum groupinstall Clustering

R356

# yum groupinstall "High Availability"

refarch(feedbac&1redhatcom +/ '''redhatcom


28/67

.2 OS #ustomi/ations

7.2.1 SAP specific OS customizationPlease a,e s.re that all (S *.stoiGations reE.ire/ or SAP have >een alie/

SAP note 10$8%0% - JRe/ 3at 5nterrise in.' #' 9nstallation an/ .gra/eK

SAP note 1$"6$10 - JRe/ 3at 5nterrise in.' 6' 9nstallation an/ .gra/eK

7.2.2 NTP+he syn*hroniGation o syste *lo*,s in a *l.ster >e*oes ininitely ore iortant henstorage is share/ aong e>ers Syste ties sho.l/ >e syn*hroniGe/ against a netor,tie server via the Netor, +ie Proto*ol N+P >y .sing the nt/ servi*e

7.2.3 ACPIPlease reeren*e the Confi)&rin) ACPI For Use wit% Inte)rate( Fence Devicesse*tion inJConig.ring an/ :anaging a Re/ 3at Cl.sterK As /es*ri>e/ there4 /isa>ling ACP9 Sot-(allos an integrate/ en*e /evi*e to sh.t /on a server ie/iately rather than atteting a*lean sh.t/on

Sot-( allos soe *oonents to reain oere/ so the syste *an >e ro.se/ ro in.tro the ,ey>oar/4 *lo*,4 o/e4 AN4 or US) /evi*e an/ s.>seE.ently ta,es longer to .llysh.t/on 9 a *l.ster e>er is *onig.re/ to >e en*e/ >y an integrate/ en*e /evi*e4/isa>le ACP9 Sot-( or that no/e (therise4 i ACP9 Sot-( is ena>le/4 an integrate/en*e /evi*e *an ta,e several se*on/s or ore to t.rn o a no/e sin*e the oerating systeattets a *lean sh.t/on 9n a//ition4 i ACP9 Sot-( is ena>le/ an/ a no/e ani*s orreeGes /.ring sh.t/on4 an integrate/ en*e /evi*e ay not >e a>le to oer o the no/eUn/er those *ir*.stan*es4 en*ing is /elaye/ or .ns.**ess.l

Use the olloing *oan/s to sit*h o ACP9 Sot-(

# service acpid stop

# chkconfig acpid off

'''redhatcom ++ refarch(feedbac&1redhatcom
https://service.sap.com/sap/support/notes/1048303https://service.sap.com/sap/support/notes/1496410https://service.sap.com/sap/support/notes/1048303https://service.sap.com/sap/support/notes/1496410


29/67

7.2.4 Firewall9 .se o a lo*al ireall on the *l.ster no/es is inten/e/4 the se*ii* 9P orts or the olloing

servi*es .st >e ena>le/ in or/er to a**oo/ate R35 3A A//-(n *o.ni*ationreE.ireents +he servi*es an/ orts are liste/ in the olloing ta>le

Service 2P Ports

oenais #$0$4 #$0#

ri**i 11111

/l 2106$

**s/ #00064 #00074 #00084 #000"

Table (.2.0.1: Service Ports

.3 %etwor& #on0i"uration9n a *l.ster *onig.ration4 the *onig.ration o the *l.ster inter*onne*t is e'treely iortant+he inter*onne*t is resonsi>le or all internal *l.ster *o.ni*ation ;ith a *l.stere/ ilesyste4 all /istri>.te/ lo*,ing essages are ro.te/ thro.gh the *l.ster inter*onne*t As s.*h4it is highly re*oen/e/ that the netor, >e relia>le an/ high see/

7.3.1 Public/Private NetworksAt least to netor, intera*es are re*oen/e/ or *l.stering +he reason or this is tosearate *l.ster trai* ro all other netor, trai* Availa>ility an/ *l.ster ile systeeroran*e is /een/ent on the relia>ility an/ eroran*e o the *l.ster *o.ni*ation

netor, rivate netor,

+hereore4 all .>li* netor, loa/ .st >e ro.te/ thro.gh a /ierent netor, .>li* netor,

7.3.2 Bonding9n high availa>ility *onig.rations4 at least the rivate or *l.ster inter*onne*t netor, set.4reera>ly >oth4 .st >e .lly re/.n/ant Netor, 9ntera*e Car/ N9C >on/ing is the onlyetho/ to rovi/e N9C ailover or the *l.ster *o.ni*ation netor,

refarch(feedbac&1redhatcom += '''redhatcom


30/67

7.3.3 Hosts file+he"etc"%ostsile or ea*h *l.ster e>er sho.l/ *ontain an entry /eining local%ost 9 thee'ternal host nae o the syste is /eine/ on the sae line4 the host nae reeren*e sho.l/>e reove/ &or e'ale4 i"etc"%osts*ontains a line li,e this

127.0.0.1 localhost.localdomain localhost foo.bar.com foo

lease *hange it to this

127.0.0.1 localhost.localdomain localhost

A//itionally4 ea*h"etc"%osts ile sho.l/ /eine the lo*al inter*onne*t o ea*h *l.ster e>er

.$ Stora"e #on0i"uration

7.4.1 Multipathing

Storage har/are ven/ors oer /ierent sol.tions or ileenting .ltiath ailover*aa>ility +his /o*.ent o*.ses on the generi* .ltiath /evi*e aer aroa*h

7.4.2 Device Mapper Multipath+he /evi*e aer .ltiath l.gin D: .ltiath rovi/es greater relia>ility an/eroran*e >y .sing ath ailover an/ loa/ >alan*ing 9n 3A s*enarios4 *l.ster servers *an.se .ltile aths to the share/ storage /evi*es Norally these /evi*es are resente/ as.ltile /evi*e iles "(ev"s(,,

D:-:.ltiath *reates a single /evi*e that ro.tes 9B( to the .n/erlying /evi*es a**or/ing tothe .ltiath *onig.ration 9t *reates ,ernel >lo*, /evi*es "(ev"(#-. an/ *orreson/ing

>lo*, /evi*es ith ersistent naes in the"(ev"#a''er/ire*tory

+he .ltiath *onig.ration ile"etc"#&lti'at%$conf*an also >e .se/ to set storage se*ii*attri>.tes +hese .ltiath se*ii* settings are .s.ally o>taine/ ro the storage ven/or an/tyi*ally s.erse/e the /ea.lt settings Please *ons.lt yo.r storage har/are ven/or or the*orre*t an/ s.orte/ .ltiath *onig.ration

'''redhatcom +0 refarch(feedbac&1redhatcom


31/67

+he aing o UN i/s to .ser rien/ly /evi*e naes sho.l/ >e ena>le/ in"etc"#&lti'at%$conf>y setting these to varia>les ithin the /ea.lts se*tion

defaults {

user_friendly_names yes

bindings_file /etc/multipath.bindings

}

The bindings file only contains the alias name and the !" id in theformat$

%alias1& %id1&

%alias2& %id2&

[ ... output truncated ... ]

9 >in/ing is *onig.re/ >.t the >in/ings ile /oesnIt e'ist4 it is *reate/ /.ring ne't syste>oot

+he >in/ings have to >e *onsistent a*ross all *l.ster no/es Distri>.te #&lti'at%$confan/#&lti'at%$bin(in)sto all no/es arti*iating in the *l.ster

:a,e s.re to .se the *orre*t /river4 ath riorities an/ loa/ >alan*ing algorith or yo.r SANstorage Soe storage arrays .se reerre/ aths 5ven tho.gh the .n/erlying storage UN*an >e a**esse/ thro.gh all availa>le &C aths only *ertain aths are otiiGe/ or a'i.eroran*e R35# an/ R356 s.ort the AUA roto*ol to a.toati*ally /ete*t an/ .seeroran*e otiiGe/ aths

+he *oan/ multipath -lllists all .ltiath /evi*es4 storage UNs4 &C aths an/ ath

stat.s J5na>le/K eans that the ath is availa>le >.t *.rrently not .se/ or 9B( >a*,. Bailover ath JA*tiveK eans that this ath is in .se an/ re*eiving 9B( reE.ests

7.4.3 LVM9n R35 3A A//-(n4 V: anage/ share/ storage *an >e *ontrolle/ >y 3igh Availa>ilityreso.r*e anager agents or V: 3A-V: or the *l.stere/ logi*al vol.e anager/aeon *lv/BCV:

+he e'ale *onig.ration in this aer .ses 3A-V: >e*a.se the servi*es anage/ >y the*l.ster sotare SAP D)4 SAP instan*es have /e/i*ate/ vol.e gro.s ith /e/i*ate/hysi*al vol.es +his avoi/s *on*.rrent a**ess to logi*al vol.es originating ro .ltile

no/es

refarch(feedbac&1redhatcom +- '''redhatcom


32/67

80=/ 3*M Configuration

+he V: *onig.ration ile"etc"lv#"lv#$conf.st >e o/iie/ to ena>le the .se o 3A-V:

1 )y /ea.lt4 the V: *oan/s s*an all /evi*es o.n/ /ire*tly in the"(evath +his isins.i*ient in /-.ltiath *onig.rations +here are to ays to ena>le .ltiath

/evi*es or V: +he easiest is to o/iy the s*an array in the *onig.ration ile asollos

scan ' ( )/de*/mapper) +

2 9n or/er to allo *l.ster e>ers to a*tivate logi*al vol.es thro.gh the 3A-V:reso.r*e agent it is ne*essary to aintain a vol.eHlist in lv#$conf

# ,f *olume_list is defined- each is only acti*ated if there is a

# match against the list.

# )*gname) and )*gname/l*name) are matched eactly.

# )tag) matches any tag set in the or .

# )) matches if any tag defined on the host is also set in the or

*olume_list ' ( )*g0)- )%nodename&)- +

Please rela*e JMno/enaeK ith the nae yo. have *onig.re/ or the no/e in theBet*B*l.sterB*l.ster*on

:o/ii*ations to lv#$confhave to >e *oile/ into the ,ernel >oot a*,age

# new-kernel-pkg --mkinitrd --initrdfile=bootinitrd-halvm-!uname -r!img--install !uname -r!

Please reeren*e the V: A/inistrators


33/67

.' #!uster #ore #on0i"uration+he *l.ster *onig.ration ile4"etc"cl&ster"cl&ster$confin =: orat4 or this *l.ster *ontainsthe olloing o.tline

%3ml *ersion')1.0)3&

%cluster&

%cman/&

%totem/&

%4uorumd/&

%fence_daemon/&

%clusternodes&

%clusternode/&

[ ... output abbreviated ... ]

%clusternode/&

%/clusternodes&

%fencede*ices&

%fencede*ice/&


%fencede*ice/&

%/fencede*ices&

%rm&

%566 onfiguration of the resource group manager 66&

%/rm&

%/cluster&

+he *l.ster *onig.ration *an >e *reate/ in three /ierent ays

1 Conga- A e> >ase/ *onig.ration intera*e

2 system-config-cluster- +he lo*al *l.ster *onig.ration


34/67

9t is thereore re*oen/e/ to *reate the initial *l.ster *onig.ration ile ith the hel o aase/ tool system-config-cluster an/ later eror all ne*essary o/ii*ations

>y han/

+o an.ally alter the *onig.ration ithin a r.nning *l.ster4 the olloing stes .st >eerore/

1 9n*reent the config_versionattri>.te ithin the tag%cluster config_*ersion')8)/&

2 U/ate the **s *l.ster *onig.ration

# ccstool update etcclusterclusterconf

+his /istri>.tes the ne *onig.ration to all e>ers o the *l.ster

+he tag sho.l/ /eine the olloing attri>.tes

Attribute Description

*onigHversion Version n.>er o the *onig.ration

Nae +he nae o the *l.ster

Table (..1: Cluster Tag Attributes

7.5.1 CMAN / OpenAIS+he (enA9S /aeon4 aise(ec4 is starte/ an/ *onig.re/ >y C:AN +yi*ally4 all or, is

erore/ ithin the *an init s*rit +he olloing *oan/ *an >e .se/ to start theaise(ec/aeon

# service cman start

+he C:ANB(enA9S ortion ithin the *l.ster *onig.ration ile is /eine/ ithin the tag +he olloing attri>.tes sho.l/ >e ta,en into *onsi/eration


e'e*te/Hvotes N.>er o votes .se/ to *al*.late the E.or.

toHno/eSe*ial *onig.ration otion or 2-no/e *l.sters hi*hignores E.or. reE.ireents

Table (..1.1: C/A+ Tag Attributes

'''redhatcom +> refarch(feedbac&1redhatcom


35/67

7.5.2 Qdisk9 the .se o a E.or. /evi*e is inten/e/4 the olloing stes .st >e erore/

1 &orat a share/ /is, artition as E.or. /is,

# mkqdisk -c )device* -l )label*

2 A// a *onig.ration tag to the *l.ster *onig.ration ile

% (tionally /eine hel.l he.risti*s or E/is,/ verii*ation .roses



interval +he reE.en*y o rea/Brite *y*les4 in se*on/s

t,o+he n.>er o *y*les a no/e .st iss in or/er to >e/e*lare/ /ea/

votes +he n.>er o votes the E.or. /aeon a/vertises toC:AN hen it has a high eno.gh s*ore

logHlevelControls the ver>osity o the E.or. /aeon in the systelogs 0 eergen*ies 7 /e>.g

logHa*ilityControls the syslog a*ility .se/ >y the E.or. /aeon

hen logging &or a *olete list o availa>le a*ilities4 seesyslog*on# +he /ea.lt val.e or this is J/aeonK

inHs*ore

A>sol.te ini. s*ore to *onsi/er oneIs sel alive 9oitte/4 or set to 04 the /ea.lt .n*tion loorn!1B2 is.se/4 here n is the total o all o /eine/ he.risti*s s*ore

attri>.tes +his .st never e'*ee/ the s. o the he.risti*s*ores4 or else the E.or. /is, never >e*oes availa>le

/evi*e

+he /evi*e the E.or. /aeon .ses +his /evi*e .st >ethe sae on all no/es la>el (verri/es the /evi*e iel/ iresent 9 se*iie/4 the E.or. /aeon rea/sBro*Bartitions an/ sear*h or E/is, signat.res on every>lo*, /evi*e o.n/4 *oaring the la>el against these*iie/ la>el +his is .se.l in *onig.rations here the>lo*, /evi*e nae /iers on a er-no/e >asis

asterHins

Controls the voting >ehavior o E/is,/ 9 set to a val.e o 14then only the E/is,/ aster rovi/es votes to C:AN +hisens.res that the E/is,/ aster a.toati*ally ins in aen*e ra*eSee the E/is,# an age or ore inoration a>o.t thisattri>.te

Table (..2.1: uorum* Tag Attributes

refarch(feedbac&1redhatcom +? '''redhatcom


36/67

9n the *ase o a slit >rain sit.ation4 he.risti*s *an >e .se/ to i/entiy the *l.ster artition thatis >est to s.rvive 3e.risti*s *an >e /eine/ >y a//ing a tag ithin the tag



rogra

+he rogra .se/ to /eterine i this he.risti* is alive +his*an >e anything e'e*.ta>le >y binsh -c A ret.rn

val.e o Gero in/i*ates s.**ess anything else in/i*atesail.re

s*ore+he eight o this he.risti* )e *are.l hen /eterinings*ores or he.risti*s +he /ea.lt s*ore or ea*h he.risti* is1

interval+he reE.en*y in se*on/s at hi*h e oll the he.risti*+he /ea.lt interval or every he.risti* is 2 se*on/s

t,o

+he n.>er o he.risti* test ail.res >eore a no/e is*onsi/ere/ D(;N an/ its s*ore is reove/ +he /ea.ltt,o or ea*h he.risti* is 14 hi*h *an >e ina/eE.ate ora*tions s.*h as IingI

Table (..2.2: "euristic Tag Attributes

&or ore /etaile/ inoration4 reer to the E/is, an age 9 /evi*e aer .ltiath is .se/together ith qdiskd4 the val.es or tkoan/ interval.st >e *are.lly *onsi/ere/ 9n the

e'ale *ase o a ath ailover4 all storage 9B( is E.e.e/ >y the /evi*e aer o/.le +heE/is, tieo.t .st >e a/ate/ to the ossi>le /evi*e aerIs E.e.ing tie A /etaile/analysis on F.or. Dis, *onig.ration *an >e o.n/ in the te*hni*al >rie 3o to (tially

Conig.re a F.or. Dis, in Re/ 3at 5nterrise in.' Cl.stering an/ 3igh-Availa>ility5nvironents

7.5.3 Fencing+he en*ing *onig.ration *onsists o to arts +he irst is the *onig.ration o the en*ing/aeon en*e/ itsel +he se*on/ is the *onig.ration o the en*ing agents that the /aeon.ses to en*e ea*h *l.ster no/e

+he en*ing /aeon is *onig.re/ >y a//ing the tag ithin the *l.ster*onig.ration ile +he olloing attri>.tes sho.l/ >e *onsi/ere/


ostH@oinH/elayPost-@oin /elay is the n.>er o se*on/s the /aeon aits>eore en*ing any vi*tis ater a no/e @oins the /oain

ostHailH/elayPost-ail /elay is the n.>er o se*on/s the /aeon aits>eore en*ing any vi*tis ater a /oain e>er ails

Table (..3.1: Fence*aemon Tag Attributes

'''redhatcom =. refarch(feedbac&1redhatcom
https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20https://access.redhat.com/knowledge/techbriefs/how-optimally-configure-quorum-disk-red-hat-enterprise-linux-clustering-and-hig%20


37/67

+he en*ing agents .se/ or ea*h *l.ster no/e .st >e *onig.re/ ithin the tag &or ea*h en*ing /evi*e4 a tag ithin the tag .st >e/eine/ +he tag sho.l/ at ini. /eine the agent an/ nae attri>.tes

+he en*ing syste s.orts .ltile layers o en*e /evi*es a,ing it is ossi>le to*onig.re ore than one ay to en*e a *l.ster no/e A en*ing attet s.**ee/e/ i all en*e

a*tions en*e /evi*es that >elong to the sae en*e-level etho/ ere s.**ess.llye'e*.te/

&or .rther inoration a>o.t the /ierent *onig.ration otions o all en*ing agents4reeren*e the an ages o the /esire/ en*ing agent

7.5.4 Cluster Nodes+he *onig.ration o the *l.ster no/es is *ontrolle/ >y tags ithin anen*as.lating tag +he >asi* *l.ster no/e *onig.ration sho.l/ *ontain at leastthe olloing attri>.tes


nae +he nae o the host

no/ei/ +he i/ o the *l.ster no/e

votes +he n.>er o E.or. votes or this no/e

Table (..0.1: Clusterno*es Tag Attributes

;ithin the tag4 the etho/s .se/ to en*e the no/e .st >e /eine/ All en*inge*hanis are en*as.late/ ithin the tag 5a*h en*ing e*hanis is /eine/ >ythe tag

Please reer to the an ages o en*e as ell as the an ages or the *hosen en*inge*haniss or .rther /etails

8 (n every *l.ster no/e4 start the *an init s*rit

# service cman start

" +o veriy the *hanges have >een roagate/4 the version n.>er an/ *l.ster stat.s*an >e viee/ on any no/e at any tie .sing *anHtool

# cmantool status

10+he state o all *l.ster no/es *an >e viee/ ith the olloing *oan/

# cmantool nodes

refarch(feedbac&1redhatcom =/ '''redhatcom


38/67

8 SAP Installation

.1 SAP Arcitecture

&olloing the esta>lishe/ SAP /o*.entation is highly re*oen/e/ SAP 9nstallation ase an/ SAP instan*e ASCSBSCS4 5RS4 PAS reE.ires a virt.al 9P

a//ress an/ virt.al hostnae

+he virt.al a//resses .st not >e *onig.re/ at the oerating syste level >e*a.se they are.n/er the *ontrol o the Cl.stering +hose a//resses are reerre/ to as the virt.al 9Pa//resses +he virt.al 9P a//ress an/ virt.al hostnae g.arantee that a /ata>ase or SAPinstan*e is alays a**essi>le .n/er the sae nae no atter hi*h hysi*al *l.ster no/e

*.rrently hosts the servi*e

o*al /ialog instan*es4 hi*h are not art o the *l.ster4 .se a virt.al host nae as an alias tothe hysi*al host nae so those SAP instan*es are not aile/ over >y R35 3A A//-(n +heenE.e.e reli*ation server /oes not nee/ an 9P a//ress >e*a.se no e'ternal *onne*tionsare esta>lishe/ ith it +he virt.al host nae is .se/ to start the instan*es an.ally via thesapstart*oan/ an/ to /isting.ish their roile naes ro hysi*al host naes

5/it the"etc"%ostsile on all no/es an/ a// the virt.al host naes an/ their asso*iate/ 9Pa//resses or a// the to yo.r DNS server A//itionally4 a// any other *l.ster relevant hostnae an/ a//ress eg4 the hysi*al host naes or a//resses o the no/es to Bet*Bhosts sothe DNS server is no longer a ossi>le single oint o ail.re

Please a,e s.re to .se the *orre*t virt.al hostnae hen installing the SAP an/ /ata>aseinstan*es ith the SAP9NS+HUS5H3(S+NA:5 araeter hen staring SAP9NS+

'''redhatcom =+ refarch(feedbac&1redhatcom
http://service.sap.com/instguideshttps://www.sdn.sap.com/irj/sdn/hahttp://service.sap.com/instguideshttps://www.sdn.sap.com/irj/sdn/ha


39/67

.3 +i!e Systems+he ile systes or o.r s*enario .st >e reare/ >eore installing SAP Net;eaver

8.3.1 Local File SystemsDire*tories s.*h as"&sr"sa'4"sa'#nt4 an/"oracle*an >e *reate/ lo*ally on ea*h no/e +helin,ing /ire*tory"&sr"sa'"/SID0"S1S*an also resi/e lo*ally >e*a.se it *ontains only lin,s to

"sa'#nt"/SID0 Ater initial installation o SAP *oy the"&sr"sa'"/SID0"S1S/ire*tory to all*l.ster no/es +he /ire*tory"&sr"sa'"t#'sho.l/ also >e lo*ally on every *l.ster e>er

Se*ii* /ire*tories or SAP agents s.*h as"&sr"sa'"cc#s4"&sr"sa'"/SID0"cc#sor"&sr"sa'"S!D.st >e *onig.re/ a**or/ing to yo.r SAP lan/s*ae

8.3.2 Instance specific File Systems+he instan*e /ire*tories"&sr"sa'"/SID0"/InstanceNo0.st >e set . on share/ storage4 sothat these /ire*tories are a>le to eror a sit*hover triggere/ >y the *l.ster sotare +he/ata>ase /ire*tory"oracle"/SID0an/ its s.>-/ire*tories *ontaining the D):S e'e*.ta>les4/atailes4 logiles an/ logar*hives .st also resi/e on share/ storage hile "oracle"clientsho.l/ >e lo*al to ea*h *l.ster no/e

&ollo the /ata>ase ile syste *onig.ration re*oen/ations ro the SAP installationg.i/e 9t is re*oen/e/ to have hysi*ally /ierent o.nt oints or the rogra iles an/or ori)lo)4 #irrlo)4 log ar*hives an/ ea*h sa/ata

N(+5 +he *onig.ration ro*ess gets ore *ole' hen .ltile /ata>ase instan*es othe sae tye r.n ithin the *l.ster +he rogra iles .st >e a**essi>le or every instan*e+he o.nts ro share/ storage .st >e a//e/ to the *l.ster *onig.ration as ile systereso.r*es to the ailover servi*e

8.3.3 Shared File Systems+he olloing ile systes nee/ to >e availa>le on all servers here instan*es o a SAPsyste are r.nning in*l./ing ali*ation servers that are not art o the *l.ster

"sa'#nt"/SID0

"&sr"sa'"trans

Sin*e si.ltaneo.s rea/ an/ rite a**esses *an o**.r to those ile systes ro /ierentservers those ile systes sho.l/ either resi/e on a high availa>le N&S server or N&Se'orting storage array Alternatively a e .se/ or ea*h ile syste

9 N&S is .se/ to rovi/e a**ess to these ile systes the N&S server *an not >e art o the*l.ster see httsBBa**essre/hat*oBsiteBsol.tionsB222%1or ore inoration

refarch(feedbac&1redhatcom == '''redhatcom
https://access.redhat.com/site/solutions/22231https://access.redhat.com/site/solutions/22231https://access.redhat.com/site/solutions/22231


40/67

.$ SAP nsta!!ation)eore installing SAP Net;eaver4 o.nt all the ne*essary ilesystes either thro.gh the*l.ster or an.ally )e *ons*io.s o the overo.nt ee*t >y o.nting the hierar*hi*allyhighest /ire*tories irst

5na>le the virt.al 9P a//ress either thro.gh the *l.ster or an.ally +his is ne*essary

>e*a.se SAPinst starts the nely *reate/ instan*e /.ring its ost-ro*essing

8.4.1 Installation with sapinst;hen starting the SAP installation tool sapinst4 a,e s.re to se*iy the virt.al host

nae

sapinst 9:;,"9T_!99T":?er that in *ase o a *lient-at*hall no/es have to >e ./ate/

+he ost iortant SAP roile araeter or a *l.stere/ SAP syste is SAPLOCALHOST

'''redhatcom =0 refarch(feedbac&1redhatcom


41/67

Ater the installation ith sapinst4 ens.re that all SAP instan*e roiles *ontain this

araeter +he val.e o the araeter .st >e the virt.al host nae se*iie/ /.ring theinstallation

As a general re*oen/ation4 the SAP araeter esim!lementationsho.l/ >e set to st/ inthe SAP DEFAULT$PFLile See SAP Note "$17%# +he SAP9nstan*e reso.r*e agent *annot

.se the AU+(:A+9CHR5C(V5R .n*tion or systes that have this araeter set toa

9n the S+AR+ roiles4 the araeter SAPS"ST#$.st >e set /ea.lt sin*e 700

8.5.3 SAP Release-specific Post-processing&or irove/ SAP har/are ,ey /eterination in high-availa>ility s*enarios it ight >ene*essary to install several SAP li*ense ,eys >ase/ on the har/are ,eys o ea*h *l.sterno/e Please see SAP Note 1178686 or ore inoration

&or SAP ,ernel release 6$04 ollo the instr.*tions o SAP Note 8777"#

&or SAP ,ernel release 6$04 ./ate the SAP ,ernel to at least at*h level 208

;hen .sing a SAP ,ernel 6$04 lease rea/ an/ ileent the a*tions ro the se*tion:an.al ost-ro*essing ro SAP Note ""#116

8.5.4 Before Starting the Cluster9n soe *ases sainst /oesnIt start the reshly installe/ instan*e an/ leaves an ety or,/ire*tory "&sr"sa'"/SID0"/Instance0/Nber0"wor2 hi*h res.lts in a onitoring error othe SAP9nstan*e reso.r*e agent

9n that *ase the instan*e .st >e starte/ an.ally in or/er or the *orre*t entries to >e ritten

to the or, /ire*tory Ater a an.al sh.t/on o the instan*es4 the *l.ster agent *an >e.se/ Ree>er that the virt.al 9P a//resses or the SAP instan*es yo. ish to start .st >ea*tive +hey *an >e starte/ an.ally eg4 ith the in.' *oan/ ip an/ then stoe/

again ater sh.tting /on the SAP instan*es

Sh.t/on the SAP instan*e an/ integrate it into the *l.ster >y *reating a SAP9nstan*ereso.r*e see *hater 7$$

.( Enueue Rep!ication Server&ollo the instr.*tions o the oi*ial SAP i>rary to set. an enE.e.e reli*ation server

httBBhelsa*oBsahelHn7%Bhel/ataBenB$7Be02%%>$2%*8%e10000000a$218"*Braesetht

refarch(feedbac&1redhatcom =- '''redhatcom
http://help.sap.com/saphelp_nw73/helpdata/en/47/e023f3bf423c83e10000000a42189c/frameset.htmhttp://help.sap.com/saphelp_nw73/helpdata/en/47/e023f3bf423c83e10000000a42189c/frameset.htmhttp://help.sap.com/saphelp_nw73/helpdata/en/47/e023f3bf423c83e10000000a42189c/frameset.htmhttp://help.sap.com/saphelp_nw73/helpdata/en/47/e023f3bf423c83e10000000a42189c/frameset.htm


42/67

9 Cluster Configuration

4.1 #!uster Resources

+here are any tyes o *onig.ra>le *l.ster reso.r*es Reeren*e the A//ing a Cl.sterServi*e to the Cl.ster se*tion o Conig.ring an/ :anaging a Re/ 3at Cl.ster or oreinoration

+he olloing reso.r*e tyes are /eine/ to rovi/e the high availa>ility .n*tionality or SAP

9P anages virt.al 9P a//resses

V: anages V: a*tivations

&S o.nts ile-systes

SAPData>ase starts B stos B onitors the Data>ase

SAP9nstan*e starts B stos B onitors a SAP instan*e A)AP or @ava

'''redhatcom =6 refarch(feedbac&1redhatcom


43/67

4.2 5asic r"mana"er #on0i"uration+he reso.r*e gro. anager is *onig.re/ ithin the *l.ster *onig.ration ile

"etc"cl&ster"cl&ster$conf +he *onig.ration is en*as.late/ ithin the tag +he reso.r*eanager *onig.ration has the olloing >asi* layo.t

%rm&

%failo*erdomains&

%failo*erdomain/&


%failo*erdomain/&

%/failo*erdomains&

%resources&

%resource/&


%resource/&

%/resources&

%ser*ice&


%/ser*ice&

%ser*ice&


%/ser*ice&

%e*ents&

%e*ent/&


%/e*ents&

%/rm&

refarch(feedbac&1redhatcom =8 '''redhatcom


44/67

+he olloing attri>.tes *an >e /eine/


logHlevel+he log level is n.>er ro 074 here 7 is I/e>.gI an/ 0is Ieergen*y onlyI +he /ea.lt val.e is $

logHa*ilityog a*ility nae4 s.*h as /aeon4 lo*al$4 or siilar +he/ea.lt val.e is /aeon

*entralHro*essing

+he *entralHro*essing otion is .se/ to a*tivate the evente*hanis CentralHro*essing is nee/e/ to ena>le thehar/ an/ sot servi*e /een/en*ies an/ the olloHservi*e/een/en*y

Table .2.1: !m Tag Attributes

4.3 +ai!over ,omains+he *l.ster *an >e /ivi/e/ into logi*al s.>sets o *l.ster no/es A ailover /oain is a s.>seto e>ers to hi*h a servi*e *an >e >o.n/

&ailover /oains are *onig.re/ in the *l.ster *onig.ration ile +he olloing e'aleo.tlines the >asi* *onig.ration s*hea

%rm&

%failo*erdomains&

%failo*erdomain name')node1) ordered')1) restricted')1)&

%failo*erdomainnode name')node1hb) priority')1)/&


%/failo*erdomain&

%failo*erdomain name')node2) ordered')1) restricted')1)&



%/failo*erdomain&

%/failo*erdomains&

%/rm&

+he e'ale a>ove *reates to ailover /oains Servi*es r.nning on ailover /oain no/e1

reer to r.n on no/e no(e3%bhile servi*es r.nning on ailover /oain no(e4reer to r.non no/e no(e4%b 5a*h *l.ster no/e *an >e art o .ltile ailover /oains

'''redhatcom => refarch(feedbac&1redhatcom


45/67

+he olloing *onig.ration attri>.tes *an >e set to /eine the ailover r.les


restri*te/

Servi*es >o.n/ to the /oain *an only r.n on *l.stere>ers hi*h are also e>ers o the ailover /oain 9no e>ers o the ailover /oain are availa>le4 the

servi*e is la*e/ in the stoe/ state

.nrestri*te/

Servi*es >o.n/ to this /oain *an r.n on all *l.stere>ers4 >.t r.n on a e>er o the /oain heneverone is availa>le +his eans that i a servi*e is r.nningo.tsi/e o the /oain an/ a e>er o the /oain *oesonline4 the servi*e igrates to that e>er

or/ere/

+he or/er se*iie/ in the *onig.ration /i*tates the or/ero reeren*e o e>ers ithin the /oain +he highest-ran,ing e>er o the /oain r.ns the servi*e henever itis online +his eans that i e>er A has a higher-ran,

than e>er )4 the servi*e igrates to A i it as r.nningon ) i A transitions ro oline to online

.nor/ere/

:e>ers o the /oain have no or/er o reeren*e anye>er ay r.n the servi*e Servi*es alays igrate toe>ers o their ailover /oain henever ossi>le4hoever4 in an .nor/ere/ /oain

noail>a*,5na>ling this otion or an or/ere/ ailover /oainrevents a.toate/ ail->a*, ater a ore-reerre/ no/ere@oins the *l.ster

Table .3.1: Failover Attributes

See the Conig.ring a &ailover Doainse*tion o the Cl.ster A/inistration


46/67

4.$ #!uster Resources and Services+here are any tyes o *l.ster reso.r*es that *an >e *onig.re/ Reso.r*es are >.n/le/together to highly availa>le servi*es hile a servi*e *onsists o one or ore *l.ster reso.r*es+he /ata>ase servi*e or e'ale *onsists o these reso.r*es

virt.al 9P a//ress 9P reso.r*e

vol.e gro.s V: reso.r*e

ilesystes or D) e'e*.ta>les4 /atailes4 logs4 et* &S reso.r*e

/ata>ase ali*ation startBstoBonitor SAPData>ase reso.r*e

Reso.r*es *an >e assigne/ to any *l.ster servi*e reso.r*e gro.s (n*e asso*iate/ ith a*l.ster servi*e4 it *an >e relo*ate/ >y the *l.ster transition engine i it /ees it ne*essary4 oran.ally thro.gh a intera*e *onga or via the *oan/ line 9 any*l.ster e>er r.nning a servi*e >e*oes .na>le to /o so eg4 /.e to har/are or sotareail.re4 netor,B*onne*tivity loss4 et*4 the servi*e ith all its reso.r*es are a.toati*ally

igrate/ to an eligi>le e>er a**or/ing to ailover /oain r.les

Reeren*e the A//ing a Cl.ster Servi*e to the Cl.ster se*tion o JConig.ring an/ :anaging aRe/ 3at Cl.sterK or ore inoration

3ighly availa>le *l.ster servi*es are *onig.re/ ithin the Mservi*e tag Consi/er /einingthe olloing attri>.tes


nae +he nae o the servi*e or reso.r*e gro.

/oain +he ailover /oain asso*iate/ ith this servi*e

a.tostart

9 set to yes4 the servi*e a.toati*ally starts ater the *l.ster ors aE.or.9 set to no4 this reso.r*e gro. starts in the I/isa>le/I state ater the*l.ster ors a E.or.Dea.lt is 1

e'*l.sive9 set4 this reso.r*e gro. only relo*ates to no/es hi*h r.n no otherreso.r*e gro.s

re*overy

+his *.rrently has three ossi>le otions

restarttries to restart aile/ arts o this reso.r*e gro.lo*ally >eore atteting to relo*ate /ea.lt

relo*ate /oes not >other trying to restart the servi*e lo*ally

/isa>le /isa>les the reso.r*e gro. i any *oonent ails

9 a reso.r*e has a vali/ re*over oeration an/ *an >e re*overe/itho.t a restart4 it is re*overe/

Table .0.1: Service Tag Attributes

'''redhatcom 0. refarch(feedbac&1redhatcom


47/67

9.4.1 SAP Resources+he olloing reso.r*e tyes are /eine/ to rovi/e the high availa>ility .n*tionality or SAP

?0// 2P

+he i reso.r*e /eines an iv$ or iv6 netor, a//ress +he olloing attri>.tes *an >e/eine/


a//ress 9Pv$ or 9Pv6 a//ress to .se as a virt.al 9P reso.r*e

onitorHlin,5na>ling this *a.ses the stat.s verii*ation to ail i the lin,on the N9C to hi*h this 9P a//ress is >o.n/ is not resent

Table .0.1.1: )p !esource Attributes

?0/+ 3*M

+he lv reso.r*e *ontrols the availa>ility o a logi*al vol.e +he *onig.ra>le reso.r*eattri>.tes are


naeA sy>oli* nae or the ile syste reso.r*e - only as reeren*e

ithin the *l.ster *onig.ration .se/ hen assigning to a servi*e

vgHnae +he nae o the vol.e gro.

lvHnae +he nae o the logi*al vol.e

Table .0.1.2: $/ !esource Attributes

refarch(feedbac&1redhatcom 0/ '''redhatcom


48/67

?0/= %S

+he s reso.r*e /eines a stan/ar/ lo*al ile syste o.nt ie4 a non *l.stere/ or otheriseshare/ ile syste +he olloing attri>.tes *an >e /eine/


nae A sy>oli* nae or the ile syste reso.r*e - only as reeren*eithin the *l.ster *onig.ration .se/ hen assigning to a servi*e

o.ntoint Path ithin ile syste hierar*hy at hi*h to o.nt this ile syste

/evi*e )lo*, /evi*e4 ile syste la>el4 or UU9D o ile syste

stye&ile syste tye 9 not se*iie/4 o.nt8 attets to /eterinethe ile syste tye

or*eH.no.nt

9 set4 the *l.ster ,ills all ro*esses .sing this ile syste hen thereso.r*e gro. is stoe/ (therise4 the .no.nt ails4 an/ thereso.r*e gro. is restarte/ 9t is ne*essary to set this to W1J or allSAP instan*e /ire*tories an/ *an >e set or all SAP an/ D)ilesystes D5&AU+ 0

otionsProvi/es a list o o.nt otions 9 none are se*iie/4 the N&S ilesyste is o.nte/ -o syn*

selHen*e9 set an/ .no.nting the ile syste ails4 the no/e ie/iatelyre>oots .t it is not reE.ire/

or*eHs*,9 set4 the ile syste is veriie/ +his otion is ignore/ or non-

@o.rnale/ ile systes s.*h as e't2

Table .0.1.3: Fs !esource Attributes

?0/0 SAP2nstance

;ithin SAP instan*es there *an >e several servi*es +yi*ally4 servi*es are /eine/ in theS+AR+ roile o the relate/ instan*e Note ith SAP Release 7104 the S+AR+ roile*ontent as ove/ to the instan*e roile Not all o those ro*esses are orth onitoring >ythe *l.ster &or instan*e4 ailover o the SAP instan*e o.l/ not >e reerre/ i the *entralsyslog *olle*tor /aeon aile/

SAP ro*esses onitore/ >y the SAP9nstan*e reso.r*e agent are

/is!or,

sgHserver

enserver

enreserver

@*ontrol

@start

'''redhatcom 0+ refarch(feedbac&1redhatcom


49/67

A SAP instan*e itho.t any o these ro*esses *an not >e anage/ ith the SAP9nstan*ereso.r*e agent

&or e'ale An environent ith a stan/alone gateay instan*e or a stan/alone e>/isat*her instan*e hi*h ails to or, ith this reso.r*e agent +he ne't version o the agent*an have a araeter that *o.l/ >e .se/ to sele*t hi*h servi*es sho.l/ >e onitore/

3oever4 this /oes not ean that a SAP e> /isat*her *annot >e in*l./e/ in another SAPinstan*e that .ses one o the onitore/ servi*es eg4 a SCS instan*e r.nning a sgHserveran/ a enserver 9n this *ase4 the e> /isat*her is starte/ an/ stoe/ together ith theother servi*es >y the *l.ster +he e> /isat*her is then not onitore/4 eaning a h.ng or/ea/ sae>/is ro*ess /oes not *a.se a ailover o the entire SAP instan*e 3oever4 thatay >e the /esire/ >ehavior

All oerations o the SAP9nstan*e reso.r*e agent are erore/ >y .sing the SAP start.raeor, *alle/ SAP :anageent Console4 or sastartsrv4 that as intro/.*e/ ith SAP,ernel release 6$0 Reeren*e a//itional inoration regar/ing the SAP :anageentConsole in SAP Note 101$$80

Using this raeor, /eines a *lear intera*e or the *l.ster heart>eat an/ ho it vies theSAP syste +he onitoring otions or the SAP syste are ar s.erior than other etho/ss.*h as onitoring ro*esses ith the s *oan/ or or inging the ali*ation

sapstartsrv.ses S(AP essages to reE.est the stat.s o r.nning SAP ro*esses As

s.*h4 it *an reE.est stat.s /ire*tly ro the ro*ess itsel4 in/een/ent ro other iss.es that*an e'ist at the tie

sapstartsrvhas o.r stat.s states

.t the servi*e is still or,ing

R5D the servi*e /oes not or,

een starte/

+he SAP9nstan*e reso.r*e agent interrets le4 eaninginor ro>les are not reorte/ to the *l.ster +his revents the *l.ster ro eroring an.nante/ ailover +he stat.ses R5D an/


50/67

9 sapcontrolret.rns a netor, error the sapstartsrvservi*e is not r.nning +he

reso.r*e agent alays trys to restart sapstartsrvin *ase the start. raeor, is not

r.nning

+he SAP9nstan*e reso.r*e *an >e *onig.re/ ith these attri>.tes


9nstan*eNae

+he .ll E.aliie/ SAP instan*e nae in the oratMS9DHM9NS+ANC5HMV3(S+egC(RHDV5):een*hange/ ater the /ea.lt SAP installationD5&AU+

"&sr"sa'"/SID0"/INSTANCE0"e+eor

"&sr"sa'"/SID0"S1S"e+e"r&n

D9RHPR(&95

+he .ll ath to the SAP roile /ire*tory Se*iy thisaraeter4 i yo. have *hange/ the SAP roile /ire*torylo*ation ater the /ea.lt SAP installationD5&AU+

"&sr"sa'"/SID0"S1S"'rofile

S+AR+HPR(&95

+he .ll ath an/ nae o the SAP S+AR+ roile Se*iythis araeter i the nae o the SAP S+AR+ roile as

*hange/ ater the SAP installation Sin*e SAP Net;eaverrelease 71 an/ neer /onIt .se a searate S+AR+ roileanyore the 9nstan*e Proile has to >e se*iie/ instea/or those SAP Neteaver releasesD5&AU+XD9RHPR(&95BS+AR+HM9NS+ANC5HMV3(S+

S+AR+H;A9++9:5 +he tie in se*on/s >eore a onitor oeration ise'e*.te/ >y the reso.r*e agent 9 the onitor ret.rnsSUCC5SS4 the start is han/le/ as SUCC5SS +his is.se.l or resolving tiing iss.es ith the L255-A//9ninstan*e +yi*ally4 the reso.r*e agent aits .ntil allservi*es are starte/ an/ the SAP :anageent Consolereorts a le sta*, installationA)APLava A//9n *onsists o an A)AP /isat*her an/ aLAVA instan*e Norally4 the start o the LAVA instan*eta,es longer than the start o the A)AP instan*e &or aLAVA 9nstan*e4 one ay nee/ to *onig.re a .*h highertieo.t or the start oeration o the reso.r*e +he



51/67


/isa/vantage o.l/ >e that the /is*overy o a aile/ start>y the *l.ster ta,es longer9n soe *ases4 it ay >e ore iortant that the A)APart o the instan*e is . an/ r.nning A ail.re o the LAVA

a//-in /oes not *a.se a ailover o the SAP instan*eA*t.ally4 the SAP :C reorts a 5(; stat.s i the LAVAinstan*e o a /o.>le sta*, syste ails &ro theerse*tive o the reso.r*e agent4 a 5(; stat.s/oesnIt trigger a *l.ster rea*tion SettingS+AR+H;A9++9:5 to a loer val.e *a.ses the reso.r*eagent to veriy the stat.s o the instan*e /.ring a startoeration ater that tie ;hen it o.l/ norally ait or ale sta*, systes

D5&AU+ %600

AU+(:A+9CHR5C(V5R

+he SAP9nstan*e reso.r*e agent attets to re*over aaile/ start attet a.toati*ally one tie +his isa**olishe/ >y ,illing any r.nning instan*e ro*essesan/ e'e*.ting *leani*Soeties a *rashe/ SAP instan*e leaves soero*esses an/Bor share/ eory segents >ehin/Setting this otion to tr.e attets to reove thero*esses an/ share/ eory segents /.ring a startoeration4 re/.*ing a/inistrator la>orD5&AU+ alse

PR5HS+AR+HUS5R5=9+4P(S+HS+AR+HUS5R5=9+4PR5HS+(PHUS5R5=9+4P(S+HS+(PHUS5R5=9+

+he .lly E.aliie/ ath to a s*rit or rogra hi*h sho.l/>e e'e*.te/ >eoreBater a reso.r*e is starte/Bstoe/SAP systes oten reE.ire/ a//itional sotare r.n on thesae server +hat *an >e onitoring sotare or sotareor soe intera*es the SAP syste .ses +hose rogras*an in*l./e >y riting a ne (C& reso.r*e agent to >eintegrate/ into the *l.ster 3oever4 soeties riting areso.r*e agent is too .*h eort ;ith the rovi/e/.sere'its4 *.sto s*rits *an >e easily in*l./e/ into the*l.ster that /o not ollo the (C& stan/ar/ +he

ret.rn*o/e o the s*rits are not .se/ >y the SAP9nstan*ereso.r*e agent +he *all o .sere'it is syn*ron4 eaningthe tie the s*rit reE.ires is going into the tieo.t o thestartBsto oeration /eine/ or the SAP9nstan*e reso.r*e9 the .sere'it-s*rit hangs4 SAP ay not >e starte/D5&AU+ ety

Table .0.1.0: SAP )nstance !esource Attributes

refarch(feedbac&1redhatcom 0- '''redhatcom


52/67

?0/- SAPDatabase

+he .rose o the reso.r*e agent is to start4 sto4 an/ onitor the /ata>ase instan*e o anSAP syste +ogether ith the RD):S syste4 it also *ontrols the relate/ netor, servi*e orthe /ata>ase s.*h as the (ra*le istener or the :a'D) 'server +he reso.r*e agente'e*ts a stan/ar/ SAP installation an/ thereore reE.ires less araeters

+he onitor oeration o the reso.r*e agent *an test the availa>ility o the /ata>ase >y .singSAP tools %transor .dbcconnect ;ith that4 it ens.res that the /ata>ase is tr.ly

a**essi>le >y the SAP syste

Ater an .n*lean e'it or *rash o a /ata>ase4 reE.ire a re*over ro*e/.re to restart *an >ereE.ire/ +he reso.r*e agent has a ro*e/.re ileente/ or ea*h /ata>ase tye 9reerre/4 the attri>.te AU+(:A+9CHR5C(V5R rovi/es this .n*tionality


S9D +he .niE.e SAP syste i/entiier eg C(R

D)+P5 +he RD):S Syste either (RA4 D)6 or ADA

D9RH5=5CU+A)5

+he .ll E.aliie/ ath to the SAP ,ernel +he reso.r*e agentreE.ires the startdban/ the %transe'e*.ta>les &or that

reason4 the /ire*tory ith the SAP ,ernel .st >e a**essi>leto the /ata>ase server at any given tie Se*iy thisaraeter i the SAP ,ernel /ire*tory lo*ation as *hange/ater the /ea.lt SAP installation

N5+S5RV9C5NA:5 +he (ra*le +NS listener nae D5&AU+ 9S+5N5R

D)L255H(N

9 no A)AP sta*, is installe/ in the SAP /ata>ase4 set this totr.e Non A)AP systes *annot >e onitore/ .sing R%trans+hat araeter shits the onitoring etho/ to @/>**onne*tD5&AU+ alseNote that soe iles o the SAP @2ee instanstan*e have to >eo.nte/ B a**essi>le or this oeration to or,Y +his ay lea/to ro>les as the SAP instan*e .s.ally isnIt o.nte/ yet/.ring D) start.Y

LAVAH3(:5

+his is reE.ire/ only i the D)L255H(N araeter is set totr.e 5nter the ath to the Lava SDT .se/ >y the SAP ;e>ASLava Set this araeter i the environent varia>leLAVAH3(:5 is not set or the root .ser4 or oints to another/ire*tory than that o the LAVAH3(:5 or the Msi/a/ .ser

D5&AU+ XLAVAH3(:5

S+R9C+H:(N9+(R9Nase 9tr.e4 it .ses SAP tools to test the *onne*tion to the /ata>aseNot or .se ith (ra*le as it res.lts in .nante/ ailovers inthe *ase o a st.*, ar*hiverD5&AU+ alse



53/67


AU+(:A+9CHR5C(V5R

+he SAPData>ase reso.r*e agent tries to re*over a aile/start attet a.toati*ally one tie +his is a*hieve/ >yeroring a or*e/ a>ort o the RD):S an/Bor e'e*.tingre*overy *oan/s

D5&AU+ alse

D9RH)((+S+RAP

+he .ll ath to the L255 instan*e >ootstra /ire*toryeg4 B&sr"sa'"COR"5C64"74ee"cl&ster"bootstra'+his is reE.ire/ only i the D)L255H(N araeter is set totr.e Note that this /ire*tory ight >e .n/er *ontrol o the*l.ster an/ not yet o.nte/ at /ata>ase start.YD5&AU+ ety

D9RHS5CS+(R5+he .ll ath to the L255 se*.rity store /ire*tory +his isreE.ire/ only i the D)L255H(N araeter is set to tr.eD5&AU+"&sr"sa'"/SID0"S1S")lobal"sec&rit8"lib"tools

D)HLARS

+he .ll E.aliie/ ile nae o the @/>* /river or the /ata>ase*onne*tion test +his is reE.ire/ only i the D)L255H(Naraeter is set to tr.e 9t is a.toati*ally rea/ ro the>ootstraroerties ile in Lava engine 6$0 an/ 700 &orLava engine 7104 the araeter is an/atory5'ale"oracle"client"36+_9:"instantclient"o7(bc3:$7arD5&AU+ ety

PR5HS+AR+HUS5R5=9+4P(S+HS+AR+HUS5R5=9+4PR5HS+(PHUS5R5=9+4

P(S+HS+(PHUS5R5=9+

Sae .n*tionality as in SAP9nstan*e reso.r*e agentD5&AU+ ety

Table .0.1.: Attributes

refarch(feedbac&1redhatcom 08 '''redhatcom


54/67

4.' ,ependencies

9.5.1 Resource Dependencies+he reso.r*es ithin a *l.ster servi*e ollo to /ierent /een/en*y r.les

&irst4 the nesting ithin the servi*e *onig.ration /eines start. or/er an/ reso.r*e/een/en*ies

9n the olloing e'ale4 reso.r*e2 /een/s on reso.r*e1 9n a//ition4 reso.r*e1 is starte/rior to starting reso.r*e2

%ser*ice&

%resource name'Aresource1A&

%resource name'Aresource2A&

%/resource&

%/resource&

%/ser*ice&

Se*on/4 an ili*it or/er an/ /een/en*y is .se/ +he olloing lists the ili*it start. or/ero the revio.sly /eine/ reso.r*es

1 lv

2 s

% i

$ other B ali*ation

9.5.2 Service Dependencies+he servi*es in a *l.ster soeties reE.ire /een/en*y r.les eg4 the /ata>ase .st >estarte/ rior to starting SAP ali*ation servers 3oever4 i the /ata>ase ails an/ iss.>seE.ently relo*ate/4 the ali*ation servers sho.l/ not >e restarte/

A//itionally4 SAP enE.e.e reli*ation reE.ires a se*ial tye o /een/en*y +he enE.e.eserver .st alays ollo the reli*ate/ enE.e.e servi*e

Note that *entralHro*essing .st >e ena>le/ to ena>le servi*e /een/en*ies an/ the events*riting reE.ire/ or the ollo servi*e /een/en*y

%rm central_processing'B1B&

...

%/rm&

'''redhatcom 0> refarch(feedbac&1redhatcom


55/67

?-+/ Hard and Soft Dependencies

+he rgmanagerservi*e /eines inter-servi*e /een/en*ies ith sot an/ har/ reE.ireents

A har/ /een/en*y o.l/ *a.se the /een/ent servi*e to >e stoe/Bstarte/ i its/een/en*ies ere stoe/Bstarte/ A sot /een/en*y is only vali/ or initial start. +he/een/ent servi*e o.l/ not >e stoe/ i its /een/en*ies ere stoe/

+he olloing e'ale /eines the servi*e *onig.ration or a sot /een/en*y

%ser*ice name'Aser*ice1A/&

...

%/ser*ice&

%ser*ice name'Aser*ice2A depend'Aser*ice$ser*ice1A depend_mode'AsoftA/&

...

%/ser*ice&

?-++ %ollo' Service Dependency+he Jollo servi*eJ /een/en*y a,es .se o rganagerIs event s*riting e*hanis 9nor/er to a*tivate the ollo servi*e /een/en*y4 *entralHro*essing .st >e ena>le/ Also4the olloing event .st >e /eine/ in a searate ile in the"&sr"s%are"cl&ster"/ire*tory onevery *l.ster no/e Create an/ /istri>.te these iles a**or/ing to the ASCS an/ 5RS *l.sterservi*e naes

"&sr"s%are"cl&ster"event-service-ers$sl

noticeC)e e>e//e/ in the cl&ster$conf*onig.ration to s.ortenE.e reli*ation ith R35 3A A//-(n

%e*ents&

%e*ent class')ser*ice) name')ser*ice6ers)file')/usr/share/cluster/e*ent6ser*ice6ers.sl)/&

%/e*ents&

refarch(feedbac&1redhatcom 0? '''redhatcom


56/67

10 Cluster Management

16.1 #)A%

+he >asi* *l.ster oeration *an >e veriie/ .sing the cmantool.tility

10.1.1 cman_tool status+he cmantoolstatus*oan/ *an >e .se/ to sho the stat.s o one *l.ster no/e

# cmantool status

ersion$ F.2.0

onfig ersion$ 1

luster "ame$ rh_*ali

luster ,d$ 1G7H7

luster ?ember$ Ies

luster eneration$ JGF

?embership state$ luster6?ember

"odes$ 2


57/67

10.1.3 cman_tool services+he cmantool services*oan/ *an >e .se/ to /islay the stat.s o the *ore *l.ster

servi*es

# cmantool services

type le*el name id state

fence 0 default 00010001 none

(1 2+

dlm 1 rgmanager 00020001 none

(1 2+

16.2 r"mana"er

10.2.1 clustat

+he reso.r*e gro. or servi*e anager state an/ all *onig.re/ servi*es *an >e /islaye/ith the clustat*oan/

# clustat -l

luster 9tatus for rh_*ali Tue Qul 12 11$10$1F 2011

?ember 9tatus$ Kuorate

?ember "ame ,N 9tatus

666666 6666 6666 666666

node1hb 1 >nline- ocal- R6?aster

node2hb 2 >nline- R6Sorer

9er*ice ,nformation

6666666 66666666666

9er*ice "ame $ ser*ice$s*c_cor_database

urrent 9tate $ started C112D

Mlags $ none C0D

>ner $ node2hbast >ner $ node1hb

ast Transition $ Mri Qul L 12$2G$GJ 2011

refarch(feedbac&1redhatcom -/ '''redhatcom


58/67

9er*ice "ame $ ser*ice$s*c_cor_ers01


Mlags $ none C0D

>ner $ node2hb

ast >ner $ node1hb

ast Transition $ Mri Qul L 10$GL$02 2011

9er*ice "ame $ ser*ice$s*c_cor_d02


Mlags $ none C0D

>ner $ node1hb

ast >ner $ node2hb

ast Transition $ Mri Qul L 11$02$1L 2011

9er*ice "ame $ ser*ice$s*c_cor_scs00


Mlags $ none C0D

>ner $ node1hb

ast >ner $ node1hb

ast Transition $ Mri Qul L 10$1F$PG 2011

10.2.2 clusvcadm+he reso.r*e anager servi*es *an >e *ontrolle/ >y the clusvcadm*oan/ +he >asi*

oerations are

clusvcadm -e )service* -/

starts servi*e Mservi*e a**or/ing to ailover /oain r.les

clusvcadm -r )service* -m )member*

relo*ate servi*e Mservi*e to e>er Me>er

clusvcadm -d )service*

/isa>lesBstos servi*e Mservi*e

&or /etaile/ inoration4 reeren*e the *l.sv*a/8 anage

'''redhatcom -+ refarch(feedbac&1redhatcom


59/67

10.2.3 rg_test+he reso.r*e anager *l.ster *onig.ration *an >e veriie/ .sing the rgtest*oan/

# rgtest test etcclusterclusterconf

Running in test mode.

oaded 22 resource rules

''' Resources ist '''

Resource type$ ip

,nstances$ 1/1

:gent$ ip.sh

:ttributes$


''' Mailo*er Nomains '''

Mailo*er domain$ node1

Mlags$ >rdered Restricted

"ode node1hb Cid 1- priority 1D


Mailo*er domain$ node2

Mlags$ >rdered Restricted



[ ... output truncated ... ]

refarch(feedbac&1redhatcom -= '''redhatcom


60/67

11 Closing thoughts ;hile lanning a *l.ster *onsi/er everything ro har/are to sotare an/ reare

ansers to the olloing E.estions

9s there no single-oint-o-ail.re in the

Cluster RH SAP

Documents