ADABAS V82 Jim Poole 2010 Adabas V82 by Jim Poole.

ADABAS V82

Jim Poole2010

Adabas V82 by Jim Poole

2

TOPICS (V8.2.2)01. COMPATIBILITIES02. CONVERSION03. LOWER CASE FIELD NAMES04. REMOVING UNIQUE DESCRIPTOR FLAG05. SMF RECORDS06. ADASAV FILE RANGE (FILE=,FMOVE=)07. NEW AC EXTENTS08 DATE/TIME EDIT MASKS DT=09. TIME ZONE SUPPORT TZ=10. DST DAYLIGHT SAVINGS INDICATOR11. SYSTEM FIELDS12. LOGICAL REMOVAL OF DESCRIPTORS13. LOGICAL REMOVAL OF FIELDS14. ADADBS MODFCB FILEREADONLY15. ADADBS ONLINVERT FNDEF option16. SVC PERFORMANCE17. ADARES PLCOPY more plogs18. ADARUN LOGWARN 19. ADADBS ADDPLOG,DELPLOG20. ADARES REGENERATE/BACKOUT21. ADARUN NPLOG/NWORK122. WORK I,II,III USE Adabas V82 by Jim Poole

3

TOPICS (V8.2.2)23. ADASEL NEW FEATURES24. ADAZIN (NEW) MAINT AND SVC INFO25. ADARUN SRLOG, PLOG SPANNED RECORDS26. ADARUN PREFSTDD27. ADADBS FUNCTIONS. FILE LOCK NOT REQUIRED28. REVIEW OF IN PARALLEL29. INFOBUFFERSIZE,DEVENTLOG30. ADARUN LOGVOLIO 31. CLOG DSECT UPDATED FOR Sx ALGORITHM32. ADAREP PPT33. ADAREP XML34. ADAREP CHANGES35. DDPRINT CHANGES36. ADARUN V64BIT 37. ADARUN LARGEPAGE 38. ACBX 64 BIT SUPPORT39. LOB ENHANCEMENTS40. OP CMD NWCONNECT FOR ENTIRE NETWORK41. ADAWRK TRANSACTION NUMBERS42. SHARED HOLD STATUS43. SMGT CHANGE44. RI COMMAND CHANGES Adabas V82 by Jim Poole

4

01. COMPATIBILITIES

WORKS WITH ALL CURRENT V8 SAG PRODUCTS

WCP V6.2.1 NAT V4.2.5 SQL V2.4.1 PRD V4.5.2 PAC V2.6.1 AVI V8.1.2 ACE V6.6.4 COR V8.1.2

? Earlier Versions / ? Other Products ?

CA-APAS compatible, apply Z51047

NON-SAGPRODUCTS ADASTRIP >5.0.2P new release

CA-APAS exploit features Q4 2010

SVC , AOS (LATER)EXCEPTIONS

PREDICT NEW FEATURESUNKNOWN


5

01. COMPATIBILITIES (ADASAV)

YES: RESTORE/RESTONL FILES=/FMOVE V81 to V82

NO: RESTORE/RESTONL FILES=/FMOVE V82 to V81

(V82 LOADLIB)


6

02. CONVERSION

NOTE 1: V82 SVC IS UP/DOWN COMPATIBLE. V81 SVC IS NOT

NOTE 2: V82 AOS IS UP/DOWN COMPATIBLE. V81 AOS IS NOT

NOTE 3: V81 ADALINKS ARE UP/DOWN COMPATIBLE

NOTE 4: Zapped CA-APAS IS NOT DOWN COMPATIBLE

STEPS:

1. INFRASTRUCTURE TO V82: SVC, AOS, CA-APAS

2. CONVERT DATABASES (STANDARD ADACNV) (PLOGS not needed)

1. CONVERT ADALINKS (BATCH, CICS, ETC)


7

03. LOWER CASE FIELD NAMES

926 field names ( 26 * 36 – 10 ) 3214 field names ( 52 * 62 – 10 )

PRIOR V82 V82

ADACMP FNDEF='01,AA,10,A,DE,UQ'ADACMP FNDEF='01,Aa,10,A'ADACMP FNDEF='01,aa,10,A'ADACMP FNDEF='01,aA,10,A'

WHEREVER FNDEF’s ARE USED

(ADACMP, ADADBS, ADAINV

Field Description Table I I I ILevel I Name I Length I Format I ------I------I--------I--------I 1 I AA I 10 I A I 1 I Aa I 10 I A I 1 I aa I 10 I A I 1 I aA I 10 I A I

ADAREP / AOS

ADARUN MSGCONSL=UPPER ADARUN MSGDRUCK=MIXED ADARUN MSGPRINT=MIXED

! ADARUNS !


8

04,05,06 QUICKIES: NOUQ, SMF, ADASAV FILE Range

04. REMOVING UNIQUE DESCRIPTOR FLAG ADADBS CHANGE FILE=42,FIELD='AA',OPTION=NOUQ (not available in AOS)

05. SMF RECORDS ADARUN SMF=NO/YES (SMF89,SMFDETAIL,SMFINTERVAL,SMFRECNO,SMFSUBSYS)

06. ADASAV FILE RANGE (FILE=,FMOVE=) ADASAV FILE=100-120


9

07. NEW AC EXTENTS

“NEW AC EXTENTS WILL ATTEMPT TO BE CONTIGUOUS”

15686 - 15686 1 8391 AC 43 DAT91115687 - 53988 38302 8391 UNUSED 0 DAT911

V81 ADAREP

11473 - 11473 1 8391 AC 43 DAT91115686 - 15686 1 8391 AC 43 DAT91115687 - 53988 38302 8391 UNUSED 0 DAT911

V81: ADD 1000 RECORDS, RUN ADAREP

15686 - 15687 2 8391 AC 43 DAT91115688 - 53988 38302 8391 UNUSED 0 DAT911

V82: RELOAD FILE, ADD 1000 RECORDS, RUN ADAREP

DOES NOT WORK WITH ADADBS/AOS (STARTRABN=)


10

08. DATE/TIME EDIT MASKS DT=Default Edit Mask or Programming Edit Mask for Adabas Fields.

PART OF DB FDT (DFLT) OR CHANGE IN DIRECT CALL FB

FORMAT/LEN NAME B P U Description DATE 4 5 8 Z'YYYYMMDD'TIME 3 4 6 Z'HHIISS'DATETIME 6 8 14 Z'YYYYMMDDHHIISS'TIMESTAMP - 11 20 Z'YYYYMMDDHHIISSXXXXXX' NATTIME 6 7 13 NATURAL T FORMAT (.1 SECS SINCE YEAR ZERO)NATDATE 3 4 7 NATURAL D FORMAT DAYS SINCE YEAR ZERO)UNIXTIME 4 6 10 FOR UNIX (SINCE 1970.01.01)XTIMESTAMP 8 8 18 FOR UNIX (SINCE 1970.01.01)

CURRENT FORMATS


11

08. DATE/TIME EDIT MASKS DT=

TO CREATE:

ADACMP FNDEF='01,D1,20,U,DT=E(TIMESTAMP)'ADACMP FNDEF='01,D2,14,U,DT=E(DATETIME)'ADACMP FNDEF='01,D3,06,B,DT=E(DATETIME)'

ADADBS NEWFIELD FILE=42, FNDEF='01,Z3,20,U,DT=E(TIMESTAMP)'

STORED IN UTC (UNIVERSAL TIME CODE) FORMAT (GMT)

NOTE: PREDICT 4.6 DOES NOT SUPPORT!


12


DATE/TIME

IN PROGRAM

2010.03.12 16:06:32.2938579 '01,D1,20,U,DT=E(TIMESTAMP)'

PROGRAM FB= RETURNS RB=

D1. 20100312160632938579

D1,08,U,E(DATE). 20100312

D1,06,U,E(TIME). 160632

D1,14,U,E(DATETIME). 20100312160632

D1,13,U,E(NATTIME). 0634355427929

D1,07,U,E(NATDATE). 0734207

D1,10,U,E(UNIXTIME). 1268409992

D1,18,U,E(XTIMESTAMP). 001268409992938579


13


1. TO USE EDIT MASKS IN FB, FIELD MUST BE DEFINED WITH DT=

3. FOR FULL DETAIL, SEE NEW MANUAL:

"Date-Time Edit Masks Reference“

NOTE: Conversions Between Date-Time Representations (READ / UPDATE)

2. TRUNCATION/FILLING MAY OCCUR BETWEEN MASKS

EG. '01,D2,14,U,DT=E(DATETIME)‘

FB=D2,20,U,E(TIMESTAMP).RB=20100312160632000000

ELSE RspCode 41


14


TO ADD/REMOVE

IF '01,D1,20,U,DT=E(TIMESTAMP)‘

REMOVE WITH:ADADBS CHANGE FILE=43,FNDEF='01,D1,20,U'

IF '01,D1,20,U‘

ADD WITH:ADADBS CHANGE FILE=43, FNDEF='01,D1,20,U,DT=E(TIMESTAMP)'

1. CANNOT CHANGE FROM ONE EDIT MASK TO ANOTHER

2. MASK MUST HAVE CORRECT FORMAT/LENGTH. ELSE RspCode 55


15

09. TIME ZONE SUPPORT TZ=“ENHANCE EDIT MASK ON DT= FIELDS”

UTC/GMT

ADABASLOCAL TIMENUC

DATETIMETIMESTAMPNATTIMEUNIXTIMEXTIMESTAMP

FDT OPTION FOR TZ= FIELDS


16

09. TIME ZONE SUPPORT TZ=

ZONEINFO or OLSON DATABASE www.twinsun.com/tz/tz-link.htm

America/Chicago , AMECHICA,, US/CentralAmerica/Denver , AMEDENVE, America/Shiprock, Navajo US/MountainAmerica/Los_Angeles , AMELOSAN,, US/PacificAmerica/New_York , AMENEWYO,, US/Eastern

SEE ADABAS SOURCE (TZINFO)

America/Indiana/Indianapolis, AMEININD,, America/Fort_Wayne AmericaAmerica/Indiana/Knox, AMEINKNO,, America/Knox_IN US/Indiana-StarkeAmerica/Indiana/Marengo, AMEINMAR,,America/Indiana/Petersburg, AMEINPET,,America/Indiana/Tell_City, AMEINTEL,,America/Indiana/Vevay, AMEINVEV,,America/Indiana/Vincennes, AMEINVIN,,America/Indiana/Winamac, AMEINWIN,,


17


//STEPLIB DD//TZINFO DD DISP=SHR,DSN=TZ.LOADLIB//DDCARD DD*ADARUN MSGDRUCK=MIXED

ADANUC / ADACMP JCL REQUIREMENTS

RECORD-BUFFER= TZ='America/New_York'

USER OP en COMMAND

NOTE: TIME ZONES ARE CASE SENSITIVE

NOTE: USE OF QUOTES


18

09. TIME ZONE SUPPORT TZ= (examples)

ADACMP TZ=‘America/Indiana/Vevay 'ADACMP FNDEF=ADACMP FNDEF='01,D2,14,U,DT=E(DATETIME),TZ‘ADACMP FNDEF=

ADACMP ( 0 RECORDS or X RECORDS

(note length,format,DT mask)

ADADBS NEWFIELD FILE=43, FNDEF='01,D4,11,P,DT=E(TIMESTAMP),TZ'

ADADBS NEWFIELD

(NO //TZINFO, NO TZ= needed)

NOTE: PREDICT 4.6 DOES NOT SUPPORT!


19

09. TIME ZONE SUPPORT TZ= (ADAREP (DT=)

Field Description Table

I I I ILevel I Name I Length I Format I Options I I I I------I------I--------I--------I------------------- I I I I 1 I D1 I 14 I U I DT=E(DATE) 1 I D2 I 14 I U I DT=E(DATETIME),TZ 1 I D3 I 14 I U I DT=E(DATETIME)


20


20100218220209D2,14,U,DT=E(DATETIME),TZ UTC/GMT

YYYYMMDDHHMMSS

OPen RB with L1 RB=C2,8,U,E(TIME).---------------------- --------------------TZ='America/Chicago‘ 160209 TZ='America/New_York‘ 170209 TZ='America/Los_Angeles‘ 140209

(NOTE LOWER CASE)


21

09. TIME ZONE SUPPORT TZ= (Response Codes)

Accessing a field option TZ but no time zone was specified in the user session.Issue the OP command with TZ=

Rc 55 sub 30

Time zone not found in ADAZON directory.

Rc 50 sub 31

Date-time edit mask (E(date-time-mask)) notation isonly permitted for a field defined with a date-time edit mask. .

Rc 41 sub 30


22

09. TIME ZONE SUPPORT TZ= (Final Thoughts)

1. There is no default timezone for a file. OPen is required (with TZ=)

2. Natural Implementation?

3. Change in timezones, change in file.

4. TZ flag can only be added/removed if File empty:ADADBS CHANGE FILE=43,FNDEF='01,D2,14,U,DT=E(DATETIME)‘ADADBS CHANGE FILE=43,FNDEF='01,D2,14,U,DT=E(DATETIME),TZ'

6. CPU Overhead.

5. UQE Open’d with TZ is not deleted if TNAE exceeded.


23

CPU DT= vs TZ

0

1

2

3

4

5

6

7

1 2 3 4

DO 400K L1’s against A. FieldB. Field with DT=C. Field with DT=, TZ(no IO, no overlap)

RUN 1 2 3 4

A B C A B C A B CA B C

7%. Increase in CPUfor field access


24

10. DST DAYLIGHT SAVINGS INDICATOR

ADACMP COMPRESS, DECOMPRESS FOR TZ FIELDS

ADACMP TZ='America/New_York',DST

“The two-byte daylight savings indicator directly follows the date-time value in uncompressed input and specifies the hexadecimal value of the daylight saving time offset from standard time in seconds.”

X’0000’ OR X’0E10’ (DECIMAL 3600)


25

11. SYSTEM FIELDS

Create Adabas fields on a file that are automatically updated by Adabas with respect to inserts (N1,N2) and updates (A1).

Note that deletes (E1) are not recorded (if the record is deleted then so is the Adabas system field).

CONCEPT

AN ADABAS FIELD BUT ONLY THE NUC CAN UPDATE IT


26

11. SYSTEM FIELDS (RULES)

1. IF USER TRIES TO UPDATE, NOTHING. (NO RESPONSE CODE)

2. ADABAS UPDATES CONTENTS WHEN COMMAND (N1,N2,A1) IS EXECUTED, NOT AT ET

3. IF THE UPDATES ARE BACKED OUT (TIMEOUT,BT), CONTENTS ARE BACKED OUT.

4. FIELDS ARE DEFINED AS 'SY' IN THE FDT AND ADAREP.

5. A CR FLAG INDICATES FIELD IS ONLY CHANGED WHEN ADDED.

6. NON-CR SY FIELDS RECORD BOTH UPDATES AND INSERTS.


27

11. SYSTEM FIELDS (RULES)

7. NON-CR SY FIELDS MUST BE DEFINED AS MU. (NOT A PE)

8. CR SY FIELDS CAN NOT BE DEFINED AS MU

9. SY FIELDS CAN BE DESCRIPTORS, PART OF DESCRIPTORS, ETC.

10. NON-CR SY FIELDS ARE MAINTAINED IN THE MU IN LIFO FASHION.

11. OCCURANCE 1 IS THE MOST RECENT UPDATE.

12. AS EACH UPDATE OCCURS, THE OTHER VALUES ARE MOVED TO N+1.

13. THE MAX NUMBER OF MU OCCURANCES IS DETERMINED BY SYFMAXUV. MAX=20 (IN FCB)


28

11. SYSTEM FIELDS (TYPES OF)

JOBNAME 8-BYTE JOBNAME OF USER THAT DID A1,N1,N2.

OPUSER 8-BYTE ETID (FROM ADDS1 OF OP COMMAND)

SESSIONID 28-BYTE UQE ID

SESSIONUSER LAST 8 BYTES OF 28B UQE ID (EG. TERM-ID OR CICS TRANID)

TIME * UTC (GMT) OF A1,N1,N2.

* TIME CAN USE DT= and TZ attributes


29

11. SYSTEM FIELDS (CREATING)

ADACMP FNDEF='01,C1,08,A,CR,SY=JOBNAME'ADACMP FNDEF='01,C2,14,U,CR,SY=TIME,DT=E(DATETIME)'ADACMP FNDEF='01,S1,08,A,MU,SY=JOBNAME'ADACMP FNDEF='01,S2,14,U,MU,SY=TIME,DT=E(DATETIME)'*ADACMP FNDEF='01,S3,08,A,MU,SY=OPUSER'ADACMP FNDEF='01,S4,28,A,MU,SY=SESSIONID'ADACMP FNDEF='01,S5,08,A,MU,SY=SESSIONUSER'ADACMP FNDEF='01,S6,20,U,MU,SY=TIME,DT=E(TIMESTAMP)'ADACMP FNDEF='01,S7,13,U,MU,SY=TIME,DT=E(NATTIME)'ADACMP FNDEF='01,S8,08,U,MU,SY=TIME,DT=E(DATE)'*ADACMP FNDEF='01,XX,20,U,MU,SY=TIME,DT=E(TIMESTAMP),TZ'

ADACMP COMPRESS or ADADBS NEWFIELD FNDEF

ADALOD

ADALOD SYFMAXUV=1 (dlft=1, RANGE: 1 – 20 )


30

11. SYSTEM FIELDS (ADAREP)

MAX-ISN formatted =1,377 System Field Max = 1: : :System Fields Yes: : :Level I Name I Length I Format I Options------I------I--------I--------I---------------------- 1 I C1 I 8 I A I SY=JOBNAME,CR 1 I C2 I 14 I U I DT=E(DATETIME) I I I I SY=TIME,CR 1 I S1 I 8 I A I MU,SY=JOBNAME 1 I S2 I 14 I U I MU,DT=E(DATETIME) I I I I SY=TIME 1 I S3 I 8 I A I MU,SY=OPUSER 1 I S4 I 28 I A I MU,SY=SESSIONID 1 I S5 I 8 I A I MU,SY=SESSIONUSER 1 I S6 I 20 I U I MU,DT=E(TIMESTAMP) I I I I SY=TIME 1 I S7 I 13 I U I MU,DT=E(NATTIME) I I I I SY=TIME 1 I S8 I 8 I U I MU,DT=E(DATE),SY=TIME


31

11. SYSTEM FIELDS

C1 CR,JOBNAME

C2 CR,DATETIME

S1 JOBNAME

S2 DATETIME

S5 SESSIONUSER

S6 TIMESTAMP

S7 NATTIME

S8 DATE

FLD TYPE

TESTJOB1

20100319184817

TESTJOB1 CICSPRG

2010031918582620100319184817

CIC34512TSU17862

2010031918582695780120100319184817654496

06343615790690634361572976

2010031920100319

A1 (UPDATE)

TESTJOB1

20100319184817

TESTJOB1

20100319184817

TSU17862

20100319184817654496

0634361572976

20100319

N1 (STORE)


32

11. SYSTEM FIELDS

ADADBS MODFCB SYFMAXUV=

(NOTE: OCCURANCES NOT REDUCED UNTIL UPDATE OCCURS)

CHANGING THE MU OCCURANCES

HOW TO REMOVE A SYSTEM FIELD?

1. ADACMP DECOMPRESS2. ADACMP COMPRESS 3. LOAD(PLOG/REGENERATE SOLUTIONS)


33

11. SYSTEM FIELDS (final notes)

1. IF UPDATE WITH NO DATA CHANGE, SY FIELDS STILL UPDATED

2. IF UPDATE A SY FIELD ONLY, SY FIELDS STILL UPDATED

3. LOGICAL FIELD DELETE (DELFN) STOPS SY FIELD UPDATES

4. PREDICT 4.6 DOES NOT SUPPORT!


34

12. LOGICAL REMOVAL OF DESCRIPTORS

MARK DESCRIPTORS FOR EVENTUAL REMOVAL BUT QUICK BACKOUT PLAN

“REMOVE A DESCRIPTOR FROM APPLICATION USE”

WHY

DESCRIPTOR INVERTED LIST CONTINUES TO BE UPDATED

FINE PRINT


35

12. LOGICAL REMOVAL OF DESCRIPTORS (Example)

A. ADADBS DELDE FILE=16,DESCRIPTOR=AE

B. READ LOGICAL BY AE (OR FIND)

RSP.CODE 39 (not documented)

C. UPDATE FIELD AE

D. ADADBS UNDELDE FILE=16,DESCRIPTOR=AE

E. READ LOGICAL OR FIND USES UPDATED VALUE


36

12. LOGICAL REMOVAL OF DESCRIPTORS (Example)

F File maintenance L Logically delete/undel descriptr

2 I AE I 20 I A I DE,DL

ADAREP FDT

ADADBS DELDE FILE=16,DESCRIPTOR=AE

ADADBS UNDELDE FILE=16,DESCRIPTOR=AE

ADADBS

AOS


37

13. LOGICAL REMOVAL OF FIELDS“REMOVE A FIELD FROM APPLICATION USE (Rsp Code 41)”

WHY?

ADADBS DELFN FILE=16,FIELDLIST='AE‘ADADBS DELFN FILE=99,FIELDLIST='AA,AB,AC‘ADADBS UNDELFN FILE=16,FIELDLIST='AC'

Eg.

4 I AC I 20 I A I NU I I I I IDELETED FIELD I

ADAREP:

F File maintenance C Define/modify FDT F Delete field from FDT G Undelete field from FDT

AOS


38

13. LOGICAL REMOVAL OF FIELDS (notes)

a. CANNOT REMOVE A DESCRIPTOR OR A PARENT FIELD FOR A DESCRIPTOR

b. IF FIELD IS A GROUP, ALL FIELDS MARKED AS DELETED

c. IF FIELD WITHIN A GROUP, FORMAT-BUFFER=grpname WILL STILL RETURN FIELD

d. IF FIELD IS A SYSTEM FIELD, ADABAS DOES NOT UPDATE FIELD


39

14. FILE READONLY.

ADADBS MODFCB FILE=42,FILEREADONLY=YES (or NO) AOS:F File maintenance M Modify file parameters Filereadonly ...... OFF

ADAREP:READONLY-MODE No

USER: Rsp Code 17 Sub 17


40

15,16,17: ONLINVERT FNDEF, SVC Performance, PLCOPY

15. ADADBS ONLINVERT FILE=201,FNDEF='01,NT,7,A,NU' (Available in AOS)

16. IMPROVED SVC PERFORMANCE UNDER V822.

17. ADARES PLCOPY CALLS UEX(2 OR 12) IF MORE PLOGS TO COPY


41

18. ADARUN LOGWARN ADARUN LOGWARN = 0 – 2147483647 (DFLT = 0 )

ADANP1 00169 2010-02-16 11:41:00 CAUTION: DDPLOGR1 NOT YET COPIEDADANP1 00169 2010-02-16 11:41:19 CAUTION: DDPLOGR1 NOT YET COPIEDADANP1 00169 2010-02-16 11:41:39 CAUTION: DDPLOGR1 NOT YET COPIEDADANP1 00169 2010-02-16 11:41:59 CAUTION: DDPLOGR1 NOT YET COPIEDADANP2 00169 2010-02-16 11:42:16 PLOG WARNING NO LONGER IN EFFECT

Eg. LOGWARN=20


42

19. ADADBS ADDPLOG,DELPLOG

//DDPLOGR1 DD DISP=SHR,DSN=AD.P.ADA169.PLOG1//DDPLOGR2 DD DISP=SHR,DSN=AD.P.ADA169.PLOG2//DDPLOGR3 DD DISP=SHR,DSN=AD.P.ADA169.PLOG3//DDPLOGR4 DD DISP=SHR,DSN=AD.P.ADA169.PLOG4//DDPLOGR5 DD DISP=SHR,DSN=AD.P.ADA169.PLOG5//DDPLOGR6 DD DISP=SHR,DSN=AD.P.ADA169.PLOG6//DDCARD DD *: : :ADARUN NPLOG=2

Eg. NUC JCL

AS PLOGS ARE NEEDED (OR NOT):

ADADBS ADDPLOG NUMBER=3 OrADADBS ADDPLOG NUMBER=3

(not tested)

O Session opercoms A Allocate/Deallocate CLOG/PLOG

AOS:


43

20. ADARES REGENERATE/BACKOUT RECORD COUNTS

---------------------------------------------I File Number I Data Record Updates II-----------------I-------------------------II 1 I 4 II 43 I 408274 I---------------------------------------------

Eg. ADARES REGENERATE


44

DEFAULT FOR WORK AND PLOGS: 1 BLOCK 1 IO

21. ADARUN NPLOG/NWORK1

V82 OPTION: 1 IO FOR X BLOCKS

A. HIGH UPDATE JOB(S)B. UPDATES DURING ADASAV SAVEC. ONLINE INVERTS, ONLINE ORDSD. CONCURRENT Sx (FIND) PROCESSINGE. COMBINATIONS OF THE ABOVE

POTENTIAL WORK/PLOG PERFORMANCE BOTTLENECKS

OLD SOLUTIONS: WORK.CACHE / BLOCKSIZE SPLIT.WORK / MULTIPLE WORK(S)


45

ADARUN NPLOGBUFFERS = 1 - 2,147,483,687ADARUN NWORK1BUFFERS = 1 - 2,147,483,687

21. ADARUN NPLOG/NWORK1 (ADARUN)

1. DEFAULT = 1 (1 IO PER BLOCK)

2. REQUIRES LFIOP /= 0

3. IF ADARUN V64BIT=YES Then ABOVE 2G BAR

4. MEMORY SPACE = buffer.count X blocksize


46

21. ADARUN NPLOG/NWORK1 (Example)Eg. ADARUN = 1

PLOG PROTECTION BLOCKS 2,962PLOG PROTECTION I/OS 2,962WORK1 PROTECTION BLOCKS 2,927WORK1 PROTECTION I/OS 2,927

: : :

AREA ADARUN PARM HIGH-WATER-MARK: : :PLOG-IO B NPLOGB= 1 1 (100 %)WRK1-IO B NWORK1= 1 1 (100 %)

SHUTDOWN DDPRINT:

DRESAOS

DSTAT


47

21. ADARUN NPLOG/NWORK1 (Example)Eg. NPLOGBUFFERS=100 NWORK1BUFFERS=100

PLOG PROTECTION BLOCKS 37,922PLOG PROTECTION I/OS 22,846WORK1 PROTECTION BLOCKS 37,843WORK1 PROTECTION I/OS 22,733: : :

AREA ADARUN PARM HIGH-WATER-MARK: : :

PLOG-IO B NPLOGB= 100 37 ( 37 %)WRK1-IO B NWORK1= 100 38 ( 38 %)

SHUTDOWN DDPRINT:

40% FEWER IO’S

572K PER WORK OR PLOG BUFFER AREA (3390)


48

0

2

4

6

8

10

12

1 2 3 4 5 6

BUF=1 BUF=10 BUF=40

21. ADARUN NPLOG/NWORK1 (Performance)

TEST: 1 2 3 4 5 6

BATCH JOB DURATION (HIGH UPDATE)

BUF=1

BUF=40

BUF=10


49

22. WORK I,II,III USE

DDPRINT SHUTDOWN, DRES, AOS

AREA ADARUN PARM HIGH-WATER-MARK ----------------------------------------------- WORK PART1 LP = 83700 1 ( 0 %) WORK PART2 LWKP2= 6000 0 ( 0 %) WORK PART3 -- = 297 0 ( 0 %)

( WORK1 WRAP STILL AT 25%?)


50

23. ADASEL NEW FEATURES

//DDKARTE DD *

TEST test syntax but do not execute (must be first line)

FDTINPUT Use an alternate FDT to read records (in case of file changes) see manual for detail

SET GLOBALS specify before 1st SELECT, can repeat this line Many new options for spanned records and various SEL errors

(read manual)


51

24. ADAZIN (NEW) MAINT AND SVC INFO“ZAP AND SM INFO FOR LOADLIB, SVC INFO (see old AOS function)”

1. //DDZIN DD DSN=loadlib2. STEPLIB or JOBLIB3. LPA or LINKLIST

INPUT LOADLIB:

ADAZIN - ALL MODULES, ALL SVC’S

ADAZIN MOD=‘mod1,mod2,mod3’ - SPECIFIC MODS, CAN REPEATADAZIN MODRANGE=‘mod1,mod2’ - RANGEADAZIN NOMOD - NO MODULESADAZIN NUMMODS=x - LIMIT TO X MODULES

ADAZIN SVC=svc1,svc2,svc3 - SPECIFIC SVC’SADAZIN NOSVC - NO SVC’SADAZIN SVCRANGE=svca,svcb - RANGE

DDKARTE:


52

24. ADAZIN (NEW) MAINT AND SVC INFO (Eg.)

ADANC1 Date 2009-11-17, Version 8.2, SM 2 Zaps AN822017 AN822022 AN822025

ADASAV Date 2009-11-07, Version 8.2, SM 2 Zaps AU822005 AU822006 AU822010 AU822012

SVC 237 SVCMVS Date 2006-09-19, Version 8.1, SM 4

SVCCLU Date 2006-06-09, Version 8.1, SM 4

SVC 238 SVCMVS Date 2009-08-11, Version 8.2, SM 2 Zaps AO822004

SVCCLU Date 2009-08-11, Version 8.2, SM 2 Zaps AI822001

SAFSVC Date 2009-10-29, Version 8.2, SM 2

DDKARTE: ADAZIN MOD='ADANC1,ADASAV'DDDRUCK:


53

25. ADARUN SRLOG, PLOG SPANNED RECORDS (review)

PLOG ALWAYS CONTAINSPRIMARY RECORD (BI / AI)

PLOG ONLY CONTAINS SECONDARY RECS IF UPDATED

PLOG

PRIMARY SECONDARY-1 SECONDARY-2UPD:BI/AI PRI

BI/AI SEC2

PRIMARY SECONDARY-1 SECONDARY-2UPD:BI/AI PRI

BI/AI SEC1

UPD: PRIMARY SECONDARY-1 SECONDARY-2 BI/AI PRI


54

25. ADARUN SRLOG, PLOG SPANNED RECORDS (V82)

ADARUN SRLOG= ALL / UPD / PART (NOT IN ADADBS,AOS)

(not tested)

ALL -entire spanned record written to PLOGUPD -(dflt) only modified spanned segments writtenPART -all segments up to and including modified segment are written

From manual (Operations, ADARUN SRLOG):

“Standalone secondary spanned records encountered in the PLOG will be rejected from further processing. A warning message is issued. Likewise, decompression of a partial field at the end of a spanned record will be skipped. All fields up to the partial field will be decompressed and the remaining fields on the spanned record are not available. “


55

26. ADARUN PREFSTDD“WRITE MULTIFETCH STATS ON CLOSE COMMAND”

LIMITED USE: ONLY FOR BATCH JOBS USING ADAMLF (recommend MLF in Program)

//MYNAME * SYSOUT or LRECL>=80 RECFM=FB

//DDCARD DD *ADARUN PREFETCH=YESADARUN PREFETCH=YES,PREFSBL=15000,PREFNREC=100ADARUN PREFSTDD=MYNAME *LIMITED TO 7 CHAR. NAME

JCL:


56

26. ADARUN PREFSTDD (Eg.)

ADAML1 +---------------------------------------------+ ADAML1 + ADAML1 + A D A M L F S T A T I S T I C S ADAML1 +ADAML1 + Percentage of PREFTBL used : 50.00ADAML1 + Number of calls to ADAMLF : 1918ADAML1 + Number of cmds to ADABAS : 56ADAML1 + Number of cmds returned from ADAMLF : 1875ADAML1 + Number of over reads : 2ADAML1 +ADAML1 +---------------------------------------------+

//MYNAME


57

27. ADADBS FUNCTIONS. FILE LOCK NOT REQUIRED

ALLOCATE/DEALLOCATEDSREUSE/ISNREUSERELEASERENAME

REVIEW USER FILE USE ==>

FROM MANUAL “ADADBS”:

“The ADADBS DSREUSE, ISNREUSE, NEWFIELD, RELEASE DE, and RENAME utility functions do not need to lock the file for their use; these functions can perform their processing in parallel with active users. This means that you do not need to set a file in read-only status (FILEREADONLY=YES) if you will be performing these other ADADBS functions only.”


58

28. REVIEW OF IN PARALLELFUNCTION AOS

ACC/UPD userDBS

ACC/UPD user

ALLOCATE FAILS FAILS

DEALLOCATE FAILS FAILS

DSREUSE in parallel works

ISNREUSE in parallel works

RELEASE in parallel works

RENAME FAILS works

CHANGE LENGTH FAILS FAILS

MODFCB ASSOPFAC FAILS works

MODFCB DATAPFAC FAILS works

MODFCB MAXDS,NI,UI,AC FAILS works

MODFCB MAXRECL FAILS works

MODFCB PGMREFRESH FAILS works

NEWFIELD in parallel works

MUPEX FAILS FAILS

RECORD SPANNING FAILS FAILSAdabas V82 by Jim Poole

59

28. REVIEW OF IN PARALLEL (NEW TO V82)

FUNCTION AOS ACC/UPD user

DBS ACC/UPD user

CHANGE OPTION=NOUQ N/A works

DELDE,UNDELDE FAILS FAILS

DELFN,UNDELFN FAILS FAILS

MODFCB FILEREADONLY FAILS FAILS

MODFCB SYFMAXUV N/A works


60

29. INFOBUFFERSIZE,DEVENTLOG “V822 HANDLES RSP.CODE 145 ONLY”

THE PROBLEM:

Eg. USER A HAS RETURN OPTION (CO1=R or NATURAL WH=OFF)

1. REQUESTS RECORD X ON HOLD

2. RECEIVE RESPONSE CODE 145

3. WHO IS HOLDING RECORD? (LONG SCAN OF HOLD QUEUE)

WHO WAS HOLDING RECORD?


61

29. INFOBUFFERSIZE,DEVENTLOG

SOLUTION DDCARD:ADARUN INFOBUFFERSIZE=0 *NOT USED ADARUN INFOBUFFERSIZE=1024-2G *RANGEADARUN INFOBUFFERSIZE=1000000 *EXAMPLE

AFTER 10,000 EACH ENTRY IS ABOUT 128.2 bytes

EG. INFOBUFFERSIZE=50000 * 50K

EQUALS ABOUT 390 ENTRIES


62

29. INFOBUFFERSIZE,DEVENTLOG (Display)

ADADBS

ADADBS DEVENTLOG

AOS

A Session monitoring L Display event log buffer


63

29. INFOBUFFERSIZE,DEVENTLOG (Eg.)

ADADBS DEVENTLOG: E V E N T L O G =================

2010-03-15 15:05:11 RSP-145 occurred for FNR=241 / ISN=2 --- User who received the RSP-145: UID='TSU38882', ETID=' ', Job=$ZM6WH X'0002FEBE20940000404040404040404000F66B80E3E2E4…' --- User who was holding the data record: UID='TSU38880', ETID=' ', Job=RZM6WH , NUCID=0 X'0002FEBE20940000404040404040404000F66D00E3E2E4…‘

2010-03-15 15:05:20 RSP-145 occurred for FNR=241 / ISN=3 --- User who received the RSP-145: UID='TSU38882', ETID=' ', Job=$ZM6WH X'0002FEBE20940000404040404040404000F66B80E3E2E4F3F…' --- User who was holding the data record: UID='TSU38880', ETID=' ', Job=RZM6WH , NUCID=0 X'0002FEBE20940000404040404040404000F66D00E3E2E4F3F8…'


64

29. INFOBUFFERSIZE,DEVENTLOG (Program)“USER CAN READ EVENTLOG FOR FOR THEIR UQE (ONLY)”

1,AA,2,B,FI Event type=X 00011,AB,2,B,FI Event sub type=X 00001,AC,2,B,FI DBID1,AD,2,B,FI NUCID1,AE,4,B,FI File Number1,AF,2,B,FI Response Code=1451,AG,2,B,FI Subcode=X 00001,AH,8,B,FI ISN1,AT,8,B,FI Time of Event (STCK value)1,AI,8,A,FI Job Name of affected user1,AJ,28,A,FI,NV User ID of affected user1,AK,8,A,FI ET ID of affected user1,AM,8,A,FI Job Name of the causer1,AN,28,A,FI,NV User ID of the causer1,AO,8,A,FI ET ID of the causer

EVENTLOG FDT:

CMD: L2ISN: 0FNR: -4 X’FFFC’

COMMANDREQS (ACBX)


65

29. INFOBUFFERSIZE,DEVENTLOG (Notes)

a. CLOGLAYOUT=8 NEW RECORD TYPE X’000D’ FOR RC 145

(not tested)

b. PERFORMANCE COST OF? None observed

RAN TESTS WITH:1M L4’S COP1=REVENTLOG=0EVENTLOG=10,000EVENTLOG=1,000,000


66

30. ADARUN LOGVOLIO

ADARUN LOGIO=YES

1B FLAG: ASSO/DATA/WORK READ/WRITE4B RABN

(not tested)

V8.1

ADARUN LOGIO=YESADARUN LOGVOLIO=YES *REQUIRES LOGIO=YES

1B FLAG: ASSO/DATA/WORK READ/WRITE4B RABN 6B VOLSER

V8.2


67

31. CLOG DSECT UPDATED FOR Sx ALGORITHM

LORSTYPE DS XL1 TYPE OF SEARCH/SEARCH ALGORITHMLORQ01 EQU X'01' ALGORITHM-1LORQ02 EQU X'02' ALGORITHM-2LORQ03 EQU X'03' ALGORITHM-3LORQ04 EQU X'04' ALGORITHM-4LORQ05 EQU X'05' MIXED SEARCH (DE-+ NON-DE)LORQ05 EQU X'05' NON-DE-SEARCH V822LORQ80 EQU X'80' NON-DE-SEARCHLORQ06 EQU X'06' MIXED SEARCH (DE-+ NON-DE) V822

ADABAS SOURCE LIB LOREC (CLOGLAYOUT=5)


68

31. CLOG DSECT UPDATED FOR Sx ALGORITHM

LOX1STYP DS XL1 +15 TYPE OF SEARCH/SEARCH ALGORITHMLOX1Q01 EQU X'01' ALGORITHM-1LOX1Q02 EQU X'02' ALGORITHM-2LOX1Q03 EQU X'03' ALGORITHM-3LOX1Q04 EQU X'04' ALGORITHM-4LOX1Q05 EQU X'05' MIXED SEARCH (DE-+ NON-DE)LOX1Q05 EQU X'05' NON-DE-SEARCH V822LOX1Q80 EQU X'80' NON-DE-SEARCHLOX1Q06 EQU X'06' MIXED SEARCH (DE-+ NON-DE) V822

ADABAS SOURCE LIB LORECX (CLOGLAYOUT=8)

*FOR BOTH, SEE CA-APAS SEARCH-ALGORITHM

?? WHERE IS ALGORITHM 7 ??

ANSWER: PER SAG, ROLLED IN WITH ALGORITHM 1 !!


69

32. ADAREP PPT

******************** ** Contents of PPT * 2010-02-09 15:31:47* ********************

PPT RABN Range = 1325 to 1356PPT RABN = 1325 NUCID = 0000 Session Status = NUCLEUS ACTIVE OR FAILED (WORK NONEMPTY) PLOG(S) NOT YET COPIED Number of entries = 3 Last Session number = 003D Last PLOG block written = 245 NOT INITIALIZED Next block number = 0

PPT Entry number = 1 Dataset = /AD/P/ADA169/WORK/ Dataset Type = DDWORK1

PPT Entry number = 2 Dataset = /AD/P/ADA169/PLOG1/ Dataset Type = DDPLOGR1

PPT Entry number = 3 Dataset = /AD/P/ADA169/PLOG2/ Dataset Type = DDPLOGR2

(Default)

OPTION: ADAREP NOPPTAdabas V82 by Jim Poole

70

33. ADAREP XML

<?xml version="1.0" encoding="ISO-8859-1"?> <?xml-stylesheet type="text/xsl" href="adabas.xsl"?> <AdabasReport> <ReportParameters> <Parameter>REPORT</Parameter> <Parameter>OUTPUT='XML'</Parameter> </ReportParameters> <Runtime> <DBID>169</DBID> <VER>8</VER> <Release>2</Release> <SM>2</SM> <Date>2010-04-02</Date> <Time>10:59:11</Time> </Runtime>

etc

OPTION: ADAREP OUTPUT='XML'

//DDXMLR1 :

(SEE MANUAL FOR CODE-PAGE,ASCII, ETC)

JCL: //DDXMLR1 *ADAREP OUTPUT VB LRECL=512//DDXMLR1 *CPLIST OUTPUT VB LRECL=512


71

34. ADAREP CHANGES (Review)

PPT SECTION (IF NOPPT NOT SPECIFIED)

FROM TOP TO BOTTOM

* Contents of Database 169 *****************************

File Name Loaded TOP-ISN MAX-ISN EXTENTS N U A AC2 D 1 CHECKPOINT 2003-09-19 6025 6889 1 1 2 0 1 5 TRIGGER 2008-06-19 89 5511 1 2 1 0 1 16 EMPLOYEES 2007-01-18 2232 2755 1 1 1 0 1


72


FROM TOP TO BOTTOM

* File Space Allocations ***************************

File Name Alloc.: NI UI AC AC2 Data/Cyl Unused: 1 CHECKPOINT 25 5 5 0 100/1 1 24 3 13/0 5 TRIGGER 20 16 4 0 100/1 5 10 5 99/1


73


FILE DETAIL

MAX-ISN formatted = 6,889

: : :

READONLY-MODE NoSystem Fields No

FDT (see details elsewhere in presentation)

1. LOWER CASE FIELD NAMES2. DT DATE.TIME INDICATOR3. TZ TIME ZONE4. SYSTEM FIELDS5. LOGICALLY DELETED DESCRIPTORS6. LOGICALLY DELETED FIELDS


74

35. DDPRINT CHANGES (Review)

FROM TOP TO BOTTOM

PLOG PROTECTION BLOCKS 9 PLOG PROTECTION I/OS 9 WORK1 PROTECTION BLOCKS 13 WORK1 PROTECTION I/OS 13


75

35. DDPRINT CHANGES (Review) THE ACTUAL H I G H - W A T E R - M A R K S FOR THE MAJOR POOLS (EXCEPT BUFFERPOOL) AREA ADARUN PARM HIGH-WATER-MARK AB -POOL NAB= 200 768 ( 0 %) CQ -POOL NC = 96000 192 ( 0 %) DUQ -POOL LDE= 50000 0 ( 0 %) FI -POOL LFP= 5000000 160 ( 0 %) HQ -POOL NH = 1120056 0 ( 0 %) PLOG-IO B NPLOGB= 1 1 (100 %) SC -POOL LCP= 2000 0 ( 0 %) TBI -POOL LI = 100000 0 ( 0 %) TBS -POOL LQ = 200000 68 ( 0 %) UQ -POOL NU = 2000 1200 ( 0 %) UQF -POOL NU = 2000 144 ( 0 %) WRK1-IO B NWORK1= 1 1 (100 %) WORK-POOL LWP= 4000000 49476 ( 1 %) WORK PART1 LP = 83700 1 ( 0 %) WORK PART2 LWKP2= 6000 0 ( 0 %) WORK PART3 -- = 297 0 ( 0 %) XID -POOL XID= ( 0 %)


76

36,37. ADARUN V64BIT, ADARUN LARGEPAGE

ADARUN V64BIT=YES *DFLT=NO

ABOVE 2G BAR:LFIOP=NPLOGBUFFERS=NWORK1BUFFERS=

ADARUN LARGEPAGE=YES *DFLT=NO

USE 1MB PAGES (REQUIRES V64BIT=YES)

NO PERFORMANCE GAIN (MEMORY UTILIZATION) (tested)


77

38-43. NOT STUDIED NOR TESTED FEATURES

38. ACBX 64 BIT SUPPORT (STILL NOT ACBX FOR MULTIFETCH)

39. LOB ENHANCEMENTS

40. OP CMD NWCONNECT FOR ENTIRE NETWORK

41. ADAWRK TRANSACTION NUMBERS

42. SHARED HOLD STATUS (REQUIRES DIRECT CALLS)

43. SMGT CHANGE


78

44. RI COMMAND CHANGES.

THE RI COMMAND NO LONGER RELEASES THE ISN(S)UNCONDITIONALLY.

IF THE AFFECTED ISN(S) HAVE BEEN UPDATED, THEN A RESPONSE CODE IS RETURNED:

ISN =0 RC 2 SUB 5ISN /=0 RC 113 SUB 5


79

DAS ENDE


ADABAS V82 Jim Poole 2010 Adabas V82 by Jim Poole.

Documents

ADABAS V82 Jim Poole 2010 Adabas V82 by Jim Poole.