Top Banner
DB2 12 for z/OS Technical Overview Part 2 John Campbell Distinguished Engineer IBM DB2 for z/OS Development
49

DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Jun 04, 2018

Download

Documents

phamkien
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DB212forz/OSTechnicalOverviewPart2

JohnCampbellDistinguishedEngineerIBMDB2forz/OSDevelopment

Page 2: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

LogisticsandQuestions

• Thepresentationisavailablefordownloadfromtheresourceslist

• Thewebcastswillbeavailableonreplay

• Youcansubmitquestionsbytypingintothequestionsareaofyourwebcastcontrolpanelatleast15minutesbeforetheendofthewebcast.

• Questionswillbeansweredastimepermits

• Anyquestionsnotansweredduetotimeconstraintswillbeansweredafterthewebcastandaddedtothe“Resourceslist”

2

Page 3: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Disclaimer/Trademarks

3

© Copyright IBM Corporation 2017. All rights reserved.U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

THE INFORMATION CONTAINED IN THIS DOCUMENT HAS NOT BEEN SUBMITTED TO ANY FORMAL IBM TEST AND IS DISTRIBUTED AS IS. THE USE OF THIS INFORMATION OR THE IMPLEMENTATION OF ANY OF THESE TECHNIQUES IS A CUSTOMER RESPONSIBILITY AND DEPENDS ON THE CUSTOMER’S ABILITY TO EVALUATE AND INTEGRATE THEM INTO THE CUSTOMER’S OPERATIONAL ENVIRONMENT. WHILE IBM MAY HAVE REVIEWED EACH ITEM FOR ACCURACY IN ASPECIFIC SITUATION, THERE IS NO GUARANTEE THAT THE SAME OR SIMILAR RESULTS WILL BE OBTAINED ELSEWHERE. ANYONE ATTEMPTING TO ADAPT THESE TECHNIQUES TO THEIR OWN ENVIRONMENTS DO SO AT THEIR OWN RISK.

ANY PERFORMANCE DATA CONTAINED IN THIS DOCUMENT WERE DETERMINED IN VARIOUS CONTROLLED LABORATORY ENVIRONMENTS AND ARE FOR REFERENCE PURPOSES ONLY. CUSTOMERS SHOULD NOT ADAPT THESE PERFORMANCE NUMBERS TO THEIR OWN ENVIRONMENTS AS SYSTEM PERFORMANCESTANDARDS. THE RESULTS THAT MAY BE OBTAINED IN OTHER OPERATING ENVIRONMENTS MAY VARY SIGNIFICANTLY. USERS OF THIS DOCUMENT SHOULD VERIFY THE APPLICABLE DATA FOR THEIR SPECIFIC ENVIRONMENT.

TrademarksIBM, the IBM logo, ibm.com, DB2, System z and z/OS are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml.

Page 4: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Objectives• IntroduceanddiscussthenewfeaturesofDB212forz/OS• Provideplanninginformationformigration• Understandthenewperformancefeatures

4

Page 5: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Agenda• Introduction• Performancefocus– traditionalworkloads• Performancefocus– enablingmodernapplications• Migration• Applicationenablement• Reliability,availability,scalability,security

5

Page 6: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

APPLICATIONENABLEMENT

6

Page 7: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DB2forz/OSadaptingtomodernApplicationDevelopmentparadigms• ManymodernapplicationdevelopersworkwithRESTservicesandJSONdataformats• DB2Adaptorforz/OSConnectprovidesthemeanstodothis• Betainprogress,plannedforDB210and11aswellasDB212

7

DB2RESTful

JSON

DB2

Page 8: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

GettingRESTandJSONintoyourmainframeenvironmentinawaythatenablesyoutobesttakeadvantageoftheassetsthatexistthere:

• LibertyProfileServer

Providesacommonandconsistententrypointformobileaccesstooneormanybackendsystems

Simplifiesfront-endfunctionsbyallowingthemtopassRESTful andJSONratherthanbeawareoforinvolvedindatatransformation

IBMBlueMix

8

EnterpriseApps

EnterpriseData

EnterpriseTransactionProcessing

CICS,IMS

Batch,WAS

SystemsofRecord

On-PremiseEnterpriseAPIs

CloudAPIs

Mobile-OptimizedAPIs

Cloud-basedServices

EnterpriseSystems

Integrationz/OS

Connect

Cloud/MobileintegrationwithDB2andz/OSConnect

8

Page 9: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Latest News• Native DB2 REST API with DB2 11 APARs PI66828 & PI70477

9

Page 10: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

MotivationforIntegratedSolutioninDB2• DB2integratedRESTAPIfunctionalitymaintainingz/OSConnectexternalsasapplicablefor

• ReuseofDDFfunctionalitythatprovidesahighlyavailable,highlyscalableandhighlyserviceablenetworkinterface

• SupportofclientInfofields• DDFprovidessecurity,auditing,anddatatransformationasbeingprovidedusingz/OSConnect

• PERMITDSN.RESTCLASS(DSNR)ID(DB2USER)ACCESS(READ)• DDFRestAPIwouldbereadyoutofthebox• Allowsadatabaseadministratortomanageservices

• Newcatalogtable• Staticexecutionpattern– authorisationchecking,objectdependencytracking

10

Page 11: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

RESTfulJSON

DB2z/OSDDF

DRDA DRDAparsing

Authcheck

ThreadCreation

SQLexecution

RESTAPI

httpsandJSONparsing

DataServerClient

Application

z/OSConnectEERESTAPI

RESTAPI

RESTfulServiceSupportinDB2

11

Page 12: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

NativeDB2RESTAPISupport• CREATE|DROP|START|STOPServiceusingeitherDataStudioV1support,ordirectDB2DDFRESTAPI

• SamplePOSThttps://<host>:<port>/services/DB2ServiceManager{"requestType":"createService«....}

• DiscoverallservicesanddiscoverdetailsforaspecificserviceusingdirectDB2DDFRESTAPI• POSThttps://<host>:<port>/services/DB2ServiceDiscover• {["collectionID":"<collectionID>"]

• DB2RESTServiceinvocation• DB2Adapterforz/OSConnectV1invocationAPIsyntax• NewdirectDB2DDFRESTinvokeAPI

• SupportedINSERT,UPDATE,DELETEandcursorbasedSELECT• CALLsupportwithIN/OUT/INOUTparametersundresultsets• AllofthevariousDB2baseSQLtypes

12

Page 13: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

ApplicationRelatedEnhancements• DRDAFastLoad– callablecommandforfaststreamingofdataintoDB2• Systemprofilingenhancements

• Autostartofsystemprofiles• Setglobalvariablesbasedonprofiles(e.g.transparentarchiving)

• NewMODIFYDDFPKGREL(BNDPOOL)option• PoolhighperformanceDBATsatconnectiontermination

• DSNULIsupportforIMSAttach• LonglistofSQLandXMLimprovements

13

Page 14: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DRDAFastLoad• Problem:

• DB2providestheDSNUTILUstoredproceduretoloaddatafromaclient• Butthisisdifficulttouse,applicationmusttransferdatatoz/OSfile

• Solution:• DB2ClientAPI(CLIandCLP)forremoteloadintoDB2• Easyandfastloadingofdatafromfilethatresidesonclient• Internalformat(SAP),aswellasdelimitedandspanned(LOBdata)• Applicableforsome“cloud”usecases• OverlapnetworkoperationswithdataingestontheDB2server• MeasuredresultsshowasfastorfasterthanDB2LOADutility

• PlanstousethisfeatureforfastwritefromSpark

14

Page 15: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

SQLEnhancements• SimpleVALUESusingdynamicSQL– V10,V11• JDBC/ODBCType2performanceEnhancements• ODBCdriverimprovements:

• TIMESTAMPwithTIMEZONEsupport• MulticontextsupportusingASSOCIATE/DISSOCIATETHREAD• Abilitytopreservedynamicstatementcacheafterrollback

• SQLPaginationsyntaxsupport– OFFSETnandLIMIT• SupportprepareAttribute literalreplacementasBINDPACKAGEoption

15

Page 16: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

SQLEnhancements…• Keepviews,UDFsintactonDDLforunderlyingtables• Increasemaximumnumberoftablesreferencedinview,UDF,statement• EnhancedMERGEsupport(seenextslide)• SQLpaginationimprovements• Newbuiltinfunctions

• HEX2BIN(V11)• MEDIAN,PERCENTILE_CONT,PERCENTILE_DISC• COUNT(DISTINCTx)• GENERATE_UNIQUE– newoptionallengthparm• HASHfunctions(CRC32,MD5,SHA1,SHA256)

16

Page 17: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

EnhancedMergeSupport• DB2z/OSinitialsupportforMERGEstatementwithlimitedfunctionalitywasdeliveredwithVersion9:

• LimitedtoUPDATEandINSERTandonlyoneofeach• Focusedonuseofhostvariablecolumnarraystoprovidemultiplerowsofinputdata

• InDB212,DB2z/OSMERGEstatementwillbealignedwithbehaviordefinedinSQLStandardandDB2family• Sourcedataasatable-reference• MultipleMATCHEDclauses• AdditionalPredicateswith[NOT]MATCHED• SupportDELETEoperation• AllowIGNOREandSIGNAL

17

Page 18: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

SQLPagination• Withthegrowthofwebandmobileapplications,applicationdevelopersarelookingformoreefficient

waystodevelopgoodperformingapplications

• Numeric-basedpagination• SELECT*FROMtabOFFSET10ROWSFETCHFIRST10ROWSONLY

• Data-dependentpagination• Existingsyntax:

WHERE(LASTNAME=:lname ANDFIRSTNAME>=:fname)OR(LASTNAME>:lname)

• NewequivalentsyntaxWHERE(LASTNAME,FIRSTNAME)>=(:lname,:fname)

18

Page 19: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

SQLEnhancements…• UnicodecolumnsinEBCDICtables• PiecemealDELETE– allowforinterimcommits• MQUDFenhancements:allowMQmessageheadertobepassed• BiTemporal enhancements

• Auditingenhancements– V11• Inclusive/inclusiveforbusinesstime• Logicaltransactionforsystemtime• TemporalRI

19

Page 20: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Piece-wiseModificationofData• Mitigatetheeffectsoflockingandloggingwhenpotentiallymillionsofrowscouldbeaffectedbya

simplestatementlike:"DELETEFROMT1WHEREC1>7“

• Solution• Supportfullselect asthetargetofaDELETEstatementswherethefullselect allowsfortheFETCHFIRSTNROWS

ONLYtobespecified.

• DELETEFROM(SELECT*FROMT1WHEREC1>7FETCHFIRST5000ROWSONLY)

20

Page 21: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

SQLEnhancements…• APPLCOMPATsupportforDB212:V12R1Mnnnwhere nnn >=500• Globalvariableenhancements

• ArrayGlobalVariables• LOBGlobalVariable• FETCHstatementandglobalvariablesasatarget• EXECUTEstatementandglobalvariables• OPENstatementandGlobalVariables

• SQLPL• SQLPLintriggers,includingtriggerversioninganddebuggingsupport• Supportforconstants• SQLPLobfuscation• DynamicSQLinSQLPLUDFsandstoredprocedures• DBMS_OUTPUTforUDFtracing– V11

21

Page 22: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DB212SQLPLTriggers• Richcapabilityintriggerbody

• AllowSQLPLcontrolstatements• IF-THEN-ELSE,LOOP,REPEAT,…

• AllowmoreSQLstatements,dynamicSQL,variables,handlers• EasierportingoftriggersfromotherDBMSes• DEBUGGERsupport• VERSIONssupport

• ProvidesabetterwaytochangeatriggerwithoutDROP,CREATE• Canchangetriggeronlineandmaintaintriggeractivationorder

• Richercapabilitymeanssomeperformanceoverheadcomparedtoanequivalenttraditionaltrigger

22

Page 23: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

XMLImprovements

23

ImprovetheperformanceoftheXMLqueriesbychoosingoptimalaccess:

76%/77%reductionintheClass1/Class2timerespectively.

ImprovetheperformanceofXMLTable thatconductsthepivot-likeoperationtoXMLdatawithname-valuepairpattern:

90%CL2CPUimprovementusingcustomer'sxmldata/queries

ImproveperformanceanddeveloperproductivitybyallowingmultipleupdateinsideXMLModify function:

Upto90%improvementinET;upto97%improvementinCPUtime(whencomparingtosemanticsequivalentsingleupdate)

XSLTRANSFORMfunctionforXMLextenderusers

AllowforeasymigrationtopureXML

Page 24: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DB2forz/OSexistingsupportforJSON• Storedatafromweb/mobileapplicationsinitsnativeform

• ManywebapplicationsuseJSONforstoringandexchanginginformation

• JSONisoftenthepreferreddataformatformobileapplicationback-ends

• Movefromdevelopmenttoproductioninnotime• AbilitytocreateanddeployflexibleJSONschemas• GivespowertodependencyonIT

• Noneedtopre-determineschemasandcreate/modifytables• Idealforagile,rapiddevelopmentandcontinuousintegration

• DB2providestwowaysforworkingwithJSON• JavadriverforJSONAPI• SQLextensions– DB211,withenhancementsinDB212

24

JSON CLP

DB2

Page 25: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

JSONEnhancement

25

>>-JSON_VAL—(--json-value--,--search-string--,--result-type--)---------><ToextractandretrieveJSONdataintoSQLdatatypesfromBSON

Example(before):

JSON_VAL(column1,'PO.customer.@cid','i:na')

InDB212,weremovetherequirementthat1st parameterhastobeaBLOBcolumn(alreadyretrofittoV11inPI39003)

InV12,wesupportmoreoptionsas1st parameter:• viewcolumn• CASEexpression• tableexpressionwithunionall• triggertransitionvariable• SQLPLvariable/parameter

Page 26: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

RELIABILITY,AVAILABILITY,SCALABILITY,SECURITY

26

Page 27: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

LiftingPartitionLimits– ProblemStatement• MaximumnumberofpartitionsisdependentonDSSIZEandpagesize

• e.g.,IfDSSIZE=256GBandpagesize=4Kthenmaximumnumberofpartsis64• Runningoutofspaceinapartitionisanapplicationoutage• WhenalteringDSSIZE,REORGmustrunonentiretablespace• DSSIZEisattablespaceLevelandnotatpartlevel

• AllpartsinheritthesameDSSIZEsetattablespacelevel• Noabilitytohavedifferingpartitionsizes• Rebalancemustrunagainstmultiplepartitions

• Maximumtablesizelimitedto16TB

27

Page 28: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

LiftingPartitionLimits– Solution• NewUTSPBRtablespacestructurecalled‘UTSPBRRPN’

• Userelativepagenumbers(RPN)insteadofabsolutepagenumbers• Simplicity,usability,availability,scalability• Removedependencybetweennumberofpartitionsandpartitionsize• 7-byteRIDs(2bytepartnumber,5bytepagenumber)

• Upto256trillionrowsinasingletable• NewREORGmappingtableformat,optionaluntilnewfunctionenabled

• Supportupto1TBpartitionsize• Maximumtablesizeincreasedfrom16TB(4Kpagesize)to4PB

• Architectedtogoevenlarger• IncreasingDSSIZEissupportedatpartition-level• NewDSSIZEsupportforindexes

28

Page 29: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

LiftingPartitionLimits– Considerations• Conversion/Exploitation:

• zparm tocontrolwhethercreationofrangepartitionedusesrelativepagenumbering• PAGENUMRELATIVE/ABSOLUTEoptiononCREATE&ALTERTABLESPACE• Conversionispendingalter- requirestablespace-levelonlineREORG• OnlinealtertoincreaseDSSIZE– immediate,non-disruptive• OnlinealtertodecreaseDSSIZE- pendingalterrequiringtablespace-levelREORG

• Logrecordformatschangedtosupport7byteRIDs• Improvedserviceability,DSN1LOGPnowformatspartitionnumberexplicitly• Newlogrecordformatwrittenin“CM”,requiringfallbacktolerationsupportinV11• NotjustforRPNpagesets!

29

Page 30: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

OnlineSchema• Insertpartition(seenextslide)• OnlinedeferredALTERINDEXCOMPRESSYES

• PreviouslyplacedindexesinRBDP• Optiontodefercolumn-levelALTERs

• Materialise throughonlineREORG• Avoidavailabilityconstraints&conflictwithotherdeferredalters

30

Page 31: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

InsertPartition• Problemstatement

• Largerange-partitionedtablesoftenhavehotspotsandrebalancingacrossentiresetofpartitionsisonerous• Partitioningschemechoseninthepastmaynolongerbeoptimal

• Solution• Abilitytoinsertanewpartitionwithspecifiedlimitkey value

• ALTERTABLEADDPARTITIONENDINGATxxx• Splitexistingpartition,distributedatabetweennewandold• Onlinechangethroughpendingalter• Onlyaffectedpartition(s)needtobeREORGed• NoPITrecoverypriortomaterializingREORG

31

Page 32: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

PendingColumnLevelAlter• Problemstatement

• Somecolumn-levelaltersresultinapplicationimpact• e.g.indexesplacedinRBDP

• Immediatealtersconflictwithpendingalters• AdditionalREORGsrequiredtomaterializependingalterstoavoidDDLfailures

• Solution• Allowexistingimmediatealterstobecomependingalters,UTSonly• AllpendingaltersaccumulatedandmaterializedthroughonlineREORG• Newzparm

• ALWAYSIMMEDIATE:Existingbehaviorforexistingalters• ALWAYSPENDING:Currentimmediatealtersareconvertedtopendingalters

• ALTERCOLUMNtypetoavoidRBDPonindexes

32

Page 33: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Security&GeneralEnhancements• LOBcompression

• zEDC hardwarerequirement• ImprovedLOBhandlingforISO(UR)queriestoavoidSQLCODE+100• TRANSFEROWNERSHIP• Permitinstallation,migrationwithoutInstallSYSADMauthoritytolimitdataaccess• NewUNLOADprivilege• Supportlong,camel-casedDBRMnames• IFCID306logrecordsreturnedinthecorrectversion

33

Page 34: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities• REORG

• ImprovedFlashcopy management• REORGwithonlyaFLASHCOPYinlineimagecopy(notraditionalICs)nowcausesREORGtofail(RC=8)iftheflashcopy fails

• Improvedpart-levelUTSPBGREORGs• SupportscreationofnewPBGpartitionforoverflowrowsduringapartlevelreorg

• Preventcopy-pendingonLOBtablespaceduringREORGofUTSPBGs• AvoidleavingcopypendingonLOBtablespaceswhennewPBGpartitionsgrownduringlogphaseofREORG

• REORG-levelmanagementofdeleteofUTSPBGpartitions• Addanewkeyword,DROP_PART,forREORGemptyUTSPBGpartitionpruningwhenzparm alterationisnotfeasible

• SupportnewCOMPRESSRATIOcatalogcolumn• AddLOAD/REORG/RUNSTATSabilitytogatheraveragecompressratioattherecordlevelinsteadofthepagesavedlevel

34

Page 35: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• REORG…

• Upto17%additionaloffloadtozIIP• ThereloadphasecannowbezIIP offloaded

• Newmappingtableformatsupport• Thenewformatsupports7bytesRIDsneededwithUTSPBRRPNsupport

• PermitREORGagainstROpagesets• REORGwithanySHRLEVELcanberunagainstanyROtablespaceandindex• RetrofittedbacktoservicelevelwithAPARPI46774)

• Displayclaimerinformationoneachdrainfailure,notjustlastretry

35

Page 36: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• LOAD

• LOADPARTREPLACEwithdummyinputagainstemptyPBRpartition• NPIprocessingoptimizedtonotscanthewholeNPItofindkeystobedeletedforthepartitionbeingREPLACEd ifitwas

alreadyempty• ReduceselapsedtimeandCPUtimesignificantlyiftherewerealotofkeysfortheotherlogicalpartsoftheNPI• Upto99%CPU98%ElapsedTimereduction

• LOADSHRLEVELCHANGEPARALLELsupportforUTSPBG• ModifiedtoremovethesingleinputparallelismrestrictionforPBGtablespacesforLOADSHRLEVELCHANGE• Labmeasurementssawupto76%elapsedtimesavingswithsomeCPUoverhead• LOADSHRLEVELNONEPBGPARALLELisstillarestriction

• Upto90%additionalzIIP offload• RELOADphaseoftheLOADutilitycanbezIIP offloaded• Thisincludesthedataconversionandloadingoftherecordintothepageset

36

Page 37: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• LOAD…

• LOADRESUMESHRLEVELNONEBACKOUTYEStoavoidRECPforpagesetonfailure• Newoptiontoallowbackout ofrowsalreadyloadeduponencounteringanerror(suchasconversion,LOB/XML,duplicate

key,RIconstraint)withoutleavingthepagesetinRECP• PREFORMATsupportforauxtables

• Indicatestheremainingpagesarepreformatteduptothehigh-allocatedRBAinthetablespaceandindexspacesthatareassociatedwiththetablethatisspecifiedintable-name

37

Page 38: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• LOAD…

• MaintainMAXASSIGNEDVALforidentitycolumns• ThisenhancementmaintainstheMAXASSGINEDVALforuserprovidedinputandalsowillresetthevalueifaLOADREPLACE

onthetablespaceisrun• EliminatedatasharingoverheadwithUNLOADISO(UR)REGISTERNOoption

• NewoptiontobypasspageregistrationintheCouplingFacilityandavoidanydatasharingoverhead• LOADREPLACEsupportforCOMPRESSRATIOcolumn

• Gatherstheaveragecompressratioattherecordlevelinsteadofthepagesavedlevel

38

Page 39: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• Backup&Recovery

• PITrecoverysupportforUTSPBGtablespaces• AllowrecoveryofPBGUTStoaPITpriortoaREORGthatmaterializedthesephysicalpendingalters:pagesize(buffer

pool),DSSIZE,SEGSIZE,MEMBERCLUSTER• FLASHCOPY_PPRCP parameterforRESTOREandRECOVER

• Allowsuserstospecify/overridethepreservemirroroptionforPPRC(syncdiskmirroring)ontheutilitystatement• Previously:RESTORESYSTEMusedHSMdefault;RECOVERusedzparm FLASHCOPY_PPRC

• OptiontoskipPITrecoveryfornon-updatedpagesets• New*default*behaviorforPITRECOVERutility- objectswhichwerenotupdated*after*therecoverypointareskipped

andnotrecovered• Reasoning:thedataintheseobjectsstillreflectthatPIT,sononeedtorecover• SavesCPUresourceconsumptionandandelapsedtime• ThisdefaultbehaviorcanbeoverriddenwithSCOPE(ALL)

39

Page 40: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• Backup&Recovery…

• SystemLevelBackupsupportformultiplecopypools• BACKUPSYSTEMandRESTORESYSTEMnowsupportmultiplecopypools• Allowstheusertokeepdaily“goldencopy”orbackupforcriticalevents

• DFSMShsm messagesincludedinutilityjoboutputforBACKUP/RESTORESYSTEM• ImprovedmessagingforBACKUPSYSTEMandRESTORESYSTEM• HSMandDSSmessagesareincludedintheDB2utilityjoboutputsothattheuserdoesnothavetolookinthe(separate)

HSMjoblogsformessages• Availablewithz/OSV2.2

• COPYoptiontospecifyFASTREPLICATION(REQUIRED)• AnewCOPYutilityzparm COPY_FASTREPLICATIONREQ|PREF|NONEallowstheusercontrolofwhetherFlashCopy is

requiredduringcreationoftheFlashCopy imagecopy• WithFASTREPLICATIONREQUIRED,DSSwillallocatetargetdatasetwithinsameDASDbox,ensuringthatFlashCopy canbe

used• PreviouslyCOPYdefaultedtoFASTREPLICATIONPREFERRED

40

Page 41: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• RUNSTATS

• UsePROFILEsupportforinlinestatsinREORG&LOAD• COLGROUPinlinestatssupportforLOADPARALLEL• INVALIDATECACHEoptiontoavoiddynamicstatementcacheinvalidation

• Defaultbehaviorhaschangedtonotinvalidatepreparedstatements• COLGROUPperformance– 25%CPU,15%ElapsedTimereduction

• WhenCOLGROUPcolumnspecificationsareredundantwithINDEXcolumns,theduplicateCOLGROUPisignoredinlieuoftheindexprocessing

41

Page 42: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Utilities…• RUNSTATS…

• NewDSNUTILVstoredproceduresupportCLOBinput>32MB• TheDSNUTILVUTSTMTutilitystatementparameterisnowaCLOBinsteadofaVARCHAR,soDB2nowsupportsa4byte

length(upto2GB)• ForexistingapplicationsstillpassingaVARCHAR,DB2willdotheconversionfromVARCHARtoCLOB

• DSNACCOXchangesforREORGavoidance• NumberofrecommendationsreducedbychangingthedefaultforrecommendingREORGbasedonthenumberofinserts

andpseudodeletessincethelastREORGtooff• RemovesthecriteriaofrecommendingaREORGbasedonREORGLASTTIME,LOADRLASTTIME,orREBUILDLASTTIMEbeing

NULL• ImprovedutilityconcurrencyforMODIFY,COPYTOCOPY,MERGCOPY

• AllowsMODIFYRECOVERY,COPYTOCOPY,MERGECOPY,andexclusiveutilitieslikeLOADandREORGtorunconcurrentlyonthesametargetobjects

42

Page 43: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DataSharingImprovements• Supportforglobaltransactions• DDFsharedsessiondataacrossgroup

• DDFtransactionre-routing,sessiontokenforclientfail-over• Datasharingperformanceimprovements:

• ImprovedlockavoidancecheckingtoreduceCFlockrequests• In-memoryindexescanreduceGetPages andCFGBPrequests• ImprovedinsertspacesearchcanavoidP-lockcontentionandstreamlineinserts• RUNSTATSandUNLOADISOLATION(UR)toavoidCFpageregistration

43

Page 44: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DataSharingImprovements…• Newdatasharingpeerrecoveryoption• RetryofautomaticLPLandGRECPrecovery• AsynchronousCFLockduplexing(notyetenabled)

• ReducesoverheadforsystemmanagedduplexingofCFLOCK1andSCAstructures• Secondarystructureupdatesareperformedasynchronously withrespecttoprimaryupdates• DB2willsyncupwithz/OStoensuredataintegrityi.e.,allmodifylockshavebeen“hardened”inthesecondary

lockstructurebeforethecorrespondingundo/redorecordfortheupdateiswrittentoDB2theactivelogonDASD

• Increasesthepracticaldistanceformulti-sitesysplex operationswhilstduplexingofCFLOCK1andSCAstructures• Plannedas4Q2016deliverablewith

• z/OS2.2APAR• z13GA2CFCC21

44

Page 45: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DataSharingImprovements…• SynchronousCFlockstructureduplexing– howitworkstoday

45

CF1PrimaryLock

CF2Secondary

Lock

IRLMandDB2XES1.Requestin

2.Requestout

4.Response

5.Responseoutz/OS

3.Communication

4.Response2.Requestout

Page 46: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

DataSharingImprovements…• Asynchronous CFlockstructureduplexing– howitwillnowwork

46

z/OS

CF1PrimaryLock

CF2Secondary

Lock

IRLMandDB2XES

1.Requestin

2.Requestout

3.Response

4.Responseoutz/OS

5.Communication

Query

6.Orderedexecution

Page 47: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

TopDB2zSocialMediaChannels#DB2z

• JointheWorldofDB2 www.worldofdb2.com

• Follow @IBMDB2onTwitterhttps://twitter.com/IBMDB2

• JoinDB2zLinkedInGroup

• https://www.youtube.com/user/IBMDB2forzOS

• DB2zonFacebook• https://www.facebook.com/IBMDB2forzOS/

47

Page 48: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

RegisterNowcomingDB2Webcasts#DB2z- http://ibm.biz/DB2z2017WebcastSeries

• DB2forz/OS RESTful APIenablingtheMobileEconomy - 11thApril

• DB212MigrationPlanningandVeryEarlyExperiencesPART1- 16thMay

• DB212MigrationPlanningandVeryEarlyExperiencesPART2- 17thMay

• DB212forz/OSDataSharingEnhancements6thJune

• DB2forz/OSandFlashCopy:PracticalUseCases- 13thJune

• UsingLargerRealMemorySizewithDB2forz/OStoreduceCPU- June27th

48

Page 49: DB2 12 for zOS Technical Overview Part 2 - Ningapi.ning.com/.../DB212forzOSTechnicalOverviewPart2.pdf · • Support DELETE operation ... • table expression with union all ... DB2

Now… LiveQ&AwithJohnCampbell