RWDG Webinar: DIY and Purchased Data Governance Tools

1

Copyright © 2012 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com

Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting Twitter About This Webinar at #RWDG

1


Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner

Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.com

The Data Administration Newsletter – TDAN.com

Real-World Data GovernanceDIY and Purchased Data Governance Tools

Monthly Webinar Series Hosted by DataversityJune 16, 2016 – 2:00 p.m. EST




Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting

22

#RWDG @RSeiner

• Real-World Data Governance – Monthly Webinar Series– Third Thursday of Each Month – 2pm EST– July 21, 2016 – Data Steward Definition and Other Data Governance Roles– Register On-Line at TDAN.com, KIKConsulting.com and DATAVERSITY.net

Real-World Data GovernanceUpcoming Webinars





33

#RWDG @RSeiner

• Non-Invasive Data Governance:The Path of Least Resistance and Greatest Success

ISBN 9781935504856 / Technics Publishing / Amazon.com

• KIKConsulting.comHome of Non-Invasive Data Governance™

• DATAVERSITY Events (with DEBTech International)

– Data Governance & Information Quality (DGIQ) ConferenceJune 27 – July 1, 2016 – San Diego, CAAssess Your Existing DG Program – TutorialData Governance, Privacy and Internet of Things – Session

Real-World Data GovernanceIn the News





44

#RWDG @RSeiner

• The Data Administration Newsletter(TDAN.com)– Monthly Publication– June Issue Available– Articles, Columns, Features, Blogs– Published by Bob Seiner– Produced by DATAVERSITY– Subscribe On-Line for Updates

Real-World Data GovernanceIn the News





55

#RWDG @RSeiner

DIY and Purchased DG ToolsIntroduction

• Data Governance tools are enablers to program success.

• The metadata stored in these tools become the backbone of a successfulData Governance program.

• The question of whether to develop your own tools versus purchasing DataGovernance tools is looked at early in the program development process.

• There are benefits and drawbacks to either way you answer this question.





66

#RWDG @RSeiner


• This month’s RWDG webinar focuses on making smart choices when itcomes to selecting or developing the tools to support Data Governance.

• Bob will share his experiences of evaluating tools on the market and alsoshare templates and tools that he has created to assist programs throughthe growing pains of success.

• There is something in the webinar for newbies and experiencedpractitioners.





77

#RWDG @RSeiner


• This webinar addresses:– How to answer the Build vs Buy question– Criteria for evaluating tools on the market– Examples of tools you can create yourself– Complimentary nature of DIY and purchased tools– Cost and benefits of Data Governance tool choices– Vendors and Tools on the Market





88

#RWDG @RSeiner

DIY and Purchased DG ToolsBuild vs Buy

• Considerations for the Build Versus Buy Decision– Requirements / Planning– Existing Tools First– Timing of the Decision– Resources Required– Total Cost of Ownership– Funding / Approval– Tools Evaluation





99

#RWDG @RSeiner


• Considerations for Building Data Governance Tools– What do you need the tool to do?– Skills to Design / Develop / Implement / Maintain– Amount of Time to Deliver– For use by Group / Department / Enterprise





1010

#RWDG @RSeiner


• More Considerations for Building Data Governance Tools– DIY Tool Ideas / Stay Tuned for Some– Database / Spreadsheet / Application– Education / Training / Support





1111

#RWDG @RSeiner


• Considerations for Buying Data Governance Tools– What do you need the tool to do?– Match Tool with Requirements / Anticipate Future Requirements– Funding to Acquire– Resources to Manage





1212

#RWDG @RSeiner


• More Considerations for Buying Data Governance Tools– IT Governance / Acquisition Process– Hardware, Database & Technical Support– Education / Training / Support





1313

#RWDG @RSeiner

DIY and Purchased DG ToolsCriteria for Evaluating Tools

• Tool Evaluation Criteria– Data Governance Criteria– Metadata Management Criteria





1414

#RWDG @RSeiner


• Data Governance Requirements and Capabilities– Business Glossary Capabilities– Ability to Customize– Application of Stewardship / Ownership– Customizable Roles– Workflow Management





1515

#RWDG @RSeiner


• More Data Governance Requirements and Capabilities– Policies and Standards Repository– Business and Master Data Rule Repository– Domain Values - Allowable Values (Reference Data)– Source to Target Mapping – Data Lineage– Impact Analysis





1616

#RWDG @RSeiner


• Even More Data Governance Requirements and Capabilities– Data Governance Metrics Capabilities– Extend Data Artifacts and Relationships– Data Issues Log and Resolution Process– Data Profiling Capabilities – Diverse Sources– Support for Internal Audit





1717

#RWDG @RSeiner


• Metadata Requirements and Capabilities– Metamodels and Software Releases– Extensibility– Self-Defined Loads– Role Representation– Process Integration





1818

#RWDG @RSeiner


• More Metadata Requirements and Capabilities– Change Control and Versioning– Communications– End User Requirements– Training and Education– Resource Requirements





1919

#RWDG @RSeiner

DIY and Purchased DG ToolsTools You Can Create

• Do-It-Yourself Tools and Templates– Data Governance Framework– Operating Model of Roles and Responsibilities– Common Data Matrix– Governance Activity Matrix– Communications Matrix





2020

#RWDG @RSeiner

SEINER NON-INVASIVE FRAMEWORK FOR DATA GOVERNANCE IMPLEMENTATION

EndorseProcesses

ResolutionProcesses

EXECUTIVE

STRATEGIC

TACTICAL

OPERATIONAL

SUPPORT

DomainProcesses

DailyProcesses

EnforceProcesses

MetricApproval

MetricAcceptance

DomainMetrics

DailyMeasurements

CollectReportMetrics

PolicyDirective

Best Practice Guidelines

Standards Requirements

Workflow

GlossaryDictionary Metadata

KIK Artifacts(Common Data

Activity Matrices)

SupportSponsor

Understand

MeetingsStatus

SubjectProject

OrientationOn Boarding

Ongoing

PlanDevelopDeliver

SteeringCommittee(Delegate)

Council(Decision)

Domain StewardsOwners(Subject)

DataStewards

(Daily)

DG LeadWork Groups

Partners(Function)

Copyright © 2016 – Robert S. Seiner and KIK Consulting & Educational Services, LLC

LEVEL

EXECUTIVE – SENIOR LEADERSHIP TEAMSTRATEGIC – BUSINESS & TECHNOLOGYTACTICAL – SUBJECT MATTER EXPERTISEOPERATIONAL – DAILY JOB FUNCTIONSUPPORT – FUNCTIONAL MANAGEMENT

LEVELS

EXECUTIVE – SENIOR LEADERSHIP TEAMSTRATEGIC – BUSINESS & TECHNOLOGY MGMTTACTICAL – SUBJECT MATTER EXPERTISEOPERATIONAL – DAILY JOB FUNCTIONSUPPORT – FUNCTIONAL MANAGEMENT

COMPONENTS

ROLES (AUTHORITY) – FORMAL RESPONSIBILITYPROCESSES – APPLICATION and ENFORCEMENT COMMUNICATIONS – EDUC, TRN, AWARENESSMETRICS – MEASUREMENTS and KPIsTOOLS – ARTIFACTS PURCHASED & DEVELOPED

Leve

ls

Components

ROLES (AU

THORITY)

COM

MU

NICATIO

NS

TOO

LS

METRICS

PROCESSES






2121

#RWDG @RSeiner


SEINER NON-INVASIVE FRAMEWORK FOR DATA GOVERNANCE IMPLEMENTATION

EndorseProcesses

ResolutionProcesses

EXECUTIVE

STRATEGIC

TACTICAL

OPERATIONAL

SUPPORT

DomainProcesses

DailyProcesses

EnforceProcesses

MetricApproval

MetricAcceptance

DomainMetrics

DailyMeasurements

CollectReportMetrics

PolicyDirective

Best Practice Guidelines

Standards Requirements

Workflow

GlossaryDictionary Metadata

KIK Artifacts(Common Data

Activity Matrices)

SupportSponsor

Understand

MeetingsStatus

SubjectProject

OrientationOn Boarding

Ongoing

PlanDevelopDeliver

SteeringCommittee(Delegate)

Council(Decision)

Domain StewardsOwners(Subject)

DataStewards

(Daily)

DG LeadWork Groups

Partners(Function)

Copyright © 2016 – Robert S. Seiner and KIK Consulting & Educational Services, LLC

LEVEL

EXECUTIVE – SENIOR LEADERSHIP TEAMSTRATEGIC – BUSINESS & TECHNOLOGYTACTICAL – SUBJECT MATTER EXPERTISEOPERATIONAL – DAILY JOB FUNCTIONSUPPORT – FUNCTIONAL MANAGEMENT

LEVELS

EXECUTIVE – SENIOR LEADERSHIP TEAMSTRATEGIC – BUSINESS & TECHNOLOGY MGMTTACTICAL – SUBJECT MATTER EXPERTISEOPERATIONAL – DAILY JOB FUNCTIONSUPPORT – FUNCTIONAL MANAGEMENT

COMPONENTS

ROLES (AUTHORITY) – FORMAL RESPONSIBILITYPROCESSES – APPLICATION and ENFORCEMENT COMMUNICATIONS – EDUC, TRN, AWARENESSMETRICS – MEASUREMENTS and KPIsTOOLS – ARTIFACTS PURCHASED & DEVELOPED

Leve

ls

Components

ROLES (AU

THORITY)

COM

MU

NICATIO

NS

TOO

LS

METRICS

PROCESSES





2222

#RWDG @RSeiner






2323

#RWDG @RSeiner






2424

#RWDG @RSeiner






2525

#RWDG @RSeiner






2626

#RWDG @RSeiner






2727

#RWDG @RSeiner

DATA DEFINER DATAPRODUCER

DATA STEWARDCOORDINATOR

DATA GOVERNANCE ACTIVITY MATRIX©

MASTER DATADEVELOPMENT

LIFE CYCLE(MDDLC)

INFORMATIONGATHERING

(DOMAIN, SYSTEM,STEWARDS)

OPERATIONAL DATA STEWARDS

DATA USERDATA DOMAIN

STEWARD(or designee)

DATA DOMAIN / LOB/FUNCTIONAL AREA

ASSESSMENT &REQUIREMENTS

PLANNING &ANALYSIS

SOLUTION DESIGN

SOLUTIONDEVELOPMENT

SOLUTION TESTING

SOLUTIONIMPLEMENTATION

SOLUTIONMONITORING &MAINTENANCE

Activity initiated re: this domain,Data Domain Steward is involvedin identifying and recording inforelated Domains, Systems,Stewards per issue or task.

Activity initiated re: this domain,Steward Coordinator is involved inidentifying Operational Stewardsin this LOB/FA that shouldparticipate in this work flow.Assure appropriate businessmeta-data is recorded.

Propose alternativesfor data definitionsolution that best fitswith definedrequirements.

Provide input to thedevelopment of thedata productionsolution.

Provide definitionrequirements &gathering document.Define data needed tooperate business &report results.

Test data solutionfrom a definitionperspective. Assurethat appropriatebusiness meta-data isrecorded.

Produce userrequirements. Usedata needed tooperate business &report results.

Coordinate activities ofOperational Stewards includingproject timelines, status reporting,tactical decision making. Assureappropriate business meta-data isrecorded.

Provide datadefinition guidance tobuild the appropriatesolution.

Provide data usageguidance to build theappropriate solution.

Coordinate tasks associatedconducting planning and analysissteps.

Propose alternativesfor data productionthat best fits with thedata definitionsolution and definedrequirements.

Propose alternativesfor data usagesolution that best fitswith definedrequirements.

Coordinate tasks associatedconducting planning and analysissteps. Accept or Resolve solutionfrom the Steward Coordinator.

Coordinate activities of allindividuals related to developmentwork including timelines, status,tactical decision making.

SYSTEM SMEs

IT

DATA SMEs

Test data solutionfrom a productionperspective. Assurethat appropriatebusiness meta-data isrecorded.

Test data solutionfrom a usageperspective. Assurethat appropriatebusiness meta-data isrecorded.

Coordinate activities of theOperational Stewards related totesting work including timelines,status, tactical decision making.

Coordinate activities of theOperational Stewards related tosolution implementation includingtimelines, status, tactical decisionmaking.

Coordinate activities of theOperational Stewards related tosolution monitoring &maintenance including timelines,status, tactical decision making.

Perform EIS system testing.Assure that appropriate technicalmeta-data is recorded.

Perform EIS data testing. Assurethat appropriate technical meta-data is recorded.

Coordinate and manage alltechnical aspects of data solutiondevelopment. Assure thatappropriate technical meta-data isrecorded.

Coordinate and manage alltechnical aspects of systemsolution development. Assurethat appropriate technical meta-data is recorded.

Coordinate system design withData Domain Stewards andSteward Coordinators.

Coordinate data design with DataDomain Stewards and StewardCoordinators.

Coordinate and manage alltechnical aspects of systemplanning and analysis with DataDomain Stewards and StewardCoordinators.

Coordinate and manage alltechnical aspects of data planningand analysis with Data DomainStewards and StewardCoordinators.

Coordinate and manage alltechnical aspects of systemassessment & requirementsgathering with Data DomainStewards and StewardCoordinators.

Coordinate and manage alltechnical aspects of dataassessment & requirementsgathering with Data DomainStewards and StewardCoordinators.

Coordinate and manage alltechnical aspects of datainformation gathering with DataDomain Stewards and StewardCoordinators. Assure appropriatetechnical meta-data is recorded.

Coordinate and manage alltechnical aspects of systeminformation gathering with DataDomain Stewards and StewardCoordinators. Assure appropriatetechnical meta-data is recorded.

Participate in datadefinition informationgathering as needed.

Participate in dataproductioninformation gatheringas needed.

Participate in datausage informationgathering as needed.

Coordinate and manage alltechnical aspects of systemsolution implementation.

Coordinate and manage alltechnical aspects of systemsolution monitoring &maintenance.

Coordinate and manage alltechnical aspects of data solutionimplementation.

Coordinate and manage alltechnical aspects of data solutionmonitoring & maintenance.

Coordinate business tasksassociated with solution testingsteps.

Coordinate business tasksassociated with solutionimplementation.

Coordinate business tasksassociated with solutionmonitoring & maintenance.

As part of daily job,identify operationdata issues pertainingto their domain ofdata.








2828

#RWDG @RSeiner






2929

#RWDG @RSeiner






3030

#RWDG @RSeiner






3131

#RWDG @RSeiner






3232

#RWDG @RSeiner






3333

#RWDG @RSeiner






3434

#RWDG @RSeiner

DIY and Purchased DG ToolsComplimentary Nature

• Using Both Purchased and DIY Tools– Use Tools that Leverage Each Other– Inevitable Reality (That You Will have Both)– Match Tool with Requirement– Portability of Metadata





3535

#RWDG @RSeiner

DIY and Purchased DG ToolsComplimentary Nature

• More on Using Both Purchased and DIY Tools– Centralized Access – Metadata Warehouse– Education / Training– Limit the Number of Tools– Availability of DIY Tools Metadata through Purchased Tools





3636

#RWDG @RSeiner

DIY and Purchased DG ToolsCost and Benefits

• Weighing the Costs and Benefits– Requirements Cost– Approval Cost– Tool Cost– Resource Cost– Maintenance Cost– Hardware Cost– Education Cost– Training Cost





3737

#RWDG @RSeiner

DIY and Purchased DG ToolsCost and Benefits

• Weighing the Costs and Benefits– Understanding Benefit– Quality Benefit– Protection Benefit– Data Management Benefit– Workflow Benefit– Audit Benefit– Legal Benefit





3838

#RWDG @RSeiner

• Types of Tools– Data Governance / Stewardship– Metadata Management– Business Glossary / Data Dictionary– Workflow Management– Data Discipline Tools

• Data Modeling• Data Movement / ETL• Reporting• Big Data and Analytics• Security / Protection• Change Management

DICTIONARY

DATA

VOCABULARYVocabulary

Semantic LevelTerminology

Business Language We Use

Data DictionaryBusiness Metadata

Business Explanation of Data in Systems

DataSystems, Databases, Reference (Code) Data, Technical

Metadata

DIY and Purchased DG ToolsVendors and Tools on the Market





3939

#RWDG @RSeiner

Data Dictionary

Business Metadata Business Explanation of Data in Systems

Data

Systems, Databases, Reference (Code) Data, Technical Metadata

Vocabulary

Semantic Level

Terminology

Business Language We UseM

aps

toH

ow U

sed

Maps to Multiple

Business Term

Standard Data Name System Data Name

Business SystemData Name








4040

#RWDG @RSeiner


• Vendors and Tools That Focus on DG– Adaptive

– Metadata / Glossary Manager– ASG

– Enterprise Data Intelligence– Collibra

– Data Governance Center– Computer Associates

– ERWin Data Modeler– Data3Sixty

– Data3Sixty / Fusion– Diaku

– Axon

– Global Data Excellence – Governance 2.0

– Global Ids – Enterprise DG Suite

– IBM– InfoSphere

– Informatica– MDM / Data Governance Suite

– SAP– Data Management Products

– SAS– Data Management Products





4141

#RWDG @RSeiner


• Industry Analyst Reports– Gartner Group– Forrester Group– Aberdeen Group– McKinsey & Company– Bain & Company– SearchDataManagement.com





4242

#RWDG @RSeiner

DIY and Purchased DG ToolsWrap Up

• In this webinar Bob addressed:– How to answer the Build vs Buy question– Criteria for evaluating tools on the market– Examples of tools you can create yourself– Complimentary nature of DIY and purchased tools– Cost and benefits of Data Governance tool choices– Vendors and Tools on the Market

• Next Real-World Data Governance Webinar – 2pm EST– July 21, 2016 – Data Steward Definition and Other Data Governance Roles





4343

#RWDG @RSeiner

DIY and Purchased DG ToolsWrap Up





4444

#RWDG @RSeiner

• Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, 412.220.9644 (Fax)[email protected]@tdan.com

@RSeiner@TDAN_com#RWDG

Real-World Data GovernanceContact Information