Top Banner
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands. All rights reserved. No part of this material may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photographic, or otherwise, without the explicit written permission of the copyright owners. Become Agile with Data Modeling by Rick F. van der Lans R20/Consultancy BV Twitter @rick_vanderlans www.r20.nl
27
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands. All rights reserved. No part

of this material may be reproduced, stored in a retrieval system, or transmitted in any form or by

any means, electronic, mechanical, photographic, or otherwise, without the explicit written permission of

the copyright owners.

Become Agile with Data Modeling

by

Rick F. van der LansR20/Consultancy BVTwitter @rick_vanderlanswww.r20.nl

Page 2: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 2

Everything About Data has Changed

Page 3: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 3

We Live in the Big Data Era

Page 4: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 4

New Data Storage Technologies

Page 5: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 5

Applications Come and Go

Application 1

Application n

Application 6

Application 5 Application 4

Application 3

Application 2

Page 6: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 6

Data in the Hands of the Users

Self-Service

Reporting

Self-Service Analytics

Self-Service ETL

Self-Service Cleansing

Self-Service …

Page 7: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 7

Lost Without a Data Model

Page 8: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 8

Why Data Models?

A data model describes what data means, what the relationships are, what the characteristics of data are, and so on

What does this mean: <John, December 15, 1999>

Data without a data model is like words without a dictionary

A data model is the Rosetta Stone to understand data correctly

Page 9: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 9

NoSQL Requires Data Modeling As Well

ID VALUE

75295<employee>

<number>6</number>

<name> <lastname>Parmenter</lastname>

<initials>R</initials>

</name>

<address> <street>Haseltine Lane</street>

<houseno>80</houseno>

<postcode>1234KK</postcode>

<town>Stratford</town>

</address>

</employee>

10381

9

<employee>

<number>7</number>

<name> <lastname>Metheny</lastname>

<initials>P</initials>

</name>

<address> <street>Brownstreet</street>

<houseno>80</houseno>

<province>ZH</province>

<town>Boston</town>

</address>

</employee>

13217

1

<employee>

<number>15</number>

<name> <lastname>Metheny</lastname>

<initials>P</initials>

<code>45</code>

</name>

</employee>

Multi-structured table

Page 10: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 10

A Data Model is More Than a Diagram

Textual definitions

List of synonyms

Textual descriptions

Integrity rules related to data quality

Business glossary

Security rules

Page 11: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 11

A Data Model is Pivotal

For business users to develop their own reports

For business users to analyze reports and results

For developers to develop new big data applications to understand the structure of the data

For BI specialists to integrate data from multiple systems to present a correct 360 degrees view of customers

For data stewards to determine the correctness of data

For many more …

Page 12: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 12

Data Modeling Old Style

Page 13: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 13

Four Requirements for Agile Data Modeling

Data storage agnostic

Collaboration

Business glossary

Flexible data model

Page 14: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 14

1. Data Storage Technology Agnostic

Dealing with many different data storage technologies

Dealing with Polyglot Persistence

Application 1

SQL

Application 2

Hadoop

Application 3

NoSQL

Application 4

Page 15: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 15

1. Data Storage Technology Agnostic

Rich set of data model concepts

Forward engineering

Reverse engineering

Page 16: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 16

1. Data Storage Technology Agnostic

SQLHadoop

NoSQL

Page 17: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 17

2. Agile Data Modeling is Collaboration

Data stewards

Business analysts

Business users

Data architects / modelers

Page 18: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 18

Versioning of Data Model (Components)

Page 19: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 19

Comparing Data Models

Page 20: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 20

Fine-Grained Check-in and Check-out

Page 21: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 21

3. Business Glossary

Page 22: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 22

Searching for Business Objects

Page 23: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 23

An Integrated Business Glossary

Page 24: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 24

4. Flexible Data Model

see http://www.agiledata.org/essays/dataModeling101.html

Page 25: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 25

A Flexible Data Model

Membercategory

Subscription Junior/Senior

Librarymember

Membercategory

Subscription Junior/Senior

Librarymember

Page 26: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 26

Concluding Remarks

Everything about data has changed

The data model has become pivotal for a larger audience

Agile data modeling is pivotal

Agile data modeling tools must support:• Data storage agnostic

• Collaboration features

• Business glossary

• Flexible data model

Page 27: Become Agile with Data Modeling

Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 27

Resources

New white paper on Agile Data Modeling• http://forms.embarcadero.com/AgileDataModelingWP

Learn more about the ER/Studio product family• http://www.embarcadero.com/data-modeling

To arrange a demo, please contact Embarcadero Sales• http://forms.embarcadero.com/forms/ERStudioProductInterest

Save the Date: April 30, 2015• Learn about upcoming features for ER/Studio’s next release

• http://forms.embarcadero.com/ERStudioNewRelease