From Print to the Cloud and Beyond: The Story of a Century Old Company and its Resiliency to Ever-Evolve

From Print to the Cloud and Beyond

The Story of a Century Old Company and its Resiliency to Ever-Evolve

Agenda

CAS Overview

CAS - In the Beginning… There was Print

CAS - The Age of Silos

CAS - IBM Integration. To the Cloud… and Beyond

Future Considerations

CAS is a division of the American Chemical Society. Copyright 2015 American Chemical Society. All rights reserved.2

Agenda

CAS Overview






CAS helps scientists around the world benefit from the published

work of their colleagues by monitoring, abstracting and indexing the

world's chemistry-related literature

CAS has been supporting scientists for more than 100 years


Since 1907, CAS’s objective

has been to find, collect, and

organize all publicly disclosed

chemistry substance

information

CAS helps scientists around the world benefit from the published work of their colleagues

CAplusSM

CAS REGISTRYSM

CHEMLIST®

CIN®


Markush

Indexing

Authority

Processing

Source

Selection

Document

Indexing

Reaction

Indexing

MARPAT®

CHEMCATS®

CAS scientists monitor, abstract and index the world's chemistry-

related literature

Proprietary, standardized indexing in CAS databases ensures

consistent, comprehensive search results.

CASREACT®

CAS products and services make it faster and easier for scientist to find the information they need for their research

CAS Registry Numbers® uniquely identify each

chemical substance without the ambiguity of multiple

naming conventions

STN® combines industry-leading search and retrieval

with unique and comprehensive content

SciFinder® offers a one-stop shop experience with

flexible search and discover options based on user

input and workflow

Science IP®, the CAS information search service

provides fast, comprehensive and accurate searches

of the world’s scientific and technical literatureCAS is a division of the American Chemical Society. Copyright 2015 American Chemical Society. All rights reserved.6

CAS Registry Number 58-08-2

CAFFEINE!

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://b.hatena.ne.jp/entry/www.cas-japan.jp/content/chemical-substances.html&ei=tg7dVIS5ArSIsQSmm4H4Aw&bvm=bv.85970519,d.cWc&psig=AFQjCNEyhBPr0TnkPWIGYzF3EYOF6vPSNw&ust=1423859649881163

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://b.hatena.ne.jp/entry/www.cas-japan.jp/content/chemical-substances.html&ei=tg7dVIS5ArSIsQSmm4H4Aw&bvm=bv.85970519,d.cWc&psig=AFQjCNEyhBPr0TnkPWIGYzF3EYOF6vPSNw&ust=1423859649881163

Agenda

CAS Overview






CAS Timeline108 Years of Progress (and Counting)


CAS End-To-End Architecture“In the Beginning… There was Print”

Data

Transformation

Data Validation

Data CurationData Integration

Data Presentation


Data Ingestion

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=https://www.flickr.com/photos/michaelpinto/4716333220/&ei=4me1VIXeMfT-sASr94KYBw&bvm=bv.83339334,d.cWc&psig=AFQjCNEkVNbZB8boFZx7Znu8sdx5DwrA2w&ust=1421260983268091

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=https://www.flickr.com/photos/michaelpinto/4716333220/&ei=4me1VIXeMfT-sASr94KYBw&bvm=bv.83339334,d.cWc&psig=AFQjCNEkVNbZB8boFZx7Znu8sdx5DwrA2w&ust=1421260983268091

“CAS Knows Jack”Jack and Friends Beside Printed Chemical Abstracts


Agenda

CAS Overview






Data Ingestion Data Transformation Data Validation Data Normalization Data Persistence

CAS End-To-End Architecture“The Age of Silos”

Data Ingestion Data Transformation Data Validation Data Curation Data Integration Data Persistence

Data Transformation Data Validation Data Integration Data Presentation


Silo Challenges

Multiple Data Ingestion Points– In some cases, the same data is being ingested twice

Multiple Views of the Data– Each silo must perform complex transformations to its specific view

– Editorial manufactures normalized data based on a print model

– Product Development wants de-normalized, complete data

– Content Delivery has a mixed view of the data

Multiple Vocabulary Conventions– Differing data definitions causes confusion across silos

No Unified, Authority Data Store– Each silo has their own copy of the data in its own specific vocabulary


Editorial Legacy Systems

Many disparate databases used to store relational data– Becomes difficult to maintain and support

Multiple database technologies used– No unified platform

Challenges to support legacy systems– Some legacy technologies are no longer supported

– Succession planning difficult to support legacy systems

– Special IT used so that legacy code would not need to be touched


Content Delivery Systems

Data was transformed into one common data model to bridge

gap between Editorial and Product View– One common schema model was complex and unwieldy

– Common model contained “unnecessary” complexities

– Common model did not align with Product Development’s specifications


Product Development Systems

Product Development must code for “unnecessary” complexities

Data not completely de-normalized– Additional development necessary to compile data


Silo Challenges


By the Numbers

Thousands of journals ingested per day– Approximately 1 TB of data per week

Over 100 other data feeds ingested per day

Over 1.2 million messages processed per day– Synced up with product data daily in less than 10 minutes

Over 6 TB of compiled data created per day


What is an Architect to Do?


Unify…Integrate…Simplify

Unify Data; Processes; Transformations; Data Ingestion

Integrate Disparate Systems; Services; Applications; and

Data Consumers

Simplify the Architecture!!!


• Run proof-of-concept and/or proof-of-technology and/or pilot project as needed

• Negotiate contract

• Adjust as needed

• Selection team members score vendor solutions

• Aggregate scores

• Select vendor with best aggregate score (judgement required)

• Bake-off if winner is too close to call

• Send RFP document to prospective vendors

• Hold clarification meetings with vendor teams

• Vendors send RFP response documents

• Vendors present their solutions and answer questions

• Create technology selection team

• Identify key requirements (based on architecture and tech stack governance)

• Assign weights

• Create RFP document and scorecard spreadsheet

Request For Proposal

Create RFP

Engage vendors

Score-driven selection

Validate selection

CAS is a division of the American Chemical Society. Copyright 2015 American Chemical Society. All rights reserved.

Requirements

Data Integration

Durable Message Bus with Guaranteed Delivery

Any-to-Any Connectivity

Architectural Flexibility

Excellent Support

A Proven Solution


Agenda

CAS Overview






Unify…Integrate…Simplify

Data Curation

Data Ingestion Data Transformation Data Validation Data Normalization Data Integration

Data Transformation Data Validation Data Integration Data Presentation


Data Persistence Data Flow Orchestration

Agenda

Overview






To the Cloud… and Beyond!

Off-Prem Processing Bursting Capabilities Data Center Relief Co-Location Capabilities

New Mobile Applications

Service Unification Service Management Service Integration



Questions


Connect with CAS:

Joseph Sapp

Lead Enterprise Application Architect

[email protected]

www.linkedin.com/in/joesapp

mailto:[email protected]

http://www.linkedin.com/in/joesapp

From Print to the Cloud and Beyond: The Story of a Century Old Company and its Resiliency to Ever-Evolve

Technology