Tobias Koebler, Matt Kangas, Tobias Karpstein EIM160 Landscape Transformation Replication Server – Real-Time Data Integration into SAP HANA
Tobias Koebler, Matt Kangas, Tobias Karpstein
EIM160
Landscape Transformation Replication Server – Real-Time Data Integration into SAP HANA
© 2012 SAP AG. All rights reserved. 2
Disclaimer
This presentation outlines our general product direction and should not be relied on in making a
purchase decision. This presentation is not subject to your license agreement or any other agreement
with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to
develop or release any functionality mentioned in this presentation. This presentation and SAP's
strategy and possible future developments are subject to change and may be changed by SAP at any
time for any reason without notice. This document is provided without a warranty of any kind, either
express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this
document, except if such damages were caused by SAP intentionally or grossly negligent.
© 2012 SAP AG. All rights reserved. 3
Agenda
Positioning & Architectural Concept
Core Functions
Table Settings and Transformation Capabilities
Additional features and use cases
Summary & Outlook
Positioning &
Architectural Concept
© 2012 SAP AG. All rights reserved. 5
Product Name and Positioning
SAP Landscape Transformation
Replication Server for SAP HANA
SAP LT Replication Server (SLT) is positioned for real-time data replication
from SAP and non-SAP sources (SAP supported data bases only)
Mainly Recommended for real-time data replication business scenarios
© 2012 SAP AG. All rights reserved. 6
SAP HANA system
SAP / non-SAP source
system
Overview
SAP LT Replication Server
Application Table
Trigger Based
Delta Recording Replication Engine
Application Table
RFC / DB
Connection
HANA Studio
DB
Connection
Replication Configuration
Connection(s) between source system and SAP HANA system are
defined as “Configuration” on the SAP LT Replication Server
Data load and replication are
triggered via SAP HANA Studio
SAP LT Replication Server does not have to be a separate SAP
system and can run on any SAP system with SAP NetWeaver 7.02
ABAP stack (Kernel 7.20EXT)
© 2012 SAP AG. All rights reserved. 7
SAP HANA system SAP LT Replication Server SAP source system
Architectural Concept 1/2 Replication from SAP sources system
Efficient initialization of data
replication based on DB trigger
and delta logging concept
Flexible and reliable replication process, incl.
data migration
Fast data replication via DB connect
LT replication functionality is fully
integrated with HANA Modeler UI
Application table Logging table
DB trigger
Read module Structure mapping &
Transformation
Application table
Write module
RFC
Connection
DB
Connection
© 2012 SAP AG. All rights reserved. 8
SAP HANA system SAP LT Replication Server Non-SAP source system
Architectural Concept 2/2 Replication from non-SAP sources system
In a first step, SAP LT Replication Server transfers all metadata table definitions from the non-SAP source system to the HANA system. From
the HANA Studio perspective, non-SAP source replication works as for SAP sources. When a table replication is started, SAP LT Replication
Server creates logging tables within the source system. As a difference, the read modules are created in the SAP LT Replication Server. The
connection to the non-SAP source system is established as a database connection.
Application table Logging table
DB trigger
Read module
Structure mapping &
Transformation
Application table
Write module
DB
Connection
DB
Connection
© 2012 SAP AG. All rights reserved. 9
Multi System Support 1/2
SAP HANA system Source systems
System A
System B
Schema 1
Schema 2
Source systems are
connected to separate
HANA schema on the
same HANA System
SAP HANA system Source systems
System A
System B
Schema 1
Schema 1
Source systems are
connected to separate
HANA systems. Schema
name can be equal or
different
SAP HANA system Source systems
System A
System B
Schema 1
Source systems are
connected to same HANA
system and also the same
schema
© 2012 SAP AG. All rights reserved. 10
SAP HANA systems SAP Source system
Schema 1
Schema 2
System A
Multi-System Support 2/2 1:N Replication for SAP source systems
If one source system is connected to
several target schemas (currently up
to 1:4 supported), the relevant target
schema can be selected in the data
provisioning UI.
SAP source system is
connected to separate
HANA systems or to the
same system with
different schema name.
Core Functions
© 2012 SAP AG. All rights reserved. 12
Configuration and Monitoring Dashboard Setup of connections in SAP LT Replication Server
Call SAP LT Replication Server
Configuration (Transaction: LTR)
Define configuration data
© 2012 SAP AG. All rights reserved. 13
Configuration and Monitoring Dashboard Setup for non-SAP source system
Start with transaction LTR
To replicate from Non-SAP source
system select Non-SAP system and the
affected database system.
Depending on the Database System, additional
required information needs to be specified (e.g.
for DB2 specify the DB Connection and the
tablespace name).
© 2012 SAP AG. All rights reserved. 14
Configuration and Monitoring Dashboard New Settings for a Configuration
A dedicated tablespace can be
defined for the logging tables. If more
than one tablespace was already
defined, they will still be displayed.
Flag for client-specific load and
replication. The data is only read
from the client which is specified in
the RFC connection.
Flag to allow usage of source system
in different configurations (1:N
replication).
© 2012 SAP AG. All rights reserved. 15
Configuration and Monitoring Dashboard Statistics
Statistical data can be displayed in the Statistics
tab page. You can view the status, the latency
times, number of records that have been
replicated, and the relevant operation (insert,
update, delete).
© 2012 SAP AG. All rights reserved. 16
SAP HANA Studio Start Data Replication from SAP HANA System
Choose data provisioning to launch
SAP HANA Modeler UI 1. 1. Select source system as defined in SAP LT Replication
Server; related system information and schema will be displayed
2. 2. Use button
1. Load to start only a load process
2. Replicate to start load and replication process
3. 3. Use button Stop Replication to finish replication
4. 4. Use button Suspend to pause replication
5. 5. Use button Resume to continue replication
Demo
Table Settings and
Transformation Capabilities
© 2012 SAP AG. All rights reserved. 19
Table Settings and Transformation Capabilities 1/4 Selective Data Replication / Filtering
SAP HANA system SAP LT Replication Server Source system
DB
Connection RFC/DB
Connection
Reduce Number of Records by Filter
Scenario
Replicating certain data only
Only data of specific years, departments, clients, etc. should be used in HANA
© 2012 SAP AG. All rights reserved. 20
Table Settings and Transformation Capabilities 2/4 Transformation Data
Conversion of Data
Scenarios
To make certain fields anonymous HR reporting
To fill initial fields
To convert units or currency and recalculate amounts and values
SAP HANA System SAP LT Replication Server Source System
DB
Connection
RFC/DB
Connection
Transformation of
Data
© 2012 SAP AG. All rights reserved. 21
Table Settings and Transformation Capabilities 3/4 Structure Change of (Target) Table Structure
Extension/Reduction of Target Table Structures
Scenarios
Merging the same tables (BSEG) from different systems (and create an additional field, for example a client field
in order to avoid duplicate entries)
Merge different tables into one table in the HANA system
Additional fields are required (for example can be calculated/filled during load/replication)
Not all fields are required in the HANA system
SAP HANA system SAP LT Replication Server Source system
DB
Connection
RFC/DB
Connection
© 2012 SAP AG. All rights reserved. 22
Table Settings and Transformation Capabilities 4/4 UI to Specify Table Settings
Transaction IUUC_REPL_CONTENT
Specific table settings:
Assignment of transformation rules
– Reduce Number of Records by Filter
– Conversion of Data
Extension/Reduction of Target Table Structures
Adjust / optimize performance of load and replication
Select table 2
Select Configuration 1
3
Demo
Additional features
and use cases
© 2012 SAP AG. All rights reserved. 25
Monitoring with SAP Solution Manager 7.1 SP5
Replication notifications and alerts
are now visible in SAP Solution
Manager 7.1 SP5.
SLT monitoring summarizes the following
information per configuration: Connectivity to source and target system
Status of latency time last 24h replication
Status of master and load jobs
Trigger status
© 2012 SAP AG. All rights reserved. 26
SAP Replication Manager – Mobile Application 1/2 Benefits and Requirements
Monitor Monitor the data replication process and system parameters.
Execution Trigger execution of important data replication functions.
Higher Flexibility Application can be run anytime and anywhere from a mobile device which is connected to the internet.
Statistics View Provide an analytical perspective of real-time data replication in terms of latency.
Infrastructure Requirements
• SUP 2.1
• Gateway (NW 7.02) (Minimal gateway)
• Backend
• IW_BEP 200 (SP2.0)
• DMIS_MOB SP01
• DMIS_2010 SP07
• SLT system should be a NW 700 EHP2 with SAP Kernel 7.20 EXT
© 2012 SAP AG. All rights reserved. 27
SAP Replication Manager – Mobile Application 2/2 Screenshots
Execute
Statistics
View
Higher
Flexibility
Monitor
© 2012 SAP AG. All rights reserved. 28
Technical Enabler for Multiple Data Provisioning Use Cases
Table-based Replication integrated into HANA Studio
Real-time for SAP and NON-SAP sources
Enabling SAP HANA Rapid Deployment Solutions and SAP HANA Application
Accelerators (e.g. CO-PA)
Replication engine for existing RDS Solutions
and ERP Accelerators
Replication engine for new
SAP HANA Application Accelerators
ERP
Operational
Reporting
CRM Sales
Pipeline
Analysis
FI/CO
Accelerator
SAP Banking
Financial
Reporting
SAP Banking
Transaction
History
CO-PA Accelerator Reporting in Drill-Down Tool
Accelerated Virtual Info Provider
Operative transactions like Top-Down Distribution
FI and CO • General Ledger
• Profit-Center Accounting
• Asset Accounting
• Overhead Cost Controlling
• Material Ledger
© 2012 SAP AG. All rights reserved. 29
SLT and SAP HANA in the Cloud Architecture and Integration with SLT
SAP source system
RFC Connection
via WAN IU
UC
_T
AB
_A
LLO
WE
D
Control table IUUC_TAB_ALLOWED in the SAP source system restricts the set of tables/clients
that are allowed to be defined for load/replication from the HANA Studio (located in the cloud).
© 2012 SAP AG. All rights reserved. 30
Outlook: SAP LT Replication Server & BW
SAP or non-SAP sources (no SAP NW BW!)
Enabling real-time data supply into SAP NetWeaver BW
Replicating Data of any SAP System (or non-SAP) into SAP NetWeaver BW
Using a WebService DataSource as interface for SAP NetWeaver BW
Real-Time data processing via SAP NW BW Realtime Data Acquisition (RDA)
Daemon into a DataStore Object (DSO) or master data tables (MD)
RFC - BAPI
Connection
RFC / DB
Connection
SAP LT Replication Server SAP NetWeaver BW
SAP HANA
Row & Column Store
SQL/Calc/Planning/Aggr. Engine
WebService
DataSource
RDA
Daemon
MD DSO
Summary & Outlook
© 2012 SAP AG. All rights reserved. 32
Key Benefits of SAP LT Replication Server for SAP HANA
Allows real-time (and scheduled) data replication
Table Settings and transformation capabilities (e.g. only replicate certain records, enrich table structure)
Ability to migrate data into HANA format while replicating data in real-time
„Unlimited“ release coverage (from SAP R/3 4.6C onwards) sourcing data from SAP ERP and other ABAP based
SAP applications
Fully integrated with SAP HANA Studio
Enhanced monitoring capabilities via SAP Solution Manager 7.1 SP5 and mobile app SAP Replication Manager
SAP LT Replication Server is the ideal solution for all HANA customers who need real-
time or scheduled data replication sourcing from SAP and NON-SAP sources
© 2012 SAP AG. All rights reserved. 33
What’s new in SAP HANA SPS05*
SLT for SAP NetWeaver BW: ready for proof-of-concepts and prototyping projects (general availability expected in Q1/2013)
Technical readiness for integrated use of SLT with SAP ERP Accelerators and other SAP HANA Application Accelerators
Improved usability
– Help Center with detailed context-related documentation
– Advanced status tracking (when using Access Plan / Range Calculation)
Improved stability
– Manual steps on SLT system after implementing a note or support package eliminated
– Support-related expert functions streamlined
New and improved performance options (for initial load and replication)
– Data load using ROW ID approach with reading type 4
– Optimized job management: free-up background jobs and resources for tables in replication with low change rates
* This presentation and SAP„s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement
© 2012 SAP AG. All rights reserved. 34
Key Information Sources and Contacts
General SAP Note - LT Replication Server for HANA:
SAP Note 1605140: includes all important information, links to overview presentation, offline demo as well as
SAP corrections
Service Market Place and Help Portal (http://service.sap.com/hana; http://help.sap.com/hana)
Installation Guide
Security Guide
Operations Guide
Do not hesitate to contact your SAP Account Team or the HANA Customer Solution
Adoption Team for more details.
Feedback Please complete your session evaluation for EIM160.
Thanks for attending this SAP TechEd session.
Exercise Source System &
SAP LT Replication
Server
SAP HANA system
SAP Logon SID: M95, M96, M97
check your sheet
User: EIM160_XX
PW: eim160
HANA Studio: ANC
check your sheet
User: SYSTEM
PW: manager
Appendix
© 2012 SAP AG. All rights reserved. 38
Technical Requirements and System Set-Up Information for SAP LT
Replication Server (SAP HANA 1.0 SPS04)
SAP HANA system SAP LT Replication Server (*) SAP Source system
System Requirements: SAP Basis: NetWeaver 702, with Kernel 7.20EXT (64BIT
Unicode) PL90 - see SAP note 1597627, => currently limited platform availability
Filesystem: 100 GB RAM: 16-32 GB CPU: 2-4 cores Recommended number of background jobs: 10
DB
Connection
RFC
Connection
System Requirements:
SAP Basis 4.6C and higher
All databases
Installation:
respective DMIS 2010 version
Minimum support pack level: SP05(**)
Installation:
Addon DMIS 2010_1_700
Minimum support pack level: SP07
Installation:
HANA SPS04: includes LT replication
functionality fully integrated into the UI of
the HANA modeler
Basic Configuration: Define RFC connection to source system Define DB connection to HANA system Define max. number of jobs to be used for data replication
Basic Configuration: Optional: define separate table space
for logging tables Define RFC user with appropriate authorization
Basic Configuration: Create a DB user (if required)
(*) LT replication server can run on any SAP system with SAP NetWeaver 7.02 ABAP stack (using SAP Kernel 7.20EXT), for example on Solution Manager 7.1 or the source system – it does not have to be a separate SAP system! (**) A few new SLT features available with HANA SPS04 may require DMIS_2010 SP07
© 2012 SAP AG. All rights reserved. 39
Technical Requirements and System Set-Up Information for SAP LT
Replication Server (SAP HANA 1.0 SPS04)
SAP HANA system SAP LT Replication Server (*) Non-SAP Source system
System Requirements:
SAP Basis: Netweaver 702, with Kernel 7.20EXT (64BIT
Unicode) PL90 - see SAP note 1597627, => currently
limited platform availability
- Filesystem: 100 GB
- RAM: 16-32 GB
CPU: 2-4 cores
Recommended number of background jobs: 10
DB
Connection
DB
Connection
System Requirements:
the OS/DB restrictions of NetWeaver 7.02
apply (see at http://service.sap.com/pam)
Installation:
Addon DMIS 2010_1_700
Minimum support pack level: SP07
Installation:
HANA SPS04: includes LT replication
functionality fully integrated into the UI of
the HANA modeler
Basic Configuration:
Define DB connection to source system
Define DB connection to HANA system
Define max. number of jobs to be used for data
replication
Basic Configuration:
Create DB user for Secondary DB connection Basic Configuration:
Create a DB user (if required)
(*) LT replication server can run on any SAP system with SAP NetWeaver 7.02 ABAP stack (using SAP Kernel 7.20EXT), for example on Solution Manager 7.1 or the source system – it does not have to be a separate SAP system!
© 2012 SAP AG. All rights reserved. 40
Database
Technical availability
SAP Sources Non SAP Sources (*)
MSFT SQL Server Enterprise Edition OK OK
Oracle Enterprise Edition OK OK
IBM DB2 LUW/ UDB (DB6) OK OK
IBM DB/2 zSeries OK OK
IBM DB2 iSeries (former AS/400) OK Planned
IBM Informix OK Planned
SAP MaxDB OK OK
Sybase ASE OK
(with DB-Version 15.7.0.11)
OK (with DB-Version 15.7.0.11)
DB Supportability Matrix (HANA 1.0 SPS04)
Loading Data via SAP LT Replication Server for SAP HANA
For non-SAP source systems, the customer database license needs to cover a permanent database
connection with 3rd party products like LT replication server.
(*) Since a DB connection from LT replication server to a non-SAP system is required, the OS/DB restrictions of NetWeaver 7.02 apply (see at
http://service.sap.com/pam)
© 2012 SAP AG. All rights reserved. 41
SLT and HANA “compatibility matrix”
Source System SLT HANA DB/Studio
DMIS 2010 SP3/4 DMIS 2010 SP4 HANA 1.0 SPS2
DMIS 2010 SP3-7 DMIS 2010 SP5-7 HANA 1.0 SPS3
DMIS 2010 SP3-7 DMIS 2010 SP5-7 HANA 1.0 SPS4
If not all systems are installed on the newest support package, some functionalities
like 1:N replication or Load from SAP Archives might not be available.
• SAP HANA can be upgraded from SPS3 to SPS4 without upgrading DMIS component
• The DMIS component can be upgraded from SP5 to a higher support package level without the need to
upgrade the HANA database or studio
SAP Note 1709225
© 2012 SAP AG. All rights reserved. 42
SAP HANA system SAP Source system
Load from SAP Archive 1/2 Architecture and Key Building Blocks
SAP LT Replication
Server
Archived data can be selected by the date of the archiving session.
ADK Archive
Structure Mapping &
Transformation
Write Module
Read Module RFC
Connection
DB
Connection
Application Table
ADK Archive
Access API
The ILM API must be available in the source system.
The API can be installed by means of SAP Note 1652039
(46C – 731).
© 2012 SAP AG. All rights reserved. 43
Load from SAP Archive 2/2 Define Load Object from SLT System
Select Archive Object
Select replication configuration
Define Selection Criteria
Select Relevant table
within current archive
object
© 2012 SAP AG. All rights reserved. 44
Key Information Sources and Contacts
General SAP Note - LT Replication Server for HANA:
SAP Note 1605140: includes all important information, links to overview presentation, offline demo as well as
SAP corrections
Service Market Place and Help Portal (http://service.sap.com/hana; http://help.sap.com/hana)
Installation Guide
Security Guide
Operations Guide
Do not hesitate to contact your SAP Account Team or the HANA Customer Solution
Adoption Team for more details.
© 2012 SAP AG. All rights reserved. 45
Resources: Enterprise Information Management with SAP
• Understand the big picture of SAP’s enterprise information
management offerings
• Explore step-by-step instructions for working with SAP Data
Services
• Learn how to perform the most important tasks in SAP
Information Steward, SAP NetWeaver Information Lifecycle
Management, SAP Master Data Governance, and SAP
Extended Content Management
• All royalties donated to Doctors Without Borders
Enter 6Y8DF3 as your discount code when ordering
at SAP PRESS
© 2012 SAP AG. All rights reserved. 46
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express
permission of SAP AG. The information contained herein may be changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary software components of
other software vendors.
Microsoft, Windows, Excel, Outlook, PowerPoint, Silverlight, and Visual Studio are registered trademarks of
Microsoft Corporation.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System
z10, z10, z/VM, z/OS, OS/390, zEnterprise, PowerVM, Power Architecture, Power Systems, POWER7,
POWER6+, POWER6, POWER, PowerHA, pureScale, PowerPC, BladeCenter, System Storage, Storwize,
XIV, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, AIX, Intelligent Miner, WebSphere,
Tivoli, Informix, and Smarter Planet are trademarks or registered trademarks of IBM Corporation.
Linux is the registered trademark of Linus Torvalds in the United States and other countries.
Adobe, the Adobe logo, Acrobat, PostScript, and Reader are trademarks or registered trademarks of Adobe
Systems Incorporated in the United States and other countries.
Oracle and Java are registered trademarks of Oracle and its affiliates.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or
registered trademarks of Citrix Systems Inc.
HTML, XML, XHTML, and W3C are trademarks or registered trademarks of W3C®, World Wide Web
Consortium, Massachusetts Institute of Technology.
Apple, App Store, iBooks, iPad, iPhone, iPhoto, iPod, iTunes, Multi-Touch, Objective-C, Retina, Safari, Siri,
and Xcode are trademarks or registered trademarks of Apple Inc.
IOS is a registered trademark of Cisco Systems Inc.
RIM, BlackBerry, BBM, BlackBerry Curve, BlackBerry Bold, BlackBerry Pearl, BlackBerry Torch, BlackBerry
Storm, BlackBerry Storm2, BlackBerry PlayBook, and BlackBerry App World are trademarks or registered
trademarks of Research in Motion Limited.
© 2012 SAP AG. All rights reserved.
Google App Engine, Google Apps, Google Checkout, Google Data API, Google Maps, Google Mobile Ads,
Google Mobile Updater, Google Mobile, Google Store, Google Sync, Google Updater, Google Voice,
Google Mail, Gmail, YouTube, Dalvik and Android are trademarks or registered trademarks of Google Inc.
INTERMEC is a registered trademark of Intermec Technologies Corporation.
Wi-Fi is a registered trademark of Wi-Fi Alliance.
Bluetooth is a registered trademark of Bluetooth SIG Inc.
Motorola is a registered trademark of Motorola Trademark Holdings LLC.
Computop is a registered trademark of Computop Wirtschaftsinformatik GmbH.
SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork,
SAP HANA, and other SAP products and services mentioned herein as well as their respective logos are
trademarks or registered trademarks of SAP AG in Germany and other countries.
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web
Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects
is an SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services
mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase Inc.
Sybase is an SAP company.
Crossgate, m@gic EDDY, B2B 360°, and B2B 360° Services are registered trademarks of Crossgate AG
in Germany and other countries. Crossgate is an SAP company.
All other product and service names mentioned are the trademarks of their respective companies. Data
contained in this document serves informational purposes only. National product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be reproduced, copied,
or transmitted in any form or for any purpose without the express prior written permission of SAP AG.