Global Marketing Oracle Enterprise Manager Migration from 12c to 13c [CON6989] Created by: Yong Kwong Lung Systems Integration Advisor Dell | Infrastructure, Engineering & Operations (IEO) [email protected]
Global Marketing
Oracle Enterprise Manager Migration from 12c to 13c [CON6989]
Created by:Yong Kwong LungSystems Integration AdvisorDell | Infrastructure, Engineering & Operations (IEO)[email protected]
Global Marketing
Agenda Summary
• Enterprise Manger in action at Dell
• Enterprise Manager integration in Dell (Upstream and Downstream Apps)
Oracle Enterprise Manager in Dell
• Overall planning of hardware, architecture, key focuses – at a glance
Architecture, Hardware Spec & key Focuses
• Best practices / Activities during OEM13c update
• Resource allocation Plan
• Mass agent deployment via gold image and application plugin such as E-Business Suite, SOA, and Siebel
• Gold Agent Image Result
• Targets Discovery via EMCLI
• Lesson Learnt, Team Feedback
Dell Approach on Migration
Global Marketing
Oracle Enterprise Manager in Dell
Global Marketing
Overview Oracle Enterprise Manager at Dell
7.4KURL Monitoring
29KDatabase Targets
57KApplication Targets
(Middleware/EBS/Siebel/PS)
App/DB Servers Monitored in Production Enterprise Manager
App/DB Servers Monitored in Non-Production Enterprise Manager
2.6KAgents
350Reports
5DownstreamApplication
1.4KUDM
DB/Host
15Jobs /
Automation
1.5KUser
3KGrouping
Global Marketing
Monitored Targets Dell In-house Application
Oracle Enterprise Manager
Baseline Metric
Admin Group
Incident Rule
User Access
Reports
UDM
Notify Method
Targets Discovery
Agent Installation
Compliance Policies
Groups
Targets Properties
RMAN BackupDeployed in 2007
OMR(Database)
NT AuthenticationPAC Group
Email NotificationSMTP Server
Incident (Remedy)Ticketing
Incident (ServiceNow)
JsonIncident
Convert to ServiceNowDec/2016
DMMR
Database Metadata Repository
DBCM
Database Compliance Mgmt
Deployed in 2010
Deployed in 2010
KPI
Key Performance Indicator
Deployed in 2013
DMP
Database Maintenance Planner
Deployed in 2012
Deployed in 2007
Oracle DB Monitoring
10g, 11g, 12c
Pilot Test 2011
Deployed in 2012
Oracle SOA Monitoring
10g, 11g
Pilot Test 2013
Deployed in 2015
Pilot Test 2013
Deployed in 2016
Oracle EBS Monitoring
11g, 12c
Oracle SIEBEL Monitoring
10g, 11g, 12c, 13c
Pilot Test & Deployed in 2015
URL Monitoring
N/A
Enterprise Manager in action at Dell
Automation
EMCLI
Jobs
Automation Service
Improvement
Since 2010-2016
Global Marketing
Architecture, Hardware Spec & Key Focuses
Global Marketing
DataGuard
OracleManagement Service
(13c)
Oracle Management Repository (13c)
Oracle Database 12c
OracleManagement Agent
13c
Archive: 512GB, FRA: 512GB, Data: 3TB Archive: 512GB, FRA: 512GB, Data: 3TB
Production Application Server Cluster(U.S., Austin, PC1) Dell 13g M630's
DR Application Server Cluster(U.S., Austin, PS3) Dell 13g M630's
EM12P3.PrdRAM 128GB
CPU 36 Core/u01 100GB
EM12P1.PrdRAM 128GB
CPU 36 Core/u01 100GB
EM12P2.PrdRAM 128GB
CPU 36 Core/u01 100GB
EM12P4.PrdRAM 128GB
CPU 36 Core/u01 100GB
Primary Cluster DB(U.S., Austin, PC1) Dell 13g M630's
DR Cluster DB(U.S., Austin, PS3) Dell 13g M630's
EM12P1.DRRAM 128GB
CPU 36 Core/u01 100GB
EM12P2.DRRAM 128GB
CPU 36 Core/u01 100GB
EM12P3.DRRAM 128GB
CPU 36 Core/u01 100GB
EM12P4.DRRAM 128GB
CPU 36 Core/u01 100GB
400GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Primary ServerRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Primary ServerRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Agent Agent Agent Agent Agent Agent
400GBRsync
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Additional OMSRAM 128GB
CPU 36 Core/u01 250GB
Support Disaster Recovery
Zero downtime for OEM rolling patching
New Enterprise Manager Architecture
From 12c Level 3… …to 13c Level 4
Shared Storage
Production Application Server Cluster(U.S., Austin, PC1)
EM12P3EM12P1 EM12P2 EM12P4
em12p.prd.amer.dell.com (U.S., Austin, PC1)
Additional OMSAdditional OMSPrimary Server Additional OMS
Agent Agent Agent
Global Marketing
Monitored Targets Dell In-house Application
Oracle Enterprise Manager
Baseline Metric
Admin Group
Incident Rule
User Access
350 Reports
1.5K UDM
Notify Method
Targets Discovery
2.6 Agent Installation
Compliance Policies
3K Groups
Target Properties
RMAN Backup
In-house Custom App
build on Oracle APEX
OMR(Database)
DMMR
Database Metadata Repository
DBCM
Database Compliance Mgmt
KPI
Key Performance Indicator
DMP
Database Maintenance Planner
Non-Standard DBSNMP Password
Oracle DB Monitoring
10g, 11g, 12c
Convert to ASMSNMP Account
Oracle SOA Monitoring
10g, 11g
Linux (V5, V6 & V7)
Windows Servers
Existing 12cR2 Agent
Oracle EBS Monitoring
11g, 12c
Oracle SIEBEL Monitoring
10g, 11g, 12c, 13c
Unhealthy / Pending Decommission Targets
URL Monitoring
N/A
Project Implementation Key Focuses
Automation
EMCLI
Jobs
15 Automation for Service Improvement
High – Resource & Time
Medium – Resource & Time
Low– Resource & Time
NT AuthenticationPAC Group
Email NotificationSMTP Server
Incident (Remedy)Ticketing
Incident (ServiceNow)
JsonIncident
Convert to ServiceNowDec/2016
Global Marketing
Dell Approach on OEM Migration
Migration Plan
Resource Allocation
Agents Installation
Targets Discovery
Global Marketing
Migration Plan:Two System Approach
Business Decision
• Downtime > 2 hrs.
OMR Health Concern
• Potential upgrade failure
End to End Infra Changes
• SLB, OMS, OMR
End to End Integration Testing
• Upstream & Downstream App
UDM convert to Metric Ext
• Complexity of the conversion
Enterprise Manager 13c
OMR
Current OMR Server New OMR Server
OMR
PrimaryServer
AdditionalOMS
Agent 12c
/u02
/u01/u01
Enterprise Manager 12c
PrimaryServer
AdditionalOMS/u02
/u01/u01
Agent 13c Agent 12c Agent 13c Agent 12c Agent 13c Agent 12c Agent 13c
Global Marketing
Group 3:
OEM Administrator
Gro
up
2:
Do
wn
stre
am
Ap
ps In
teg
ratio
n
Gro
up
1:
OE
M1
3c A
ge
nt M
igra
tio
n
Oracle Enterprise Manager
Baseline Metric
Admin Group
Incident Rule
User Access
350 Reports
1.5 UDM
Notify Method
Targets Discovery
Agent Installation
Compliance Policies
3K Groups
Target Properties
RMAN Backup
OMR(Database)
DMMR
Database Metadata Repository
DBCM
Database Compliance Mgmt
KPI
Key Performance Indicator
DMP
Database Maintenance Planner
Oracle DB Monitoring
10g, 11g, 12c
Oracle SOA Monitoring
10g, 11g
Oracle EBS Monitoring
11g, 12c
Oracle SIEBEL Monitoring
10g, 11g, 12c, 13c
URL Monitoring
N/A
Resource Allocation
350 Reports1.5k UDM
ComplinacePolicies
3K Groups
Group 4:
Overall OEM Function Validation, Monitoring health check and
performance test
Project Manager
Automation
Global Marketing
Create Gold Agent Images
{APP}_{OS}{PLATFORM}
E.g.: odb_linux64
Pre-requisite•On OMS Server
•24308359-August Bundle Patch 13.1.0.0.160816
•24364619-Plugins 13.1.1.0.160816
•22741755-Support OEL5.x
•On Agent Target Server (one only)
•Deploy 13.1 Agent
•Plugin Deploy
•24308442-August Bundle Patch 13.1.0.0.16081
{APP}_{OS}{PLATFORM}_{VER}
E.g.: odb_linux64_v1
{APP}_{OS}{PLATFORM}
E.g.: odb_linux64
Application OS Platform Gold Image Version
Oracle E-Business Suite Linux 64bit EBS_Linux64 ebs_linux64_v1
Oracle Database Linux 64bit ODB_Linux64 odb_linux64_v1
Oracle SOA Linux 64bit SOA_Linux64 soa_linux64_v1
Oracle SIEBEL Win 64bit SIEBEL_Win64 siebel_win64_v1
1
2
3
4
5
6
Global Marketing
Agent Installation using Gold Agent Images
1
2
3
Add New Server
Gold Agent Image
Installation Details
Start Agent Deployment
Fresh Agent
Installation
Agent Upgrade 1
2
Subscribe Agent(s)
Start Agent Deployment
Select Agent(s)
Global Marketing
Gold Agent Images Result
Day 1
•333 DB
hosts
Day 2
•4 SEIBEL hosts
Day 3
•26 EBS hosts
Day 4
•195 SOA hosts
Day5
•229 DB
hosts
604hosts
success
Pilot Test Result178 host failed due to:
•SSH Daemon Error
•Agent File-system Full
•Lack of Account Permission
•Un-contactable Servers
•Agent Installation =
•Patches Apply =•Plugin Deploy =
•Parameter Update =
With Gold Agent Images (5 Hosts)
30Minutes
•Agent Installation = 24 minutes
•Patches Apply = 20 Minutes•Plugin Deploy = 20 Minutes
•Parameter Update = 10 Minutes
Without Gold Agent Images (5 Hosts)
74 Minutes
604 Agents
Agent yet to be updated
Agent without images subscribe
Image Name with Total Agents
Compliance Status
Global Marketing
•Retrieve Targets Configuration
•gc$target
•gc$target_properties
Preparation
•Generate EMCLI command
Converting•Register Targets to OEM13c via EMCLI
Execution
Enterprise
Manager 12c
Enterprise
Manager 13c
Targets Discovery
ClusterCluster DB
Weblogic Domain
Cluster ASMDB Instance
ListenerUser Registration
ASM Instance
Grouping
Target’s Properties UDM conversion
User Role Granting
Fusion Middleware
Global Marketing
Feedback by Dell Project Team…
Gold Images were excellentGood so far
Less effort and time
Strategic guidance AND execution are clearOEM13c Better UI & Performance
“Improve my knowledge”
Save CostEasy to follow up
Customer Loves it!Never patch Agent again
Speed up targets migration via EMCLILess communication gap
Proud to be part of the team!!
Global Marketing
Thank YouPresenter:Matheus VieiraSystems Engineering Sr AnalystDell | Infrastructure, Engineering & Operations (IEO)[email protected]