The document discusses enabling monitoring of engineered systems using Oracle Enterprise Manager 12c. It describes discovering the components of Exadata Database Machine, Exalogic Elastic Cloud, and Exalytics In-Memory Machine using the OEM 12c interface and plugins. The key steps include installing OEM agents, configuring prerequisites, discovering the systems, and customizing the monitoring setup.

1. Monitor Your Engineered Systems
From a Single Pane Of Glass
Oracle Enterprise Manager and Exadata, Exalogic & Exalytics
Prepared By:
Alfredo Krieg
Sr. Oracle Enterprise Cloud Administrator
The Sherwin-Williams Company

2. Visit IOUG at the User Group Pavilion
Stop by the User Group Pavilion in the Upper Level
of Moscone South and catch up with the user
community!
• Connect with IOUG members and volunteers
• Learn more about IOUG membership and benefits
and how to join the IOUG community, 30,000+
technologists strong
• Enter to win discounts, free books from IOUG Press
and COLLABORATE 16 Registration
Visit us Sunday – Wednesday!

3. SIG Meetings at Oracle OpenWorld
All meetings will be held in User Group Pavilion,
Meeting Room, Moscone South
Monday, October 26
• IOUG Cloud Computing SIG Meet-Up: 10:00 a.m.—11:00 a.m.
• IOUG Oracle Enterprise Manager SIG: 5:00 p.m.—6:00 p.m. *Location:
OTN Lounge, Moscone South*
Tuesday, October 27
• IOUG IoT SIG: 10:30 a.m.—11:30 a.m.
• IOUG BIWA SIG: 11:30 a.m.—12:30 p.m.
Wednesday, October 28
• IOUG Exadata SIG: 10:30 a.m.—11:30 a.m.
• IOUG RAC SIG: 1:00 p.m.—2:00 p.m.
• IOUG Oracle 12c SIG: 2:00 p.m.—3:00 p.m.

4. COLLABORATE 16 – IOUG Forum
April 10-14, 2016
Mandalay Bay Resort & Casino
Las Vegas, NV
IOUG Forum Advantage
• Save up to $1,000 on registration and education offerings,
like pre-conference workshops
• Gain access to exclusive IOUG content, including the
Strategic Leadership Program
• Priority access to IOUG hands-on labs
• Advance access to supplemental session material
presentations
• Special IOUG activities
collaborate.ioug.org | #C16LV

5. Connect with IOUG
Twitter: Follow @IOUG
Facebook: Connect with IOUG on our
official Facebook page
www.ioug.org/facebook
LinkedIn: Connect and network with other
Oracle professionals and experts in the
IOUG LinkedIn group www.ioug.org/linkedin

6. • Senior Oracle Cloud Administrator at The Sherwin-
Williams Company based in Cleveland, OH
• Oracle ACE Associate
• OEM Cloud Control 12c and Database Performance
Tuning
• Oracle Technologies since 2004 & 11g Certified
• Blog bitkode.blogspot.com
About me

7. Connect with me
Twitter: Follow @alfredokrieg
LinkedIn: www.linkedin.com/alfredokrieg
Email: alfredokrieg@gmail.com
alfredo.krieg.villa@sherwin.com

8. • Largest Producer of Paint & Coatings in US, among
Top 3 worldwide
• Founded in 1866 in Cleveland, OH
• 2016 is 150th Anniversary
• 2013 - $10.19 billion in sales
• Business in 120+ Countries
• 34,000+ employees
• 4,000+ Company Owned Stores
• 90+ Manufacturing Facilities Globally
The Sherwin-Williams Company

9. • Why use OEM 12c?
Single Interface for all Engineered Systems
Connectivity between OEM and EMOC for Exalogic for
alerts (management?)
Use of monitoring templates, administration groups and
roles already created
Notifications
Automation of tasks using Job system and corrective
actions
Motivation

10. • OEM 12c Architecture
• Oracle OMS, Repository and Agents
• OEM 12c plug-ins
• Plug-ins for Exadata, Exalogic and Exalytics
• Engineered Systems Architecture
• Exadata DB Machine
• Exalogic Elastic Cloud
• Exalytics In-Memory Machine
• Enabling Monitoring
• Install, discover and configure components
• Customize monitoring and automate tasks
• Tools
• Repvfy and Exachk
Agenda

11. OEM 12c Architecture

12. Modular (Building Block) Approach
OEM 12c Architecture
OEM
Components
OEM
Base +
Plug-ins

13. Customizing OEM
OEM 12c Architecture
OEM Base +
Plug-ins
+ =
Metric Extensions
thresholds, etc.
Your OEM
Everything is Awesome!

14. • Plug-ins by default
• Oracle Database
• RAC, ASM, DB, etc.
• Oracle Fusion Middleware
• WebLogic, SOA, BI, etc.
• My Oracle Support
• SRs, Knowledge library, patches, etc.
• Oracle Exadata
• Oracle DB Machine targets
OEM 12c Architecture

15. • Exadata DB Machine
• Exadata plug-in
• Exalogic Elastic Cloud (Virtual)
• Oracle Fusion Middleware plug-in
• Oracle Virtualization plug-in
• Oracle ZFS Storage Appliance plug-in
• Exalytics In-Memory Machine
• Oracle Fusion Middleware plug-in
OEM 12c Architecture

16. • OEM 12c Architecture
• Oracle OMS, Repository and Agents
• OEM 12c plug-ins
• Plug-ins for Exadata, Exalogic and Exalytics
• Engineered Systems Architecture
• Exadata DB Machine
• Exalogic Elastic Cloud
• Exalytics In-Memory Machine
• Enabling Monitoring
• Install, discover and configure components
• Customize monitoring and automate tasks
• Tools
• Repvfy and Exachk
Agenda

17. • Exadata DB Machine
Engineered Systems Architecture
Exadata Components
Compute
Nodes
Infiniband
Switches
Storage
Cells
ILOMs
CISCO
Switch
PDUs

18. Engineered Systems Architecture

19. Engineered Systems Architecture
• Exalogic Elastic Cloud Hardware
Compute
Nodes
Infiniband
Switches
ILOMs CISCO
Switch
PDU
Exalogic Components

20. Engineered Systems Architecture

21. Engineered Systems Architecture
• Exalogic Elastic Cloud Software

22. Engineered Systems Architecture
• Exalogic Elastic Cloud Software

23. Engineered Systems Architecture
• Exalytics In-Memory Machine
Compute
Nodes
Exalytics

24. Engineered Systems Architecture

25. • OEM 12c Architecture
• Oracle OMS, Repository and Agents
• OEM 12c plug-ins
• Plug-ins for Exadata, Exalogic and Exalytics
• Engineered Systems Architecture
• Exadata DB Machine
• Exalogic Elastic Cloud
• Exalytics In-Memory Machine
• Enabling Monitoring
• Install, discover and configure components
• Customize monitoring and automate tasks
• Tools
• Repvfy and Exachk
Agenda

26. • Exadata DB Machine
Install OEM 12c Agent
Discover Oracle Exadata Database Machine
Discovery Agent
Infiniband Discovery
Prerequisite Check
Components discovery
Monitoring Agents
Monitoring Credential
SNMP Subscription
Review
Discover Cluster and HAS
Discover ASM, DB and Listener
Enabling Monitoring

27. • Exadata DB Machine
• Prerequisite steps before discovering Exadata
DB machine within Oracle Enterprise Manager
12c (Doc ID 1437434.1)
1. Create a Database Server ILOM Service Processor User
(nm2user)
2. Verify permissions. The account running the OEM agent
should have read/execute on $ORACLE_HOME/bin/kfod
binaries
3. Verify the versions. Exadatas before 2011 should have
unsupported versions of the schematic files
4. Verify the values of <ADMINNAME> and <ADMINIP> for
components
5. Others
Enabling Monitoring

28. • Install OEM 12c Agent on compute nodes
Enabling Monitoring

29. • Discover Oracle Exadata DB Machine
Enabling Monitoring

30. • Discover Oracle Exadata DB Machine
Enabling Monitoring

31. • Discover Oracle Exadata DB Machine
Enabling Monitoring

32. • Discover Oracle Exadata DB Machine
• nm2user required (SSH)
Enabling Monitoring

33. • Discover Oracle Exadata DB Machine
• $ORACLE_HOME/perl/bin/perl exadataDiscoveryPreCheck.pl
Enabling Monitoring

34. • Discover Oracle Exadata DB Machine
• Prerequisite script for Exadata Discovery in Oracle
Enterprise Manager Cloud Control 12c (Doc ID 1473912.1)
Usage:
$ORACLE_HOME/perl/bin/perl
exadataDiscoveryPreCheck.pl [-dhq] [-aid
dir] [-cePass password] [-coPass password]
[-em file] [-i file]
[-ibPass password] [-log file] [-oh dir]
[-ot file] [-sch file]
Enabling Monitoring

35. • Discover Oracle Exadata DB Machine
Enabling Monitoring

36. • Discover Oracle Exadata DB Machine
Enabling Monitoring

37. • Discover Oracle Exadata DB Machine
Enabling Monitoring

38. • Discover Oracle Exadata DB Machine
Enabling Monitoring

39. Enabling Monitoring

40. • Exalogic Elastic Cloud (Virtual)
Install OEM 12c Agent
Prerequisites
Import Ops Center Certificate into Agent’s Keystore
Import OVM Manager Certificate into the Agent
Set OVMM to Read-Only mode
Discover Oracle VM Manager
Discover Oracle ZFS Storage Appliances
Discover the Exalogic Elastic Cloud Target
Enabling Monitoring

41. • Install OEM 12c Agent on compute nodes
Enabling Monitoring

42. • Exalogic Elastic Cloud (Virtual)
Import Ops Center Certificate into Agent’s Keystore
Login as root to the EMOC host
Change directory to
[root@localhost~]# cd $OPS_CENTER_HOME/oem-
ec/security/jsse
Export the Certificate
[root@localhost jsse]# $JAVA_HOME/jre/bin/keytool -
export -alias cacao_agent -file oc.crt -keystore
truststore -storepass trustpass
Import the Certificate into Agent’s Keystore
$JAVA_HOME/jre/bin/keytool -import -keystore
$AGENT_HOME/agent_inst/sysman/config/montrust/AgentTr
ust.jks -alias <alias_name> -file
<path_to_oc_certificate_file>/oc.crt
Bounce the Agent
Enabling Monitoring

43. • Exalogic Elastic Cloud (Virtual)
Import the OVMM Certificate into the Agent
As root on the OVMM host
cd /u01/app/oracle/ovm-manager-3/
/opt/oracle/em12c/agent/core/12.1.0.3.0/jdk/bin/keyto
ol -keystore ./ovmmCoreTcps.ks -exportcert -alias
ovmm -file ovmm.cr
Password: <Enter>
As the OEM Agent user on the OVMM host
$AGENT_HOME/bin/emctl secure add_trust_cert_to_jks -
trust_certs_loc <Location of the Oracle VM Manager
Certificate> -alias ovmm
Password: <Enter>
Bounce the OEM Agent
Enabling Monitoring

44. • Exalogic Elastic Cloud (Virtual)
• How To Configure Oracle Virtual Machine Manager (OVMM) for read-only access by
Enterprise Manager Cloud Control (Doc ID 1533415.1)
Set OVMM to Read-Only mode
Login into the VM that hosts the OVMM as oracle
Perform the below sequence
cd /u01/app/oracle/ovm-manager-3/ovm_shell
sh ovm_shell.sh --url=tcp://localhost:54321
--username=admin
--password=<ovmm admin user pwd>
ovm = OvmClient.getOvmManager ()
f = ovm.getFoundryContext ()
j = ovm.createJob ( 'Setting EXALOGIC_ID' );
j.begin ();
f.setAsset ( "EXALOGIC_ID", "<Exalogic ID for the
Rack>");
j.commit ();
Enabling Monitoring

45. • Exalogic Elastic Cloud (Virtual)
• How To Configure Oracle Virtual Machine Manager (OVMM) for read-only access by
Enterprise Manager Cloud Control (Doc ID 1533415.1)
Set OVMM to Read-Only mode
Enabling Monitoring

46. • Exalogic Elastic Cloud (Virtual)
Discover Oracle VM Manager
Enabling Monitoring

47. • Exalogic Elastic Cloud (Virtual)
Discover Oracle VM Manager
Go to Enterprise -> Cloud -> Oracle VM Infrastructure Home
Select Register OVM Manager
Enabling Monitoring

48. • Exalogic Elastic Cloud (Virtual)
Discover Oracle VM Manager
Enabling Monitoring

49. • Exalogic Elastic Cloud (Virtual)
Discover ZFS Storage Appliance
Enabling Monitoring

50. • Exalogic Elastic Cloud (Virtual)
Discover ZFS Storage Appliance
Enabling Monitoring

51. • Exalogic Elastic Cloud (Virtual)
Discover ZFS Storage Appliance
Go to Setup -> Add Target -> Add Targets Manually
Select Add Targets Declaratively and choose ZFS Storage
Appliance
Enabling Monitoring

52. • Exalogic Elastic Cloud (Virtual)
Discover ZFS Storage Appliance
Enabling Monitoring

53. • Exalogic Elastic Cloud (Virtual)
Discover Exalogic Elastic Cloud
Enabling Monitoring

54. • Exalogic Elastic Cloud (Virtual)
Discover Exalogic Elastic Cloud
Enabling Monitoring

55. Enabling Monitoring

56. • Exalytics In-Memory Machine
Deploy OEM 12c Agent
Discover the Exalytics System Target
Go to Targets -> Systems
Enabling Monitoring

57. • Exalytics In-Memory Machine
Discover the Exalytics System Target
Add the Exalytics System
Enabling Monitoring

58. • Exalytics In-Memory Machine
Discover the Exalytics System Target
Enabling Monitoring

59. Enabling Monitoring

60. • Exadata Resource Utilization
Enabling Monitoring

61. • Exalogic Performance Summary
Enabling Monitoring

62. • Exalytics Performance Summary
Enabling Monitoring

63. • OEM 12c Architecture
• Oracle OMS, Repository and Agents
• OEM 12c plug-ins
• Plug-ins for Exadata, Exalogic and Exalytics
• Engineered Systems Architecture
• Exadata DB Machine
• Exalogic Elastic Cloud
• Exalytics In-Memory Machine
• Enabling Monitoring
• Install, discover and configure components
• Customize monitoring and automate tasks
• Tools
• Repvfy and Exachk
Agenda

64. • Repvfy
verifyEXADATA
======================================================================
6002. Exadata components without a backup Agent
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
= Action:
= - Re-run the discovery of the Database Machine and select a primary and
= a backup Agent for each discovered Database Machine component
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
6005. Check for DB_BLOCK_CHECKSUM
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
= Action:
= - Set the database initialization parameter "DB_BLOCK_CHECKSUM" to "TYPICAL"
= [default] or "FULL", in a test system and evaluate the performance impact.
= If there is no adverse performance impact, set the parameter for both
= primary and standby databases.
= - For more info, see the Exadata Best Practices
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
Oracle Exadata Best Practices (Doc ID 757552.1)
Tools

65. • Repvfy
6006. Check for DB_LOST_WRITE_PROTECT
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
= Action:
= - Set the database initialization parameter "DB_LOST_WRITE_PROTECT" to
= "TYPICAL" on all reported databases
= - For more info, see the Exadata Best Practices
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
6009. Check for consistent redolog file sizes
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
= Action:
= - Add files to the redolog file groups on all reported databases of the
= same size
= - For more info, see the Exadata Best Practices
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
8998. Broken targets
=--------- ---------- ---------- ---------- ---------- ---------- ---------=
= Action:
= - Either the monitoring configuration of the target is wrong or incomplete
= To verify and update the configuration go to the Monitoring Configuration
= page of the target in the Console
= - Or the Agent is unable to obtain the runtime parameters (dynamic- and
= category properties) of the target
Tools

66. • Exachk
• Download and deploy the plug-in to the OMS
• Add the Healthcheck target manually
Tools

67. • Exachk
• Configure Healthcheck
Tools

68. • Exachk
• Configure exachk
• Environment variables
export RAT_COPY_EM_XML_FILES=1
export RAT_OUTPUT=[exachk output directory]
• Start exachk daemon
./exachk -d start.
• Run exachk tool
./exachk -daemon –a
Oracle Exadata Database Machine exachk or
HealthCheck (Doc ID 1070954.1)
Exachk Health-Check Tool for Exalogic (Doc ID
1449226.1)
Tools

69. • Exachk
Tools

70. • Exadata
• Enterprise Manager 12c Support For ORACLE EXADATA DATABASE
MACHINE X5-2 (Doc ID 1967701.1)
• Patch Requirements for Setting up Monitoring and Administration for
Exadata (Doc ID 1323298.1)
• Exadata Storage software versions supported by the Oracle Enterprise
Manager Exadata plug-in (Doc ID 1626579.1)
• Release Schedule for Enterprise Manager Cloud Control Plug-ins (Doc ID
1486995.1)
• Troubleshooting Exadata Database Machine Discovery in 12c Cloud
Control (Doc ID 1448388.1)
• Script to Collect Exadata Cell Performance Information (cellperfdiag.sql)
(Doc ID 2038493.1)
• Steps to shut down or reboot an Exadata storage cell without affecting
ASM (Doc ID 1188080.1)
Troubleshoot Issues

71. • Exalogic
• Exalogic Virtual : False-Positive Oracle Enterprise Manager (OEM or EM)
Alerts claiming that ILOM Storage Nodes are down (irrespective of the
Nodes being continuously up) (Doc ID 2039612.1)
• After Rediscovery Of An Exalogic Rack In EM 12c Cloud Control, All
Compute And Storage Node ILOM Targets Are Shown In "Diagnose for
Status Pending" (Doc ID 2034489.1)
• Exalogic vServers Not Discovered In Enterprise Manager Cloud Control
12c After Applying April 2015 PSU (Doc ID 2041461.1)
• Oracle Exalogic Elastic Cloud Known Issues - Virtualization Release (Doc
ID 1512139.1)
• How To Monitor Exalogic Virtual Environments through Enterprise
Manager Cloud Control (EMCC) (Doc ID 1910452.1)
• How To Configure Oracle Virtual Machine Manager (OVMM) for read-only
access by Enterprise Manager Cloud Control (Doc ID 1533415.1)
Troubleshoot Issues

72. • Exalytics
• Enterprise Manager (EM) 12c Agent On Exalytics Fails With Error: "No
Exalytics Property File Found. Please choose a Agent which is on a
Exalytics Machine Host." (Doc ID 1606987.1)
• Starting EM12c R2 Agent On Oracle Exalytics Fails With Errors: "Init
Operation Failed...agent.SecureAgentCmd main.214 - Failed to secure the
Agent..." (Doc ID 1555939.1)
• Adding Exalytics Oracle BI Suite Target In EM12c Fails With Error
"Presentation Server not found" (Doc ID 1547268.1)
Troubleshoot Issues

73. Thank You!