Weekend Upgrade EBS 11i to R12 - Real World Tips to Reduce Upgrade Downtime

1. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.1
Weekend Upgrade EBS 11i to R12
- Real World Tips to Reduce
Upgrade Downtime
Biju Thomas 13-May-14

2. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.2
Weekend Upgrade
EBS 11i to R12 -
Real World Tips to Reduce
Upgrade Downtime

3. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.3
Speaker
• Oracle ACE
• Principal Solutions Architect with
OneNeck® IT Solutions
• More than 20 years of Oracle database
administration experience and over 7 years
of E-Business Suite experience
• Author of Oracle12c OCA, Oracle11g OCA,
co-author of Oracle10g, 9i, 8i certification
books published by Sybex/Wiley.
• Presentations, Articles, Blog, Tweet

4. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.4
Session Objectives
• R12.1.3 Upgrade Overview
• Case Study Environment
• Upgrade Timing and Tuning
• Upgrade Version Choice (12.2 or 12.1)
• Reference Documents

5. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.5
R12.1.3 UPGRADE OVERVIEW

6. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.6
Upgrading to 12.1.3
Pre-Tasks
• Pre-Tasks – Recommended and Required
Steps, prior to R12 Upgrade
– Upgrade database to 11gR2 – latest patch set
and PSU (11.2.0.4)
– Configure EBS instance to use Oracle
Applications Tablespace Model (OATM)
– Apply pre-requisite EBS patches, such as 11i
sustaining support patches and ATG Rollup
Patch 6 or higher.

7. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.7
Getting Ready for Upgrade
• Reference
– Oracle® E-Business Suite Upgrade Guide
Release 11i to 12.1.1 Part No. E16342-04
• TUMS Patch and Report
– Lists tasks that you can omit from the upgrade
because they do not apply to your system
• Functional Steps to prepare for upgrade
– CRM, Financials, Procurement, Projects,
SCM, etc.

8. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.8
Base Release Upgrade
(12.1.1)
• Lay down file system [Rapid Install]
• AD Upgrade Driver for 12.1.1 (patch
7461070)
• American English unified driver
(u6678700.drv)
• Apply product patches

9. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.9
Upgrade to Latest Release
(12.1.3)
• Reference
– Oracle E-Business Suite Release 12.1.3 Readme
(Doc ID 1080973.1)
• Upgrade to 12.1.3
– Use AutoPatch to apply R12.AD.B.DELTA.3 Patch 9239089
– Use AutoPatch to apply Oracle E-Business Suite Release 12.1.3 Patch 9239090
– Use AutoPatch to apply the latest consolidated online help Patch 9239095
• Post 12.1.3 patches
– RPC1 : Released 29-Mar-14 (Oracle E-Business Suite Release
12.1.3+ Recommended Patch Collection 1 (RPC1) (Doc ID 1638535.1)
• Combines recommended post-12.1.3 patches into a single,
integrated and regression-tested patch to ensure successful
installation
– Product specific patches
• Post-install Applications Technology patches

10. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.10
Post Upgrade Setup &
Validation
• Customization/CEMLI setup
• Functional Setup, Changes, Configuration
• Third party tools configuration
• IT validation
• User validation

11. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.11
CASE STUDY ENVIRONMENT

12. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.12
Upgraded Environment
Properties 11i Instance R12 Instance
ASM/ Database
version
Oracle 11gR2 11.2.0.3 Oracle11gR2 11.2.0.3
Instance Type Single instance – Non-RAC, on
Solaris Cluster
Two Node – RAC on Solaris HA
Cluster
EBS OS Version RedHat Linux 4 – 32 bit Oracle Linux OEL 6.3 – 64 Bit
EBS version 11.5.10.2 12.1.3
EBS Nodes 1 x Admin + Concurrent Manager
2 x Web/Forms (Load Balanced)
External – iSupplier
Discoverer
1 x Admin + Concurrent Manager
1 x Concurrent Manager (PCP)
2 x Web/Forms (Load Balanced)
External – iSupplier
Discoverer
EBS Server type Physical Virtual node on VMWare using
OEL.
Discoverer Dedicated Physical Dedicated discoverer node – Virtual

13. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.13
Database Migration to
New Hardware
• Standby database created
on new h/w before
upgrade
• Instance required new
name for R12
• During upgrade window,
standby broken and
database renamed to
FCO (15 mins)
• After R12 upgrade
database started in RAC
mode as FCO1 and FCO2
instances (10 mins)
M9000 M5000 M5000
RAC
STANDBY
DATABASE
P11i P11i
M9000 M5000 M5000
RAC
P11i FCO
M9000 M5000 M5000
RAC
P11i FCO1 FCO2

14. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.14
UPGRADE TIMING AND TUNING

15. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.15
Upgrade Tuning Major Phases
R12.1.3 Partially Tuned Upgrade
11i Preparation
(3.5 hrs)
R12.1.1 Upgrade
(22 hrs)
R12.1.3 Upgrade
(8 hrs)
Post Upgrade
Steps
(10 hrs)
Functional Setup
& IT Testing
(8 hrs)
R12.1.3 Final Tuned Upgrade
11i Preparation
(1.5 hrs)
R12.1.1
Upgrade
(7 hrs)
R12.1.3
Upgrade
(4 hrs)
Post Upgrade
Steps
(6 hrs)
Functional
Setup & IT
Testing
(6 hrs)
Total 51.5
Total 24.5

16. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.16
Upgrade Tuning 12.1.3 –
Biggest Gains
• Storage change from EMC Clarion to VMAX with
SSD.
• More CPU and Memory on DB node to support
multiple workers (48). More memory on CM/Admin
node.
• Review timing report
– APPL_TOP/admin/<SID>/out directory – file
adt<session_id>.lst
– Tune long running jobs by identifying the SQL. Most
likely a MOS note available with fix.
– Skip jobs that are running against unused modules
(after confirming with Oracle Support)
• “exit 0”

17. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.17

18. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.18
Upgrade Tuning 12.1.3 –
Biggest Gains - 2
• Skip install/setup by using Save and Restore.
– Rapid Install 12.1.1 file system (patched).
– Tech stack Oracle home with latest patches.
– CEMLI directories
– Configuration files
• Context Files
• spfile, tnsnames.ora, listener.ora files
– Key profiles, PCP configuration, MRP setup
– Discoverer Noetix EU Schema
• Entropy waits problem - Setup “rngd” daemon on
application nodes
– Java processes waiting on CPU
– Trace shows “[pid 3238] <... futex resumed> ) = -1
ETIMEDOUT (Connection timed out)”

19. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.19
Upgrade Tuning 12.1.3 –
More… 1
• Upgrade with only one RAC node.
– Setup cluster and RAC instances
– Start only one instance as non-RAC database for
upgrade
– Start DB as RAC after 12.1.3 upgrade.
• No flashback, no archivelog mode
• Tune database parameters – parallelism,
multi-block reads, SGA, etc
• Continuous Compile of invalid objects “utlrp”
single thread

20. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.20
Upgrade Tuning 12.1.3
More… 2
• Distributed patching for 12.1.3
• Parallel AutoConfig
• Tune max# workers
• Import Statistics after upgrade
• Automate by scripting, including skipping known failed workers
– update applsys.fnd_install_processes set status='C' where filename in ('cstdacr.sql',
'wshup124.sql', 'MSDODPCODE.sql', 'EGOSILDU.sql','jaiitemtemplcr.sql', 'JAIRCVDFF.sql',
'FndXdfCmp.class') and status='F';
• Complete as much as tasks much earlier
– Upgrade database to 11gR2, PSU, Required patches, OATM, etc
– Multi-Org, Data cleanup
• Repeatable process
– Document all issues and resolution for each iteration
• Project Management
– Detailed tasks, estimated start and elapsed times

21. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.21
Tips from Oracle ATG
• Oracle E-Business Suite Reducing
Downtime Upgrading to 12.1/12.2
(Doc ID 1578187.1)
– 130+ slides – very comprehensive
– Pay attention to pre-upgrade activities,
Configuration and Performance
sections.
• Purge & Archive… reduce database
size!

22. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.22
UPGRADE VERSION CHOICE

23. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.23
Ready for R12.2?
• Which Oracle E-Business Suite Release Should
You Target: 12.1 or 12.2? (Doc ID 1592197.1)
• Smaller EBS system
• Hard to find downtime window to apply patches
• Cannot afford two upgrades and testing – to 12.1 and
then 12.2
• 12.2 functional enhancements important for business

24. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.24
Ready for 12c?
• Supported by 11i (11.5.10.2) and 12.x
• Interoperability Notes EBS 12.0 or 12.1 with
RDBMS 12cR1 (Doc ID 1524398.1)
– Install the 12.1.0 software
– Install Oracle Database 12c Products from the 12c
Examples CD
– Create OH/nls/data/9idata directory
– Apply additional 12.1.0.1 RDBMS patches
– Upgrade the database instance
– Modify initialization parameters
– Perform patch post-install instructions
– Post upgrade tasks
– Implement and run AutoConfig

25. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.25
ORACLE REFERENCE DOCUMENTS

26. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.26
MOS References
• R12.1 / R12.2 : Oracle E-Business Suite Releases 12.1 and
12.2 Release Content (Doc ID 1302189.1)
• R11i / R12 : Database Documentation Resources for the E-
Business Suite (Doc ID 1072409.1)
• Oracle Applications Release 12 Upgrade Sizing and Best
Practices (Doc ID 399362.1)
• Database Preparation Guidelines for an E-Business Suite
Release 12.1 Upgrade (Doc ID 761570.1)
• Oracle E-Business Suite Reducing Downtime Upgrading to
12.1/12.2 (Doc ID 1578187.1)
• Oracle E-Business Suite Recommended Performance Patches
(Doc ID 244040.1)
• Patch Requirements for Sustaining Support for Oracle E-
Business Suite Release 11.5.10 (Doc ID 883202.1)

27. Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved.27
Thank you!
Thank you for your time…
Contact:
Tweets: @Biju_Thomas
Facebook: OracleNotes
Blog: www.bijoos.com/oraclenotes
Please Complete “Feedback” on Guidebook