OPPD upgraded their PeopleSoft Financials, HCM, and Portal applications from various older versions to PeopleTools version 8.51.12. Change Assistant was used to perform the upgrades. There were several challenges encountered including performance issues, integration issues between the applications, and "kick out" issues that took some time to resolve with Oracle support. New functionality in 8.51.12 included type ahead searching, improved navigation menus, and embedded help on grids.
4. OPPD Tools Upgraded - Current
• Server Operating System
– HP-UX B.11.31 U ia64 (Itanium Server)
• One Server for ALL of test regions
(HCM, Financials, Portal)
• One Server for Production HCM and Portal
• One Server for Production Financials
5. OPPD Tools Upgraded – Current
• RDBMS
– Oracle 11.2.0.2
• Web Server
– WebLogic 10.3.3
• Application Server
– Tuxedo Version 10.3.0.0, 64-bit, Patch Level 072
• Verity (Search tool)
– 6.5.1.1
6. OPPD Tools Upgraded – Current
• Browser
– Internet Explorer 8
• 8.51.12 Also supported by
–Firefox 3.6
–Safari 4
• Not supported anymore
–Firefox 3.5
• COBOL – had to upgrade with new tools
– Server Express 5.1
7. Peopletools Timeline
Production Test Production
Tools Release 11/13/2010 8/1/2011 8/24/2011 9/9/2011 9/26/2011 11/3/2011 11/19/2011
8.49.18 FIN
8.50.08 PORTAL/HCM HCM
8.51.08 PORTAL PORTAL/HCM/FIN
8.51.12 PORTAL/HCM PORTAL/HCM/FIN
POC PORTAL/HCM/FIN
8.51.12 +POC PORTAL/HCM/FIN
8. OPPD Tools Upgraded - Prep
• Run SYSAUDIT and DDDAUDIT from current production –
– clean up any issues prior to running upgrade or at least capture scripts.
• Additional CONVERSION database region needed
– Ran multiple tests for timings.
• Need dedicated laptop/computer that will not have to share
resources.
– DO NOT PUT ON SHARED SERVER!!!
• Installed Change Assistant on 3 dedicated laptops, one each for
HCM, Portal, and Financials.
9. OPPD Tools Upgraded - Prep
• Upgraded database to Oracle 11g
– Oracle Client on upgrade laptops needed upgraded with new client to
build timestamp conversion scripts.
• Set up Configuration Manager for each region
(Portal, HCM, Financials) on each laptop
• Output and Staging directories wrote to a single directory
with each MTP (move to production) test, i.e.
10. Change Assistant
• Used Change Assistant (CA) to do the upgrade
– Little to no hiccups with CA
– HCM did small upgrade from 8.50.08 to 8.51.12
– Financials was VERY SIGNIFICANT upgrade, 8.49.18
to 8.51.12 (skipping 8.50)
• Portal
– Used delivered “PeopleTools Only Upgrade” template
• HCM and Financials
– Used modified versions of the “PeopleTools Only
Upgrade” template.
12. CA – HCM Customizations to Template
• Created automatic steps
– SQL scripts (Every Test Region)
• Run SYSAUDIT and DDAUDIT cleanup scripts against conversion
region
– DOS commands
• Clear PS Cache from windows
del c:pscache /Q /S
• Copy SQL scripts from BATCH folder to MTP folder for each Test
run
13. CA – HCM Customizations to Template
• Created automatic steps
– SQL script
• Truncate the SJT tables inside HCM.
• During HCM 9.1 upgrade our “Create Views” step was
taking 14 hrs to complete
• Until we truncated these tables and then ran Stats,
• Now it runs all HCM views in 46 minutes
14. CA – HCM Customizations to Template
• Created automatic step
– Changed DMS script to SQL
• Clean up the Pagelet Wizard tables and IB Message
Queue.
• They had manual step to stop and launch old release
data mover and run 2 DMS scripts
• We took the SQL from those DMS scripts and put them
into automatic step to run inside CA
15. CA – HCM Customizations to Template
• Due to new tools upgrade, the Report Nodes
for process scheduler were removed each
time you converted a region.
• Set it up once in our Conversion region for all our
Report Nodes
• Ran DMS script to capture it
• Used CA to run the import DMS and migrate the
changes to each of the regions
16. CA – HCM Customizations to Template
Export DMS Script:
-- Copy report distribution nodes from 8.51.12 region
forward
-- oppd jeh 9/7/2011
SET LOG F:SQROPPD_CDMDISTNODE.LOG;
SET OUTPUT F:JODIEOPPD_CDMDISTNODE.DAT;
--IMPORT after setup of report nodes in HR91CONV region
first time
EXPORT PS_CDM_DIST_NODE;
17. CA – HCM Customizations to Template
Import DMS Script:
-- Copy report distribution nodes from 8.51.12 region forward
-- oppd jeh 9/7/2011
SET LOG
C:upgradeMTPoutputPeopleTools_Only_Upgrade_HR91DE
V-TOOLS_MoveToProductionoppd_imp_cdmdistnode.log;
SET INPUT OPPD_CDMDISTNODE.DAT;
--IMPORT after setup of report nodes in HR91CONV region first
time
DELETE FROM PS_CDM_DIST_NODE;
IMPORT PS_CDM_DIST_NODE;
18. CA – HCM Customizations to Template
• Created automatic step
– Copy certain projects from a file into the
converted region.
• Tools overlaid some projects we had for a few
customizations
– Tried to manually create a step to do “Copy
Project”… it kept failing during the test run.
• Opened the xml from the template and compared their
delivered “Copy Project” xml with the one we created
and they were NOT identical
19.
20. CA – HCM Customizations to Template
• Copy Project definitions worked AFTER:
– Copied their “Copy Project Step” and renamed the
step thru change assistant.
– Made some small changes in XML.
– Make sure the Script/Procedure has the word
• “copyProjectName” as one word
21. Financials Template for Upgrade
• Financials – Larger upgrade going from
8.49.18 to 8.51.12
– Template very intense due to skip 8.50
24. Financials Customizations to Template
• Same as HCM
• Automated existing manual step to purge the
message queues
• Created automatic step to run statistics
• Note: Once the production run of the
Financials CA Template was started we didn’t
need to touch it until we had to boot the
servers
25. Portal Pack
• Prior to this upgrade Financials was not integrated with Portal
• Modify security roles in Financials
– HCM and Financials had roles named the same
– This would cause a problem when migrated to Portal
– Renamed same named roles to OPPF with an Update
statement
• Created a portal pack in Financials and migrated it to Portal
– Portal Registry Definitions, Roles, and Permission Lists
• Security inserts/updates in Portal
– Inserted into PSROLEUSER
– Reset the portal node name to ERP from LOCAL_NODE in
Portal
26. Security Audit
• Determined delivered changes
– Weblibs
– Pages
• Existing
– Are still valid?
– Are still working?
27. Integration Broker
• PSFT_HR node was corrupt – had to rebuild it
• secureFileKeystore – Integration between
Financials and third party apps did not work
• Batch jobs
• PS_AMM_FILTER
• Due to skipping 8.50 a POC was required for IB
missing application package
28. Automated Testing
• Regression Testing
– Functional Test Scripts executed in Quick Test Pro
• Core business processes reviewed/validated
– Payroll, HR NewHire/Job Change, T&L TimeSheet/Reports
• Performance Testing
– Scripting with LoadRunner did not work in Portal
– Found Portal/Pia inconsitencies with ICSID and
validated with the POC prior to upgrade to 8.51.12
29. Automated Documentation
Technical Specifications
• Overview
– Business requirements
– Benefits
– Risk
• Summary
– All objects required for customization
– Object description
– Object type
30. Technical Specifications Continued
• Details
– Long description
– Details needed to rebuild
• XML based
– PL/SQL generates
– Project save to file for PeopleCode
– Stylesheet renders in browser
– Copy and Paste to Word
34. Challenges – PT Install
– When installing PeopleTools on UNIX, had
to start with empty folder
– Could not do project compare due to
missing release label between HCM and
Portal
• This updates a physical table from app designer
35. Challenges - Performance
• We upgraded Oracle from 11.1 to 11.2
– Had Performance hits again like we had going into
9.1
– Removed /*+Rule*/ hints in our Reports and
Views
– Restored all but 8 Function-based indexes that
were removed in HCM 9.1 upgrade
36. Challenges – Kick Outs
• Portal 9.1
• Upgraded Tools from 8.50.08 to 8.51.08 (Spring 2011)
– Due to branding issue Portal bundle 1-4 required
• HCM was still on 8.50.08
– 8/1/2011 Kick Out issue began in production for both internal and
external users
• Kick outs started, roughly 115 – 200 times a day
– Oracle said “it is fixed in 8.51.05”…
– We quickly upgraded HCM PeopleTools to match Portal, at
8.51.08 which is > 8.51.05…
– Still broke….
37. Challenges –Kick Outs
– ITToolbox clients said, “we fixed it with
8.51.12, been live for 3 weeks, no problems”
– Stopped testing of 8.51.08 and upgraded to
8.51.12 on all Applications
• Set back for Financials that had been thru testing on
8.51.08, they were ready to go.
– Performance Testing proved otherwise, still
broken with 8.51.12… kick outs still existed!!!
38. Challenges – Kick Outs
– Now stuck in TEST waiting for Oracle solution
– Oracle finally was able to duplicate and released
Proof of Concept (POC ) for 8.51.12.
• Identified as session id (ICSID) issue between regions
– POC contained small project and changes to
classes directory
– Oracle added the POC fix to 8.51.13
– Waited from 9/9 until 11/3 for Oracle to replicate
and provide solution
39. Challenges
• Attachments – Was not able to use the attachment
functionality after upgrading
– JAR files
– Modified psconfig.sh to include the following line:
PS_FILEDIR=/tmp/PSFTP;export PS_FILEDIR
40. Challenges
• 11.2 version of Oracle Client on the Upgrade
Laptop
– Due to upgrade from 10g to 11g
• Security between Portal, HCM, and Financials
• nVision – Minimum 10.1 SQLPlus needed
41. New Functionality
• Type ahead feature
– Type window appears showing prompt values
while you are typing
42. New Functionality
To Disable type ahead
From “Home” page, all the
way to the bottom….
Click “My Personalizations”
Click “Personalize Navigation Personalizations”
46. Nice to know feature
• Any Date field can default to “Today’s Date” by
entering “t” into the date field:
47. Q&A?
Thank you for attending.
Email:
jehahn@oppd.com
mclove@oppd.com
ladawes@oppd.com
Editor's Notes
Poll Audience to find out how many use Portal PacksPortal is a front end that gives you access to the PeopleSoft ApplicationsUsers logged in through portal and then had to click on the PeopleSoft Menu and then PS Financials Link which took them into FinancialsNow they access their GL, PC, etc. menus directly from the Portal page.Once Portal pack was created and cleaned in Financials it was migrated to PortalRoles can only migrate across the same tools versionsSecurity –To give them access to these new components in Portal the security in financials had to be duplicated in Portal.Financials and HR had roles named the same but with different content (PL’s) in them. I discovered that there were 4 roles that had the same names. We renamed them with an OPPF prefix instead of an OPP prefix. This was all done in Financials prior to the Portal pack being created so the new roles migrated to Portal.Did an insert into PSROLEUSER to tie the user with the role and thenReset the portal node name to ERP from LOCAL_NODE in Portal so when clicked on it took the user to Financials.
update PSIBRTNGDEFN, PSRTNGDFNPARM to reset the sendernodename and receivernodenameApp Package missing prevented IB sending from financialssecurFileKeystoreFix for IB between Financials and Asset Suite – 8.50 tools and upGo to the Gateway Properties file and find the secureFileKeystorePasswd.Copy it into the password encryption file below the properties file.Press encrypt.Copy the new encrypted password and replace the “password” with the new encrypted password.Press OK.batch jobs did not work initially after go live. We had some issues during test but had the profile for our production ID modified. Rebuilding the process scheduler fixed our issue after several hours of troubleshooting.PS_AMM_FILTER – We received an error when trying to access the Asynchronous Services page unless this table was truncated. Fix was found on Oracle Support.
43 indexes to nine…
Reason for ICSID Kickouts: Kept losing the PSSESSIONID, so when ICSID was trying to validate, it couldn’t so it kicked users out of system.At login you are assigned what is called PSJSESSIONID –specifically PORTAL-PSJSESSIONID—example: 1327228690 , then to maintain ‘active secured pages’ each page request passes ICStateNum and ICSID generated from the server to the client.
We were missing new environment variables on the server.JAR files were missing for HCM.