SlideShare a Scribd company logo
1 of 42
Session ID:
Prepared by:
8 Advance Topics on Supporting
JDE
David Toal, Terillium
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Topics
• 100% CPU on JAS Servers
• Network Causing JDE to Crash
• Backup Strategy Crashing JD Edwards
• Database locking and blocking causing sporadic
performance issues?
• Largest Table in Database
• SQL Maintenance
• Index on a table improve performance?
• Add a second Web server to Production?
100% CPU on Jas Servers
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Symptoms
• WebServer CPU is running at or
near 100%
• Users are experiencing slow
and non responsive behavior.
• Some Users might not be able
to log on.
• Other instances on same server
are slow as well.
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Multiple Causes = Same Resolution
Cause
• User Pulls Large amount of
Data. (DataBrowser, App)
• Custom Code Heavy Data
Calculations in ER.
• Standard Code Issues –
P30200, P90CG501 , P4310,
P04015, P40215…. (21033380,
2174901, 19995782)
• Tools Release Bugs (18787865,
18921015, 19711614)
• WebLogic Bugs (13836819,
23094342, 16857433…)
Resolution
• Restart the JAS Server
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Under the Covers – Garbage Collection
CPU is running 100%
because Java Garbage
Collection Running Non-
Stop.
Garbage Collections Result
in “Stop the World” events.
http://www.oracle.com/webfolder/technetwork/tutorials/obe/java/gc01/index.html
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Under the Cover – Infinite Loops
CPU is running 100%
because of a code infinite
loop.
Infinite loops use as much
CPU as possible, but
typically do not get in the
way of other requests.
If Condition
True
Run Code
Check
Condition
Unchanged
Set
Condition
to true
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Troubleshooting
• Read the Log files
• Jas
• Weblogic
• Potentially Java logging
• Identify the Situation
• What are users doing?
• Investigate Known Bugs and issue
• Apps, Tools, Weblogic and Java
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolutions
• Fix Custom Code
• Apply ESU’s
• Apply Tools release
• Update/Patch Weblogic
• Update Java
Networking Causing JDE to
Crash
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Error Messages
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Physical Network
April 2-6, 2017 in Las Vegas, NV USA #C17LV
VMWare
https://pubs.vmware.com/vsphere-51/topic/com.vmware.vsphere.avail.doc/GUID-52F1BC6A-CC0D-4B1A-BDD7-5063B3AED1CE.html
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution - Recommendations
• Find the Metadata Kernel and verify that the disconnect
is in its logs. Kill it. A new one will be generated.
• Find the Security Server Kernel with the disconnects and
kill it.
• All JDE Servers should be on the same VLAN, Subnet,
Switch(es).
• Traffic between servers should never be routed
• If Network has issue, Test JDE do not assume it is OK.
• Simple, Network can’t go down.
Backup Crashing JDE
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Symptoms
• JDE is running on Virtual Hardware
• User’s can’t log into JDE first think in the morning
(especially Monday Morning), however not every
Monday.
• Log files look like a Network issue with lost connections.
• In Windows the Event Viewer looks clean except for a
Time Adjustment.
• Problem appears to happen at the end of the backups,
not the beginning or during
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Snapshot Backup Initialized
San
Server-1
C_Drive.File
D_Drive.File
Server-2
C_Drive.File
D_Drive.File
Server-3
C_Drive.File
D_Drive.File
Physical Server
Physical Server
Server-1
Server-2
Server-3
Back-
up
Delta
Network
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Snapshot Removed
San
Server-1
C_Drive.File
D_Drive.File
Server-2
C_Drive.File
D_Drive.File
Server-3
C_Drive.File
D_Drive.File
Physical Server
Physical Server
Server-1
Server-2
Server-3
Back-
up
Delta
Network
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Back to Normal Operations
San
Server-1
C_Drive.File
D_Drive.File
Server-2
C_Drive.File
D_Drive.File
Server-3
C_Drive.File
D_Drive.File
Physical Server
Physical Server
Server-1
Server-2
Server-3
Back-
up
Network
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution
• Only do Backups during slow to no activity times
• Restart JD Edwards after Backups
• Use Database Tools to do Database Backups
• WebServers/BSSV/AIS Rarely Change – Limit Backups
• Enterprise Servers – PrintQueue, Packages change
regularly
• Deployment Server does not stability of production.
Database Locking and Blocking
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Symptoms
• Endless Spinning Wheel
• Slow responses in some applications, but fine in others.
• Batch Job never finishing
• Batches getting backed up in queues
April 2-6, 2017 in Las Vegas, NV USA #C17LV
SQL Server – Activity Monitor
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Oracle Server
Script to Identify Blockers
• select * from dba_blockers
• will show the Oracle SID(s) of sessions blocking
You can then take that to v$session as in:
• select username, sid, serial#, program, machine, event,
seconds_in_wait from v$session where sid = NNN
• (NNN from first query)
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolutions
• All - Determine the Code the is causing the block and fix
it.
• All – Stop the offending process, Typically JDE call object
or Batch Job Kernel
• Oracle – Kill Session (alter system kill session ‘sid’,’serial’)
• SQL Server – Turn on RCSI and Snap Shot Isolation.
Which will allow dirty reads of the data
• SQL Server – Use NoLock Option in third party database
accsees
• Select * from PRODDTA.F0101 with (NOLOCK)
Largest Table in Database
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Finding the Largest Tables
SQL Server
SELECT
t.NAME AS TableName,
s.Name AS SchemaName,
p.rows AS RowCounts,
SUM(a.total_pages) * 8 AS TotalSpaceKB,
SUM(a.used_pages) * 8 AS UsedSpaceKB,
(SUM(a.total_pages) - SUM(a.used_pages)) * 8 AS UnusedSpaceKB
FROM
sys.tables t
INNER JOIN
sys.indexes i ON t.OBJECT_ID = i.object_id
INNER JOIN
sys.partitions p ON i.object_id = p.OBJECT_ID AND i.index_id =
p.index_id
INNER JOIN
sys.allocation_units a ON p.partition_id = a.container_id
LEFT OUTER JOIN
sys.schemas s ON t.schema_id = s.schema_id
WHERE
t.NAME NOT LIKE 'dt%'
AND t.is_ms_shipped = 0
AND i.OBJECT_ID > 255
GROUP BY
t.Name, s.Name, p.Rows
ORDER BY
SUM(a.used_pages) desc
From <http://stackoverflow.com/questions/7892334/get-size-of-all-
tables-in-database>
Oracle
select * from (
select owner, segment_name, bytes/1024/1024 Size_Mb from
dba_segments order by bytes/1024/1024 DESC )
where rownum <= 20
From <http://www.freelists.org/post/oracle-l/Finding-top-20-large-
objectstables-in-database,2>
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Example
TableName SchemaName RowCounts
TotalSpace
KB
UsedSpace
KB
UnusedSpace
KB
F42199 PRODDTA 282934259 751738536 751620376 118160
F0911 PRODDTA 79698847 379647592 377779440 1868152
F0902 PRODDTA 26811210 69369864 69361976 7888
F0901 PRODDTA 27226149 63510512 63491096 19416
F550902F PRODDTA 228711645 41898536 41892344 6192
F0618 PRODDTA 7087448 31130528 31053112 77416
F01131M PRODDTA 61101026 25117072 25113328 3744
F4111 PRODDTA 8179761 23409368 23390768 18600
F0411 PRODDTA 3953236 12748568 12639984 108584
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolutions
• Run you JDE Purge Programs (F42199, F986110,
F0101Z1, etc.)
• Implement Archiving Solutions like Essentio and
Archtools
• Scheduled SQL Scripts to clear outdated data.
SQL Maintenance
April 2-6, 2017 in Las Vegas, NV USA #C17LV
SQL Fragmentation
SELECT dbschemas.[name] as 'Schema',
dbtables.[name] as 'Table',
dbindexes.[name] as 'Index',
indexstats.avg_fragmentation_in_percent,
indexstats.page_count
FROM sys.dm_db_index_physical_stats (DB_ID(), NULL, NULL, NULL, NULL) AS indexstats
INNER JOIN sys.tables dbtables on dbtables.[object_id] = indexstats.[object_id]
INNER JOIN sys.schemas dbschemas on dbtables.[schema_id] = dbschemas.[schema_id]
INNER JOIN sys.indexes AS dbindexes ON dbindexes.[object_id] = indexstats.[object_id]
AND indexstats.index_id = dbindexes.index_id
WHERE indexstats.database_id = DB_ID()
ORDER BY indexstats.avg_fragmentation_in_percent desc
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Schema Table Index
avg_fragmentation_in_
percent page_count
SY920 F95631 NULL 99.9688958 51407
SVM920 F986110 NULL 99.83630952 53711
SY920 F95631 F95631_5 99.18525703 10310
SY920 F95631 F95631_4 99.00985317 20704
SVM920 F986110 F986110_4 98.67240761 22296
SY920 F98211 F98211_5 98.11715481 10516
OL920 F9861 F9861_PK 94.39737274 15225
SY920 F98211 F98211_PK 91.51252208 38492
SVM920 F986114 F986114_2 86.0855957 14697
SY920 F95630 NULL 76.28625873 37744
SY920 F98210 F98210_PK 73.26782145 24016
DD920 F00165 NULL 63.53686636 13860
SVM920 F986110 F986110_PK 55.73337359 13247
SVM920 F986114 F986114_PK 50.08852006 36150
SVM920 F986114A F986114A_PK 35.96706725 594302
DD920 F9210 F9210_PK 25.46419098 10556
SY920 F9563110 F9563110_PK 1.444407121 35724
SY920 F956311A F956311A_PK 0.539741028 77074
SVM920 F986110 NULL 0 574778
SY920 F95630 NULL 0 54295
SY920 F95631 NULL 0 710468
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Rebuild vs ReOganize
• Rebuild is always an offline
operation and has to finish in
order to fix indexing problems
• Reoganize can be done online
but only reorganizes may not
work well with highly
fragmented tables
avg_fragmentation_in_percent value Corrective statement
> 5% and < = 30% ALTER INDEX REORGANIZE
> 30% ALTER INDEX REBUILD WITH (ONLINE = ON)*
Indexes
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Index added to F03B11Z1, F0411Z1,
F0911Z1
“I just tested several batches and the run time improved
significantly on the large batches. Batch 600000000819
and 600000000831 went from over one hour+ to less than
5 minute”
- Happy Customer
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution
• Identify Indexes needed using Database Tools and
Developer expertise. (aka understand the code)
• Build the Index in JDE Edwards (you can do it at the
database level but you will loose it during an upgrade)
• Don’t over do it! Many time indexes will help but it is
possible to create an index that has a negative impact on
performance.
Add a Second Production Web
Server
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Symptoms
• Best Practices says 50-100 users per Jas instance.
• Need to be able to able to bring a webserver down but
not all of JDE.
• Want to leave the Webservers up for testing but keep
users out.
• Want to use a Alias URL eg. jde.company.net
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution
• Option 1 – Give different users different URL’s and
effectively load balance by picking who goes where
Web 1 Web 2
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution
• Option 2 – Use DNS Round Robin and have users hit
different servers.
Web 1 Web 2
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Resolution
• Option 3 – Use a Load Balancer
Web 1 Web 2
Load Balancer
April 2-6, 2017 in Las Vegas, NV USA #C17LV
Contact us: weknowjde@terillium.com
Questions?

More Related Content

Recently uploaded

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Recently uploaded (20)

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

8 Advanced JDE Support Topics (That Are Often Overlooked)

  • 1. Session ID: Prepared by: 8 Advance Topics on Supporting JDE David Toal, Terillium
  • 2. April 2-6, 2017 in Las Vegas, NV USA #C17LV Topics • 100% CPU on JAS Servers • Network Causing JDE to Crash • Backup Strategy Crashing JD Edwards • Database locking and blocking causing sporadic performance issues? • Largest Table in Database • SQL Maintenance • Index on a table improve performance? • Add a second Web server to Production?
  • 3. 100% CPU on Jas Servers
  • 4. April 2-6, 2017 in Las Vegas, NV USA #C17LV Symptoms • WebServer CPU is running at or near 100% • Users are experiencing slow and non responsive behavior. • Some Users might not be able to log on. • Other instances on same server are slow as well.
  • 5. April 2-6, 2017 in Las Vegas, NV USA #C17LV Multiple Causes = Same Resolution Cause • User Pulls Large amount of Data. (DataBrowser, App) • Custom Code Heavy Data Calculations in ER. • Standard Code Issues – P30200, P90CG501 , P4310, P04015, P40215…. (21033380, 2174901, 19995782) • Tools Release Bugs (18787865, 18921015, 19711614) • WebLogic Bugs (13836819, 23094342, 16857433…) Resolution • Restart the JAS Server
  • 6. April 2-6, 2017 in Las Vegas, NV USA #C17LV Under the Covers – Garbage Collection CPU is running 100% because Java Garbage Collection Running Non- Stop. Garbage Collections Result in “Stop the World” events. http://www.oracle.com/webfolder/technetwork/tutorials/obe/java/gc01/index.html
  • 7. April 2-6, 2017 in Las Vegas, NV USA #C17LV Under the Cover – Infinite Loops CPU is running 100% because of a code infinite loop. Infinite loops use as much CPU as possible, but typically do not get in the way of other requests. If Condition True Run Code Check Condition Unchanged Set Condition to true
  • 8. April 2-6, 2017 in Las Vegas, NV USA #C17LV Troubleshooting • Read the Log files • Jas • Weblogic • Potentially Java logging • Identify the Situation • What are users doing? • Investigate Known Bugs and issue • Apps, Tools, Weblogic and Java
  • 9. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolutions • Fix Custom Code • Apply ESU’s • Apply Tools release • Update/Patch Weblogic • Update Java
  • 11. April 2-6, 2017 in Las Vegas, NV USA #C17LV Error Messages
  • 12. April 2-6, 2017 in Las Vegas, NV USA #C17LV Physical Network
  • 13. April 2-6, 2017 in Las Vegas, NV USA #C17LV VMWare https://pubs.vmware.com/vsphere-51/topic/com.vmware.vsphere.avail.doc/GUID-52F1BC6A-CC0D-4B1A-BDD7-5063B3AED1CE.html
  • 14. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution - Recommendations • Find the Metadata Kernel and verify that the disconnect is in its logs. Kill it. A new one will be generated. • Find the Security Server Kernel with the disconnects and kill it. • All JDE Servers should be on the same VLAN, Subnet, Switch(es). • Traffic between servers should never be routed • If Network has issue, Test JDE do not assume it is OK. • Simple, Network can’t go down.
  • 16. April 2-6, 2017 in Las Vegas, NV USA #C17LV Symptoms • JDE is running on Virtual Hardware • User’s can’t log into JDE first think in the morning (especially Monday Morning), however not every Monday. • Log files look like a Network issue with lost connections. • In Windows the Event Viewer looks clean except for a Time Adjustment. • Problem appears to happen at the end of the backups, not the beginning or during
  • 17. April 2-6, 2017 in Las Vegas, NV USA #C17LV Snapshot Backup Initialized San Server-1 C_Drive.File D_Drive.File Server-2 C_Drive.File D_Drive.File Server-3 C_Drive.File D_Drive.File Physical Server Physical Server Server-1 Server-2 Server-3 Back- up Delta Network
  • 18. April 2-6, 2017 in Las Vegas, NV USA #C17LV Snapshot Removed San Server-1 C_Drive.File D_Drive.File Server-2 C_Drive.File D_Drive.File Server-3 C_Drive.File D_Drive.File Physical Server Physical Server Server-1 Server-2 Server-3 Back- up Delta Network
  • 19. April 2-6, 2017 in Las Vegas, NV USA #C17LV Back to Normal Operations San Server-1 C_Drive.File D_Drive.File Server-2 C_Drive.File D_Drive.File Server-3 C_Drive.File D_Drive.File Physical Server Physical Server Server-1 Server-2 Server-3 Back- up Network
  • 20. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution • Only do Backups during slow to no activity times • Restart JD Edwards after Backups • Use Database Tools to do Database Backups • WebServers/BSSV/AIS Rarely Change – Limit Backups • Enterprise Servers – PrintQueue, Packages change regularly • Deployment Server does not stability of production.
  • 22. April 2-6, 2017 in Las Vegas, NV USA #C17LV Symptoms • Endless Spinning Wheel • Slow responses in some applications, but fine in others. • Batch Job never finishing • Batches getting backed up in queues
  • 23. April 2-6, 2017 in Las Vegas, NV USA #C17LV SQL Server – Activity Monitor
  • 24. April 2-6, 2017 in Las Vegas, NV USA #C17LV Oracle Server Script to Identify Blockers • select * from dba_blockers • will show the Oracle SID(s) of sessions blocking You can then take that to v$session as in: • select username, sid, serial#, program, machine, event, seconds_in_wait from v$session where sid = NNN • (NNN from first query)
  • 25. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolutions • All - Determine the Code the is causing the block and fix it. • All – Stop the offending process, Typically JDE call object or Batch Job Kernel • Oracle – Kill Session (alter system kill session ‘sid’,’serial’) • SQL Server – Turn on RCSI and Snap Shot Isolation. Which will allow dirty reads of the data • SQL Server – Use NoLock Option in third party database accsees • Select * from PRODDTA.F0101 with (NOLOCK)
  • 26. Largest Table in Database
  • 27. April 2-6, 2017 in Las Vegas, NV USA #C17LV Finding the Largest Tables SQL Server SELECT t.NAME AS TableName, s.Name AS SchemaName, p.rows AS RowCounts, SUM(a.total_pages) * 8 AS TotalSpaceKB, SUM(a.used_pages) * 8 AS UsedSpaceKB, (SUM(a.total_pages) - SUM(a.used_pages)) * 8 AS UnusedSpaceKB FROM sys.tables t INNER JOIN sys.indexes i ON t.OBJECT_ID = i.object_id INNER JOIN sys.partitions p ON i.object_id = p.OBJECT_ID AND i.index_id = p.index_id INNER JOIN sys.allocation_units a ON p.partition_id = a.container_id LEFT OUTER JOIN sys.schemas s ON t.schema_id = s.schema_id WHERE t.NAME NOT LIKE 'dt%' AND t.is_ms_shipped = 0 AND i.OBJECT_ID > 255 GROUP BY t.Name, s.Name, p.Rows ORDER BY SUM(a.used_pages) desc From <http://stackoverflow.com/questions/7892334/get-size-of-all- tables-in-database> Oracle select * from ( select owner, segment_name, bytes/1024/1024 Size_Mb from dba_segments order by bytes/1024/1024 DESC ) where rownum <= 20 From <http://www.freelists.org/post/oracle-l/Finding-top-20-large- objectstables-in-database,2>
  • 28. April 2-6, 2017 in Las Vegas, NV USA #C17LV Example TableName SchemaName RowCounts TotalSpace KB UsedSpace KB UnusedSpace KB F42199 PRODDTA 282934259 751738536 751620376 118160 F0911 PRODDTA 79698847 379647592 377779440 1868152 F0902 PRODDTA 26811210 69369864 69361976 7888 F0901 PRODDTA 27226149 63510512 63491096 19416 F550902F PRODDTA 228711645 41898536 41892344 6192 F0618 PRODDTA 7087448 31130528 31053112 77416 F01131M PRODDTA 61101026 25117072 25113328 3744 F4111 PRODDTA 8179761 23409368 23390768 18600 F0411 PRODDTA 3953236 12748568 12639984 108584
  • 29. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolutions • Run you JDE Purge Programs (F42199, F986110, F0101Z1, etc.) • Implement Archiving Solutions like Essentio and Archtools • Scheduled SQL Scripts to clear outdated data.
  • 31. April 2-6, 2017 in Las Vegas, NV USA #C17LV SQL Fragmentation SELECT dbschemas.[name] as 'Schema', dbtables.[name] as 'Table', dbindexes.[name] as 'Index', indexstats.avg_fragmentation_in_percent, indexstats.page_count FROM sys.dm_db_index_physical_stats (DB_ID(), NULL, NULL, NULL, NULL) AS indexstats INNER JOIN sys.tables dbtables on dbtables.[object_id] = indexstats.[object_id] INNER JOIN sys.schemas dbschemas on dbtables.[schema_id] = dbschemas.[schema_id] INNER JOIN sys.indexes AS dbindexes ON dbindexes.[object_id] = indexstats.[object_id] AND indexstats.index_id = dbindexes.index_id WHERE indexstats.database_id = DB_ID() ORDER BY indexstats.avg_fragmentation_in_percent desc
  • 32. April 2-6, 2017 in Las Vegas, NV USA #C17LV Schema Table Index avg_fragmentation_in_ percent page_count SY920 F95631 NULL 99.9688958 51407 SVM920 F986110 NULL 99.83630952 53711 SY920 F95631 F95631_5 99.18525703 10310 SY920 F95631 F95631_4 99.00985317 20704 SVM920 F986110 F986110_4 98.67240761 22296 SY920 F98211 F98211_5 98.11715481 10516 OL920 F9861 F9861_PK 94.39737274 15225 SY920 F98211 F98211_PK 91.51252208 38492 SVM920 F986114 F986114_2 86.0855957 14697 SY920 F95630 NULL 76.28625873 37744 SY920 F98210 F98210_PK 73.26782145 24016 DD920 F00165 NULL 63.53686636 13860 SVM920 F986110 F986110_PK 55.73337359 13247 SVM920 F986114 F986114_PK 50.08852006 36150 SVM920 F986114A F986114A_PK 35.96706725 594302 DD920 F9210 F9210_PK 25.46419098 10556 SY920 F9563110 F9563110_PK 1.444407121 35724 SY920 F956311A F956311A_PK 0.539741028 77074 SVM920 F986110 NULL 0 574778 SY920 F95630 NULL 0 54295 SY920 F95631 NULL 0 710468
  • 33. April 2-6, 2017 in Las Vegas, NV USA #C17LV Rebuild vs ReOganize • Rebuild is always an offline operation and has to finish in order to fix indexing problems • Reoganize can be done online but only reorganizes may not work well with highly fragmented tables avg_fragmentation_in_percent value Corrective statement > 5% and < = 30% ALTER INDEX REORGANIZE > 30% ALTER INDEX REBUILD WITH (ONLINE = ON)*
  • 35. April 2-6, 2017 in Las Vegas, NV USA #C17LV Index added to F03B11Z1, F0411Z1, F0911Z1 “I just tested several batches and the run time improved significantly on the large batches. Batch 600000000819 and 600000000831 went from over one hour+ to less than 5 minute” - Happy Customer
  • 36. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution • Identify Indexes needed using Database Tools and Developer expertise. (aka understand the code) • Build the Index in JDE Edwards (you can do it at the database level but you will loose it during an upgrade) • Don’t over do it! Many time indexes will help but it is possible to create an index that has a negative impact on performance.
  • 37. Add a Second Production Web Server
  • 38. April 2-6, 2017 in Las Vegas, NV USA #C17LV Symptoms • Best Practices says 50-100 users per Jas instance. • Need to be able to able to bring a webserver down but not all of JDE. • Want to leave the Webservers up for testing but keep users out. • Want to use a Alias URL eg. jde.company.net
  • 39. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution • Option 1 – Give different users different URL’s and effectively load balance by picking who goes where Web 1 Web 2
  • 40. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution • Option 2 – Use DNS Round Robin and have users hit different servers. Web 1 Web 2
  • 41. April 2-6, 2017 in Las Vegas, NV USA #C17LV Resolution • Option 3 – Use a Load Balancer Web 1 Web 2 Load Balancer
  • 42. April 2-6, 2017 in Las Vegas, NV USA #C17LV Contact us: weknowjde@terillium.com Questions?

Editor's Notes

  1. Windows more likely to see Weblogic 100% Cpu issues.
  2. Automatic garbage collection is the process of looking at heap memory, identifying which objects are in use and which are not, and deleting the unused objects. An in use object, or a referenced object, means that some part of your program still maintains a pointer to that object. An unused object, or unreferenced object, is no longer referenced by any part of your program. So the memory used by an unreferenced object can be reclaimed. In a programming language like C, allocating and deallocating memory is a manual process. In Java, process of deallocating memory is handled automatically by the garbage collector. The basic process can be described as follows. - (http://www.oracle.com/webfolder/technetwork/tutorials/obe/java/gc01/index.html )
  3. Infinite loops seems to have less impact on performance.
  4. A variety of messages.
  5. Reporting Servers cause locks and block
  6. To Rebuild or Reorganize: That is the Question First off: ‘Reorganize’ and ‘Rebuild’ are two different operations that each reduce fragmentation in an index. They work differently toward the same end. You don’t need to run both against the same index. (I sometimes find that people are doing both against every index in a maintenance plan. That’s just double the work and NOT double the fun.) Rebuild: An index ‘rebuild’ creates a fresh, sparkling new structure for the index. If the index is disabled, rebuilding brings it back to life. You can apply a new fillfactor when you rebuild an index. If you cancel a rebuild operation midway, it must roll back (and if it’s being done offline, that can take a while). Reorganize: This option is more lightweight. It runs through the leaf level of the index, and as it goes it fixes physical ordering of pages and also compacts pages to apply any previously set fillfactor settings. This operation is always online, and if you cancel it then it’s able to just stop where it is (it doesn’t have a giant operation to rollback). Factors to consider: Standard Edition rebuilds ain’t awesome. If you’ve got SQL Server Standard Edition, index rebuilds are always an offline operation. Bad news: they’re also single-threaded. (Ouch!) Enterprise Edition rebuilds have gotchas. With SQL Server Enterprise Edition, you can specify an online rebuild — unless the index contains large object types. (This restriction is relaxed somewhat in SQL Server 2012). You can also use parallelism when creating or rebuilding an index— and that can save a whole lot of time. Even with an online rebuild, a schema modification lock (SCH-M) is needed at the time the fresh new index is put in place. This is an exclusive lock and in highly concurrent environments, getting it can be a big (blocking) problem. There’s a bug in SQL Server 2012 Enterprise Edition Rebuilds that can cause corruption. If you’re running SQL Server 2012 SP1 – SP2, parallel online index rebuilds can cause corruption. Read about your options here. Rebuilding partitioned tables is especially tricky. You can rebuild an entire partitioned index online– but nobody really wants to do that because they’re huge! The whole idea behind horizontal partitioning is to break data into more manageable chunks, right? Unfortunately, partition level rebuilds are offline until SQL Server 2014. Reorganizing can be pretty cool. ‘Reorganizing’ an index is always an online op, no matter what edition of SQL Server you’re using. It doesn’t require a schema mod lock, so it can provide better concurrency. Reorganizing only defragments the leaf level of the index. On large tables it can take longer than a rebuild would take, too. But as I said above, it’s nice that you can reorganize for a while and then stop without facing a massive rollback.