SlideShare a Scribd company logo
1 of 49
Download to read offline
Extreme performance with Oracle
SOA Suite 12.2, Coherence and
Exalogic
Helsinki, Wednesday , May 17, 2017
By Michel Schildmeijer,
Speaker and Contents
• Michel Schildmeijer, Oracle ACE
• 17 years WebLogic, Middleware, Integration
Contents:
• Dehydration on SOA, what is it?
• How configure Oracle SOA Suite for Exalogic
• SOA and Coherence
□ How can SOA make use of coherence for dehydration?
19-5-2017Ruimte voor voettekst2
The case
• A credit insurance company
• Lot’s of initiatives to transform to new technology
• Key platform was the “Blue Stack”
• Current Oracle Fusion Middleware Platform on
conventional hardware
19-5-2017Ruimte voor voettekst3
First: Generic Migration Plan
19-5-20174
Period 1 Period 2 Period 3 Period 4
<nn> weeks <nn> weeks <nn> weeks
Inventory & Design
Develop, Deploy, Build
Rollout & TestRollout & Test
Oracle Fusion Middleware 12c Migration Path
Operational Ready & LiveOperational Ready & Live
<nn> weeks
Pre-analysis Upgrade SOA 11g to 12c
• Pre-analysis for upgrade areas of complexity:
□ Use custom DB scripts for purge, partitioning
□ Custom code using SOA locator APIs
□ Significant performance tuning in 11g?
□ Long running Instances?
19-5-2017Redesign & Rebuild5
19-5-2017Ruimte voor voettekst6
SOA logical landscape
Process Services
Orchestration
System BPM
Business Logic
Databases
Data Services
Enterprise Service Bus (ESB)
Systems of Record
Web Portals
Human Business Process Management (BPM)
Security
RegistryandRepository
Manageandmonitor
Choice: In place upgrade SOA 11g to 12c
19-5-20177
Chosen: Side by side Upgrade SOA 11g to 12c
• New build domain configuration
• Deploy composites after upgrade
• Not for long-running instances
19-5-2017Redesign & Rebuild8
19-5-2017Ruimte voor voettekst9
SOA Infrastructure PlatformSOA Infrastructure Platform
WebLogic Server
Managed Server(S)
Java EE deployed Apps for
SOA
Webapps
EJB/MDB
RAR
Software & Config files
Oracle Linux
SOA WebLogic Cluster
Operating System
Installation & Config
Domain Configuration
JDBC
JMS
HTTP(S)
JMX
Side by side Upgrade SOA 11g to 12c
19-5-2017Redesign & Rebuild10
Dehydration of SOA Suite, what is it?
• Statelessness - Services minimize resource
consumption by deferring the management of state
information when necessary
• State is maintained and offloaded in a dehydration
store
• An instance is created every time a new inbound call
arrives
• Every important step is maintained using a
dehydration point
19-5-2017Ruimte voor voettekst11
Why Dehydration?
• Long running instances waiting for response consumes
memory and CPU
• While waiting for the response the bpel engine can
store the process, thus freeing up server resources.
• Over the life cycle of the BPEL instance, the instance
with the current state of execution may be saved in
database.
19-5-2017Ruimte voor voettekst12
Dehydration continued
• Storing status of BPEL process(long running process,
asynchronous process) into database tables
• SOA_INFRA schema is the dehydration store contains tables
to hold the meta data of the process.
• Synchronous Process
□ Process gets dehydrated only at the end of the process.
□ Using Dehydrate activity we can explicitly dehydrate
process state if required.
• Asynchronous Process
□ Automatically dehydrated the process based on the
activities used.
19-5-2017Ruimte voor voettekst13
Dehydration store tables
• Cube_Instance: Stores the information about the
composite instance that gets created.
• Cube_scope: Stores information about the scopes and
variables declared and used.
• DLV_Message: All the incoming payload details are
stored.
• Invoke_Message: All the outgoing message payload
details are stored.
• Audit_Trail: Used to store information xml rendered in
EM console.
19-5-2017Ruimte voor voettekst14
19-5-2017Ruimte voor voettekst15
• Transaction speeds are constrained by database
I/O at dehydration points
• Persisting state and flow data cause substantial
database growth
• Purging database at regular intervals is a
mandatory operational overhead
Oracle Confidential – Internal/Restricted/Highly Restricted16
Challenges
A possible Solution
• Choice to persist flow and instance data only for faulted
transactions
• Coherence cache for running transactions (flow trace, BPEL
state, audit trail and payloads)
• Tracks and updates already persisted transactions
• Choice to defer writing to a database - update in batches
• Configurable write behind thread
• Metrics to track and evaluate state of transactions
19-5-2017Ruimte voor voettekst18
But first
• Design a SOA Suite infrastructure which makes use of:
□ Extreme performance features
□ Stable and solid solution architecture
□ Exalogic network capabilities
19-5-2017Ruimte voor voettekst19
19-5-2017Ruimte voor voettekst20
Exalogic X5-2 Converged Infrastructure
Integrated Network Attached Storage
ZFS Clustered for high availability
80 TB SAS disk, 6,4 TB read cache, 800
GB write cache
Clones, snapshots, remote replication
Integrated Storage
40 Gb/sec internal I/O backplane
10 Gigabit Ethernet connectivity to
datacenter
Internal I/O Fabric and Data Center Conn.
2 socket, 8-core, 2.9 GHz Intel Xeon
processors
7.5 TB of DRAM
1080 cores in a Full Rack; also available in
1/2,1/4,1/8 or multi-rack configurations
Redundant SSD, power, cooling,
InfiniBand
Compute Power
Different
Vendors
across the
stack
Integrated
Tuned
Optimized
Consolidated
Application
Platform
Layer
Compute
Layer
Storage
Layer
I/O Layer
OS Layer
HP Blades
HP Storage
HP
Networking
150+ parts
Months from start to finish before
its ready for production
1 Engineered System
Unpack and ready for production
“in one day”
Building Blocks
Engineered versus “common stack”
5/19/201723
• The “Magic” Switch
WebLogic boost
5/19/201724
• WebLogic Exalogic Domain Enhancements
• -Dweblogic.ScatteredReadsEnabled &
-Dweblogic.GatheredWritesEnabled
• Better I/O in high network volume environments
• Uses Native IO Socket Channels optimized
• -Dweblogic.replication.enableLazyDeserialization
• Clustered session replication
WebLogic boost
5/19/201725
WebLogic boost
• # Enable Java Exalogic optimizations
EXTRA_JAVA_PROPERTIES="${EXTRA_JAVA_PROPERTIES}
-Xlargepages:exitOnFailure=false -
Doracle.xdkjava.exalogic.optimization=true
-Dweblogic.ScatteredReadsEnabled=true
-Dweblogic.GatheredWritesEnabled=true
-
Dweblogic.replication.enableLazyDeserialization=true
"
export EXTRA_JAVA_PROPERTIES
More optimizations
• Optimal use of Infiniband
• Clusters and channels
• Oracle Traffic Director
• SOA Suite and Coherence
Optimal use of Infiniband
• Because of high speed IB network we
could
• Store all persistency in database
• JMS TLogs
• JMS FileStores
Optimal use of Infiniband
JDBC GridLink over Infiniband
• jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS=(PROT
OCOL=tcp)(HOST=<IBVIP>)(PORT=1521))(CONNECT_D
ATA=(SERVICE_NAME=<DB Service>)))
• JAVA_OPTIONS="${JAVA_OPTIONS}
-
Djava.net.preferIPv4Stack=true
-Doracle.net.SDP=true"
setDomainEnvsetDomainEnv
JDBCJDBC
WebLogic Channels
5/19/201731
5/19/201732
WebLogic Channels
Several channels to define
• WebLogic Admin Channel.
• This is the default channel to be used by the
AdminServer.
• Internal network channels for HTTP and
T3 (Cluster, Coherence, OTD)
• These channels are used for internal traffic:
• Cluster communication
• Application High Availability and Serialization
• Application caching with Coherence
• External network channels for SOA
JMS Messaging Optimization
• The way message are temporary stored,
compressed and decompressed can be set
with these optimizations
• JMS Lockless Request Manager.
• A specific WebLogic JMS MBean must be set
for using concurrent messaging for JMS queue
JMS Messaging Optimization
• The way message are temporary stored,
compressed and decompressed can be set
with these optimizations
• JMS Lockless Request Manager.
• A specific WebLogic JMS MBean must be set
for using concurrent messaging for JMS queue
ServerMBean.useConcurrentQueueForRequestManager=true
SOA and Coherence
• Coherence in JVM or separate coherence
cluster
• Coherence cluster needs own JVMs
• Coherence WKA addresses use over Infiniband
-Dtangosol.coherence.wka1=(IPoIB adress
localhost)-Dtangosol.coherence.wka2=(IPoIB
adress1)-Dtangosol.coherence.localhost=(IPoIB
adress2)
SOA and Coherence
• Coherence integrate with SOA Suite:
• Activation of Coherence Adapter
SOA and Coherence
• Coherence
Configurations:
• file adapter-
soa-
config.xml
• New EIS
Adapter
SOA and Coherence
SOA and Coherence
• Test Coherence Adapter:
• WSDL call a different adapter reference for each
operation.
• Put (Put item in cache),
• Get (Get item from cache),
• Remove (Remove item from cache) or
• Query (Query item from cache),
• list – retrieve all the objects in the cache. listKeys
– retrieve all the keys of the objects in the cache;
• removeAll – remove all the objects from the cache.
5/19/201741
5/19/201742
5/19/201743
5/19/201744
SOA BPEL and Coherence
• Some specific settings set in JVM for Coherence:
EXTRA_JAVA_PROPERTIES="${EXTRA_JAVA_PROPERTIES}
-Dsoa.archives.dir=${SOA_ORACLE_HOME}/soa
-Dsoa.oracle.home=${SOA_ORACLE_HOME}
-Dsoa.instance.home=${DOMAIN_HOME}
-Dtangosol.coherence.log=jdk
• Transport optimization
-Dtangosol.coherence.transport.reliable=imb -
Djavax.xml.soap.MessageFactory=oracle.j2ee.ws.saaj.soap.MessageFactoryImpl
• Take the database role in committing and rollback
-Dweblogic.transaction.blocking.commit=true
-Dweblogic.transaction.blocking.rollback=true
SOA BPEL and Coherence
• Some specific settings for SOA:
• CacheEnabled=true
• -Dbpel.cache.localStorage=true
• -Dbpel.cache.threadCount=<value>
• -Dbpel.cache.cubeInstance.sizeLimit=<value>
• -Dbpel.cache.invokeMessage.sizeLimit=<value>
• -Dbpel.cache.deliveryMessage.sizeLimit=<value>
• -Dbpel.cache.deliverySubscription.sizeLimit=<value>
Note that all settings relate to some form of dehydration
The benefits
• Minimize database traffic by using coherence cache
• Regulate amount of dehydrations to the database
• Use ZFS storage, high speed with Infiniband
• Besides all the Exalogic benefits, also to be used
on non Exalogic hardware
Any Questions?
Let’s keep in touch!!
The ACE Community
mschildmeijer@qualogy.com
https://community.oracle.com/blogs/mnemonic
https://www.qualogy.com/nl/techblog/author/michel-
schildmeijer
Any Questions?
Let’s keep in touch!!
@MNEMONIC01
@Qualogy_news
nl.linkedin.com/in/mschldmr

More Related Content

What's hot

Turning OpenStack Swift into a VM storage platform
Turning OpenStack Swift into a VM storage platformTurning OpenStack Swift into a VM storage platform
Turning OpenStack Swift into a VM storage platform
OpenStack_Online
 

What's hot (20)

ActiveMQ 5.9.x new features
ActiveMQ 5.9.x new featuresActiveMQ 5.9.x new features
ActiveMQ 5.9.x new features
 
10 Strategies for Developing Reliable Jakarta EE & MicroProfile Applications ...
10 Strategies for Developing Reliable Jakarta EE & MicroProfile Applications ...10 Strategies for Developing Reliable Jakarta EE & MicroProfile Applications ...
10 Strategies for Developing Reliable Jakarta EE & MicroProfile Applications ...
 
Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...
Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...
Continuous Deployment into the Unknown with Artifactory, Bintray, Docker and ...
 
Turning OpenStack Swift into a VM storage platform
Turning OpenStack Swift into a VM storage platformTurning OpenStack Swift into a VM storage platform
Turning OpenStack Swift into a VM storage platform
 
Oracle Enterprise Manager - EM12c R5 Hybrid Cloud Management
Oracle Enterprise Manager - EM12c R5 Hybrid Cloud ManagementOracle Enterprise Manager - EM12c R5 Hybrid Cloud Management
Oracle Enterprise Manager - EM12c R5 Hybrid Cloud Management
 
JavaEdge 2008: Your next version control system
JavaEdge 2008: Your next version control systemJavaEdge 2008: Your next version control system
JavaEdge 2008: Your next version control system
 
Apache Kafka Security
Apache Kafka Security Apache Kafka Security
Apache Kafka Security
 
Batch Applications for the Java Platform
Batch Applications for the Java PlatformBatch Applications for the Java Platform
Batch Applications for the Java Platform
 
GWT Enterprise Edition
GWT Enterprise EditionGWT Enterprise Edition
GWT Enterprise Edition
 
Microservices with Node.js and Apache Cassandra
Microservices with Node.js and Apache CassandraMicroservices with Node.js and Apache Cassandra
Microservices with Node.js and Apache Cassandra
 
Build Robust Blockchain Services with Hyperledger and Containers
Build Robust Blockchain Services with Hyperledger and ContainersBuild Robust Blockchain Services with Hyperledger and Containers
Build Robust Blockchain Services with Hyperledger and Containers
 
Enterprise container platform verrazzano
Enterprise container platform verrazzanoEnterprise container platform verrazzano
Enterprise container platform verrazzano
 
WebLogic 12c - OMF Canberra June 2014
WebLogic 12c - OMF Canberra June 2014WebLogic 12c - OMF Canberra June 2014
WebLogic 12c - OMF Canberra June 2014
 
Advanced WebLogic Monitoring: JMX and WLSDM Automation
Advanced WebLogic Monitoring: JMX and WLSDM AutomationAdvanced WebLogic Monitoring: JMX and WLSDM Automation
Advanced WebLogic Monitoring: JMX and WLSDM Automation
 
Marcus Rochelle - Landis+Gyr - Monitoring with Nagios Enterprise Edition
Marcus Rochelle - Landis+Gyr - Monitoring with Nagios Enterprise EditionMarcus Rochelle - Landis+Gyr - Monitoring with Nagios Enterprise Edition
Marcus Rochelle - Landis+Gyr - Monitoring with Nagios Enterprise Edition
 
Kafka Security
Kafka SecurityKafka Security
Kafka Security
 
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA SolutionsNagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
 
Should i break it?
Should i break it?Should i break it?
Should i break it?
 
What's New in Grizzly & Deploying OpenStack with Puppet
What's New in Grizzly & Deploying OpenStack with PuppetWhat's New in Grizzly & Deploying OpenStack with Puppet
What's New in Grizzly & Deploying OpenStack with Puppet
 
Performance out
Performance outPerformance out
Performance out
 

Similar to Oracle SOA suite and Coherence dehydration

Oracle db architecture
Oracle db architectureOracle db architecture
Oracle db architecture
Simon Huang
 
My sqlstrategyroadmap
My sqlstrategyroadmapMy sqlstrategyroadmap
My sqlstrategyroadmap
slidethanks
 

Similar to Oracle SOA suite and Coherence dehydration (20)

GEN-Z: An Overview and Use Cases
GEN-Z: An Overview and Use CasesGEN-Z: An Overview and Use Cases
GEN-Z: An Overview and Use Cases
 
Latest (storage IO) patterns for cloud-native applications
Latest (storage IO) patterns for cloud-native applications Latest (storage IO) patterns for cloud-native applications
Latest (storage IO) patterns for cloud-native applications
 
Inter connect2016 yss1841-cloud-storage-options-v4
Inter connect2016 yss1841-cloud-storage-options-v4Inter connect2016 yss1841-cloud-storage-options-v4
Inter connect2016 yss1841-cloud-storage-options-v4
 
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and InfrastrctureRevolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
 
MySQL 5.7 what's new
MySQL 5.7 what's newMySQL 5.7 what's new
MySQL 5.7 what's new
 
What is coming for VMware vSphere?
What is coming for VMware vSphere?What is coming for VMware vSphere?
What is coming for VMware vSphere?
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funcio...
Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funcio...Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funcio...
Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funcio...
 
VMworld 2013: How SRP Delivers More Than Power to Their Customers
VMworld 2013: How SRP Delivers More Than Power to Their Customers VMworld 2013: How SRP Delivers More Than Power to Their Customers
VMworld 2013: How SRP Delivers More Than Power to Their Customers
 
Scylla Summit 2016: Compose on Containing the Database
Scylla Summit 2016: Compose on Containing the DatabaseScylla Summit 2016: Compose on Containing the Database
Scylla Summit 2016: Compose on Containing the Database
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16
 
Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph
 
Enterprise PostgreSQL - EDB's answer to conventional Databases
Enterprise PostgreSQL - EDB's answer to conventional DatabasesEnterprise PostgreSQL - EDB's answer to conventional Databases
Enterprise PostgreSQL - EDB's answer to conventional Databases
 
Oracle db architecture
Oracle db architectureOracle db architecture
Oracle db architecture
 
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
 
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
 
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
 
VMworld Europe 2014: Advanced SQL Server on vSphere Techniques and Best Pract...
VMworld Europe 2014: Advanced SQL Server on vSphere Techniques and Best Pract...VMworld Europe 2014: Advanced SQL Server on vSphere Techniques and Best Pract...
VMworld Europe 2014: Advanced SQL Server on vSphere Techniques and Best Pract...
 
My sqlstrategyroadmap
My sqlstrategyroadmapMy sqlstrategyroadmap
My sqlstrategyroadmap
 

Recently uploaded

The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
VishalKumarJha10
 

Recently uploaded (20)

The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
 
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdfPayment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
 
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptxBUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdfAzure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 

Oracle SOA suite and Coherence dehydration

  • 1. Extreme performance with Oracle SOA Suite 12.2, Coherence and Exalogic Helsinki, Wednesday , May 17, 2017 By Michel Schildmeijer,
  • 2. Speaker and Contents • Michel Schildmeijer, Oracle ACE • 17 years WebLogic, Middleware, Integration Contents: • Dehydration on SOA, what is it? • How configure Oracle SOA Suite for Exalogic • SOA and Coherence □ How can SOA make use of coherence for dehydration? 19-5-2017Ruimte voor voettekst2
  • 3. The case • A credit insurance company • Lot’s of initiatives to transform to new technology • Key platform was the “Blue Stack” • Current Oracle Fusion Middleware Platform on conventional hardware 19-5-2017Ruimte voor voettekst3
  • 4. First: Generic Migration Plan 19-5-20174 Period 1 Period 2 Period 3 Period 4 <nn> weeks <nn> weeks <nn> weeks Inventory & Design Develop, Deploy, Build Rollout & TestRollout & Test Oracle Fusion Middleware 12c Migration Path Operational Ready & LiveOperational Ready & Live <nn> weeks
  • 5. Pre-analysis Upgrade SOA 11g to 12c • Pre-analysis for upgrade areas of complexity: □ Use custom DB scripts for purge, partitioning □ Custom code using SOA locator APIs □ Significant performance tuning in 11g? □ Long running Instances? 19-5-2017Redesign & Rebuild5
  • 6. 19-5-2017Ruimte voor voettekst6 SOA logical landscape Process Services Orchestration System BPM Business Logic Databases Data Services Enterprise Service Bus (ESB) Systems of Record Web Portals Human Business Process Management (BPM) Security RegistryandRepository Manageandmonitor
  • 7. Choice: In place upgrade SOA 11g to 12c 19-5-20177
  • 8. Chosen: Side by side Upgrade SOA 11g to 12c • New build domain configuration • Deploy composites after upgrade • Not for long-running instances 19-5-2017Redesign & Rebuild8
  • 9. 19-5-2017Ruimte voor voettekst9 SOA Infrastructure PlatformSOA Infrastructure Platform WebLogic Server Managed Server(S) Java EE deployed Apps for SOA Webapps EJB/MDB RAR Software & Config files Oracle Linux SOA WebLogic Cluster Operating System Installation & Config Domain Configuration JDBC JMS HTTP(S) JMX
  • 10. Side by side Upgrade SOA 11g to 12c 19-5-2017Redesign & Rebuild10
  • 11. Dehydration of SOA Suite, what is it? • Statelessness - Services minimize resource consumption by deferring the management of state information when necessary • State is maintained and offloaded in a dehydration store • An instance is created every time a new inbound call arrives • Every important step is maintained using a dehydration point 19-5-2017Ruimte voor voettekst11
  • 12. Why Dehydration? • Long running instances waiting for response consumes memory and CPU • While waiting for the response the bpel engine can store the process, thus freeing up server resources. • Over the life cycle of the BPEL instance, the instance with the current state of execution may be saved in database. 19-5-2017Ruimte voor voettekst12
  • 13. Dehydration continued • Storing status of BPEL process(long running process, asynchronous process) into database tables • SOA_INFRA schema is the dehydration store contains tables to hold the meta data of the process. • Synchronous Process □ Process gets dehydrated only at the end of the process. □ Using Dehydrate activity we can explicitly dehydrate process state if required. • Asynchronous Process □ Automatically dehydrated the process based on the activities used. 19-5-2017Ruimte voor voettekst13
  • 14. Dehydration store tables • Cube_Instance: Stores the information about the composite instance that gets created. • Cube_scope: Stores information about the scopes and variables declared and used. • DLV_Message: All the incoming payload details are stored. • Invoke_Message: All the outgoing message payload details are stored. • Audit_Trail: Used to store information xml rendered in EM console. 19-5-2017Ruimte voor voettekst14
  • 16. • Transaction speeds are constrained by database I/O at dehydration points • Persisting state and flow data cause substantial database growth • Purging database at regular intervals is a mandatory operational overhead Oracle Confidential – Internal/Restricted/Highly Restricted16 Challenges
  • 17. A possible Solution • Choice to persist flow and instance data only for faulted transactions • Coherence cache for running transactions (flow trace, BPEL state, audit trail and payloads) • Tracks and updates already persisted transactions • Choice to defer writing to a database - update in batches • Configurable write behind thread • Metrics to track and evaluate state of transactions
  • 19. But first • Design a SOA Suite infrastructure which makes use of: □ Extreme performance features □ Stable and solid solution architecture □ Exalogic network capabilities 19-5-2017Ruimte voor voettekst19
  • 21. Exalogic X5-2 Converged Infrastructure Integrated Network Attached Storage ZFS Clustered for high availability 80 TB SAS disk, 6,4 TB read cache, 800 GB write cache Clones, snapshots, remote replication Integrated Storage 40 Gb/sec internal I/O backplane 10 Gigabit Ethernet connectivity to datacenter Internal I/O Fabric and Data Center Conn. 2 socket, 8-core, 2.9 GHz Intel Xeon processors 7.5 TB of DRAM 1080 cores in a Full Rack; also available in 1/2,1/4,1/8 or multi-rack configurations Redundant SSD, power, cooling, InfiniBand Compute Power
  • 22. Different Vendors across the stack Integrated Tuned Optimized Consolidated Application Platform Layer Compute Layer Storage Layer I/O Layer OS Layer HP Blades HP Storage HP Networking 150+ parts Months from start to finish before its ready for production 1 Engineered System Unpack and ready for production “in one day” Building Blocks Engineered versus “common stack”
  • 23. 5/19/201723 • The “Magic” Switch WebLogic boost
  • 24. 5/19/201724 • WebLogic Exalogic Domain Enhancements • -Dweblogic.ScatteredReadsEnabled & -Dweblogic.GatheredWritesEnabled • Better I/O in high network volume environments • Uses Native IO Socket Channels optimized • -Dweblogic.replication.enableLazyDeserialization • Clustered session replication WebLogic boost
  • 25. 5/19/201725 WebLogic boost • # Enable Java Exalogic optimizations EXTRA_JAVA_PROPERTIES="${EXTRA_JAVA_PROPERTIES} -Xlargepages:exitOnFailure=false - Doracle.xdkjava.exalogic.optimization=true -Dweblogic.ScatteredReadsEnabled=true -Dweblogic.GatheredWritesEnabled=true - Dweblogic.replication.enableLazyDeserialization=true " export EXTRA_JAVA_PROPERTIES
  • 26. More optimizations • Optimal use of Infiniband • Clusters and channels • Oracle Traffic Director • SOA Suite and Coherence
  • 27. Optimal use of Infiniband • Because of high speed IB network we could • Store all persistency in database • JMS TLogs • JMS FileStores
  • 28. Optimal use of Infiniband
  • 29. JDBC GridLink over Infiniband • jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS=(PROT OCOL=tcp)(HOST=<IBVIP>)(PORT=1521))(CONNECT_D ATA=(SERVICE_NAME=<DB Service>))) • JAVA_OPTIONS="${JAVA_OPTIONS} - Djava.net.preferIPv4Stack=true -Doracle.net.SDP=true" setDomainEnvsetDomainEnv JDBCJDBC
  • 33. WebLogic Channels Several channels to define • WebLogic Admin Channel. • This is the default channel to be used by the AdminServer. • Internal network channels for HTTP and T3 (Cluster, Coherence, OTD) • These channels are used for internal traffic: • Cluster communication • Application High Availability and Serialization • Application caching with Coherence • External network channels for SOA
  • 34. JMS Messaging Optimization • The way message are temporary stored, compressed and decompressed can be set with these optimizations • JMS Lockless Request Manager. • A specific WebLogic JMS MBean must be set for using concurrent messaging for JMS queue
  • 35. JMS Messaging Optimization • The way message are temporary stored, compressed and decompressed can be set with these optimizations • JMS Lockless Request Manager. • A specific WebLogic JMS MBean must be set for using concurrent messaging for JMS queue ServerMBean.useConcurrentQueueForRequestManager=true
  • 36. SOA and Coherence • Coherence in JVM or separate coherence cluster • Coherence cluster needs own JVMs • Coherence WKA addresses use over Infiniband -Dtangosol.coherence.wka1=(IPoIB adress localhost)-Dtangosol.coherence.wka2=(IPoIB adress1)-Dtangosol.coherence.localhost=(IPoIB adress2)
  • 37. SOA and Coherence • Coherence integrate with SOA Suite: • Activation of Coherence Adapter
  • 38. SOA and Coherence • Coherence Configurations: • file adapter- soa- config.xml • New EIS Adapter
  • 40. SOA and Coherence • Test Coherence Adapter: • WSDL call a different adapter reference for each operation. • Put (Put item in cache), • Get (Get item from cache), • Remove (Remove item from cache) or • Query (Query item from cache), • list – retrieve all the objects in the cache. listKeys – retrieve all the keys of the objects in the cache; • removeAll – remove all the objects from the cache.
  • 45. SOA BPEL and Coherence • Some specific settings set in JVM for Coherence: EXTRA_JAVA_PROPERTIES="${EXTRA_JAVA_PROPERTIES} -Dsoa.archives.dir=${SOA_ORACLE_HOME}/soa -Dsoa.oracle.home=${SOA_ORACLE_HOME} -Dsoa.instance.home=${DOMAIN_HOME} -Dtangosol.coherence.log=jdk • Transport optimization -Dtangosol.coherence.transport.reliable=imb - Djavax.xml.soap.MessageFactory=oracle.j2ee.ws.saaj.soap.MessageFactoryImpl • Take the database role in committing and rollback -Dweblogic.transaction.blocking.commit=true -Dweblogic.transaction.blocking.rollback=true
  • 46. SOA BPEL and Coherence • Some specific settings for SOA: • CacheEnabled=true • -Dbpel.cache.localStorage=true • -Dbpel.cache.threadCount=<value> • -Dbpel.cache.cubeInstance.sizeLimit=<value> • -Dbpel.cache.invokeMessage.sizeLimit=<value> • -Dbpel.cache.deliveryMessage.sizeLimit=<value> • -Dbpel.cache.deliverySubscription.sizeLimit=<value> Note that all settings relate to some form of dehydration
  • 47. The benefits • Minimize database traffic by using coherence cache • Regulate amount of dehydrations to the database • Use ZFS storage, high speed with Infiniband • Besides all the Exalogic benefits, also to be used on non Exalogic hardware
  • 48. Any Questions? Let’s keep in touch!! The ACE Community mschildmeijer@qualogy.com https://community.oracle.com/blogs/mnemonic https://www.qualogy.com/nl/techblog/author/michel- schildmeijer
  • 49. Any Questions? Let’s keep in touch!! @MNEMONIC01 @Qualogy_news nl.linkedin.com/in/mschldmr