• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Innovations in Grid Computing with Oracle Coherence
 

Innovations in Grid Computing with Oracle Coherence

on

  • 3,047 views

Learn how Coherence can increase the availability, scalability and performance of your existing applications with its advanced low-latency data-grid technologies. Also hear some interesting ...

Learn how Coherence can increase the availability, scalability and performance of your existing applications with its advanced low-latency data-grid technologies. Also hear some interesting industry-specific use cases that customers had implemented and how Oracle is integrating Coherence into its Enterprise Java stack. (As presented by Craig Blitz at Oracle Technology Network Architect Day in Chicago, October 24, 2011.)

Statistics

Views

Total Views
3,047
Views on SlideShare
3,046
Embed Views
1

Actions

Likes
0
Downloads
122
Comments
0

1 Embed 1

http://www.adaptit.co.za 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Innovations in Grid Computing with Oracle Coherence Innovations in Grid Computing with Oracle Coherence Presentation Transcript

    • Innovations in Grid Computing with Oracle Coherence Craig Blitz Oracle Coherence Product Management1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • The
following
is
intended
to
outline
general
product
use
 and
direc4on.
It
is
intended
for
informa4on
purposes
only,
 and
may
not
be
incorporated
into
any
contract.
It
is
not
a
 commitment
to
deliver
any
material,
code,
or
func4onality,
 and
should
not
be
relied
upon
in
making
purchasing
 decisions.
 The
development,
release,
and
4ming
of
any
features
or
 func4onality
described
for
Oracle’s
products
remains
at
the
 sole
discre4on
of
Oracle.
2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Presentation Objectives To Understand… 1)
What
is
driving
the
need
for
Distributed
Caching
and
In‐ Memory
Data
Grid
products?
 2) How
Coherence
improves
performance,
enables
linear
 scalability,
and
provides
availability
for
shared
services 3)
Coherence’s
Strategic
Direc8on
and
Latest
Features
3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Internet Scale Problem:
How
to
deal
with
the
flood
of
customer
demand
for
 services
that
occurs
when
you
expose
your
infrastructure
to
a
 large,
poten4ally
unbounded
network.
 ‐
Or,
stated
more
posi4vely
‐

 Opportunity:
How
to
build
infrastructure
that
allows
you
to
 scale
business
and
improve
margins
by
exposing
your
services
 to
a
large,
poten4ally
unbounded
network.
4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • The Internet Scale Problem is Multi-Faceted•  Virtually unlimited number of customers•  Services exposed to partners’ overuse•  Customers’ experience relies on partners’ services•  Global and Real-time 5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Scaling Infrastructure to Meet the Problem •  Applications must act on data in real-time –  Access, query, and aggregate the data –  Trigger business actions based on changes to data •  Must scale predictably and cost-effectively –  Failure to do so results in loss of revenue and cost overruns –  No time to re-architect in Internet time •  Need a new paradigm in data management6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Coherence•  Elastic caching is “the secret sauce for internet scale”•  In-Memory Data Grid pioneer since 2001•  Gartner’s Leader’s Quadrant for Enterprise Application Servers, 2009 7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • More. Faster. Cheaper.• Scale
to
more
users
and
more
data
• Scale
predictably
and
cost‐effec4vely
• Act
on
data
in
real‐4me

• Reduce
spending
on
backend
systems
 Get
on
the
Grid
8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Coherence •  Coherence: in-memory data grid End
Users
 –  Distributed caching to applications –  Scalable extreme transaction processing Applica4on
 Servers
 –  Real-time eventing, query, and map/ reduce aggregations –  Abstraction from back-end data Applica4on
 sources Objects
 –  High-availability to applications Mainframes,
 Databases,
etc.
9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Fusion Middleware Complete, Open, Integrated, Best-in-Class Web
 Mobile
 Social
 User
Engagement
 Content
Management
 Iden4ty
 Management
 Business
Intelligence
 Development
 Business
Process
 Tools
 Management
 Service
Integra4on
 Enterprise
 Management
 Data
Integra4on
 Cloud
Applica4on
Founda4on
10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Presentation Objectives To Understand… 1)
What
is
driving
the
need
for
Distributed
Caching
and
In‐ Memory
Data
Grid
products?
 2) How
Coherence
improves
performance,
enables
linear
 scalability,
and
provides
availability
for
shared
services11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Enterprise Application Scalability ChallengesEase
of
Scaling
 Service
Clients
 •  Grows
and
scales
 Browsers,
supplier
and
partner
clients,
applica4on
 naturally
 clients,
mobile
apps,
and
other
service
consumers.
 •  Increasing
load
 Service
Implementa8on
 •  Computa4onally
 Custom
applica4ons,
BPM
processes,
service
bus
 intensive
work
 endpoints,
UI
services,
and
other
service
providers.
 •  Highly
dependent
on
 shared
services
 Shared
Services
 •  Complex
and
 RDBMS,
cloud
services,
supplier
and
partner
services,

 expensive
to
scale
 mainframe
applica4ons,
and
so
on.
 •  High
latency,
SPOB,
 and
SPOF
 12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Traditional Clustering •  Dependent on shared service latency Service
Clients
 •  Increase in size of cluster leads to increase in load on shared serviceService
 Service
 Service
Node
1
 Node
2
 •  Inconsistent view of data across Node
N
 cluster nodesCached
 Cached
 Cached
 •  No possibility for in-memoryObjects
 Objects
 Objects
 analytics •  Limited in-memory cache due to •  Capacity implications •  Java garbage collection Shared
Service
 13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Enter the Coherence Data GridEase
of
Scaling
 •  Clustered Caching Service
Clients
 –  Consistent view of data across cluster •  Partitioned Caching Service
 Service
 Service
 Node
1
 Node
2
 Node
N
 –  Increase in size of cluster adds capacity but does not decrease performance In‐memory
Data
Grid
 •  Distributed Data Processing –  Enables a scalable platform for high performance in- memory analytics Shared
Services
 14 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • How to Integrate with Coherence Two Options Custom integration through Coherence API - or – Through Existing ‘Switch-On’ OOTB Integrations Oracle TopLink Grid: JPA object-relational data Oracle Coherence*Web: HTTP sessions Other Oracle Products that integrate Coherence15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Coherence Basic Inteface Custom Integration•  Application uses NamedCache neCache = CacheFactory .getCache("NetworkElement"); Coherence API to store/ … access its data NetworkElement ne = new•  Application cache NetworkElement(“ID-321”, “OC-196”, “Nortel Networks); properties are configured neCache.put(“ID-321”, ne); externally through XML … file NetworkElement ne = neCache.get(“ID-321”);•  Basic cache access through NamedCache Map interface16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Management Partitioned Caching•  Extreme Scalability: Automatically, dynamically and transparently partitions the data set across the members of the grid.•  Pros: –  Linear scalability of data capacity –  Processing power scales with data capacity. –  Fixed cost per data access•  Cons: –  Cost Per Access: High percentage chance that each data access will go across the wire.•  Primary Use: •  Large in-memory storage environments •  Parallel processing environments 17 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Management Partitioned Fault Tolerance•  Automatically, dynamically and transparently manages the fault tolerance of your data.•  Backups are guaranteed to be on a separate physical machine as the primary.•  Backup responsibilities for one node’s data is shared amongst the other nodes in the grid. 18 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Management Near Caching•  Extreme Scalability and Extreme Performance: The best of both worlds between the Replicated and Partitioned topologies. Most recently/ frequently used data is stored locally.•  Pros: –  All of the same Pros as the Partitioned topology plus… –  High percentage chance data is local to request.•  Cons: –  Cost Per Update: There is a cost associated with each update to a piece of data that is stored locally on other nodes.•  Primary Use: –  Large in-memory storage environments with likelihood of repetitive data access. 19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Source Integration Read Through / Write Through •  Read Through –  All data reads occur through cache –  If there is a cache miss, the cache will load the data from the data source automatically •  Write Through –  All data writes occur through cache –  Updates to the cache are written synchronously to the data source20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Source Integration Write Behind •  All data writes occur through cache •  Updates to the cache are written asynchronously to the data source21 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Processing Parallel Query •  Programmatic query mechanism •  Queries performed in parallel across the grid •  Standard indexes provided out-of-the-box and supports implementing your own custom indexes22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Processing Continuous Query Cache •  Automatically, transparently and dynamically maintains a view locally based on a specific criteria (i.e. Filter) •  Same API as all other Coherence caches23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Processing Invocable Map •  The inverse of caching •  Sends the processing to where the data is in the grid –  Once and only once guarantees –  Processing is automatically fault-tolerant •  Processing can be: •  Targeted to a specific key or collection of keys •  Targeted to any object that matches a specific criteria (i.e. Filter)24 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Data Processing Events •  Build Complex Event-Driven Apps •  Java Bean Model •  Key-Based •  Filter-Based25 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Presentation Objectives To Understand… 1)
What
is
driving
the
need
for
Distributed
Caching
and
In‐ Memory
Data
Grid
products?
 2) How
Coherence
improves
performance,
enables
linear
 scalability,
and
provides
availability
for
shared
services 3)
Coherence’s
Strategic
Direc8on
and
Latest
Features
26 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Release Overview •  Oracle Coherence 3.7.1 –  Released September 23 –  Strategic investment in: •  Exalogic Innovation •  Ease of Use •  Integration Points –  Significant hardening27 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 © 2011 Oracle Corporation
    • "Oracle
Coherence
has
been
a
market
leader
helping
customers
scale
 applica4ons
to
meet
the
demands
of
internet‐scale
compu4ng
for
over
a
 decade
now.

Coherence
3.7.1
con4nues
to
reduce
complexity,
ease
 integra4on,
and
accelerate
4me
to
market
of
scalable
solu4ons...

At
the
 same
4me,
when
running
on
an
Oracle
Exalogic
engineered
system,
 Coherence
3.7.1
leverages
Oracles
Exabus
technology
to
achieve
the
lowest
 latencies
and
highest
throughput.”
 Cameron
Purdy
 VP
Development,
Oracle
28 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 © 2011 Oracle Corporation
    • Elastic Data Virtual Memory for Your Data•  Revolutionizes the scale of data grids Cache
 Cache
 Cache
•  Use block storage for cached data Server
 Server
 Server
 –  Optimized for flash –  Works well with NAS, Disk, etc. 1
 2

 3
•  Simplifies capacity planning and Heap
 Heap

 Heap

 deployment –  Configure amount of on-heap data to store –  Overflow data written to block storage –  Data stored in buffers until flushed to journal –  Reduces chances of Out-Of-Memory errors Flash

 Flash

 Flash
 29 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • REST Support•  REST API – cache creation – data access & modification – parallel aggregation/ processing/querying•  Easy Integration – iOS, Ruby, PHP, Python… – Via the HTTP protocol•  Compliments C++/.NET/ Java Support 30 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 © 2011 Oracle Corporation
    • Coherence API Types Scalable
Distributed
Cache
to
Scalable,
Event‐Driven
Real‐Time
Applica4ons
 Java
/
C++
/
.NET
 REST (Python, PHP,…) Aggrega4on
 Query
Filter
 Grid
 Real‐Time
 Map
API
 (Map‐Reduce)
 API
 Processing
API
 Client
API
 API
 Coherence
 WAN
Replica4on
 Coherence
 Cluster

 Cluster

 Per
Member
 Data
 Cache
Store/Source
 Loader
API
31 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Query Explain Plan•  Evaluate query cost and index effectiveness•  Quicker time to market of optimized Coherence solutions•  Explain Plan •  Provides the estimated cost of evaluating a filter as part of a query operation•  Trace •  Performs the associated query •  Provides the actual cost of evaluating a filter as part of a query operation. 32 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 © 2011 Oracle Corporation
    • Live Objects New Coherence Incubator Project•  Building blocks for an event- driven finite-state machine –  …that is distributed –  …and scalable –  …and resistant to machine failure•  Architectural possibilities: –  Stated Event Driven Processing –  Ripple Effect 33 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Coherence on Exalogic Engineered System Optimized Scalability and Performance in a Box•  Coherence optimized for Exabus 4x Throughput,•  Pre-configured network/compute nodes 1/6th Latency!!!•  Elastic Data: Expand Capacity with Flash•  Easy deployment as demand spikes•  Grow from ¼ to multi-rack 34 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • GoldenGate/Coherence Integration Custom
 Coherence
 TopLink
Grid
 Update
 GoldenGate 
 Packaged
 Enabled
 Coherence

 Cohere Cache
Updater 
 Java
Client 
 Applica4on
 Applica4on
 nce
•  Simplifies Coherence use in shared database environment <entity –  Propagates DB updates to Coherence class="Address"> <table name="ADDR”/> Coherence
 <attributes> <id name="id"> –  GoldenGate captures changes to <generated- 

Database
Log
Stream
Capture
 value /> </id> database tables Direct
Database
Updates
 <version name="ver“/> </attributes> Update
 </entity> –  TopLink maps database changes to Coherence
 cached objects JPA
 Metadata
 Read/Write
Through
 –  Availability—2012 –  GoldenGate 11gR2 –  Available as patch to WebLogic 12.1.1 and 11.1.1.6/10.3.6 –  Oracle database only Database
 35 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Coherence
Integra8ons
 Oracle
IGBU
 Oracle
Golden
Gate
 WebCenter
 Oracle
CGBU
 Meta‐data
Services
(MDS)
 SOA
BPEL
 Oracle
GlassFish
 Oracle
ADF
 SOA
Human
Workflow
 Oracle
Access
Manager
 Oracle
PeopleSoR
 SOA
Business
Rules
 Oracle
CEP
 Oracle
Secure
Token
Service
 SOA
Coherence
Adapter
 Real‐8me
Decision
 Oracle
Iden8ty
Federa8on
 SOA
Technology
Adapters
 TopLink
 ATG
 BI
Publisher
 WebLogic
Portal
 Oracle
En8tlement
Services
Service
Delivery
PlaQorm
 Oracle
BEAM
 WebLogic
Server
 Oracle
Web
Services
Manager
 Oracle
Service
Bus
 
Advanced
Capabili4es
 SOA
Infrastructure
 
Data
Grid
 ATG
Hosted
Services
 
Data
Cache
Oracle
Data
Integra8on
 
Simple
Clustering
 36 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Enterprise Pack for Eclipse (OEPE) •  Coherence Project Configuration –  Facets –  Library Management –  Descriptor Generation •  Runtime Configuration –  Launch Config Editor –  Run/Deploy/Debug from IDE •  Configuration Support –  tangosol-coherence-override.xml editor –  Validation –  Context Sensitive Help Integration –  Cache Configuration Editor (OEPE 1.8)37 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 © 2011 Oracle Corporation
    • For More Information •  General Information: http://coherence.oracle.com •  Coherence Training: http://education.oracle.com •  Coherence Discussion Forum: http://forums.oracle.com •  Coherence User Group on Linkedin •  “Oracle Coherence 3.5” by Aleks Seovic •  My email: Email: craig.blitz@oracle.com38 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Q & (hopefully) A39 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Enterprise Manager 12C Comprehensive Coherence Management Performance
 Monitoring
&
 Administra4on
 Diagnos4cs
 Configura4on
 Provisioning
 Management

40 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Enterprise Manager 12C Monitoring & Diagnostics Deep
Performance
Visibility
&
Alerts
Based
Proac4ve
Monitoring
 • Completely
customizable
performance
views
–
save
different
views
for
different
monitoring
 requirements
of
the
enterprise
 • Proac4ve
Alerts
and
no4fica4ons
based
on
granular
thresholds
 • Topology
view
to
show
associa4ons
and
dependencies
 • Log
monitoring
–
generate
Alerts
based
on
log
pajers
 • Advanced
monitoring
–
push
replica4on,
reap
sessions,
transac4onal
caches,
etc
 Real‐4me
JVM
Diagnos4cs
for
Coherence
Nodes
 • Real‐4me
threads
analysis
–
find
call
stack,
locks,
method
local
variables,
etc

 • Real‐4me
heap
analysis
–
heap
distribu4on
in
different
spaces
(eden,
perm‐gen,
etc),
 garbage
collec4on
 • Differen4al
heap
analysis
–
pin
point
heap
leaks
by
comparing
two
snapshots
41 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
    • Oracle Enterprise Manager 12C Administration & Provisioning Centralized
Cache
Data
Management

 •  Query
based
data
opera4ons

 •  Central
UI
for
key
cache
opera4ons
–
view,
update,
 import,
export,
purge,
add/remove
indexes
 •  Dras4cally
saves
4me
in
cache
opera4ons
and
makes
it
 easy
for
administrators
 •  Save
queries
for
future
references
 Automated
Provisioning
 •  Maintain
‘gold
image’
in
the
solware
library
 •  Provisioning
new
cluster
or
add
nodes
to
an
exis4ng
 cluster
 •  Support
Unicast
Addrress
as
well
as
WKA
based
clusters
42 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8