Delivering Efficiency and Expansion  from the Ground Up: The Application Grid Matt Wright Director, Product Management, Oracle Fusion Middleware
QUESTION 1 Which of the following technologies do you use? WebLogic Server Oracle Application Server Tuxedo More than one of the above
And the Winner is………..
Grid 06/06/09 ©2008 Oracle Corporation
The Real Challenges What is really limiting efficiency and expansion? Volatility of needs Tight coupling Granularity mismatch 06/06/09 ©2008 Oracle Corporation  Needs Resource Resource Resource
“You Are Here” 06/06/09 ©2008 Oracle Corporation
Problems In Today’s IT The legacy of dedicated stacks 06/06/09 ©2008 Oracle Corporation  OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM  App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy Inefficiency Difficult Scale-Out Limited Performance
Alternative #1: More Boxes Just adding hardware won’t always help OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM  App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy 06/06/09 ©2008 Oracle Corporation
Alternative #2: Just Fix with SOA or BPM You can’t just paper over fundamentals 06/06/09 ©2008 Oracle Corporation  Custom App Packaged App SOA Svc C/C++/ COBOL Legacy SOA/BPM OS JVM App Svr OS JVM App Svr OS JVM  App Svr OS TPM OS TPM
Alternative #3: Improve Applications Costly, complex, time-consuming OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM  App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy 06/06/09 ©2008 Oracle Corporation  New! New! New! New! New!
A New Approach:  Application Grid 06/06/09 ©2008 Oracle Corporation  Efficiency Flexible Scaling High Quality  of Service Application Grid Custom App Packaged App SOA Svc C/C++/ COBOL Legacy
The Impact of SOA Even greater need for dynamic adjustment 06/06/09 ©2008 Oracle Corporation  App 1 Application Grid SOA Svc SOA Svc SOA Svc SOA Svc SOA Svc App 3 App 2
Inside the Application Grid Pooling, sharing, dynamic adjustment 06/06/09 ©2008 Oracle Corporation  App 1 Application Grid SOA Svc SOA Svc SOA Svc SOA Svc SOA Svc App 3 App 2
What is Application Grid? What It’s  NOT A single product A standard An all-or-none thing Integration What It  IS An approach An architecture A vision A set of best practices Multiple technologies Multiple products Resourcing 06/06/09 ©2008 Oracle Corporation
Do I Have to Start Over? Evolution to application grid Automation/Optimization Low-Level, Localized High-Level, Cross-Data Center Dynamic Scaling Course-Grained Fine-Grained Basic  Cluster  Scale-Out In-Memory Dynamic Grid Scale-Out Basic  Management Policy/Rules-Based Automated Scale-Out Automated service startup and failover Enterprise-Wide Dynamic  Optimization 06/06/09 ©2008 Oracle Corporation
Application Grid Benefits 06/06/09 ©2008 Oracle Corporation  Flexible Scaling High Quality of Service Efficiency Application Application
Business Impact 06/06/09 ©2008 Oracle Corporation  Efficiency =  Grow Despite Constraints Flexible Scale Out =  Adjust Course with Agility High Quality of Service = Rise Above the Competition
QUESTION 2 What is deterministic garbage collection? The latest in environmental waste recycling The route taken by a garbage truck JVM technology that enables predictable, real time performance at the JVM layer
And the Winner is………..
Innovation at the Foundation 9/10/2008 ©2008 Oracle Corporation  New Needs New Abilities New needs and abilities are often most powerfully addressed in lower layers 06/06/09 ©2008 Oracle Corporation  New Ideas API API API Layer 1 e.g. JVM Layer 2 e.g. App Server Layer 3 e.g. SOA Layer 4 e.g. BPM Deterministic Garbage Collection AJAX  Acceleration In-memory  Data Grid
Application Grid Fundamentals Core capabilities 06/06/09 ©2008 Oracle Corporation  2.  Control Allocation 3.  View Behavior 4.  Automate 1.  Share Resources Management App App App SOA Svc SOA Svc
Application Grid Technologies Foundation-level middleware 06/06/09 ©2008 Oracle Corporation  Java C/C++/COBOL Application  Server Transaction  Processing  Monitor In-Memory Data Grid Management Java Virtual Machine
Fusion Middleware Application Grid Comprehensive, hot-pluggable, pre-integrated 06/06/09 ©2008 Oracle Corporation  WebLogic  Server Tuxedo Coherence Enterprise  Manager WebLogic Operations Control JRockit Mission Control Tuxedo System Application Monitor JRockit Provisioning Configuration Management
Building on the Fundamentals Standardized hardware, rock-solid nodes, automation   06/06/09 ©2008 Oracle Corporation  Node Performance Node Reliability Node Configurability Node Predictability Tuxedo Tuxedo Tuxedo JRockit WLS JRockit WLS JRockit WLS JRockit Coherence JRockit Coherence JRockit Coherence WLOC
Decoupled Resourcing Add standardized, streamlined, commodity hardware 06/06/09 ©2008 Oracle Corporation  Lower Cost, Less Complexity, Easier Diagnostics
Predictable Reliability, Performance WebLogic Server, JRockit, Tuxedo WebLogic Server: World’s #1 application server JRockit: World’s fastest JVM and only guaranteed predictable performance for standard Java Tuxedo: World’s #1 distributed TPM for mainframe-class reliability, performance, and scale on commodity hardware 06/06/09 ©2008 Oracle Corporation
Predictable Reliability, Performance WebLogic Server, JRockit, Tuxedo WebLogic Server: World’s #1 application server JRockit: World’s fastest JVM and only guaranteed predictable performance for standard Java Tuxedo: World’s #1 distributed TPM for mainframe-class reliability, performance, and scale on commodity hardware 06/06/09 ©2008 Oracle Corporation  Differentiator #1: Guaranteed Predictable Performance
Node Configurability Modular application server means efficiency 06/06/09 ©2008 Oracle Corporation  Different application server instances in the grid have different modules enabled Application Grid App Svr App Svr Mem Grid JVM Application Server 1 Application Server 2
QUESTION 3 Which of the following best describes you? Use Coherence within your organisation. Don’t use Coherence but you know what it is. Familiar with the concept of a  distributed cache/in-memory data grid. Not at all Coherent.
And the Winner is………..
Coherence In-Memory Data Grid Fine-grained dynamic scaling, performance, reliability Memory spans  multiple machines Add/remove nodes  dynamically Scale  linearly  to thousands Reliability through  redundancy Performance through  parallelization Integration through  shared memory grid Tuxedo 06/06/09 ©2008 Oracle Corporation  OS JVM Coherence WebLogic Server OS JVM OS JVM
Coherence In-Memory Data Grid Fine-grained dynamic scaling, performance, reliability Memory spans  multiple machines Add/remove nodes  dynamically Scale  linearly  to thousands Reliability through  redundancy Performance through  parallelization Integration through  shared memory grid Tuxedo 06/06/09 ©2008 Oracle Corporation  OS JVM Coherence WebLogic Server OS JVM OS JVM Differentiator #2: True Dynamic Scaling
Key to Application Grid: Management Need the right levels and right automation 06/06/09 ©2008 Oracle Corporation  Application Grid App Svr App Svr App Mem Grid JVM Database Enterprise  Management Grid  Management OS HW
Cross-Stack Management Instrumentation at each level; intelligent synthesis 06/06/09 ©2008 Oracle Corporation  Is this application near any critical SLA threshold? Do I need to adjust parameters on this machine? Do I need to adjust the memory grid? Can I better optimize grid across all applications? Management App Svr Mem Grid JVM Applica
WebLogic Operations Control Intelligent synthesis 06/06/09 ©2008 Oracle Corporation  WebLogic Operations Control Policies SLA Needs Manual Input Resource Adjust Svc  Start/ Stop Metrics Automation App Svr Mem Grid JVM Applica
WebLogic Operations Control Intelligent synthesis 06/06/09 ©2008 Oracle Corporation  WebLogic Operations Control Policies SLA Needs Manual Input Resource Adjust Svc  Start/ Stop Metrics Automation Differentiator #3: Cross-Stack  Grid Management App Svr Mem Grid JVM Applica
Case Study: Large Web Application 06/06/09 ©2008 Oracle Corporation  Problem Controlling IT costs by moving away from one-off purchasing Eliminating downtime that can cost the company thousands of dollars per minute Implementing upgrades seamlessly Scenario High-volume consumer-facing transactional Web application with high growth Profile Large Web-based social networking app 17 million registered users 10,000+ new users daily Application Grid Standardized hardware Use of WebLogic Server clustering for scale out Standardized WebLogic Server nodes replicated through WLST scripting Looking at JRockit and Coherence Solution 40-node cluster of WLS 10 for main site Provides dependable high availability Extensive use of WLST scripting to achieve  grid-like provisioning Side-by-side app deployments to allow for smoother  app upgrades Improve customer satisfaction with superior performance
Getting Started There are some easy early wins! Identify areas of greatest  pain Inefficiency Inflexibility Performance/reliability Identify areas of greatest  opportunity Where  small improvements  get big returns Where  existing infrastructure  already supports some “gridness” Build a  plan Short term:  leverage existing  grid enablement Short-Medium term:  augment  with better grid infrastructure Medium-Long term: build out application grid  across data center $ ¥ £ € 06/06/09 ©2008 Oracle Corporation
Factors to Keep in Mind Not All Grid Enablers are Created Equal The More… Comprehensive Cross-stack integrated Live, production hot-pluggable Predictable Manageable … your infrastructure elements are, the more successful will be your application grid ©2008 Oracle Corporation  06/06/09 JRockit WebLogic Server Tuxedo Coherence
Take-Aways Application Grid  is an approach to foundation infrastructure based on resource  pooling  and  sharing 06/06/09 ©2008 Oracle Corporation  Key   Enablers   Are Control Visibility Management  Only  Oracle   enables Guaranteed, predictable performance True dynamic scaling Cross-stack management Key  Benefits  Are  Efficiency Flexible scaling High quality of service
 
Evaluation 1 How did you rate the Content and Presentation that was presented? Poor     Excellent 1 5
Evaluation 2 How do you rate the presenters Moustache? Poor     Excellent 1 5
 

Matt Wright - The Application Grid

  • 1.
  • 2.
    Delivering Efficiency andExpansion from the Ground Up: The Application Grid Matt Wright Director, Product Management, Oracle Fusion Middleware
  • 3.
    QUESTION 1 Whichof the following technologies do you use? WebLogic Server Oracle Application Server Tuxedo More than one of the above
  • 4.
    And the Winneris………..
  • 5.
    Grid 06/06/09 ©2008Oracle Corporation
  • 6.
    The Real ChallengesWhat is really limiting efficiency and expansion? Volatility of needs Tight coupling Granularity mismatch 06/06/09 ©2008 Oracle Corporation Needs Resource Resource Resource
  • 7.
    “You Are Here”06/06/09 ©2008 Oracle Corporation
  • 8.
    Problems In Today’sIT The legacy of dedicated stacks 06/06/09 ©2008 Oracle Corporation OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy Inefficiency Difficult Scale-Out Limited Performance
  • 9.
    Alternative #1: MoreBoxes Just adding hardware won’t always help OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy 06/06/09 ©2008 Oracle Corporation
  • 10.
    Alternative #2: JustFix with SOA or BPM You can’t just paper over fundamentals 06/06/09 ©2008 Oracle Corporation Custom App Packaged App SOA Svc C/C++/ COBOL Legacy SOA/BPM OS JVM App Svr OS JVM App Svr OS JVM App Svr OS TPM OS TPM
  • 11.
    Alternative #3: ImproveApplications Costly, complex, time-consuming OS JVM App Svr Custom App OS JVM App Svr Packaged App OS JVM App Svr SOA Svc OS TPM C/C++/ COBOL OS TPM Legacy 06/06/09 ©2008 Oracle Corporation New! New! New! New! New!
  • 12.
    A New Approach: Application Grid 06/06/09 ©2008 Oracle Corporation Efficiency Flexible Scaling High Quality of Service Application Grid Custom App Packaged App SOA Svc C/C++/ COBOL Legacy
  • 13.
    The Impact ofSOA Even greater need for dynamic adjustment 06/06/09 ©2008 Oracle Corporation App 1 Application Grid SOA Svc SOA Svc SOA Svc SOA Svc SOA Svc App 3 App 2
  • 14.
    Inside the ApplicationGrid Pooling, sharing, dynamic adjustment 06/06/09 ©2008 Oracle Corporation App 1 Application Grid SOA Svc SOA Svc SOA Svc SOA Svc SOA Svc App 3 App 2
  • 15.
    What is ApplicationGrid? What It’s NOT A single product A standard An all-or-none thing Integration What It IS An approach An architecture A vision A set of best practices Multiple technologies Multiple products Resourcing 06/06/09 ©2008 Oracle Corporation
  • 16.
    Do I Haveto Start Over? Evolution to application grid Automation/Optimization Low-Level, Localized High-Level, Cross-Data Center Dynamic Scaling Course-Grained Fine-Grained Basic Cluster Scale-Out In-Memory Dynamic Grid Scale-Out Basic Management Policy/Rules-Based Automated Scale-Out Automated service startup and failover Enterprise-Wide Dynamic Optimization 06/06/09 ©2008 Oracle Corporation
  • 17.
    Application Grid Benefits06/06/09 ©2008 Oracle Corporation Flexible Scaling High Quality of Service Efficiency Application Application
  • 18.
    Business Impact 06/06/09©2008 Oracle Corporation Efficiency = Grow Despite Constraints Flexible Scale Out = Adjust Course with Agility High Quality of Service = Rise Above the Competition
  • 19.
    QUESTION 2 Whatis deterministic garbage collection? The latest in environmental waste recycling The route taken by a garbage truck JVM technology that enables predictable, real time performance at the JVM layer
  • 20.
    And the Winneris………..
  • 21.
    Innovation at theFoundation 9/10/2008 ©2008 Oracle Corporation New Needs New Abilities New needs and abilities are often most powerfully addressed in lower layers 06/06/09 ©2008 Oracle Corporation New Ideas API API API Layer 1 e.g. JVM Layer 2 e.g. App Server Layer 3 e.g. SOA Layer 4 e.g. BPM Deterministic Garbage Collection AJAX Acceleration In-memory Data Grid
  • 22.
    Application Grid FundamentalsCore capabilities 06/06/09 ©2008 Oracle Corporation 2. Control Allocation 3. View Behavior 4. Automate 1. Share Resources Management App App App SOA Svc SOA Svc
  • 23.
    Application Grid TechnologiesFoundation-level middleware 06/06/09 ©2008 Oracle Corporation Java C/C++/COBOL Application Server Transaction Processing Monitor In-Memory Data Grid Management Java Virtual Machine
  • 24.
    Fusion Middleware ApplicationGrid Comprehensive, hot-pluggable, pre-integrated 06/06/09 ©2008 Oracle Corporation WebLogic Server Tuxedo Coherence Enterprise Manager WebLogic Operations Control JRockit Mission Control Tuxedo System Application Monitor JRockit Provisioning Configuration Management
  • 25.
    Building on theFundamentals Standardized hardware, rock-solid nodes, automation 06/06/09 ©2008 Oracle Corporation Node Performance Node Reliability Node Configurability Node Predictability Tuxedo Tuxedo Tuxedo JRockit WLS JRockit WLS JRockit WLS JRockit Coherence JRockit Coherence JRockit Coherence WLOC
  • 26.
    Decoupled Resourcing Addstandardized, streamlined, commodity hardware 06/06/09 ©2008 Oracle Corporation Lower Cost, Less Complexity, Easier Diagnostics
  • 27.
    Predictable Reliability, PerformanceWebLogic Server, JRockit, Tuxedo WebLogic Server: World’s #1 application server JRockit: World’s fastest JVM and only guaranteed predictable performance for standard Java Tuxedo: World’s #1 distributed TPM for mainframe-class reliability, performance, and scale on commodity hardware 06/06/09 ©2008 Oracle Corporation
  • 28.
    Predictable Reliability, PerformanceWebLogic Server, JRockit, Tuxedo WebLogic Server: World’s #1 application server JRockit: World’s fastest JVM and only guaranteed predictable performance for standard Java Tuxedo: World’s #1 distributed TPM for mainframe-class reliability, performance, and scale on commodity hardware 06/06/09 ©2008 Oracle Corporation Differentiator #1: Guaranteed Predictable Performance
  • 29.
    Node Configurability Modularapplication server means efficiency 06/06/09 ©2008 Oracle Corporation Different application server instances in the grid have different modules enabled Application Grid App Svr App Svr Mem Grid JVM Application Server 1 Application Server 2
  • 30.
    QUESTION 3 Whichof the following best describes you? Use Coherence within your organisation. Don’t use Coherence but you know what it is. Familiar with the concept of a distributed cache/in-memory data grid. Not at all Coherent.
  • 31.
    And the Winneris………..
  • 32.
    Coherence In-Memory DataGrid Fine-grained dynamic scaling, performance, reliability Memory spans multiple machines Add/remove nodes dynamically Scale linearly to thousands Reliability through redundancy Performance through parallelization Integration through shared memory grid Tuxedo 06/06/09 ©2008 Oracle Corporation OS JVM Coherence WebLogic Server OS JVM OS JVM
  • 33.
    Coherence In-Memory DataGrid Fine-grained dynamic scaling, performance, reliability Memory spans multiple machines Add/remove nodes dynamically Scale linearly to thousands Reliability through redundancy Performance through parallelization Integration through shared memory grid Tuxedo 06/06/09 ©2008 Oracle Corporation OS JVM Coherence WebLogic Server OS JVM OS JVM Differentiator #2: True Dynamic Scaling
  • 34.
    Key to ApplicationGrid: Management Need the right levels and right automation 06/06/09 ©2008 Oracle Corporation Application Grid App Svr App Svr App Mem Grid JVM Database Enterprise Management Grid Management OS HW
  • 35.
    Cross-Stack Management Instrumentationat each level; intelligent synthesis 06/06/09 ©2008 Oracle Corporation Is this application near any critical SLA threshold? Do I need to adjust parameters on this machine? Do I need to adjust the memory grid? Can I better optimize grid across all applications? Management App Svr Mem Grid JVM Applica
  • 36.
    WebLogic Operations ControlIntelligent synthesis 06/06/09 ©2008 Oracle Corporation WebLogic Operations Control Policies SLA Needs Manual Input Resource Adjust Svc Start/ Stop Metrics Automation App Svr Mem Grid JVM Applica
  • 37.
    WebLogic Operations ControlIntelligent synthesis 06/06/09 ©2008 Oracle Corporation WebLogic Operations Control Policies SLA Needs Manual Input Resource Adjust Svc Start/ Stop Metrics Automation Differentiator #3: Cross-Stack Grid Management App Svr Mem Grid JVM Applica
  • 38.
    Case Study: LargeWeb Application 06/06/09 ©2008 Oracle Corporation Problem Controlling IT costs by moving away from one-off purchasing Eliminating downtime that can cost the company thousands of dollars per minute Implementing upgrades seamlessly Scenario High-volume consumer-facing transactional Web application with high growth Profile Large Web-based social networking app 17 million registered users 10,000+ new users daily Application Grid Standardized hardware Use of WebLogic Server clustering for scale out Standardized WebLogic Server nodes replicated through WLST scripting Looking at JRockit and Coherence Solution 40-node cluster of WLS 10 for main site Provides dependable high availability Extensive use of WLST scripting to achieve grid-like provisioning Side-by-side app deployments to allow for smoother app upgrades Improve customer satisfaction with superior performance
  • 39.
    Getting Started Thereare some easy early wins! Identify areas of greatest pain Inefficiency Inflexibility Performance/reliability Identify areas of greatest opportunity Where small improvements get big returns Where existing infrastructure already supports some “gridness” Build a plan Short term: leverage existing grid enablement Short-Medium term: augment with better grid infrastructure Medium-Long term: build out application grid across data center $ ¥ £ € 06/06/09 ©2008 Oracle Corporation
  • 40.
    Factors to Keepin Mind Not All Grid Enablers are Created Equal The More… Comprehensive Cross-stack integrated Live, production hot-pluggable Predictable Manageable … your infrastructure elements are, the more successful will be your application grid ©2008 Oracle Corporation 06/06/09 JRockit WebLogic Server Tuxedo Coherence
  • 41.
    Take-Aways Application Grid is an approach to foundation infrastructure based on resource pooling and sharing 06/06/09 ©2008 Oracle Corporation Key Enablers Are Control Visibility Management Only Oracle enables Guaranteed, predictable performance True dynamic scaling Cross-stack management Key Benefits Are Efficiency Flexible scaling High quality of service
  • 42.
  • 43.
    Evaluation 1 Howdid you rate the Content and Presentation that was presented? Poor Excellent 1 5
  • 44.
    Evaluation 2 Howdo you rate the presenters Moustache? Poor Excellent 1 5
  • 45.