First Steps With Grid Computing


Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • First Steps With Grid Computing

    1. 2. First Steps with Grid Computing & Oracle Application Server 10 g Venkata Ravipati Product Manager Oracle Corporation Session id: 40187 Sastry malladi CMTS Oracle Corporation Jamie Shiers IT Division, CERN [email_address]
    2. 3. Agenda <ul><li>Introduction Grid Computing </li></ul><ul><li>OracleAS 10 g Features </li></ul><ul><li>CERN Case Study </li></ul><ul><li>OracleAS 10 g Roadmap </li></ul><ul><li>Q&A </li></ul>Introduction Grid Computing
    3. 4. IT Challenges <ul><li>Enterprise I/T is highly fragmented, leading to </li></ul><ul><ul><li>poor utilization, excess capacity, and systems inflexibility. </li></ul></ul><ul><li>Adding capacity is complex and labor-intensive </li></ul><ul><li>Systems are fragmented into inflexible “islands” </li></ul><ul><li>Expensive server capacity sits underutilized </li></ul><ul><li>Installing, configuring, and managing application infrastructure is slow and expensive </li></ul><ul><li>Poorly integrated applications with redundant functionality increase costs and limit business responsiveness </li></ul>
    4. 5. Grid Computing Solves IT Problems <ul><li>High cost of adding capacity </li></ul><ul><li>Islands of inflexible systems </li></ul><ul><li>Underutilized server capacity </li></ul><ul><li>Hard to configure and manage </li></ul><ul><li>Poorly integrated applications with redundant functions </li></ul><ul><li>Pool modular, low-cost hardware components </li></ul><ul><li>Virtualize system resources </li></ul><ul><li>Dynamically allocate workloads and information </li></ul><ul><li>Unify management and automate provisioning </li></ul><ul><li>Compose applications from reusable services </li></ul>IT Problem Grid Solution
    5. 6. What is Grid computing <ul><li>Grid computing is a hardware and software infrastructure that enable </li></ul><ul><ul><li>Transparent Resource Sharing across an enterprise:Divisions,Data Centers, Resources Categories </li></ul></ul><ul><ul><ul><li>Computers </li></ul></ul></ul><ul><ul><ul><li>Storage, </li></ul></ul></ul><ul><ul><ul><li>Databases </li></ul></ul></ul><ul><ul><ul><li>Application Servers </li></ul></ul></ul><ul><ul><ul><li>Applications </li></ul></ul></ul><ul><ul><li>Coordination resources that are not subject to centralized control </li></ul></ul><ul><ul><li>Using standard, open, general-purpose protocols and interfaces </li></ul></ul><ul><ul><li>To deliver nontrivial qualities of service </li></ul></ul>
    6. 7. Enterprise Grid Infrastructure Must Be Comprehensive Management Middleware Database Storage
    7. 8. Agenda <ul><li>Introduction Grid Computing </li></ul><ul><li>OracleAS 10 g Features </li></ul><ul><li>CERN Case Study </li></ul><ul><li>OracleAS 10 g Roadmap </li></ul><ul><li>Q&A </li></ul>OracleAS 10 g Features
    8. 9. Introducing Oracle 10 g <ul><li>Complete, integrated grid infrastructure </li></ul>
    9. 10. Oracle Application Server 10 g 10 g Workload Management Workload Management Software Provisioning User Provisioning Application Availability Application Development Application Monitoring
    10. 11. Workload Management <ul><li>Adding and allocating computing capacity is expensive and too slow to adapt to changing business requirements </li></ul><ul><li>Virtualize servers as modular HW resources </li></ul><ul><li>Virtualize software as reusable run-time services </li></ul><ul><li>Manage workloads automatically based on pre-defined policies </li></ul>IT Problem Oracle 10 g Solution
    11. 12. Virtualized Hardware Resources Add Capacity Quickly and Economically
    12. 13. Virtualized Middleware Services Accounting Application Group Collections of Resources and Runtime Services into Logical Applications HTTP Server Web Cache J2EE Server
    13. 14. Policy-based Workload Management Policy Manager Stores application-specific policies Resource Manager Manages resource availability/status Dispatcher & Scheduler Distribute workloads based on application-specific policies Workload Manager
    14. 15. Middleware Services <ul><li>HTTP servers </li></ul><ul><li>Web caches </li></ul><ul><li>J2EE servers </li></ul><ul><li>EJB processes </li></ul><ul><li>Portal services </li></ul><ul><li>Wireless services </li></ul><ul><li>Web services </li></ul><ul><li>Integration services </li></ul><ul><li>Directory services </li></ul><ul><li>Authentication services </li></ul><ul><li>Authorization services </li></ul><ul><li>Enterprise Reporting services </li></ul><ul><li>Query Analysis services </li></ul>
    15. 16. Metrics-based Workload Reallocation Unexpected demand!  shift more capacity to Web Store <ul><li>Employee Portal </li></ul><ul><li>Portal </li></ul><ul><li>Accounting </li></ul><ul><li>Discoverer, reports </li></ul><ul><li>Web Store </li></ul><ul><li>HTTP, J2EE Server </li></ul>
    16. 17. Scheduled Workload Reallocation General Ledger Order Entry General Ledger Order Entry Start of Quarter: End of Quarter:
    17. 18. Policy-based Edge Caching <ul><li>Virtualized pools of storage enable sharing and transfer of data between nodes </li></ul><ul><li>Adaptive caching policies flexibly accommodate changing demand </li></ul>Virtual HTTP Server Grid Caches Client
    18. 19. Oracle Application Server 10 g 10 g Software Provisioning User Provisioning Application Availability Application Development Application Monitoring Workload Management
    19. 20. Software Provisioning <ul><li>Installing, configuring, upgrading and patching systems is labor-intensive and too slow to adapt to changing business requirements </li></ul><ul><li>Manage virtualized HW and SW resources as one system </li></ul><ul><li>Automate installation, configuration, upgrading, and patching processes </li></ul>IT Problem Oracle 10 g Solution
    20. 21. Software Provisioning <ul><li>Grid Control Repository (GCR) with centralized inventories for installation and configuration </li></ul><ul><ul><li>Provision servers </li></ul></ul><ul><ul><li>Provision software </li></ul></ul><ul><ul><li>Provision users </li></ul></ul>Grid Control Repository
    21. 22. Automated Deployment <ul><li>Install and configure a single server node </li></ul><ul><li>Register configuration to the Repository </li></ul><ul><li>Automatically deploy to nodes as they are added to the grid </li></ul>Grid Control Repository
    22. 23. Software Cloning Select Software and Instances to Clone 1 <ul><li>Automated provisioning based on master node </li></ul><ul><li>Archive & replicate specific configurations </li></ul><ul><ul><li>e.g. : Payroll config. optimized for Fridays at 4:00pm </li></ul></ul><ul><li>Context-specific adjustments </li></ul><ul><ul><li>e.g. : IP address, host name, web listener </li></ul></ul>Update Configuration Inventory in GCR 3 Clone to Selected Targets 2
    23. 24. Patch and Update Management <ul><li>Real-time discovery of new patches </li></ul><ul><li>Automated staging and application of patches </li></ul><ul><li>Rolling application upgrades </li></ul><ul><li>Patch history tracking </li></ul>Determine Applicability 2 Apply Patch/ Upgrade 3 Patch Published 1 Update Patch Inventory in GCR 4
    24. 25. Oracle Application Server 10 g 10 g Software Provisioning User Provisioning Application Availability Application Development Application Monitoring Workload Management
    25. 26. User Provisioning <ul><li>It takes too long to register new users </li></ul><ul><li>Users have too many accounts, passwords, and privileges to manage </li></ul><ul><li>Developers re-implement authentication for each new application </li></ul><ul><li>Centralized identity management </li></ul><ul><li>Shared authentication service </li></ul>IT Problem Oracle 10g Solution
    26. 27. Single Sign-on Across the Grid Accounting Sales Portal Directory Support Portal <ul><li>Consolidate accounts </li></ul><ul><li>Simplify management </li></ul><ul><li>Facilitate re-use </li></ul>Client
    27. 28. <ul><li>Create users once </li></ul><ul><ul><li>Centrally manage roles, privileges, preferences </li></ul></ul><ul><li>Support single password for all applications </li></ul><ul><li>Delegate administration </li></ul><ul><ul><li>Locally administered departments, LOBs, etc. </li></ul></ul><ul><ul><li>User self-service </li></ul></ul><ul><li>Interoperate with existing security infrastructure </li></ul>User Provisioning
    28. 29. Oracle Application Server 10 g 10 g Software Provisioning User Provisioning Application Availability Application Development Application Monitoring Workload Management
    29. 30. Application Availability <ul><li>Ensuring required levels of availability is too expensive </li></ul><ul><li>Modular components provide inexpensive redundancy </li></ul><ul><li>Coordinated response to system failures ensures application availability </li></ul>IT Problem Oracle 10g Solution
    30. 31. Application Availability <ul><li>Transparent Application Failover (TAF) </li></ul><ul><ul><li>Automatic session migration </li></ul></ul><ul><li>Fast-Start Fault Recovery™ </li></ul><ul><ul><li>Automatic failure detection and recovery </li></ul></ul><ul><li>Multi-tier Failover Notification (FaN) </li></ul><ul><ul><li>Speeds end-to-end application failover time </li></ul></ul><ul><ul><li>From 15 minutes to <15 seconds </li></ul></ul>
    31. 32. Transparent Application Failover <ul><li>Employee Portal </li></ul><ul><li>Portal </li></ul><ul><li>Accounting </li></ul><ul><li>Discoverer, reports </li></ul><ul><li>Web Store </li></ul><ul><li>HTTP, J2EE Server </li></ul>Resource failure!  fail-over the service to additional nodes
    32. 33. Fast-Start Fault Recovery™ <ul><li>Employee Portal </li></ul><ul><li>Portal </li></ul><ul><li>Accounting </li></ul><ul><li>Discoverer, reports </li></ul><ul><li>Web Store </li></ul><ul><li>HTTP, J2EE Server </li></ul>Nodes recovered  re-instate automatically
    33. 34. <ul><li>Overcomes TCP/IP timeout delays associated with cross-tier application failovers: </li></ul>Multi-tier Failover Notification (FaN) > 15 mins < 12 secs 15 mins < 4 secs Without FaN With FaN RAC Failover AS Detection Total Downtime < 8 secs* < 8 secs*
    34. 35. Oracle Application Server 10 g 10 g Software Provisioning User Provisioning Application Availability Application Development Application Monitoring Workload Management
    35. 36. Application Monitoring <ul><li>Insufficient performance data to plan, tune, and manage systems effectively </li></ul><ul><li>Software pre-instrumented to provide status and fine-grained performance data </li></ul><ul><li>Centralized console analyzes and summarizes Grid performance </li></ul>IT Problem Oracle 10g Solution
    36. 37. Application Monitoring <ul><li>Monitor virtual application resources </li></ul><ul><ul><li>e.g. : J2EE containers, HTTP servers, Web caches, firewalls, routers, software components, etc. </li></ul></ul><ul><li>Root cause diagnostics </li></ul><ul><li>Track real-time and historic performance metrics </li></ul><ul><ul><li>App. availability, business transactions, end user perf. </li></ul></ul><ul><li>Notifications and alerts </li></ul><ul><li>Administer service level agreements (SLAs) </li></ul>
    37. 38. Repository-based Management <ul><li>Centralized repository-based management provides a unified view of entire infrastructure </li></ul><ul><li>Manage all your end-to-end application infrastructure from any device </li></ul>Grid Control Repository Computer Host Database Storage System App Server Client Router/Switch Firewall Portals Clusters Integration Web Sites Custom Apps
    38. 39. Performance Monitoring <ul><li>Capture real-time and historical performance data </li></ul><ul><li>Analyze and tune workload policies </li></ul><ul><li>Answer questions like: </li></ul><ul><ul><li>“ How much time is being spent in just the JDBC part of this application?” </li></ul></ul><ul><ul><li>“ What was the average response time over the past 3, 6, and 9 months?” </li></ul></ul>
    39. 40. <ul><li>User specified targets, metrics, and thresholds </li></ul><ul><ul><li>e.g. : CPU utilization, user response times, etc. </li></ul></ul><ul><li>Flexible notification methods </li></ul><ul><ul><li>e.g. : Phone, e-mail, fax, SMS, etc. </li></ul></ul><ul><li>Self-correction via pre-defined responses </li></ul><ul><ul><li>e.g. : Execute a script to shut down low priority jobs </li></ul></ul>Policy-based Alerts
    40. 41. Agenda <ul><li>Introduction Grid Computing </li></ul><ul><li>OracleAS 10 g Features </li></ul><ul><li>CERN Case Study </li></ul><ul><li>OracleAS 10 g Roadmap </li></ul><ul><li>Q&A </li></ul>
    41. 42. LHC Computing Grid Project Oracle-based Production Services for LCG 1
    42. 43. Goals <ul><li>To offer production quality services for LCG 1 to meet the requirements of forthcoming (and current!) data challenges </li></ul><ul><ul><li>e.g. CMS PCP/DC04, ALICE PDC-3, ATLAS DC2, LHCb CDC’04 </li></ul></ul><ul><li>To provide distribution kits, scripts and documentation to assist other sites in offering production services </li></ul><ul><li>To leverage the many years’ experience in running such services at CERN and other institutes </li></ul><ul><ul><li>Monitoring, backup & recovery, tuning, capacity planning, … </li></ul></ul><ul><li>To understand experiments’ requirements in how these services should be established, extended and clarify current limitations </li></ul><ul><li>Not targeting small-medium scale DB apps that need to be run and administered locally (to user) </li></ul>
    43. 44. What Services? <ul><li>POOL file catalogue using EDG-RLS (also non-POOL!) </li></ul><ul><ul><li>LRC + RLI services + client APIs </li></ul></ul><ul><ul><li>For GUID <-> PFN mappings </li></ul></ul><ul><li>and EDG-RMC </li></ul><ul><ul><li>For file-level meta-data: POOL currently stores: </li></ul></ul><ul><ul><ul><li>filetype (e.g. ROOT file), fully registered, job status </li></ul></ul></ul><ul><ul><li>Expect also ~10 items from CMS DC04: others? </li></ul></ul><ul><li>plus (service behind) EDG Replica Manager client tools </li></ul><ul><li>Need to provide robustness, recovery, scalability, performance, … </li></ul><ul><li>File catalogue is a critical component of the Grid! </li></ul><ul><ul><li>Job scheduling, data access, … </li></ul></ul>
    44. 45. The Supported Configuration <ul><li>All participating sites should run: </li></ul><ul><li>A “Local Replica Catalogue” (LRC) </li></ul><ul><ul><li>Contains GUID <-> PFN mapping for all local files </li></ul></ul><ul><li>A “Replica Location Index” (RLI) <-- independent of EDG deadlines </li></ul><ul><ul><li>Allows files at other sites to be found </li></ul></ul><ul><ul><li>All LRCs are configured to publish to all remote RLIs </li></ul></ul><ul><ul><ul><li>Scalability beyond O(10) sites?? </li></ul></ul></ul><ul><ul><ul><li>Hierarchical and other configurations may come later… </li></ul></ul></ul><ul><li>A “Replica Metadata Catalogue” (RMC) </li></ul><ul><ul><li>Not proposing a single, central RMC </li></ul></ul><ul><ul><li>Jobs should use local RMC </li></ul></ul><ul><ul><li>Short-term: handle synchronisation across RMCs </li></ul></ul><ul><ul><ul><li>In principle possible today “on the POOL-side” (to be tested) </li></ul></ul></ul><ul><ul><li>Long-term: middleware re-engineering? </li></ul></ul>
    45. 46. Component Overview Replica Location Index Local Replica Catalog Storage Element <ul><ul><li>CNAF </li></ul></ul>Replica Location Index Local Replica Catalog Storage Element RAL Replica Location Index Local Replica Catalog Storage Element CERN Replica Location Index Local Replica Catalog Storage Element IN2P3
    46. 47. Where should these services be run? <ul><li>At sites that can provide supported h/w & O/S configurations (next slide) </li></ul><ul><li>At sites with existing Oracle support team </li></ul><ul><li>We do not yet know whether we can make Oracle-based services easy enough to setup (surely?) and run (should be for canned apps?) where existing Oracle experience is not available </li></ul><ul><ul><li>Will learn a lot from current roll-out </li></ul></ul><ul><ul><li>Pros: can benefit from scripts / doc / tools etc. </li></ul></ul><ul><ul><li>Other sites: simply re-extract catalog subset from nearest Tier1 in case of problems? </li></ul></ul><ul><ul><li>Need to understand use-cases and service level </li></ul></ul>
    47. 48. Requirements for Deployment <ul><li>A farm node running Red Hat Enterprise Linux and Oracle9iAS </li></ul><ul><ul><li>Runs Java middleware for LRC, RLI etc. </li></ul></ul><ul><ul><li>One per VO </li></ul></ul><ul><li>A disk server running Red Hat Enterprise Linux and Oracle9i </li></ul><ul><ul><li>Data volume for LCG 1 small (~10 5 – 10 6 entries, each < 1KB) </li></ul></ul><ul><ul><li>Query / lookup rate low (~1 every 3 seconds) </li></ul></ul><ul><ul><ul><li>Projection to 2008: 100 – 1000Hz; 10 9 entries </li></ul></ul></ul><ul><ul><li>Shared between all VOs at a given site </li></ul></ul><ul><li>Site responsible for acquiring and installing h/w and RHEL </li></ul><ul><ul><li>$349 for ‘basic edition’ http://www. redhat .com/software/ rhel / es / </li></ul></ul>
    48. 49. What if? <ul><li>DB server dies </li></ul><ul><ul><li>No access to catalog until new server configured & DB restored </li></ul></ul><ul><ul><li>‘ Hot standby’ or clustered solution offers protection against most common cases </li></ul></ul><ul><ul><li>Regular dump of full catalog into alternate format, e.g. POOL XML? </li></ul></ul><ul><li>Application server dies </li></ul><ul><ul><li>Stateless, hence relatively simple move to a new host </li></ul></ul><ul><ul><ul><li>Could share with another VO </li></ul></ul></ul><ul><ul><li>Handled automatically with application server clusters </li></ul></ul><ul><li>Data corrupted </li></ul><ul><ul><li>Restore or switch to alternate catalog </li></ul></ul><ul><li>Software problems </li></ul><ul><ul><li>Hardest to predict and protect against </li></ul></ul><ul><ul><li>Could cause running jobs to fail and drain batch queues! </li></ul></ul><ul><ul><li>Very careful testing, including by experiments, before move to a new version of the middleware (weeks, including smallish production run?) </li></ul></ul><ul><li>Need to foresee all possible problems, establish recovery plan and test! </li></ul>What happens during period when catalog is unavailable?
    49. 50. Backup & Recovery, Monitorin g <ul><li>Backend DB included in standard backup scheme </li></ul><ul><ul><li>Daily full, hourly incrementals + archive log – allows point in time recovery </li></ul></ul><ul><ul><li>Need additional logging plus agreement with experiments to understand ‘point in time’ to recover to – and testing! </li></ul></ul><ul><li>Monitoring: both at box-level (FIO) and DB/AS/middleware </li></ul><ul><li>Need to ensure problems (inevitable, even if undesirable) are handled gracefully </li></ul><ul><li>Recovery tested regularly, by several members of the team </li></ul><ul><li>Need to understand expectations: </li></ul><ul><ul><li>Catalog entries guaranteed for ever? </li></ul></ul><ul><ul><li>Granularity of recovery? </li></ul></ul>
    50. 51. Recommended Usage - Now <ul><li>POOL jobs: recommend extracting catalog sub-set prior to job and post-cataloging new entries as separate step </li></ul><ul><li>Non-POOL jobs, e.g. EDG-RM client: minimum, test RC and implement simple retry + provide enough output in job log for manual recovery if necessary </li></ul><ul><ul><li>Perpetual retry inappropriate if e.g. configuration error </li></ul></ul><ul><li>In all cases, need to foresee hiccoughs in service e.g. 1 hour, particularly during ramp-up phase </li></ul><ul><li>Please provide us with examples of your usage so that we can ensure adequate coverage by test suite! </li></ul><ul><li>Strict naming convention essential for any non-trivial catalogue maintenance </li></ul>
    51. 52. Status <ul><li>RLS/RLI/RMC services deployed at CERN for each experiment + DTEAM </li></ul><ul><ul><li>RLSTEST service also available, but should not be used for production! </li></ul></ul><ul><li>Distribution mechanism, including kits, scripts and documentation available and ‘well’ debugged </li></ul><ul><li>Only 1 outside site deployed so far (Taiwan) – others in the pipeline </li></ul><ul><ul><li>FZK, RAL, FNAL, IN2P3, NIKHEF … </li></ul></ul><ul><li>We need help to define list and priorities! </li></ul><ul><li>Actual installation rather fast (max a few hours) </li></ul><ul><li>Lead time can be long </li></ul><ul><ul><li>Assign resources etc – a few weeks! </li></ul></ul><ul><li>Plan is (still) to target first sites with Oracle experience to make scripts & doc as clear and smooth as possible </li></ul><ul><ul><li>Then see if it makes sense to go further… </li></ul></ul>
    52. 53. Registration for Access to Oracle Kits <ul><li>Well known method of account registration in dedicated group (OR) </li></ul><ul><li>Names will be added to mailing list to announce e.g. new releases of Oracle s/w, patch sets etc. </li></ul><ul><li>Foreseeing much more gentle roll-out than for previous packages </li></ul><ul><li>Initially just DBAs supporting canned apps </li></ul><ul><ul><li>RLS backend, later potential conditions DB if appropriate </li></ul></ul><ul><li>For simple, moderate-scale DB apps, consider use of central Sun cluster, already used by all LHC experiments </li></ul><ul><li>Distribution kits, scripts etc in afs </li></ul><ul><ul><li>/afs/ </li></ul></ul><ul><li>Documentation also via Web </li></ul><ul><ul><li> </li></ul></ul>
    53. 54. Links <ul><li> </li></ul><ul><li>High level overview of the various components; pointers to presentations on use-cases etc </li></ul><ul><li> </li></ul><ul><li>Detailed installation & configuration instructions </li></ul><ul><li> </li></ul><ul><li>File catalog use-cases, DB requirements, many other talks… </li></ul>
    54. 55. Future Possibilities <ul><li>Investigating resilience against h/w failure using Application Server & Database clusters </li></ul><ul><li>AS clusters also facilitate move of machines, addition of resources, optimal use of resources etc. </li></ul><ul><li>DB clusters (RAC) can be combined with stand-by databases and other techniques for even greater robustness </li></ul><ul><li>(Greatly?) simplified deployment, monitoring and recovery can be expected with Oracle10 g </li></ul>
    55. 56. Summary <ul><li>Addressing production-quality DB services for LCG 1 </li></ul><ul><li>Clearly work in progress, but basic elements in place at CERN, deployment just starting outside </li></ul><ul><li>Based on experience and knowledge of Oracle products, offering distribution kits, documentation and other tools to those sites that are interested </li></ul><ul><li>Need more input on requirements and priorities of experiments regarding production plans </li></ul>
    56. 57. A Q & Q U E S T I O N S A N S W E R S