Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Grid Engine State of the Union


Published on

In this slidecast, Fritz Ferstl from Univa presents: Grid Engine State of the Union.

"Univa Grid Engine is the next generation product that open source Grid Engine users have been waiting for. Our customers save time and money through increased uptime, and with our innovative feature and product evolution they can significantly reduce the total cost of ownership of running Grid Engine. We have improved the speed of several aspects of the product with new features and functionality designed to improve the speed of dispatching and throughput. The following features drive performance of Grid Engine to a new height. They are only available from Univa."

You can watch the presentation recording at:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Grid Engine State of the Union

  1. 1. EvolveSave moneyGet more valueAccelerateGrid Engine “State of the Union”
  2. 2. Who  is  Univa?   •  Data  Center  Automa4on  Experts   •  Based  in  Chicago,  global  reach   •  Dras4c  growth  Y/Y  in  2011  &  2012   •  #  of  customers,  bookings,  etc   •  Unique  Posi4oning  –  Home  of  Grid  Engine   •  Sun  Grid  Engine  core  development  team  works  for  Univa   •  4  of  Top  5  Grid  Engine  sites  by  core  counts   •  4  of  Top  5  Commercial  Grid  Engine  sites   •  4  of  Top  7  Research  Grid  Engine  sites   •  2  of  the  Top  Oil  and  Gas  companies     •  Add-­‐on  products  and  technologies   •  Where  Grid  Engine  evoluIon  happens:   •  26  releases  with  close  to  500  enhancements  and  fixes  in  24  months  © Univa Corporation 2013. All Rights Reserved. 2
  3. 3. Grid Engine - 20 Years of History •  1992: Initial developments @ Genias in Regensburg •  1993: First Customer Shipment (as CODINE) •  1996: Addition of GRD policy module •  Collaboration with Raytheon & Instrumental Inc •  1999: Merger with Chord Systems into Gridware •  2000: Acquisition through Sun •  Re-launch as Sun Grid Engine •  2001: Open Sourcing •  Until 2010: Massive growth in adoption (>10,000 sites) •  2010: Acquisition through Oracle •  Open Source gets orphaned •  2011: Key engineering team joins Univa •  Now: 3rd product release of Univa Grid Engine© Univa Corporation 2013. All Rights Reserved. 3
  4. 4. Situation •  In 2010 Oracle changed the game •  Gone are the days - subsidy from a multi-billion company •  Development in the open •  Features •  Support •  Bug fixes •  Qualified binaries •  Choice remains •  Stay with open source •  Evolve forward© Univa Corporation 2013. All Rights Reserved. 4
  5. 5. Grid Engine: Paid Development 97% of Sun Grid Engine Sun Grid Engine Code checkins were contributed Contributions by Sun. Those contributions ceased in 2010 with 6.2u5 3% (check-ins since day 1 in 2001) Sun The core development team Salaried now works for Univa. Future? Developers 8.1 Lines of Code Univa Grid Engine Changed 97% 8.0.1 8.0 6.2U5 Open Source Grid Engine We cannot predict the Single largest contribution to open source outside of Sun slope of this line. The past can help predict by Univa. 20x larger than all combined 2001-2010. the future. Jan 2011 May 2011 Oct, 2011 Aug, 2012The community offered configuration and “how to” support. Time 5It was not a development oriented community © Univa Corporation 2013. All Rights Reserved.
  6. 6. Univa Grid Engine Optimizes Resources •  Univa provides Grid Engine users with •  Active development of Grid Help organizations play a Engine features better game of Tetris •  Active Technical Support •  Third party integrations •  Add-on products that increase the value of existing systems •  Univa leads Scalability •  Support large cluster capacity with customers above 100,000 cores •  Univa offers Training •  Offer user and admin training to customers •  Univa has partnered with leading HPC hardware and software companies“[Univa] Grid Engine certainly allows us to go live with a newcomponent called Aggregator on Hadoop without a major •  Univa leads the industry in Hadoop +investment. If we didnt have [Univa] Grid Engine, it would be a Grid Engine deploymentsmajor investment to go live on Hadoop because we would have •  5 customers in production with Cloudera andto build a new cluster and incur all the costs around that.” Univa - Katrina Montinola, VP Engineering, Archimedes Model 6
  7. 7. Accomplishments: •  We lead the HPC industry in delivery and execution •  Significant investment in support of customer needs •  Feature Evolution - Targeted at saving time and money •  Three production release of Grid Engine in a year •  >25 production patch releases •  Approximately 450 improvements to Grid Engine •  Product Evolution - Targeted at improving TCO of Grid Engine •  Delivered advanced reporting – UniSight •  Cluster analytics •  About to release License Orchestrator •  Optimizes expensive application licenses •  UniCloud •  Optimizes the availability of local and cloud servers needed to support application workload “There is little competition for Univas Grid Engine business strategy. It knows its target customer base (which is very well qualified), makes its pitch (by phone), and either takes an order or walks away.” John Barr, The 451 Group© Univa Corporation 2013. All Rights Reserved. 7
  8. 8. Customer Traction Market Leading Workflow Management Sample Wins – 82% Revenue from Enterprise© Univa Corporation 2013. All Rights Reserved. 8
  9. 9. What Univa Offers Grid Engine Users •  Univa Grid Engine Customer Program •  Univa Grid Engine is a drop in replacement for Sun and Oracle Grid Engine users •  Migration is an upgrade •  Technical Support from experienced team •  What you need when you need it •  Security and maintenance patches •  Hot fixes, configuration help, tuning guidance •  Continued Product Development •  New, ground-breaking features and improvements – Examples: Hadoop Integration, Job Classes •  Support for new hardware (GPU, Phi, ARM) and Operating Systems •  Access to add-on products - Example: UniSight •  Access to improved documentation •  New Products •  UniCloud •  License Orchestrator •  Native Windows implementation •  Indemnification from open source technologies used in Grid Engine© Univa Corporation 2013. All Rights Reserved. 9
  10. 10. Major  8.1  Features  &  Benefits  •  Univa Grid Engine 8.1 released in Aug 2012•  Current: v8.1.3 (Nov ‘12) - Planned: 8.1.4 (April ’13) Feature   How  Job  Classes   ✔   ✔   ✔   Templates  providing  ease  of  use,  control  and  best  fit  Resource  Maps   ✔   ✔   OpImal  mapping  of  resources  to  jobs  Core  /  NUMA   ✔   ✔   ✔   Tuned  uIlizaIon  of  CPU  and  memory  architectures  Binding  Database   ✔   ✔   ✔   Increased  upIme  @  top  performance  Spooling  Fair  Urgency   ✔   ✔   Balanced  uIlizaIon  of  criIcal  resources  MPI  IntegraIons   ✔   ✔   ✔   Tuned,  out-­‐of-­‐the-­‐box  integraIon  with  MPI  versions  Improved   ✔   ✔   Faster  Ime  to  resoluIon  of  issues  DiagnosIcs   © Univa Corporation 2013. All Rights Reserved. 10
  11. 11. Evolve with Univa •  Lower TCO with our innovative new features •  Improved value is delivered with our new products for Grid Engine sites •  Global enterprise support when and where you need it •  Peace of mind: Univa Grid Engine is an upgrade© Univa Corporation 2013. All Rights Reserved. 11
  12. 12. Thank YouFor more information check out http://www.univa.comOr contact me at fferstl@univa.comWatch out for more insideHPC Slidecasts to follow-on topics like•  Univa enabling Big Data and Big Compute conversion•  Resource management challenges in light of HPC architecture evolution and Univa‘s solutions•  Univa‘s advanced license management (cross-org, cross-geo)•  Univa Grid Engine feature specifics