888 IT Operations Management with Nolio


Published on

888's webinar with Nolio held Feb '10, Covering how 888 achieved IT Operational agility,control and automation using Nolio's ASAP (Application Service Automation Platform) solution.

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Upper part of the slide (red rectangular): major purpose is to describe the symptoms/pains that IT Ops management and team are experiencing today as a results of lack of solutions.The outcome of the new IT service requirements and lack of technological solutions to support it, is high error rates, which according to industry analysts, 60% of application failures in production, are as a result of human errors in the installation and configuration phases.Another common symptom is that Operations teams becomes bottleneck in the organization. Dev teams are introducing high rate and volume of application changes where IT Ops team can not keep up with it.Another major problem is the cost and low efficiency when IT Ops require to handle application deployments, upgrades, patches, maintenance, remediation and recovery, too many people are involved with each process (DBA, Apps Engineers, Web Engineer, Testers..), many of the tasks have to be repeated due to errors, and processes have to run on large scale of servers in many Environments.Lastly, Operations Management team (senior and middle level) are lacking visibility, control and auditing of what is going on in the Datacenter with regard to Application services ( who is doing, what and where in the DC? How well were the processes done? How many times did they have to repeat it? how long a recovery process took? How many rollback were activated last month? Quarter?...)Main Screen animation (major purpose: describe the complexity today and how it is increasing, demonstrating that lack of solutions to handle it, and why the above symptoms are common:Animation1 (Bridge Apps/Ops): the first challenge associated with the application services, is the hand over of deliverables and processes between Dev/Test/Ops teams. Each such handover is a potential for error and mistake.Animation2 (Growing volume…): in the Modern datacenter, the volume of application changes and frequency is increasing. Both for the various application services changes (Deployments, patches, scale, upgrades, remediation..) and the Business needs to fast react to customer needs and business opportunities. The outcome is that now the traditional problematic gap between Apps and Ops must be bridge much more times in much higher frequency, increasing complexity, cost and error probability.Animation 3: if that’s not enough, each of those application services has to be done on complex datacenter applications, multi tier, dependencies, sequencing, each of those layers/tiers can reside on dozens and hundreds of servers. And it that’s not enough…Animation 4: the underlying infrastructure can be multiplatform (unix, linux, win..), reside on different mixture of server type (physical, virtual, cloud), in multiple global distributed datacenters (scalability, DRP)…
  • Nolio’s solution: main purpose is to give overview on Nolio’s solution:Nolio’s solution is designed around the 4 key Application processes, application deployment, application maintenance, Application Remediation and application recovery, enabling IT Ops management the ability to automate and manage the application services.Nolio’s solution has 4 dimensions around the key application services: Standardization: as IT Ops teams, has to interact and receive deliverables and processes from multiple development teams, QA teams, Application Support/Release and Operations teams. Each team today has its own methods and best practices to interact and deliver to the production environments( some use scripts, some manual procedures, some use packages, some use files repositories, some use emails, some use release notes, some will send a developer, sometime the info reside in people’s head…).. In short, lack of standardization.Nolio’s ASAP put in place a standardization mechanism, aligning every delivery format into an application service structure (application name, application component, workflows and permissions).2. Automation Engine (OUTput)- 2nd dimension is the ability to execute the application services on any scale of servers, regardless of the infrastructure type (phy,virt,cloud), enabling automation over mixed environments and companies which are in transition from physical to virtual/cloud. 3. Manageability – the 3rd dimension, is enabling Operations managers to gain visibility about what is going on in their datacenters, both online and offline reports and dashboards. The ability to know who is doing what, when and where, the quality of the operations teams services, the time it takes to remidiate a problem, number of rollbacks done and many more..4. 3rd party integration -
  • Like stop windows server, copy file, compare file and so on. Interface with IISThe product has a self distribution mechanism, allowing Nolio to install an agent remotly*** Ask Eran Sher to add in the box activates that Nolio “knows”
  • 888 IT Operations Management with Nolio

    1. 1.
    2. 2. Nolio ASAP <br />EranSher, Co-Founder & VP Products<br />
    3. 3. <ul><li> High error rates / application failures
    4. 4. Bottlenecks, delays
    5. 5. Lower operational efficiencies, higher costs
    6. 6. Limited manageability and control </li></ul>Bridge Apps & Ops<br />Growing Volume and Frequency of Change<br />Manage App Complexity, Dependencies<br />Control Distributed<br />Heterogeneous DCs<br /> Key operational challenges<br />
    7. 7. Nolio Architecture <br />Proxy Server<br />Thin Mgmt’ Client<br />Local Agents<br />Central Server<br />
    8. 8. Standardization Interface IN<br />Automation Engine OUT<br />The Nolio ASAP Solution<br />Manageability, Visibility, Control<br />3rd Party Integration <br />Deploy<br />Maintain<br />Remediate<br />Recover<br />Centrally Manage the Application Service-Cycle<br />
    9. 9. IT Operations On The Poker Table<br />Ariel Pisetzky<br />Director of IT Operations<br />
    10. 10. 888 Achievements with Nolio<br /><ul><li>Overall: Reduced number of Application failures and reduce Operational Cost!
    11. 11. Senior Management – Visibility, Reports
    12. 12. Operations management – Control, Visibility and Automation
    13. 13. Ops Engineers – “now I can do my job!” (without mistakes, no need to repeat tasks and stay long hours”)</li></li></ul><li>Automation Results and ROI<br />
    14. 14. What we did with Nolio<br /><ul><li>Financial system deployments
    15. 15. CRM updates & upgrades
    16. 16. Front end server roll-outs
    17. 17. Front end servers updates
    18. 18. Central processing application upgrade
    19. 19. And many, many more</li></li></ul><li>888 IT Ops - Responsibilities<br /><ul><li>What does the team do?
    20. 20. Keeping the production environment running
    21. 21. Updating the services
    22. 22. Deploying new applications
    23. 23. Building B2B white label environments
    24. 24. How do we measure the team?
    25. 25. Uptime
    26. 26. Stability
    27. 27. Deployment time</li></li></ul><li>2009 IT Ops Targets<br /><ul><li>Quality of Service
    28. 28. Reduce deployment time
    29. 29. Reduce deployment errors
    30. 30. Automate checklist procedure
    31. 31. Manageability and control
    32. 32. Know who/what/where/when
    33. 33. Control who/what/where/when
    34. 34. Measure our services (quality and time) so we can improve
    35. 35. Preserve “know-how”</li></li></ul><li>IT Infrastructure – High Level View<br />
    36. 36. IT Infrastructure – Going in to Details<br />
    37. 37. IT Infrastructure – Going in to Details<br />
    38. 38. IT Infrastructure – Going in to Numbers<br /><ul><li>800 servers in production
    39. 39. 8 types of OS
    40. 40. 5 main product lines</li></ul>Casino<br />Poker<br />Sport<br />Games<br />Bingo<br /><ul><li>Over 80 internal applications</li></li></ul><li>888 IT Ops – Org Chart<br />CIO<br />IT Ops<br />IT Infra<br />Monitoring<br />Automation<br />Support<br />Tier 2<br />Project Management<br />
    41. 41. Application Changes growth - 2009<br />> 260%<br />
    42. 42. Constant IT Growth<br /><ul><li>New datacenter
    43. 43. Replace ~300 application servers
    44. 44. Relocate online activity – in flight!
    45. 45. More CPU’s – up ~15%
    46. 46. Virtualize old physical servers
    47. 47. More storage (40%)
    48. 48. More networking devices</li></li></ul><li>Summary – 2009 challenges<br /><ul><li>Extreme growth of monthly Change Requests
    49. 49. Growth of servers in the datacenters
    50. 50. Opened a new datacenters
    51. 51. 3 new applications to manage</li></li></ul><li>Why Automation<br /><ul><li>We had to be prepared:
    52. 52. > 260% growth the amount of Change Requests completed!
    53. 53. 35% of the servers re-installed or relocated
    54. 54. Open an additional datacenter
    55. 55. We had to improve our Service Quality:
    56. 56. Reduce human errors servicing critical applications
    57. 57. Shorten deployment time of application changes
    58. 58. We had to do it efficiently:
    59. 59. Save hundreds of work hours in new deployments
    60. 60. Reduce the use of on-call engineers
    61. 61. Support business growth with minimum hiring and training.</li></li></ul><li>What to Look for in Automation<br /><ul><li>Holistic solution
    62. 62. Management reports
    63. 63. Automation with ease of use – not scheduling
    64. 64. Delegation (provide tools for the organization)
    65. 65. Ease of use
    66. 66. Easy initial setup and deployment of the solution
    67. 67. You don’t want automation for automation deployment
    68. 68. Ongoing maintenance should be easy
    69. 69. Fast ROI
    70. 70. Ease of use when writing scenarios</li></li></ul><li>Nolio Rollout in 888<br /><ul><li>Phase I (design, assessment, planning)
    71. 71. Asses IT Ops Targets for 2009
    72. 72. Targeted specific applications
    73. 73. In the selected Apps, traced the processes with the Highest Error rate and highest cost.
    74. 74. Built Process automation gantt.
    75. 75. Phase II (quick wins)
    76. 76. Assigned 5% team effort
    77. 77. Started with credit processing application
    78. 78. Deployed >50 agents & automated time consuming workflows
    79. 79. Results: With minimal* effort, number of deployment errors were reduced by 80%
    80. 80. Phase III (full deployment)
    81. 81. All team members know Nolio
    82. 82. 10’s of application deployments have been automated
    83. 83. 1000’s of successful deployment</li></ul>* 5 weeks, “sideshow” project, no interference with ongoing activity<br />
    84. 84. Some screen shots<br />
    85. 85. Nolio in 888 – CRM Upgrade Procedure<br />
    86. 86. Nolio in 888 – CRM Upgrade<br />
    87. 87. Nolio in 888 – CRM Upgrade<br />
    88. 88. Nolio in 888 – CRM Upgrade<br />
    89. 89. Nolio in 888 – CRM Upgrade<br />