Summit 2011 infra_pini_v6

My Challenge – how to Sew it all together http://www.istockphoto.com/file_thumbview_approve/132499/2/istockphoto_132499-vintage-sewing-and-mending-kit.jpg Pini Cohen’s work Copyright 2011 @STKI 3 Do not remove source or attribution from any graphic or portion of graphic

What is new?• STKI’s first IT development survey• NOC Operator metrics• New DBA metrics• Ratios of production from all serversstorage New Pini Cohen’s work Copyright 2011 @STKI 4 Do not remove source or attribution from any graphic or portion of graphic

Agenda• Major Trends and Issues• Development and SOA• ESM BSM CMDB• DBMS and DATA• Platforms – Servers• Clients• Storage Source: http://astonguild.org.uk/files/NEW_MENU_FRONT_RGB%5B1%5D.jpg Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

General Trends• The current infrastructure perspective in IT shops• The Gap• What are the big vendors doing?• Public Cloud• Private Cloud - Appliances• Manage Scattered IT• Pervasive Ubiquitous Computing• Near Field Communications and Video• Lean IT• Recommendations Source: http://www.google.co.il/imgres?imgurl=http://f arm5.static.flickr.com/4044/4215428802_8d8 72c6ccd.jpg&imgrefurl=http://flickr.com/photo s/efrenefren/4215428802/&usg=__Ca3quraL K4CKcTuemqbIelfUoQs=&h=500&w=365&sz =143&hl=iw&start=0&zoom=1&tbnid=yfgFXR Yu1l4N1M:&tbnh=146&tbnw=107&ei=asF_T dfJMInGgAezh6WaCA&prev=/images%3Fq% 3Dappetizer%2Bmenu%26um%3D1%26hl% 3Diw%26client%3Dfirefox- a%26sa%3DX%26rls%3Dorg.mozilla:en- US:official%26biw%3D1280%26bih%3D625 %26tbs%3Disch:1,isz:m&um=1&itbs=1&iact= rc&dur=365&oei=asF_TdfJMInGgAezh6WaC A&page=1&ndsp=27&ved=1t:429,r:20,s:0&tx Pini Cohen’s work Copyright 2011 @STKI 6 =74&ty=54 Do not remove source or attribution from any graphic or portion of graphic

Important trendsissues raised by some clients• WinXP will be without support soon• Storage growth• Lack of IT professionals• Datacenter unifications (storage, compute, networks)• CMDB• Green• Unified communications Pini Cohen’s work Copyright 2011 @STKI 7 Do not remove source or attribution from any graphic or portion of graphic

Is something missing here?! Source: http://www.egd-media.co.uk/Home_files/droppedImage_1.jpg Pini Cohen’s work Copyright 2011 @STKI 9 Do not remove source or attribution from any graphic or portion of graphic

Who are None IT Technology Users (NITU)?• Students• Startups• SOHO (Small Office Home Office)• Young people• Home users• SMB’s Source: http://www.aixiaofei.com/upload/article/2009-08/1249625696.652387mS35fe.jpg Pini Cohen’s work Copyright 2011 @STKI 10 Do not remove source or attribution from any graphic or portion of graphic

IT vs. None IT Technology Users (NITU)IT None IT Technology usersUsing PC Using Macs or Tablets or PCIT buys the PC Using the device from home both PC (BYOPC) and phoneCommunicating via Email Communicating via Email, Social networks, etc.Social networks are just starting to be Social networks are part of the businesspart of Organization strategy – mainlywithin the marketing departmentsOnline and Batch applications Online applicationsUsing traditional voice and just little Using VOIP extensively (Viber, Skype, etc.)VOIPEither at Work or at Home Always at Work and at Home Pini Cohen’s work Copyright 2011 @STKI 11 Do not remove source or attribution from any graphic or portion of graphic

IT vs. NITU (cont.)IT None IT Technology usersParanoia regarding public cloud but Have more control of access to data byvulnerable to internal threats internal employeesNot using Saas Just using SaasUsing virtual servers that are in installed Using Iaason premisesNot using Mac servers Using Mac serversHigh Capex High Opex – that can be changed Lots of emphasis on none-core issues – Time and effort spent on core business ispatch distribution, performance issues, higher while the provider takes care ofetc. none-core issuesNot using freeopen source SW (Redhat Using freeopen source SWis not considered open source in thiscategorization) Pini Cohen’s work Copyright 2011 @STKI 12 Do not remove source or attribution from any graphic or portion of graphic

IT vs. NITU (cont.)IT None IT Technology usersApplications are generally not location Applications are natively location awareawareApplication are not QR ready Applications are QR readyTraditional business activity- product – Using crowdsourcing for marketing andmarketing – then selling product development (much leaner)Traditional organization structure Using crowdsourcing internally – “the guy at the warehouse” can influence on what the product will look like. Much more creativeNeed to perform some activities to Always connectedconnect (if possible)Not all technology domains are located in All technology is unitedone place – mobile projects, web sites,telephony, CCTV, other sensors Pini Cohen’s work Copyright 2011 @STKI 13 Do not remove source or attribution from any graphic or portion of graphic

STKI’s Point:Mind the increasing GAP ! Source: http://tednellen.blogspot.com/2009/12/last-sunday-of-09.html Pini Cohen’s work Copyright 2011 @STKI 14 Do not remove source or attribution from any graphic or portion of graphic

Will corporate IT be the Last Dinosaur?! Source: http://t1.gstatic.com/images?q=tbn:ANd9GcTCsfFbHIQWy7ikFKkSoVhBNEHZhpd1d3-dXaiLIF3kqwq5fTYj Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

The strategy of some big vendors• Showing that big vendors are trying to do things differently – Google- approaching the enterprise – Microsoft- approaching the NITU (None IT Technology Users) that many years ago was Microsoft’s origin Pini Cohen’s work Copyright 2011 @STKI 16 Do not remove source or attribution from any graphic or portion of graphic

Google’s Vision• “In a 100% web world, business applications are delivered over the Internet and accessed in a web browser.” Dave Girouard, President, Google Enterprise Pini Cohen’s work Copyright 2011 @STKI 17 Do not remove source or attribution from any graphic or portion of graphic

Google Strategy for the Enterprises – step by step1. Private cloud with Search and Geoseptical appliances.2. SAAS for security (Postini), Exchange synchronization tools for Exchange DRP and archiving3. Gmail mail server. Users can still work with Microsoft Outlook or will Gmail GUI(with offline capabilities)4. Google Collaboration- web sites, portals, etc.5. Google Docs (competition to MS Office)6. Google App Engine (PAAS). Competition to Azure and others.7. Google App market place8. In the (near?) future – Google IAAS – competition to Amazon EC29. Chrome OS laptops Pini Cohen’s work Copyright 2011 @STKI 18 Do not remove source or attribution from any graphic or portion of graphic

Deploy powerful integrated solutions on premise and online DevicesOn Premise Applications Google Apps Your Apps 3rd Party Apps SearchGeospatial Google‟s Global Platform

Integrate your existing architecture to start your journey On Premise Device Management Devices ERP Device Mgmt. Applications Google Apps Your Apps 3rd Party Apps Cloud Connect User Mgmt. CRM Google‟s Global Platform Secure Data Search Connector Geospatial

Enjoy seamless communication and collaboration Gmail Google Docs web-based communication real-time collaboration tools hub Priority Inbox Rich Formatting overcome information overload images, tables, drawings with automatically prioritized and bullets emailContextual Gadgets Version historyapprove POs or update Voice & Video Chat maintained throughout theforecasts without leaving multiple communication editing process so you can Real-Time CollaborationGmail easily review multiple multiple users edit documents choices within a single versions simultaneously interface

Build, buy and manage applications your way App Engine Apps Marketplace platform as a service integrated 3rd party apps Easy to scale add capacity as usage of an application grows RatingsEasy to deploy Comprehensive list ratings from other customers tohost your applications on Easy to Manage Applications including project help you find the best AppsGoogle‟s infrastructure and easily deploy multiple management, accounting,provide them to your versions of applications to CRM and moreemployees via the web test new functionality

Google is not immune to mistakes“…Google Wave is no longer being actively developed” Pini Cohen’s work Copyright 2011 @STKI 27 Do not remove source or attribution from any graphic or portion of graphic

Microsoft• Is putting most of its R&D budget on Cloud and NITU (None IT Technology Users)• But does not want to harm the relationship with traditional IT shops Pini Cohen’s work Copyright 2011 @STKI 28 Do not remove source or attribution from any graphic or portion of graphic

Windows AzureConnect

First Azure Project in Israel !  Guest Entry Project in The Government Complex (Cloud Guest MGMT)  Invitation forms and processes  Daily visitors reports  Serves 4 Ministries:  Ministry Of Culture And Sports  Ministry Of Science  Ministry Of Public Security  Ministry of Housing and developing  Why Azure:  Guardian & Microsoft service and support  Reduce operating costs and improve business agility  Scalable, Secure and Highly Available 34

Guest Entry Solution DEMO Daily Visitors Invite Form Report entrance Government Complex 35

Solution Architecture Security Interface E-Government invite Security Azure 36

On Premises / Hosters Azure Service in your datacenter Windows Azure & SQL Azure Physical Control - Geographic Proximity Regulatory Compliance - Data Sovereignty

Enterprise Benefits from Cloud Computing Capability From ToServer/Storage 10-20% Cloud accelerates 70-90% Utilization business value Self service None across a wide Unlimited variety of Test Provisioning Weeks domains. Minutes Change Months Days/Hours Management Release Weeks Minutes Management Fixed costMetering/Billing Granular modelStandardization Complex Self-Service Payback period Years Monthsfor new services Source: IBM Legacy environments Cloud enabled enterprise Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Today there are three primary delivery models that companiesare implementing for cloudEnterprise Traditional Public Clouds Enterprise Private Cloud IT Hybrid CloudPrivate Cloud Hybrid Cloud Public CloudIT activities/functions are provided “as Internal and external IT activities/functions are provideda service,” over an intranet, within the service delivery “as a service,” over the Internetenterprise and behind the firewall methods are integrated, • Key features:• Key features include: with activities/functions – Scalability – Scalability allocated to based on security requirements, – Automatic/rapid provisioning – Automatic/rapid provisioning criticality, architecture – Standardized offerings – Chargeback ability and other established – Consumption-based pricing. – Widespread virtualization policies. – Multi-tenancy Source: IBM Market Insights, Cloud Computing Research, July 2009. Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Delivery models for cloudEnterprise Traditional Public Clouds Enterprise Private Cloud IT Hybrid CloudPrivate Cloud Public CloudGood old consolidationvirtualization SAASIndustry in a box PAASAutomation IAASOther Source: IBM Market Insights, Cloud Computing Research, July 2009. STKI modifications Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Public Cloud• With Public Cloud “2 people business” can have: – ERP – CRM 196,802 soho ( up to 9 – Manufacturing Software companies employees) – VOIP• Soon they will have applications that corporate IT does not have! Example: Video Application Pini Cohen’s work Copyright 2011 @STKI 46 Do not remove source or attribution from any graphic or portion of graphic

Where do clouds come from?!• STKI client “we got questions about cloud implementation at our organization from our board of directors”! Source: http://www.clipartguide.com/_pages/0060-0808-2813-3928.html Pini Cohen’s work Copyright 2011 @STKI 47 Do not remove source or attribution from any graphic or portion of graphic

Public cloud issues as raised by clients• We will be prisoners of the public cloud provider. But aren’t we prisoners of our core business ERP CRM vendors?!• Public cloud providers will raise prices and we will not be able to do anything! And our current vendors never raise prices….• Public cloud is like SW rental vs. owning the license There are many tradition SW vendors that only rent SW• We will loose agility in public cloud. Anything that is hard to do – the cloud provider will refuse to do. The current vendors respond to all our needs…• STKI: All of these concerns are real and users should consider carefully before using public cloud offerings. Still public cloud offering should be used by IT. Pini Cohen’s work Copyright 2011 @STKI 48 Do not remove source or attribution from any graphic or portion of graphic

The players Source: http://www.jackofallclouds.com/ methodology: I use QuantCast‟s top 1M site list as a reference. taking the top half of the list (500k sites in total). Each site is queried to determine whether it is hosted on a cloud provider, and if so on whichPini Cohen’s work Copyright 2011 @STKIDo not remove source or attribution from any graphic or portion of graphic

DBMS market new frontiers: Native Cloud Service Hadoop Cassandra Database.com Xeround Redis Voldemort Amazon Simple DB FathomDB VoltDB MySQL, Memcached Cluster Ed Amazon RDS NoSQL Cloud Enabled SQL MySQL, PostGress, Microsoft SQL Azure XMLDB Gemstone Current Object DB Clustrix IT Microsoft Oracle SQL Server DB2 Traditional Pini Cohen’s work Copyright 2011 @STKI Source: http://xeround.com/58 Do not remove source or attribution from any graphic or portion of graphic

Summery of Public Cloud sections• Things are certainly happening in the public cloud arena Source; http://www.silicon.com/technology/networks/2011/02/04/cloud-computing-to-boom-in-2011-39746924/ Pini Cohen’s work Copyright 2011 @STKI 59 Do not remove source or attribution from any graphic or portion of graphic

Private Cloud• Appliances• Automation including workflow and self service Source: http://gigaom.com/2010/05/12/why-private-clouds-are-a-catch-22-for-buyers/ Pini Cohen’s work Copyright 2011 @STKI 60 Do not remove source or attribution from any graphic or portion of graphic

Private cloud by users• Will enable flexible, elastic infrastructure on which a variety of applications can be easily provisioned and efficiently operated.• But requires huge investment• Like automatic gear – we all like it but it requires 10% more fuel Source: http://forums.juniper.net/t5/Architecting-the-Network/Fabric-Computing-Gartner-s-view-for-the-future-of-the-datacenter/bc-p/75834 Pini Cohen’s work Copyright 2011 @STKI 61 Do not remove source or attribution from any graphic or portion of graphic

The new soon to be ITPini Cohen’s work Copyright 2011 @STKI Source: http://www.accenture.com/SiteCollectionDocuments/PDF/Accenture_Infrastructure_Consulting_Next_Generation_Data_Center.pdfDo not remove source or attribution from any graphic or portion of graphic

Building the next-generation data center and enabling cloud computing (Accenture)Phase 1 - Continued focus on data center virtualization(across all areas of server, storage and network),consolidation and standardizationPhase 2 - Automating IT processes, integrating servicemanagement tools, optimizing resources and leveragingprovisioning toolsPhase 3- Service approach to IT rather thana component view. At this stage, companies typically beginto see the value of cloud computing. Source: http://www.accenture.com/SiteCollectionDocuments/PDF/Accenture_Infrastructure_Consulting_Next_Generation_Data_Center.pdf STKI modifications Pini Cohen’s work Copyright 2011 @STKI 63 Do not remove source or attribution from any graphic or portion of graphic

AppliancesWe are seeing more and more Appliances offerings NetBackup 5000 Appliance Oracle Exadata Teradata EMC GreenplunTurnkey Deduplication Solution from Symantec Exalogic VBLOCK Pini Cohen’s work Copyright 2011 @STKI Google FlexPod for Vmware Do not remove source or attribution from any graphic or portion of graphic SAP HANA

Why do we need appliance?• All components are tuned to work together• Improved performance• Automatic provisioning that works! (prepared to do the needed task)• Self service that works! (prepared to do the needed task)• Patches that are tested for specific situations• Lower time to market• Operations are easier Pini Cohen’s work Copyright 2011 @STKI 65 Do not remove source or attribution from any graphic or portion of graphic

Example: adding another server- not that easy…• Example: adding Websphere server to cluster:  Use a text editor to open the wpconfig.properties file.  Windows and UNIX location: portal_server_root/config/wpconfig.properties  Ensure that the following properties are uncommented and specify appropriate values:  ClusterName property: Specify the name of the cluster to which you are adding the node.  ServerName property: Specify the cluster member name you want to use when adding this node to the cluster. Important: The cluster member name you specify for this property must be unique within the cell and cannot have the same value as the ServerName property on the primary node or other secondary nodes.  PrimaryNode property: Verify that the value for this node is false.  Add the node to the cluster.  Windows and UNIX: Run the following command from the portal_server_root/config directory: – Windows: WPSconfig.bat cluster-setup -DWasPassword=password – UNIX: ./WPSconfig.sh cluster-setup -DWasPassword=password  Click the application server name for the secondary node.  Click Ports under the Communications settings, and verify the port number listed for the WC_defaulthost port.  Click Servers > Cluster Topology to view the updated cluster topology.  Regenerate the Web server plug-in.  Regenerate the Web server plug-in using the deployment manager administrative console.  If you are using a remote Web server, copy the updated plug-in configuration file (plugin-cfg.xml) to the Web servers plug-in configuration directory.  Stop and start the Web server.  Restart all cluster members, where each cluster member is a single application server in the cluster. Source: http://publib.boulder.ibm.com/infocenter/wpdoc/v6r0/index.jsp?topic=/com.ibm.wp.ent.doc/wpf/clus_install_addmember_horiz.html Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

IBM CloudBurst and WebSphere CloudBurst provide cloud management capabilities with different scopes WebSphere CloudBurst Appliance IBM CloudBurst Bladecenter + set of pre-configured provisioning Offering type Physical appliance and management software + configuration services General purpose cloud provisioning/ Applicable Scope Application middleware environments management Bring your own (leverage underutilized assets in Included in the offering (bladecenter w/ 3 blades Hardware for cloud your datacenter) in it) User-built images (whichever productsItems managed in cloud GA virtual images from IBM for select products customer chooses to build) 67

Lead Time: To get a new application environment….Today, this list of serial processes is executed for each new application environment:Approvals Procurement HW Install OS Install MW Install App Install/Config 2-4 month lead time! Factor out repetitive tasks to reduce lead time! Approvals Procurement HW Install Done once at cloud creation/expansion time OS Install MW Install App Install/Config Done once at image/pattern creation/customization time Click “Deploy” and wait Done for each environment request Hours or Minutes lead time! 68

Consistency/Less Errors: “HyperVisor Edition” Images IBM Middleware shipped as an .OVF virtual image, ready to run on a hypervisor The following products offered in HV form as of 8/2010: WAS V6.1 HV  WebSphere Application Server v6.1 WAS V7 HV  WebSphere Application Server v7  WebSphere Process Server v7 WebSphere  WebSphere Portal Server v6.1.5 Application Server  DB2 Operating System Products support various combinations of:  VMware ESX, z/VM and/or PowerVM hypervisors  Red Hat Enterprise Linux, SUSE Linux, AIX Maintenance, support, and fixes through IBM for both WAS and Operating System  New images include most recent GA components of IBM middleware, as well as OS patches 69

Enable a self-optimizing private cloud w/Intelligent Management Pack! Use the pattern editor to select the policy-based1 management options to include in your environment 2 WebSphere CloudBurst activates IMP in the dispensed pattern 3 Policy-based management self- optimizes your running private cloud environment until you stop it! 70

TCO Analysis Available!Quantifies WS CloudBurst Benefits Without WS With WS Enabled by Virtualization CloudBurst CloudBurst Optimization New100% Development Rapid provisioning Strategic New Benefits Software Costs Change Development Capacity Reduced Capital Expenditures Reduced Operating Expenditures Power Costs Additional Benefits DeploymentCurrent Reduced risk, less idle time, more IT (1-time) efficient use of energy, acceleration Spend of innovative projects, enhanced Software Costs Labor Costs (reduced xx%) customer service (Operations & Maintenance) Power Costs Reduced (reduced xx%) Business Case Results annual Labor Costs cost of Annual Savings: $MM (xx%) (reduced xx%) operation Hardware Costs by xx% Breakeven: xx days (annualized) Hardware Costs Net Present Value (NPV): $MM (reduced xx%) Internal Rate of Return (IRR): xx% Return on Investment (ROI): xx% 71

Appliances – what can you touch? Oracle’s Exadata point of view:“We discourage installing additional software on the database servers butwe dont prohibit it.Our guidance is to keep extra software to a minimum e..g just backup,management, and security agents.In some cases where there is a serious and measured advantage to runningon the DB servers (e.g. some ETL software) then it might make sense toinstall those.We very heavily discourage or disallow modifications to the OperatingSystem other than installing packages or fixes officially provided byOracle. For example installing third-party device drivers is heavilydiscouraged or disallowed.So, on Exadata you should only install Oracle databases and software relatedto it - like third party backup tools, management tools and security tools.For applications we have Exalogic ..” Pini Cohen’s work Copyright 2011 @STKI 72 Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on Appliances• The danger of loosing flexibility and lock in situation should be balanced by the performance and ease of operations benefits• It’s just the beginning of the trends and the industry is not sure where Appliances will be a long term viable solution• Not all appliance are the same: Backup Appliance is not “Core business” Appliance in the perspective of benefits or risks. Pini Cohen’s work Copyright 2011 @STKI 73 Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on Cloud• Do something with the cloud (private, public) – TODAY!• Automation Automation Automation (which also means standardization and workflow and self service) Pini Cohen’s work Copyright 2011 @STKI 74 Do not remove source or attribution from any graphic or portion of graphic

STKI’s theme: Manage Scattered IT• There are ComputerTechnology domains that are not handled by IT. Examples: – Telephony – Web Sites – CCTV and Security – Social Networking – Computers in manufacturing sites – Tablet PC’s• This has to STOP! Pini Cohen’s work Copyright 2011 @STKI 75 Do not remove source or attribution from any graphic or portion of graphic

Ubiquitous Pervasive computing• Computingsensors everywhere! From your refrigerator to your shoes to your neighbor’s dog…• Implications are enormous especially for: – More storage growth – Capturing this information and processing it (CEP)• Should be part of IT Pini Cohen’s work Copyright 2011 @STKI 77 Do not remove source or attribution from any graphic or portion of graphic

Ubiquitous computing pervasive computing External TCP/IP InternetSource: http://www.elec.qmul.ac.uk/people/stefan/ubicom/slides/ubicom-ch02-slides.ppt ICT Network External Energy Grid External Phone Network Ubiquitous computing: smart devices, environments and interac External Video External Audio Broadcast Broadcast Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

MEMS Source: http://bcctae.files.wordpress.com/2010/10/adaptive-experiences-ubiquitous-computing.ppt Micro fabrication and integration of low-cost sensors, actuators and computer controllers, MEMS (Micro Electro- Mechanical Systems) Ubiquitous computing: smart devices,Photo: courtesy of Brett Warneke environments and interaction 79 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

DUST Source: http://bcctae.files.wordpress.com/2010/10/adaptive-experiences-ubiquitous-computing.ppt Dust: miniaturized devices can be without visual output displays, e.g., Micro Electro- Mechanical Systems (MEMS), ranging from nanometers through micrometers to millimeters. Smart Dust project , Pister, UC,Berkely hypothesized that dust could be spread around environment to receive and report changesPini Cohen’s work Copyright 2011 @STKIDo not remove source or attribution from any graphic or portion of graphic

SKINS Source: http://bcctae.files.wordpress.com/2010/10/adaptive-experiences-ubiquitous-computing.ppt Skin: fabrics based upon light emitting and conductive polymers, organic computer devices, can be formed into more flexible non-planar display surfaces and products such as clothes and curtains „SmartSecondSkin‟ is an artefact designed by Jenny Tillotson to illustrate a responsive fabric inspired by neurobiological delivery mechanisms found under skin.Pini Cohen’s work Copyright 2011 @STKIDo not remove source or attribution from any graphic or portion of graphic

CLAY Source: http://bcctae.files.wordpress.com/2010/10/adaptive-experiences-ubiquitous-computing.ppt Clay: ensembles of MEMS can be formed into arbitrary three dimensional shapes as artifacts resembling many different kinds of physical object „MIT‟s Tangible Media Group is an actuated tabletop display, which is able to render and animate three- dimensional shapes with a malleable surface. It allows users to experience and form digital models like geograpil terrain in an intuitive manner.Pini Cohen’s work Copyright 2011 @STKIDo not remove source or attribution from any graphic or portion of graphic

Ubiquitous computing pervasive computing Audio-Video Cluster Computer as Hub of cluster Local Network User Interaction Internal Comms.Source: http://www.elec.qmul.ac.uk/people/stefan/ubicom/slides/ubicom-ch02-slides.ppt Processing: edit, annotate, compose Management: Resources & Content Storage Email Web Ubiquitous computing: smart devices, environments and inte Wide network Chat VoD Audio-Video Stream VoIP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Sensor Feeds will influence storage dramatically• Sensor Feeds: The tighter linkages between info sharing environment and the operational DCGS/ISR capability providers is making the technology of sensors critical to plan for our future. Increases in sensor feeds are directly fueling our future needs for communications, processing and storage capabilities. 1024 Yottabytes Source: http://ctovision.typepad.com/InfoSharingTechnologyFutures.ppt STKI modifications 1021 Theater Data Stream (2006): Zettabytes ~270 TB of NTM data / year Example: One 1018 Theater’s 250 TB Exabytes Large Data JCTD 12 TB Storage Capacity: 2006 2010 Capability Gap 1015 Petabytes UUVs FIRESCOUT VTUAV DATA 1012 Terabytes GIG Data Capacity (Services, Transport & Storage) 2000 Today 2010 2015 & Beyond Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Payment can be Enhanced for the User with Mobile NFC Mobile NFC can be used for payment at kiosks, ticketing, internet, or person-to-person• Additional uses that enhance payments include: – Tickets can be purchased, stored, and redeemed. – Prepaid cards can be bought, stored, and accessed in the phone. – Coupons can be transferred to a friend, recommending products. – Product history and medical warnings can be read in the store. – Shopping lists can be collected from tags. – Electronic devices can be activated after purchase and warranties sent in. – And many more! http://www.nfc-forum.org/resources/presentations/Tagawa_Barcelona_2010.pdf Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NFC Is More Than Payment and Mobile Phones• NFC mobile phones are for more than payments: – Secure access to buildings and PCs – Inventory control with tags and readers – Security patrols – Patient monitoring – Information gathering with educational tags http://www.nfc-forum.org/resources/presentations/Tagawa_Barcelona_2010.pdf Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NFC: Near Field Communication • “NFC mobile payments to exceed $30 billion by 2012” • “1 in 6 users worldwide will have an NFC-enabled phone by 2014” –Juniper Research(M) Pini Cohen’s work Copyright 2011 @STKI http://juniperresearch.com/shop/products/report/pdf/brochure/3267MPM%20NFC%20report%20brochure.pdf Do not remove source or attribution from any graphic or portion of graphic

Lean IT• Lean IT - Lean IT is the extension of lean manufacturing and lean services principles. Its central concern, applied in the context of IT, is the elimination of waste, where waste is work that adds no value to a product or service.• Lean is a complete process. Part of it is problem-solving procedures (Kaizen) where MUDA (waste) is to be found Pini Cohen’s work Copyright 2011 @STKI 92 Do not remove source or attribution from any graphic or portion of graphic

Lean IT• We are doing all we can. Why do we need Kaizen procedures?!• Example of Kaizen procedures in Service Desk scenario in leading IT organization: – Reduce support time for incident by 50% (same staff)! – Answering the phone according to SLA – from 76% to 96% ! Pini Cohen’s work Copyright 2011 @STKI 93 Do not remove source or attribution from any graphic or portion of graphic

Muda: The Seven Deadly Types of Waste (classical Lean)• Defects• Overproduction• Source: http://www.systems2win.com/lk/lean/7wastes.htm Over-processing• Transport and handling• Waiting• Confusion – missing information• Unsafe• Underutilized human potential Pini Cohen’s work Copyright 2011 @STKI 94 Do not remove source or attribution from any graphic or portion of graphic

From Lean to Agile via Kanban• A Kanban is a physical card used in Toyota Production System (TPS). It has spread to the manufacturing industry all over the Source: http://www.infoq.com/articles/hiranabe-lean-agile-kanban STKI modifications world as a tool of Lean Manufacturing. Now in Agile software development the visualization of projects, such as posting task cards on a wall, is a commonly seen practice, which is sometimes called "Software Kanban", or "Task Kanban". Pini Cohen’s work Copyright 2011 @STKI 95 Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on the Gap• Spend some effort (time and money) on new technologies. Example: communicate on social networks, harness your organization with crowdsourcing, do some IAAS, SAAS, PAAS etc.• When experimenting be aware that not everything will be “piece of cake”.• (repeating because its important) Automation Automation Automation (including workflow and self service)!• Automation also means standardization• In each quarter automate several key processes• In each quarter dispose several unneeded technologies• IT personal should understand the business more Pini Cohen’s work Copyright 2011 @STKI 97 Do not remove source or attribution from any graphic or portion of graphic

Mini Agenda• IT Development Survey• “Code intelligence”• BRMS CEP• Data Quality• HTML5• Keyword Driven Testing• SOA maturity• Selected projects SOA• SOAESB staffing ratios• Ratings for SOAESB and ETL tools Pini Cohen’s work Copyright 2011 @STKI 99 Do not remove source or attribution from any graphic or portion of graphic

Technologies Maturity Model 2011– Middleware and Development Regular use of Data Quality tools not onlyBusiness Value for migration SemanticInvestment AGILE Full SOA –to make money BPM Organization GUI change TDDCut costs, integration Lean IT ProjectIncrease Open Source KDT Pure HTML5 Businessproductivity ESB ALM tools Project WPF PaaSCommodity IT SOAServices ETL Governance toolsInvestmentfor regulations Using Implementing Looking Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI IT Development Survey• The first IT development survey in Israel!• Covering: – Development vs. Maintenance budget – Level of effort in development (requirements, design, code, testing, etc.) – Level of effort in maintenance (bugs, new enhancements, infra. upgrades) – Development internally, outsourced and package modification – Regulation vs. planned vs. unplanned – Development metrics – QA organization, etc. – Methodologies used in development process Pini Cohen’s work Copyright 2011 @STKI 101 Do not remove source or attribution from any graphic or portion of graphic

STKI IT Development survey• How should you use this data: – Look at the fine print – not all graphs are the same – including or excluding specific data according to the industry – If you do not have all data as stated look at the ratios Pini Cohen’s work Copyright 2011 @STKI 102 Do not remove source or attribution from any graphic or portion of graphic

New Initiatives (“development”) vs. Running (“maintenance) Systems New RunningIsraeli IT Average Initiatives Systems Finance - 73% 27% Banking Maint. Telecom 71% 29% 43% Finance - 53% 47% Dev. Insurance & 57% Credit Cards Health 48% 52% Government 32% 68% Source: STKI Survey The actual question was: Which part from your development budget is directed to “development vs. maintenance” Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

About Development vs. Maintenance• Different companies has different takes. Example: – “Development – 7 days or more with features that contribute to company profitability (not regulation)” – “Everything is development except bugs correction or training support. Updating tables is development” – Up to two months works is considered maintenance. Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Spending from IT budget on developing new SW projectsAll DataPackagecustomizationnot included Pini Cohen’s work Copyright 2011 @STKI 106 Do not remove source or attribution from any graphic or portion of graphic Source: STKI Survey

STKI IT Development Survey Requirements,• Spending from IT Budget 8%• Testing including acceptance testing (effort by IT)• Development - means Testing, 21% developers effort and not necessarily just Design, 19% development (might include unit testing and other testing) Development, 52% Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI 107 Do not remove source or attribution from any graphic or portion of graphic

Per sector Requirements Design Development Testing 16% 13% 25% 23% 21% 30% 53% 50% 59% 49% 46% 56% 24% 21% 24% 15% 17% 6% 12% 6% 7% 7% 7% 5%Defence Health Telecom Finance (no Banking PublicGov. Source: STKI Survey Banks) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI IT Development Report• Public Government – Spending more on the requirement stage – Testing looks is much less mature. – Therefore developers are dealing with testing – Several organization are on the building stage of their testing unitsprocedures• Health: more effort on design. Less effort on Testing• Telecom: heavy investment in testing without specific budget to User Acceptance testing• Finance (not banking): Heavy Management cost. Lots of investment in Design Pini Cohen’s work Copyright 2011 @STKI 109 Do not remove source or attribution from any graphic or portion of graphic

Requirement Mgmt. Attention Public 12% Telecom 7% Health 7%Finance (Insurance & Credit Cards) 7% Defense 6% Banking 5% Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Testing Focus Factors Influencing QA: Telecom 30%• Internal SW development• SW is an integral part of Defense 25% the org. services to customers Finance 23% (Insurance & Credit Cards)• Regulation• Established Banking 21% methodologies (CMMI, ISO) Health 16% Public 13% Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

What “contributes” to Software maintenance:• Not all “minor improvements” are the same:• One company might put all improvement in “development budget” while the other will put all “new development that is less than two weeks”• “Infra” is SW adjustment to infrastructure changes – Win7, Oracle 11G, etc. Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI 112 Do not remove source or attribution from any graphic or portion of graphic

Who and what is developed?All including PublicHealth PublicHealth Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI 113 Do not remove source or attribution from any graphic or portion of graphic

Development Budget Distribution Sector Regulation Planned Unplanned Regulation Finance 30% 47% 23% 15% Banking 18% 60% 22% PlannedUnplanned Projects Telecom 18% 56% 26% Requests 60% 25% Public 15% 60% 25% Health 6% 75% 19% Defense 5% 60% 35% Pini Cohen’s work Copyright 2011 @STKI Source: STKI Survey Do not remove source or attribution from any graphic or portion of graphic

Metrics used Project Bugs Faults Depth of Development Other Management Testing Operations maturity Source: STKI SurveyEach respondent could add several metrics Pini Cohen’s work Copyright 2011 @STKI 115 Do not remove source or attribution from any graphic or portion of graphic

Metrics used – what is missing? Project Bugs Faults Depth of Development Other Management Testing Operations maturityDeployment Hatmaa metrics are missing! Pini Cohen’s work Copyright 2011 @STKI 116 Do not remove source or attribution from any graphic or portion of graphic

Selected Project Management metrics• Resource, Time, Features. And keeping track of it.• LOC – line of code• Number of mission accomplished in a monthperiod (normalized on mission size)• Plan vs. actual in total effort spent per customer, project• Net resources vs. overhead (courses, safety, illness- out of work) Pini Cohen’s work Copyright 2011 @STKI 117 Do not remove source or attribution from any graphic or portion of graphic

Selected Quality (bugfault related) metrics. All per severity level• # of bugs in testing and per man year, per K LOC• # of escaping bugs (limited time in production) and per man year, per K LOC• # of escaping bugs per # of bugs found in testing• First time quality – in testing and in production Pini Cohen’s work Copyright 2011 @STKI 118 Do not remove source or attribution from any graphic or portion of graphic

Selected Quality (bugfault related) metrics. All per severity level• # of critical bugs per total bugs found in testing and in production• # of requiring bugs (bugs that were not fixed at after first time)• # of false positive bugs – bugs that were reported but actually did not exist Pini Cohen’s work Copyright 2011 @STKI 119 Do not remove source or attribution from any graphic or portion of graphic

Selected testing breath metrics• Percent of code tested• Percent of code with automatic tests Pini Cohen’s work Copyright 2011 @STKI 120 Do not remove source or attribution from any graphic or portion of graphic

Selected dev.production process metrics• How many changes were introduced to a project while being developed (not relevant to Agile)• Did the project followed all procedures• How many times the project was put to production (if more than once- something went wrong…)• # of LOC developed per specific feature (comparing two developing environmentsupporting tools) Pini Cohen’s work Copyright 2011 @STKI 121 Do not remove source or attribution from any graphic or portion of graphic

Other development metrics• ISO metrics• Maturity of reporting systems –how well people report to the activitybug system (is reporting accurate, how often the reporting takes place, what is the delay between activity and the reporting). Pini Cohen’s work Copyright 2011 @STKI 122 Do not remove source or attribution from any graphic or portion of graphic

Organization Position of QA Office of the CIO 11% QA Development Department Department 50% 39% Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Show me the QA money! • When QA is part of development the testing budget is lower – 38% difference! (at average)Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI 124 Do not remove source or attribution from any graphic or portion of graphic

Profile of your testing personnel Rising interest in Israeli Nearshore due to their subsidization by the Gov. Nearshore 19% Internal Staff Professional 57% Services 24% Source: STKI Survey Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Which Methodology is used• Counted even if used in few projects or experimenting (for example “using iterative only in Internet projects” or “experimenting agile in small projects”• CMMI is more common in Banking• ISO certifications used are ISO9001:2008 and 9002. Pini Cohen’s work Copyright 2011 @STKI 126 Do not remove source or attribution from any graphic or portion of graphic

CEP vs. BRMS• CEP – is something happening? Identify an event.• BRMS – what to do with the event.• Also (sort of..) BRMS that can handle time related input and with lots of capacity is CEP• CEP and BRMS should come (or relate) to BAM Pini Cohen’s work Copyright 2011 @STKI 133 Do not remove source or attribution from any graphic or portion of graphic

 continuous ingestion infrastructure provides services  continuous analysis for scheduling analytics across h/w nodes, for establishing streaming connectivity Filter / Sample … Transform Annotate Correlate Classify where appropriate, elements can be “fused” together achieve scale removing communication latencies by partitioning applications into s/w components by distributing across stream-connected h/w nodes134 © 2011 IBM Corporation

‫‪Data Quality and Regulation‬‬‫לצורך יישום הוראות סעיף זה על גוף מוסדי להתייחס לכל הפחות לנקודות‬ ‫ו.‬ ‫•‬ ‫הבאות:‬ ‫1) שלמות הדיווחים – יש להתייחס לשלמות הן מבחינת מלאי (כל הדיווחים‬ ‫•‬ ‫הוכנו) והן מבחינת דיווח (כל הדיווחים נשלחו).‬ ‫2) תהליך הפקת הדיווחים.‬ ‫•‬ ‫3) סבירות הנתונים.‬ ‫•‬‫4) לענין הדוח לעמית או למבוטח יש להתייחס בנוסף, בהיבט מצרפי, לנכונות‬ ‫•‬‫שליפת המידע ממערכות המידע, לסך התנועות של ההפקדות והמשיכות במהלך‬‫השנה הרלוונטית ושיעור התשואה ושיעור דמי הניהול השנתיים בגין אותה שנה.‬ ‫יחד עם זאת, ובהתאם להוראות הממונה שיצאו בדבר טיוב נתונים, יש‬ ‫•‬ ‫לראות את הרחבת התהליך על יתר נתוני הדוח לעמית או למבוטח בהתאם‬ ‫ללוחות הזמנים שיקבעו בהוראות טיוב הנתונים‬ ‫‪Source: http://www.finance.gov.il/hon/2001/mosdiym/memos/tt2010-26b.doc‬‬ ‫‪Pini Cohen’s work Copyright 2011 @STKI‬‬ ‫731‬ ‫‪Do not remove source or attribution from any graphic or portion of graphic‬‬

For dealing with Data Quality• Define : – Data Owner (business) – high level management – Data Custodian (business) – need to actually keep track of data – Data Steward (IT) – help to apply the data owner and data custodian requests• Apply metrics for Data Quality• User Data Quality tools Pini Cohen’s work Copyright 2011 @STKI 138 Do not remove source or attribution from any graphic or portion of graphic

HTML5 new features• Canvas element• Offline storage database• Document editing• Drag-and-drop• Cross-document messaging• Geolocation• Video GOTO: http://html5demos.com/ Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Apple vs. Adobe• Today Adobe is launching an experimental Flash-to- HTML5 conversion tool called Wallaby. The tool takes content created with Adobes Flash Professional and converts it to HTML5, the latest revision of the Web markup language. HTML5 is supported in most Web browsers, but, most importantly, its supported on Apples iPhone, iPad and iPod Touch, where Flash is banned. Source: http://www.readwriteweb.com/archives/Adobe_Releases_Flash_to_HTML5_Conversion_Tool.php Source: http://www.google.co.il/imgres?imgurl=http://www.graphicmania.net/wp-content/uploads/10042010/adobevsapple.jpg&imgrefurl=http://www.graphicmania.net/apple-adobe-war-who-is-the-winner/&usg=__qEgJpLjP-6BI8NLK-6kSY7yVCsU=&h=2 Pini Cohen’s work Copyright 2011 @STKI 143 Do not remove source or attribution from any graphic or portion of graphic

Keyword-driven testing• Software testing methodology for automated testing that separates the test creation process : a Planning Stage, and an Implementation Stage.• This enables automatic test written by testers and not programmers Source: wikipedia STKI modifications Pini Cohen’s work Copyright 2011 @STKI 145 Do not remove source or attribution from any graphic or portion of graphic

SOA Maturity Level The “middle man” 8. ESB team Architect enablesexecuting business services 7. ESB team Architect mandates business services 6. ESB team Architect suggests business services 5. ESB team mandates interface services 4. ESB team with SOAG tools 3. ESB team that suggests interface servicesDeveloper DeveloperDesigner 2. ESB with team that “do what you are told”Designermight use BPMSOAtools independently 1. Integration team – no tools might use BPMSOA tools independently 0. No Integration Layer Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

What will help SOA adoption?• The SOAESB team will not be a bottle neck:  Strict SLA (run time and development process)  Development within the SOA will be done by the developers and not the SOAESB team• Run time SOA governance (monitoring, etc.)• Design time SOA governance (repositories, etc.)• Shared system analysts for supporting the design of application• Working together with the project managers.• The project manager has the final word• The relationship between the project managers and the shared system analyst is the key for SOA adoption (reuse, agility, etc.) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –SOAESB• IBM Websphere SOAESB – FIBI, Bank Leumi, Poalim (upgrade), IEC (updrage), Amdocs (Upgrade) , IDF (upgrade)• IBM Data Power: Teva, Random Logic 888, Isracard (upgrade), Tehila (upgrade), Menura (upgrade), IDF (upgrade)• Tibco (upgrade), Amadeus, Better Place (upgrade), ELAL (upgrade), Partner (upgrade) Pini Cohen’s work Copyright 2011 @STKI 148 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –SOAESB• Magic (iBolt): Maytronics, Angel (bread), Shikun Ve Binuy, Delta, Logic, Amidr, Mishpatim Office, Jewish Agency of Israel, DHL, Tel- Aviv Bicycle Rental, Ananey Tikshoert• Microsoft Biztalk: Click Software, Shaam, 013 Netvision (upgrade), Israel Customs (upgrade), Pheonix (upgrade), Mishpatim office (upgrade)• Oracle ESBSOA: Harel (including BPM), Rafael, IDF, Yes(inc. BPM), Plasan Sasa (inc. BPM), DBPG, RH electronics, Elbit, SCD, Vering, Evogence(inc. BPM), VISA CAL Pini Cohen’s work Copyright 2011 @STKI 149 Selected Ins Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –ETL• IBM Datastage – Bezeq, Teva• Informatica- Amdocs IT , Better Place , Lamas, Cvidya, Rashut Hagvulot (Project), Jerusalem Cigarette Company, Ministry of Justice, Shupersal, Bituach Leumi• Oracle ODI – Retalix, Teva, Yesm, Elisra, RSA• Microsoft (SSIS): Harel Insurance, Menora, Intel Pini Cohen’s work Copyright 2011 @STKI 150 Do not remove source or attribution from any graphic or portion of graphic Selected Ins

Selected Installations 2010-1Q11 Partial List of selected wins –ESM• IBM Tivoli– Bezeq, Teva• Informatica- Amdocs IT , Better Place , Lamas, Cvidya, Rashut Hagvulot (Project), Jerusalem Cigarette Company, Ministry of Justice, Shupersal, Bituach Leumi• Oracle ODI – Retalix, Teva, Yes, Elisra, RSA Selected Ins Pini Cohen’s work Copyright 2011 @STKI 151 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –ETL• Oracle ODI: Retalix, Teva, Yes, Prime Minister, RSA, ECI, Elisra• Oracle Goldengate: Poalim, Hot(upgrade), Leumicard, Cellcom, Police, Bikoret Gvulot, Yedioth Technology, Luminix, Pelephone Selected Ins Pini Cohen’s work Copyright 2011 @STKI 152 Do not remove source or attribution from any graphic or portion of graphic

EAISOA Support Ratios• EAI SOA variations are very big: – From static (old) messaging interface (MQ) to new and changing “SOA” service – How “thick” is the interface: 20 times a day to 20,000 a minute – How involved are the applications developers? – Example of service : “update flight details to web site”, “credit scoring” , etc. – How to count?! Example: there is one big service “Retrieve document” but this services is accessing 10 applications and 3 document management environments. It also has several variationsaccess methods. So what should be the count?! Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

EAISOA Support Ratios• Number of Services/Interfaces supported by Integration/ESB/SOA team FTE Per FTE # of Services 25 percentile 51 Median 125 75 percentile 180 Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning Integration Brokers SOA infrastructure Vendors to Watch: Magic ezBlox Tibco IBM OracleLocal Support SoftwareAG Worldwide Leader Microsoft This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning - ETL Informatica IBMLocal Support Oracle Microsoft This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on Development ,• Update your development metrics• Apply “Code intelligence tools” when needed• CEP and BRMS tools will become important especially when Pervasive Computing will evolve• Data Quality will become main stream (not just for application migration)• HTML5 is key technology.• Apply reasonable SOA goals – the responsibility should always stay at the project manager Pini Cohen’s work Copyright 2011 @STKI 158 Do not remove source or attribution from any graphic or portion of graphic

Agenda• Major Trends and Issues• Development and SOA• ESM BSM CMDB IT operations• DBMS and DATA• Platforms – Servers• Clients Source: http://astonguild.org.uk/files/NEW_MENU_FRONT_RGB%5B1%5D.jpg• Storage Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Technologies Maturity Model 2011– Enterprises System Management CMDB. No big changesBusiness Value Investmentto make moneyCut costs, Increase productivity End User IT Project BTM Experience Pure APM Business ProjectCommodity IT BSM CMDB with System closed loop Services Management CMDB – change Basic – management Automatic Investment discoveryfor regulations Migration from Big 4 Using Implementing Looking Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Mini Agenda Enterprise System Management• Categorization of management areas and main issues in this field• Basic description of each category use cases and maturity: – Traditional ESM – End user experience – APM – BTM• The Big4 vs. The rest of the world• CMDB status• Insights about change management and patch management• ESM Ratios• ESM wins and rating and partnerships Pini Cohen’s work Copyright 2011 @STKI 161 Do not remove source or attribution from any graphic or portion of graphic

Business Process vs. Monitoring• What’s between the “Business Process” and “Monitoring the business process”? – “Deposit 500NIS in my account” is a business process. – “Response time for transaction is 2 seconds” is monitoring – “Business process of updating clients address was not completed” is what? – “Client had 1M$ transaction but it’s odd since he is a poor client” is what? Maybe the business process is “perform transaction and look for anomalies ”• Currently, business process monitoring is done at the application level Pini Cohen’s work Copyright 2011 @STKI 162 Do not remove source or attribution from any graphic or portion of graphic

Old slide- still relevant - Enterprise System Management Project Failures• ESM projects are the most difficult IT projects to maintain.• This is why ESM projects fail Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

The different layers of ESM (Enterprise System Management)• Traditional system management – agent that reports to the center – Physical map – Logical map• End User Experience tools – Real – Synthetic• CorrelationTransaction management tools (sophisticated sniffing correlated to applicationstools)• Specific tools /APM (Application Performance Management). Examples: for SAP, for DBMS, for .Net, for JAVA, for networks , etc.• Central Console – Manager of Managers• CMDB – auto discovery (with relations) and repository Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Near neighbors for ESM (tools and users-usage)• Service Desk• OperationsNOC and RBA• SLA management• Compliance and regulations• Infrastructure teams – Configuration management tools, capacity planning tools• Asset Management + meteringusage tools• SOC – Security Center• Application managers and application developers (using the specific tools) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Common issues• All technologies have issues to operate in DMZ – behind FW• Many vendors come from area X but say they can handle to complete alphabet… Pini Cohen’s work Copyright 2011 @STKI 166 Do not remove source or attribution from any graphic or portion of graphic

Traditional system management – agent that reports to the center Physical map Logical map• Description: agents (or agentless) that describe the situation of particular CI (Configuration Item)• Output: map with physical or logical CI’s. Should have history or trends but not always implemented. Might report to higher level console.• Sample of monitoring: Disk of system X is almost full, Process Y of system X is stuck, system SAP has some fault (Yellow color)• Sample of vendors: BIG 4 (HP BMC CA IBM) and many small : Microsoft, Centerity, TrigerPlus, Whatsup, many more.• Advantages: Very mature – the basics. The “eyes” from infrastructure point of view.• Disadvantages: Does not look at business transaction. Difficult to keep the logical map updated• Special infrastructure needed – not an issue with traditional IT equipment, might take some CPUnetwork resources• Price - up to 100’s $ per agent might be much less• # of installation in corporate Israeli IT shops >300 (almost every IT shop) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

End User experience – Synthetic, Real• Description: Track what is happening at the end user level. Synthetic – runs automatic preconfigured script once in a while. Real – track actual activities• Output – Graphs of response time per site or per application. Might report to higher level console.• Sample of monitoring: pick response time for transaction A in location B is 2 seconds – higher than expected.• Sample of vendors: HP (Synthetic and Real), Aternity (Real), CA (Wily – depending on application protocol), etc.• Advantages – Gives idea of what the users real experience. Rather mature area.• Disadvantages – every new version of application the script should be modified. Does not give idea of the reasonlayer for problem (might be related to other products technologies).• Special infrastructure needed –should monitormimic specific protocol (Web is the easiest) in Synthetic – should be able to log in as “not real” user.• Price 1700$ per transaction measured or 20-30$ per client• # of installation in corporate Israeli IT shops >75 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

BTM – Business Transaction Management• Description: Follow transactions via “sniffing like” technique.• Output – flow of transactions – statistics, SLA errors, etc.• Sample of monitoring - Transaction “1111” went into server A but did not go out”• Sample of vendors – Optier, Corralsense, Vantage (Compuware) Dynatrace, Big 4 (CA IBM BMC HP)• Advantages – gives the best indication of where is the process stuck. Enables proactive operations (call client “1111” and tell him something went wrong).• Disadvantages- Implementation is specific to application. Will not replace the general ESM. Many times not installed on the PC. Less mature – only few installations in Israel.• Special infrastructure needed –should listen to incoming, outcomming traffic.• Price – rough estimation - $3,000 per CPU, pricing per application starts at $100K might be much less.• Might help in business monitoring? Since it handles each transaction and can transfer metadata (and data) information about each transaction. This metadata can be used for business monitoring.• # of installation in corporate Israeli IT shops <10 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

APM – Application Performance Monitoring (“Specific”)• Description: Drill down of what is happening in specific environment technology.• Output – specific information relevant to technology• Sample of monitoring “Buffer limit has been reached” (for .net technology)• Sample of vendors: Wily (CA), Avicode (Microsoft), Dynatrace, Precise, Quest , CiscoWorks.• Advantages: gives the absolute knowledge. Bringing together operations and developmenttechnology.• Disadvantages : does not look at a complete business process. In many cases will be used at the specific technology team.• Special infrastructure needed – different solution for each technology.• Price – varied.• # of installation in corporate Israeli IT shops >200 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

ESM current status: the big ESM players• Clients are happy with their ESM installations but others are not: – "Our concept about ESM has failed! No ROI. Too much time and effort for getting just a little more than basic System Management tools" – "Cost of ESM is huge. We are considering using cheapopen source solution for some of the functionality. Going back to "Best of Breed". – "The basic monitoring will be done by cheapopen source while the BSM by the big vendors"• I heard more complaints this year especially with IBM and CA whom are having big technology upgrade of core products• However, Regulation, ITIL implementation, change management etc. is very near to ESM and this helps the big ESM vendors. Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Users are considering tools not from the Big 4• Partial list: – Microsoft – Oracle – Centerity – Trigger Plus – Nagios – Comostas – Server alive Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

CMDB tool selection dilemma – ESM vs. Service DeskESM Service Desk• CMDB should update • In many organizations the “service maps” in Change Management the ESM console is already handled by• ESM team is more Service Desk requests related to agents, • Service desk should configuration, etc. have information about IT assets Vendor selected for CMDB might replace other ESM serviced desk products Pini Cohen’s work Copyright 2011 @STKI 176 Do not remove source or attribution from any graphic or portion of graphic

What clients currently get from CMDB (auto- discovery) project?• Before stopping serverresource checking if it is not used by "unknown" application• When error happens checking at the CMDB level "what has changed from yesterday"• Updating the logical ESM maps automatically from the CMDB. If I add new server to the SAP Application Server – it will be shown automatically in the corresponding ESM logical map of "SAP system"• Getting the asset and configuration from the list and comparingupdating it so other lists. Helping compliancerenewing contracts Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

What clients currently get from CMDB (auto- discovery) project ? (cont.)• Defining “preferred configuration" and checking if this policy do apply. Example – "Web Server should have Antivirus, MQ, IIS version 8, MSSQL service pack x, port 80 and 81 opened in the FW" then checking that all web servers are configured this way.• New! Integration between the CMDB CIs and the Service Desk. This enables to correlate each incidentproblem to specific CIs.• Basic workflow – Example when CMDB discovers new server it executes several automatic tasks (adding it to the "to-do list" of ESM team, installing agents, etc.) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

What clients currently do not get from CMDB (auto-discovery) project ?• Sophisticated workflowautomation. BTW, who is the leader: ESMOperation team or SystemInfra team?• From incident management to problem management using CMDB functionality (automatic correlations)• Capacity planning• Closed look change management – Dont forget in closed loop change management incidentsproblems update the development team and should be tracked seamlessly ("the bug you have open was is now at testing stage and is scheduled to go to production in 3 day") Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

CMDB discovery utilities - Venotion Business layer • Lines of business • “online services” Business context is • “private banking” added manually VENotion • Business Domains • Business Services • “apply for a loan” adds business • Business Processes context to IT processes Application layer • SQL Server, WAS, Apache Tomcat • Applications (DB, Web Servers) • RPC Service • Processes and Services • “javaw.exe”, “asp_wp.exe” • Application relations / dependencies • MQ Managed CI’s in Today’s CMDB Physical layer • Machines and servers • 192.168.9.32 • Port usage • Websrv_tst023 • Addresses • TCP Ports 80, 23, 21 • Network relations / dependencies Pini Cohen’s work Copyright 2011 @STKI 180 Do not remove source or attribution from any graphic or portion of graphic

From RT change management• Change management issues are the first number for production errors• Once in a while “odd” things occur. For example Antivirus new definitions has caused one specific application to halt• In most organization there are well defined change management procedures. The procedure are still not followed by all IT members (system, some developers, etc.)• Some organizations are using extra measures: – There are two desktops on the table for production and for non-production – When something is done on production there will be second person observing – The person that wrote a script is not allowed to execute it on production. Another person is called. Pini Cohen’s work Copyright 2011 @STKI 182 Do not remove source or attribution from any graphic or portion of graphic

From RT change management• There are different attitudes at the Change Advisory Board (CAB): – Just approve the change – Manage (put the steps needed for) the change• There is a trend for working in releases rather than treating each change request separately Pini Cohen’s work Copyright 2011 @STKI 183 Do not remove source or attribution from any graphic or portion of graphic

RT change management - Metrics• Number of changes per period• Time to implement a change• Quality metrics (related to development metrics):• Number of errors in production• Number of not successful changes• Number of “re-productions” changes that had to be placed again to production• Number of “urgent” changes (without the standard procedure)• STKI’s take – Users should maintain Change Management metrics! Pini Cohen’s work Copyright 2011 @STKI 184 Do not remove source or attribution from any graphic or portion of graphic

RT change• Scheduling downtime is very difficult• Organizations should have some kind of “agreed” or “default” downtime slot (example second Sunday each month) and not “invent the wheel” each time Pini Cohen’s work Copyright 2011 @STKI 185 Do not remove source or attribution from any graphic or portion of graphic

RT change – Tools related to Change Management• Workflow tools for request approval (no actual provisioning). Many users use SPS-MOSS or extensions to Service Desk incidents. “None-issue”.• Automation Provisioning tools. Related to private cloud. Users are only starting to consider tools on organization level.• CMDB Auto Discovery tools. Currently these tools are not heavily used for Change management procedures. Maybe because CMDB is implemented by the “monitoring” team.• ALM – SCM – software configuration management tools. Mature market. Should manage scripts (DBMS) as well. Users add “other” document for none-code instructions Pini Cohen’s work Copyright 2011 @STKI 186 Do not remove source or attribution from any graphic or portion of graphic

Patch Management• Microsoft Critical Vulnerability patches that require boot are installed about 6 months after released!• STKI does not recommend this!• In DMZ the update is faster• Only patches with active threats (VIP patches) are installed faster!• HW firmware upgrades or other critical SW patches are not installed unless requested by the vendor support when incident has occurred• Desktop patches distribution is less an issue. In many cases the IT will not tell the users about the change. Source: http://careertips4geeks.blogspot.com/2010/10/blog-post.html Pini Cohen’s work Copyright 2011 @STKI 187 Do not remove source or attribution from any graphic or portion of graphic

ESM (Enterprise System Management) support ratio• Numbers of servers in Open (Win, Linux, Unix) covered by ESM team (including BSM, CMDB, etc. – if implemented)• Data about “not capable ESM teams” not included• FTE member: Per FTE # of Servers (all) # of Servers Prod 25 percentile 216 131 Median 347 220 75 percentile 459 316• About the same as last years data Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Market Status and Recommendations• Users are using these integrators (support, maintenance) in ESM – Enterprise System Management BSM CMDB:•Aman• CA• Malam Matrix• Ness HP• IBM Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic 189

Israel Market Positioning – Management Frameworks HP Vendors to Watch: CA Oracle as central console BMCLocal Support IBM Microsoft This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –ESM• IBM Tivoli– Bank Leumi (system automation), Poalim (upgrade)• HP (mainly with Aman) – Shupersal, Cellcom (major upgrade), Visa Cal, IDF (upgrade), Amdocs (Server Automation) , Mirs, Phoenix, Retalix• BMC – Comverse (CMDB), Better Place (upgrade), Bank Leumi (updrage), Yes( upgrade) , Poalim (upgrade - network) , Paz (upgrade) , Coca –Cola (upgrade), Discount (End User)• CA - Ministry of Trasporation (Wily), Partner (upgrade), Mod, Elbit (upgrade), TASE (wily) , Tehila (upgrade) , Pais, (upgrade), Mekorot (upgrade), Ministry of Taasuka (upgrade) Selected Ins Pini Cohen’s work Copyright 2011 @STKI 191 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –Alternatives to the Big 4 ESM• Centerity- Klita office, Bituach Yashir, Knesset, Israel Navy, IDF (several), Milgam, Ariel Collage, Ort, Maariv, Haifa port, Eilat Port (outsourcing), Beitar Ilit municipality, Shikun veBinuy, Africa Israel• Microsoft (service map)– Egged, Leumi Card, Pheonix, Mekorot, Tel-Aviv municipality, Hot• TriggerPlus: Elta, Chimpal , Nice Selected Ins Pini Cohen’s work Copyright 2011 @STKI 192 Do not remove source or attribution from any graphic or portion of graphic

Selected ESM products (big 4) and integrators Selected products and Integrators M atrix / Team Tangra M alam IGS m Ness Netcom AM AN CCC HeadON DoITWize CA x x Tivoli x x x x (netcool) HP x x BM C x Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on ESM• The ESM team should not lean• History of all production faults should be kept for analysis. This will be the base for ESM improvement and implementation of new ESM tools• ESM team approval is a must before change in production systems• BTM is not mature in Israel. Will it be the BTM year?• CMDB has lots of potential but is not viable for some organizations because the heavy investment needed Pini Cohen’s work Copyright 2011 @STKI 194 Do not remove source or attribution from any graphic or portion of graphic

Mini Agenda DBMS• NoSQL• DBMS appliances• From RT’s – about DBA organization, consolidation, etc.• CDC tools• DBA staffing ratios• Ratings Pini Cohen’s work Copyright 2011 @STKI 196 Do not remove source or attribution from any graphic or portion of graphic

The balance is changing Cloud applications have different needs Infra is betterNeed for more Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Big Data• Big Data is a term applied to data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target currently ranging from a few dozen terabytes to many petabytes of data in a single data set.• Examples include web logs, RFID, sensor networks, social networks, Internet text and documents, Internet search indexing, call detail records, genomics, astronomy, biological research, military surveillance, medical records, photography archives, video archives, and large scale eCommerce. (wikipedia) Source: http://fortunewallstreet.files.wordpress.com/2010/12/matrix.jpg Pini Cohen’s work Copyright 2011 @STKI 198 Do not remove source or attribution from any graphic or portion of graphic

Brewers (CAP) Theorem• It is impossible for a distributed computer system to simultaneously provide all three of the following guarantees: – Consistency (all nodes see the same data at the same time) – Availability (node failures do not prevent survivors from continuing to operate) – Partition Tolerance (the system continues to operate despite arbitrary message loss) Source: Scalebase Pini Cohen’s work Copyright 2011 @STKI http://en.wikipedia.org/wiki/CAP_theorem Do not remove source or attribution from any graphic or portion of graphic

What It Means Source: Scalebasehttp://guyharrison.squarespace.com/blog/2010/6/13/consistency-models-in-non-relational-databases.html Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Dealing With CAP• Drop Partition Tolerance – Run everything on one machine. – This is, of course, not very scalable.• Drop Availability – If a partition fail, everything waits until the data is consistent again. – This can be very complex to handle over a large number of nodes. Source: Scalebase Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Dealing With CAP• Drop Consistency – Welcome to the “Eventually Consistent” term. • At the end – everything will work out just fine - And hi, sometimes this is a good enough solution – When no updates occur for a long period of time, eventually all updates will propagate through the system and all the nodes will be consistent – For a given accepted update and a given node, eventually either the update reaches the node or the node is removed from service – Known as BASE (Basically Available, Soft state, Eventual consistency), as opposed to ACID Source: Scalebase Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NoSQL Types• Key/Value – A big hash table – Examples: Voldemort, Amazon Dynamo• Big Table – Big table, column families – Examples: Hbase, Cassandra• Document based – Collections of collections – Examples: CouchDB, MongoDB• Graph databases – Based on graph theory – Examples: Neo4J• Each solves a different problem Source: Scalebase Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Pros/Cons• Pros: – Performance – BigData – Most solutions are open source – Data is replicated to nodes and is therefore fault-tolerant (partitioning) – Dont require a schema – Can scale up and down• Cons: – Code change – No framework support – Not ACID – Eco system (BI, Backup) – There is always a database at the backend – Some API is just too simple Source: Scalebase Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

DBMS market new frontiers: Native Cloud Service Hadoop Cassandra Database.com Xeround Redis Voldemort Amazon Simple DB FathomDB VoltDB MySQL, Memcached Cluster Ed Amazon RDS NoSQL Cloud Enabled SQL MySQL, PostGress, Microsoft SQL Azure XMLDB Gemstone Current Object DB Clustrix IT Microsoft Oracle SQL Server DB2 Traditional Pini Cohen’s work Copyright 2011 @STKI Source: http://xeround.com/207 Do not remove source or attribution from any graphic or portion of graphic

There are some NoSQL projects out there… Source: NoSQL Databases: Providing Extreme Scale and Flexibility By Matthew D. Sarrel Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NoSQL Market Forecast 2011-2015 http://www.marketresearchmedia.com/2010/11/11/nosql-market/ Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Can we live with NoSQL limitations?• Facebook has dropped Cassandra• “..we found Cassandras eventual consistency model to be a difficult pattern to reconcile for our new Messages infrastructure”• Facebook has selected HBase (Columnar DBMS) . http://www.facebook.com/notes/facebook-engineering/the-underlying-technology-of-messages/454991608919 Pini Cohen’s work Copyright 2011 @STKI 212 Do not remove source or attribution from any graphic or portion of graphic

Meanwhile, back on “Earth”, Growing Market- special purpose DBMS machines• Teradata• Oracle Exadata• IBM Netezza• EMC Greenplum• HP• Microsoft- Fast Track and Parallel Data Warehouse Pini Cohen’s work Copyright 2011 @STKI 213 Do not remove source or attribution from any graphic or portion of graphic

Information ManagementThe Netezza TwinFin™ Appliance Slice of User Data Disk Enclosures Swap and Mirror partitions High speed data streaming SQL Compiler Query Plan SMP Hosts Optimize Admin S-Blades™ (with FPGA-based Processor & Database Accelerator) streaming DB logic High-performance database engine streaming joins, aggregations, sorts, etc.214 © 2010 IBM Corporation

Information ManagementAppliance family for data life-cycle management Skimmer TwinFin Cruiser Dev & Test System Data Warehouse Queryable Archiving High Performance Analytics Back-up / DR 1 TB to 10 TB 1 TB to 1.5 PB 100 TB to 10 PB215 © 2010 IBM Corporation

DBMS appliances• First impression from initial testing of DBMS appliances:• Importexport was not trivial. More effort than expected.• Unprecedented performance boost. Examples (empty machine): – From 7-8 hours to 20 seconds – From 3 hours to 1 hour• With heavy loaded machine performance boost is lower• Heavy IO load gets the most performance boost Pini Cohen’s work Copyright 2011 @STKI 216 Do not remove source or attribution from any graphic or portion of graphic

DBA organization• In Oracle centric organizations MSSQL will be in sub-group. In such organizations MSSQL sub-team will have less resources that might cause to SLA issues• DBMS departments suffer constantly from shortage of personal resource. In many case they will agree to support new project with extra personal (since it Capex and not Opex ..) but will use the help in “old” applications• Oracle RAC is superior technology but require more effort and skills and in some cases (bigger –complicated DBMS) might even lead to downtime issues. Users are hoping that Exadata will help with RAC stability. Pini Cohen’s work Copyright 2011 @STKI 217 Do not remove source or attribution from any graphic or portion of graphic

From RT• Users are deploying DBMS in virtual server environment in some cases• About half of application upgrades will cause some serious work from the DBA part (performance, application issues, etc.)• Users indicated the data compression tools and procedures (in the DBMS level) has saved about 30% of space• There is no “Black Box DBMS” in every productproject installed in the organization the DBMS has to “put his hands on”• Users believe that the market is before big changes – technologies and players Pini Cohen’s work Copyright 2011 @STKI 218 Do not remove source or attribution from any graphic or portion of graphic

Automation• Many production errors are caused by change management issues so organizations have development tools and procedures for change management: – Moving DBMS changes from one environment to the other with labels that are related to the SCM tool – What are the differences between two DBMS – Automatic partition management tools – Even RAC management tools – DBA’s should not type directly to the DMBS/ They should uses just scripts that where tested in all environments Pini Cohen’s work Copyright 2011 @STKI 219 Do not remove source or attribution from any graphic or portion of graphic

DBMS consolidation projects• Upgrade applicationDBMS to the same version and put DBMS on one DBMS with several instances (up to 100 applications)• Benefits: – Perform upgrades, patches on one DBMS and not on many – Saving licenses• Issues: – All applications should have the same upgrade cycle (from DBMS perspective) and all should agree on down time slots – Some technical issues (all applications should have the same “init parms”) Pini Cohen’s work Copyright 2011 @STKI 220 Do not remove source or attribution from any graphic or portion of graphic

Local Trends• Data Compression can save up to 30% and even more.• All DBMS in packagesapplications developed in outsourcing needs intervention from the local DBA team. “Black Box DBMS” model is not working. Pini Cohen’s work Copyright 2011 @STKI 221 Do not remove source or attribution from any graphic or portion of graphic

DBA organization• DBA’s are divided in larger organizations to several groups: – Production DBS – Testing and Change Management – Application – ADBA – In larger organizations the production has sub-team for performance• Example of DBA organization: Non-Prod 20% Prod Source: STKI ADBA 55% 25% Pini Cohen’s work Copyright 2011 @STKI 222 Do not remove source or attribution from any graphic or portion of graphic

Attunity CDC Suite for SSIS an Operational Data Replication solution Complete solution for real-time and efficient heterogeneous data replication and integration, integrated with SQL Server. 1. Low impact on data server using log-based CDC technology 2. Efficiency and reduced resources, processing only incremental changes 3. Fully integrated with SSIS (2000, 2005) for ease of use 4. Monitoring and control console to manage replication processes 5. Capitalize on existing investments in SQL Server licenses1. SQL Server2. Oracle3. DB2/4004. DB2 on z/OS5. NonStop SQL/MP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

DBMS Support Ratios• Number of developers (in the Open) supported by DBA FTE Per FTE # of Applications New 25 percentile 11 Median 19 75 percentile 28 Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Market Status and Recommendations• Users are using these integrators (support, maintenance) in DBMS open area:• Oracle• Microsoft• Veracity Many smallgood integrators in this area• Matrix• Valinor• Priority• IBM• Inspire many other exist Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning – DBMS Open – General Usage Oracle MicrosoftLocal Support IBM This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI’s take on DBMS• Automation Automation Automation• Workflow, Self-service• Focus on change management• Standardization• Watch for NoSQL development• DBMS Consolidation Pini Cohen’s work Copyright 2011 @STKI 228 Do not remove source or attribution from any graphic or portion of graphic

Mini Agenda - Platforms• Fabric Computing• Green Capacity• Mac servers• Server virtualization issues and vendors• Platform staffing ratios• Server production ratios• Vendor Ratings Pini Cohen’s work Copyright 2011 @STKI 230 Do not remove source or attribution from any graphic or portion of graphic

Technologies Maturity Model 2011 ServersBusiness Value Investment IT Project to make money Pure Cloud Business Server Servers Project Cut costs, Increase Virtualization productivity for Prod Multi domain Automation Linux Server UnixMF Legacy Quantum Commodity IT Servers consolidation Unified Computer Services Fabric Specific domain Computing Investment Automationfor regulations Using Implementing Looking Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Fabric Computing• The Goal is to create a very flexible, elastic infrastructure on which a variety of applications can be easily provisioned and efficiently operated.• Interconnected nodes that look like a weave or a fabric when viewed collectively from a distance• The main advantages of fabrics are that a massive concurrent processing combined with a huge, tightly-coupled address space makes it possible to solve huge computing problems and that they are both scalable and able to be dynamically reconfigured• Challenges include a non-linearly degrading performance curve, whereby adding resources does not linearly increase performance which is a common problem with parallel computing and maintaining security. Source: wikipedia STKI modifications http://en.wikipedia.org/wiki/Fabric_computing#cite_note-fabrics-1 and http://forums.juniper.net/t5/Architecting-the-Network/Fabric-Computing-Gartner-s-view-for-the-future-of-the-datacenter/bc-p/75834 Pini Cohen’s work Copyright 2011 @STKI 232 Do not remove source or attribution from any graphic or portion of graphic

Instead of “islands” of servers… Data Groupware BPM Accounting Billing Compliance Portal Mining ManagementCPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMHBAHBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA KVMKVM KVM KVM KVM KVM KVMNICNIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC Database ERP CRM Email Business Data RiskApplication Intelligence Warehouse ManagementCPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMHBAHBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA KVMKVM KVM KVM KVM KVM KVMNICNIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC NIC Source: egeneraNetwork Storage KVM Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

A “pool” of computing resources! Data Groupware BPM Accounting Billing Compliance Portal Mining ManagementCPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMKVM KVM KVM KVM KVM KVM KVMHBA HBA HBAHBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA NIC NIC NICNICNIC NIC NIC NIC NIC NIC NIC NIC NIC NIC Database ERP CRM Email Business Data RiskApplication Intelligence Warehouse ManagementCPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMHBAHBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBA HBAKVM KVM KVM KVM KVM KVM KVM NIC NIC NIC NICNICNIC NIC NIC NIC NIC NIC NIC NIC NIC Source: egeneraNetwork Storage KVM Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

A “pool” of computing resources! Data Groupware BPM Accounting Billing Compliance Portal Mining Management CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM Database ERP CRM Email Business Data Risk Application Intelligence Warehouse Management CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMControl HBA HBA KVM KVM NIC NIC Source: egeneraBlades Network Storage Management Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic Portal

A “pool” of computing resources! Data Groupware BPM Accounting Billing Compliance Portal Mining Management CPU RAM Database CPU RAM CPU RAM CPU RAM CPU RAM Business CPU RAM Data CPU RAM Risk Application ERP CRM Email Intelligence Warehouse Management CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMControl HBA HBA KVM KVM NIC NIC Source: egeneraBlades Network Storage Management Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic Portal

A “pool” of computing resources! Data Groupware BPM Accounting Billing Compliance Portal Mining Management Database Business Data Risk Virtual Application ERP CRM Email Intelligence Warehouse Management Servers Virtualization Layer CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM Stateless RAM CPU CPU RAM CPU RAM CPU RAM CPU RAM CPU RAM CPU RAMProcessing Blades High-Speed Low Latency Fabric Switch Control HBA HBA KVM KVM NIC NIC Source: egenera Blades Network Storage Management Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic Portal

Results of Blade EverythingThe industry‟s most complete portfolioEnclosures A Full Range of 2P and 4P Blades Server Blades Workstation Storage Blades Blades Unified Management Choice of Power Services Assessment Implementation SupportInterconnect choices for LAN, SAN, and Scale-Out ClustersVirtual Connect LAN Ethernet NICs SAN Fibre Channel InfiniBand 4X DDR

FlexPod for VMwareVMware vSphere 1 Rack Data Center SolutionVMware vSphere Enterprise Plus 30 Westmere CPUs (180 cores)VMware vCenter Standard 2 TB server memory (up to 4 TB) 40-Gbps interconnect (4x 10 GE)Cisco® Unified Fabric 512-GB SSD storage cache2 Cisco Nexus® 5548 with fabric services 42 TB storage (per 3 FlexPod configurations)2 Cisco Nexus 1010 and 1000V 1 Enterprise IT Infrastructure For an organization of 1500 usersCisco UCS Platform with a mixed workload of:2 Cisco UCS 6120XP Fabric Interconnect  VMware View 4.5 (MS Windows 7)3 Cisco UCS 5108 Blade Server Chassis  MS Exchange 20109 Cisco UCS B-250 M2 plus VIC  MS SharePoint 20106 Cisco UCS B-200 M2 plus VIC  MS SQL Server 2008 R2  Plus headroom for more applicationsNetApp FAS3210A4 NetApp DS2246 450-GB SAS shelves2 256-GB flash cache Two classes of computing2 10-Gbps IP interfaces supporting dense memory and4 4-Gbps Fibre Channel interfaces general virtualized workloadsNetApp complete bundle © 2010 NetApp, Cisco, and VMware. All Rights Reserved. C97-633489-00 239

The race for green capacity - iDataPlex Rack -vs.- Standard 19” Rack  Rack is rotated 90 – Half-depth, front-access servers. • Low airflow impedance. • Servers located side-by-side. • Doubles server density in similar footprint.  100U Rack – 84U for Nodes, etc. – 16U for switches, etc.(vertical) 1280mm 444 x 700mm 444 x 700mm 1050mm 1200mm 1020mm 446 x 520mm 446 x 520mm w/RDHx) 600mm (840mm Pini Cohen’s work Copyright 2011 @STKI Source: IBM240 Do not remove source or attribution from any graphic or portion of graphic

The role of System is changing• The “System” is changing: – From HW and OS centric that is focused on the particular platform – To integration between systems, connectors and XML• More “business process” oriented – need to know what the application is doing and what is the business process even before installing a patch Pini Cohen’s work Copyright 2011 @STKI 243 Do not remove source or attribution from any graphic or portion of graphic

Server Virtualization is the King Source: http://www.phoenixmasonry.org/images/King_Solomon.jpg Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

At What stage are You? Separate Consolidate Mutualise Automate Liberate DC consolidation & Disaster Recovery Virtual Desktop InfrastructureSource: F5 virtualization Bus. Continuity Cloud projects Dynamic Application projects (migration, Provisioning SLA Management new services) Server On demand On demand Application control (& Cloud) Test & Dev Consolidation capacity Datacenter Virtual Desktop Infrastructure Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Enterprise Virtualization to Cloud Maturity ModelSeparate Consolidate Aggregate Automate LiberateTest and Development Server Capacity Self-Managing Enterprise Computing Consolidation On Demand Datacenters Clouds On and Off Premise Private Public Source: F5 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Server Virtualization Vendors• VMWARE is the King• Microsoft is trying very hard.  Selected hyperV clients (some not only hyperV) : Tel-Aviv Municipality, Israel Navy, Tehila, Leumi Card, Bituach Leumi, Rashut Sdut Hateufa, Eliara, Leumit Health, Clalit Health, Mercantile Bank, Mekorot, Hadassa, Orbotech, Israel Police, Ayalon Roads, Frutarom, Nice, Poria Hospital, Municipality of Ramat Gan, Israel foreign Affairs.• Microsoft will grow its share but will not threaten VMWARE in the near future. Redhat (Kumranet) and Citrix (Xen) have also technically good solutions.• The Key for Microsoft is Management and Automation (Microsoft System Center Virtual Machine Manager Self-Service, Opalis, etc.) Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Server Virtualization Issues• Define business QOS to application. For example – in high load give CRM guests better resources (CPU, Storage, Network)• Define procedures and use them in different environments different servers• Monitoring – is 100% CPU “real” number? Is 50% CPU “real” number”?• DuplicateAdd server if needed• Capacity planning• Mapping the relationships between application workloads, physical and virtual servers and the attached storage Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Adding another server- not that easy…• Example: adding Websphere server to cluster:  Use a text editor to open the wpconfig.properties file.  Windows and UNIX location: portal_server_root/config/wpconfig.properties  Ensure that the following properties are uncommented and specify appropriate values:  ClusterName property: Specify the name of the cluster to which you are adding the node.  ServerName property: Specify the cluster member name you want to use when adding this node to the cluster. Important: The cluster member name you specify for this property must be unique within the cell and cannot have the same value as the ServerName property on the primary node or other secondary nodes.  PrimaryNode property: Verify that the value for this node is false.  Add the node to the cluster.  Windows and UNIX: Run the following command from the portal_server_root/config directory: – Windows: WPSconfig.bat cluster-setup -DWasPassword=password – UNIX: ./WPSconfig.sh cluster-setup -DWasPassword=password  Click the application server name for the secondary node.  Click Ports under the Communications settings, and verify the port number listed for the WC_defaulthost port.  Click Servers > Cluster Topology to view the updated cluster topology.  Regenerate the Web server plug-in.  Regenerate the Web server plug-in using the deployment manager administrative console.  If you are using a remote Web server, copy the updated plug-in configuration file (plugin-cfg.xml) to the Web servers plug-in configuration directory.  Stop and start the Web server.  Restart all cluster members, where each cluster member is a single application server in the cluster. Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic Source: http://publib.boulder.ibm.com/infocenter/wpdoc/v6r0/index.jsp?topic=/com.ibm.wp.ent.doc/wpf/clus_install_addmember_horiz.html

The Unbearable Lightness of Virtualization• Before- when needing a server you’ve need to: plan (space, electricity , cooling), negotiate, order, wait for shipment, install, ….• Now – 8 minutes and you’ve got up and running server!• So now if you have some kind of problem or something is stuck you might try to add more servers. Maybe this will solve the issue.• This means developmentarchitecture has to work less in certain architecture scenarios (performance, scalability, availability)• But what about: – Good SW development – finding whats wrong and not just adding more servers – Licensing – Monitoring – Storage, Backups – Complexity! Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Server Ratios - Windows• Number of Windows Servers (logical ) per System member Per FTE All Win Prod Win Servers Servers 25 percentile 92servers 47servers Median 122 Servers 67 Servers 75 percentile 200 Servers 100 servers – Median about the same compared to last year but both 25% percentile and 75% percentile increased at about 15% – Server is either physical or virtual – This includes SBC (CitrixWTSJetro) support• For development environment’s ratios can grow up to 600 Servers per FTE• Organizations with 100% identical servers in branches can get ratios of 1:500 servers per FTE Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Percent of Production Windowsserver from all Windows servers Percent of prod servers 25 percentile 50% Median 62% 75 percentile 75% Server is either physical or virtual Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Server Ratios –Unix Linux• Number of Unix (OS) and Linux servers per System member: Per FTE Unix Linux Servers 25 percentile 15servers Median 35 Servers 75 percentile 50 Servers• Roughly same ratios as last year’s data• Virtualization is used much less in Unix then in WindowsLinux• Good metric for Unix is hard to find: – Per CPU (but there are machines with many virtual OS on each CPU) – Per OS (but there are sometimes huge machines with 1 OS) – Per physical server Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NOC, Operators Ratio• Number of Open production servers per NOC person: Per FTE Unix Linux Servers 25 percentile 15servers Median 46 Servers 75 percentile 80 Servers• Large variety since there is large variety in NOC operations• MF, AS/400, OpenVMS – not included in the count but add lots of load Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

NOC (Network Operation Center), Operators, “Gesher”• Huge variety of NOC responsibility: – Look only at monitoring screens – Batch operations (both production Control-M, FTP, and infra such as backup) – Change management – Service desk during night – Physical room – electricity, cooling• Mostly 7*24 withwithout Saturday• In organizations with no NOC the Service Desk will have to look at the monitoring screens Pini Cohen’s work Copyright 2011 @STKI 255 Do not remove source or attribution from any graphic or portion of graphic

Market Status and Recommendations• Users are using these integrators (support, maintenance) in Servers-Platform Open area:•HP• EMET• WE IBM Malam-Team• Matrix (both for Redhat and Infra) One1• PenguinIT CCC Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning – Industry Standard Processors X86 including blades (Intel AMD) HP IBMLocal Support DELL Cisco This analysis should be used with its supporting documents – specifically for Dell and CISCO positioning Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

CISCO UCS selected clients• Amdocs (project), Nice, Discount Bank, Yes, Bezeqint, Interwize, Vishay, IRRATIONAL SOLUTIONS, Foris, Smile 012 Pini Cohen’s work Copyright 2011 @STKI 258 Do not remove source or attribution from any graphic or portion of graphic

Cisco• Cisco has certainly “pumped new blood” into the mature server market• Many clients see the benefit in unified (fabric) computing where compute storage and networks are provisioned together in agile manner. Cisco is perceived by many clients as a leader in this trend.• Users expect the rest of the players to follow.• Still, users want standardization and in HPIBM dominant market many users will go to Cisco new only at good price tag off HPIBM offering.• Cisco is not always able to come with this kind of price tag. Large network deals can help the client in this perspective.• Users say – “I did not take Cisco now but I will reconsider in 3 years” Pini Cohen’s work Copyright 2011 @STKI 259 Do not remove source or attribution from any graphic or portion of graphic

Dell• Dell has very good name for its reliability and for its “value per money” proposition• However in the Blades market Dell was a bit late (functionality, certifications, marketing, etc.) and this led to “Dell lovers” to prefer HP or IBM in Blades.• Currently Dell is not considered “well established” Blades player in Israel but it has the potential for regaining this position Pini Cohen’s work Copyright 2011 @STKI 260 Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning -Unix IBM HPLocal Support Many clients ask themselves about the future of SUN Oracle/ SUN This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

About Unix positioning• Users perceive IBM as the leader from technology point of view• Several time during the survey I heard: – “All are bad” – “I will give you the rating but I’m not buying more Unix machine- just moving to Linux” Pini Cohen’s work Copyright 2011 @STKI 262 Do not remove source or attribution from any graphic or portion of graphic

Technologies Maturity Model 2011– End Point DevicesBusiness Value Investment Mobileto make money Devices MAC for the Business Microsoft IT ProjectCut costs, Increase Traditional BPOS productivity SBC for niche VDI Pure Business environment Application Project virtualization OfficeCommodity IT 2007 Windows 7 Services Software Appliances Investmentfor regulations Using Implementing Looking Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Mini agenda – Clients• Desktop virtualization• Zero Client• Keyboard Projection• SW update cycle status (Windows Office)• Bring Your Own PC• Graphics processing unit programming• Clients support staffing ratio• Vendor ratings Pini Cohen’s work Copyright 2011 @STKI 265 Do not remove source or attribution from any graphic or portion of graphic

Desktop Virtualization• The hottest buzz!• Major pros:  Application Compatibility – no effort is needed – especially from the development team  More personalization  Will enable in the future public cloud• Major cons:  Cost (VDI license, VDA, infrastructure)  Maturity (Dedup in Storage, updating master in none-persistence environment, etc.)  New technologies are needed for application distribution• STKI take: as Desktop Virtualization and Cloud concept will mature Desktop Virtualization will appear strategic desktop delivery mechanism Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Desktop Virtualization• Although Application Compatibility is major advantage of Desktop virtualization, there are still some (minor) compatibility issues:  When the name of the desktop has some importance to the application – the default naming convention of the VDI infrastructure is not applicable  In default VDI implementation SID (Security IDentifier) is reused and this can cause problems with several inventory systems Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Desktop Virtualization• Different organizations will look at Desktop virtualization differently:  Organizations with well managed and secured desktop environment – delivering one PC image to all employees at the IT service desk with good SLA  Organization with several images to several locations employee types, different security mechanizms, Second level support staff must come to the employee, with too much autonomy to the LOB departments• IT organization should be very clear with the desktop virtualization project targets (Business continuity, better security) .• Currently there Desktop Virtualization is not a silver bullet (ROI, TCO) to all organization. Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Zero or Ultra-thin client• No longer runs a full operating system: the kernel instead merely initializes the network, begins the networking protocol, and handles display of the servers output. (Wikipedia)• Pano Zero Client “ .. no CPU, no memory, no operating system, no drivers, no software and no moving parts” Pini Cohen’s work Copyright 2011 @STKI 270 Do not remove source or attribution from any graphic or portion of graphic

Zero ClientsWhat is a zero client?• A simple appliance which connects users into one hosted environmentWhat experience does a zero client deliver?• Quickly and seamlessly transports users into their corporate environmentWhat expectations have been established for zero clients?• Client-side setup is either completely automated or not required• Endpoint management is either completely automated or not required• The desktop device is expected to be small, energy efficient, affordable, and fast bootWho would want a zero client?• Practical for modern SBC or VDI owners with user populations connecting into one corporate environment Source: HP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

value propositionWhat are the user benefits of a zero client?• The user is quickly transported into their corporate environment upon boot• The complexity of a local UI and connection launch is eliminatedWhat are the IT administrator benefits of a zero client?• Client-side setup is either fully automated or eliminated• Desktop endpoints are generic with low power consumption• No desktop management infrastructure is required• ISV host resources are maximized for true centralized ITWhat are the limitations of a zero client?• No legacy host support, e.g. Unix, Sun, IBM mainframes, etc.• No local web browsing or Java support• Users cannot connect to multiple host environments• Does not support wireless or VPN connections Source: HP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

User ExperienceTRADITIONAL THIN CLIENT A Boot Local UI Connect Pre-Configured Locally OR Inherited Config Remotely A Login Begin Work Source: HP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

User experienceZERO CLIENT Boot Connect & Login Begin Work Check for Check for Settings Retained New Client Kit New Config File Source: HP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

More keyboard technologies Source: http://www.computerworld.com/s/article/9202298/Will_touch_screens_kill_the_keyboard_?taxonomyId=128&pageNumber=3 Pini Cohen’s work Copyright 2011 @STKI 277 Do not remove source or attribution from any graphic or portion of graphic

Bring you own PC (BYOPC) Source: http://gogadgetforum.com/showthread.php/2179-Want-to-bring-your-own-PC by Freeform Dynamics Pini Cohen’s work Copyright 2011 @STKI 279 Do not remove source or attribution from any graphic or portion of graphic

From 2009 presentation: General Purpose PCcomputation on the GPU (graphics processing unit) Trends – Started in computer graphics community – Mapping computation problems to graphics rendering pipeline Pini Cohen’s work Copyright 2011 @STKI Courtesy Jens Krueger and Aaron Lefohn Do not remove source or attribution from any graphic or portion of graphic Source : http://www.na-mic.org/Wiki/images/5/5c/Hpc-g80-cuda.ppt stki modifications

Windows market shareSource: http://marketshare.hitslink.com/operating-system-market-share.aspx?qprid=8 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

When upgrading Windows or Office• In most cases special training is needed.• In some organizations where not all employs did show up to the course- the Service Desk got many questions• Other users upgraded only to users who did show up. Pini Cohen’s work Copyright 2011 @STKI 287 Do not remove source or attribution from any graphic or portion of graphic

PC Support Ratios• Support per PC is not equal to Support per Employee since there might be organizations with more PC and Employees (some employees has more than one PC) or vice versa (one PC is used for several employees working in shifts). The difference is small.• Service desk ratios variation is related a lot to the “application support” and even “business support”.• Applicationbusiness related support might be up to 30% of service desk effort Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

PC Support Ratios and TCO• 2nd level support is dependent on geographical locations and related devices (“check readers”)• PC Second Level support Ratios variation is very big since in some organizations the field technicians are part of new system implementation, some are responsible for HW (and some not…)• Thin client reduces the need for 2nd level support but increases the need for infrasystem support• Is the SBC system part of System or PC ?! Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

PC Support Ratios• Support Per PC for FTE Per FTE Service Second Third – Total Desk Level Image Support per PC 25 percentile 208 285 1000 117 Median 458 417 2000 159 75 percentile 573 525 3050 201 Source: STKI• Support per Employee for FTE Per FTE Service Second Third – Total Desk Level Image Support per Empl. 25 percentile 250 247 1025 117 Median 492 400 2000 157 75 percentile 592 675 3375 260 Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Market Status and Recommendations• Users are using these integrators (support, maintenance) in Clients area:• One1 (including Calanit, Harel)• Malam• Taldor• Ness• Matrix• Hayun Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning Desktops Vendors to Watch: HP AppleLocal Support DELL Not rarely I hear – its all the same! Lenovo Acer This analysis should be White used with its supporting boxes documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning Laptops Vendors to Watch: Lenovo is loosing some of its dominance Lenovo HP LG DELL ToshibaLocal Support Sony Apple Worldwide Leader This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Technologies Maturity Model 2011 StorageBusiness Value Investment Sophisticated snaps for creatingto make money CDP environmentsCut costs, Increase Green Dedup for VTL Dedup Storage Primary productivity for Backup storage Storage Thin Virtualization ProvisioningCommodity IT NAS and FCOE Services SAN Flash Drives Cloud Email Email Storage Investment Archiving Archivingfor regulations as a service Using Implementing Looking Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Mini agenda- Storage• Storage growth• Storage protocols – FCOE• High density storage• RAM and SSD storage• Storage virtualization• VTL-Deduplication status• New type of storage vendors• SAN vs. NAS Highend vs. Midrange• Staffing ratios• Vendor ratings Pini Cohen’s work Copyright 2011 @STKI 296 Do not remove source or attribution from any graphic or portion of graphic

Ubiquitous computing pervasive computing Audio-Video Cluster Computer as Hub of cluster Local Network User Interaction Internal Comms.Source: http://www.elec.qmul.ac.uk/people/stefan/ubicom/slides/ubicom-ch02-slides.ppt Processing: edit, annotate, compose Management: Resources & Content Storage Email Web Ubiquitous computing: smart devices, environments and inte Wide network Chat VoD Audio-Video Stream VoIP Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Storage Size and Growth in Selected IndustriesIndustry 2011 1Q 2010 1Q Planned Size RAW Size RAW Growth per yearDefense 500T-6P 500TB-4P 50%- 100%Finance 600T-1.3P 400TB-1P 40% - 75%Health 140T-550T 140TB-350TB 30%-50%Manufacturing – 100T-250T 40TB-200TB 20%-50%RetailTelco 2P-3P 900TB-2.5 30%-50% PETAGovernmental 100T-300T 10TB-30TB 25%-100%PublicHigh Tech 150T-550T 40TB-150TB 20%-30% Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Protocol Comparisons FC over Ethernet (no TCP/IP) App App Applications Applications SCSI SCSI SCSI SCSI iSCSI FC FC FC FC FC SRPEncapsulation Encapsulation iFCP FCIP TCP Layer Layer TCP TCP IP IP IP FCoE FCoE Base Base FC Infiniband Ethernet Ethernet Transport Transport Block storage FC replication New transport and with TCP/IP over IP FC management drivers Low latency, high Source: EMC http://www.google.co.il/url?sa=t&source=web&cd=1&ved=0CBkQFjAA&url=http%3A%2F%2Fwww.scalar.ca%2Fnewsevents%2Fdownload%2FFCOE- Aug7.ppt&rct=j&q=%22Data%20center%20Ethernet%22%20%20%22Converged%20Enhanced%20Ethernet%22%20%20FCOE%20filetype%3Appt&ei=cJt4TafEF8Kg8QOx883ABA&usg=AFQjCNEjDc bandwidth AKpuQjNVJ1-HfyhzhCGqmMcw&cad=rja Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Lossless Ethernet AKpuQjNVJ1-HfyhzhCGqmMcw&cad=rja Aug7.ppt&rct=j&q=%22Data%20center%20Ethernet%22%20%20%22Converged%20Enhanced%20Ethernet%22%20%20FCOE%20filetype%3Appt&ei=cJt4TafEF8Kg8QOx883ABA&usg=AFQjCNEjDc Source: EMC http://www.google.co.il/url?sa=t&source=web&cd=1&ved=0CBkQFjAA&url=http%3A%2F%2Fwww.scalar.ca%2Fnewsevents%2Fdownload%2FFCOE-• Limit the environment only to the Data Center – FCoE is Layer 2 only• IEEE 802.1 Data Center Bridging (DCB) is the standards task group• Converged Enhanced Ethernet (CEE) is an industry consensus term which covers three link level features – Priority Flow Control (PFC, IEEE 802.1Qbb) – Enhanced Transmission Selection (ETS, IEEE 802.1Qaz) – Data Center Bridging Exchange Notification (DCBX, currently part of IEEE 802.1Qaz, leverages 802.1AB (LLDP))• Data Center Ethernet is a Cisco term for CEE plus additional functionality including Congestion Notification (IEEE 802.1Qau) Enhanced Ethernet provides the Lossless Infrastructure which will enable FCoE and augment iSCSI storage traffic . Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

RT storage• Users are certain that FCOE will change dramatically the storage landscape and the relationship between Storage and Networking• However users believe that FCOE will mature only in about 2-3 years or more Pini Cohen’s work Copyright 2011 @STKI 305 Do not remove source or attribution from any graphic or portion of graphic

FCoE Extends FC on a Single NetworkServer sees storage traffic as FC Network FC Ethernet Driver Driver Network FCoE SW Stack Standard Converged 10G NIC Network Adapter FC storage 2 Lossless Ethernetoptions Links FC network Ethernet Converged FC Network Switch Source: EMC http://www.google.co.il/url?sa=t&source=web&cd=1&ved=0CBkQFjAA&url=http%3A%2F%2Fwww.scalar.ca%2Fnewsevents%2Fdownload%2FF COE- Aug7.ppt&rct=j&q=%22Data%20center%20Ethernet%22%20%20%22Converged%20Enhanced%20Ethernet%22%20%20FCOE%20filetype%3A ppt&ei=cJt4TafEF8Kg8QOx883ABA&usg=AFQjCNEjDcAKpuQjNVJ1-HfyhzhCGqmMcw&cad=rja Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic SAN sees host as FC

GS: Price gap is closing. We expect 80GB-100GB SSDs to be within $100 of a HDD in the next 24 months. Source: GS http://bg.panlv.net/file/2010/01/10/087c22dd5c96e25f.pdf Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Kaminario K2- DRAM Storage Appliance Most demanding business application Up to 25x performance Less than 1 day deployment Kaminario K2• Performance – eliminate the I/O bottleneck! Enables millions of IOPS, 10s GB/s, low latency• High Availability – data protection, no SPoF• Scalability – start small and grow• Easy – any application, no tuning

Kaminario K2 Capabilities - Performance • Eliminates I/O bottlenecks • Millions of IOPs – 300K to 1.5M IOPs • high throughput – 3.2GB/S to 16GB/S • Application performance – 2x - 25x improvement • Consistent performance for any workload, and with no degradation over timePage310

Storage virtualization- the next big thing?!• We have expected many years? Will it ever come?!• Looks like it is progressing (abroad) Pini Cohen’s work Copyright 2011 @STKI 311 Do not remove source or attribution from any graphic or portion of graphic

RT storage – VTLDedup• VTL Dedup has matured a lot this year• There are occasionally Dedup product and Backup software compatibility issues. In many cases license update for the backup SW is needed.• Also the integrator should have good knowledge both in the Backup SW and the DedupVTL solution• Accessing the VTL directly (without the backup SW) might be very useful in call center environments for recording hearing• Currently not all source type are appropriate for Dedup. Example of problematic situations – DBMS log files, Exchange EDB, etc.• Users believe that one algorithmmethod should be used for all Dedup purposes – both source and target Dedup. Symantec is leading the pack in this area. Pini Cohen’s work Copyright 2011 @STKI 312 Do not remove source or attribution from any graphic or portion of graphic

RT VTL DEDUP• Actual Dedup ratio in Backup environment is about 1 to 10. Vendors claim much more…• The solution throughput and scalability are also an issue• Some clients have discontinued physical tapes completely! But most clients to backup to physical tapes once in a while. Pini Cohen’s work Copyright 2011 @STKI 313 Do not remove source or attribution from any graphic or portion of graphic

RT VTL cont.• Backup of virtual server environment is still an issue. Backing up with traditional agents on each guest might cause issues (CPU, network overloaded)• Users are implanting VMware Data Recovery (VDR) orwith Dedup products (Avanar , Puredisk). Backup with storage snaps is also an option used• Who is responsible to the virtualization storage needs? The System or Storage groups ? Pini Cohen’s work Copyright 2011 @STKI 314 Do not remove source or attribution from any graphic or portion of graphic

Production Dedup and Compression• Backup of Prod data is promising technology. Currently users are using mainly Netapp and to some extend EMC’s technologies• Users have witnesses even 35% reduction of space in NAS environments• The combination of production Dedup and Snaps is not always appropriate. Dedup and compression might work better.• IBM purchase of Storwize is also a sign for the importance of these technologies Pini Cohen’s work Copyright 2011 @STKI 315 Do not remove source or attribution from any graphic or portion of graphic

New type of vendors• Local, Agile, Knowledgeable, Hands on and Brave!• Example: OpenStorage representing many small vendorssolutions such as Nexenta, Arkeia, Gluster, SANS DIGITAL and also established solutions such as HP and EMC• Assembling locally storage solution Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Next-Generation Unified StorageOptimized for today‟s virtualized IT EMC Unisphere VNXe3100 VNXe3300 VNX5100 VNX5300 VNX5500 VNX5700 VNX7500 Affordable. Simple. Efficient. Powerful.© Copyright 2011 EMC Corporation. All rights reserved. 318

High End Storage vs. Midrange Storage• The majority of IT organizations differentiate High End and Midrange Storage solutions. What differentiate according to users: – Performance (example: “500 to 900 MB per second is HIGHEND”) – Availability – Reliability – Higher risk – Upgrade firmware without downtime – Functionality (number of copies, failback, etc.) – Price – More difficult to manageoperate Source: http://blog.oregonlive.com/clackamascounty_impact/2009/07/large _Worthington-Testifies.JPG• Big storage shops tend to differentiate• Higher level managers tend not to differentiate• New argument this year “Do not need midrange storage – we can use SATA in highend”! Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

STKI’s take• VTLDedup is maturing fast and can bring real benefit now.• Soon we will have “general storage” category. Specialized “HighEnd” or NAS will be a niche.• Managing the storage will be key priority• Automation Automation Automation (which also means standardization)• Users should have established storage metrics such as: – Storage managed per administrator – Storage in inventory - unused storage divided by total storage – Data multiplier (number of copies made of primary data ) – Data availability (number of hours storage is – Mean time to recovery (MTTR)• IAAS (Storage services) will become mainstream for long term data retention needs in about 5 years Pini Cohen’s work Copyright 2011 @STKI 322 Do not remove source or attribution from any graphic or portion of graphic

Competition in Storage is the toughest!• User to STKI “I am in shock. From 60% price reduction in two months!” Source: http://t2.gstatic.com/images?q=tbn:ANd9GcRry6HPDj21W6jLMe6hIeJFDJtuA0JLGJFIah_GGbelxmC5DNCL Pini Cohen’s work Copyright 2011 @STKI 323 Do not remove source or attribution from any graphic or portion of graphic

Storage Ratios• Number of Raw TB and Usable TB per Storage Staff Member FTE (including backup and DRP of storage): Per FTE RAW Storage Usable Storage 25 percentile 97TB 42TB Median 225TB 150TB 75 percentile 350TB 238TB• Moderate 25% increase from last years data Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Usable/Raw storage ratio• Net Storage in this research – usable for applications: – After Raids – After replication to DRP – Without VTL’s NETRAW Ratio – The term “Usable storage” is 25 percentile 50% tricky since with snapshots Median 60% and thin provisioning 75 percentile 71% application can see more storage then “Raw storage” Source: STKI Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Market Status and Trends• Survey has shown that these integrators are used: (providers – from service point of view) in Storage area:• EMC• Netapp• HP IBM Hilan (WE+Ankor)• Malam-Team Emet• HDS Matrix Bynet Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Market Status and Trends• Survey has shown that these integrators are used: (providers – from service point of view) in backup area:• GlassHouse• IBM• HP• Emet• Team RealNetworks Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning High-end Storage (total including MF) EMCLocal Support IBM HDS HP This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning Midrange Storage SCSI EMC Vendors to Watch: NETAPP IBM XIV N DS DataDirectLocal Support Networks HP Midrange storage share is rising on the expenses of highend storage HDS This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning General Storage Solution – starting point for general use Leaders EMC NETAPP HPLocal Support IBM XIV N DS HDS This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning Storage NAS NETAPPLocal Support EMC This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Israel Market Positioning (Enterprise Backup SW) Backup to Symantec Cloud is an option: example AsigraLocal Support EMC IBM HP This analysis should be used with its supporting documents Israeli Market Presence Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –StorageEMC- IDF, Hot, Teva, Partner, Cellcom, Bezeq, Pelephone, 012,Yes, ITEAM, VISA CAL, Discount, Clal, Comverse, Amdocs, IEC,Zim, MotorollaNETAPP (some via IBM) – Clalit, IAI, Elbit, Postil, Rafael,Pelephone (upgrade), Cellcom (upgrade) , Clal, Ministry ofTransportation, NetafimHDS:HDS: Walla, Kul Al Arab, H&M, Aeroscout, Office Core,DIDWW, Shararey Zedek hospital, Mataf(upgrade),Poalim(upgrade), Igud (upgrade), Bezeqint (Upgrade), BituachLeumi (updrade), Shaam(upgrade), Ministry of Social Affairs(Revaha) upgrade, Migdal (upgrade), Teva (upgrade), TASE(upgrade), Clalit (upgrade) Pini Cohen’s work Copyright 2011 @STKI 334 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –StorageIBM – IAA (DS), Ayalon (DS), Menora (DS). Isracard (DS)Poslim (DS), IEC (XIV) , Mn. Of Education (XIC), Mn. OfTransportation (XIV), Hotzaa Lapoal (XIV), CentralStatiscial Bereau (XIV), LivePerson (XIV) Pointis (XIV),Hachsharat Hayeshuv (XIV), 012 (XIV) Bank Leumi (XIVupgrade) Leumit (XIV upgrade), MeuchededKaminario – Digitaltrowel, other installations Pini Cohen’s work Copyright 2011 @STKI 335 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List of selected wins –Storage• HP (wins and upgrades and customers) Kenshoo ; ECI ; Amdocs; Assaf Harofeh ; Bank- Hapoalim ; Bank- Yahav ; Bank of Palestine ; Bezeq International ; Bezeq, Brom ; Dead Sea Works ;Egged;Elisra ; Flextronics ; Hadassah Hospital ; Haaretz ; Hillel Yaffe ; Intel Israel Police ; JaJah ; Keter-Plastic ; Logic ; Microsoft ; Maccan Ericson ; Mifal HaPais ; Ministry of Justice ; Ministry of Finance ; Nilit ; Nice ; Osem ; Strauss-Elite ; Peker Plada ; Zoglovek ; TOTO ; JCE; Big ; Fox ; Rami-Levi ; Tuttnauer ; Ramat- Gan Municipality ; Ministry of Interior ; Altshuler Shaham;Migdal ; Shirionit- Hosem ; Haifa Municipality ; Ruppin Collage ; Ministry of Health ; Flying Cargo ; Tamnun ; Bakara- Geva ; Shagrir ; Tel Aviv Municipality ; Jerusalem Municipality Comverse ; Star-Home ; Sapir Collage ; Amiad; RH Electronics ; Orbotech ; Random Logic ;Numonix ; Sintecmedia ; Carmel Olefins ; Maman Cargo ; Hillel Yafe Hospital ; Ziv Hospital ; Hadasa Pini Cohen’s work Copyright 2011 @STKI 336 Do not remove source or attribution from any graphic or portion of graphic

Selected Installations 2010-1Q11 Partial List ofselected wins –VTLsource-target DEDUPBackupEMC – Datadomain – Orbotech, Pelephone, Discount,Harel, Asuta, Clal, Migda, Yad Vashem, ITEAM, MODEMC – Avamar –Visa Cal, Clal, Bezeq, Intel, NDS, Coca-Cola, Co-Op, ComverseIBM – Protectier - IEC, Mataf (updrage), AmdocsEMC – Mirs, Partner (major upgrade)Symantec (NB) – Nice, Isracard, Hani (Israel ports),Israel Foreign Affairs (Puredisk), 888, Liveperson,Diplomat, Exlibris , Bezeq ing. Pini Cohen’s work Copyright 2011 @STKI 337 Do not remove source or attribution from any graphic or portion of graphic

Storage Selected Vendors TEAM / M alam/ Bezeq omnitech/ Glass Int. netcom WE House CCC M atrix Bynet EM ET ONE1 Taldor SGI Kavey ZahavEM C x x x x xIBM x x x x x xHP x x xNETAPP x x x x x x x HDS x x x DDN x Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Selected Vendors and SI’s in Israel – Enterprise B/R Glass T eamVendor EMET House Malam CCC Matrix Yael ANKOR One1 (we) T errasky SimplimentiaHP DP x xEMC Legato x X x xSymantec (NB) x x x x x xBM TSM X x Pini Cohen’s work Copyright 2011 @STKI Do not remove source or attribution from any graphic or portion of graphic

Summit 2011 infra_pini_v6

by Pini Cohen on Mar 30, 2011

Accessibility

Tags

Upload Details

Usage Rights

1 Embed 61

Statistics

Summit 2011 infra_pini_v6 — Presentation Transcript