“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools


Published on

Review why a CMDB is essential to and is the foundation of your BSM strategy
Outline the known challenges that require planning at the outset of a CMDB initiative
Drill down into the approach and lessons learned in the initial stages of a CMDB rollout for one of the largest financial institutions in North America

1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Tivoli Application Dependency Discovery Mapping and RAD can solve many of the previously highlighted management challenges.
  • Tivoli Application Dependency Discovery Mapping discovers the applications and services that need be monitored. This application related info is then imported into RAD. Once all the application dependency models are imported into RAD, we should be able to monitor those components. We can use the Netcool/ISM integration to automatically provision these monitors for example.
  • This is a portion of the model for the sample data imported. As you can see this is a considerably large model. Imagine the time it would take to develop this model from scratch using the RAD GUI.
  • The Netcool® suite of products provide a powerful event management platform that provides massive noise reduction, de-duplication and correlation Precision™ IP takes this noise reduction to the next level by providing accurate, topology based root cause analysis Precision™ IP will dramatically improve the efficiency and effectiveness of the Operations Organization by … Enabling faster problem isolation for network connectivity failures Providing visibility of the network assets Precision™ IP is suitable for use in IP networks from small/medium enterprise to largest/complex Service Provider Enterprise infrastructures Discovery Extensible Additional Standard and Vendor MIB collection – e.g. ifAlias (RFC), locIfDescr (Cisco) Data Addition Add non-discoverable data to the topology APIs (Perl & Java) Netcool®/Impact™ Precision DSA (Data Source Adaptor) Add EMS derived data to the topology Topology “Manager-of-Managers” Single view of all topology sources Services requests for network data from third-party systems / OSS vendors
  • The AppDisco server, as explained before, discovers the applications, their dependencies on other applications and computer hosts. Precision-IP has the network connectivity information from these computer systems to the switches, routers etc.
  • Procedure Go to the $RAD_HOME/integrations/appDisco/bin directory. Execute the script xslParseAppDiscoData.sh. This script will use the XSL files present in the bin/supportFiles dir and parse the XML files (that were exported from AppDisco) present in the directory exportedFromAppDisco. It will then generate the radsh script files needed to import them into RAD. Execute the script importDataToRad.sh . This script actually uses the above radsh script files that got generated, to import them into RAD using RAD Shell.
  • “Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools

    1. 1. “ Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools Antonio Rolle Director generationE Technologies October 25, 2006
    2. 2. &quot;Lights Out&quot; Configuration of Proviso, RAD & xSMs <ul><li>Leverage the information collected by Tivoli Application Discovery Depending Mapping (TADDM), Precision for IP Networks and data contained in your Configuration Management Database (CMDB) to automate the configuration of Proviso, Real Time Active Dashboards (RAD), xSMs. During this session learn how ensure that all of your services, servers and applications are monitored based on information collected by Application Discovery and Precision IP. </li></ul>
    3. 3. Techniques for Configuration <ul><li>Manual </li></ul><ul><li>Bulk loading </li></ul><ul><ul><li>Simple to understand and architect </li></ul></ul><ul><ul><li>No operational/runtime external dependencies </li></ul></ul><ul><ul><li>Difficult to handle updates and changes </li></ul></ul><ul><li>Auto population from events </li></ul><ul><ul><li>Leverages existing investment in event enrichment: Quick to value </li></ul></ul><ul><ul><li>Difficult to construct multi-parent relationships </li></ul></ul><ul><ul><li>Limited support for updates/deltas </li></ul></ul><ul><li>Dynamic access </li></ul><ul><ul><li>Very up to date access to externally managed data </li></ul></ul><ul><ul><li>Depends on external databases being HA to serve system </li></ul></ul><ul><ul><li>Trickier to conceptualize and configure </li></ul></ul><ul><ul><li>Benefit: Updates and deltas are handled gracefully </li></ul></ul>
    4. 4. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing Other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    5. 5. generationE Background <ul><li>Founded in 1999; headquarters in Chicago </li></ul><ul><li>Fortune 500 and Service Provider Focus </li></ul><ul><li>Offices in Chicago, Dallas, & San Clemente </li></ul><ul><li>40 Professional Services Personnel and growing </li></ul><ul><li>Key Business Activities: </li></ul><ul><ul><li>Software solution sales </li></ul></ul><ul><ul><li>Consulting Services </li></ul></ul><ul><ul><li>Maintenance & Support </li></ul></ul>
    6. 6. generationE Practice Areas <ul><li>Fault Management & Service Assurance </li></ul><ul><ul><li>Security Management </li></ul></ul><ul><ul><li>Systems Management </li></ul></ul><ul><ul><li>Application Management </li></ul></ul><ul><ul><li>Network Management </li></ul></ul><ul><ul><li>Database Management </li></ul></ul><ul><li>Capacity & Performance Management </li></ul><ul><li>IT Service Management </li></ul><ul><ul><li>Service Level Management </li></ul></ul><ul><ul><li>Asset Management </li></ul></ul><ul><ul><li>Configuration Management </li></ul></ul><ul><ul><li>Change Management </li></ul></ul><ul><ul><li>Incident Management </li></ul></ul><ul><ul><li>Problem Management </li></ul></ul><ul><ul><li>Service Desk </li></ul></ul><ul><li>Job Scheduling </li></ul>Process Improvement
    7. 7. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    8. 8. ITIL Configuration Management Database <ul><li>Purpose of the Configuration Management Database </li></ul><ul><li>Hold relationships between system components, including Incidents, Problems, Known errors, Changes and Releases. </li></ul><ul><li>Holds corporate data about employees, suppliers, locations and business units. </li></ul><ul><li>Automates the management of configuration item details to reduce errors and costs. </li></ul><ul><li>Reconciles data between data sources. </li></ul><ul><li>Supports Service Level Management: linking configuration items to supported services </li></ul><ul><li>Holds inventory details on CIs: supplier, cost, purchase date, license renewal, maintenance agreements. </li></ul>“ Forrester strongly believes that the term “ a CMDB” is a complete misnomer. No vendor is capable of developing a single database that holds all the relevant information in the required format at the same time and that can scale to the needs of larger corporations.” - Thomas Mendel, Forrester Analyst
    9. 9. IBM CMDB De-Constructed Discovery/Data Integration Engine Configuration Change Process Engines Config, Change CMDB Open and published interfaces, Visualization, Federation, Reconciliation architecture Comprehensive and Extensible Model CCMDB Data Engine (Configuration Discovery) Automatically Creates and maintains the CMDB
    10. 10. Clarke’s Third Law Any sufficiently advanced technology is indistinguishable from magic. Source: Arthur C. Clarke “ ”
    11. 11. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    12. 12. Tivoli Application Discovery Dependency Mapping (TADDM) Overview <ul><li>Application Mapping with Dependencies </li></ul><ul><ul><li>The software lets IT managers see the logical and physical dependencies among applications, servers and devices, experts say. </li></ul></ul><ul><ul><li>“ If you want to manage an IT service, you need to first define what it’s made up of, how it’s configured </li></ul></ul><ul><ul><li>Glenn O’Donnell, Meta </li></ul></ul><ul><li>CMDB </li></ul><ul><ul><li>“ The CMDB is the center of the ITIL Universe” </li></ul></ul><ul><li>Compliance </li></ul><ul><li>Automated solutions dramatically reduce auditor testing. Ernst & Young estimates that manual processes need to be tested 30 times more than automated processes to ensure accuracy. </li></ul>INVENTORY ORDER ENTRY LOGISTICS
    13. 13. <ul><li>Application Maps </li></ul><ul><li>Auto Discovery </li></ul><ul><li>Configuration Management </li></ul><ul><li>Change Tracking </li></ul><ul><li>Visualize Business services & Metrics </li></ul><ul><li>Track SLA’s over time </li></ul><ul><li>Business and Customer Impact </li></ul><ul><li>Problem Resolution </li></ul>Determine Service Dependencies Using TADDM
    14. 14. Integrated Architecture RAD ObjectServer xSMs Probes ITCAM ITM TADDM Server Service Config Repository Applications and Services
    15. 15. Netcool RAD Integration: Application Dependency Discovery <ul><li>Desired Integration Points: </li></ul><ul><li>Discover Services and Dependencies </li></ul><ul><li>Import Service Info into RAD </li></ul><ul><li>Monitor relevant components </li></ul><ul><li>Goal: Automate all the above </li></ul>
    16. 16. <ul><li>Export from TADDM using its API </li></ul><ul><li>Use XSL to parse exported XML files to RAD Shell files </li></ul><ul><li>Use RAD shell to import these RAD shell files </li></ul>Application Discovery RAD Integration - How?
    17. 17. RAD Visualization
    18. 18. Netcool SSM Integration: Application Dependency Discovery <ul><li>Desired Integration Points: </li></ul><ul><li>Discover processes running on hosts </li></ul><ul><li>Generate SSM configuration files </li></ul><ul><li>Monitor relevant processes </li></ul>
    19. 19. SSM Discovered Process Monitoring <ul><li>Export Discovered Processes </li></ul><ul><li>Generation SSM Configuration Files </li></ul><ul><li>“ Tweak” The Configuration Files </li></ul><ul><li>Push Configuration Files to $SSM_HOME/config </li></ul><ul><li>Execute cfg-help.pl to load configuration file </li></ul><ul><li>Confirm in agentConfigTable or psControlTable </li></ul>
    20. 20. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    21. 21. Netcool/Precision <ul><li>Scalable Network Discovery and Centralized Data Repository </li></ul><ul><ul><ul><li>Extendable discovery for layers 1, 2 & 3 devices, interfaces and connectivity </li></ul></ul></ul><ul><ul><ul><li>Broad support; IP, HSRP, CDP, Ethernet, VLAN, MPLS IP VPNs, Layer </li></ul></ul></ul><ul><ul><ul><li>Ethernet VPNs, IP over ATM </li></ul></ul></ul><ul><ul><ul><li>Dynamic, always active and event driven to detect network change as it occurs </li></ul></ul></ul>
    22. 22. The Netcool Information Model (NCIM) Schema
    23. 23. The Netcool Information Model (NCIM) Schema
    24. 24. Tivoli Netcool Impact Presicion Data Source Adapter <ul><li>Bi-directional DSA that allows Impact to query Precision’s NCIM database. </li></ul><ul><li>Precision Listener allows Impact to receive notifications from Precision that things have changed. It can’t tell you what changed though. </li></ul>
    25. 25. Sample Precision Data Read Policy <ul><li>USE_SHARED_SCOPE; </li></ul><ul><li>function ActionNode_PrecisionSamplePolicy(OrgNodes) { </li></ul><ul><li>log(&quot;**PrecisionSamplePolicy**&quot;); </li></ul><ul><li>Type = &quot;Precision&quot;; </li></ul><ul><li>Filter = &quot;Subject = '&quot; + &quot;RIVERSOFT.3.0.MODEL.QUERY&quot; + &quot;' AND Query='&quot; + 'select * from master.entityByName;' + &quot;'&quot;; </li></ul><ul><li>Filter = Filter + &quot; AND Timeout='100000'&quot;; </li></ul><ul><li>log(&quot;Filter is &quot; + Filter); </li></ul><ul><li>out=GetByFilter(Type, Filter, CountOnly); </li></ul><ul><li>if (Num > 0) { </li></ul><ul><li>runFunction0=true; </li></ul><ul><li>} </li></ul><ul><li>// Num > 0 </li></ul><ul><li>if ( runFunction0 = true ) { </li></ul><ul><li>// display all the rows </li></ul><ul><li>ActionNode_DisplayQueryResults(OrgNodes); </li></ul><ul><li>i=0; </li></ul><ul><li>while(i<Num) </li></ul><ul><li>{ </li></ul><ul><li> Log(&quot;out[&quot;+i+&quot;]= &quot;+out[i].EntityName); </li></ul><ul><li>i=i+1; </li></ul><ul><li>} </li></ul><ul><li>log(&quot;Num is &quot; + Num); </li></ul><ul><li>} </li></ul><ul><li>} </li></ul><ul><li>function ActionNode_DisplayQueryResults(OrgNodes) { </li></ul><ul><li>log(&quot;**DisplayQueryResults***&quot;); </li></ul><ul><li>log(&quot;ErrorString is &quot; + OrgNode.ErrorString); </li></ul><ul><li>log(&quot;FieldNames is &quot; + OrgNode.FieldNames); </li></ul><ul><li>log(&quot;EntityName is &quot; + OrgNode.EntityName); </li></ul><ul><li>} </li></ul><ul><li>ActionNode_PrecisionSamplePolicy(OrgNodes); </li></ul>
    26. 26. Netcool RAD Integration: Precision for IP Networks <ul><li>Desired Integration Points: </li></ul><ul><li>Update RAD Server & Application Model with network connectivity information </li></ul><ul><li>Monitor relevant components </li></ul>
    27. 27. <ul><li>Export server list from TADDM using its API </li></ul><ul><li>Extract related switch or router information from Precision IP </li></ul><ul><li>Import switch and router information into RAD </li></ul>Precision IP RAD Integration - How?
    28. 28. Integration example - ASM View automatically partitioned by application Application details for a specific device (from ASM)
    29. 29. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    30. 30. <ul><li>SQL Data Sources </li></ul><ul><ul><li>Oracle </li></ul></ul><ul><ul><li>DB2 </li></ul></ul><ul><ul><li>Netcool/OMNIbus </li></ul></ul><ul><ul><li>Sybase </li></ul></ul><ul><ul><li>MS SQL </li></ul></ul><ul><ul><li>PostgreSQL </li></ul></ul><ul><ul><li>MySQL </li></ul></ul><ul><ul><li>Informix </li></ul></ul><ul><ul><li>ODBC </li></ul></ul><ul><li>Socket DSA </li></ul><ul><li>Standard Technologies </li></ul><ul><ul><li>JMS </li></ul></ul><ul><ul><li>Web Services </li></ul></ul><ul><ul><li>XML (RO) </li></ul></ul><ul><ul><li>POP3/SMTP </li></ul></ul><ul><ul><li>Instant Messaging </li></ul></ul><ul><ul><li>LDAP </li></ul></ul><ul><ul><li>SNMP </li></ul></ul><ul><ul><li>Flat File (RO) </li></ul></ul><ul><li>Applications </li></ul><ul><ul><li>Netcool/Precision </li></ul></ul><ul><ul><li>Smallworld (RO) </li></ul></ul><ul><ul><li>Alcatel 5620 (RO) </li></ul></ul><ul><ul><li>Cramer Dimension </li></ul></ul><ul><ul><li>TIBCO </li></ul></ul>Netcool/Impact Data Source Adapters
    31. 31. Other CMDB Data Sources <ul><li>Microsoft Enterprise Project Manager </li></ul><ul><li>HP OpenView Service Desk </li></ul><ul><li>Mercury Application Mapping </li></ul><ul><li>Troux Technologies 4 Platform CMDB(SQL) </li></ul><ul><li>BMC Remedy CMDB (WebServices) </li></ul><ul><li>Voyence Control (WebServices) </li></ul><ul><li>CA Unicenter (WebServices) </li></ul><ul><li>Altiris (MS SQL Server DSA) </li></ul><ul><li>Home Grown (*) </li></ul><ul><li>… </li></ul>
    32. 32. Typical Uses of Netcool/Impact <ul><li>Customers use Impact to process high-volume event streams and: </li></ul><ul><ul><li>Gather additional information about an event (“ enrichment ”) </li></ul></ul><ul><ul><li>Decide which events should be filtered out (“ suppression ”) </li></ul></ul><ul><ul><li>Set markers in diverse data sources (“ correlation ”) </li></ul></ul><ul><ul><li>Take action on devices (“ auto-correction ”) </li></ul></ul><ul><ul><li>Alert staff about a high-priority condition (“ notification ”) </li></ul></ul><ul><ul><li>And escalate, if none of the above actions produced the desired results (“ escalation ”) </li></ul></ul>
    33. 33. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    34. 34. Case Study <ul><li>Scenario </li></ul><ul><ul><li>Customer has deployed RAD to manage service levels, manage IT priorities to service requirements </li></ul></ul><ul><li>Challenges </li></ul><ul><ul><li>Manually create comprehensive application maps, with deep configurations and interdependencies </li></ul></ul><ul><ul><li>Manually create and maintain business application groupings </li></ul></ul><ul><ul><li>Cannot identify what has changed in an application to resolve application performance and availability issues </li></ul></ul>
    35. 35. Questions <ul><li>Antonio Rolle [email_address] http://www.generationetech.com </li></ul>
    36. 36. Agenda <ul><li>generationE Technologies Overview </li></ul><ul><li>ITIL CMDB Concepts </li></ul><ul><li>Utilizing TADDM Autodiscovery Data </li></ul><ul><li>Utilizing Precision Autodiscovery Data </li></ul><ul><li>Utilizing other CMDB Data </li></ul><ul><li>Case Study </li></ul>
    37. 37. Service Management Logical Architecture The Business Perspective IT Infrastructure Management Realtime Event Management Historical Performance Management Distributed-data Management Service-dependency Management virtual CMDB Event Engine Discovery Monitoring Visualization Da t a Ac c e s s Ev en t Ac c e s s 3 rd Party Applications, Databases, middleware & OSS 3 rd Party Event & Element Management Tools
    38. 38. Methodology Meets Technology Discover Business Dependencies Discover the Network Infrastructure Discover the Application Infrastructure Discover Business Applications
    39. 39. RAD and TADDM Integration Installation <ul><li>Acquire the installation file for RAD/TADDM </li></ul><ul><ul><li>AppDiscoIntegration4June2006Rad30.tar.gz </li></ul></ul><ul><li>Unzip and untar the file </li></ul><ul><li>Make sure you are logged in as the RAD administrative user (netcool) and that $NCHOME is set appropriately </li></ul><ul><li>Run the untarred install script: </li></ul><ul><ul><li>install.sh </li></ul></ul><ul><li>The installer script will copy all needed files to </li></ul><ul><ul><li>$NCHOME/guifoundation/webapps/sla/integrations/appDisco </li></ul></ul>
    40. 40. RAD/TADDM Integration <ul><li>The steps to move data from TADDM to RAD vary depending on whether the two application reside on the same server. </li></ul><ul><li>There are some steps required to set up TADDM to be able to export services properly. This generally consists of importing custom templates for the purpose of RAD. </li></ul><ul><li>If they do both reside on the same server, then there is one script which will do everything: </li></ul><ul><li>importAppDiscoToRad.sh ad_uid ad_password raduid radpasswd </li></ul><ul><li>If the application reside on different servers the process is essentially the same but we must add the external server name for TADDM to the above command </li></ul><ul><li>We can also use partial commands which will allow us to only use a portion of the import/export functionality </li></ul>
    41. 41. Importing pre-created TADDM data to RAD <ul><li>We will start with data that has already been exported from TADDM in xml format. This data should be in the directory: </li></ul><ul><ul><li>$NCHOME/guifoundation/webapps/sla/integrations/appDisco/exportedFromAppDisco </li></ul></ul><ul><li>Make sure the $ RAD_HOME variable is set: </li></ul><ul><ul><li>export RAD_HOME=$NCHOME/guifoundation/webapps/sla </li></ul></ul><ul><li>Execute the following script: </li></ul><ul><ul><li>xslParseAppDiscoData.sh </li></ul></ul><ul><li>Execute the following script: </li></ul><ul><ul><li>importDataToRad.sh </li></ul></ul>