Midwest IMS RUG 09_2013 - IBM DB2 QMF 10 Family Overview and IMS JDBC.ppt


Published on

Published in: News & Politics, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • the data type and length of the column
  • Successive QMF releases have progressively introduced features which broaden the appeal and utility of QMF across the enterprise users base, while retaining the z/OS-focused functionality that has sustained QMF as the reporting infrastructure of choice for DB2 for z/OS customers. Going back to our slide contrasting QMF with Cognos, we saw the uptake in BA tools such as Cognos within less technical user communities and knew we had to step up our game. Our customers told us their users of QMF liked what it had to offer but they needed more … a lot more. Also, many of our most ardent supporters were asking us to up the ante so they could entice new users to take advantage of QMF’s power and efficiency … well here you are. Now we have added mobile support thus keeping pace with the ever-changing world of end user interfaces and the emerging mobile world.
  • … and we have seen a parallel evolution of the objects themselves: QMF for TSO/CICS renders queries, reports, and procedures using the productive and well-known 3270-based user interface. QMF for Windows ran the same queries, reports, and procedures presenting the resulting content within a desktop application user interface. Later versions of QMF for Windows also introduced a ‘visual report’ format, capable of augmenting text-based reports with images and lines but the output wasn’t quite as graphical as some other potential solutions. QMF V10 introduces significant enhancements, including interactive dashboards and full-featured graphical reporting. Collectively, this provides all enterprise users with access to QMF queries, reports and procedures in a modern and versatile form that is suitable for all skill levels. Fixpack 5 now offers new graphics and charting capabilities that dramatically extend the ability to produce very elegant and sophisticated output in keeping with today’s BA solutions.
  • QMF visual reports build upon the features of the traditional text-based QMF reports. In fact, visual reports can be automatically generated from classic QMF forms/reports. Visual reports include the following additional features: A rich graphical palette containing dozens of charts, visual primitives and data presentation elements. Ability to conditionally format data using property expressions to dynamically present information tailored to the privileges of the viewer. Support for reports execution interactively or in batch (scheduled) mode. Reports can be viewed in HTML, Flash or PDF. Reports offer comparable functionality to dashboards only laid out on a page-based canvas.
  • This is not a comprehensive list of benefits but it does illustrate many of the new features/functions available to you. Keep in mind the majority of the innovations are enabled via the Workstation and WebSphere components. I am repeating myself a bit as I want to heavily emphasize that this is a new QMF. For example, in Fixpack 5 we added a new query object we call an Analytics Query. It provides the ability to define an extremely complex (if need be) series of data access, analysis, transforms, and more as a single object. As most BA requests come in the form of “word problems, this new query provides a means to encapsulate the entire request/problem within a single object. It is unique, it is new, and surpasses the existing BA tools on the market today. Statistical Product and Service Solutions
  • QMF for Workstation and WebSphere support the creation of: QMF queries – draw data from a given data source (OLAP or relational). Ability to manipulate data in the query results grid, including side groups, top groups, aggregations, sorting, filtering (via parameter prompts – e.g. region=x or date > xyz). Directly export resulting data to Excel, PDF document or generate a QMF report or visual report from it. Now with new analytic queries you can create a self-contained BA solution with complex data access, analysis, and rendering all within a single object. Tabular (text only) or visual reports allow content to be formatted for end user consumption. Visual reports support unlimited queries and data sources per report, bringing together various data sets into one presentation. Reports can be executed interactively or scheduled for execution at periodic intervals. Dashboards present data in an interactive visual form, allowing users to click through information and dynamically apply constraints to the data. Dashboards can concurrently draw data from an unlimited number of relational and multi-dimensional data sources and support a wide variety of presentation options. Dashboards are deployed via the workstation or web environment and can be rendered in HTML, Flash or PDF format.
  • QMF for WebSphere provides the most effective means of disseminating QMF content across the enterprise, allowing users to access QMF queries, reports or dashboards via an ordinary web browser or mobile devices. Powers users can also use the web interfaces to create, edit or run QMF queries and create or apply reports to the resulting data. Note there are several output formats available thus the end users can specify not only where to route the output but what format to use.
  • QMF’s graphical reporting and dashboard capabilities are complemented by enhancements to the traditional ad-hoc querying features that QMF customers have heavily relied upon over the decades. QMF provides workstation and web users with three methods by which queries can be developed or edited: Diagram view allows queries to be graphically developed using a table wire diagram. Users can draw from pre-configured Entity Relationship Diagrams (ERDs) or simply drag and drop tables from the database explorer view onto the diagram. This form of query designer will be familiar to users of modern SQL development toolsets. SQL editor with built-in content assist and code completion significantly increase productivity by auto-completing or dynamically suggesting columns and functions as the SQL is typed. Prompted query builder methodically leads the user through the query design process, from the selection of tables to the joins between them, the columns of interest, aggregations, conditions and sorting. As with the diagram view, this allows users to rapidly build queries without SQL knowledge. Users can develop queries using any of the three methods above. Queries can be developed across all three editors – for example, the diagram view could be used to select tables, the prompted view to set conditions and the SQL view to further refine. Any changes made in a given view are automatically reflected in the other two. Thus the user can switch back and forth depending upon which interface they prefer or from which they need to take advantage.
  • For those with SQL skills or even those who wish to embellish a query with operations not available in the diagram or prompted modes, QMF provides a direct SQL query creation feature. For some usage, the creator wants to exactly specify the SQL statements with no interpretation or clever GUI to mask the statements. It may well be that a customer wishes to accept SQL from another tool and populate a QF query with it for comparison or migration purposes. The SQL supported will be determined by the source database.
  • Operational Analytics is emerging as a strong requirement for many customers today. With IMS 11 and beyond and QMF’s JDBC support, you can now directly access IMS and extract detailed, transaction level data with speed and confidence. IMS customers do not utilize this to submit large queries to IMS, rather they use the need for immediate and up to date data being effectively queried by QMF. Think of a customer service rep needing to access the latest incidents with all the details and view the results in a report, a chart, or a dashboard.
  • jdbc:ims://host:port/class://dfsivp37.DFSIVP37DatabaseView:dbViewLocation=C:/share/IMS Universal Drivers Metadata;fetchSize=0; jdbc:ims://host:port/DFSCP000:dpsbOnCommit=true;
  • For clients that connect to IMS DB through ODBM, such as the IMS™ Universal drivers and clients using the Distributed Relational Database Architecture (DRDA), IMS Connect authenticates the user, but does not check the authority of the user to perform any actions. To authenticate a user ID for an IMS DB client, IMS Connect can use the IMS Connect DB Security user exit routine (HWSAUTH0), a security product such as RACF, or both. IMS Connect only calls the HWSAUTH0 user exit when RACF=Y. If RACF support is included in your IMS Connect configuration, IMS Connect calls the HWSAUTH0 user exit before invoking RACF. The HWSAUTH0 user exit routine can override the input user ID with a different user ID and can provide a RACF group ID to be authenticated further by IMS Connect. The HWSAUTH0 user exit routine is a BPE type-1 user exit routine and is refreshable. RACF is enabled in IMS Connect for IMS DB and IMS TM clients by specifying RACF=Y in the IMS Connect configuration member or by issuing the IMS Connect command SETRACF ON. IMS Connect does not support Secure Sockets Layer (SSL) directly for clients that connect to IMS DB. To secure connections to IMS DB with SSL, use IBM® z/OS® Communications Server Application Transparent Transport Layer Security feature (AT-TLS). The use of AT-TLS is transparent to IMS Connect. If IMS Connect is the ODBM client, ODBM extracts the userid from the RACO passed in from IMS Connect If ODBM uses the CCTL DRA interface (ie. RRS=N was specified for ODBM startup), ODBM will pass the RACF userid/groupname to IMS in fields PAPLUSRN and PAPLGRPN. If ODBM uses the ODBA AER interface (ie. RRS=Y was specified for ODBM startup), ODBM will call RACF with RACO to clone an ACEE off the AER Thread TCB. If the ODBM client is using the CSLDMI API and is authorized, the userid will be one of USERID parm, SECTOKEN parm, or the ODBM address space userid specified on the USER= startup JCL if neither USERID nor SECTOKEN are specified. If the ODBM client is using the CSLDMI API and is not authorized, the userid will be the ODBM address space userid specified on the USER= startup JCL.
  • Midwest IMS RUG 09_2013 - IBM DB2 QMF 10 Family Overview and IMS JDBC.ppt

    1. 1. Advanced Technical Skills (ATS) North America QMF Workstation for IMS Access © 2012 IBM Corporation Ken Blackman, IBM
    2. 2. Advanced Technical Skills (ATS) North America QMF 10 introduced a new era for the QMF product family New Eclipse-based user interface Powerful new business analytics features and functions Sophisticated dashboards for the business users and executives Enterprise data access to many new data sources via JDBC IMS © 2012 IBM Corporation Access to OLAP information (Essbase, MS Analysis Services, SAP/BW) Metadata capabilities to facilitate ease of use Mobile device support … and more! IMS data type and length of the column
    3. 3. Advanced Technical Skills (ATS) North America Evolution of Target User Base QMF for TSO and High Performance Option HPO Database Administrators Technical Users QMF for Windows – Extends QMF to the desktop Allusersacrosstheenterprise © 2012 IBM Corporation Data Analysts, IT QMF for Windows/WebSphere V8 – Extends QMF to the web browser – Introduces graphical reporting All Business Users QMF for Workstation/WebSphere V10 – Intuitive visual solutions – Personalized, non-technical GUI – Enhanced security – Support for OLAP & variety of DBs Allusersacrosstheenterprise
    4. 4. Advanced Technical Skills (ATS) North America Evolution of QMF Objects © 2012 IBM Corporation QMF for Workstation/WebSphere supports: Queries, Forms, Procedures Enhanced Visual Reports Visual Dashboards Analytical queries Visual queries QMF for TSO supports: Queries, Forms, Procedures
    5. 5. Advanced Technical Skills (ATS) North America Dashboards of any shape, size, and content are supported. These is no ‘typical’ dashboard … a myriad of possibilities are available - such as this one created for an automotive customer. QMF dashboards © 2012 IBM Corporation Dashboards may contain a mixture of output and styles. Objects may be ‘wired’ together. For example, a query result from IMS may be used to drive another query from a DB2 data source.
    6. 6. Advanced Technical Skills (ATS) North America QMF Graphical Reports Generate HTML or PDF graphical reports Draw data from one or more data sources Support optional cover sheets, summary pages and report annexes © 2012 IBM Corporation Schedule at designated intervals and deploy via the workstation, web, mobile device, or email Directly embed reports within portals, custom web sites, or web applications
    7. 7. Advanced Technical Skills (ATS) North America Enhanced Analytics new query object called Analytics Query Standard statistical analysis methods (regression, etc.) Predictive capabilities Forecasting capabilities Interoperate with IBM SPSS or other © 2012 IBM Corporation Interoperate with IBM SPSS or other tools
    8. 8. Advanced Technical Skills (ATS) North America QMF for Workstation and WebSphere Ad-hoc & prepared queries – Create/edit/re-use QMF queries – Apply groupings, aggregations and conditional formats and more – One-click export to Excel, data files or DB table – One-click generation of reports from the data © 2012 IBM Corporation Tabular and graphical reports – Generate QMF tabular reports or graphical visual reports – Highly customizable page-based layouts – Draw data from any number of data sources QMF Dashboards – Customized, interactive data visualizations – Rapid authoring model
    9. 9. Advanced Technical Skills (ATS) North America QMF on the Web and enhanced mobile support QMF for WebSphere – Disseminate queries, reports and dashboards to users across the enterprise for all browsers and platforms – Create, run and share queries on the Web – Run and share reports on the Web – Deploy dashboards to business users as stand- © 2012 IBM Corporation alone solutions or embedded within web pages and web applications – Deploy to mobile devices (iPad, Android) Ability to render content in – Pure HTML & JavaScript* – Adobe Flash Player – PDF – Excel
    10. 10. Advanced Technical Skills (ATS) North America Query creation for the ‘casual’ End User Rapidly build and execute ad-hoc queries without SQL skills Develop queries with a ‘query diagram’ designer: – ER diagrams provide pre-built data schemas – Easily define columns, conditions, aggregations, sorting options, and order of columns Step-by-step development with a ‘prompted query builder’: © 2012 IBM Corporation Step-by-step development with a ‘prompted query builder’: – Leads the user through the query development process – Each aspect of the query (tables, columns etc.) is assigned a panel for easy navigation Diagram designer and prompted interfaces are available in both the workstation and web user interfaces
    11. 11. Advanced Technical Skills (ATS) North America Query creation for SQL users Enter and edit SQL via the web or workstation Full-featured, colorized SQL editor includes code assist, code completion and dynamic parameter hints, increasing development productivity Users can move between the prompted diagram and SQL views, refining a given query with all three editor modes For example, a user could: © 2012 IBM Corporation For example, a user could: – Define query tables by selecting elements from a pre-existing data diagram – Add query conditions using the expression designer within the prompted query view – Add final refinements via the SQL editor (such as nested SQL or unions)
    12. 12. Advanced Technical Skills (ATS) North America QMF Repositories Repositories provide a logical grouping of QMF objects (queries, procedures, visual reports, and visual dashboards and applications) and contain the database connection information and resource limits – Define the JDBC driver library – Configure the repository storage – Create a shared repository © 2012 IBM Corporation – Create a shared repository – Define the connection to the database – Create the repository connection
    13. 13. Advanced Technical Skills (ATS) North America QMF Security Permissions Repositories – Internal security, you must specify the user name and password that will identify the QMF administrator account – LDAP • Active Directory single sign-on is available with LDAP providers only Permissions – Full: grants the user or group permission to perform all functions (edit, view, browse and delete) on the repository object. © 2012 IBM Corporation browse and delete) on the repository object. – Edit: grants the user or group permission to make changes to, as well as view and browse, the repository object. – Browse: grants the user or group permission to see the contents of the repository object. Browse privileges on a query object allows a user to open and run the query – View: grants the user or group permission to see the repository object listed in the repository. They cannot open or run the object. – None: denies the user or group permission to see that the repository object is included in the repository.
    14. 14. Advanced Technical Skills (ATS) North America QMF Resource Limits Resource limits help you manage resource consumption on a database data source. Resource limits can be applied globally to data sources or they can be applied to individual queries that access any data source Data source and query resource limits allow you to control resource consumption on a per user, group, day of the week, or time of day basis. © 2012 IBM Corporation time of day basis.
    15. 15. Advanced Technical Skills (ATS) North America Operational Business Intelligence - IMS access with QMF Increase the value of your IMS investment – JDBC Open Data Access to IMS in a managed environment – Users graphically construct ad-hoc IMS queries – Create reports and dashboards that draw directly from IMS data – Roll out web-based graphical content that blends IMS data with relational and multi-dimensional data sources © 2012 IBM Corporation – Incorporate IMS data within federated queries – QMF’s JDBC workloads are zAAP eligible
    16. 16. Advanced Technical Skills (ATS) North America 1 6 IMS Integration with QMF IMS Open Database: •IMS allows distributed access over TCP/IP using the IMS Universal Database Driver (JDBC) •IMS Connect and Open Database Manager now work together as a DRDA server for IMS data Workstation z/OS © 2012 IBM Corporation16 Windows, Linux, and the Mac z/OS QMF IMS Universal Database Driver T C P I P T C P I P IMS Connect S C I ODBM S C I D R A CTL IMS DB DL/I PC IMS DRDA TCPIP IMS 12 Catalog MetadataIMS 11 Local file Metadata jdbc:ims://host:port/class: //dfsivp37.DFSIVP37DatabaseView: dbViewLocation=C:/share/IMS Universal Drivers Metadata;fetchSize=0; jdbc:ims://host:port/DFSCP000:dpsbOnCommit=true
    17. 17. Advanced Technical Skills (ATS) North America How to get the IMS Universal Drivers The IMS Universal Drivers are shipped with IMS. The IMS distribution libraries (DLIBs) contain the master copy of elements in IMS and can be used to restore SYSMODs in the target library or to rebuild a target environment. These data sets are maintained by SMP/E. The IMS.ADFSJHFS: ADFSJHFS contains the type-2 and type-4 Universal driver Java class libraries used for IMS DB access through the JDBC and DLI for Java interfaces. The TLIB data sets are the IMS SMP/E target libraries (SYSLIBs), and are the libraries that are used to run and use IMS. The IMS HFS data sets contain – SDFSJCIC: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/classic/cics/IBM/ © 2012 IBM Corporation – SDFSJCIC: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/classic/cics/IBM/ – SDFSJHFS: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/IBM/ – SDFSJSAM: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/ivp/IBM/ – SDFSJRAR: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/IBM/ – SDFSJCPI: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/classic/IBM/ – SDFSJTOL: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/classic/dlimodel/IBM/ – SDFSJCPS: Maps to PathPrefix/usr/lpp/ims/imsnn/imsjava/classic/classic/ivp/IBM/ – SDFSIC4J: Maps to PathPrefix/usr/lpp/ims/imsnn/ico/IBM/ The IMS Universal JDBC driver (imsudb.jar) is used to make SQL calls with the JDBC API and can be download as a binary file from HFS path: PathPrefix/usr/lpp/ims/imsnn/imsjava/IBM/ where nn is the IMS version you have installed
    18. 18. Advanced Technical Skills (ATS) North America Logon © 2012 IBM Corporation
    19. 19. Advanced Technical Skills (ATS) North America ODBM Security PSB Schedule Time ODBM RRS=Y IMS ODBASE=Y ISIS=N use AIMS ODBM RRS=Y IMS ODBASE=Y ISIS= R|A use IIMS ODBM RRS=N IMS ODBASE=Y ISIS=N no security ODBM RRS=N IMS ODBASE=N ISIS=R|A use IIMS IMS ODBM JOB USER= TCB ACEE IMS Connect ODBM Client RACF=Y Authenticated USERID RACO © 2012 IBM Corporation19 PSB 1 Userid ODBM does not perform any user authentication or authorization ACEE UseridUserID PasswordQMF
    20. 20. Advanced Technical Skills (ATS) North America IMS Universal Driver JDBC driver configuration file © 2012 IBM Corporation
    21. 21. Advanced Technical Skills (ATS) North America Data Source configuration © 2012 IBM Corporation
    22. 22. Advanced Technical Skills (ATS) North America di q.A1111111 © 2012 IBM Corporation
    23. 23. Advanced Technical Skills (ATS) North America Sort Ascending or Descending © 2012 IBM Corporation
    24. 24. Advanced Technical Skills (ATS) North America Creating side order © 2012 IBM Corporation
    25. 25. Advanced Technical Skills (ATS) North America Parts database © 2012 IBM Corporation
    26. 26. Advanced Technical Skills (ATS) North America Report © 2012 IBM Corporation
    27. 27. Advanced Technical Skills (ATS) North America Excel Spreadsheet © 2012 IBM Corporation
    28. 28. Advanced Technical Skills (ATS) North America QMF query IMS 12 Catalog Metadata © 2012 IBM Corporation
    29. 29. Advanced Technical Skills (ATS) North America QMF query IMS 12 Catalog Metadata © 2012 IBM Corporation
    30. 30. Advanced Technical Skills (ATS) North America QMF query IMS 12 Catalog Metadata © 2012 IBM Corporation
    31. 31. Advanced Technical Skills (ATS) North America QMF query IMS 11 Local Metadata © 2012 IBM Corporation
    32. 32. Advanced Technical Skills (ATS) North America QMF query IMS 11 Local Metadata © 2012 IBM Corporation
    33. 33. Advanced Technical Skills (ATS) North America QMF Enterprise Edition 10 Summary QMF is a viable, enterprise-wide business analytics suite It has a new UI, data sources, deployment options, dashboard and predictive analytics capability Administration and installation options have been greatly simplified as © 2012 IBM Corporation Administration and installation options have been greatly simplified as well as expanded to provide a wide range of possibilities QMF continues to be a feature of DB2 for z/OS, but may be installed and deployed on any server in an enterprise at no additional cost Sophisticated new functions have been added such as data federation, new metadata support, and a new analytics query style QMF supports an ever expanding number of users and user types such as mobile devices (e.g. iPad and more)