This document discusses data governance capabilities in IBM Streams version 4.1. It introduces integration with the IBM Information Governance Catalog for governing Streams assets and runtime activities. Key points include: Streams bundles and assets can be imported into the catalog; governance is enabled at the instance level; assets are discoverable in Streams Explorer and can be dragged into applications; and lineage and data flow can be viewed from catalog queries and reports. Future enhancements may include supporting additional Streams operators and governing additional data.

1. © 2015 IBM Corporation
Data Governance
IBM Streams Version 4.1
Mary Komor
Team Lead – Streams Studio
mkomor@ca.ibm.com

2. 2 © 2015 IBM Corporation
Important Disclaimer
THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL
PURPOSES ONLY.
WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE
INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS”, WITHOUT WARRANTY
OF ANY KIND, EXPRESS OR IMPLIED.
IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY,
WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE.
IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR
OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION.
NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF:
• CREATING ANY WARRANTY OR REPRESENTATION FROM IBM (OR ITS AFFILIATES OR ITS OR
THEIR SUPPLIERS AND/OR LICENSORS); OR
• ALTERING THE TERMS AND CONDITIONS OF THE APPLICABLE LICENSE AGREEMENT
GOVERNING THE USE OF IBM SOFTWARE.
IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice at IBM’s sole discretion. Information regarding potential
future products is intended to outline our general product direction and it should not
be relied on in making a purchasing decision. The information mentioned regarding
potential future products is not a commitment, promise, or legal obligation to deliver
any material, code or functionality. Information about potential future products may
not be incorporated into any contract. The development, release, and timing of any
future features or functionality described for our products remains at our sole
discretion.
THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE.
IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION.

3. 3 © 2015 IBM Corporation
Agenda
 What is data governance?
 Data governance and Streams
 Future enhancements

4. 4 © 2015 IBM Corporation
Data Governance
 InfoSphere Information Governance Catalog (IGC)
– Part of InfoSphere Information Server
– Supported version: Version 11.5 (tested with Version 11.3)
 Comprehensive information integration
 Understanding, managing, improving, leveraging information
 Lineage reports and analysis

5. 5 © 2015 IBM Corporation
Data Governance and Streams
 Streams V4.1 added integration with IBM Governance Catalog (IGC)
 Streams bundle and assets
 Support for application development
 Support for runtime activities

6. 6 © 2015 IBM Corporation
Streams assets
 Use IGC REST Explorer to import Streams bundle
– Bundle file: <streams_install_loc>/etc/governance/StreamsIGCAssetDefinitions.zip

7. 7 © 2015 IBM Corporation
Configuring a Streams instance
 Governance occurs at the instance level
– Streams Instance properties:
• instance.governanceEnabled
 Set to true to enable governance
 Default is false
• instance.governanceUrl
 https://<host>:<port>
– Instance wide credential to connect to the catalog
• streamtool setigcadminconfig –d <domain> -i <instance> --igc-admin-user <userid>
--igc-admin-password <password>

8. 8 © 2015 IBM Corporation
Asset discovery and application construction
 Streams Explorer
– Define connections to catalog
 Streams Graphical Editor
– List registered assets in palette
– Drag and drop
– code generation with schema where applicable
 Demo

9. 9 © 2015 IBM Corporation
Lineage and data flow
 Automatic asset and flow registration for applications running in
configured instance
 Use IGC to see details of the applications, edit to enrich information
 Run lineage reports to see data flow and assets used
 Run queries to view history of job submission/cancellation, jobs
submitted on a specific data, by a specific user, etc
 Demo

10. 10 © 2015 IBM Corporation
Future enhancements
 Initial implementation supports limited number of operators
– FileSource, FileSink, DirectoryScan
– ODBC operators
– KafkaSource, KafkaSink
– MQTTSource, MQTTSink
– JMSSource, JMSSink
– HDFS2FileSource, HDFS2FileSink
 What other operators should we support?
 What other data do you want to govern?

11. 11 © 2015 IBM Corporation
Questions?