NIEM, CAM and Open-XDX tools

729 views

Published on

Looks at developing NIEM IEPDs using open source tools and techniques.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
729
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

NIEM, CAM and Open-XDX tools

  1. 1. Deploy Requirements NIEM Model Test<Insert Picture Here> Data NIEM, CAM, and Open-XDX Build Generate Exchange Dictionary Exchange DevelopmentDavid Webber, NIEM Team, Oracle Public Sector
  2. 2. Disclaimer NoticeThe following is not intended to outline Oracle general productdirection. It is intended for information purposes only, and maynot be incorporated into any contract. It is not a commitment todeliver any material, code, or functionality, and should not berelied upon in making purchasing decisions.The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the solediscretion of Oracle. Copyright ©2011, Oracle. All rights reserved. Slide 2 Oracle Draft Materials – Limited Circulation
  3. 3. AgendaW hy NIEM? Quick Overview • National Information Exchange Model (NIEM) • Who, What, Why, How? • Technology thoughtsN IEM information exchange anatomy • Exchange structures and schema • NIEM domain schema • NIEM IEPD • NIEM enterprise dictionaries (aka EIEM)M aking It Real – CAM tools and Open-XDX for NIEM • Rapid XML exchange development • Not just transactions – web services • Open-XDX – the future for Open Data APIsS ummary • Project Overview • Resources Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation Slide 3
  4. 4. W NIEM Turned 7 years old in April – Where have we COME with NIEM• NIEM Chartered on April 19, 2005• First Major Version: 1.0, published in 2006• Next Major Version: 2.0, published in 2007• Current Minor Version: 2.1 minor release, published in 2009• 2012 - NIEM 3.0 work in progress + NIEM UML profile 4 Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  5. 5. W FEDERAL AGENCY COMMITMENTSAGENCY USE OF NIEMDepartment of Agriculture Committed to UseDepartment of Defense Committed to UseDepartment of Education Committed to UseDepartment of Energy Committed to UseDepartment of Health and Human Services Committed to UseDepartment of Homeland Security Committed to UseDepartment of Housing and Urban Development Committed to UseDepartment of Justice Committed to UseDepartment of Labor Committed to UseDepartment of State Committed to UseDepartment of the Interior Committed to UseDepartment of the Treasury Committed to UseDepartment of Transportation Committed to UseDepartment of Veterans Affairs Committed to UseEnvironmental Protection Agency Further Evaluation RequiredGeneral Services Administration Committed to UseNational Aeronautics and Space Administration Further Evaluation RequiredNational Archives and Records Administration Committed to UseNational Science Foundation Committed to UseNuclear Regulatory Commission Will Not UseOffice of the Director of National Intelligence Committed to UseSocial Security Administration Further Evaluation RequiredGeospatial Line of Business Will Not UseGrants Management Line of Business Further Evaluation RequiredFinancial Management Line of Business Committed to UseHuman Resources Line of Business Committed to Use 5 Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  6. 6. W NIEM’s Newest Domains NEWEST DOMAINS NIEM Government Resource Management Domain NIEM Health Domain NIEM Human Services Domain DOMAINS IN PLANNING NIEM Agriculture NIEM Education NIEM Transportation Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  7. 7. W National Information Exchange Model (NIEM)  Created a centralized organization to promote 1 Centralize - Joint DOJ / standardization of information exchange for cross DHS / HHS program jurisdictional information sharing.  NIEM’s governing structure is comprised of Federal, State, Local, Tribal and private organizations. NIEM is managed at an executive level by the Department of Homeland Security (DHS), Department of Justice (DOJ), and Department of Health and Human Services (HHS) Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  8. 8. W NIEM is still improving… • Collections of complex XML Schema • Verbose components • Embedded context in names • Currently facing significant scaling challenges • Inconsistencies; too much manual management; slow lifecycles • Dictionary technology incubating • Enhanced code lists mechanism incubating • UML profile is evolving initiative with OMG • Attempt to marry modelling techniques and XSD Schema syntax • Policy and Security mechanisms incubating • Need to embrace enabling tools for rapid expansion of domains and community collaboration Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  9. 9. W National Information Exchange Model (NIEM) Tools for enabling 3 interoperability Provides the tools for enabling interoperability at the data layer within and across systems supporting information sharing, while preserving investments in current technology and optimizing new technology development. COMPLEXITY multiple disconnected components + closed coded Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  10. 10. N • Exchange structures and schema • NIEM domain schema • NIEM IEPD • NIEM enterprise dictionaries (aka EIEM) INFORMATION EXCHANGE ANATOMY Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  11. 11. N National Information Exchange Model (NIEM) 2 Repeatable, Reusable Methodology (Exchange Specification Lifecycle) • Design • Develop • Deploy • Document • Dictionaries • Discovery • Differentiate • DiagnoseIEPD - Information Exchange Package Documentation Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  12. 12. N NIEM IEPD / Exchange Delivery Lifecycle Dictionaries Requirements Discovery Updates Drag and Drop Visual Design Designer Diagnose Develop Exchange XML Samples Templates 1Production Results Differentiate XSD Schema 2 Deploy Document NIEM IEPD 3 Reports Validated Templates / XMI / UML Models 4 Required Schema IEPD artifacts Documentation 5 Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  13. 13. M • Rapid XML exchange development • Not just transactions – web services • Open-XDX – the future for Open Data APIs • Real reuse – Collaborative Component Dictionaries MAKING IT REAL Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  14. 14. M CAM Toolkit • Minimal learning curve for practitioners • Provide technology neutral methods, tools and techniques • Leverage visual metaphors – WYSIWYG • Business Rule Validation • Conformance Test Suites • SQL data mapping / XML generation (code-free methods) SIMPLICITY integrated components + visual metaphors + open source • Creates technical artifacts needed for a NIEM IEPD • Deliver the NIEM domain and core component sets in format that can be quickly adapted and reused Copyright ©2011, Oracle. All rights reserved. Slide 14 Oracle Draft Materials – Limited Circulation
  15. 15. M IEPD Delivery Tasks / Tools Matrix Open-XDX CAM CAMV (OPX) Exchange Schema Development X Canonical Model Development / Generation X Exchange Schema Generation X NIEM Compliance Checking / Reporting X WSDL / JAXB Binding Generation X Operation Message Test Case Generation X Production Services Message Generation X SQL Schema Mapping X X NIEM IEPD Artifact Generation X - Cross-reference spreadsheet X - UML model X - Business Rules Report X - XSD schema package X Conformance Test Suite X Run time XML instance validation X In order to be NIEM-conformant, the IEPD must adhere to: 1. NIEM Conformance Document 2. NIEM Naming and Design Rules (NDR) v1.3 3. NIEM Model Package Description (MPD) Specification v1.0 15 Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  16. 16. M CAM Runtime Validation Framework - Data Exchanges Structure SQL Query Rules Database Template Lookup (compiled) Code Lists (optional) Results XML Information Exchange XML Java Handler instance CAMV Errors and Warnings Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  17. 17. M CAM Open-XDX Deployment - Data Exchanges SQL Mapping Structure SQL Query Rules Template Database Code Lists (compiled) Lookup Diagnostics and Metrics Open- XMLSystem SQL XDX Instance http://www.youtube.com/watch?v=oVXtJIZVvRA Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  18. 18. M Integration Deployment View Open XDX / CAMV architecture Design Test Deploy Data Delivery CAM Editor SQL DB Open XDX CAMV XML Open XDX SQL XML FMW CAMV Web • Device• Visual Editor • Generate Data • Browser• SQL Browser • Validate Data • Open XDX • Server• Dictionaries • Send Data • Web Services• Drag and Drop • FMW / BPM Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  19. 19. S • Project Overview • Resources SUMMARY Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  20. 20. S CAMeditor.ORG Project Statistics SNAPSHOT OF PROJECT ACTIVITIES 50,000 CAMeditor.org page visits in one year 140 countries have downloaded tools; 27% of visitors are from U.S.; 600+ downloads weekly 1000+ video training minutes viewed monthly 6 languages now available‹#› Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  21. 21. S Links and References DOWNLOADS - http://cameditor.org NIEM MATERIALS - Oracle NIEM website http://www.oracle.com/goto/niem Oracle XMLOrb blog site http://blogs.oracle.com/xmlorb Online NIEM tutorials http://www.niemtrainingvideos.org Copyright ©2011, Oracle. All rights reserved. Slide 21 Oracle Draft Materials – Limited Circulation
  22. 22. S Formal NIEM IEPD Packaging Details IEPD Artefact DescriptionExchange FilesSubset Schema (SSGT) Subset of the full NIEM schema—a compressed directory of schemas to distinguish from other schema sets. Generated using CAM User requirements -distinguishes user-required data components from components they depend on for conformance. Generated by and up-loaded to theWantlist Schema Subset Generation Tool (SSGT). This is an open specification and the SSGT is not required to create a wantlist, though it is easier. Base document schema that defines the XML root element and is generally named after the IEPD itself. Also known as the document schema, referenceExchange Schema schema, or root schema.Constraint Schema Constraints for separate constraint validation path—a compressed directory of schemas to distinguish from other schema sets. Never UsedExtension Schema Specification for extended components—separate local name-spaces of components not contained in NIEM.Sample XML Instance Example instance(s) – may reference optional stylesheet.Stylesheet (generic) Example stylesheet for display of instance(s).Documentation The Master Document is the main document for which all of the context and details around the exchange are explained. This document includes, the WordMaster Documentation overview, as well as details surrounding the exchange, business drivers and requirements Document Exchange model in standard open format (xmi, vsd, zargo) and standard open graphic (jpg, pdf, etc.) preferably a Unified Modeling Language (UML)Exchange model XMI model. Business rules in one of the following formats: (1) plain or structured English, (2) written into master documentation, (3) Schematron or other formalBusiness Rules business rule language, or (4) generated by a development tool.Mapping to NIEM Mapping of domain components, tagged with constraints (i.e., cardinality, etc.) to NIEM components; preferably the Component Mapping Tool (CMT). Components created because they were not in NIEM—may be part of mapping spreadsheet and include structure and definitions of new components. PreferExtended Components CMT.Change log Record of cumulative changes from previous IEPD versions. The initial IEPD simple records its creation date.Catalog Manual EntryCatalog XML file A machine-readable list of artifacts in the IEPD in an open, portable and browser-displayable format (simple manual edit).Metadata XML file All metadata of owner and domain to be registered with the IEPD (simple manual edit). Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation
  23. 23. S CAM Toolkit Capabilities Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

×