Watch full webinar here: https://bit.ly/3orxU1c
Data Virtualization has been getting a lot of attention recently – Gartner has called it an important component of any enterprise architecture and stated that by 2022, 60% of organizations will implement it.
If you are a Partner currently with a project in the Government and Public Sector we invite you to meet with a Denodo expert. Find out how you can accelerate with Data Virtualization!
Learn how you can utilize Denodo Data Virtualization in your current government projects to reduce risk, gain competitive advantage, and help your clients achieve better mission outcomes.
Key Points of Discussion:
- How to leverage Data Virtualization to differentiate and better support missions
- How Data Virtualization can reduce program risk
- Recent Use Cases and Success Models
- Analyst recommendations
Download our recent brief to learn how Federal agencies are leveraging Data Virtualization to gain unprecedented agility and constituent responsiveness.
Contact Kathleen Krasniqi if you have any questions.
7. 7
Source: “EU Sees More Data Breach Reports, Privacy Complaints”
Mathew J. Schwartz, Bank Info Security, December 19, 2018
8. 8
Gartner - Transitioning to Digital Government Primer for 2018 (Gartner ID: G00344026)
The structure of government has remained largely the same for more than
half a century, even as citizen expectations have outpaced government’s
ability to address them. The process improvements of earlier e-
government programs have yet to produce integrated, cross-organizational
service models that deliver better outcomes for citizens.
9. 9
A Modern Data Architecture
Reporting
Analytics
Data Science
Data Market Place
Data Monetization
AI/ML
iPaaS
Kafka
ETL
CDC
Sqoop
Flume
RawDataZoneStagingArea
CuratedDataZoneCoreDWHmodel
Data Warehouse
Data Lake
Data Virtualization Platform
Analytical Views
Data Science Views
λ Views
Real-Time Views
DWH Views
Hybrid Views
Cloud Views
UniversalCatalogofDataServices
CentralizedAccessControl
Enterprise Data Fabric
10. 10
Decoupling Users from IT
IT: Flexible Source Architecture
Users: Flexible
Tool Choice
IT can now
move at slower
speed without
affecting the
users
Users can now
make faster
and more
sophisticated
decisions as all
data accessible
by any tool of
choice
12. 12
Source: Gartner Data Virtualization Market Guide, Dec 2018
Through 2022, 60% of all organizations will implement
data virtualization as one key delivery style in their data
integration architecture”
15. 15
DoD – Data Center Consolidation and Migration
• The ‘Agency’, part of the Department of Defense, develops and maintains state-of-
the-art supportability analysis and Life Cycle Logistics decision support software
tools to assist acquisition Program and Product Support Managers.
• Responsibility and management of the Agency’s computing infrastructure was being
transferred to another department to consolidate this capability in a single group.
16. 16
Business Problem
Need to reduce Oracle footprint and need to converge to a single Data Center
A. Reduce Oracle Footprint (DW Modernization, Data Lake Implementation)
▪ Agency wanted to reduce their Oracle footprint & spend by migrating some of their data to
Hadoop
▪ Wanted to take advantage of the benefits of Hadoop (Hortonworks)
▪ Concerned about having to re-write all of their 1000+ reports (PL-SQL)
B. Migrate and Merge Data Centers (Convergence)
▪ Needed to migrate off of an IBM-hosted Data Center
▪ Also needed to merge Data Centers, as control of the Data Center infrastructure was being
consolidated under another department.
17. 17
Findings & Gap Analysis
• “Repointing” a tool from Oracle to Hadoop is complex and significant
▪ Legacy PL/SQL in some cases was not ANSI compliant
▪ SQL optimization required to reduce the number of table joins - performance
▪ Modify data structures to take advantage of schema-on-read (Hadoop)
• Data Warehouse must be modernized
▪ Parts Tracker applications query involved 36 table joins
▪ Crashed one of the vendor platforms
▪ Oracle heavily dependent upon indexes to perform queries – increases storage
▪ During redesign of warehouse, data structure to be designed for efficient Hadoop queries
• Some re-engineering of analytical and reporting tools will be required for compatibility and performance with
Hadoop (and other data sources)
▪ Emphasis on use of semantic layer to minimize application tool re-write required when replacing / optimizing data
sources
▪ Maximize use of self-service / BI Development tools to increase velocity of Tool modernization, vice custom code
18. 18
Solution
Solutions to challenges
A. Implement Denodo DV as a “Semantic Layer”
▪ Provides the ability to migrate data to other platforms without impacting applications
B. Implement Denodo DV as a “Single Source for Data”
▪ Users have one place to go for data
19. 19
Resultant Enterprise Architecture
BI / Reporting Capabilities
• WebLIDB/LMR
• Parts Tracker
• DODAAC Readiness Analyzer
• Customer Satisfaction
• Overage Repairable Management
• Repairable and Recoverable
• Supply Performance Statistics
• Aging Deadline Notifications
• Cost Driver
• DPST
• MMIS
• ARMT
• TPE Planner
Analytics / Visualizations
• Fleet Readiness
• Fleet Projection
• Readiness Improvement Options
• Combat Slant
• CWT and ZPARK
• SSA ASL Performance
• Class IX Parts Impacting Readiness
• Class VII and IX Asset Visibility
• FMC Percentages % by UIC or LIN
• Condition-Based Maintenance (CBM)
Modeling, Simulation and Artificial
Intelligence
• LMI DST; COA Analysis, OIB Optimization
• CBM
• ExASL: Stockage determination
• PSCC: Optimization of storage and distribution
• COMPASS: enables Level of Repair Analysis
(LORA) studies
• CASA: Life Cycle Cost (LCC)/Total Ownership
Cost (TOC) decision support
• Army Air Clearance Authority
20. 20
Database Consolidation and Modernization by Phases
PHASE 1
Convergence
3Q18 4Q18 1Q19 2Q19 3Q19 4Q19 1Q20
PHASE 2
Modernization
PHASE 3
Optimization
5 DBs
** Duplicate Data Bases utilized to provide load balancing during
elevated usage and redundancy for data base failures/errors
14 DBs
10 DBs
2Q18
20 DBs
**
21. 21
Tool Migration and Consolidation by Phases
2Q18 3Q18 4Q18 1Q19 2Q19 3Q19 4Q19 1Q20
• Logistics Modernized
Reporting
• Sustainment Base
Production
• Pipeline Retrograde Ref
PHASE 1
Convergence
PHASE 2
Modernization
Tools
modernized to
Data Analytics
Platform during
convergence
Tools modernized to
Data Analytics Platform
post convergence
Optimization of transactional tools
or tools with their own databases
to Enterprise Platform (Hadoop
and/or HANA) / removal of Oracle
dependency
(T) Transactional tools increase the
complexity of repointing to Hadoop
• ETM/IETM
• PS Magazine
• IMI
• LIW Resources
• WWW / INTRANET
• FEDLOG
Content Management
• Fedlog Addressing
System – (T)
• LCLET
• LMI DST – (T)
• LPDS
• MMIS – (T)
• National Equipment
List – (T)
• NMP / IMM
• OASIS/AOAP – (T)
• SSN Reports
• SRDP – (T)
• TMDE
• TPE – (T)
• WebUIT (T)
• WON Correction
• AMC Quality
Assessment
• AR-COP / M-
COP
• ARFORGEN
Cycle Tools –
(T)
• Army Reset
COP – (T)
• Automated
Reset
Management
Tool (ARMT) –
(T)
• COSIS
• DPST – (T)
• DST ET – (T)
• EDMO
ETL/EDMO
Web Portal
• EDMO Upload
Data Module (T)
PHASE 3
Optimization
47 Tools Sunset in FY16
• AMDF Discrep
• ARFORGEN COP
• Ask the Commander Admin
• CAGE Search
• CASA (link only)
• CBT Admin
• Commanders Blog Admin
• COMPASS (link only)
• COMPASS Lite (link only)
• DIREP (DLIS ONLY)
• Field Dispo LSE Planner
• I and S Problem Report
• ILS Life Cycle Model
• IUID Plans
• JDOC Shell
• Lateral Trans Trkr
• LBE Visibility
• LCMC ResWrksheet
• Level of Repair (link only)
• LMP Serial Number Updt
• LOG911 Admin
• LOG911 Admin Mgr
• LOG911 Sum Rpt
• LDAC CBT
• LDAC CDR's Guide
• MACOM BO
• MACOM Vendor
• My LCMC Dispo Stat
• My Prod Planner
• NAVAIR
• Non Major Asset Vis
• OPMS
• powerLOG-J (link only)
• Preset Tool
• Price Chl Form
• PSCC (link only)
• Readiness Exec Sum
• Reset Dispo LCMC (MSC)
Planner
• Reset Train Mgr
• SAASMOD
• Security Maintenance
• SoS Search
• SYSPARS (link only)
• TMSS Perf Specs
• Unit Reset Worksheet
• WebFLIS Search
• WLTW Admin
28 Tools Sunset in FY17
16 of 28 Tools/Capabilities
Currently Available in the
Enterprise
•ABF Search by NIIN - (CF)
•DODAAC Other Services - (CF)
•EIC Finder - (CF)
•FLIP DODAAC - (CF)
•IAC - (CF)
•IAC Search - (CF)
•INS Cd Request - (CF)
•INS Code Search - (CF)
•INS Codes - (CF)
•LOGTAADS Search - (CF)
•NSN LIN DODIC Qry - (CF)
•Packaging Requirements - (CF)
•Project Cd Search - (CF)
•SKO Transactions - (CF)
•Tailored myNSN - (CF)
•UIC Search - (CF)
12 of 28 Tools/Capabilities
Retired (Not on a Migration
Path to the Enterprise)
•ASC Workload Planner - (CF)
•Left of RPAT Equipment List
•MyAOAP
•MySOR
•MySSA
•RPA - (CF)
•RPA Tools - (CF)
•SRT List
•Task Force Builder - (T)
•Task Force Builder Pub
•TC-AIMS II Export Viewer
•TPE Export TC AIMS II
30 Tools Sunset in FY18
•AEL Tracker
•AMC Supply Chain
•Automated Recon - (CF)
•DODAAC Search - (CF)
•ILAP - (CF)
•Batch Document Search -
(CF)
•ILAP RIC List - (CF)
•MMDF**
•Non Army Asset Vis - (CF)
•ORF/RCF
•Project Code
•RIC Search - (CF)
•RIDB Upload Air Man/Unman -
(T)(CF)
•RIDB Upload Grnd/Msl - (T)(CF)
•SB 700-20 Search - (CF)
•Sets Kits Outfits - (CF)
•360 Logistics*
•ARIL Query - (CF)
•D6S/MRA Closure - (CF)
•Equip Cntrl Rec 2408-9 -
(T)(CF)
•Ground Eq Tracker - (CF)
•Ground Eq Verifier - (T)(CF)
•MAPR Upload
•MAPR Usage Query
•MyRetrograde*
•PBUSE Mgmt Tools - (CF)
•PFSA
•PM Toolbox - (CF)
•Quick Hits
•Reset Plan Viewer (link only)
• Asset
Visibility
• Common
CBM
DW/Caesar
• Parts Tracker
• Materiel List
Builder
• Force Builder
• DODAAC
Readiness
Analyzer
22. Emerging Enterprise BI Architecture
22
BI / Reporting Capabilities
• WebLIDB/LMR
• Parts Tracker
• DODAAC Readiness Analyzer
• Customer Satisfaction
• Overage Repairable Management
• Repairable and Recoverable
• Supply Performance Statistics
• Aging Deadline Notifications
• Cost Driver
• DPST
• MMIS
• ARMT
• TPE Planner
Analytics / Visualizations
• Fleet Readiness
• Fleet Projection
• Readiness Improvement Options
• Combat Slant
• CWT and ZPARK
• SSA ASL Performance
• Class IX Parts Impacting Readiness
• Class VII and IX Asset Visibility
• FMC Percentages % by UIC or LIN
• Condition-Based Maintenance (CBM)
Modeling, Simulation and Artificial
Intelligence
• LMI DST; COA Analysis, OIB Optimization
• CBM
• ExASL: Stockage determination
• PSCC: Optimization of storage and distribution
• COMPASS: enables Level of Repair Analysis
(LORA) studies
• CASA: Life Cycle Cost (LCC)/Total Ownership
Cost (TOC) decision support
• Army Air Clearance Authority
23. 23
Benefits
Initial Deployment (2017): 4 Cores | Expansion (2018): 40 Production Cores for total of 44 Cores.
Technical Savings
▪ Reduced costs from leveraging Hadoop platform
▪ Reduced costs by consolidating Data Centers on-prem
Business Value
▪ Time-to-market: Can respond much more quickly to user requests for data; can also embrace
new platforms (Amazon) and Data Sources (Amazon Services)
▪ Significantly reduced the timeframe for migration of Data Centers
Additional Benefits
▪ Using Denodo Data Catalog to empower end-users to develop their own reports much easier and
faster (Self Service)
24. 24
ROI – Savings in Cost and Resources
0
10
20
30
40
50
60
$-
$1,000,000.00
$2,000,000.00
$3,000,000.00
$4,000,000.00
$5,000,000.00
$6,000,000.00
Bldg web services prior to Denodo Initial Denodo POC Current Denodo Rate
Annual Cost # full time staff
26. 1. Federal e-government programs are complex and
often fail to deliver the expected benefits to the
Agency
2. Data Virtualization – as a core component in a
modern data architecture – can reduce complexity
and risk
3. Data delivery to users of all types is accelerated –
up to 97% reduction in time to deliver for the
Agency
4. The result Data Fabric is more agile and adaptive
for future needs of the Agency
Key Takeaways
27. Ready to Discover? Sign Up!
Accelerator Track for Government and Public Sector
Achieve, Innovate, and Modernize with Data
Virtualization
https://pages.denodo.com/WC-Govt-NA-Accelerator.html