At DAMA Day NYC, WhereScape's CTO Neil Barton spoke about the automation of data infrastructure as a necessary component to effectively enable the citizen data scientist and augmented analytics. Neil also discussed how AI/ML can be used to recommend data ingestion pipelines and models in either supervised or unsupervised paradigms.

1. Augmented Analytics and Automation in
the Age of the Data Scientist
Neil Barton, CTO, WhereScape
June 2019

2. Data Infrastructure Framework Approach
WhereScapeConventional approach involves slow and manual processes
requiring a multitude of tools, time and resources Automates these tasks to deliver data projects
faster and more efficiently with a single tool

3. Data Sources Ingestion
Data Stores (cloud & on-premise)
Methodology
WhereScape Metadata
IoT / Sensors
Social / Apps
Database
Files
…
Ecosystem
Integration
Batch
CDC
Stream
RDBMS Hadoop Object Stores NoSQL
Dimensional
Data Lake
Data Store
Data Vault
3NF
Design Develop Deploy Document Operate
Data Science
& Exploration
Data Catalog BI Reporting
Data
Virtualization
Data
Governance
Current Landscape

4. The Challenge for IT
• Do more, without more
• Learning curve and skills shortage
• Evolving technologies, changing landscape
• Added data landscape complexity with an
established data infrastructure in place

5. Infrastructure Modernization
Cloud
Batch + Streaming
DevOps / DataOps
AUTOMATION-FIRST

6. Cloud
 Ease of adoption
 Elastic compute
 Lower (zero) management
 Pay only for what you use
YOU still need to build it!!
Source: Snowflake

7. Scenario
• From SQL Server to Snowflake,
using WhereScape® automation
and Data Vault 2.0
Results
• Created first data vault design
in WhereScape within 3 days
• First production data vault
within Snowflake in 3 months,
fully documented
Case Study

8. Streaming: A New Breed of Data and Analytics
Sensor Data Social Media Machine Data

9. Real-time Predictive Analytics
Problem: Financial loss due to fraud
Approach: Real-time credit fraud
detection
Benefit: Reduce fraud-related
financial loss

10. DevOps / DataOps
Full Lifecycle Automation
• Deployment automation
• Test automation
• Continuous integration
and continuous delivery

11. Next BIG Things!
Active Metadata
AI-enabled automation
Streaming-first

12. Augmented Analytics
Source: Eckerson Group
PURPOSE-BUILT
TOOLS
Production Reports, Ad
Hoc Reports, OLAP
1990s 2000s 2010 2015 2020
BUSINESS
INTELLIGENCE
SUITES
All-In-One Packages
AUGMENTED
INTELLIGENCE
AI-enabled analytics
and analytics-enabled
AI
ANALYTIC
PLATFORMS
Open, extensible,
embeddable analytic
environments
VISUAL DISCOVERY
TOOLS
Self-service tools
1st Generation: BI
IT Generated
2nd Generation: Self-Service BI
Business Generated
3rd Generation: AI
Statistics Generated

13. Despite some dystopian
predictions, machines,
including third-generation BI
tools, will not replace humans;
they will augment them. Like
any automation technology, AI
will liberate people from manual
tasks and the drudgery of
routine, repetitive work. AI will
free people to focus on more
value-added activities, making
them much more productive
and effective at what they do.
– Wayne W. Eckerson
Eckerson Group
Need new Image

14. Data Sources Ingestion
Data Stores (cloud & on-premise)
Methodology
IoT / Sensors
Social / Apps
Database
Files
…
Ecosystem
Integration
Batch
CDC
Stream
RDBMS Hadoop Object Stores NoSQL
Dimensional
Data Lake
Data Store
Data Vault
3NF
Data Science
& Exploration
Data Catalog BI Reporting
Data
Virtualization
Data
Governance
AI-enabled Automation
WhereScape Metadata
Design Develop Deploy Document Operate
WhereScape Active Metadata
Design Develop Deploy Document Operate
Human Driven
AI-enabled

15. By 2022,
organizations
utilizing active
metadata to
dynamically
connect, optimize
and automate data
integration
processes will
reduce time to data
delivery by 30%.
– Gartner
Need new Image

16. Streaming-First
Source: https://www.eckerson.com/articles/streams-everywhere-towards-streaming-first-architectures
Processing
Persistence
Batch First
Processing
Persistence
Stream
Handling
Hybrid
Stream
Handling
PersistenceProcessing
Streaming-First

17. WhereScape.com
© Copyright 2018, WhereScape Software Ltd. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies.
About WhereScape
WhereScape helps IT organizations of all sizes leverage automation to design, develop, deploy and operate
data infrastructure faster. More than 700 customers worldwide rely on WhereScape automation to eliminate
hand-coding and other repetitive tasks to deliver data warehouses, vaults, lakes and marts in days or weeks
rather than months or years. WhereScape has global operations in the USA, UK, Singapore and New Zealand.