Leveraging Streaming Data through Automation

IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Leveraging Streaming Data through Automation
John L. Myers
Managing Research Director
EMA
Neil Barton
CTO
WhereScape

View the On-Demand Webinar
The Leveraging Streaming Data through
Automation webinar is available to view at:
https://ema.wistia.com/medias/1r0r86b9ot
Slide 2 © 2018 Enterprise Management Associates, Inc.

Featured Speakers
John Myers, Managing Research Director, EMA
John has nearly 20 years of experience in areas related to business analytics and
business intelligence in professional services, sales consulting, product
management, industry analysis, and research. He helps organizations solve their
analytics problems, whether they related to operational platforms like customer
care, billing, or applied analytical applications, such as revenue assurance or
fraud management. John established thought leadership in emerging data
management paradigms such as big data (combination of multi-structured and
relational data sets) applications and NoSQL access data stores.
Neil Barton, Chief Technology Officer, WhereScape
Neil has more than 20 years of experience focused on software
architecture, data warehousing and business intelligence including
positions at Oracle Australia and Sequent Computer Systems. Neil is also
co-inventor of three US patents related to business intelligence software
solutions.

IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Logistics for Today’s Webinar
An archived version of the event recording will be
available at www.enterprisemanagement.com
• Log questions in the chat panel located on the lower
left-hand corner of your screen
• Questions will be addressed during the Q&A session
of the event
QUESTIONS
EVENT RECORDING
A PDF of the speaker slides will be distributed
to all attendees
PDF SLIDES

Join the Conversation
To submit questions or comments, use:
@ema_research @JohnLMyers44 @WhereScape
#StreamingAutomation

Agenda
• Drivers behind the growth of streaming usage scenarios
• Challenges that streaming data presents
• Value of automation techniques and technologies
• Benefits of applying automation to streaming data pipelines
• How WhereScape automation with Streaming can fast-track
streaming data use in your data landscape
• Question and Answer

Drivers Behind the Growth of Streaming
Usage Scenarios

Data-Driven Cultures and Strategies

Internet of Things and Streaming:
Increasing the Importance of Streaming Data Architectures
85%
of respondents indicated
that IoT was part of their
organizational strategy 72%
of respondents indicated
that streaming data was
part of their organizational
strategy

Business Scenarios for Streaming Data
New Business Models New Product Development Operational Productivity
Process Efficiency Supply Chain Management

Streaming Data Integration:
Use Cases
Real-Time Applications
Mobile and Online Path Analysis
Streaming Device and Sensor Data

Challenges That Streaming Data
Presents

Obstacles to Streaming
Connectivity to data sources
Inability to ingest/store data
Quality and reliability of data

Streaming Teams:
Spending Too Much Time on Configuration
11% of respondents with
important streaming
practices spent over 40%
of their time on data
prep(aration) practices

Streaming Teams:
Faster Data Prep
Nearly 40% of respondents
with important streaming
practices were able to do data
prep(aration) activities within
one day

Streaming Teams:
Reacting to Changing Requirements
of respondents with
important streaming
practices were making
changes to their advanced
analytical models weekly
(or daily)
6 of 10

Important Issues:
Metadata Capture and Data Lineage

Value of Automation Techniques and
Technologies

Centralized Architecture:
Making it Simple to Change and Maintain

Managing Change
More likely to
support weekly
changes to analytics
environment with
strong DWA
practices than
without
2.5 x

Successful Outcomes
Almost twice the project
success rating using DWA
strategies, going from
nearly “Very successful”
score to “Limited failure”
score
2x

Ongoing Support and Maintenance
Decrease in
ongoing
maintenance
activity timeframes
using DWA
35%

Benefits of Applying Automation to
Streaming Data Pipelines

Streaming + Automation:
Increase the Scale and Quality of Pipelines

Reducing the Amount of Configuration Time
25-35%%

Transformation and Data Prep
• Management and
selection of fields
• Simple look-ups

Scale Team Performance
Improved
Productivity!!!

Machine Learning Development and Processing
• Transformation
• Augmentation
• Aggregation
• Processing
• One too many models
• Action based on results

Managing Changing Requirements
Half the time or twice
the success!!!

WhereScape® Automation with Streaming

Value of Data Infrastructure
Automation
 Improve Time-to-Value
 Reduce project cost
 Reduce delivery time
 Reduce project risk
 Greater consistency and quality
 Keep pace with business needs

Project Types
Data Warehouse Data Mart Data Vault
Cloud Big Data Streaming

A New Breed of Data and Analytics
Sensor Data Social Media Machine Data

The Challenge for IT
• Do more, without more
• Learning curve and skills shortage
• Evolving technologies, changing
landscape
• Added data landscape complexity with an
established data infrastructure in place

Now, Manage Both Batch and Streaming Data
• Ease development burden using metadata to
drive development
• Ease ongoing maintenance overhead
• Enrich streaming data with existing EDW data
• Rich metadata environment providing context,
lineage and documentation

WhereScape Automation with Streaming
- Gadi Glogowski, Product Line Manager
Being able to strengthen our organization’s capabilities to leverage
real-time data will enable us to better serve our customers by
providing streaming operational measures against historical
performance data and key performance indicators, improving transit
service in real-time. WhereScape automation with Streaming will help
us to automate the management of real-time dataflows, reducing time
to market, R&D investment, our customers’ total cost of ownership
and better matching the speed of our business.
“
“

WhereScape® Automation
with Streaming
Capabilities
Discover and capture metadata for sources
Design metadata-based pipelines
Create and manage target structures
Generate pipeline from metadata
Wizards and best practices
Full lifecycle management

WhereScape Automation
with Streaming
 Open up new analytic opportunities
 Speed up pipeline development
 Hide complexity of underlying technologies
 Minimize learning curve for teams
 Integrate with batch-based data
 Ease ongoing management

• Streaming success
built on agility and
quality
• Automation expands
bandwidth and
success
• Streaming +
automation =
manageable and
reliable combination
Where to go from here?

Join the Conversation
To submit questions or comments, use:
@ema_research @JohnLMyers44 @WhereScape
#StreamingAutomation

Question and Answer: Log Questions in the Q&A panel
located on the lower left-hand corner
Learn more about Streaming and WhereScape automation with
Streaming at www.wherescape.com

Leveraging Streaming Data through Automation

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Leveraging Streaming Data through Automation

Similar to Leveraging Streaming Data through Automation (20)

More from Enterprise Management Associates

More from Enterprise Management Associates (20)

Recently uploaded

Recently uploaded (20)

Leveraging Streaming Data through Automation