Data Warehouse Modernization
through Automation
Kevin Marshbank, Principal Consultant
The Data Vault Shop
Welcome
Our Agenda
• The demands of data warehousing and
modernization needs today
• Data warehouse automation – what it is and
how it can help
• A brief demo of automation in action
Our Data Landscapes are
Increasing in Complexity
 Data volumes are exploding
 Data sources and types are rapidly evolving
 More data stores, with a need to maintain and
integrate the old, while migrating to the new
 … All feeding an Ever-Growing List of Business
Needs without the luxury of more IT resources
Modern Data Ecosystems are Demanding More from IT
The Traditional Approach to
Data Infrastructure Delivery
Hand-Coding and Manual Processes
• Lengthy, expensive and problematic
projects
• Lack of agility, standardization and best
practices
• Documentation and technical debt
• Tribal knowledge
Automation Helps IT Modernize
and Deliver Data Infrastructure
 Faster by automating patterns
 Easier by reducing the complexity of new
technologies and data platforms
 With less risk and greater consistency
through adopting best practices
 That’s easier to evolve and expand
 At less cost
WhereScape helps IT teams
fast-track projects and deliver
more through data
infrastructure automation.
GLOBAL REACH
Portland, OR
Asia
Auckland,
NZ
Europe
PROVEN
700+ customers
From small organizations to
large global enterprises.
20 years
Of automation innovations
for IT teams of all sizes.
EXPERIENCED
5x developer output
By automating the routine steps
that slow developers down.
ROI
Helping 700+ customers worldwide to automate
Automation Leverages Data Warehousing Patterns
Overcomplicated
Inefficient
The Conventional Way
With WhereScape
Simplified and Automated
 Metadata-driven
 Built-in methodologies
 Best practices, industry standards
 Documentation and lineage
 Full lifecycle management
Automation in Action
Automate the Entire Data Warehousing
Lifecycle to Speed Up the Ability to Deliver
DevelopDesign Deploy OperateDocument
WhereScape Automation
 Fast-tracks project delivery
 Limits project risk
 Lowers initiative costs
 Boosts team productivity
 Supports DevOps and agile
continuous integration and delivery
 Minimizes the complexity of hybrid
environments, new platforms and a
new era of data sources
Questions?
Dilbert on Brook’s Law
Questions?
www.wherescape.com
My contact info:
Kevin Marshbank
kevin@datavault.shop
https://www.linkedin.com/in/marshbank
@marshbank
WhereScape.com
© Copyright 2019, WhereScape Software Ltd. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies.
About WhereScape
WhereScape helps IT organizations of all sizes leverage automation to design, develop, deploy and operate
data infrastructure faster. More than 700 customers worldwide rely on WhereScape automation to eliminate
hand-coding and other repetitive tasks to deliver data warehouses, vaults, lakes and marts in days or weeks
rather than months or years. WhereScape has global operations in the USA, UK, Singapore and New Zealand.
Extra Slides
A New Breed of Data and Analytics Opportunity =
New Skillsets and a Learning Curve for IT
IoT Social Media Sensor Data
FULL LIFECYCLE AUTOMATION
REQUIREMENTS LOGICAL MODEL ELTPHYSICAL MODEL DOCUMENTATIONDEPLOYMENT OPERATIONS
Data Warehouse Lifecycle
1
2
3
THE BUSINESS NEED
BLUEPRINT
FRAMEWORK
SYSTEMS WORK
CONTINUAL
IMPROVEMENT
OWNER’S MANUAL
FINISH WORK
NOW OPEN
8
7
4
5
6

Maximize Your Data Warehouse Modernization Efforts Through Automation

  • 1.
    Data Warehouse Modernization throughAutomation Kevin Marshbank, Principal Consultant The Data Vault Shop
  • 2.
    Welcome Our Agenda • Thedemands of data warehousing and modernization needs today • Data warehouse automation – what it is and how it can help • A brief demo of automation in action
  • 3.
    Our Data Landscapesare Increasing in Complexity  Data volumes are exploding  Data sources and types are rapidly evolving  More data stores, with a need to maintain and integrate the old, while migrating to the new  … All feeding an Ever-Growing List of Business Needs without the luxury of more IT resources
  • 4.
    Modern Data Ecosystemsare Demanding More from IT
  • 5.
    The Traditional Approachto Data Infrastructure Delivery Hand-Coding and Manual Processes • Lengthy, expensive and problematic projects • Lack of agility, standardization and best practices • Documentation and technical debt • Tribal knowledge
  • 6.
    Automation Helps ITModernize and Deliver Data Infrastructure  Faster by automating patterns  Easier by reducing the complexity of new technologies and data platforms  With less risk and greater consistency through adopting best practices  That’s easier to evolve and expand  At less cost
  • 7.
    WhereScape helps ITteams fast-track projects and deliver more through data infrastructure automation. GLOBAL REACH Portland, OR Asia Auckland, NZ Europe PROVEN 700+ customers From small organizations to large global enterprises. 20 years Of automation innovations for IT teams of all sizes. EXPERIENCED 5x developer output By automating the routine steps that slow developers down. ROI
  • 8.
    Helping 700+ customersworldwide to automate
  • 9.
    Automation Leverages DataWarehousing Patterns
  • 10.
  • 11.
    With WhereScape Simplified andAutomated  Metadata-driven  Built-in methodologies  Best practices, industry standards  Documentation and lineage  Full lifecycle management
  • 14.
  • 15.
    Automate the EntireData Warehousing Lifecycle to Speed Up the Ability to Deliver DevelopDesign Deploy OperateDocument
  • 16.
    WhereScape Automation  Fast-tracksproject delivery  Limits project risk  Lowers initiative costs  Boosts team productivity  Supports DevOps and agile continuous integration and delivery  Minimizes the complexity of hybrid environments, new platforms and a new era of data sources
  • 17.
  • 18.
  • 19.
    Questions? www.wherescape.com My contact info: KevinMarshbank kevin@datavault.shop https://www.linkedin.com/in/marshbank @marshbank
  • 20.
    WhereScape.com © Copyright 2019,WhereScape Software Ltd. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies. About WhereScape WhereScape helps IT organizations of all sizes leverage automation to design, develop, deploy and operate data infrastructure faster. More than 700 customers worldwide rely on WhereScape automation to eliminate hand-coding and other repetitive tasks to deliver data warehouses, vaults, lakes and marts in days or weeks rather than months or years. WhereScape has global operations in the USA, UK, Singapore and New Zealand.
  • 21.
  • 22.
    A New Breedof Data and Analytics Opportunity = New Skillsets and a Learning Curve for IT IoT Social Media Sensor Data
  • 23.
    FULL LIFECYCLE AUTOMATION REQUIREMENTSLOGICAL MODEL ELTPHYSICAL MODEL DOCUMENTATIONDEPLOYMENT OPERATIONS Data Warehouse Lifecycle 1 2 3 THE BUSINESS NEED BLUEPRINT FRAMEWORK SYSTEMS WORK CONTINUAL IMPROVEMENT OWNER’S MANUAL FINISH WORK NOW OPEN 8 7 4 5 6

Editor's Notes

  • #2 Session Abstract: In today’s ever-changing data management environment, it’s critical for your data warehousing team to be able to quickly and efficiently understand, harness, construct and manage the dataflows and pipelines your organization requires. As your organization's data sources rapidly proliferate, so does the challenge of managing an ever-growing and changing data ecosystem. Successful data warehousing teams are meeting this challenge head on by modernizing their tools and methods, and turning to automation to design, develop, deploy and operate new and existing data warehouses, data vaults, data marts and other data infrastructure faster. Learn how automation can better arm your existing team as they work, and help you more easily manage a changing data landscape, whether it's in the cloud, on-premises or a hybrid of the two.
  • #5 As a result, the organizations best suited to make the most of this data revolution are more likely to start to need to manage data landscapes that look like this rather than the more simplistic, traditional ones of the past.
  • #8 The proven leader in data infrastructure automation to help IT deliver projects faster and deliver more  {THIS IS THE PRIMARY MESSAGE} 700+ customers worldwide – [verbal speaking point/thought – More than 700 customers around the globe that represent organizations of all sizes. More than 30 customer stories told on wherescape.com that detail project successes, including time and cost savings and process improvement]   5x developer output – [verbal speaking point/thought – By automating the generation of repetitive coding and project documentation, WhereScape gives developers the bandwidth to focus on higher value work]    Experienced - A history of expertise combined with innovation – [verbal speaking point/thought – A history of expertise combined with innovation (we want to convey the value of time in the industry without be construed as old school, dodgy, archaic, etc compared to other tech darlings). For 20 years, WhereScape has worked with companies to deliver automation software that fuels data warehouse design and development best practice – and at the same time eases the learning curve associated with leveraging new technologies. Recent examples of development innovation at work: Data Vault, Snowflake, Streaming)   A global reach – US HQ, with offices in EMEA and AP and an active partner network – [verbal speaking point – WhereScape is headquartered in Portland, Oregon. Development, sales and support staff are located throughout US, EMEA and Asia Pacific regions and further bolstered with local sales and consulting partners to best serve customers.]
  • #9 WhereScape empowers organizations worldwide to deliver business value from their decision support infrastructure - saving time, money and reducing risk.
  • #11 WhereScape solved this problem with our Automation software. Full life cycle management Accelerate time to production Cut the complexity Reduce cost, effort, and risk Native, optimized code Fully Documented
  • #12 WhereScape solved this problem with our Automation software. Full life cycle management Accelerate time to production Cut the complexity Reduce cost, effort, and risk Native, optimized code Fully Documented
  • #14 Whether on-premises or in the cloud, deliver data warehouses, data vaults, data lakes and data marts quickly with the WhereScape RED integrated development environment. Automates development and operations workflows Generates platform-native code Creates and updates documentation automatically Uses built-in best practices
  • #15 Demonstration
  • #17 Full life cycle management Accelerate time to production Cut the complexity Reduce cost, effort, and risk Native, optimized code Fully Documented
  • #23 With a new breed of Data and Analytics comes a new expectation from your end users to obtain this same speed of data and breadth of visibility – But for many teams, this may be a new area of work to understand and deliver upon. Additionally, this new breed of data is opening up organizational opportunities for machine learning, supply chain optimization, fraud detection and more that were previously unavailable to you.
  • #24 This is another way to show and discuss how WhereScape fits the data warehouse lifecycle in lieu potentially of the “ladder” slides for audiences that may not be as technical – and uses the analogy of a building’s lifecycle.