In today’s environment, it can be difficult for businesses to keep up with customer expectations. Organisations need to innovate to deliver the best products, while also modernising legacy applications and systems. Every journey to a more modern data architecture is unique and driven by specific business initiatives, but without the proper planning and execution, it can become an expensive, time-consuming project.
In this presentation, we discuss one customer’s challenges and solution for delivering resilient, real-time replication from traditional on-premise systems to the latest cloud analytics platform.
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Journey to a Modern Data Architecture
1. Journey to a Modern
Data Architecture
Steve Crabb | Senior Sales Engineer, Precisely
Data Architecture Melbourne 2023
2. “Connect opens
up the whole
database to us. If
we add any new
tables, then it’s
easy to add them
to the extraction
process and
replications.”
Quinton McKenzie
Head of Corporate Core
Sky New Zealand
CHALLENGES
• Minimize data latency replicating data
from IBM i platform and Db2
• Business analysts and data
scientists needed to request schemas
for analysis, causing delayed
data delivery/discovery
• Slow runtimes for existing bespoke ETL
IMPACT
• Real-time replication of 1000+ tables
to Snowflake
• Reduced IT involvement
• No changes to core business systems
• Fast time-to-market for new analytics
and reporting
Sky Realizes Real-
Time, Error-Free Data
Replication
3. Journey to a modern data architecture
of CEOs want their
organisation to be
more data-driven
83%
Source: IDC
Data-Driven
Design
Regulatory
Compliance
Advanced
analytics
Risk
Management
Data
Democratization
Customer
Retention
Supply Chain
Resilience
Financial
Modeling
Real-Time
Dashboards
Efficient
Cross-Sell and
Up-Sell
ESG
Reporting
Rapid
Product
Development
Targeted,
Personalised
Marketing
Machine
Learning
Corporate
Sustainability
Artificial
Intelligence
4. Journey to a modern data architecture
Data-Driven
Design
Regulatory
Compliance
Advanced
analytics
Risk
Management
Data
Democratization
Customer
Retention
Supply Chain
Resilience
Financial
Modeling
Real-Time
Dashboards
Efficient
Cross-Sell and
Up-Sell
ESG
Reporting
Rapid
Product
Development
Targeted,
Personalised
Marketing
Machine
Learning
Corporate
Sustainability
Artificial
Intelligence
Data owned by IT
Slow, batch
ETL processes
Data brought to
the solution
Separate business &
IT metadata
Massive, loosely
integrated products
Rules-based data
management
5. Journey to a modern data architecture
Data-Driven
Design
Regulatory
Compliance
Advanced
analytics
Risk
Management
Data
Democratization
Customer
Retention
Supply Chain
Resilience
Financial
Modeling
Real-Time
Dashboards
Efficient
Cross-Sell and
Up-Sell
ESG
Reporting
Rapid
Product
Development
Targeted,
Personalised
Marketing
Machine
Learning
Corporate
Sustainability
Artificial
Intelligence
Data owned by IT
Business &
IT collaboration
Slow, batch
ETL processes
Streaming
data pipelines
Data brought to
the solution
Data processing runs
where the data is
Separate business &
IT metadata
Shared catalog of technical
& business metadata
Massive, loosely
ntegrated products
Flexible, modular,
interoperable solution
Rules-based data
management
AI-driven rules, alerts,
and enrichment
6. Journey to a modern data architecture
of data
practitioners
completely trust
their data
27%
Source: IDC
Data-Driven
Design
Regulatory
Compliance
Advanced
analytics
Risk
Management
Data
Democratization
Customer
Retention
Supply Chain
Resilience
Financial
Modeling
Real-Time
Dashboards
Efficient
Cross-Sell and
Up-Sell
ESG
Reporting
Rapid
Product
Development
Targeted,
Personalised
Marketing
Machine
Learning
Corporate
Sustainability
Artificial
Intelligence
7. 47%
of newly created data
records have at least
one critical error
68%
of organisations say
disparate data negatively
impacts their organisation
84%
of CEOs say that they
are concerned about the
integrity of the data they
are making decisions on
Data Trends Survey Forbes
HBR
Trusted data is a business imperative
8. For trusted data,
you need data integrity
Data integrity is data with maximum
accuracy, consistency, and context for
confident business decision-making
Data
Integrity
9. For trusted data,
you need data integrity
Data integrity is data with maximum
accuracy, consistency, and context for
confident business decision-making LOCATION
QUALITY
GOVERNANCE
ENRICHMENT INTEGRATION
Your unique data
integrity journey
will reflect your
business
needs
Data
Integrity
10. Cloud / VPC / On-Premises
Data
Integration
Data
Observability
Data
Quality
Geo
Addressing
Spatial
Analytics
Data
Governance
Data
Enrichment
APIs and SDKs
Enterprise Business
Systems
• Enterprise apps
• Analytics tools
• Precisely industry
apps
• BI dashboards
• AI/ML
Enterprise Data
Sources
• Business Intelligence
• CRM
• Workforce mgmt.
• Data warehouse
• ERP
• Billing
Data Integrity Services
Data Integrity Foundation Data catalog Intelligence Agents
12. The leader in data integrity
Our software, data enrichment products and
strategic services deliver accuracy, consistency, and
context in your data, powering confident decisions.
of the Fortune 100
99
countries
100 2,500
employees
customers
12,000
Brands you trust, trust us
Data leaders partner with us