Data Integration &
Big Data
Management
Big Data London - 2017
© 2016 Attunity
Technology Investment Areas 2016 2015 2014
BI/Analytics 1 1 1
Cloud 2 3 5
Mobile 3 5 3
Digitization/Digital Marketing 4 6 7
Infrastructure and Data Center 5 2 2
ERP 6 4 4
Security 7 7 7
Industry Specific Applications 8 10 9
CRM 9 9 10
Networking/Voice-Data Comm’s 10 8 6
Top CIO Priorities:
Sources: Gartner CIO Surveys 2013-2015
Big Data adoption
Migration & Analytics
Data Integration for Analytics and IoT
© 2016 Attunity
4© 2017 Attunity
Attunity – modern data integration
Make data available
and ready for analytics across
diverse platforms on-premise
and in
the Cloud
With the most universal, hybrid
and real-time data delivery
platform
#1 provider of CDC
Breadth and depth of
source/target support
Agile automation for data
integration flows
WHAT WE DO HOW WE DO IT WHY WE DIFFER
The modern platform for companies building
Data Lakes, Streaming Architectures and moving to the Cloud
© 2016 Attunity
5© 2017 Attunity
CLOUDSTREAMINGDATA LAKES
Shift to MODERN data ARCHITECTURES
ON PREMDATA WAREHOUSE BATCH
© 2016 Attunity
The Evolution of Data Analytics
•Operationalising Data Lake
•Real-time and streaming
•Hadoop and the cloud
A Modern Data Platform
© 2016 Attunity
•Hadoop has won the battle
•Moved out of Dev and Test
•Enterprise demands more
• Closer to production
• Business impact
Sqoop
Financial Services Use Case
•Oracle and DB2
•Classic data lake
•360 View of the Customer
•Customer Engagement
Operationalising Hadoop
© 2016 Attunity
The Evolution of Hadoop
•Operationalising Hadoop
•Real-time and streaming
•Hadoop and the cloud
The First 10 Years
© 2016 Attunity
Real-time Streaming with Kafka
•Real-time processing
•Real-time monitoring
•Real-time Hadoop
•Big and Fast Data
•Scalable to 1000’s applications
•Actionable Insight
•Streaming Data to Kafka
• Multiple data Feeds
• Multiple data Consumers
•Online Credit card transaction failure
 Under 20 seconds a real person calling you back
and helping with the transaction
Online Retail – Use Case
© 2016 Attunity
The Evolution of Hadoop
•Operationalising Hadoop
•Real-time and streaming
•Hadoop and the cloud
The First 10 Years
© 2016 Attunity
Combining Hadoop and the Cloud
TargetsSources
On Premises
Cloud Platform
HadoopRDBMS
Data Warehouse
Hadoop
RDBMS
Data Warehouse
© 2016 Attunity
Universal Data Availability
Results
4500 applications
DB2 MF SQL Oracle
•Consolidating massive data volumes
for global analytics
• Hadoop Data Lake with Kafka
•Minimising labour and cost
•Realising faster insights and
competitive advantage
Fortune 100 automotive maker
© 2016 Attunity
The Data Driven Enterprise
•Operationalising Hadoop
• Financial services – enterprise use cases
•Real-time and streaming
• Online retail – customer success
•Hadoop and the cloud
• Global Data Lake
Customer Use Case I
© 2016 Attunity
Zurich is a global insurance company founded in 1872 ,Head
Quartered in Zurich Switzerland.
Zurich business is organized into three core business segments:
General Insurance, Global Life and Farmers.
Zurich’s customers include
•Individuals.
•small businesses.
•mid-sized and large companies, including multinational
corporations.
in more than 170 countries.
Zurich Insurance – Introduction
15
INTERNALUSE ONLY
Putting the Customer First
16You can have data without information, but you cannot have
information without data
INTERNALUSE ONLY
Layers of the Data Lake
17
© 2016 Attunity
Staging
ConsumerIntegrationSource
iSeries/HP
SQL
Oracle
Sybase
MySQL
Finance Cube
CRM/ERP/Web
High Avail-CDC Windows-CDC …CDC
Analytics Platforms
Pull/Push
Service
Transformation
Data Hub Management
Job management
Reporting
Validation check
management
System
management
Archiving
Management DB
Metadata
Pull
Service
DB2/VSAM/IMS
MG-CDC
SAP
Analytical Data
Marketing Cube
Transactional Data
Mgmt Reports
(asynchronous; Event and Bulk)
…CDC
Oracle
Sybase
MySQL
Validation
Aggregation
EDW
18
Customer Use Case II
From Batch to Stream
© 2016 Attunity
AnalysePersistIngestSource
From Batch to Stream
20
External
Data
OLTP
Data
Near Real Time
© 2016 Attunity
AnalysePersistIngestSource
From Batch to Stream
21
External
Data
OLTP
Data
Near Real Time
Microsoft and Attunity form a
Strategic Partnership for Data Migrations
© 2016 Attunity
The Strategic Partnership and Collaboration Enable and Simplify:
- Cloud and Database Migrations from any Enterprise platform to Microsoft’s across Azure and
On-premises
- Ingests of a broad set of information sources, including SAP, Oracle, mainframes into
Microsoft-managed DBs, DWs and Data Lakes
- Continuous update and refresh of resulting datasets for maximum value of BI, actionable
analytics and zero-downtime migrations
Modern Enterprise Analytics Depend on Data.
Easy, Complete, Refreshed, Hybrid, Secure.
© 2016 Attunity
Unified Solution for the Microsoft Data Platform
Document DB*
SQL Database
SQL Data Warehouse
ADL & BLOB *
Event Hubs*
Migration
easy
no downtime
heterogeneous
Analytics/BI
real-time Replication
low impact
optimized performance
(*) Forthcoming on Attunity roadmap in 2017/2018
Mainframes
Azure DB for MySQL
Azure DB for PostgreSQL
© 2016 Attunity
25© 2017 Attunity
CLOUDSTREAMINGDATA LAKES
Shift to MODERN data ARCHITECTURES
ON PREMDATA WAREHOUSE BATCH

Big Data LDN 2017: Data Integration & Big Data Management

  • 1.
    Data Integration & BigData Management Big Data London - 2017
  • 2.
    © 2016 Attunity TechnologyInvestment Areas 2016 2015 2014 BI/Analytics 1 1 1 Cloud 2 3 5 Mobile 3 5 3 Digitization/Digital Marketing 4 6 7 Infrastructure and Data Center 5 2 2 ERP 6 4 4 Security 7 7 7 Industry Specific Applications 8 10 9 CRM 9 9 10 Networking/Voice-Data Comm’s 10 8 6 Top CIO Priorities: Sources: Gartner CIO Surveys 2013-2015 Big Data adoption Migration & Analytics
  • 3.
    Data Integration forAnalytics and IoT
  • 4.
    © 2016 Attunity 4©2017 Attunity Attunity – modern data integration Make data available and ready for analytics across diverse platforms on-premise and in the Cloud With the most universal, hybrid and real-time data delivery platform #1 provider of CDC Breadth and depth of source/target support Agile automation for data integration flows WHAT WE DO HOW WE DO IT WHY WE DIFFER The modern platform for companies building Data Lakes, Streaming Architectures and moving to the Cloud
  • 5.
    © 2016 Attunity 5©2017 Attunity CLOUDSTREAMINGDATA LAKES Shift to MODERN data ARCHITECTURES ON PREMDATA WAREHOUSE BATCH
  • 6.
    © 2016 Attunity TheEvolution of Data Analytics •Operationalising Data Lake •Real-time and streaming •Hadoop and the cloud A Modern Data Platform
  • 7.
    © 2016 Attunity •Hadoophas won the battle •Moved out of Dev and Test •Enterprise demands more • Closer to production • Business impact Sqoop Financial Services Use Case •Oracle and DB2 •Classic data lake •360 View of the Customer •Customer Engagement Operationalising Hadoop
  • 8.
    © 2016 Attunity TheEvolution of Hadoop •Operationalising Hadoop •Real-time and streaming •Hadoop and the cloud The First 10 Years
  • 9.
    © 2016 Attunity Real-timeStreaming with Kafka •Real-time processing •Real-time monitoring •Real-time Hadoop •Big and Fast Data •Scalable to 1000’s applications •Actionable Insight •Streaming Data to Kafka • Multiple data Feeds • Multiple data Consumers •Online Credit card transaction failure  Under 20 seconds a real person calling you back and helping with the transaction Online Retail – Use Case
  • 10.
    © 2016 Attunity TheEvolution of Hadoop •Operationalising Hadoop •Real-time and streaming •Hadoop and the cloud The First 10 Years
  • 11.
    © 2016 Attunity CombiningHadoop and the Cloud TargetsSources On Premises Cloud Platform HadoopRDBMS Data Warehouse Hadoop RDBMS Data Warehouse
  • 12.
    © 2016 Attunity UniversalData Availability Results 4500 applications DB2 MF SQL Oracle •Consolidating massive data volumes for global analytics • Hadoop Data Lake with Kafka •Minimising labour and cost •Realising faster insights and competitive advantage Fortune 100 automotive maker
  • 13.
    © 2016 Attunity TheData Driven Enterprise •Operationalising Hadoop • Financial services – enterprise use cases •Real-time and streaming • Online retail – customer success •Hadoop and the cloud • Global Data Lake
  • 14.
  • 15.
    © 2016 Attunity Zurichis a global insurance company founded in 1872 ,Head Quartered in Zurich Switzerland. Zurich business is organized into three core business segments: General Insurance, Global Life and Farmers. Zurich’s customers include •Individuals. •small businesses. •mid-sized and large companies, including multinational corporations. in more than 170 countries. Zurich Insurance – Introduction 15
  • 16.
    INTERNALUSE ONLY Putting theCustomer First 16You can have data without information, but you cannot have information without data
  • 17.
  • 18.
    © 2016 Attunity Staging ConsumerIntegrationSource iSeries/HP SQL Oracle Sybase MySQL FinanceCube CRM/ERP/Web High Avail-CDC Windows-CDC …CDC Analytics Platforms Pull/Push Service Transformation Data Hub Management Job management Reporting Validation check management System management Archiving Management DB Metadata Pull Service DB2/VSAM/IMS MG-CDC SAP Analytical Data Marketing Cube Transactional Data Mgmt Reports (asynchronous; Event and Bulk) …CDC Oracle Sybase MySQL Validation Aggregation EDW 18
  • 19.
    Customer Use CaseII From Batch to Stream
  • 20.
    © 2016 Attunity AnalysePersistIngestSource FromBatch to Stream 20 External Data OLTP Data Near Real Time
  • 21.
    © 2016 Attunity AnalysePersistIngestSource FromBatch to Stream 21 External Data OLTP Data Near Real Time
  • 22.
    Microsoft and Attunityform a Strategic Partnership for Data Migrations
  • 23.
    © 2016 Attunity TheStrategic Partnership and Collaboration Enable and Simplify: - Cloud and Database Migrations from any Enterprise platform to Microsoft’s across Azure and On-premises - Ingests of a broad set of information sources, including SAP, Oracle, mainframes into Microsoft-managed DBs, DWs and Data Lakes - Continuous update and refresh of resulting datasets for maximum value of BI, actionable analytics and zero-downtime migrations Modern Enterprise Analytics Depend on Data. Easy, Complete, Refreshed, Hybrid, Secure.
  • 24.
    © 2016 Attunity UnifiedSolution for the Microsoft Data Platform Document DB* SQL Database SQL Data Warehouse ADL & BLOB * Event Hubs* Migration easy no downtime heterogeneous Analytics/BI real-time Replication low impact optimized performance (*) Forthcoming on Attunity roadmap in 2017/2018 Mainframes Azure DB for MySQL Azure DB for PostgreSQL
  • 25.
    © 2016 Attunity 25©2017 Attunity CLOUDSTREAMINGDATA LAKES Shift to MODERN data ARCHITECTURES ON PREMDATA WAREHOUSE BATCH