The document discusses the architecture and components of modern data lakes, emphasizing the role of SnapLogic in data integration and processing. It outlines the capabilities for data acquisition, management, and visualization using various data sources, including on-premise and cloud applications. SnapLogic provides tools to organize, prepare, and analyze data efficiently in a flexible, secure, and scalable environment.

1. SnapLogic Live – Big Data in Motion

2. 2
Source: Internap
http://www.internap.com/resources/infographic-data-motion-vs-data-rest/

3. 3
The Data Lake
“Just as data integration is the
foundation of the data
warehouse, an end-to-end
data processing capability is
the core of the data lake. The
new environment needs a
new workhorse.”
- Mark Madsen, Third Nature
snaplogic.com/resources

4. z
Data
Acquisition
Data Access
z
Data
Management
Data Lake Components
Add information
and improve
data
Spark
Python
Scala
Java
R
Pig
Collect and
integrate data
from multiple
sources
HDFS
AWS S3
MS Azure Blob
On Prem Apps
and Data
• ERP
• CRM
• RDBMS
Cloud Apps
and Data
• CRM
• HCM
• Social
IoT Data
• Sensors
• Wearables
• Devices
Lakeshore
Data Mart
• MS Azure
• AWS
Redshift
BI / Analytics
• Tableau
• MS
PowerBI /
Azure
• AWS
QuickSight
Organize and
prepare data
for
visualization
HDFS
AWS S3
MS Azure Blob
Hive
Batch
Streaming
Schedule and manage:
Oozie, Ambari
Kafka, Sqoop,
Flume
Real-time
Impala, HiveSQL,
SparkSQL
Current Data Lake Architecture

5. z
Data
Acquisition
Data Access
z
Data
Management
The Modern Data Lake
Powered by SnapLogic
Sort,
Aggregate,
Join, Merge,
Transform
SnapLogic
abstracts and
operationalizes
with MapReduce
or Spark
pipelines
Collect and
integrate data
from multiple
sources
SnapLogic
pipelines with
standard mode
execution
Organize and
prepare data
for
visualization
SnapLogic
pipelines with
standard mode
execution
On Prem Apps
and Data
• ERP
• CRM
• RDBMS
Cloud Apps
and Data
• CRM
• HCM
• Social
IoT Data
• Sensors
• Wearables
• Devices
Lakeshore
Data Mart
• MS Azure
• AWS
Redshift
BI / Analytics
• Tableau
• MS
PowerBI /
Azure
• AWS
QuickSight
Schedule and manage:
SnapLogic
Batch
Streaming
Real-time
Modern Data Lake Architecture
SnapLogic Pipeline

6. 6
SnapLogic in the Modern Data Fabric
ConsumeStore&ProcessSource
z z z z
HANA
Data Warehouses &
Data Marts
Big Data and Data
Lakes
INGEST INGEST
Data Integration and
Transformation
On Prem
Applications
Relational
Databases
Cloud
Applications
NoSQL
Databases
Web
Logs
Internet of
Things
DELIVER DELIVER

7. Modern Architecture: Hybrid and Elastic
Streams: No data is
stored/cached
Secure: 100%
standards-based
Elastic: Scales out &
handles data and app
integration use cases
Metadata
Data
Databases
On Prem
Apps
Big Data
Cloud Apps
and DataCloud-Based Designer, Manager,
Dashboard
Cloudplex
Groundplex
Hadooplex
Firewall

8. Discussion
snaplogic.com
Unified Platform Self-Service UX
Modern Architecture Connected: 400+ Snaps