The document outlines a reference architecture for integrating SAP and Hortonworks technologies to optimize big data processing and analytics. It emphasizes real-time analytics, data ingestion, and storage solutions for processing large-scale datasets and provides tools for data management and analysis. Key components include the Hortonworks Data Platform, SAP HANA, and various analytical services for efficient data exploration and reporting.

1. Page 1 © Hortonworks Inc. 2011 – 2014. All Rights
Reserved
SAP and Hortonworks Reference
Architecture
June 2014
Hortonworks. We Do Hadoop.

2. Page 2 © Hortonworks Inc. 2011 – 2014. All Rights
Reserved
A Modern Data Architecture With SAP
OPERATIONS
TOOLS
Provision,
Manage &
Monitor
DEV & DATA
TOOLS
Build & Test
DATASYSTEMSAPPLICATIO
NS
Repositories
ROOMS
Statistical
Analysis
BI / Reporting,
Ad Hoc Analysis
Interactive Web
& Mobile Applications
Enterprise
Applications
EDW MPP
RDBM
S
EDW
MPP
Governance
&Integration
Security
Operations
Data Access
Data Management
SOURCES
OLTP, ERP,
CRM Systems
Documents
& Emails
Web Logs,
Click Streams
Social
Networks
Machine
Generated
Sensor
Data
Geo-location
Data
HANA

3. Big Data Reference Architecture
HADOOP DATA LAKE
SAP HANA
APPLICATONS
Low Cost Scale-
Out Storage
Data Processing
Transformation,
Rationalization
Deep Analytics
&
Exploration
Stream
Processing
Accelerated
Analytics
Application
Services
Analytic Predictive Web Mobile
DataIngestion&Provisioning
Sensor
Logs
Text
Structured
Social
Weather
Geo
Other
SOURCES

4. © 2013 SAP AG. All rights reserved. 4Customer
SAP/Hortonworks Real-Time Big Data Architecture
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
Transfer
Datasets
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Transactional, Analytical, Online
Applications
Customer Mobile
Applications
SAP Mobile Platform
SAP Business Objects BI Suite
Exploration, Reporting, Dashboarding,
Predictive, Mobile
SAPBusinessObjects
DataService
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds
Real-Time Data Ingestion Real-Time Recommendation Applications
Real-Time Response Inline Predictive Analytics for Transactional Applications
Close-Looped Analytics Smart Mobile Applications
Real-time
Real-TimeDataAcquisition
StreamingDataEvents,ReplicateData
TablesfromTransactionalApplications
Sybase
Event
Stream
Processor
Sybase
Replication
Server
SAPSLT
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models

5. © 2013 SAP AG. All rights reserved. 5Customer
Parallel load of
valuable data
Load,
then
transform
at
scale:
MapReduce,
Pig,
Java
SAP/Hortonworks ETL Rationalization (loading data faster)
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Dataorchestration
Services
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds
2
3
Falcon
1
► Low Latency ingestion of data from operational systems
► Tiered Storage model offers partitioning into Hot-Warm-Cold data during ingestion.
► On-the-fly transformation for Hot Data can be performed in memory using HANA
► Off-load pre-processing of data to the Hadoop Platform
Hortonworks Data Platform
Data Reservoir
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models

6. © 2013 SAP AG. All rights reserved. 6Customer
Big Data Interactive Data Exploration
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Visualization and Reporting
► Interactive high performance Analytics and Visualization
► Agile modeling and shorter turn-around on reports & dashboards
► Exploration of Data in –memory and interactively with Hadoop.
► Uniform Data Science Experience on in-memory and multi-terabyte data sets
Hcatalog
Late binding schemas
1
SAS, ML,
custom
Science
through
scalable stats
and analysis
Hive
Interactive SQL
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
SAPBusinessObjects
DataService
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds

7. © 2013 SAP AG. All rights reserved. 7Customer
SAP/Hortonworks Real-Time Stream Processing
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Online apps Mobile apps Visualization and Reporting
Real-time
Real-TimeDataAcquisition
StreamingDataEvents,ReplicateDataTables
fromTransactionalApplications
Sybase
Event
Stream
Processor
Sybase
Replication
Server
SAPSLT
App events, mobile location data flows into platform for analysis
1
► Real-time ingestion from operational systems, sensors and smart devices
► Pattern detection, anomaly detection and streaming analytics on data in flight.
► Scalable storage for offline model tuning and data science.
► Instant visibility across operations and corporate functions
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
Storm
2
Dataorchestration
Services
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds

8. © 2013 SAP AG. All rights reserved. 8Customer
SAP/Hortonworks Real-Time Insights and Models
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Online apps Mobile apps Visualization and Reporting
Real-time
Real-TimeDataAcquisition
StreamingDataEvents,ReplicateData
TablesfromTransactionalApplications
Real-Time Data Ingestion Real-Time Recommendation Applications
Real-Time Response Inline Predictive Analytics for Transactional Applications
Close-Looped Analytics Smart Mobile Applications
Sybase
Event
Stream
Processor
Sybase
Replication
Server
SAPSLT
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
Dataorchestration
Services
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds

9. © 2013 SAP AG. All rights reserved. 9Customer
SAP/Hortonworks Real-Time Big Data Architecture
SAP HANA
Real-Time Analytics, Interactive Data Exploration & Application Platform
Federated
Smart Data
Access
OLAP Engine
Predictive
Engine
Spatial Engine
Application Logic
& Rendering(XS)
Online apps Mobile apps Visualization and Reporting
Real-time
Real-TimeDataAcquisition
StreamingDataEvents,ReplicateData
TablesfromTransactionalApplications
Real-Time Data Ingestion Real-Time Recommendation Applications
Real-Time Response Inline Predictive Analytics for Transactional Applications
Close-Looped Analytics Smart Mobile Applications
Sybase
Event
Stream
Processor
Sybase
Replication
Server
SAPSLT
Hortonworks Data Platform
Data Reservoir
Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
Dataorchestration
Services
Batch Data
Feeds
TransactionalSystems,Databases,
FlatFiles,BatchDataFeeds