To be able to use analytics effectively and thus leverage the data treasures in the company, you need a modern and scalable data platform that can react flexibly to events and was designed with a DataOps mindset from the very beginning.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Modern Data Platforms
1. What does a modern data
platform for analytics in the
company look like?
München, 2021-02-10, Arne Roßmann
2. Arne Roßmann
Education:
- Computer Science (BSc) with Focus on Business
Intelligence
- International Management (MBA)
Key Competences:
- Enterprise Architecture
- DevOps / DataOps
- Big Data / Cloud
Projects / Roles:
- Chief Architect
- DevOps Coach
- Solution Architect
- (before: Developer, Scrum Master, Project
Manager, …)
3. § What are the characteristics of an Enterprise Data & AI Platform
§ How does a Reference Architecture for an Enterprise Data & AI Platform look like?
§ Why Kafka is a perfect key component in the modern platform?
§ A real world example
§ Q & A
Agenda
6. Concept_Templates_April_2018.pptx
System of Insights Approach
6
NEXT-GEN ENTERPRISE DATA & AI PLATFORM
DATA CENTRIC MODELS
BUSINESS DATA HUB
DATA PROCESSING
DATA CURATION
STREAMING
SOURCES
BATCH
SOURCES
AI & ANALYTICS
FOUNDATION
SEARCH, AI & ANALYTICS
OLAP
PLATFORM MANAGEMENT & OPERATIONS
PLATFORM SECURITY
ACTIVE
DIRECTORY
ORCHESTRATION
KEY
VAULT
MFA SECURITY
CENTER
OMS
MONITOR
STREAM PROCESSING STREAM SERVING STORE
UNIVERSAL DATA LAKE
DATA TRANSFORMATION
DATA TRUST
AZURE DEVOPS
DATA INGESTION
LANDING
RAW DATA
INGESTION
TRANSFORMED DATA INGESTION
STREAM INGESTION
AI & ANALYTICS
EXECUTION
INTELLIGENT
APPs
SELF SERVICE &
ENTERPRISE BI
REAL-TIME
APPs
DATA
SERVICES
APP
DATA
SERVICES
CUSTOM AI
APPs
AI
&
ANALYTICS
SERVICES
Multiple sources converge to a common Data & AI platform using Microsoft Azure centric services
Goals: Consistent, repeatable methods and processes that can scale
Govern locally where it matters, manage centrally
AZURE DATA FACTORY
AZURE DATA FACTORY
AZURE DATABRICKS
AZURE DATABRICKS
AZURE DATABRICKS
EVENT HUB KAFKA
AZURE DATA LAKE
AZURE DATA LAKE
AZURE DATA LAKE
COSMOS DB
DATA LAKE SEARCH AZURE ML
AAS
ADLS
POWER BI
BOT
FRAMEWORK
COGNITIVE
SERVICES
APP SERVICE
LOGIC
APP
FUNCTION
SYNAPSE ANALYTICS
MGMT & SECURITY
AZURE INFORMATION PROTECTION AXON
SECURE@SOURCE ENTERPRISE DATA CATALOG
POLYBASE
AZURE SYNAPSE
ANALYTICS
API APP