SlideShare a Scribd company logo
1 of 36
Raw data to analysis and visualization in the Cloud
with Amazon Web Services (AWS) and Qlik
Rahul Bhartia, AWS
John Park, Qlik
April, 2015
2#qonnections
Legal Disclaimer
©Qlik Confidential
This Presentation contains forward-looking statements, including, but not limited to, statements regarding the value and effectiveness of
Qlik's products, the introduction of product enhancements or additional products, Qlik’s partner and customer relationships, and Qlik's
growth, expansion and market leadership, that involve risks, uncertainties, assumptions and other factors which, if they do not materialize
or prove correct, could cause Qlik's results to differ materially from those expressed or implied by such forward-looking statements. All
statements, other than statements of historical fact, are statements that could be deemed forward-looking statements, including
statements containing the words "predicts," "plan," "expects," "anticipates,“ “see,” "believes," "goal," "target," "estimate," "potential," "may",
"will," "might," "could," and similar words. Qlik intends all such forward-looking statements to be covered by the safe harbor provisions for
forward-looking statements contained in Section 21E of the Exchange Act and the Private Securities Litigation Reform Act of 1995. Actual
results may differ materially from those projected in such statements due to various factors, including but not limited to: risks and
uncertainties inherent in our business; our ability to attract new customers and retain existing customers; our ability to effectively sell,
service and support our products; our ability to manage our international operations; our ability to compete effectively; ourability to
develop and introduce new products and add-ons or enhancements to existing products; our ability to continue to promote and maintain
our brand in a cost-effective manner; our ability to manage growth; our ability to attract and retain key personnel; the scope and validity of
intellectual property rights applicable to our products; adverse economic conditions in general and adverse economic conditions
specifically affecting the markets in which we operate; and other risks and uncertainties more fully described in Qlik's publicly available
filings with the Securities and Exchange Commission. Past performance is not necessarily indicative of future results. Theforward-
looking statements included in this presentation represent Qlik's views as of the date of this presentation. Qlik anticipates that subsequent
events and developments will cause its views to change. Qlik undertakes no intention or obligation to update or revise any forward-looking
statements, whether as a result of new information, future events or otherwise. These forward-looking statements should not be relied
upon as representing Qlik's views as of any date subsequent to the date of this presentation.
This Presentation should be read in conjunction with Qlik's periodic reports filed with the SEC (SEC Information), including the disclosures
therein of certain factors which may affect Qlik’s future performance. Individual statements appearing in this Presentation are intended to
be read in conjunction with and in the context of the complete SEC Information documents in which they appear, rather than asstand-
alone statements. This presentation is intended to outline our general product direction and should not be relied on in making a
purchase decision, as the development, release, and timing of any features or functionality described for our products remains
at our sole discretion.
© 2015 QlikTech International AB. All rights reserved. Qlik®, QlikView®, Qlik® Sense, QlikTech®, and the Qlik logos are trademarks of
QlikTech International AB which have been registered in multiple countries. Other marks and logos mentioned herein are trademarks or
registered trademarks of their respective owners.
3#qonnections
Rahul Bhartia
• Ecosystem Solutions Architect, AWS
• Data and analytics applications for the Cloud
• Over 10 years in architecture of data processing
systems
Presenters
John Park
• Senior Solution Architect, Partner Engineering
• ETL, Data warehousing, Software design, *NIX
systems and architecture
• 2 years Qlik, 7 years DW Consultant
• Twitter: @jpark328
4#qonnections
Agenda
• Introduction
• What can the Cloud do for us?
• Amazon Web Services (AWS)
• Qlik with AWS in the Cloud
• Demo
• Summary and key takeaways
5#qonnections
What can the cloud do for us ?
Collect
• EventsTransactions
• Files and Logs
Store
• Object Store
• Databases
• NoSQL
Capabilities of Qlik with Amazon Web Services (AWS)
Process
• Hadoop and data integration tools (ETL)
Think of the cloud as ‘The Matrix’ and you have infinite amount of cheap resources to create
your Business Intelligence environment
Analyze
• Query , Visualize and Collaborate
Amazon Web Services (AWS)
Why AWS?
Building and managing cloud since 2006
40+ services to support any cloud workload
History of rapid, customer-driven releases
11 regions, 29 availability zones, 53 edge locations
48 proactive price reductions to date
Thousands of SIs and ISVs; 2,100+ Marketplace listings
Experience
Service Breadth & Depth
Pace of Innovation
Global Footprint
Pricing Philosophy
Ecosystem
Administration
& Security
Access
Control
Identity
Management
Key Management
& Storage
Monitoring
& Logs
Resource &
Usage Auditing
Platform
Services
Analytics App Services Developer Tools & Operations Mobile Services
Data
Pipelines
Data
Warehouse
Hadoop
Real-time
Streaming Data
Application
Lifecycle
Management
Container
s
Deployment
DevOps
Event-driven
Computing
Resource
Templates
Identity
Mobile
Analytics
Push
Notifications
Sync
App
Streaming
Email
Queuing &
Notifications
Search
Transcoding
Workflow
Core
Services
CDN
Compute
(VMs, Auto-scaling, and
Load Balancing)
Databases
(Relational, NoSQL, and
Caching)
Networking
(VPC, DX, and DNS)
Storage
(Object, Block, EFS,
and Archival)
Infrastructure
Availability
Zones
Points of
PresenceRegions
Enterprise
Applications
Business
Email
Sharing &
Collaboration
Virtual
Desktop
Technical &
Business Support
Account
Management
Partner
Ecosystem
Professional
Services
Security &
Pricing Reports
Solutions
Architect
s
Support
Training &
Certification
Machine
Learning
AWS - cloud computing services
Culture of innovation
On-premises
Infrequent and long
experimentations
High risk
Lower innovation
Frequent and short
experimentations
Low risk
Higher innovation
Innovate faster by experimenting often with lower risks
“Unstructured data growth
explosive, with estimates
of compound annual
growth (CAGR) at 62%
from 2008 – 2012”
Source: IDC
GB
TB
PB
ZB
EB
Unconstrained data growth
Not only about growth…
Data
Velocity
Variety
Volume
Structured, Unstructured, Text, Binary
Gigabytes, Terabytes, Petabytes
Millisecond, Second, Minute, Hour, Day
One tool to rule them all
Use the right tools
Amazon
S3
Amazon
Kinesis
Amazon
DynamoDB
Amazon
Redshift
Amazon
Elastic
MapReduce
Data Answers
Collect Process Analyze
Store
Object storage
Highly scalable
Support for automatic encryption
Designed for 99.999999999%
durability
Amazon
S3
Amazon Aurora, MySQL, Oracle,
SQLServer, Postgres
High Availability
Push Button Scalability
Up to 3 TB and 30K IOPS
Amazon
RDS
Relational data warehouse
Massively parallel
Petabyte scale
Fully managed
Starting at $1,000/TB per year
Amazon
Redshift
Amazon
EMR
Managed Hadoop clusters
Easy to use
Fully managed
Support for Amazon EC2 Spot and
Reserved Instances
Amazon
DynamoDB
NoSQL database
Seamless scalability
Zero administration
Single digit millisecond latency
Amazon
Kinesis
Real-time data ingestion
High throughput
Elastic
Connectors for S3, Redshift and
DynamoDB
Amazon
Data
Pipeline
Data workflow orchestration
Creation and management of resources
Managed dependencies and scheduling
Notification and alerts using Amazon
SNS
Amazon
Glacier
Amazon
EMR
Amazon
EMR
Amazon
Redshift
Amazon
DynamoDB
Amazon
S3
Platform for your data
Data
Web
Application
Business
Intelligence
Amazon
Data Pipeline
Interactive
querying
Qlik with AWS in the Cloud: John Park
23#qonnections
Qlik®
with AWS - Andersen Corporation
Challenges
• With plans to transform the structure of its sales team,
Andersen Corporation needed a streamlined way to
realign, measure and track the success of its sales
team. Additionally, the team would have limited IT
bandwidth to support the project and just 90 days to
deploy.
Solution
• Andersen Corporation deployed QlikView in the cloud
with the help of Qlik Consulting to support the
restructure of its sales team. The tool is now at the
heart of all sales decisions.
Benefit
• Streamlined view of all sales data in one platform aligned
with new sales structure
• Increased efficiency with sales targeting based on
geography
• Created a self-service environment for sales team allowing
direct access to personal performance and sales pipeline.
• ROI in 90 Days
“With only three months to deploy and limited
bandwidth from our IT team, we went into this project
knowing we would need to rely heavily on the vendor.
Qlik Consulting was able to quickly understand the
idiosyncrasies of our business, digest the complexity
of the project and lay the proper foundation needed for
our team’s success”
Director of Business Analytics, Andersen
Corporation
• Andersen Corporations is the largest window
manufacturer in North America
• Employees 9,000 people
• 100+ Year company serving North America, South
America, Europe, Asia and Middle East.
24#qonnections
QlikView - Business discovery on AWS
• Cloud-based associative business discovery
for Big Data
• Massive data scalability with Amazon EC2
• Rapid Big Data app development with
Amazon Redshift
• Seamlessly combines Big Data with other
data sources
• Easy to implement no upfront cost
Amazon EMR
Hadoop
Cluster
Amazon RDS
Operational
Systems
Amazon Redshift
Data
Warehouse
25#qonnections
PresentationApplication
Windows Based
File Share
(Optional)
Third-Party Integration:
• Informatica
• Talend
DataAccess
Windows IIS
QlikView - Business Discovery Platform on AWS
Business Discovery Apps
Sales • Finance • Marketing • Operations
QlikView
Web Server
Business Users
IT Admins
QlikView
Management Console
QlikView Server
QlikView Publisher
Data Sources
Custom connectors; ODBC;
OLEDB; QVX; XML
QVW; QVD files
Data/Business
Analysts
Developers
QlikView
Developer
Security Integration:
• IAM
• AD Server Replication
Elastic IP
Instances
Amazon EC2 Amazon EC2
Amazon S3 MySQL DB
Instance
Oracle DB
Instance
MS SQL
Instance Amazon Redshift
AWS Management
Console
Lets jump into the demo
27#qonnections
Take raw data and perform ETL and reload automatically in Qlik
• Use AWS CloudFormation to create our stack*
• Raw data into Amazon S3(manually)
• Use Amazon Data Pipeline as an orchestration engine
– Amazon EMR performs analysis with data on Amazon S3
– Load detail data into Amazon Redshift
– Amazon EMR summarizes data and place it in Amazon S3
– Trigger a QlikView re-load
• Automatically see the results on QlikView Access Point.
Our demo today
28#qonnections
Now for Our Demo
Picture source: http://deathtothestockphoto.com/stories/
Architecture for Demo
Availability Zone us-east1a
Subnet 1 Subnet 2
Internet Gateway
User
Amazon VPC
Qlik
Server
Qlik
Server
Bastion
Amazon
Redshift
Amazon
S3
QlikView Server- Amazon
EC2*
Amazon
Redshift
Amazon S3
with
summarized data
Amazon S3 as
Landing Zone
AWS Data Pipeline
Raw CSV
Amazon EC2
Qlik Extraction
Amazon
EMR
31#qonnections
Security
• AWS Identity and Access Management (IAM)
• Amazon VPC – subnets, security groups and network access
control list and
• Amazon S3 bucket policies and support for encryption
Performance
• Placement groups for low-latency, 10 Gbps network
• Enhanced networking for high packet-per-second performance
Cost Savings
• Use Amazon Elastic Block Store (Amazon EBS) and stop or
terminate Amazon EC2 instances
• Elasticity with Auto Scaling
• Amazon EC2 Spot Instances and Reserved Instances
Repeatability
• Script everything you can and automate
Considerations
32#qonnections
Qlik
• All collateral from this session will be posted in
branch – http://branch.qlik.com/, GitHub, Slideshare
Qlik community - https://community.qlik.com/welcome
Slides will be posted on community and code will be posted on
branch.
AWS
• Test Drive - http://www.ipc-global.com/login-page-for-directit-test-
drive-labs/
• AWS Summits - http://aws.amazon.com/summits/
• AWS Documentations - http://aws.amazon.com/documentation/
• AWS Boot camp at Summits
Where can I learn more about Qlik and AWS
33#qonnections
Combine AWS and Qlik for maximum benefits
• Provide your customers with production grade Qlik
environment(Use Stacks)
• Go from raw data to analysis in days not months with AWS
• An affordable flexible option that also scales with your customer
needs
– No hardware or software to buy to install Qlik
– Get started quickly
– Quick ROI for customers
Summary and key takeaways
Question & Answer
35#qonnections
Feedback survey
• Please complete the track session survey via the mobile app
• Access the track session survey through the mobile app
• Enter track session code T63
• Provide your feedback
Thank You

More Related Content

What's hot

Qlikview Overview
Qlikview OverviewQlikview Overview
Qlikview Overviewlarymoseley
 
BI & Analytics in Action Using QlikView
BI & Analytics in Action Using QlikViewBI & Analytics in Action Using QlikView
BI & Analytics in Action Using QlikViewUday Kothari
 
Qlik-16x9-CorpExecutive-Presentation_Mar2016
Qlik-16x9-CorpExecutive-Presentation_Mar2016Qlik-16x9-CorpExecutive-Presentation_Mar2016
Qlik-16x9-CorpExecutive-Presentation_Mar2016Carson Walker
 
Discover the QlikView Way
Discover the QlikView Way Discover the QlikView Way
Discover the QlikView Way Helena Caligari
 
Modernizing the Finance Function with Qlik
Modernizing the Finance Function with QlikModernizing the Finance Function with Qlik
Modernizing the Finance Function with QlikPaul Van Siclen
 
Getting Started with Qlikview
Getting Started with QlikviewGetting Started with Qlikview
Getting Started with QlikviewEdureka!
 
QlikView / Qlik Sense (ver. EN)
QlikView / Qlik Sense (ver. EN)QlikView / Qlik Sense (ver. EN)
QlikView / Qlik Sense (ver. EN)BPX SA
 
Data Driven Possibilities with Qlik
Data Driven Possibilities with QlikData Driven Possibilities with Qlik
Data Driven Possibilities with QlikMischa van Werkhoven
 
What makes QlikView unique
What makes QlikView unique  What makes QlikView unique
What makes QlikView unique QlikView-India
 
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a ServiceAthens Big Data
 
Best Practices - QlikView Application Development
Best Practices - QlikView Application DevelopmentBest Practices - QlikView Application Development
Best Practices - QlikView Application DevelopmentTBSL
 
Qlik-Education-Catalog-EN
Qlik-Education-Catalog-ENQlik-Education-Catalog-EN
Qlik-Education-Catalog-ENMarco Zampieri
 
QlikView projects in Agile Environment
QlikView projects in Agile EnvironmentQlikView projects in Agile Environment
QlikView projects in Agile EnvironmentSaleha Amin, CSM, PMP
 
Credon - Qlik Sense Presentation
Credon - Qlik Sense PresentationCredon - Qlik Sense Presentation
Credon - Qlik Sense PresentationWim Wuytens
 
Blueprint Series: Banking In The Cloud – Ultra-high Reliability Architectures
Blueprint Series: Banking In The Cloud – Ultra-high Reliability ArchitecturesBlueprint Series: Banking In The Cloud – Ultra-high Reliability Architectures
Blueprint Series: Banking In The Cloud – Ultra-high Reliability ArchitecturesMatt Stubbs
 
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next Generation
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next GenerationQlik Sense for Beginners - www.techstuffy.com - QlikView Next Generation
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next GenerationPractical QlikView
 
Data and its Role in Your Digital Transformation
Data and its Role in Your Digital TransformationData and its Role in Your Digital Transformation
Data and its Role in Your Digital TransformationVMware Tanzu
 
CWIN17 san francisco-william belding-innovation through insights 2017-12-07
CWIN17 san francisco-william belding-innovation through insights 2017-12-07CWIN17 san francisco-william belding-innovation through insights 2017-12-07
CWIN17 san francisco-william belding-innovation through insights 2017-12-07Capgemini
 
The Big Picture: Real-time Data is Defining Intelligent Offers
The Big Picture: Real-time Data is Defining Intelligent OffersThe Big Picture: Real-time Data is Defining Intelligent Offers
The Big Picture: Real-time Data is Defining Intelligent OffersCloudera, Inc.
 

What's hot (20)

Qlikview Overview
Qlikview OverviewQlikview Overview
Qlikview Overview
 
BI & Analytics in Action Using QlikView
BI & Analytics in Action Using QlikViewBI & Analytics in Action Using QlikView
BI & Analytics in Action Using QlikView
 
Qlik-16x9-CorpExecutive-Presentation_Mar2016
Qlik-16x9-CorpExecutive-Presentation_Mar2016Qlik-16x9-CorpExecutive-Presentation_Mar2016
Qlik-16x9-CorpExecutive-Presentation_Mar2016
 
Discover the QlikView Way
Discover the QlikView Way Discover the QlikView Way
Discover the QlikView Way
 
Modernizing the Finance Function with Qlik
Modernizing the Finance Function with QlikModernizing the Finance Function with Qlik
Modernizing the Finance Function with Qlik
 
Getting Started with Qlikview
Getting Started with QlikviewGetting Started with Qlikview
Getting Started with Qlikview
 
QlikView / Qlik Sense (ver. EN)
QlikView / Qlik Sense (ver. EN)QlikView / Qlik Sense (ver. EN)
QlikView / Qlik Sense (ver. EN)
 
Data Driven Possibilities with Qlik
Data Driven Possibilities with QlikData Driven Possibilities with Qlik
Data Driven Possibilities with Qlik
 
What makes QlikView unique
What makes QlikView unique  What makes QlikView unique
What makes QlikView unique
 
QlikView & Salesforce
QlikView & SalesforceQlikView & Salesforce
QlikView & Salesforce
 
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
 
Best Practices - QlikView Application Development
Best Practices - QlikView Application DevelopmentBest Practices - QlikView Application Development
Best Practices - QlikView Application Development
 
Qlik-Education-Catalog-EN
Qlik-Education-Catalog-ENQlik-Education-Catalog-EN
Qlik-Education-Catalog-EN
 
QlikView projects in Agile Environment
QlikView projects in Agile EnvironmentQlikView projects in Agile Environment
QlikView projects in Agile Environment
 
Credon - Qlik Sense Presentation
Credon - Qlik Sense PresentationCredon - Qlik Sense Presentation
Credon - Qlik Sense Presentation
 
Blueprint Series: Banking In The Cloud – Ultra-high Reliability Architectures
Blueprint Series: Banking In The Cloud – Ultra-high Reliability ArchitecturesBlueprint Series: Banking In The Cloud – Ultra-high Reliability Architectures
Blueprint Series: Banking In The Cloud – Ultra-high Reliability Architectures
 
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next Generation
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next GenerationQlik Sense for Beginners - www.techstuffy.com - QlikView Next Generation
Qlik Sense for Beginners - www.techstuffy.com - QlikView Next Generation
 
Data and its Role in Your Digital Transformation
Data and its Role in Your Digital TransformationData and its Role in Your Digital Transformation
Data and its Role in Your Digital Transformation
 
CWIN17 san francisco-william belding-innovation through insights 2017-12-07
CWIN17 san francisco-william belding-innovation through insights 2017-12-07CWIN17 san francisco-william belding-innovation through insights 2017-12-07
CWIN17 san francisco-william belding-innovation through insights 2017-12-07
 
The Big Picture: Real-time Data is Defining Intelligent Offers
The Big Picture: Real-time Data is Defining Intelligent OffersThe Big Picture: Real-time Data is Defining Intelligent Offers
The Big Picture: Real-time Data is Defining Intelligent Offers
 

Viewers also liked

SoCal BigData Day
SoCal BigData DaySoCal BigData Day
SoCal BigData DayJohn Park
 
QWC 2014 - A picture worth 1000 words
QWC 2014 - A picture worth 1000 wordsQWC 2014 - A picture worth 1000 words
QWC 2014 - A picture worth 1000 wordsJohn Park
 
A Picture is Worth a Thousand Words
A Picture is Worth a Thousand WordsA Picture is Worth a Thousand Words
A Picture is Worth a Thousand WordsJohn Park
 
Druid at Hadoop Ecosystem
Druid at Hadoop EcosystemDruid at Hadoop Ecosystem
Druid at Hadoop EcosystemSlim Bouguerra
 
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...Big Data Spain
 
Intro to Apache Spark
Intro to Apache SparkIntro to Apache Spark
Intro to Apache SparkMammoth Data
 
Alpine academy apache spark series #1 introduction to cluster computing wit...
Alpine academy apache spark series #1   introduction to cluster computing wit...Alpine academy apache spark series #1   introduction to cluster computing wit...
Alpine academy apache spark series #1 introduction to cluster computing wit...Holden Karau
 
Sa introduction to big data pipelining with cassandra & spark west mins...
Sa introduction to big data pipelining with cassandra & spark   west mins...Sa introduction to big data pipelining with cassandra & spark   west mins...
Sa introduction to big data pipelining with cassandra & spark west mins...Simon Ambridge
 
Rethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleRethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleHelena Edelson
 
Akka in Production - ScalaDays 2015
Akka in Production - ScalaDays 2015Akka in Production - ScalaDays 2015
Akka in Production - ScalaDays 2015Evan Chan
 
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)Robert "Chip" Senkbeil
 
Reactive app using actor model & apache spark
Reactive app using actor model & apache sparkReactive app using actor model & apache spark
Reactive app using actor model & apache sparkRahul Kumar
 
Real-Time Anomaly Detection with Spark MLlib, Akka and Cassandra
Real-Time Anomaly Detection  with Spark MLlib, Akka and  CassandraReal-Time Anomaly Detection  with Spark MLlib, Akka and  Cassandra
Real-Time Anomaly Detection with Spark MLlib, Akka and CassandraNatalino Busa
 
Reactive dashboard’s using apache spark
Reactive dashboard’s using apache sparkReactive dashboard’s using apache spark
Reactive dashboard’s using apache sparkRahul Kumar
 
Four Things to Know About Reliable Spark Streaming with Typesafe and Databricks
Four Things to Know About Reliable Spark Streaming with Typesafe and DatabricksFour Things to Know About Reliable Spark Streaming with Typesafe and Databricks
Four Things to Know About Reliable Spark Streaming with Typesafe and DatabricksLegacy Typesafe (now Lightbend)
 
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...Anton Kirillov
 
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo Lee
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo LeeData Science lifecycle with Apache Zeppelin and Spark by Moonsoo Lee
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo LeeSpark Summit
 
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)Helena Edelson
 
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...Helena Edelson
 

Viewers also liked (20)

SoCal BigData Day
SoCal BigData DaySoCal BigData Day
SoCal BigData Day
 
QWC 2014 - A picture worth 1000 words
QWC 2014 - A picture worth 1000 wordsQWC 2014 - A picture worth 1000 words
QWC 2014 - A picture worth 1000 words
 
A Picture is Worth a Thousand Words
A Picture is Worth a Thousand WordsA Picture is Worth a Thousand Words
A Picture is Worth a Thousand Words
 
Druid at Hadoop Ecosystem
Druid at Hadoop EcosystemDruid at Hadoop Ecosystem
Druid at Hadoop Ecosystem
 
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...
The Enterprise and Connected Data, Trends in the Apache Hadoop Ecosystem by A...
 
Intro to Apache Spark
Intro to Apache SparkIntro to Apache Spark
Intro to Apache Spark
 
Alpine academy apache spark series #1 introduction to cluster computing wit...
Alpine academy apache spark series #1   introduction to cluster computing wit...Alpine academy apache spark series #1   introduction to cluster computing wit...
Alpine academy apache spark series #1 introduction to cluster computing wit...
 
Sa introduction to big data pipelining with cassandra & spark west mins...
Sa introduction to big data pipelining with cassandra & spark   west mins...Sa introduction to big data pipelining with cassandra & spark   west mins...
Sa introduction to big data pipelining with cassandra & spark west mins...
 
Rethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleRethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For Scale
 
How to deploy Apache Spark 
to Mesos/DCOS
How to deploy Apache Spark 
to Mesos/DCOSHow to deploy Apache Spark 
to Mesos/DCOS
How to deploy Apache Spark 
to Mesos/DCOS
 
Akka in Production - ScalaDays 2015
Akka in Production - ScalaDays 2015Akka in Production - ScalaDays 2015
Akka in Production - ScalaDays 2015
 
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)
Spark Kernel Talk - Apache Spark Meetup San Francisco (July 2015)
 
Reactive app using actor model & apache spark
Reactive app using actor model & apache sparkReactive app using actor model & apache spark
Reactive app using actor model & apache spark
 
Real-Time Anomaly Detection with Spark MLlib, Akka and Cassandra
Real-Time Anomaly Detection  with Spark MLlib, Akka and  CassandraReal-Time Anomaly Detection  with Spark MLlib, Akka and  Cassandra
Real-Time Anomaly Detection with Spark MLlib, Akka and Cassandra
 
Reactive dashboard’s using apache spark
Reactive dashboard’s using apache sparkReactive dashboard’s using apache spark
Reactive dashboard’s using apache spark
 
Four Things to Know About Reliable Spark Streaming with Typesafe and Databricks
Four Things to Know About Reliable Spark Streaming with Typesafe and DatabricksFour Things to Know About Reliable Spark Streaming with Typesafe and Databricks
Four Things to Know About Reliable Spark Streaming with Typesafe and Databricks
 
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...
Data processing platforms architectures with Spark, Mesos, Akka, Cassandra an...
 
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo Lee
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo LeeData Science lifecycle with Apache Zeppelin and Spark by Moonsoo Lee
Data Science lifecycle with Apache Zeppelin and Spark by Moonsoo Lee
 
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)
Streaming Big Data with Spark, Kafka, Cassandra, Akka & Scala (from webinar)
 
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...
Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...
 

Similar to Raw data to analysis and visualization in the Cloud with AWS and Qlik

Qonnections 2014 - Sales and Marketing Functional Forum
Qonnections 2014 - Sales and Marketing Functional ForumQonnections 2014 - Sales and Marketing Functional Forum
Qonnections 2014 - Sales and Marketing Functional ForumBrian Booden
 
How Zebra Technologies delivers business intelligence with Elastic on Google ...
How Zebra Technologies delivers business intelligence with Elastic on Google ...How Zebra Technologies delivers business intelligence with Elastic on Google ...
How Zebra Technologies delivers business intelligence with Elastic on Google ...Elasticsearch
 
Streamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureStreamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureElasticsearch
 
Streamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureStreamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureElasticsearch
 
Public sector keynote
Public sector keynotePublic sector keynote
Public sector keynoteElasticsearch
 
Elastic Cloud: The best way to experience everything Elastic
Elastic Cloud: The best way to experience everything ElasticElastic Cloud: The best way to experience everything Elastic
Elastic Cloud: The best way to experience everything ElasticElasticsearch
 
Elastic, DevSecOps, and the DOD software factory
Elastic, DevSecOps, and the DOD software factoryElastic, DevSecOps, and the DOD software factory
Elastic, DevSecOps, and the DOD software factoryElasticsearch
 
Elastic Cloud keynote
Elastic Cloud keynoteElastic Cloud keynote
Elastic Cloud keynoteElasticsearch
 
Managing the Elastic Stack at Scale
Managing the Elastic Stack at ScaleManaging the Elastic Stack at Scale
Managing the Elastic Stack at ScaleElasticsearch
 
Heroku + Salesforce = Partner Success
Heroku + Salesforce = Partner SuccessHeroku + Salesforce = Partner Success
Heroku + Salesforce = Partner SuccessAlexander Sutherland
 
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...Business Insight
 
SI Alliance Marketing - Insurance Analytics Solution Webinar
SI Alliance Marketing - Insurance Analytics Solution WebinarSI Alliance Marketing - Insurance Analytics Solution Webinar
SI Alliance Marketing - Insurance Analytics Solution WebinarDavid Castro
 
La transformación digital impulsada por los datos en la industria de servicio...
La transformación digital impulsada por los datos en la industria de servicio...La transformación digital impulsada por los datos en la industria de servicio...
La transformación digital impulsada por los datos en la industria de servicio...Data IQ Argentina
 
Welcome to the Government Success Platform
Welcome to the Government Success PlatformWelcome to the Government Success Platform
Welcome to the Government Success PlatformSalesforce Partners
 
TrailheaDX Global Gathering London 2018
TrailheaDX Global Gathering London 2018TrailheaDX Global Gathering London 2018
TrailheaDX Global Gathering London 2018Keir Bowden
 
Building einstein analytics apps uk-compressed
Building einstein analytics apps   uk-compressedBuilding einstein analytics apps   uk-compressed
Building einstein analytics apps uk-compressedrikkehovgaard
 
From secure VPC links to SSO with Elastic Cloud
From secure VPC links to SSO with Elastic CloudFrom secure VPC links to SSO with Elastic Cloud
From secure VPC links to SSO with Elastic CloudElasticsearch
 
What's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releasesWhat's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releasesElasticsearch
 
Elastic Observability keynote
Elastic Observability keynoteElastic Observability keynote
Elastic Observability keynoteElasticsearch
 
2019 Fiscal Year Close
2019 Fiscal Year Close 2019 Fiscal Year Close
2019 Fiscal Year Close ~Eric Principe
 

Similar to Raw data to analysis and visualization in the Cloud with AWS and Qlik (20)

Qonnections 2014 - Sales and Marketing Functional Forum
Qonnections 2014 - Sales and Marketing Functional ForumQonnections 2014 - Sales and Marketing Functional Forum
Qonnections 2014 - Sales and Marketing Functional Forum
 
How Zebra Technologies delivers business intelligence with Elastic on Google ...
How Zebra Technologies delivers business intelligence with Elastic on Google ...How Zebra Technologies delivers business intelligence with Elastic on Google ...
How Zebra Technologies delivers business intelligence with Elastic on Google ...
 
Streamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureStreamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft Azure
 
Streamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft AzureStreamline search with Elasticsearch Service on Microsoft Azure
Streamline search with Elasticsearch Service on Microsoft Azure
 
Public sector keynote
Public sector keynotePublic sector keynote
Public sector keynote
 
Elastic Cloud: The best way to experience everything Elastic
Elastic Cloud: The best way to experience everything ElasticElastic Cloud: The best way to experience everything Elastic
Elastic Cloud: The best way to experience everything Elastic
 
Elastic, DevSecOps, and the DOD software factory
Elastic, DevSecOps, and the DOD software factoryElastic, DevSecOps, and the DOD software factory
Elastic, DevSecOps, and the DOD software factory
 
Elastic Cloud keynote
Elastic Cloud keynoteElastic Cloud keynote
Elastic Cloud keynote
 
Managing the Elastic Stack at Scale
Managing the Elastic Stack at ScaleManaging the Elastic Stack at Scale
Managing the Elastic Stack at Scale
 
Heroku + Salesforce = Partner Success
Heroku + Salesforce = Partner SuccessHeroku + Salesforce = Partner Success
Heroku + Salesforce = Partner Success
 
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...
Caso di successo esposto durante l'evento Qlik Visualize Your Worl 2014 - Per...
 
SI Alliance Marketing - Insurance Analytics Solution Webinar
SI Alliance Marketing - Insurance Analytics Solution WebinarSI Alliance Marketing - Insurance Analytics Solution Webinar
SI Alliance Marketing - Insurance Analytics Solution Webinar
 
La transformación digital impulsada por los datos en la industria de servicio...
La transformación digital impulsada por los datos en la industria de servicio...La transformación digital impulsada por los datos en la industria de servicio...
La transformación digital impulsada por los datos en la industria de servicio...
 
Welcome to the Government Success Platform
Welcome to the Government Success PlatformWelcome to the Government Success Platform
Welcome to the Government Success Platform
 
TrailheaDX Global Gathering London 2018
TrailheaDX Global Gathering London 2018TrailheaDX Global Gathering London 2018
TrailheaDX Global Gathering London 2018
 
Building einstein analytics apps uk-compressed
Building einstein analytics apps   uk-compressedBuilding einstein analytics apps   uk-compressed
Building einstein analytics apps uk-compressed
 
From secure VPC links to SSO with Elastic Cloud
From secure VPC links to SSO with Elastic CloudFrom secure VPC links to SSO with Elastic Cloud
From secure VPC links to SSO with Elastic Cloud
 
What's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releasesWhat's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releases
 
Elastic Observability keynote
Elastic Observability keynoteElastic Observability keynote
Elastic Observability keynote
 
2019 Fiscal Year Close
2019 Fiscal Year Close 2019 Fiscal Year Close
2019 Fiscal Year Close
 

Recently uploaded

Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 

Recently uploaded (20)

Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 

Raw data to analysis and visualization in the Cloud with AWS and Qlik

  • 1. Raw data to analysis and visualization in the Cloud with Amazon Web Services (AWS) and Qlik Rahul Bhartia, AWS John Park, Qlik April, 2015
  • 2. 2#qonnections Legal Disclaimer ©Qlik Confidential This Presentation contains forward-looking statements, including, but not limited to, statements regarding the value and effectiveness of Qlik's products, the introduction of product enhancements or additional products, Qlik’s partner and customer relationships, and Qlik's growth, expansion and market leadership, that involve risks, uncertainties, assumptions and other factors which, if they do not materialize or prove correct, could cause Qlik's results to differ materially from those expressed or implied by such forward-looking statements. All statements, other than statements of historical fact, are statements that could be deemed forward-looking statements, including statements containing the words "predicts," "plan," "expects," "anticipates,“ “see,” "believes," "goal," "target," "estimate," "potential," "may", "will," "might," "could," and similar words. Qlik intends all such forward-looking statements to be covered by the safe harbor provisions for forward-looking statements contained in Section 21E of the Exchange Act and the Private Securities Litigation Reform Act of 1995. Actual results may differ materially from those projected in such statements due to various factors, including but not limited to: risks and uncertainties inherent in our business; our ability to attract new customers and retain existing customers; our ability to effectively sell, service and support our products; our ability to manage our international operations; our ability to compete effectively; ourability to develop and introduce new products and add-ons or enhancements to existing products; our ability to continue to promote and maintain our brand in a cost-effective manner; our ability to manage growth; our ability to attract and retain key personnel; the scope and validity of intellectual property rights applicable to our products; adverse economic conditions in general and adverse economic conditions specifically affecting the markets in which we operate; and other risks and uncertainties more fully described in Qlik's publicly available filings with the Securities and Exchange Commission. Past performance is not necessarily indicative of future results. Theforward- looking statements included in this presentation represent Qlik's views as of the date of this presentation. Qlik anticipates that subsequent events and developments will cause its views to change. Qlik undertakes no intention or obligation to update or revise any forward-looking statements, whether as a result of new information, future events or otherwise. These forward-looking statements should not be relied upon as representing Qlik's views as of any date subsequent to the date of this presentation. This Presentation should be read in conjunction with Qlik's periodic reports filed with the SEC (SEC Information), including the disclosures therein of certain factors which may affect Qlik’s future performance. Individual statements appearing in this Presentation are intended to be read in conjunction with and in the context of the complete SEC Information documents in which they appear, rather than asstand- alone statements. This presentation is intended to outline our general product direction and should not be relied on in making a purchase decision, as the development, release, and timing of any features or functionality described for our products remains at our sole discretion. © 2015 QlikTech International AB. All rights reserved. Qlik®, QlikView®, Qlik® Sense, QlikTech®, and the Qlik logos are trademarks of QlikTech International AB which have been registered in multiple countries. Other marks and logos mentioned herein are trademarks or registered trademarks of their respective owners.
  • 3. 3#qonnections Rahul Bhartia • Ecosystem Solutions Architect, AWS • Data and analytics applications for the Cloud • Over 10 years in architecture of data processing systems Presenters John Park • Senior Solution Architect, Partner Engineering • ETL, Data warehousing, Software design, *NIX systems and architecture • 2 years Qlik, 7 years DW Consultant • Twitter: @jpark328
  • 4. 4#qonnections Agenda • Introduction • What can the Cloud do for us? • Amazon Web Services (AWS) • Qlik with AWS in the Cloud • Demo • Summary and key takeaways
  • 5. 5#qonnections What can the cloud do for us ? Collect • EventsTransactions • Files and Logs Store • Object Store • Databases • NoSQL Capabilities of Qlik with Amazon Web Services (AWS) Process • Hadoop and data integration tools (ETL) Think of the cloud as ‘The Matrix’ and you have infinite amount of cheap resources to create your Business Intelligence environment Analyze • Query , Visualize and Collaborate
  • 7. Why AWS? Building and managing cloud since 2006 40+ services to support any cloud workload History of rapid, customer-driven releases 11 regions, 29 availability zones, 53 edge locations 48 proactive price reductions to date Thousands of SIs and ISVs; 2,100+ Marketplace listings Experience Service Breadth & Depth Pace of Innovation Global Footprint Pricing Philosophy Ecosystem
  • 8. Administration & Security Access Control Identity Management Key Management & Storage Monitoring & Logs Resource & Usage Auditing Platform Services Analytics App Services Developer Tools & Operations Mobile Services Data Pipelines Data Warehouse Hadoop Real-time Streaming Data Application Lifecycle Management Container s Deployment DevOps Event-driven Computing Resource Templates Identity Mobile Analytics Push Notifications Sync App Streaming Email Queuing & Notifications Search Transcoding Workflow Core Services CDN Compute (VMs, Auto-scaling, and Load Balancing) Databases (Relational, NoSQL, and Caching) Networking (VPC, DX, and DNS) Storage (Object, Block, EFS, and Archival) Infrastructure Availability Zones Points of PresenceRegions Enterprise Applications Business Email Sharing & Collaboration Virtual Desktop Technical & Business Support Account Management Partner Ecosystem Professional Services Security & Pricing Reports Solutions Architect s Support Training & Certification Machine Learning AWS - cloud computing services
  • 9. Culture of innovation On-premises Infrequent and long experimentations High risk Lower innovation Frequent and short experimentations Low risk Higher innovation Innovate faster by experimenting often with lower risks
  • 10. “Unstructured data growth explosive, with estimates of compound annual growth (CAGR) at 62% from 2008 – 2012” Source: IDC GB TB PB ZB EB Unconstrained data growth
  • 11. Not only about growth… Data Velocity Variety Volume Structured, Unstructured, Text, Binary Gigabytes, Terabytes, Petabytes Millisecond, Second, Minute, Hour, Day
  • 12. One tool to rule them all
  • 13. Use the right tools Amazon S3 Amazon Kinesis Amazon DynamoDB Amazon Redshift Amazon Elastic MapReduce Data Answers Collect Process Analyze Store
  • 14. Object storage Highly scalable Support for automatic encryption Designed for 99.999999999% durability Amazon S3
  • 15. Amazon Aurora, MySQL, Oracle, SQLServer, Postgres High Availability Push Button Scalability Up to 3 TB and 30K IOPS Amazon RDS
  • 16. Relational data warehouse Massively parallel Petabyte scale Fully managed Starting at $1,000/TB per year Amazon Redshift
  • 17. Amazon EMR Managed Hadoop clusters Easy to use Fully managed Support for Amazon EC2 Spot and Reserved Instances
  • 18. Amazon DynamoDB NoSQL database Seamless scalability Zero administration Single digit millisecond latency
  • 19. Amazon Kinesis Real-time data ingestion High throughput Elastic Connectors for S3, Redshift and DynamoDB
  • 20. Amazon Data Pipeline Data workflow orchestration Creation and management of resources Managed dependencies and scheduling Notification and alerts using Amazon SNS
  • 21. Amazon Glacier Amazon EMR Amazon EMR Amazon Redshift Amazon DynamoDB Amazon S3 Platform for your data Data Web Application Business Intelligence Amazon Data Pipeline Interactive querying
  • 22. Qlik with AWS in the Cloud: John Park
  • 23. 23#qonnections Qlik® with AWS - Andersen Corporation Challenges • With plans to transform the structure of its sales team, Andersen Corporation needed a streamlined way to realign, measure and track the success of its sales team. Additionally, the team would have limited IT bandwidth to support the project and just 90 days to deploy. Solution • Andersen Corporation deployed QlikView in the cloud with the help of Qlik Consulting to support the restructure of its sales team. The tool is now at the heart of all sales decisions. Benefit • Streamlined view of all sales data in one platform aligned with new sales structure • Increased efficiency with sales targeting based on geography • Created a self-service environment for sales team allowing direct access to personal performance and sales pipeline. • ROI in 90 Days “With only three months to deploy and limited bandwidth from our IT team, we went into this project knowing we would need to rely heavily on the vendor. Qlik Consulting was able to quickly understand the idiosyncrasies of our business, digest the complexity of the project and lay the proper foundation needed for our team’s success” Director of Business Analytics, Andersen Corporation • Andersen Corporations is the largest window manufacturer in North America • Employees 9,000 people • 100+ Year company serving North America, South America, Europe, Asia and Middle East.
  • 24. 24#qonnections QlikView - Business discovery on AWS • Cloud-based associative business discovery for Big Data • Massive data scalability with Amazon EC2 • Rapid Big Data app development with Amazon Redshift • Seamlessly combines Big Data with other data sources • Easy to implement no upfront cost Amazon EMR Hadoop Cluster Amazon RDS Operational Systems Amazon Redshift Data Warehouse
  • 25. 25#qonnections PresentationApplication Windows Based File Share (Optional) Third-Party Integration: • Informatica • Talend DataAccess Windows IIS QlikView - Business Discovery Platform on AWS Business Discovery Apps Sales • Finance • Marketing • Operations QlikView Web Server Business Users IT Admins QlikView Management Console QlikView Server QlikView Publisher Data Sources Custom connectors; ODBC; OLEDB; QVX; XML QVW; QVD files Data/Business Analysts Developers QlikView Developer Security Integration: • IAM • AD Server Replication Elastic IP Instances Amazon EC2 Amazon EC2 Amazon S3 MySQL DB Instance Oracle DB Instance MS SQL Instance Amazon Redshift AWS Management Console
  • 26. Lets jump into the demo
  • 27. 27#qonnections Take raw data and perform ETL and reload automatically in Qlik • Use AWS CloudFormation to create our stack* • Raw data into Amazon S3(manually) • Use Amazon Data Pipeline as an orchestration engine – Amazon EMR performs analysis with data on Amazon S3 – Load detail data into Amazon Redshift – Amazon EMR summarizes data and place it in Amazon S3 – Trigger a QlikView re-load • Automatically see the results on QlikView Access Point. Our demo today
  • 28. 28#qonnections Now for Our Demo Picture source: http://deathtothestockphoto.com/stories/
  • 29. Architecture for Demo Availability Zone us-east1a Subnet 1 Subnet 2 Internet Gateway User Amazon VPC Qlik Server Qlik Server Bastion Amazon Redshift Amazon S3 QlikView Server- Amazon EC2*
  • 30. Amazon Redshift Amazon S3 with summarized data Amazon S3 as Landing Zone AWS Data Pipeline Raw CSV Amazon EC2 Qlik Extraction Amazon EMR
  • 31. 31#qonnections Security • AWS Identity and Access Management (IAM) • Amazon VPC – subnets, security groups and network access control list and • Amazon S3 bucket policies and support for encryption Performance • Placement groups for low-latency, 10 Gbps network • Enhanced networking for high packet-per-second performance Cost Savings • Use Amazon Elastic Block Store (Amazon EBS) and stop or terminate Amazon EC2 instances • Elasticity with Auto Scaling • Amazon EC2 Spot Instances and Reserved Instances Repeatability • Script everything you can and automate Considerations
  • 32. 32#qonnections Qlik • All collateral from this session will be posted in branch – http://branch.qlik.com/, GitHub, Slideshare Qlik community - https://community.qlik.com/welcome Slides will be posted on community and code will be posted on branch. AWS • Test Drive - http://www.ipc-global.com/login-page-for-directit-test- drive-labs/ • AWS Summits - http://aws.amazon.com/summits/ • AWS Documentations - http://aws.amazon.com/documentation/ • AWS Boot camp at Summits Where can I learn more about Qlik and AWS
  • 33. 33#qonnections Combine AWS and Qlik for maximum benefits • Provide your customers with production grade Qlik environment(Use Stacks) • Go from raw data to analysis in days not months with AWS • An affordable flexible option that also scales with your customer needs – No hardware or software to buy to install Qlik – Get started quickly – Quick ROI for customers Summary and key takeaways
  • 35. 35#qonnections Feedback survey • Please complete the track session survey via the mobile app • Access the track session survey through the mobile app • Enter track session code T63 • Provide your feedback

Editor's Notes

  1. TALKING POINTS Customers have selected AWS for eight years because we have proven ourselves committed to customer success. We believe we stand apart in the market because of six factors: Experience, Service Breadth and Depth, Pace of Innovation, Global Footprint, Pricing Philosophy, and Partner Ecosystem
  2. AWS has developed the broadest collection of services available from any cloud provider. Our approach to regions, availability zones, and POPs provides global coverage for high availability, low latency applications. Foundation services across compute, storage, security, and networking offer customers flexibility in their architecture. We have a full spectrum of options to meet most price-to-performance scenarios. We offer the capability for both managed and unmanaged database options. The offerings for Analytics and Application Services enable advanced data processing and workloads. AWS Redshift, our cloud-based data warehouse, is the fastest growing service in the history of AWS. Our management tools offer a lot of insight and flexibility to let you manage your AWS resources through either our tools or the management tools you’re already familiar with. Recent expansion into enterprise applications has been entirely driven by customer feedback on where they’d like us to deliver value.
  3. We see our customers do amazing things when they reduce the cost of experimentation- it moves IT from being a roadblock, where each idea costs lots of money and takes lots of time, to being an enabler where you can launch a speculative project quickly and cheaply. It allows firms to take more chances on ideas, and gives them a shot at winning big, as opposed to being scared to even try.
  4. Due to the convergence of many technologies of cloud, mobile, social, and advancements in many field such as genomics, life sciences, space, the size of the digital universe is growing at an ever increasing rate. Customers have also found tremendous value in being able to mine this data to make better medicine, tailored purchasing recommendations, detect fraudulent financial transactions in real time, provide on-demand digital content such as movies and songs, predict weather forecasts, the list goes on and on.
  5. However, we don’t believe that there is one tool that can do everything, but rather if you use the right tools, you can build a highly configurable big data architecture to meet your specific needs.
  6. While I won’t be able to go over all of our big data services, I would like to spend some time introducing to you several key big data services that are designed for high availability and durability, as a managed service where we provision the infrastructure on your behalf where you can get significant big data storage and analytics with a few clicks or api calls.
  7. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  8. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  9. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  10. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  11. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  12. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  13. Fundamental storage at internet scale, it can store any number of objects from 1 byte to 5 TB in size It is engineered for 11 9’s of durability replicating your data at least three times in three distinct physical data centers we call availability zones We have customers such as Dropbox, Spotify, Pinterest store billions of objects or files as photos, videos, songs, or any other type of file.
  14. Elastic capability and on demand nature of Cloud with Qlikview. High Level AWS EC2 Redshift Redshift Being an WH Construct
  15. Direct Connect
  16. What is Big Data ? What is Hadoop ?
  17. Totally private web application with no public access to any AWS resources Must be on the VPN to manage the resources or use the application
  18. Reality Data management overview