Comparison of various streaming technologies

Senior Software Developer at IBM Analytics
Mar. 22, 2016
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
Comparison of various streaming technologies
1 of 38

More Related Content

What's hot

Evolving from Messaging to Event StreamingEvolving from Messaging to Event Streaming
Evolving from Messaging to Event Streamingconfluent
Apache Deep Learning 201 - Barcelona DWS March 2019Apache Deep Learning 201 - Barcelona DWS March 2019
Apache Deep Learning 201 - Barcelona DWS March 2019Timothy Spann
Designing For Multicloud, CF Summit Frankfurt 2016Designing For Multicloud, CF Summit Frankfurt 2016
Designing For Multicloud, CF Summit Frankfurt 2016Mark D'Cunha
Real-World Pulsar Architectural PatternsReal-World Pulsar Architectural Patterns
Real-World Pulsar Architectural PatternsDevin Bost
Serverless machine learning architectures at HelixaServerless machine learning architectures at Helixa
Serverless machine learning architectures at HelixaData Science Milan
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...GetInData

What's hot(20)

Viewers also liked

Real-Time Event & Stream Processing on MS AzureReal-Time Event & Stream Processing on MS Azure
Real-Time Event & Stream Processing on MS AzureKhalid Salama
IoT Innovation Lab Berlin @relayr - Kay Lerch on Getting basics right for you...IoT Innovation Lab Berlin @relayr - Kay Lerch on Getting basics right for you...
IoT Innovation Lab Berlin @relayr - Kay Lerch on Getting basics right for you...Kay Lerch
Dataflow with Apache NiFi - Apache NiFi Meetup - 2016 Hadoop Summit - San JoseDataflow with Apache NiFi - Apache NiFi Meetup - 2016 Hadoop Summit - San Jose
Dataflow with Apache NiFi - Apache NiFi Meetup - 2016 Hadoop Summit - San JoseAldrin Piri
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...Data Con LA
Developing Connected Applications with AWS IoT - Technical 301Developing Connected Applications with AWS IoT - Technical 301
Developing Connected Applications with AWS IoT - Technical 301Amazon Web Services
Lightbend Fast Data PlatformLightbend Fast Data Platform
Lightbend Fast Data PlatformLightbend

Viewers also liked(20)

Similar to Comparison of various streaming technologies

Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...
Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...Prolifics
Introduction to Structured StreamingIntroduction to Structured Streaming
Introduction to Structured Streamingdatamantra
Natural Laws of Software PerformanceNatural Laws of Software Performance
Natural Laws of Software PerformanceGibraltar Software
Five cool ways the JVM can run Apache Spark fasterFive cool ways the JVM can run Apache Spark faster
Five cool ways the JVM can run Apache Spark fasterTim Ellison
Jstorm introduction-0.9.6Jstorm introduction-0.9.6
Jstorm introduction-0.9.6longda feng
Apache Storm and Oracle Event Processing for Real-time AnalyticsApache Storm and Oracle Event Processing for Real-time Analytics
Apache Storm and Oracle Event Processing for Real-time AnalyticsPrabhu Thukkaram

Similar to Comparison of various streaming technologies(20)

Recently uploaded

Master's Encyclopedia Mohammad Mahdi Farshadian.pdfMaster's Encyclopedia Mohammad Mahdi Farshadian.pdf
Master's Encyclopedia Mohammad Mahdi Farshadian.pdfEducational Group Mohammad Farshadian
Finding Your Way in Container SecurityFinding Your Way in Container Security
Finding Your Way in Container SecurityKsenia Peguero
OpenOCD-K3OpenOCD-K3
OpenOCD-K3Nishanth Menon
PROCESS PLANNING ACTIVITIESPROCESS PLANNING ACTIVITIES
PROCESS PLANNING ACTIVITIESDJAGADEESH1
Chapter 8. Classification Basic Concepts.pptChapter 8. Classification Basic Concepts.ppt
Chapter 8. Classification Basic Concepts.pptSubrata Kumer Paul
UNIT III	PRINCIPLES OF ILLUMINATION	UNIT III	PRINCIPLES OF ILLUMINATION
UNIT III PRINCIPLES OF ILLUMINATION karthi keyan

Comparison of various streaming technologies

Editor's Notes

  1. Add Dynamic Allocation.
  2. https://github.com/davidkiss/storm-twitter-word-count
  3. https://github.com/Blackmist/TwitterTrending
  4. https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html#controlling-latency https://ci.apache.org/projects/flink/flink-docs-release-0.10/setup/config.html#configuring-taskmanager-processing-slots
  5. https://cwiki.apache.org/confluence/display/FLINK/Data+exchange+between+tasks https://ci.apache.org/projects/flink/flink-docs-release-0.10/setup/config.html#configuring-taskmanager-processing-slots
  6. Flink uses effectively distributed blocking queues with bounded capacity The output side never puts too much data on the wire by a simple watermark mechanism. If enough data is in-flight, we wait before we copy more data to the wire until it is below a threshold. This guarantees that there is never too much data in-flight. If new data is not consumed on the receiving side (because there is no buffer available), this slows down the sender. http://data-artisans.com/how-flink-handles-backpressure/
  7. 35