Qonnections2015 - Why Qlik is better with Big DataJohn Park
Big Data is everywhere. We generate enough data to track every single transactions, sensors, and interactions. But what do we do with this? Using Jethro Data and Qlik you can easily unlock the value of Big Data. Qlik can help you find outliers and trends in Billions rows and make what seems long esoteric process easy. The presentation will go through the problem statement and Qlik like approach to solving the problem. We will also introduce Jethro data a new Qlik Partner to the Our Partners
Data processing platforms with SMACK: Spark and Mesos internalsAnton Kirillov
The first part of the slides contains general overview of SMACK stack and possible architecture layouts that could be implemented on top of it. We discuss Apache Spark internals: the concept of RDD, DAG logical view and dependencies types, execution workflow, shuffle process and core Spark components. The second part is dedicated to Mesos architecture and the concept of framework, different ways of running applications and schedule Spark jobs on top of it. We'll take a look at popular frameworks like Marathon and Chronos and see how Spark Jobs and Docker containers are executed using them.
Real Time Machine Learning Visualization With SparkChester Chen
Training machine learning model involves a lot of experimentation, we need a way to visualize the training process.
We presented a system to enable real time machine learning visualization with Spark:
-- Gives visibility into the training of a model
-- Allows us monitor the convergence of the algorithms during training
-- Can stop the iterations when convergence is good enough.
Qonnections2015 - Why Qlik is better with Big DataJohn Park
Big Data is everywhere. We generate enough data to track every single transactions, sensors, and interactions. But what do we do with this? Using Jethro Data and Qlik you can easily unlock the value of Big Data. Qlik can help you find outliers and trends in Billions rows and make what seems long esoteric process easy. The presentation will go through the problem statement and Qlik like approach to solving the problem. We will also introduce Jethro data a new Qlik Partner to the Our Partners
Data processing platforms with SMACK: Spark and Mesos internalsAnton Kirillov
The first part of the slides contains general overview of SMACK stack and possible architecture layouts that could be implemented on top of it. We discuss Apache Spark internals: the concept of RDD, DAG logical view and dependencies types, execution workflow, shuffle process and core Spark components. The second part is dedicated to Mesos architecture and the concept of framework, different ways of running applications and schedule Spark jobs on top of it. We'll take a look at popular frameworks like Marathon and Chronos and see how Spark Jobs and Docker containers are executed using them.
Real Time Machine Learning Visualization With SparkChester Chen
Training machine learning model involves a lot of experimentation, we need a way to visualize the training process.
We presented a system to enable real time machine learning visualization with Spark:
-- Gives visibility into the training of a model
-- Allows us monitor the convergence of the algorithms during training
-- Can stop the iterations when convergence is good enough.