Apache Toree

•

10 likes•5,437 views

Apache Toree provides the interactive notebook for Spark/Scala. Toree is a IPython/Jupyter kernel. It lets you mix Spark/Scala code with markdown, execute the notebook, and publish it on the web. Asim will talk about how to install and get started with Apache Toree, how to use it to develop Spark applications interactively in notebooks, and how to publish your notebooks.

Data & Analytics

ASIM JALIS
Galvanize/Zipfian, Data
Engineering
Cloudera, Microso!,
Salesforce
MS in Computer Science
from University of
Virginia

WHAT IS GALVANIZE’S DATA
ENGINEERING IMMERSIVE?
Immersive Peer Learning
Environment
Master High-Demand
Skills and Technologies
Heart of San Francisco in
SOMA

YOU GET TO . . .
Play with Terabytes of
Data
Spark, Hadoop, Hive,
Kafka, Storm, HBase
Data Science at Scale
Level UP your Career

FOR MORE INFORMATION
asim.jalis@galvanize.com
http://galvanize.com

WHAT IS THIS TALK ABOUT?
What is Apache Toree?
How can I create
IPython/Jupyter
notebooks for
Spark/Scala?

HOW MANY PEOPLE HERE ARE
FAMILIAR WITH
IPYTHON/JUPYTER NOTEBOOKS?

HOW MANY PEOPLE HERE ARE
FAMILIAR WITH APACHE SPARK?

HOW MANY PEOPLE HERE ARE
FAMILIAR WITH SCALA?

WHAT IS LITERATE
PROGRAMMING?
Proposed by Don Knuth
Write programs for
humans, not machines
Programs communicate
ideas to others
Default text is
documentation or
thoughts
Code is explicitly
marked out

LITERATE PROGRAM
This program prints hello world.
<<hello.c>>=
<<includes>>
<<main>>
@
Some includes.
<<includes>>=
#include <stdio.h>
@
Print hello world, then exit.
<<main>>=
int main(int argc, char *argv[]) {
printf("Hello World!n");
return 0;
}
@

WHAT PROBLEM DOES JUPYTER
SOLVE?
Suppose you want to share programming idea or tutorial
You write an article and embed code in it
Now imagine being able to execute the code in the article

HOW IS THIS DIFFERENT FROM
CODE COMMENTS?
Commented code is not technical literature
It cannot be published or read as an article
A literate program is an executable article

WHAT IS JUPYTER?
Create executable
documents
Originally for Python
Supports other systems
through kernels

JUPYTER DEMO
Write Markdown text
Write Scala Spark code
Execute
Repeat
Tab-completion

JUPYTER ARCH
Jupyter server
Displays notebook in
browser
Executes code on
Python runtime
Displays output back
into notebook

FERNANDO PÉREZ
IPython/Jupyter
inventor
Particle Physics PhD,
University of Colorado—
Boulder
Now at UC Berkeley
Started IPython in 2001

IS IT IPYTHON OR JUPYTER?
Started out as IPython
notebook
Not specific to Python
Can work with Scala and
other languages
Jupyter captures its
language independence

WHAT IS TOREE?
Toree is a Jupyter Kernel
Executes Scala
Runs Spark
Driver/Context

TOREE ARCHITECTURE
Jupyter Server talks to
Toree Kernel
Toree Kernel talks to
Spark Driver
Spark Driver talks to
Spark Executors

HOW IS TOREE DIFFERENT FROM
ZEPPELIN
Toree compliant with Jupyter protocol
Toree is easy to install and use
Zeppelin does not use Jupyter protocol
Zeppelin wants to be a platform like Jupyter

TOREE COMMITS
Lot of activity last year
Stabilizing

WHO WROTE TOREE?
Top 2 contributors responsible for 50% of commits
chipsenkbeil has 318 commits
Lull3rSkat3r has 72 commits

WHY IS IT CALLED TOREE?
Nothing special about the name. Some
people in the group and just picked it out.
Some facts though, it is a purposeful
misspelling of the the Japanese word torii.
A torrii is a traditional gate for Shinto
shrines in Japan. —Corey Stubbs (personal
email)

WHAT WE WILL COVER
How to install Toree
How to automatically pull Java libraries in your notebook
How to publish notebooks on
How to turn notebooks into slide shows
http://nbviewer.jupyter.org/

QUICKSTART TUTORIAL
For details on how to do all these things
See https://github.com/asimjalis/apache-toree-quickstart

REFERENCES
Apache Toree Quickstart Tutorial
https://github.com/asimjalis/apache-toree-quickstart
Apache Toree on GitHub
https://github.com/apache/incubator-toree
Apache Toree Home
https://toree.incubator.apache.org/

Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed to act as a gateway to Spark by enabling users Spark from standard Jupyter notebooks. This allows users to easily integrate Spark into their existing Jupyter deployments, This allows users to easily move between languages and contexts without needing to switch to a different set of tools. Apache Toree is designed expressly for interactive work. It supports interpreters in Scala, Python, and R. In this talk, I will cover the design of Toree, how it interacts with the Jupyter ecosystem and various ways in which users can extend the functionality of Apache Toree via a powerful plugin system.

Scalable Scientific Computing with Dask

Uwe Korn

Python as the Zen of Data Science

Travis Oliphant

Convolutional Neural Networks at scale in Spark MLlib

DataWorks Summit

Jeremy Nixon will focus on the engineering and applications of a new algorithm built on top of MLlib. The presentation will focus on the methods the algorithm uses to automatically generate features to capture nonlinear structure in data, as well as the process by which it’s trained. Major aspects of that are the compositional transformations over the data, convolution, and distributed backpropagation via SGD with adaptive gradients and an adaptive learning rate. Applications will look into how to use convolutional neural networks to model data in computer vision, natural language and signal processing. Details around optimal preprocessing, the type of structure that can be learned, and managing its ability to generalize will inform developers looking to apply nonlinear modeling tools to problems that they face.

SparkFrameworkSergio Viademonte.

Deep Learning on Apache® Spark™ : Workflows and Best Practices

Jen Aman

The combination of Deep Learning with Apache Spark has the potential for tremendous impact in many sectors of the industry. This webinar, based on the experience gained in assisting customers with the Databricks Virtual Analytics Platform, will present some best practices for building deep learning pipelines with Spark. Rather than comparing deep learning systems or specific optimizations, this webinar will focus on issues that are common to deep learning frameworks when running on a Spark cluster, including: * optimizing cluster setup; * configuring the cluster; * ingesting data; and * monitoring long-running jobs. We will demonstrate the techniques we cover using Google’s popular TensorFlow library. More specifically, we will cover typical issues users encounter when integrating deep learning libraries with Spark clusters. Clusters can be configured to avoid task conflicts on GPUs and to allow using multiple GPUs per worker. Setting up pipelines for efficient data ingest improves job throughput, and monitoring facilitates both the work of configuration and the stability of deep learning jobs.

Scale up and Scale Out Anaconda and PyData

Travis Oliphant

DL4J at Workday Meetup

David Kale

David Kale and Ruben Fizsel from Skymind talk about deep learning for the JVM and enterprise using deeplearning4j (DL4J). Deep learning (nouveau neural nets) have sparked a renaissance in empirical machine learning with breakthroughs in computer vision, speech recognition, and natural language processing. However, many popular deep learning frameworks are targeted to researchers and poorly suited to enterprise settings that use Java-centric big data ecosystems. DL4J bridges the gap, bringing high performance numerical linear algebra libraries and state-of-the-art deep learning functionality to the JVM.

Building applications that can read and analyze a wide variety of data may change the way we do science and make business decisions. However, building such applications is challenging: real world data is expressed in natural language, images, or other “dark” data formats which are fraught with imprecision and ambiguity and so are difficult for machines to understand. This talk will describe Snorkel, whose goal is to make routine Dark Data and other prediction tasks dramatically easier. At its core, Snorkel focuses on a key bottleneck in the development of machine learning systems: the lack of large training datasets. In Snorkel, a user implicitly creates large training sets by writing simple programs that label data, instead of performing manual feature engineering or tedious hand-labeling of individual data items. We’ll provide a set of tutorials that will allow folks to write Snorkel applications that use Spark. Snorkel is open source on github and available from Snorkel.Stanford.edu.

Georgia Tech cse6242 - Intro to Deep Learning and DL4J

Josh Patterson

Spark-Streaming-as-a-Service with Kafka and YARN: Spark Summit East talk by J...

Spark Summit

Since April 2016, Spark-as-a-service has been available to researchers in Sweden from the Swedish ICT SICS Data Center at www.hops.site. Researchers work in an entirely UI-driven environment on a platform built with only open-source software. Spark applications can be either deployed as jobs (batch or streaming) or written and run directly from Apache Zeppelin. Spark applications are run within a project on a YARN cluster with the novel property that Spark applications are metered and charged to projects. Projects are also securely isolated from each other and include support for project-specific Kafka topics. That is, Kafka topics are protected from access by users that are not members of the project. In this talk we will discuss the challenges in building multi-tenant Spark streaming applications on YARN that are metered and easy-to-debug. We show how we use the ELK stack (Elasticsearch, Logstash, and Kibana) for logging and debugging running Spark streaming applications, how we use Graphana and Graphite for monitoring Spark streaming applications, and how users can debug and optimize terminated Spark Streaming jobs using Dr Elephant. We will also discuss the experiences of our users (over 120 users as of Sept 2016): how they manage their Kafka topics and quotas, patterns for how users share topics between projects, and our novel solutions for helping researchers debug and optimize Spark applications. To conclude, we will also give an overview on our course ID2223 on Large Scale Learning and Deep Learning, in which 60 students designed and ran SparkML applications on the platform.

Deep Learning Intro - Georgia Tech - CSE6242 - March 2015

Josh Patterson

Data science lifecycle with Apache Zeppelin

DataWorks Summit/Hadoop Summit

Hadoop Summit 2014 - San Jose - Introduction to Deep Learning on Hadoop

Josh Patterson

As the data world undergoes its cambrian explosion phase our data tools need to become more advanced to keep pace. Deep Learning has emerged as a key tool in the non-linear arms race of machine learning. In this session we will take a look at how we parallelize Deep Belief Networks in Deep Learning on Hadoop’s next generation YARN framework with Iterative Reduce. We’ll also look at some real world examples of processing data with Deep Learning such as image classification and natural language processing.

Pyspark vs Spark Let's Unravel the Bond!

ankitbhandari32

Hadoop summit 2016

Adam Gibson

Apache Spark and Apache Ignite: Where Fast Data Meets the IoT with Denis Magda

Databricks

It’s not enough to build a mesh of sensors or embedded devices to get more insights about the surrounding environment and optimize your production. Usually, your IoT solution needs to be capable of transferring enormous amounts of data to a storage or cloud where the data has to be processed further. Quite often, the processing of the endless streams of data has to be done almost in real-time so that you can react on the IoT subsystem’s state accordingly, and in time. During this session, see how to build a Fast Data solution that will receive endless streams from the IoT side and will be capable of processing the streams in real-time using Apache Ignite’s cluster resources. In particular, learn about data streaming to an Apache Ignite cluster from embedded devices and real-time data processing with Apache Spark.

Deep Learning: DL4J and DataVec

Josh Patterson

Smart Data Conference: DL4J and DataVec

Josh Patterson

Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...

Simplilearn

Deep Learning covers all the essential Deep Learning frameworks that are necessary to build AI models. In this presentation, you will learn about the development of essential frameworks such as TensorFlow, Keras, PyTorch, Theano, etc. You will also understand the programming languages used to build the frameworks, the different companies that use these frameworks, the characteristics of these Deep Learning frameworks, and type of models that were built using these frameworks. Now, let us get started with understanding the different popular Deep Learning frameworks being used in industries. Below are the different Deep Learning frameworks we'll be discussing in this presentation: 1. TensorFlow 2. Keras 3. PyTorch 4. Theano 5. Deep Learning 4 Java 6. Caffe 7. Chainer 8. Microsoft CNTK Why Deep Learning? It is one of the most popular software platforms used for deep learning and contains powerful tools to help you build and implement artificial neural networks. Advancements in deep learning are being seen in smartphone applications, creating efficiencies in the power grid, driving advancements in healthcare, improving agricultural yields, and helping us find solutions to climate change. With this Tensorflow course, you’ll build expertise in deep learning models, learn to operate TensorFlow to manage neural networks and interpret the results. And according to payscale.com, the median salary for engineers with deep learning skills tops $120,000 per year. You can gain in-depth knowledge of Deep Learning by taking our Deep Learning certification training course. With Simplilearn’s Deep Learning course, you will prepare for a career as a Deep Learning engineer as you master concepts and techniques including supervised and unsupervised learning, mathematical and heuristic aspects, and hands-on modeling to develop algorithms. Those who complete the course will be able to: 1. Understand the concepts of TensorFlow, its main functions, operations, and the execution pipeline 2. Implement deep learning algorithms, understand neural networks and traverse the layers of data abstraction which will empower you to understand data like never before 3. Master and comprehend advanced topics such as convolutional neural networks, recurrent neural networks, training deep networks and high-level interfaces 4. Build deep learning models in TensorFlow and interpret the results 5. Understand the language and fundamental concepts of artificial neural networks 6. Troubleshoot and improve deep learning models 7. Build your own deep learning project 8. Differentiate between machine learning, deep learning, and artificial intelligence Learn more at https://www.simplilearn.com/deep-learning-course-with-tensorflow-training

Deep Learning and Recurrent Neural Networks in the Enterprise

Josh Patterson

Deep learning with DL4J - Hadoop Summit 2015

Josh Patterson

Large Scale Processing of Unstructured Text

DataWorks Summit

Natural Language Processing (NLP) practitioners often have to deal with analyzing large corpora of unstructured documents and this is often a tedious process. Python tools like NLTK do not scale to large production data sets and cannot be plugged into a distributed scalable framework like Apache Spark or Apache Flink. The Apache OpenNLP library is a popular machine learning based toolkit for processing unstructured text. Combining a permissive licence, a easy-to-use API and set of components which are highly customize and trainable to achieve a very high accuracy on a particular dataset. Built-in evaluation allows to measure and tune OpenNLP’s performance for the documents that need to be processed. From sentence detection and tokenization to parsing and named entity finder, Apache OpenNLP has the tools to address all tasks in a natural language processing workflow. It applies Machine Learning algorithms such as Perceptron and Maxent, combined with tools such as word2vec to achieve state of the art results. In this talk, we’ll be seeing a demo of large scale Name Entity extraction and Text classification using the various Apache OpenNLP components wrapped into Apache Flink stream processing pipeline and as an Apache NiFI processor. NLP practitioners will come away from this talk with a better understanding of how the various Apache OpenNLP components can help in processing large reams of unstructured data using a highly scalable and distributed framework like Apache Spark/Apache Flink/Apache NiFi.

How to Build Deep Learning Models

Josh Patterson

Hands on image recognition with scala spark and deep learning4j

Guglielmo Iozzia

sparklyr - Jeff Allen

Sri Ambati

Storm presentation

Shyam Raj

Geoalchemy

Camptocamp

Theme: Development: presentation is focused on a specific technology, demonstrating either a new product or new developments in an existing product. GeoAlchemy is a powerful toolkit to use SQL spatial databases from Python. GeoAlchemy helps you use spatial databases from Python. GeoAlchemy provides extensions to SQLAlchemy, the Python SQL toolkit and ORM. GeoAlchemy builds on SQLAlchemy's extreme flexibility, and can be used for different types of applications, from simple scripts to complex web applications. In this talk we will present GeoAlchemy and SQLAlchemy. We will describe when and how SQLAlchemy and GeoAlchemy can be useful. We will demonstrate the power and flexibility of the tools. We will also present the new version of GeoAlchemy, namely GeoAlchemy 2. GeoAlchemy 2 enables leveraging PostGIS' new features. For example, GeoAlchemy 2 supports PostGIS's new raster type. Finally, we will demonstrate how GeoAlchemy integrates with other well-known Python tools, such as Shapely.

Sparklife - Life In The Trenches With Spark

Ian Pointer

What's hot

Fast and Scalable Python

Travis Oliphant

Snorkel: Dark Data and Machine Learning with Christopher Ré

Jen Aman

Georgia Tech cse6242 - Intro to Deep Learning and DL4J

Josh Patterson

Spark-Streaming-as-a-Service with Kafka and YARN: Spark Summit East talk by J...

Spark Summit

Deep Learning Intro - Georgia Tech - CSE6242 - March 2015

Josh Patterson

Data science lifecycle with Apache Zeppelin

DataWorks Summit/Hadoop Summit

Hadoop Summit 2014 - San Jose - Introduction to Deep Learning on Hadoop

Josh Patterson

Pyspark vs Spark Let's Unravel the Bond!

ankitbhandari32

Hadoop summit 2016

Adam Gibson

Apache Spark and Apache Ignite: Where Fast Data Meets the IoT with Denis Magda

Databricks

Deep Learning: DL4J and DataVec

Josh Patterson

Smart Data Conference: DL4J and DataVec

Josh Patterson

Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...

Simplilearn

Deep Learning and Recurrent Neural Networks in the Enterprise

Josh Patterson

Deep learning with DL4J - Hadoop Summit 2015

Josh Patterson

Large Scale Processing of Unstructured Text

DataWorks Summit

How to Build Deep Learning Models

Josh Patterson

Hands on image recognition with scala spark and deep learning4j

Guglielmo Iozzia

sparklyr - Jeff Allen

Sri Ambati

Storm presentation

Shyam Raj

What's hot (20)

Fast and Scalable Python

Snorkel: Dark Data and Machine Learning with Christopher Ré

Georgia Tech cse6242 - Intro to Deep Learning and DL4J

Spark-Streaming-as-a-Service with Kafka and YARN: Spark Summit East talk by J...

Deep Learning Intro - Georgia Tech - CSE6242 - March 2015

Data science lifecycle with Apache Zeppelin

Hadoop Summit 2014 - San Jose - Introduction to Deep Learning on Hadoop

Pyspark vs Spark Let's Unravel the Bond!

Hadoop summit 2016

Apache Spark and Apache Ignite: Where Fast Data Meets the IoT with Denis Magda

Deep Learning: DL4J and DataVec

Smart Data Conference: DL4J and DataVec

Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...

Deep Learning and Recurrent Neural Networks in the Enterprise

Deep learning with DL4J - Hadoop Summit 2015

Large Scale Processing of Unstructured Text

How to Build Deep Learning Models

Hands on image recognition with scala spark and deep learning4j

sparklyr - Jeff Allen

Storm presentation

Similar to Apache Toree

Geoalchemy

Camptocamp

Sparklife - Life In The Trenches With Spark

Ian Pointer

Pharo Status

Jannik Laval

Microservices and Teraflops: Effortlessly Scaling Data Science with PyWren wi...

Databricks

While systems like Apache Spark have moved beyond a simple map-reduce model, many data scientists and scientific users still struggle with complex cluster management and configuration tools when trying to do data processing in the cloud. Recently, cloud providers have offered infrastructure such as AWS Lambda to run event-driven, stateless functions as micro-services. In this model, a function is deployed once and is invoked repeatedly whenever new inputs arrive and elastically scales with input size. In this session, the speakers claim that microservices on serverless infrastructure present a viable platform for eliminating cluster management overhead and fulfilling the promise of elasticity in cloud computing for all users. Their key insight is that they can dynamically inject code into these stateless functions and, combined with remote storage, they can build a data processing system that inherits the elasticity of the serverless model while addressing the simplicity required by end users. Using PyWren, their implementation on AWS Lambda, they show that this model is general enough to implement a number of distributed computing models, such as BSP, efficiently. Learn about a number of scientific and machine learning applications that they have built with PyWren, and how this model could be used to develop a serverless-Spark in the future.

Converging Big Data and Application Infrastructure by Steven Poutsy

Big Data Spain

Spark: The Good, the Bad, and the Ugly

Sarah Guido

Given at Data Day Texas 2016. Apache Spark has been hailed as a trail-blazing new tool for doing distributed data science. However, since it's so new, it can be difficult to set up and hard to use. In this talk, I'll discuss the journey I've had using Spark for data science at Bitly over the past year. I'll talk about the benefits of using Spark, the challenges I've had to overcome, the caveats for using a cutting-edge technology such as this, and my hopes for the Spark project as a whole.

Machine learning in Apache Zeppelin

Gary Sieling

Le PERL est mort

apeiron

Neural Networks, Spark MLlib, Deep Learning

Asim Jalis

A Jupyter kernel for Scala and Apache Spark.pdf

Luciano Resende

Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed that enables data scientists and data engineers to easily connect and leverage Apache Spark and its powerful APIs from a standard Jupyter notebook to execute their analytics workloads. In this talk, we will go over what's new with the most recent Apache Toree release. We will cover available magics and visualizations extensions that can be integrated with Toree to enable better data exploration and data visualizations. We will also describe some high-level designs of Toree and how users can extend the functionality of Apache Toree powerful plugin system. And all of these with multiple live demos that demonstrate how Toree can help with your analytics workloads in an Apache Spark environment.

First steps with Data Science

Igor Leroy

OSDC 2018 | The Computer science behind a modern distributed data store by Ma...

NETWAYS

What we see in the modern data store world is a race between different approaches to achieve a distributed and resilient storage of data. Most applications need a stateful layer which holds the data. There are at least three necessary ingredients which are everything else than trivial to combine and of course even more challenging when heading for an acceptable performance. Over the past years there has been significant progress in respect in both the science and practical implementations of such data stores. In his talk Max Neunhoeffer will introduce the audience to some of the needed ingredients, address the difficulties of their interplay and show four modern approaches of distributed open-source data stores. Topics are: – Challenges in developing a distributed, resilient data store – Consensus, distributed transactions, distributed query optimization and execution – The inner workings of ArangoDB, Cassandra, Cockroach and RethinkDB The talk will touch complex and difficult computer science, but will at the same time be accessible to and enjoyable by a wide range of developers.

OpenStack: A python based IaaS provider

Flavio Percoco Premoli

OpenStack is an IaaS provider software written in Python. As such, it provides a massive scalable operating system and services like: Image, Storage, Object, Compute, etc. This talks aims to give the audience an overview about OpenStack, its capabilities, its modules, coding styles, workflow and organization. As a successful community driven development case, it’s definitely a good reference for anyone willing to take that road or maybe joining existing projects.

Python in 15 minutes

Rodolfo Carvalho

refORM: Death to ORMs in .NETJames Hughes

Making the big data ecosystem work together with Python & Apache Arrow, Apach...

Holden Karau

Making the big data ecosystem work together with python apache arrow, spark,...

Holden Karau

The computer science behind a modern disributed data store

J On The Beach

What we see in the modern data store world is a race between different approaches to achieve a distributed and resilient storage of data. Every application needs a stateful layer which holds the data. There are at least three necessary components which are everything else than trivial to combine, and, of course, even more challenging when heading for an acceptable performance. Over the past years there has been significant progress in both the science and practical implementations of such data stores. In his talk Max Neunhoeffer will introduce the audience to some of the needed ingredients, address the difficulties of their interplay and show four modern approaches of distributed open-source data stores (ArangoDB, Cassandra, Cockroach and RethinkDB).

开源沙龙第一期 Python introfantasy zheng

Jeremy Nixon, Machine Learning Engineer, Spark Technology Center at MLconf AT...

MLconf

Convolutional Neural Networks at scale in Spark MLlib: Jeremy Nixon will focus on the engineering and applications of a new algorithm built on top of MLlib. The presentation will focus on the methods the algorithm uses to automatically generate features to capture nonlinear structure in data, as well as the process by which it’s trained. Major aspects of that include compositional transformations over the data, convolution, and distributed backpropagation via SGD with adaptive gradients and an adaptive learning rate. Applications will look into how to use convolutional neural networks to model data in computer vision, natural language and signal processing. Details around optimal preprocessing, the type of structure that can be learned, and managing its ability to generalize will inform developers looking to apply nonlinear modeling tools to problems that they face.

Similar to Apache Toree (20)

Geoalchemy

Sparklife - Life In The Trenches With Spark

Pharo Status

Microservices and Teraflops: Effortlessly Scaling Data Science with PyWren wi...

Converging Big Data and Application Infrastructure by Steven Poutsy

Spark: The Good, the Bad, and the Ugly

Machine learning in Apache Zeppelin

Le PERL est mort

Neural Networks, Spark MLlib, Deep Learning

A Jupyter kernel for Scala and Apache Spark.pdf

First steps with Data Science

OSDC 2018 | The Computer science behind a modern distributed data store by Ma...

OpenStack: A python based IaaS provider

Python in 15 minutes

refORM: Death to ORMs in .NET

Making the big data ecosystem work together with Python & Apache Arrow, Apach...

Making the big data ecosystem work together with python apache arrow, spark,...

The computer science behind a modern disributed data store

开源沙龙第一期 Python intro

Jeremy Nixon, Machine Learning Engineer, Spark Technology Center at MLconf AT...

Recently uploaded

一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单

ewymefz

UofM毕业证【微信95270640】办文凭{明尼苏达大学毕业证}Q微Q微信95270640UofM毕业证书成绩单/学历认证UofM Diploma未毕业、挂科怎么办？+QQ微信：Q微信95270640-大学Offer（申请大学）、成绩单（申请考研）、语言证书、在读证明、使馆公证、办真实留信网认证、真实大使馆认证、学历认证办国外明尼苏达大学明尼苏达大学毕业证假文凭教育部学历学位认证留信认证大使馆认证留学回国人员证明修改成绩单信封申请学校offer录取通知书在读证明offer letter。快速办理高仿国外毕业证成绩单： 1明尼苏达大学毕业证+成绩单+留学回国人员证明+教育部学历认证（全套留学回国必备证明材料给父母及亲朋好友一份完美交代）; 2雅思成绩单托福成绩单OFFER在读证明等留学相关材料（申请学校转学甚至是申请工签都可以用到）。 3.毕业证 #成绩单等全套材料从防伪到印刷从水印到钢印烫金高精仿度跟学校原版100%相同。专业服务请勿犹豫联系我！联系人微信号：95270640诚招代理：本公司诚聘当地代理人员如果你有业余时间有兴趣就请联系我们。国外明尼苏达大学明尼苏达大学毕业证假文凭办理过程： 1客户提供办理信息：姓名生日专业学位毕业时间等（如信息不确定可以咨询顾问：我们有专业老师帮你查询）； 2开始安排制作毕业证成绩单电子图； 3毕业证成绩单电子版做好以后发送给您确认； 4毕业证成绩单电子版您确认信息无误之后安排制作成品； 5成品做好拍照或者视频给您确认； 6快递给客户（国内顺丰国外DHLUPS等快读邮寄）。有一次山娃坐在门口写作业写着写着竟伏在桌上睡着了迷迷糊糊中山娃似乎听到了父亲的脚步声当他晃晃悠悠站起来时才诧然发现一位衣衫破旧的妇女挎着一只硕大的蛇皮袋手里拎着长铁钩正站在门口朝黑色的屋内张望不好坏人小偷山娃一怔却也灵机一动立马仰起头双手拢在嘴边朝楼上大喊：“爸爸爸——有人找——那人一听朝山娃尴尬地笑笑悻悻地走了山娃立马“嘭的一声将铁门锁死心却咚咚地乱跳当山娃跟父亲说起这事时父亲很吃惊抚摸着山娃母

Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...

pchutichetpong

M Capital Group (“MCG”) expects to see demand and the changing evolution of supply, facilitated through institutional investment rotation out of offices and into work from home (“WFH”), while the ever-expanding need for data storage as global internet usage expands, with experts predicting 5.3 billion users by 2023. These market factors will be underpinned by technological changes, such as progressing cloud services and edge sites, allowing the industry to see strong expected annual growth of 13% over the next 4 years. Whilst competitive headwinds remain, represented through the recent second bankruptcy filing of Sungard, which blames “COVID-19 and other macroeconomic trends including delayed customer spending decisions, insourcing and reductions in IT spending, energy inflation and reduction in demand for certain services”, the industry has seen key adjustments, where MCG believes that engineering cost management and technological innovation will be paramount to success. MCG reports that the more favorable market conditions expected over the next few years, helped by the winding down of pandemic restrictions and a hybrid working environment will be driving market momentum forward. The continuous injection of capital by alternative investment firms, as well as the growing infrastructural investment from cloud service providers and social media companies, whose revenues are expected to grow over 3.6x larger by value in 2026, will likely help propel center provision and innovation. These factors paint a promising picture for the industry players that offset rising input costs and adapt to new technologies. According to M Capital Group: “Specifically, the long-term cost-saving opportunities available from the rise of remote managing will likely aid value growth for the industry. Through margin optimization and further availability of capital for reinvestment, strong players will maintain their competitive foothold, while weaker players exit the market to balance supply and demand.”

Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...

Subhajit Sahu

Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.

Malana- Gimlet Market Analysis (Portfolio 2)

TravisMalana

哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样

axoqas

原版定制【Q微信:741003700】《(usq毕业证书)南昆士兰大学毕业证研究生文凭证书》【Q微信:741003700】成绩单、雅思、外壳、留信学历认证永久存档查询，采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。【业务选择办理准则】一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【Q微信741003700】文凭即可二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信741003700】即可三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才【关于价格问题（保证一手价格）】我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...

Timothy Spann

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI Discussion on Vector Databases, Unstructured Data and AI https://www.meetup.com/unstructured-data-meetup-new-york/ This meetup is for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs.This meetup was formerly Milvus Meetup, and is sponsored by Zilliz maintainers of Milvus.

原版制作(swinburne毕业证书)斯威本科技大学毕业证毕业完成信一模一样

u86oixdj

学校原件一模一样【微信：741003700 】《(swinburne毕业证书)斯威本科技大学毕业证》【微信：741003700 】学位证，留信认证（真实可查，永久存档）原件一模一样纸张工艺/offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。本公司拥有海外各大学样板无数，能完美还原。 1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700 【主营项目】一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！二.真实使馆公证(即留学回国人员证明,不成功不收费) 三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度) 如果您处于以下几种情况： ◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】 ◇面对父母的压力，希望尽快拿到； ◇不清楚认证流程以及材料该如何准备； ◇回国时间很长，忘记办理； ◇回国马上就要找工作，办给用人单位看； ◇企事业单位必须要求办理的 ◇需要报考公务员、购买免税车、落转户口 ◇申请留学生创业基金留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才

Machine learning and optimization techniques for electrical drives.pptx

balafet

Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...

John Andrews

SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation" Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults Description: Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project. Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas

【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】

NABLAS株式会社

一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理

oz8q3jxlp

原版定制【微信:41543339】【(Deakin毕业证书)迪肯大学毕业证】【微信:41543339】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】【业务选择办理准则】一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才留信网服务项目： 1、留学生专业人才库服务（留信分析） 2、国（境）学习人员提供就业推荐信服务 3、留学人员区块链存储服务 → 【关于价格问题（保证一手价格）】我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！

The Building Blocks of QuestDB, a Time Series Database

javier ramirez

Talk Delivered at Valencia Codes Meetup 2024-06. Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds. It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.

The affect of service quality and online reviews on customer loyalty in the E...

jerlynmaetalle

一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理

74nqk8xf

毕业原版【微信:41543339】【(Coventry毕业证书)考文垂大学毕业证】【微信:41543339】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】【业务选择办理准则】一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才留信网服务项目： 1、留学生专业人才库服务（留信分析） 2、国（境）学习人员提供就业推荐信服务 3、留学人员区块链存储服务 → 【关于价格问题（保证一手价格）】我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！

Ch03-Managing the Object-Oriented Information Systems Project a.pdf

haila53

Criminal IP - Threat Hunting Webinar.pdf

Criminal IP

一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理

slg6lamcq

原版定制【微信:41543339】【(Adelaide毕业证书)阿德莱德大学毕业证】【微信:41543339】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】【业务选择办理准则】一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才留信网服务项目： 1、留学生专业人才库服务（留信分析） 2、国（境）学习人员提供就业推荐信服务 3、留学人员区块链存储服务 → 【关于价格问题（保证一手价格）】我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...

Timothy Spann

Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx

AnirbanRoy608946

Criminal IP - Threat Hunting Webinar.pdf

Criminal IP

Recently uploaded (20)

一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单

Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...

Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...

Malana- Gimlet Market Analysis (Portfolio 2)

哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...

原版制作(swinburne毕业证书)斯威本科技大学毕业证毕业完成信一模一样

Machine learning and optimization techniques for electrical drives.pptx

Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...

【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】

一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理

The Building Blocks of QuestDB, a Time Series Database

The affect of service quality and online reviews on customer loyalty in the E...

一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理

Ch03-Managing the Object-Oriented Information Systems Project a.pdf

Criminal IP - Threat Hunting Webinar.pdf

一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...

Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx

Criminal IP - Threat Hunting Webinar.pdf

Apache Toree

1. APACHE TOREE ASIM JALIS GALVANIZE

2. INTRO

3. ASIM JALIS Galvanize/Zipfian, Data Engineering Cloudera, Microso!, Salesforce MS in Computer Science from University of Virginia

4. WHAT IS GALVANIZE’S DATA ENGINEERING IMMERSIVE? Immersive Peer Learning Environment Master High-Demand Skills and Technologies Heart of San Francisco in SOMA

5. YOU GET TO . . . Play with Terabytes of Data Spark, Hadoop, Hive, Kafka, Storm, HBase Data Science at Scale Level UP your Career

7. FOR MORE INFORMATION asim.jalis@galvanize.com http://galvanize.com

8. TALK OVERVIEW

9. WHAT IS THIS TALK ABOUT? What is Apache Toree? How can I create IPython/Jupyter notebooks for Spark/Scala?

10. HOW MANY PEOPLE HERE ARE FAMILIAR WITH IPYTHON/JUPYTER NOTEBOOKS?

11. HOW MANY PEOPLE HERE ARE FAMILIAR WITH APACHE SPARK?

12. HOW MANY PEOPLE HERE ARE FAMILIAR WITH SCALA?

13. LITERATE PROGRAMMING

14. WHAT IS LITERATE PROGRAMMING? Proposed by Don Knuth Write programs for humans, not machines Programs communicate ideas to others Default text is documentation or thoughts Code is explicitly marked out

15. LITERATE PROGRAM This program prints hello world. <<hello.c>>= <<includes>> <<main>> @ Some includes. <<includes>>= #include <stdio.h> @ Print hello world, then exit. <<main>>= int main(int argc, char *argv[]) { printf("Hello World!n"); return 0; } @

16. WHAT PROBLEM DOES JUPYTER SOLVE? Suppose you want to share programming idea or tutorial You write an article and embed code in it Now imagine being able to execute the code in the article

17. HOW IS THIS DIFFERENT FROM CODE COMMENTS? Commented code is not technical literature It cannot be published or read as an article A literate program is an executable article

18. JUPYTER/IPYTHON

19. WHAT IS JUPYTER? Create executable documents Originally for Python Supports other systems through kernels

20. JUPYTER DEMO Write Markdown text Write Scala Spark code Execute Repeat Tab-completion

21. JUPYTER ARCH

22. JUPYTER ARCH Jupyter server Displays notebook in browser Executes code on Python runtime Displays output back into notebook

23. FERNANDO PÉREZ IPython/Jupyter inventor Particle Physics PhD, University of Colorado— Boulder Now at UC Berkeley Started IPython in 2001

24. IS IT IPYTHON OR JUPYTER? Started out as IPython notebook Not specific to Python Can work with Scala and other languages Jupyter captures its language independence

25. APACHE TOREE

26. WHAT IS TOREE? Toree is a Jupyter Kernel Executes Scala Runs Spark Driver/Context

27. HOW DOES TOREE WORK?

28. TOREE ARCHITECTURE Jupyter Server talks to Toree Kernel Toree Kernel talks to Spark Driver Spark Driver talks to Spark Executors

29. HOW IS TOREE DIFFERENT FROM ZEPPELIN Toree compliant with Jupyter protocol Toree is easy to install and use Zeppelin does not use Jupyter protocol Zeppelin wants to be a platform like Jupyter

30. TOREE COMMITS Lot of activity last year Stabilizing

31. WHO WROTE TOREE? Top 2 contributors responsible for 50% of commits chipsenkbeil has 318 commits Lull3rSkat3r has 72 commits

32. ROBERT “CHIP” SENKBEIL AND COREY STUBBS

33. WHY IS IT CALLED TOREE? Nothing special about the name. Some people in the group and just picked it out. Some facts though, it is a purposeful misspelling of the the Japanese word torii. A torrii is a traditional gate for Shinto shrines in Japan. —Corey Stubbs (personal email)

34. ACTUAL TORII

35. TOREE HANDS-ON DEMO

36. WHAT WE WILL COVER How to install Toree How to automatically pull Java libraries in your notebook How to publish notebooks on How to turn notebooks into slide shows http://nbviewer.jupyter.org/

37. QUICKSTART TUTORIAL For details on how to do all these things See https://github.com/asimjalis/apache-toree-quickstart

38. CONCLUSION

39. REFERENCES Apache Toree Quickstart Tutorial https://github.com/asimjalis/apache-toree-quickstart Apache Toree on GitHub https://github.com/apache/incubator-toree Apache Toree Home https://toree.incubator.apache.org/

40. QUESTIONS

Apache Toree

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Apache Toree

Similar to Apache Toree (20)

Recently uploaded

Recently uploaded (20)

Apache Toree