SlideShare a Scribd company logo
Azure Notebooks
Jupyter For The Cloud
WELCOME
Cameron Vetter
I have 20 years of experience using Microsoft tools and technologies to develop
software. I have experience in many roles including Development, Architecture,
Infrastructure, Management, and Leadership roles. I've worked for some of the largest
companies in the world and for small local companies getting a breadth of experience
in different Corporate Cultures. Currently, I work at SafeNet Consulting, where I get to
do what I love... Architect, Design, and Develop great software! I currently focus on
Microservices, SOA, Azure, Cognitive Toolkit, and Kubernetes.
Principal Cloud Consultant
A Partner to Advise and Support
About SafeNet
Consulting
SafeNet specializes in being partners in your
success. We currently focus on Custom Application
Development, Cloud Consulting Services,
Data & Analytics, and User Experience Strategy.
Introduction
What is Jupyter?
What is Azure Notebooks?
Intro to the Example
Code, Execution & Markdown
Data Visualization
Where does this tool fit?
Question & Answer
Agenda
What is Jupyter?
The Jupyter Notebook is an open-source web
application that allows you to create and share
documents that contain live code, equations,
visualizations and narrative text.
Uses include: data cleaning and transformation,
numerical simulation, statistical modeling, data
visualization, machine learning, and much more.
Jupyter Notebook
jupyter.org
Share Notebooks
Notebooks can be shared with others using
email, Dropbox, GitHub and the Jupyter Notebook
Viewer.
Interactive Output
Your code can produce rich, interactive output:
HTML, images, videos, LaTeX, and custom MIME
types.
Big Data Integration
Leverage big data tools, such as Apache Spark, from
Python, R and Scala. Explore that same data with pandas,
scikit-learn, ggplot2, TensorFlow
Use Your Language of Choice
Jupyter has support for over 40
programming languages, including Python,
R, Julia, and Scala.
Data powers Netflix. It permeates our thoughts, informs our decisions,
and challenges our assumptions. It fuels experimentation and innovation
at unprecedented scale. Our 100 Petabytes of data helps us discover
fantastic content and deliver personalized experiences for our 130 million
members around the world.
-- Netflix Blog
Industry
Example
Jupyter adoption hits critical mass
with Netflix Data Scientists.
Data Scientist Adoption
Data Engineers began work to
elevate notebooks from a niche tool
to a first-class citizen at Netflix for
data consumption.
Developers Take Notice
All user types rapidly adopt because
of the versatility, power, and ease of
use
Organic Adoption
Today Jupyter Notebooks is the most
popular platform for data
consumption at Netflix.
Jupyter Notebooks
Data Access at Netflix
/ Use Case /
Source: https://bit.ly/netflixjupyter/
What is Azure Notebooks?
Azure
Notebooks
Useful for any workspace
Perfect for data scientists, developers, students,
or anyone. Develop and run code in your
browser regardless of industry or skillset.
Multiple language support
Supporting more languages than any other
platform including Python 2, Python 3, R, and
F#.
Microsoft Azure Cloud Services
Created by Microsoft Azure: Always accessible,
always available from any browser, anywhere in
the world.
Source: https://notebooks.azure.com/
What’s the Big Deal?
/ With Jupyter in Azure /
Create an account and you are up and running!
Give read only access to anyone via a link or
Download a copy of the IPYNB file to share.
It is easy to attach an Azure Notebook to a DSVM
for more power!
Integrate easily with GitHub, Clone to your own
Notebook, Cloud based Storage and Backups
No Install
Needed
Share
Anywhere
Cloud
Compute
Cloud
Features
Intro to the Example
The Example
This example is presented in Jupyter
bringing a human readable quality that is
missing in my workshop.
Different Angle
This example is content borrowed from
my full day workshop.
Workshop
I’m focusing on Jupyter not the code, I
will highlight a couple things in code, but
we will focus on Azure Notebooks.
Don’t Focus on the Code
Region
An ANN that predicts if a sales
lead will be a WIN or a LOSS
Client Size
Route to Market
Days in Sales Stage
Etc…
Sales Prediction
/ Will you make the sale? /
Deal Size
Code, Execution, and Markdown
A collection of extensions that add
functionality to the Jupyter notebook.
These extensions are mostly written in
JavaScript and will be loaded locally in
your browser.
Jupyter Notebook
Extensions
Source: https://github.com/ipython-contrib/jupyter_contrib_nbextensions
Collapsible Headings
Allows notebook to have collapsible sections,
separated by headings.
Notify
Jupyter notebook extension to display a web
notification to notify you when the kernel becomes
idle. This can be useful when running tasks that
take more than a couple of seconds to complete.
Lab 2
Let’s Look at
Notebooks!
TAKE NOTE:
• Examine Extensions
• Markdown and code mixed
• Results in line after the execution
• The Data Frame is rendered pretty
Markdown
/ Adding the pretty to your Notebooks /
• Standard Markdown
• Feel free to blend HTML like I did
• Check out this cheat sheet:
https://www.ibm.com/support/knowledgecenter/SSQNUZ_current/com.i
bm.icpdata.doc/dsx/markd-jupyter.html
Data Visualization
Lab 3, 4, 5
More
Notebooks!
TAKE NOTE:
• More pretty rendering
• In line Graph using matplotlib
• Array rendering not so pretty
• In Line Graph using Seaborn
01 / MatPlotLib 02 / Seaborn
Graphing Libraries
/ Visualizing data in Jupyter /
Lab 6
Even More
Notebooks!
TAKE NOTE:
• Training is very long running
• Used Matplotlib to plot the training results
Where Does This Tool Fit?
Long Running Tasks
Jupyter gracefully handles long running tasks, but is
not an ideal environment.
Data Management
Most of your projects will have associated data
sets, but where do you manage them and how do
you make them portable?
Writing Code
A lot of our IDE expectations are not met by
Jupyter, making it not the best place to write code
Weaknesses
Lab 7 + 8
Don’t Do This!
TAKE NOTE:
• Jupyter is a poor fit for a grid search
• Jupyter renders lab 8 output poorly
Developers
Jupyter give developers a sand box to work in
especially when shaping data, and allows them to
understand the work of data scientists
Data Scientists
Jupyter fits the workflow of a data scientist
allowing them to codify their work in a
presentation style that shares both the how and
the why
www.cameronvetter.com
Any Questions?
@poshporcupine Linkedin.com/in/cameronvetter

More Related Content

Similar to Azure Notebooks - Jupyter for the Cloud

DevOps for Data Scientists - Stefano Tucci
DevOps for Data Scientists - Stefano TucciDevOps for Data Scientists - Stefano Tucci
DevOps for Data Scientists - Stefano Tucci
Stefano Tucci
 
.NET per la Data Science e oltre
.NET per la Data Science e oltre.NET per la Data Science e oltre
.NET per la Data Science e oltre
Marco Parenzan
 
Databricks for Dummies
Databricks for DummiesDatabricks for Dummies
Databricks for Dummies
Rodney Joyce
 
Python Developer Toolbox
Python Developer ToolboxPython Developer Toolbox
Python Developer Toolbox
Nick Landry
 
Deploying deep learning models with Docker and Kubernetes
Deploying deep learning models with Docker and KubernetesDeploying deep learning models with Docker and Kubernetes
Deploying deep learning models with Docker and Kubernetes
PetteriTeikariPhD
 
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
Demi Ben-Ari
 
Puppeteer : Is it time to ditch Selenium?
Puppeteer : Is it time to ditch Selenium?Puppeteer : Is it time to ditch Selenium?
Puppeteer : Is it time to ditch Selenium?
Mindfire LLC
 
AI at Microsoft for HEC
AI at Microsoft for HECAI at Microsoft for HEC
AI at Microsoft for HEC
Alex Danvy
 
TechRadarCon 2022 | Have you built your platform yet ?
TechRadarCon 2022 | Have you built your platform yet ?TechRadarCon 2022 | Have you built your platform yet ?
TechRadarCon 2022 | Have you built your platform yet ?
Haggai Philip Zagury
 
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
Tour de France Azure PaaS 6/7 Ajouter de l'intelligenceTour de France Azure PaaS 6/7 Ajouter de l'intelligence
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
Alex Danvy
 
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
Naoki (Neo) SATO
 
[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure
Korkrid Akepanidtaworn
 
Machine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlowMachine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlow
Aditya Bhattacharya
 
Integrating Machine Learning Capabilities into your team
Integrating Machine Learning Capabilities into your teamIntegrating Machine Learning Capabilities into your team
Integrating Machine Learning Capabilities into your team
Cameron Vetter
 
The Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
The Superhero’s Method of Modern HTML5 Development by RapidValue SolutionsThe Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
The Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
RapidValue
 
Machine Learning and AI
Machine Learning and AIMachine Learning and AI
Machine Learning and AI
James Serra
 
Introduction to Microsoft’s Hadoop solution (HDInsight)
Introduction to Microsoft’s Hadoop solution (HDInsight)Introduction to Microsoft’s Hadoop solution (HDInsight)
Introduction to Microsoft’s Hadoop solution (HDInsight)
James Serra
 
Inspire Creativity with Immersive Learning Experiences
Inspire Creativity with Immersive Learning ExperiencesInspire Creativity with Immersive Learning Experiences
Inspire Creativity with Immersive Learning Experiences
HP
 
Deploy multi-environment application with Azure DevOps
Deploy multi-environment application with Azure DevOpsDeploy multi-environment application with Azure DevOps
Deploy multi-environment application with Azure DevOps
Andrea Tosato
 
DevOps lagos meetup
DevOps lagos meetupDevOps lagos meetup
DevOps lagos meetup
Ewere Diagboya
 

Similar to Azure Notebooks - Jupyter for the Cloud (20)

DevOps for Data Scientists - Stefano Tucci
DevOps for Data Scientists - Stefano TucciDevOps for Data Scientists - Stefano Tucci
DevOps for Data Scientists - Stefano Tucci
 
.NET per la Data Science e oltre
.NET per la Data Science e oltre.NET per la Data Science e oltre
.NET per la Data Science e oltre
 
Databricks for Dummies
Databricks for DummiesDatabricks for Dummies
Databricks for Dummies
 
Python Developer Toolbox
Python Developer ToolboxPython Developer Toolbox
Python Developer Toolbox
 
Deploying deep learning models with Docker and Kubernetes
Deploying deep learning models with Docker and KubernetesDeploying deep learning models with Docker and Kubernetes
Deploying deep learning models with Docker and Kubernetes
 
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...
 
Puppeteer : Is it time to ditch Selenium?
Puppeteer : Is it time to ditch Selenium?Puppeteer : Is it time to ditch Selenium?
Puppeteer : Is it time to ditch Selenium?
 
AI at Microsoft for HEC
AI at Microsoft for HECAI at Microsoft for HEC
AI at Microsoft for HEC
 
TechRadarCon 2022 | Have you built your platform yet ?
TechRadarCon 2022 | Have you built your platform yet ?TechRadarCon 2022 | Have you built your platform yet ?
TechRadarCon 2022 | Have you built your platform yet ?
 
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
Tour de France Azure PaaS 6/7 Ajouter de l'intelligenceTour de France Azure PaaS 6/7 Ajouter de l'intelligence
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
 
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight
 
[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure
 
Machine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlowMachine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlow
 
Integrating Machine Learning Capabilities into your team
Integrating Machine Learning Capabilities into your teamIntegrating Machine Learning Capabilities into your team
Integrating Machine Learning Capabilities into your team
 
The Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
The Superhero’s Method of Modern HTML5 Development by RapidValue SolutionsThe Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
The Superhero’s Method of Modern HTML5 Development by RapidValue Solutions
 
Machine Learning and AI
Machine Learning and AIMachine Learning and AI
Machine Learning and AI
 
Introduction to Microsoft’s Hadoop solution (HDInsight)
Introduction to Microsoft’s Hadoop solution (HDInsight)Introduction to Microsoft’s Hadoop solution (HDInsight)
Introduction to Microsoft’s Hadoop solution (HDInsight)
 
Inspire Creativity with Immersive Learning Experiences
Inspire Creativity with Immersive Learning ExperiencesInspire Creativity with Immersive Learning Experiences
Inspire Creativity with Immersive Learning Experiences
 
Deploy multi-environment application with Azure DevOps
Deploy multi-environment application with Azure DevOpsDeploy multi-environment application with Azure DevOps
Deploy multi-environment application with Azure DevOps
 
DevOps lagos meetup
DevOps lagos meetupDevOps lagos meetup
DevOps lagos meetup
 

More from Cameron Vetter

Why do most machine learning projects never make it to production
Why do most machine learning projects never make it to productionWhy do most machine learning projects never make it to production
Why do most machine learning projects never make it to production
Cameron Vetter
 
Ml.net machine learning for .net developers!
Ml.net machine learning for .net developers!Ml.net machine learning for .net developers!
Ml.net machine learning for .net developers!
Cameron Vetter
 
Cloud First Architecture
Cloud First ArchitectureCloud First Architecture
Cloud First Architecture
Cameron Vetter
 
Mixed reality the second generation is all about ux
Mixed reality   the second generation is all about uxMixed reality   the second generation is all about ux
Mixed reality the second generation is all about ux
Cameron Vetter
 
An Introduction to Artificial Neural Networks
An Introduction to Artificial Neural NetworksAn Introduction to Artificial Neural Networks
An Introduction to Artificial Neural Networks
Cameron Vetter
 
Azure Batch AI for Neural Networks
Azure Batch AI for Neural Networks Azure Batch AI for Neural Networks
Azure Batch AI for Neural Networks
Cameron Vetter
 
Using a Service Bus for Microservice Communication
Using a Service Bus for Microservice CommunicationUsing a Service Bus for Microservice Communication
Using a Service Bus for Microservice Communication
Cameron Vetter
 
Augmented reality for the Enterprise
Augmented reality for the EnterpriseAugmented reality for the Enterprise
Augmented reality for the Enterprise
Cameron Vetter
 
Augmented Reality - Let’s Make Some Holograms! (UXD Version)
Augmented Reality - Let’s Make Some Holograms! (UXD Version)Augmented Reality - Let’s Make Some Holograms! (UXD Version)
Augmented Reality - Let’s Make Some Holograms! (UXD Version)
Cameron Vetter
 
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
Cameron Vetter
 

More from Cameron Vetter (10)

Why do most machine learning projects never make it to production
Why do most machine learning projects never make it to productionWhy do most machine learning projects never make it to production
Why do most machine learning projects never make it to production
 
Ml.net machine learning for .net developers!
Ml.net machine learning for .net developers!Ml.net machine learning for .net developers!
Ml.net machine learning for .net developers!
 
Cloud First Architecture
Cloud First ArchitectureCloud First Architecture
Cloud First Architecture
 
Mixed reality the second generation is all about ux
Mixed reality   the second generation is all about uxMixed reality   the second generation is all about ux
Mixed reality the second generation is all about ux
 
An Introduction to Artificial Neural Networks
An Introduction to Artificial Neural NetworksAn Introduction to Artificial Neural Networks
An Introduction to Artificial Neural Networks
 
Azure Batch AI for Neural Networks
Azure Batch AI for Neural Networks Azure Batch AI for Neural Networks
Azure Batch AI for Neural Networks
 
Using a Service Bus for Microservice Communication
Using a Service Bus for Microservice CommunicationUsing a Service Bus for Microservice Communication
Using a Service Bus for Microservice Communication
 
Augmented reality for the Enterprise
Augmented reality for the EnterpriseAugmented reality for the Enterprise
Augmented reality for the Enterprise
 
Augmented Reality - Let’s Make Some Holograms! (UXD Version)
Augmented Reality - Let’s Make Some Holograms! (UXD Version)Augmented Reality - Let’s Make Some Holograms! (UXD Version)
Augmented Reality - Let’s Make Some Holograms! (UXD Version)
 
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
Augmented Reality - Let’s Make Some Holgrams! (Developer Version)
 

Recently uploaded

Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
varshanayak241
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx
Georgi Kodinov
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Globus
 
Why React Native as a Strategic Advantage for Startup Innovation.pdf
Why React Native as a Strategic Advantage for Startup Innovation.pdfWhy React Native as a Strategic Advantage for Startup Innovation.pdf
Why React Native as a Strategic Advantage for Startup Innovation.pdf
ayushiqss
 
Explore Modern SharePoint Templates for 2024
Explore Modern SharePoint Templates for 2024Explore Modern SharePoint Templates for 2024
Explore Modern SharePoint Templates for 2024
Sharepoint Designs
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
Tendenci - The Open Source AMS (Association Management Software)
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 

Recently uploaded (20)

Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
 
Why React Native as a Strategic Advantage for Startup Innovation.pdf
Why React Native as a Strategic Advantage for Startup Innovation.pdfWhy React Native as a Strategic Advantage for Startup Innovation.pdf
Why React Native as a Strategic Advantage for Startup Innovation.pdf
 
Explore Modern SharePoint Templates for 2024
Explore Modern SharePoint Templates for 2024Explore Modern SharePoint Templates for 2024
Explore Modern SharePoint Templates for 2024
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 

Azure Notebooks - Jupyter for the Cloud

  • 3. Cameron Vetter I have 20 years of experience using Microsoft tools and technologies to develop software. I have experience in many roles including Development, Architecture, Infrastructure, Management, and Leadership roles. I've worked for some of the largest companies in the world and for small local companies getting a breadth of experience in different Corporate Cultures. Currently, I work at SafeNet Consulting, where I get to do what I love... Architect, Design, and Develop great software! I currently focus on Microservices, SOA, Azure, Cognitive Toolkit, and Kubernetes. Principal Cloud Consultant
  • 4. A Partner to Advise and Support About SafeNet Consulting SafeNet specializes in being partners in your success. We currently focus on Custom Application Development, Cloud Consulting Services, Data & Analytics, and User Experience Strategy.
  • 5. Introduction What is Jupyter? What is Azure Notebooks? Intro to the Example Code, Execution & Markdown Data Visualization Where does this tool fit? Question & Answer Agenda
  • 7. The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more. Jupyter Notebook jupyter.org
  • 8. Share Notebooks Notebooks can be shared with others using email, Dropbox, GitHub and the Jupyter Notebook Viewer. Interactive Output Your code can produce rich, interactive output: HTML, images, videos, LaTeX, and custom MIME types. Big Data Integration Leverage big data tools, such as Apache Spark, from Python, R and Scala. Explore that same data with pandas, scikit-learn, ggplot2, TensorFlow Use Your Language of Choice Jupyter has support for over 40 programming languages, including Python, R, Julia, and Scala.
  • 9. Data powers Netflix. It permeates our thoughts, informs our decisions, and challenges our assumptions. It fuels experimentation and innovation at unprecedented scale. Our 100 Petabytes of data helps us discover fantastic content and deliver personalized experiences for our 130 million members around the world. -- Netflix Blog Industry Example
  • 10. Jupyter adoption hits critical mass with Netflix Data Scientists. Data Scientist Adoption Data Engineers began work to elevate notebooks from a niche tool to a first-class citizen at Netflix for data consumption. Developers Take Notice All user types rapidly adopt because of the versatility, power, and ease of use Organic Adoption Today Jupyter Notebooks is the most popular platform for data consumption at Netflix. Jupyter Notebooks Data Access at Netflix / Use Case / Source: https://bit.ly/netflixjupyter/
  • 11. What is Azure Notebooks?
  • 12. Azure Notebooks Useful for any workspace Perfect for data scientists, developers, students, or anyone. Develop and run code in your browser regardless of industry or skillset. Multiple language support Supporting more languages than any other platform including Python 2, Python 3, R, and F#. Microsoft Azure Cloud Services Created by Microsoft Azure: Always accessible, always available from any browser, anywhere in the world. Source: https://notebooks.azure.com/
  • 13. What’s the Big Deal? / With Jupyter in Azure / Create an account and you are up and running! Give read only access to anyone via a link or Download a copy of the IPYNB file to share. It is easy to attach an Azure Notebook to a DSVM for more power! Integrate easily with GitHub, Clone to your own Notebook, Cloud based Storage and Backups No Install Needed Share Anywhere Cloud Compute Cloud Features
  • 14. Intro to the Example
  • 15. The Example This example is presented in Jupyter bringing a human readable quality that is missing in my workshop. Different Angle This example is content borrowed from my full day workshop. Workshop I’m focusing on Jupyter not the code, I will highlight a couple things in code, but we will focus on Azure Notebooks. Don’t Focus on the Code
  • 16. Region An ANN that predicts if a sales lead will be a WIN or a LOSS Client Size Route to Market Days in Sales Stage Etc… Sales Prediction / Will you make the sale? / Deal Size
  • 18. A collection of extensions that add functionality to the Jupyter notebook. These extensions are mostly written in JavaScript and will be loaded locally in your browser. Jupyter Notebook Extensions Source: https://github.com/ipython-contrib/jupyter_contrib_nbextensions
  • 19. Collapsible Headings Allows notebook to have collapsible sections, separated by headings. Notify Jupyter notebook extension to display a web notification to notify you when the kernel becomes idle. This can be useful when running tasks that take more than a couple of seconds to complete.
  • 20. Lab 2 Let’s Look at Notebooks! TAKE NOTE: • Examine Extensions • Markdown and code mixed • Results in line after the execution • The Data Frame is rendered pretty
  • 21. Markdown / Adding the pretty to your Notebooks / • Standard Markdown • Feel free to blend HTML like I did • Check out this cheat sheet: https://www.ibm.com/support/knowledgecenter/SSQNUZ_current/com.i bm.icpdata.doc/dsx/markd-jupyter.html
  • 23. Lab 3, 4, 5 More Notebooks! TAKE NOTE: • More pretty rendering • In line Graph using matplotlib • Array rendering not so pretty • In Line Graph using Seaborn
  • 24. 01 / MatPlotLib 02 / Seaborn Graphing Libraries / Visualizing data in Jupyter /
  • 25. Lab 6 Even More Notebooks! TAKE NOTE: • Training is very long running • Used Matplotlib to plot the training results
  • 26. Where Does This Tool Fit?
  • 27. Long Running Tasks Jupyter gracefully handles long running tasks, but is not an ideal environment. Data Management Most of your projects will have associated data sets, but where do you manage them and how do you make them portable? Writing Code A lot of our IDE expectations are not met by Jupyter, making it not the best place to write code Weaknesses
  • 28. Lab 7 + 8 Don’t Do This! TAKE NOTE: • Jupyter is a poor fit for a grid search • Jupyter renders lab 8 output poorly
  • 29. Developers Jupyter give developers a sand box to work in especially when shaping data, and allows them to understand the work of data scientists Data Scientists Jupyter fits the workflow of a data scientist allowing them to codify their work in a presentation style that shares both the how and the why