Serverless Machine Learning Workshop

•

2 likes•1,865 views

What is Machine Learning and how does it work? But even more importantly, what problems can ML solve for you and your company? Once you have understood the potential use cases, we will briefly describe the main challenges in the world of Big Data. Why is deploying ML models so hard and how can Cloud Computing help? Many MLaaS options are available on the market (AWS, Google, Azure, BigML, etc.). We will see how they compare to each other and which may best fit your needs. Whenever MLaaS is not enough, you can build your own ML models. We will briefly explain why Serverless is a great deployment strategy for this use case and what problems and limitation arise with it. Furthermore, we will put these ideas into practice and build a model for Sentiment Analysis, based on Python (scikit-learn), and trained with a public dataset by Stanford University.

Engineering

[特別企画]
Serverless Machine Learning
Workshop
clda.co/serverless-‐workshop
10/04/2016 東京

@alex_casalboni
clda.co/serverless-‐workshop Workshop | 東京
Web Developer (6+ years)
Sr. SoBware Engineer @ Cloud Academy
Master in Computer Science
About me

What is Machine Learning?
Back to 1959 (Arthur Samuel)
How computers learn from Data
clda.co/serverless-‐workshop Workshop | 東京
How to solve decision problems

Machine Learning pipeline
Training Predic6on
batch real-‐Ame
Feature
extrac6on
batch
data informaPon
features ML models
clda.co/serverless-‐workshop Workshop | 東京

?
Machine Learning taxonomy
Supervised
Learning
Unsupervised
Learning
clda.co/serverless-‐workshop Workshop | 東京

?
Machine Learning taxonomy
classiﬁca8on
regression
170 
cm
Supervised
Learning
Unsupervised
Learning
clda.co/serverless-‐workshop Workshop | 東京

Machine Learning taxonomy
clustering
rule extrac8on
group A group B
A, B C
Supervised
Learning
Unsupervised
Learning
clda.co/serverless-‐workshop Workshop | 東京

What problems can ML solve for you?
Supervised
Learning
Unsupervised
Learning
classiﬁca'on
regression
clustering
rule extrac'on
?
170 
cm
gro gro
A, B C
clda.co/serverless-‐workshop Workshop | 東京

What problems can ML solve for you?
Supervised
Learning
Unsupervised
Learning
classiﬁca'on
regression
clustering
rule extrac'on
?
fraud detecPon
170 
cm
gro gro
A, B C
price of a stock over Pme
purchase likelihood
user segmentaPon
clda.co/serverless-‐workshop Workshop | 東京

Learning
Data
Machine
Cloud
Big
Science
Information
Internet
Statistics
Technology
Python Future
Mining Social
Deep
IOT
Algorithms
Management
Storage Petabytes
Parallel
Network
Privacy
Million
NoSQL
PaaS
SQL
Database
Exabytes
Billion
Dataset
Hadoop
R
clda.co/serverless-‐workshop Workshop | 東京

Generated data started growing ~10 years ago…
“90% of the data in the world today has been
created in the last two years alone” -‐ IBM
“300+ hours worth of video content is being
uploaded to the site every minute” -‐ Youtube
clda.co/serverless-‐workshop Workshop | 東京

… and it keeps geKng bigger!
clda.co/serverless-‐workshop Workshop | 東京

Big data challenges
Manual exploraPon is not an opPon
Data-‐driven decisions are a must
Distributed/parallel compuPng
The curse of dimensionality
clda.co/serverless-‐workshop Workshop | 東京

clda.co/serverless-‐workshop Workshop | 東京

Why is deploying ML models a challenge?
clda.co/serverless-‐workshop Workshop | 東京

Why is deploying ML models a challenge?
1. Prototyping != ProducPon-‐ready
2. We need ElasPcity
4. MulP-‐model architectures
3. Too many nice-‐to-‐have features
clda.co/serverless-‐workshop Workshop | 東京
5. Avoid lack of ownership

Machine Learning as a Service (MLaaS)
Amazon 
Machine Learning
Azure 
Machine Learning
Google 
PredicAon API
IMB 
Watson AnalyAcs
BigML 
Workshop | 東京clda.co/serverless-‐workshop

Amazon Machine Learning
AmazonML
One of the ﬁrst MLaaS soluPons (1 year old)
Great service for classiﬁcaPon and regression
Only linear models (linear & logisPc regression + SGD)
No support for advanced scenarios yet
Workshop | 東京clda.co/serverless-‐workshop

AmazonML @ Cloud Academy
Workshop | 東京clda.co/serverless-‐workshop
clda.co/7-‐day-‐free
(no credit card required!)

Serverless compuAng to the rescue!
Transparent scalability, elasPcity and availability
Developer-‐friendly maintenance (versioning + aliases)
AWS
Lambda
Event-‐driven approach & never pay for idle
1 funcPon = 1 model
A/B tesPng via composiPon
clda.co/serverless-‐workshop Workshop | 東京

Quick Example
clda.co/ML-‐Lambda
clda.co/serverless-‐workshop Workshop | 東京

Thank you for aZending :)
cloudacademy.com
Q & A
10/04/2016 東京

You will learn how to efficiently design and train machine learning models in Python and deploy them to the cloud. This process reduces the development & operational efforts required to make your prototypes production-ready. We will describe the main challenges faced by data scientists involved in deploying machine learning models into real production environments with specific references, examples of Python libraries, and multi-model systems requiring advanced features such as A/B testing and high scalability & availability. While discussing the advantages and limitations of multiple deployment strategies in the cloud, we will focus on serverless computing (i.e. AWS Lambda) as a solution for simplifying your development & deployment workflows.

How to deploy machine learning models in the Cloud

Alex Casalboni

Developing and experimenting with machine learning models in Python is easy and well supported by robust and agile libraries such as scikit-learn, although efficiently deploying multi-model systems at scale is still a challenge in the data science field. This talk will focus on the main issues related to deploying machine learning models and how to make scikit-learn production-ready with minimal operational efforts, by means of Cloud Computing services, in particular Amazon Web Services. Prerequisites: basic Machine Learning understanding (modeling and training), minimal knowledge about scikit-learn and Python utilities such as Pandas and boto.

Building Serverless Machine Learning models in the Cloud

Alex Casalboni

Here I describe the main challenges faced by data scientists involved in deploying machine learning models into real production environments. I also include references/examples of Python libraries and multi-model systems requiring advanced features such as A/B testing and high scalability/availability. While discussing the limitations of traditional deployment strategies, I will demonstrate how serverless computing can simplify your deployment workflow.

Sam Kroonenburg and Pete Sbarski - The Story of a Serverless Startup

ServerlessConf

Presented at ServerlessConf NYC 2016. A Cloud Guru is a completely serverless online learning platform that connects 50,000+ users in real-time, using AWS Lambda, Firebase and a huge array of 3rd party cloud services. We’ll tell the story of building a completely serverless company, and how this approach has literally fueled our business model, and enabled us to disrupt the training industry. We’ll explain the 5 principles you should following when adopting serverless architectures, and walk through real-world examples of each from our platform. Expect to hear about AWS Lambda, Firebase, Auth0, CloudSearch, Elastic Transcoder, S3, CloudFront CDN and lots of JavaScript!

Get your mobile app in production in 3 months: Native and Reactive Mobile Apps

Ackee

A Lap around ASP.NET 5 - VConf

Sam Basu

Introducción al JAMStack - JS Ourense

Carlos Azaustre

Get your mobile app in production in 3 months: Backend

Ackee

2017 September Golang Sydney meetup https://www.meetup.com/golang-syd/events/243263974/ Yun Zhi Lin wrote serverless-golang to bring about the perfect combination of strongly typed idiomatic Golang with the simplicity of Serverless Framework. Serverless Golang currently forms the backbone of amaysim’s Serverless Realtime Event Driven Architecture, Anti-Corruption Layer and Single Customer View across 4 business verticals. The library comes with easy to follow real world examples, and is entirely built and deployed immutably via Docker.

How and why test Azure Front Door with AWS Lambda & PowerShell? | Osman Sahin...

UK DevOps Collective

Osman Sahin, a regular attendee of our events, explains how and why he is using AWS Lambda & PowerShell to test the new Azure Front Door service. Presented Wednesday 28th July 2019 at the London PowerShell User Group Meetup hosted by dotdigital Group. Connect with Osman Sahin: - LinkedIn: https://www.linkedin.com/in/osmanysahin/ Thanks to dotdigital Group (https://dotdigital.com / https://twitter.com/dotdigital) for providing the venue, food and drinks. We very much appreciate your continued support of our community of PowerShell & DevOps tech enthusiasts. Join our next event at https://www.meetup.com/PowerShell-London-UK/. We are running at least one Meetup every month. #PowerShell #Azure #AWS #DevOps

Azure Static Web Apps 入門

Tsubasa Yoshino

AWS Community Day Bangkok 2019 - Dev Ops Philosophy Increase Productivity

AWS User Group - Thailand

Codemotion Berlin 2017 - Event-driven and serverless applications with IBM Cl...

Frederic Lavigne

Serverless computing (aka FaaS, Functions as a Service) is one of the hottest topics in the field of cloud computing. IBM Cloud Functions (built on Apache OpenWhisk) is one player in this new field. During this presentation, Frederic will talk about his journey through the world of serverless computing, the core concepts, the value proposition and differentiators, typical usage and real-world customer scenarios, and the underlying programming model of serverless computing in general and Cloud Functions in particular, latest trends and additions, and conclude his session with some fancy demos.

AWS Community Day Bangkok 2019 - Hello ClaudiaJS

AWS User Group - Thailand

AWS Community Day Bangkok 2019 - DevOps Cost Reduction using Jenkins & AWS Sp...

AWS User Group - Thailand

Visual Recognition with Anki Cozmo and TensorFlow

Niklas Heidloff

Visual Recognition with Anki Cozmo and TensorFlow - Deployed on IBM Cloud viaKubernetes and Apache OpenWhisk https://github.com/nheidloff/visual-recognition-for-cozmo-with-tensorflow http://heidloff.net/article/visual-recognition-for-cozmo-with-tensorflow https://twitter.com/nheidloff https://github.com/anki/cozmo-python-sdk https://codelabs.developers.google.com/codelabs/tensorflow-for-poets https://www.ibm.com/cloud https://openwhisk.apache.org

Build a Chatbot in Ten Minutes - Dave Kerr - Serverless Summit

CodeOps Technologies LLP

--This presentation was presented in Serverless Summit - www.inserverless.com --- In this presentation I'll show you how to use Amazon Lambda and Lex to build a working chatbot in just a few minutes. No prior experience is required, you'll see how to use a simple starter kit built by myself and a friend to rapidly set up a bot. This is a great way to get your hands dirty with serverless programming on the AWS platform, and have some fun writing a bot!

Running Containerized Applications on Modern Serverless Platforms

DevOps.com

Serverless enables powerful scaling from zero to infinity. However, traditional serverless technologies are cloud-vendor-specific with limited portability. Come and learn from Google Cloud and GitLab experts about emerging technologies like Kubernetes, Knative, Cloud Run, and GitLab Serverless, making it possible to write applications once and then port them to a variety to deployment environments. In this webcast, we'll walk through some of the benefits and challenges of using cloud-vendor-specific serverless technologies. With Kubernetes as an infrastructure abstraction organizations can take advantage of hybrid (cloud and on-premises) as well as multi-cloud compute. We'll show you how to containerize a traditional application and deploy it to a variety of environments including Cloud Run as well as any Kubernetes cluster using GitLab Serverless.

Create Alexa Skills using IBM Watson Conversation and Apache OpenWhisk

Niklas Heidloff

Create Alexa Skills using IBM Watson Conversation and Apache OpenWhisk http://heidloff.net https://twitter.com/nheidloff https://github.com/IBM/alexa-skill-watson-conversation https://developer.ibm.com/code/patterns https://www.ibm.com/cloud https://www.ibm.com/watson/services/conversation https://www.ibm.com/cloud/functions https://developer.amazon.com/edw/home.html#/skills https://alexa.amazon.de https://echosim.io/welcome

Democratizing Serverless—The Open Source Fn Project - Serverless Summit

CodeOps Technologies LLP

Serverless computing is one of the hottest trends in software second only to containers. But most serverless function platforms suffer from vendor lock-in and a poor developer experience. Ideally, companies should be able to run their functions on any cloud choosing the one that offers the best value with the knowledge that they could change providers if need be. Developers should be able to build and test on their laptops knowing that the functions platform they’re developing on locally is same platform that’s running in the cloud—not some approximation or emulation. The purpose of the recently announced Fn project is to respond to these needs and to deliver an open source Apache 2.0 licensed functions platform that can run anywhere: laptop, server, cloud. In this session we’ll introduce Fn, its polyglot function support, and its Docker-based architecture that allows it to run on any platform and with any scheduler including Kubernetes, Mesos, and Swarm.

Running Spring, .NET, and IBM Watson Voice on PCF 2.0

VMware Tanzu

Join Vince Russo and Peter Blum from Pivotal as they show attendees a real-world example of straddling workloads across Pivotal Application Service (PAS) and Pivotal Container Service (PKS). In this practitioner-focused webinar, we'll tour through Spring and .NET versions of an app to receive the output generated by the Watson Voice Gateway (WVG). Then we'll walk through the PKS-managed Kubernetes cluster using IBM-provided pods for deploying the Watson Voice Gateway (WVG). The cluster will be deployed using the PKS CLI, then the pods will be created with the WVG configuration file. The Spring and .NET applications will be deployed on PAS. A third-party VoIP application will be used to call into the Voice Gateway to issue commands, which will be outputted to the Spring and .NET Application for "processing." Hear directly from our field and R&D experts!

Adform Cloud Infrastructure

Matas Tvarijonas

ServerlessConf Tokyo キーノート

Amazon Web Services Japan

Amazon Rekognition - Image Analysis Overview

Alex Casalboni

What's hot

Get your mobile app in production in 3 months: Native and Reactive Mobile Apps

Ackee

Get your mobile app in production in 3 months: DevOps and Infrastructure

Ackee

Rescale New Feature: Bring Your Own VPC

Takahisa Shiratori

Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...

Quentin Adam

.Net Development on AWS

Matthew Will

Serverless Computing with Azure

Analben Mehta

Amazingly Simple Serverless Go

Yun Zhi Lin

How and why test Azure Front Door with AWS Lambda & PowerShell? | Osman Sahin...

UK DevOps Collective

Azure Static Web Apps 入門

Tsubasa Yoshino

AWS Community Day Bangkok 2019 - Dev Ops Philosophy Increase Productivity

AWS User Group - Thailand

Codemotion Berlin 2017 - Event-driven and serverless applications with IBM Cl...

Frederic Lavigne

AWS Community Day Bangkok 2019 - Hello ClaudiaJS

AWS User Group - Thailand

AWS Community Day Bangkok 2019 - DevOps Cost Reduction using Jenkins & AWS Sp...

AWS User Group - Thailand

Visual Recognition with Anki Cozmo and TensorFlow

Niklas Heidloff

Build a Chatbot in Ten Minutes - Dave Kerr - Serverless Summit

CodeOps Technologies LLP

Running Containerized Applications on Modern Serverless Platforms

DevOps.com

Create Alexa Skills using IBM Watson Conversation and Apache OpenWhisk

Niklas Heidloff

Democratizing Serverless—The Open Source Fn Project - Serverless Summit

CodeOps Technologies LLP

Running Spring, .NET, and IBM Watson Voice on PCF 2.0

VMware Tanzu

Adform Cloud Infrastructure

Matas Tvarijonas

What's hot (20)

Get your mobile app in production in 3 months: Native and Reactive Mobile Apps

Get your mobile app in production in 3 months: DevOps and Infrastructure

Rescale New Feature: Bring Your Own VPC

Build a reverse proxy for modern immutable infrastructure - Sozu - Devops D D...

.Net Development on AWS

Serverless Computing with Azure

Amazingly Simple Serverless Go

How and why test Azure Front Door with AWS Lambda & PowerShell? | Osman Sahin...

Azure Static Web Apps 入門

AWS Community Day Bangkok 2019 - Dev Ops Philosophy Increase Productivity

Codemotion Berlin 2017 - Event-driven and serverless applications with IBM Cl...

AWS Community Day Bangkok 2019 - Hello ClaudiaJS

AWS Community Day Bangkok 2019 - DevOps Cost Reduction using Jenkins & AWS Sp...

Visual Recognition with Anki Cozmo and TensorFlow

Build a Chatbot in Ten Minutes - Dave Kerr - Serverless Summit

Running Containerized Applications on Modern Serverless Platforms

Create Alexa Skills using IBM Watson Conversation and Apache OpenWhisk

Democratizing Serverless—The Open Source Fn Project - Serverless Summit

Running Spring, .NET, and IBM Watson Voice on PCF 2.0

Adform Cloud Infrastructure

Viewers also liked

ServerlessConf Tokyo キーノート

Amazon Web Services Japan

Amazon Rekognition - Image Analysis Overview

Alex Casalboni

AWS Lambda: Advanced Coding Session

Alex Casalboni

"On-premises" FaaS on Kubernetes

Alex Casalboni

AWS User Group BiH @ Mostar

Alex Casalboni

LAI - AWS IoT Workshop

Alex Casalboni

ODSC - Neural Networks on AWS Lambda

Anoop Vasant Kumar

Cloud Academy's AWS Hands on-labs

Alex Casalboni

Introduction to the Serverless paradigm

Alex Casalboni

Introduction to building alexa skills and putting your amazon echo to work

Abe Diaz

AWS re:Invent 2016: Building IoT Applications with AWS and Amazon Alexa (HLC304)

Amazon Web Services

Alexa, what is the Internet of Things? Now that technology is small enough to be embedded in everyday devices, Healthcare has an opportunity to exploit the extraordinary potential of connecting ordinary devices. In this presentation, we explain how to rapidly build an IoT system and how to drive the Cloud with your voice on an Amazon Echo. In addition to describing how to use Alexa, we explore using AWS IoT, Lambda, Amazon SNS, and DynamoDB.

AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...

Amazon Web Services

This workshop teaches you how to build your first voice skill with Alexa. You bring a skill idea and we’ll show you how to bring it to life. This workshop will walk you through how to build an Alexa skill, including Node.js setup, how to implement an intent, deploying to AWS Lambda, and how to register and test a skill. You’ll walk out of the workshop with a working prototype of your skill idea. Prerequisites: Participants should have an AWS account established and available for use during the workshop. Please bring your own laptop.

Building a Machine Learning App with AWS Lambda

Sri Ambati

Tensorflow in production with AWS Lambda

Fabian Dubois

An Introduction to Kubernetes

Imesh Gunaratne

Traditional virtualization technologies have been used by cloud infrastructure providers for many years in providing isolated environments for hosting applications. These technologies make use of full-blown operating system images for creating virtual machines (VMs). According to this architecture, each VM needs its own guest operating system to run application processes. More recently, with the introduction of the Docker project, the Linux Container (LXC) virtualization technology became popular and attracted the attention. Unlike VMs, containers do not need a dedicated guest operating system for providing OS-level isolation, rather they can provide the same level of isolation on top of a single operating system instance. An enterprise application may need to run a server cluster to handle high request volumes. Running an entire server cluster on Docker containers, on a single Docker host could introduce the risk of single point of failure. Google started a project called Kubernetes to solve this problem. Kubernetes provides a cluster of Docker hosts for managing Docker containers in a clustered environment. It provides an API on top of Docker API for managing docker containers on multiple Docker hosts with many more features.

Cloud Academy & AWS: how we use Amazon Web Services for machine learning and ...

Alex Casalboni

Alexa bootcamp - Skill building 101

Amazon Web Services

コミュニティバス運行へのICT活用事例とその可能性

Masaki Ito

Troubleshooting Java HotSpot VM

Poonam Bajaj Parhar

While working with Java applications running on the Java HotSpot VM, we might sometimes encounter problems such as application hangs, memory leaks, unexpected application behavior, or crashes. Troubleshooting such problems can be very hard and tricky. But with knowledge of the right set of tools and utilities for nailing these problems down and how to approach them, troubleshooting can be made much easier and can help us develop stable, reliable, and efficient Java applications. This slides deck covers how we should approach these JVM issues and which tools and utilities are useful for diagnosing and troubleshooting them.

New Threats, New Approaches in Modern Data Centers

Iben Rodriguez

New Threats, New Approaches in Modern Data Centers - A Presentation by NPS at CENIC conference 11:00 am - 12:00 pm, Wednesday, March 22, 2017 – in San Diego, California The standard approach to securing data centers has historically emphasized strong perimeter protection to keep threats on the outside of the network. However, this model is ineffective for handling new types of threats—including advanced persistent threats, insider threats, and coordinated attacks. A better model for data center security is needed: one that assumes threats can be anywhere and probably are everywhere and then, through automation, acts accordingly. Using micro-segmentation, fine-grained network controls enable unit-level trust, and flexible security policies can be applied all the way down to a network interface. In this joint presentation between customer, partner, and VMware, the fundamental tenants of micro-segmentation will be discussed. Presenters will describe how the Naval Postgraduate School has incorporated these principles into the architecture and design of a multi-tenant Cybersecurity Lab environment to deliver security training to national and international government personnel. Edgar Mendoza, IT Specialist, Information Technology and Communications Services (ITACS) Naval Postgraduate School Eldor Magat, Computer Specialist, ITACS, Naval Postgraduate School Mike Monahan, Network Engineer, ITACS, Naval Postgraduate School Iben Rodriguez, Brocade Resident SDN Delivery Consultant, ITACS, Naval Postgraduate School Brian Recore, NSX Systems Engineer, VMware, Inc. https://youtu.be/mYBbIbfKkGU?t=1h7m16s Copied from the program with corrections - https://adobeindd.com/view/publications/b9fbbdf0-60f1-41dc-8654-3d2141b0bf54/nh4h/publication-web-resources/pdf/Conference_Agenda_2017_v1.pdf

Viewers also liked (20)

ServerlessConf Tokyo キーノート

Amazon Rekognition - Image Analysis Overview

AWS Lambda: Advanced Coding Session

"On-premises" FaaS on Kubernetes

AWS User Group BiH @ Mostar

LAI - AWS IoT Workshop

ODSC - Neural Networks on AWS Lambda

Cloud Academy's AWS Hands on-labs

Introduction to the Serverless paradigm

Introduction to building alexa skills and putting your amazon echo to work

AWS re:Invent 2016: Building IoT Applications with AWS and Amazon Alexa (HLC304)

AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...

Building a Machine Learning App with AWS Lambda

Tensorflow in production with AWS Lambda

An Introduction to Kubernetes

Cloud Academy & AWS: how we use Amazon Web Services for machine learning and ...

Alexa bootcamp - Skill building 101

コミュニティバス運行へのICT活用事例とその可能性

Troubleshooting Java HotSpot VM

New Threats, New Approaches in Modern Data Centers

Similar to Serverless Machine Learning Workshop

“Houston, we have a model...” Introduction to MLOps

Rui Quintino

Why you shouldn't probably care about Machine Learning

BIWUG

Operationalizing R with Azure ML

Chris McHenry

Getting started with Machine Learning

Mike Fowler

Getting started with machine learning | Mike Fowler

AWSCOMSUM

Zipline—Airbnb’s Declarative Feature Engineering Framework

Databricks

Zipline is Airbnb’s data management platform specifically designed for ML use cases. Previously, ML practitioners at Airbnb spent roughly 60% of their time on collecting and writing transformations for machine learning tasks. Zipline reduces this task from months to days – by making the process declarative. It allows data scientists to easily define features in a simple configuration language. The framework then provides access to point-in-time correct features – for both – offline model training and online inference. In this talk we will describe the architecture of our system and the algorithm that makes the problem of efficient point-in-time correct feature generation, tractable. The attendee will learn Importance of point-in-time correct features for achieving better ML model performance Importance of using change data capture for generating feature views An algorithm – to efficiently generate features over change data. We use interval trees to efficiently compress time series features. The algorithm allows generating feature aggregates over this compressed representation. A lambda architecture – that enables using the above algorithm – for online feature generation. A framework, based on category theory, to understand how feature aggregations be distributed, and independently composed. While the talk if fairly technical – we will introduce all the concepts from first principles with examples. Basic understanding of data-parallel distributed computation and machine learning might help, but are not required.

Pitfalls of machine learning in production

Antoine Sauray

Strata CA 2019: From Jupyter to Production Manu Mukerji

Manu Mukerji

Proposed title From Jupyter to production Description of the presentation Jupyter is very popular for data science, data exploration and visualization, this talk is about how to use it in for AI/ML in a production environment. General Flow of talk: How things can go wrong with QA, Production releases when using a notebook Common Jupyter ML examples Standard ML flow Training in production Model creation Testing in production Papermill and Jupyter Production workflows with Sagemaker Speaker Manu Mukerji is senior director of data, machine learning, and analytics at 8×8. Manu’s background lies in cloud computing and big data, working on systems handling billions of transactions per day in real time. He enjoys building and architecting scalable, highly available data solutions and has extensive experience working in online advertising and social media.

Cloud Computing: New era in ML. Gianluigi Mucciolo - XPeppers

Data Driven Innovation

Lessons Learned from Building Machine Learning Software at Netflix

Justin Basilico

Talk from Software Engineering for Machine Learning Workshop (SW4ML) at the Neural Information Processing Systems (NIPS) 2014 conference in Montreal, Canada on 2014-12-13. Abstract: Building a real system that incorporates machine learning as a part can be a difficult effort, both in terms of the algorithmic and engineering challenges involved. In this talk I will focus on the engineering side and discuss some of the practical issues we’ve encountered in developing real machine learning systems at Netflix and some of the lessons we’ve learned over time. I will describe our approach for building machine learning systems and how it comes from a desire to balance many different, and sometimes conflicting, requirements such as handling large volumes of data, choosing and adapting good algorithms, keeping recommendations fresh and accurate, remaining responsive to user actions, and also being flexible to accommodate research and experimentation. I will focus on what it takes to put machine learning into a real system that works in a feedback loop with our users and how that imposes different requirements and a different focus than doing machine learning only within a lab environment. I will address the particular software engineering challenges that we’ve faced in running our algorithms at scale in the cloud. I will also mention some simple design patterns that we’ve fond to be useful across a wide variety of machine-learned systems.

Machine learning at scale - Webinar By zekeLabs

zekeLabs Technologies

Scaling Machine Learning from zero to millions of users (May 2019)

Julien SIMON

Weekly #105: AutoViz and Auto_ViML Visualization and Machine Learning

Bill Liu

Serverless AI with Scikit-Learn (GPSWS405) - AWS re:Invent 2018

Amazon Web Services

Take advantage of serverless technologies for artificial intelligence (AI) by making a prediction on the fly. There is no model hosting and no servers to maintain. In this session, we show how to train a model in scikit-learn, an open source machine learning library for Python. Then we load and call the trained model from an AWS Lambda function, and finally we demonstrate how to load the library and send the data for prediction.

Machine Learning Startup

Ben Lackey

Designing and coding for cloud-native applications using Python, Harjinder Mi...

Pôle Systematic Paris-Region

Serverless projects at Myplanet

Daniel Zivkovic

1) Learn about Myplanet's Headless CMS solution using Gatsby Preview and Contentful’s UI Extensions (https://www.contentful.com/resources/serverless/) 2) their Serverless project with IBM - using Apache OpenWhisk (https://www.ibm.com/cloud/functions) 3) how Myplanet got involved with AWS DeepRacer - a fun way to get started with Reinforcement Learning (RL), and their racing experience at re:Invent DeepRacer League (https://reinvent.awsevents.com/learn/deepracer/) 4) their Machine Learning (ML) research related to finding DeepRacer’s ideal line (https://medium.com/myplanet-musings/the-best-path-a-deepracer-can-learn-2a468a3f6d64). BONUS: Two TED Talks referenced in the intro 5) When ideas have sex | Matt Ridley | Jul 14, 2010 https://www.ted.com/talks/matt_ridley_when_ideas_have_sex 6) Why The Best Leaders Make Love The Top Priority | Matt Tenney | Dec 5, 2019 https://www.youtube.com/watch?v=qCVoohdyI6I VIDEO: https://youtu.be/ZH1xxmBNx5k

2019 StartIT - Boosting your performance with Blackfire

Marko Mitranić

A workshop held in StartIT as part of Catena Media learning sessions. We aim to dispel the notion that large PHP applications tend to be sluggish, resource-intensive and slow compared to what the likes of Python, Erlang or even Node can do. The issue is not with optimising PHP internals - it's the lack of proper introspection tools and getting them into our every day workflow that counts! In this workshop we will talk about our struggles with whipping PHP Applications into shape, as well as work together on some of the more interesting examples of CPU or IO drain.

Deployment Design Patterns - Deploying Machine Learning and Deep Learning Mod...

All Things Open

AllThingsOpen 2018 - Deployment Design Patterns (Dan Zaratsian)

dtz001

While the adoption of machine learning and deep learning techniques continue to grow, many organizations find it difficult to actually deploy these sophisticated models into production. It is common to see data scientists build powerful models, yet these models are not deployed because of the complexity of the technology used or lack of understanding related to the process of pushing these models into production. As part of this talk, I will review several deployment design patterns for both real-time and batch use cases. I’ll show how these models can be deployed as scalable, distributed deployments within the cloud, scaled across hadoop clusters, as APIs, and deployed within streaming analytics pipelines. I will also touch on topics related to security, end-to-end governance, pitfalls, challenges, and useful tools across a variety of platforms. This presentation will involve demos and sample code for the the deployment design patterns.

Similar to Serverless Machine Learning Workshop (20)

“Houston, we have a model...” Introduction to MLOps

Why you shouldn't probably care about Machine Learning

Operationalizing R with Azure ML

Getting started with Machine Learning

Getting started with machine learning | Mike Fowler

Zipline—Airbnb’s Declarative Feature Engineering Framework

Pitfalls of machine learning in production

Strata CA 2019: From Jupyter to Production Manu Mukerji

Cloud Computing: New era in ML. Gianluigi Mucciolo - XPeppers

Lessons Learned from Building Machine Learning Software at Netflix

Machine learning at scale - Webinar By zekeLabs

Scaling Machine Learning from zero to millions of users (May 2019)

Weekly #105: AutoViz and Auto_ViML Visualization and Machine Learning

Serverless AI with Scikit-Learn (GPSWS405) - AWS re:Invent 2018

Machine Learning Startup

Designing and coding for cloud-native applications using Python, Harjinder Mi...

Serverless projects at Myplanet

2019 StartIT - Boosting your performance with Blackfire

Deployment Design Patterns - Deploying Machine Learning and Deep Learning Mod...

AllThingsOpen 2018 - Deployment Design Patterns (Dan Zaratsian)

Recently uploaded

一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理

zwunae

IIT毕业证原版定制【微信：176555708】【伊利诺伊理工大学毕业证成绩单-学位证】【微信：176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。 ◆◆◆◆◆ — — — — — — — — 【留学教育】留学归国服务中心 — — — — — -◆◆◆◆◆ 【主营项目】一.毕业证【微信：176555708】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！二.真实使馆公证(即留学回国人员证明,不成功不收费) 三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度) 如果您处于以下几种情况： ◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【微信：176555708】 ◇面对父母的压力，希望尽快拿到； ◇不清楚认证流程以及材料该如何准备； ◇回国时间很长，忘记办理； ◇回国马上就要找工作，办给用人单位看； ◇企事业单位必须要求办理的 ◇需要报考公务员、购买免税车、落转户口 ◇申请留学生创业基金留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分→ 【关于价格问题（保证一手价格）我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！学历顾问：微信：176555708

CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx

R&R Consult

CFD analysis is incredibly effective at solving mysteries and improving the performance of complex systems! Here's a great example: At a large natural gas-fired power plant, where they use waste heat to generate steam and energy, they were puzzled that their boiler wasn't producing as much steam as expected. R&R and Tetra Engineering Group Inc. were asked to solve the issue with reduced steam production. An inspection had shown that a significant amount of hot flue gas was bypassing the boiler tubes, where the heat was supposed to be transferred. R&R Consult conducted a CFD analysis, which revealed that 6.3% of the flue gas was bypassing the boiler tubes without transferring heat. The analysis also showed that the flue gas was instead being directed along the sides of the boiler and between the modules that were supposed to capture the heat. This was the cause of the reduced performance. Based on our results, Tetra Engineering installed covering plates to reduce the bypass flow. This improved the boiler's performance and increased electricity production. It is always satisfying when we can help solve complex challenges like this. Do your systems also need a check-up or optimization? Give us a call! Work done in cooperation with James Malloy and David Moelling from Tetra Engineering. More examples of our work https://www.r-r-consult.dk/en/cases-en/

Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)

MdTanvirMahtab2

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...

thanhdowork

block diagram and signal flow graph representation

Divya Somashekar

weather web application report.pdf

Pratik Pawar

space technology lecture notes on satellite

ongomchris

Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B

Sreedhar Chowdam

Standard Reomte Control Interface - Neometrix

Neometrix_Engineering_Pvt_Ltd

About Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol. • Remote control: Parallel or serial interface. • Compatible with MAFI CCR system. • Compatible with IDM8000 CCR. • Compatible with Backplane mount serial communication. • Compatible with commercial and Defence aviation CCR system. • Remote control system for accessing CCR and allied system over serial or TCP. • Indigenized local Support/presence in India. • Easy in configuration using DIP switches. Technical Specifications Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol. Key Features Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol. • Remote control: Parallel or serial interface • Compatible with MAFI CCR system • Copatiable with IDM8000 CCR • Compatible with Backplane mount serial communication. • Compatible with commercial and Defence aviation CCR system. • Remote control system for accessing CCR and allied system over serial or TCP. • Indigenized local Support/presence in India. Application • Remote control: Parallel or serial interface. • Compatible with MAFI CCR system. • Compatible with IDM8000 CCR. • Compatible with Backplane mount serial communication. • Compatible with commercial and Defence aviation CCR system. • Remote control system for accessing CCR and allied system over serial or TCP. • Indigenized local Support/presence in India. • Easy in configuration using DIP switches.

power quality voltage fluctuation UNIT - I.pptx

ViniHema

Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf

fxintegritypublishin

Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.

NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...

Amil Baba Dawood bangali

Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad

Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...

AJAYKUMARPUND1

Student information management system project report ii.pdf

Kamal Acharya

Fundamentals of Electric Drives and its applications.pptx

manasideore6

Final project report on grocery store management system..pdf

Kamal Acharya

In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services. Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options. In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website. This document will discuss each of the underlying technologies to create and implement an e- commerce website.

Immunizing Image Classifiers Against Localized Adversary Attacks

gerogepatton

This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks (CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations. When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10 and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing accuracy improvements over previous techniques. The results indicate that the combination of the volumetric input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating adversary training.

Nuclear Power Economics and Structuring 2024

Massimo Talia

Planning Of Procurement o different goods and services

JoytuBarua2

Architectural Portfolio Sean Lockwood

seandesed

Recently uploaded (20)

一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理

CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx

Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...

block diagram and signal flow graph representation

weather web application report.pdf

space technology lecture notes on satellite

Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B

Standard Reomte Control Interface - Neometrix

power quality voltage fluctuation UNIT - I.pptx

Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf

NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...

Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...

Student information management system project report ii.pdf

Fundamentals of Electric Drives and its applications.pptx

Final project report on grocery store management system..pdf

Immunizing Image Classifiers Against Localized Adversary Attacks

Nuclear Power Economics and Structuring 2024

Planning Of Procurement o different goods and services

Architectural Portfolio Sean Lockwood

Serverless Machine Learning Workshop

1. [特別企画] Serverless Machine Learning Workshop clda.co/serverless-‐workshop 10/04/2016 東京

2. @alex_casalboni clda.co/serverless-‐workshop Workshop | 東京 Web Developer (6+ years) Sr. SoBware Engineer @ Cloud Academy Master in Computer Science About me

3. What is Machine Learning? Back to 1959 (Arthur Samuel) How computers learn from Data clda.co/serverless-‐workshop Workshop | 東京 How to solve decision problems

4. Machine Learning pipeline Training Predic6on batch real-‐Ame Feature extrac6on batch data informaPon features ML models clda.co/serverless-‐workshop Workshop | 東京

5. ? Machine Learning taxonomy Supervised Learning Unsupervised Learning clda.co/serverless-‐workshop Workshop | 東京

6. ? Machine Learning taxonomy classiﬁca8on regression 170  cm Supervised Learning Unsupervised Learning clda.co/serverless-‐workshop Workshop | 東京

7. Machine Learning taxonomy Supervised Learning Unsupervised Learning clda.co/serverless-‐workshop Workshop | 東京

8. Machine Learning taxonomy clustering rule extrac8on group A group B A, B C Supervised Learning Unsupervised Learning clda.co/serverless-‐workshop Workshop | 東京

9. What problems can ML solve for you? Supervised Learning Unsupervised Learning classiﬁca'on regression clustering rule extrac'on ? 170  cm gro gro A, B C clda.co/serverless-‐workshop Workshop | 東京

10. What problems can ML solve for you? Supervised Learning Unsupervised Learning classiﬁca'on regression clustering rule extrac'on ? fraud detecPon 170  cm gro gro A, B C price of a stock over Pme purchase likelihood user segmentaPon clda.co/serverless-‐workshop Workshop | 東京

11. Learning Data Machine Cloud Big Science Information Internet Statistics Technology Python Future Mining Social Deep IOT Algorithms Management Storage Petabytes Parallel Network Privacy Million NoSQL PaaS SQL Database Exabytes Billion Dataset Hadoop R clda.co/serverless-‐workshop Workshop | 東京

12. Generated data started growing ~10 years ago… “90% of the data in the world today has been created in the last two years alone” -‐ IBM “300+ hours worth of video content is being uploaded to the site every minute” -‐ Youtube clda.co/serverless-‐workshop Workshop | 東京

13. … and it keeps geKng bigger! clda.co/serverless-‐workshop Workshop | 東京

14. Big data challenges Manual exploraPon is not an opPon Data-‐driven decisions are a must Distributed/parallel compuPng The curse of dimensionality clda.co/serverless-‐workshop Workshop | 東京

15. clda.co/serverless-‐workshop Workshop | 東京

16. clda.co/serverless-‐workshop Workshop | 東京

17. Why is deploying ML models a challenge? clda.co/serverless-‐workshop Workshop | 東京

18. Why is deploying ML models a challenge? 1. Prototyping != ProducPon-‐ready 2. We need ElasPcity 4. MulP-‐model architectures 3. Too many nice-‐to-‐have features clda.co/serverless-‐workshop Workshop | 東京 5. Avoid lack of ownership

19. Machine Learning as a Service (MLaaS) Amazon  Machine Learning Azure  Machine Learning Google  PredicAon API IMB  Watson AnalyAcs BigML  Workshop | 東京clda.co/serverless-‐workshop

20. Amazon Machine Learning AmazonML One of the ﬁrst MLaaS soluPons (1 year old) Great service for classiﬁcaPon and regression Only linear models (linear & logisPc regression + SGD) No support for advanced scenarios yet Workshop | 東京clda.co/serverless-‐workshop

21. AmazonML @ Cloud Academy Workshop | 東京clda.co/serverless-‐workshop clda.co/7-‐day-‐free (no credit card required!)

22. Serverless compuAng to the rescue! Transparent scalability, elasPcity and availability Developer-‐friendly maintenance (versioning + aliases) AWS Lambda Event-‐driven approach & never pay for idle 1 funcPon = 1 model A/B tesPng via composiPon clda.co/serverless-‐workshop Workshop | 東京

23. clda.co/serverless-‐workshop Workshop | 東京

24. Quick Example clda.co/ML-‐Lambda clda.co/serverless-‐workshop Workshop | 東京

25. Thank you for aZending :) cloudacademy.com Q & A 10/04/2016 東京

Serverless Machine Learning Workshop

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Serverless Machine Learning Workshop

Similar to Serverless Machine Learning Workshop (20)

Recently uploaded

Recently uploaded (20)

Serverless Machine Learning Workshop