Production Machine Learning

•

1 like•380 views

www.productionml.org intro talk for Vancouver, BC machine learning meetup

Production ML
@osamakhn

who am I?
Osama Khan
Big Data Engineer @ACLServices
Grad Student @GTComputing
AWS Big Data Specialist+
! Vancouver, BC
" : Java " : C# (via J#) # : Python
$ : Golang, NodeJS % : Scala
Previously: Robot Soccer, Credit Rating, AML, O&G
Portfolio, NLP/Governance, Doctor Triage, Energy
Monitoring, Consulting, Private Equity
Recently: Data/ML Pipeline, Tools & Platforms

what are we going to
talk about?
The goal of this talk is to provide a high level overview
of the data landscape, introduce AWS and run
through an exercise of containerizing an ML service
1) Data Landscape (v2018): Changing ecosystem
and new roles
2) Just Enough AWS: AWS Intro, EC2, et. al
3) Workshop: RESTful ML Service
4) Demos: Athena, Sagemaker, Quicksight, ModelDB,
Heroku ML API, Docker ML API

classic model

classic model

classic model

data science silo
Data Source Data & Feature
Engineering
Adaptation of slide by Ben Lorica
Model
Building
Deploy
Monitor

maturity spectrum

what’s changing(-ed)?
1. Cloud (faas, serverless data pipelines, ml-as-a-service)
2. Consumer demand for ML features/products/applications
3. Targeted Models (we need to manage 20MM models for 10MM users maybe)
4. Localization (ASEAN facial recognition)
5. Security (Adv. ML, Side-channel attacks)
6. Transparency (Bias is a BUG)
7. Many toy sophisticated solutions but conventional, simpler techniques (regression)
still deliver more business value!
8. Monitoring to ensure deployed models are making high quality predictions
9. Need practices to maintain (update or rebuild) models over time
10. and ….

feature engineering, wat?
By @MLpuppy

data science (v2017+)

model: monitoring & maintenance
- What models are being deployed? [Model Inventory]
- Are we seeing deviations from expected performance? [Model Output monitoring]
- Reasons for performance degradation? [Data monitoring]
- Take action on out of ordinary situations

rise of machine learning engineers

intro to aws
https://acloud.guru

relevant technologies & references
https://acloud.guru
Storage Compute ETL Viz
CS349D: Cloud Computing Technology

DEMO: Sagemaker, Athena, Quicksight, RESTful ML

www.productionml.org

More Related Content

What's hot

On large-scale web sites, users leave thousands of traces every second. Businesses need to process and interpret these traces in real-time to be able to react on the behavior of their users. In this talk, Andreas will show a real world example of the power of a modern open-source stack. He will walk you through the design of a real-time clickstream analysis PAAS solution based on Apache Spark, Kafka, Parquet and HDFS, explain our decision making and present our lessons learned.

Clickstream Analysis With Apache Spark

Clickstream Analysis With Apache Spark

Clickstream Analysis With Apache Spark

Andreas Zitzelsberger

This session will begin with a short recap of how we created systems over the past 20 years, up to the current idea of building systems, using a Microservices architecture. What is a Microservices architecture and how does it differ from a Service-Oriented Architecture? Should you use traditional REST APIs to integrate services with each each other in a Microservices Architecture? Or is it better to use a more loosely-coupled protocol? Answers to these and many other questions are provided. The talk will show how a distributed log (event hub) can help to create a central, persistent history of events and what benefits we achieve from doing so. Apache Kafka is a perfect match for building such an asynchronous, loosely-coupled event-driven backbone. Events trigger processing logic, which can be implemented in a more traditional as well as in a stream processing fashion. The talk shows the difference between a request-driven and event-driven communication and answers when to use which. It highlights how a modern stream processing system can be used to hold state both internally as well as in a database and how this state can be used to further increase independence of other services, the primary goal of a Microservices architecture.

Building event-driven Microservices with Kafka Ecosystem

Building event-driven Microservices with Kafka Ecosystem

Building event-driven Microservices with Kafka Ecosystem

Due to explosion of IoT, we have streaming data that needs to be processed in real-time. This needs to be made available for applications as well as analytics scenarios such as anomaly detection. This workshop presents a solution using Confluent Cloud on Azure, Azure Cosmos DB and Azure Synapse Analytics which can be connected in a secure way within Azure VNET using Azure Private link configured on Kafka clusters.

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

HostedbyConfluent

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

With the rapid onset of the global Covid-19 Pandemic from the start of this year the USA Centers for Disease Control and Prevention (CDC) had to quickly implement a new Covid-19 specific pipeline to collect testing data from all of the USA’s states and territories, and carry out other critical steps including integration, cleaning, checking, enrichment, analysis, and enforcing data governance and privacy etc. The pipeline then produces multiple consumable results for federal and public agencies. They did this in under 30 days, using Apache Kafka. In this presentation we'll build a similar (but simpler) pipeline for ingesting, integrating, indexing, searching/analysing and visualising some publicly available tidal data. We'll briefly introduce each technology and component, and walk through the steps of using Apache Kafka, Kafka Connect, Elasticsearch and Kibana to build the pipeline and visualise the results.

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Most data visualisation solutions today still work on data sources which are stored persistently in a data store, using the so called “data at rest” paradigms. More and more data sources today provide a constant stream of data, from IoT devices to Social Media streams. These data stream publish with high velocity and messages often have to be processed as quick as possible. For the processing and analytics on the data, so called stream processing solutions are available. But these only provide minimal or no visualisation capabilities. One option is to first persist the data into a data store and then use a traditional data visualisation solution to present the data. If latency is not an issue, such a solution might be good enough. An other question is which data store solution is necessary to keep up with the high load on write and read. If it is not an RDBMS but an NoSQL database, then not all traditional visualisation tools might already integrate with the specific data store. An other option is to use a Streaming Visualisation solution. They are specially built for streaming data and often do not support batch data. A much better solution would be to have one tool capable of handling both, batch and streaming data. This talk presents different architecture blueprints for integrating data visualisation into a fast data solution and then we show how the different blueprints can be implemented by mapping products onto the blueprints.

Streaming Visualization

Streaming Visualization

Streaming Visualization

MongoDB at Baidu

MongoDB at Baidu

MongoDB at Baidu

Tinder’s Quickfire Pipeline powers all things data at Tinder. It was originally built using AWS Kinesis Firehoses and has since been extended to use both Kafka and other event buses. It is the core of Tinder’s data infrastructure. This rich data flow of both client and backend data has been extended to service a variety of needs at Tinder, including Experimentation, ML, CRM, and Observability, allowing backend developers easier access to shared client side data. We perform this using many systems, including Kafka, Spark, Flink, Kubernetes, and Prometheus. Many of Tinder’s systems were natively designed in an RPC first architecture. Things we’ll discuss decoupling your system at scale via event-driven architectures include: – Powering ML, backend, observability, and analytical applications at scale, including an end to end walk through of our processes that allow non-programmers to write and deploy event-driven data flows. – Show end to end the usage of dynamic event processing that creates other stream processes, via a dynamic control plane topology pattern and broadcasted state pattern – How to manage the unavailability of cached data that would normally come from repeated API calls for data that’s being backfilled into Kafka, all online! (and why this is not necessarily a “good” idea) – Integrating common OSS frameworks and libraries like Kafka Streams, Flink, Spark and friends to encourage the best design patterns for developers coming from traditional service oriented architectures, including pitfalls and lessons learned along the way. – Why and how to avoid overloading microservices with excessive RPC calls from event-driven streaming systems – Best practices in common data flow patterns, such as shared state via RocksDB + Kafka Streams as well as the complementary tools in the Apache Ecosystem. – The simplicity and power of streaming SQL with microservices

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Organizational success depends on our ability to sense the environment, grab opportunities and eliminate threats that are present in real-time. Such real-time processing is now available to all organizations (with or without a big data background) through the new WSO2 Stream Processor. This slides presents WSO2 Stream Processor’s new features and improvements and explains how they make an organization excel in the current competitive marketplace. Some key features we will consider are: * WSO2 Stream Processor’s highly productive developer environment, with graphical drag-and-drop, and the Streaming SQL query editor * The ability to process real-time queries that span from seconds to years * Its interactive visualization and dashboarding features with improved widget generation * Its ability to processing at scale via distributed deployments with full observability * Default support for HTTP analytics, distributed message trace analytics, and Twitter analytics

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

Sriskandarajah Suhothayan

At Netflix, the big data platform is the foundation for analytics that drive all product decisions that directly impact our customer experience. As for scale, it is one of the top three largest services running at Netflix, in terms of compute power and data size. In this talk, we will take the audience through a journey to understand how we scale the platform to handle the increasing amount of data (over 500 billion events generated daily), the increasing demand of analytics (which translates to compute power), and the increasing number of users dependent on our platform to make business decisions.

The evolution of the big data platform @ Netflix (OSCON 2015)

The evolution of the big data platform @ Netflix (OSCON 2015)

The evolution of the big data platform @ Netflix (OSCON 2015)

Real-Time Analytics with Confluent and MemSQL

Real-Time Analytics with Confluent and MemSQL

Real-Time Analytics with Confluent and MemSQL

Today's modern data architectures and the their implementations contain an Event Hub. What are the benefits of placing an Event Hub in a Modern Data (Analytics) Architecture? What exactly is an Event Hub and what capabilities should it provide? Why is Apache Kafka the most popular realization of an Event Hub? These and many other questions will be answered in this session. The talk will start with a vendor-neutral definition of the capabilities of an Event Hub. Then the session will highlight the different architecture styles which can be supported using an Event Hub (Kafka), such as Streaming Data Integration, Stream Analytics and Decoupled Event-Driven Applications and how can these be combined into a unified architecture, making the Event Hub the central nervous system of an enterprise architecture. We will end with an overview of the Kafka ecosystem and a placement of the various components onto the Modern Data (Analytics) Architecture.

Event Hub (i.e. Kafka) in Modern Data Architecture

Event Hub (i.e. Kafka) in Modern Data Architecture

Event Hub (i.e. Kafka) in Modern Data Architecture

Building a real-time, scalable and intelligent programmatic ad buying platform

Building a real-time, scalable and intelligent programmatic ad buying platform

Building a real-time, scalable and intelligent programmatic ad buying platform

80% of the time in every project is spent on data integration: Getting the data you want the way you want it. This problem remains challenging despite 40 years of attempts to solve it. We want a reliable, low latency system that can handle varied data from wide range of data management systems. We want a solution that is easy to manage and easy to scale. Is it too much to ask? In this presentation, we’ll discuss the basic challenges of data integration and introduce design and architecture patterns that are used to tackle these challenges. We will explore how these patterns can be implemented using Apache Kafka and share pragmatic solutions that many engineering organizations used to build fast, scalable and manageable data pipelines. Speaker: Gwen Shapira Gwen Shapira is a system architect at Confluent, where she helps customers achieve success with their Apache Kafka implementation. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. Gwen currently specializes in building real-time reliable data-processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, the coauthor of Hadoop Application Architectures, and a frequent presenter at industry conferences. She is also a committer on Apache Kafka and Apache Sqoop. When Gwen isn’t coding or building data pipelines, you can find her pedaling her bike, exploring the roads and trails of California and beyond.

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

Most data visualisation solutions today still work on data sources which are stored persistently in a data store, using the so called “data at rest” paradigms. More and more data sources today provide a constant stream of data, from IoT devices to Social Media streams. These data stream publish with high velocity and messages often have to be processed as quick as possible. For the processing and analytics on the data, so called stream processing solutions are available. But these only provide minimal or no visualisation capabilities. One option is to first persist the data into a data store and then use a traditional data visualisation solution to present the data. If latency is not an issue, such a solution might be good enough. An other question is which data store solution is necessary to keep up with the high load on write and read. If it is not an RDBMS but an NoSQL database, then not all traditional visualisation tools might already integrate with the specific data store. An other option is to use a Streaming Visualisation solution. They are specially built for streaming data and often do not support batch data. A much better solution would be to have one tool capable of handling both, batch and streaming data. This talk presents different architecture blueprints for integrating data visualisation into a fast data solutions and then we show how the different blueprints can be implemented by mapping products onto the blueprints.

Streaming Visualisation

Streaming Visualisation

Streaming Visualisation

A new generation of technologies is needed to consume and exploit today's real time, fast moving data sources. Apache Kafka, originally developed at LinkedIn, has emerged as one of these key new technologies. This webinar explores the use-cases and architecture for Kafka, and how it integrates with MongoDB to build sophisticated data-driven applications that exploit new sources of data. Watch the webinar to learn: - What MongoDB is and where it's used - What data streaming is and where it fits into modern data architectures - How Kafka works, what it delivers, and where it's used - How to operationalize the Data Lake with MongoDB & Kafka - How MongoDB integrates with Kafka – both as a producer and a consumer of event data The webinar is co-presented with Confluent, the company founded by the creators of Apache Kafka.

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Should we use traditional REST APIs to bind services together? Or is it better to use a more loosely-coupled protocol? This talk will dive into how we piece services together in event driven systems, how we use a distributed log (event hub) to create a central, persistent history of events and what benefits we achieve from doing so. Apache Kafka is a perfect match for building an asynchronous, loosely-coupled event-driven backbone. Events trigger processing logic, which can be implemented in a traditional as well as in a stream processing fashion. The talk will show the difference between a request-driven and event-driven communication and show when to use which.

Building Event-Driven (Micro)Services with Apache Kafka

Building Event-Driven (Micro)Services with Apache Kafka

Building Event-Driven (Micro)Services with Apache Kafka

Independent of the source of data, the integration of event streams into an Enterprise Architecture gets more and more important in the world of sensors, social media streams and Internet of Things. Events have to be accepted quickly and reliably, they have to be distributed and analyzed, often with many consumers or systems interested in all or part of the events. Storing such huge event streams into HDFS or a NoSQL datastore is feasible and not such a challenge anymore. But if you want to be able to react fast, with minimal latency, you can not afford to first store the data and doing the analysis/analytics later. You have to be able to include part of your analytics right after you consume the data streams. Products for doing event processing, such as Oracle Event Processing or Esper, are available for quite a long time and used to be called Complex Event Processing (CEP). In the past few years, another family of products appeared, mostly out of the Big Data Technology space, called Stream Processing or Streaming Analytics. These are mostly open source products/frameworks such as Apache Storm, Spark Streaming, Flink, Kafka Streams as well as supporting infrastructures such as Apache Kafka. In this talk I will present the theoretical foundations for Stream Processing, discuss the core properties a Stream Processing platform should provide and highlight what differences you might find between the more traditional CEP and the more modern Stream Processing solutions.

Introduction to Stream Processing

Introduction to Stream Processing

Introduction to Stream Processing

What's hot (20)

Clickstream Analysis With Apache Spark

Clickstream Analysis With Apache Spark

Clickstream Analysis With Apache Spark

Building event-driven Microservices with Kafka Ecosystem

Building event-driven Microservices with Kafka Ecosystem

Building event-driven Microservices with Kafka Ecosystem

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

Machine Learning on Streaming Data using Kafka, Beam, and TensorFlow (Mikhail...

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...

Streaming Visualization

Streaming Visualization

Streaming Visualization

MongoDB at Baidu

MongoDB at Baidu

MongoDB at Baidu

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

WSO2 Stream Processor: Graphical Editor, HTTP & Message Trace Analytics and m...

The evolution of the big data platform @ Netflix (OSCON 2015)

The evolution of the big data platform @ Netflix (OSCON 2015)

The evolution of the big data platform @ Netflix (OSCON 2015)

Real-Time Analytics with Confluent and MemSQL

Real-Time Analytics with Confluent and MemSQL

Real-Time Analytics with Confluent and MemSQL

Event Hub (i.e. Kafka) in Modern Data Architecture

Event Hub (i.e. Kafka) in Modern Data Architecture

Event Hub (i.e. Kafka) in Modern Data Architecture

Building a real-time, scalable and intelligent programmatic ad buying platform

Building a real-time, scalable and intelligent programmatic ad buying platform

Building a real-time, scalable and intelligent programmatic ad buying platform

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

SF big Analytics : Stream all things by Gwen Shapira @ Lyft 2018

Streaming Visualisation

Streaming Visualisation

Streaming Visualisation

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Rediscovering the Value of Apache Kafka® in Modern Data Architecture

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Webinar: Data Streaming with Apache Kafka & MongoDB

Building Event-Driven (Micro)Services with Apache Kafka

Building Event-Driven (Micro)Services with Apache Kafka

Building Event-Driven (Micro)Services with Apache Kafka

Introduction to Stream Processing

Introduction to Stream Processing

Introduction to Stream Processing

Similar to Production Machine Learning

Seminario de Cloud Computing na UFRRJ

Seminario de Cloud Computing na UFRRJ

Seminario de Cloud Computing na UFRRJ

Alex Barbosa Coqueiro

AWS re:Invent 2016 : announcement, technical demos and feedbacks

AWS re:Invent 2016 : announcement, technical demos and feedbacks

AWS re:Invent 2016 : announcement, technical demos and feedbacks

Emmanuel Quentin

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Amazon Web Services

Cloud Architectures - Jinesh Varia - GrepTheWeb

Cloud Architectures - Jinesh Varia - GrepTheWeb

Cloud Architectures - Jinesh Varia - GrepTheWeb

C# Client to Cloud

C# Client to Cloud

C# Client to Cloud

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Amazon Web Services

Solution architecture Amazon web services

Solution architecture Amazon web services

Solution architecture Amazon web services

Sandeep Sharma IIMK Smart City,IoT,Bigdata,Cloud,BI,DW

Big Data Analytics from Azure Cloud to Power BI Mobile

Big Data Analytics from Azure Cloud to Power BI Mobile

Big Data Analytics from Azure Cloud to Power BI Mobile

tapanbanker.com-Tapan-N-Banker-Resume

tapanbanker.com-Tapan-N-Banker-Resume

tapanbanker.com-Tapan-N-Banker-Resume

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

Amazon Web Services Korea

Solution Architecture - AWS

Solution Architecture - AWS

Solution Architecture - AWS

Sandeep Sharma IIMK Smart City,IoT,Bigdata,Cloud,BI,DW

20181027 deep learningcommunity_aws

20181027 deep learningcommunity_aws

20181027 deep learningcommunity_aws

Hirokuni Uchida

Architecting an Open Source AI Platform 2018 edition

Architecting an Open Source AI Platform 2018 edition

Architecting an Open Source AI Platform 2018 edition

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

Intro Presentation at AWS AWSome Day Dublin July 2015

Intro Presentation at AWS AWSome Day Dublin July 2015

Intro Presentation at AWS AWSome Day Dublin July 2015

Data Con LA 2020 Description Join us to learn about Stargate! Stargate is a data gateway deployed between client applications and a database. It's built with extensibility as a first-class citizen and makes it easy to use a database for any application workload by adding plugin support for new APIs, data types, and access methods. After detailing the architecture and ideas behind the frameworks we will demo the creation of REST and GraphQL APIs on top of Cassandra through simple configuration. Bring back home a working sample ! Speaker Cedrick Lunven, Director of Developer Advocacy, Datastax

Stargate, the gateway for some multi-models data API

Stargate, the gateway for some multi-models data API

Stargate, the gateway for some multi-models data API

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Amazon Web Services

Microservices and Serverless computing allow you to build and run simpler and more efficient applications, while improving your agility and saving a lot of money. The ability to deploy your applications without the need for provisioning or managing servers opens for startups new opportunities to build web, mobile, and IoT backends; run stream processing or big data workloads; run chatbots, and more, without the investment in hardware or professional manpower to run this hardware. In this session, we will learn how to get started with Microservices and Serverless computing with AWS Lambda, which lets you run code without provisioning or managing servers.

Microservices and serverless for MegaStartups - DLD TLV 2017

Microservices and serverless for MegaStartups - DLD TLV 2017

Microservices and serverless for MegaStartups - DLD TLV 2017

Similar to Production Machine Learning (20)

Seminario de Cloud Computing na UFRRJ

Seminario de Cloud Computing na UFRRJ

Seminario de Cloud Computing na UFRRJ

AWS re:Invent 2016 : announcement, technical demos and feedbacks

AWS re:Invent 2016 : announcement, technical demos and feedbacks

AWS re:Invent 2016 : announcement, technical demos and feedbacks

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Semplificare l'analisi dei dati con architetture "Serverless": architetture e...

Cloud Architectures - Jinesh Varia - GrepTheWeb

Cloud Architectures - Jinesh Varia - GrepTheWeb

Cloud Architectures - Jinesh Varia - GrepTheWeb

C# Client to Cloud

C# Client to Cloud

C# Client to Cloud

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Aberdeen Oil & Gas Event - Enterprise Cloud Adoption Patterns

Solution architecture Amazon web services

Solution architecture Amazon web services

Solution architecture Amazon web services

Big Data Analytics from Azure Cloud to Power BI Mobile

Big Data Analytics from Azure Cloud to Power BI Mobile

Big Data Analytics from Azure Cloud to Power BI Mobile

tapanbanker.com-Tapan-N-Banker-Resume

tapanbanker.com-Tapan-N-Banker-Resume

tapanbanker.com-Tapan-N-Banker-Resume

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

20141021 AWS Cloud Taekwon - Startup Best Practices on AWS

Solution Architecture - AWS

Solution Architecture - AWS

Solution Architecture - AWS

20181027 deep learningcommunity_aws

20181027 deep learningcommunity_aws

20181027 deep learningcommunity_aws

Architecting an Open Source AI Platform 2018 edition

Architecting an Open Source AI Platform 2018 edition

Architecting an Open Source AI Platform 2018 edition

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

Astroinformatics 2014: Scientific Computing on the Cloud with Amazon Web Serv...

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

Intro Presentation at AWS AWSome Day Dublin July 2015

Intro Presentation at AWS AWSome Day Dublin July 2015

Intro Presentation at AWS AWSome Day Dublin July 2015

Stargate, the gateway for some multi-models data API

Stargate, the gateway for some multi-models data API

Stargate, the gateway for some multi-models data API

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Lessons & Use-Cases at Scale - Dr. Pete Stanski

Microservices and serverless for MegaStartups - DLD TLV 2017

Microservices and serverless for MegaStartups - DLD TLV 2017

Microservices and serverless for MegaStartups - DLD TLV 2017

Recently uploaded

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Histor y of HAM Radio presentation slide

Histor y of HAM Radio presentation slide

Histor y of HAM Radio presentation slide

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Slack Application Development 101 Slides

Slack Application Development 101 Slides

Slack Application Development 101 Slides

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Choosing the right accounts payable services provider is a strategic decision that can significantly impact your business's financial performance and operational efficiency. By considering factors such as expertise, range of services, technology infrastructure, scalability, cost, and reputation, businesses can make informed decisions and select a provider that aligns with their unique needs and objectives. Partnering with the right provider can streamline accounts payable processes, drive cost savings, and position your business for long-term success. https://katprotech.com/accounts-payable-and-purchase-order-automation/

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Katpro Technologies

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

What are drone anti-jamming systems? The drone anti-jamming systems and anti-spoof technology protect against interference, jamming, and spoofing of the UAVs. To protect their security, countries are beginning to research drone anti-jamming systems, also known as drone strike weapons. The anti-jam and anti-spoof technology protects against interference, jamming and spoofing. A drone strike weapon is a drone attack weapon that can attack and destroy enemy drones. So what is so unique about this amazing system?

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

Antenna Manufacturer Coco

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Delhi Call girls

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

Recently uploaded (20)

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Histor y of HAM Radio presentation slide

Histor y of HAM Radio presentation slide

Histor y of HAM Radio presentation slide

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Slack Application Development 101 Slides

Slack Application Development 101 Slides

Slack Application Development 101 Slides

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

Production Machine Learning

1. Production ML @osamakhn

2. who am I? Osama Khan Big Data Engineer @ACLServices Grad Student @GTComputing AWS Big Data Specialist+ ! Vancouver, BC " : Java " : C# (via J#) # : Python $ : Golang, NodeJS % : Scala Previously: Robot Soccer, Credit Rating, AML, O&G Portfolio, NLP/Governance, Doctor Triage, Energy Monitoring, Consulting, Private Equity Recently: Data/ML Pipeline, Tools & Platforms

3. what are we going to talk about? The goal of this talk is to provide a high level overview of the data landscape, introduce AWS and run through an exercise of containerizing an ML service 1) Data Landscape (v2018): Changing ecosystem and new roles 2) Just Enough AWS: AWS Intro, EC2, et. al 3) Workshop: RESTful ML Service 4) Demos: Athena, Sagemaker, Quicksight, ModelDB, Heroku ML API, Docker ML API

4. classic model

5. classic model

6. classic model

7. data science silo Data Source Data & Feature Engineering Adaptation of slide by Ben Lorica Model Building Deploy Monitor

8. maturity spectrum

9. what’s changing(-ed)? 1. Cloud (faas, serverless data pipelines, ml-as-a-service) 2. Consumer demand for ML features/products/applications 3. Targeted Models (we need to manage 20MM models for 10MM users maybe) 4. Localization (ASEAN facial recognition) 5. Security (Adv. ML, Side-channel attacks) 6. Transparency (Bias is a BUG) 7. Many toy sophisticated solutions but conventional, simpler techniques (regression) still deliver more business value! 8. Monitoring to ensure deployed models are making high quality predictions 9. Need practices to maintain (update or rebuild) models over time 10. and ….

10. feature engineering, wat? By @MLpuppy

11. data science (v2017+)

12. model: monitoring & maintenance - What models are being deployed? [Model Inventory] - Are we seeing deviations from expected performance? [Model Output monitoring] - Reasons for performance degradation? [Data monitoring] - Take action on out of ordinary situations

13. rise of machine learning engineers

14. intro to aws https://acloud.guru

15. relevant technologies & references https://acloud.guru Storage Compute ETL Viz CS349D: Cloud Computing Technology

16. DEMO: Sagemaker, Athena, Quicksight, RESTful ML

17. www.productionml.org