Reinventing Deep Learning  with Hugging Face Transformers

•

3 likes•864 views

Julien SIMON

Talk @ Big Data AI Paris, 26/09/2022

2022: Transformers are eating Deep Learning
BERT
ROBERTA
GPT-2
GPT-3
VISION TRANSFORMER
WAV2VEC2
CLIP
SEGFORMER
STABLE DIFFUSION
"Transformers are emerging as a general-purpose architecture for ML"
https://www.stateof.ai/
RNN and CNN usage down, Transformers usage up!
https://www.kaggle.com/kaggle-survey-2021
RNN
CNN
LSTM

Neural networks
Building
large
datasets
GPUs
Expert
tools
Deep Learning: how it started

Deep Learning: how it's going
87% of data science
projects never
make it into produc
ti
on
https://venturebeat.com/2019/07/19/
why-do-87-of-data-science-projects-
never-make-it-into-production
Only 25% of
companies report
widespread adop
ti
on
https://www.pwc.com/us/en/tech-
effect/ai-analytics/ai-
predictions.html

Transformers
Transfer
Learning
ML Hardware
Developer
tools
Deep Learning 2.0

7
Hugging Face: one of the fastest-growing open source projects
https://github.com/huggingface/transformers/

The Hugging Face Hub: The Github of Machine Learning
73,000+ models
10,000+ datasets
10,000+ organiza
ti
ons
100,000+ users
1M+ downloads daily
h
tt
ps://huggingface.co

Machine Learning Hardware
• A new generation of chips designed for ML workloads
• Faster training
• 6-hour training 2x faster? Several iterations in a single day!
• Faster prediction
• Lower latency, increased throughput
• Better cost-performance ratio
• Hugging Face partners with hardware innovators
https://github.com/huggingface/optimum
•

Developer Tools
Model in
production
10,000+ datasets
on the hub
73,000+ models
on the hub
No-code AutoML
HW-accelerated
managed API
HW-accelerated
inference
Hosted ML
applications
HW-accelerated training
Amazon SageMaker
Optimum
Datasets
Models
Hugging Face Endpoints
for Azure
Transformers
Accelerate
Optimum

Summing things up
• ML is complicated because we love to make it complicated
• Make sure your teams focus on the right things
1. Define business goals and KPIs
2. Save time with pre-trained models and transfer learning
3. Don't reinvent tools, platform, infrastructure
4. Collaborate on models and datasets

Learn more about Hugging Face and Transformers
https://huggingface.co/tasks
https://huggingface.co/course
https://github.com/huggingface
Hugging Face Endpoints launch event (27/9): https://shorturl.at/gJQSX
Learn more about our solutions
https://huggingface.co/support - Expert Acceleration Program, from modeling to production
https://huggingface.co/platform - Private Hub, running on your infrastructure (on prem or cloud)
Getting started Stay in touch!
@julsimon
julsimon.medium.com
youtube.com/c/juliensimonfr

Dmitry Kan, Principal AI Scientist at Silo AI and host of the Vector Podcast [1], will give an overview of the landscape of vector search databases and their role in NLP, along with the latest news and his view on the future of vector search. Further, he will share how he and his team participated in the Billion-Scale Approximate Nearest Neighbor Challenge and improved recall by 12% over a baseline FAISS. Presented at https://www.meetup.com/open-nlp-meetup/events/282678520/ YouTube: https://www.youtube.com/watch?v=RM0uuMiqO8s&t=179s Follow Vector Podcast to stay up to date on this topic: https://www.youtube.com/@VectorPodcast

HuggingFace AI - Hugging Face lets users create interactive, in-browser demos...

Bluechip Technologies

LangChain is an advanced framework that allows developers to create language model-powered applications. It provides a set of tools, components, and interfaces that make building LLM-based applications easier. With LangChain, managing interactions with language models, chaining together various components, and integrating resources like APIs and databases is a breeze. The platform includes a set of APIs that can be integrated into applications, allowing developers to add language processing capabilities without having to start from scratch.

Fine tuning large LMs

SylvainGugger

End to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage

Animesh Singh

With the breadth of sheer functionalities which need to be addressed in the Machine Learning world around building, training, serving and managing models, getting it done in a consistent, composable, portable, and scalable manner is hard. The Kubernetes framework is well suited to address these issues, which is why it's a great foundation for deploying ML workloads. Kubeflow is designed to take advantage of these benefits. In this talk, we are going to address how to make it easy for everyone to develop, deploy, and manage portable, scalable ML everywhere and support the full lifecycle Machine Learning using open source technologies like Kubeflow, Tensorflow, PyTorch,Tekton, Knative, Istio and others. We are going to discuss how to enable distributed training of models, model serving, canary rollouts, drift detection, model explainability, metadata management, pipelines and others. Additionally we will discuss Watson productization in progress based on Kubeflow Pipelines and Tekton, and point to Kubeflow Dojo materials and follow-on workshops.

Deep learning for NLP and Transformer

Arvind Devaraj

Lecture 4: Transformers (Full Stack Deep Learning - Spring 2021)

Sergey Karayev

BERT introduction

Hanwha System / ICT

Transformer Seq2Sqe Models: Concepts, Trends & Limitations (DLI)

Deep Learning Italia

Customizing LLMs

Jim Steele

What is MLOps

Henrik Skogström

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Minh Pham

Landscape of AI/ML in 2023

HyunJoon Jung

Transformer Introduction (Seminar Material)

Yuta Niki

MLOps for production-level machine learning

cnvrg.io AI OS - Hands-on ML Workshops

MLOps (a compound of “machine learning” and “operations”) is a practice for collaboration and communication between data scientists and operations professionals to help manage the production machine learning lifecycle. Similar to the DevOps term in the software development world, MLOps looks to increase automation and improve the quality of production ML while also focusing on business and regulatory requirements. MLOps applies to the entire ML lifecycle - from integrating with model generation (software development lifecycle, continuous integration/continuous delivery), orchestration, and deployment, to health, diagnostics, governance, and business metrics. To watch the full presentation click here: https://info.cnvrg.io/mlopsformachinelearning In this webinar, we’ll discuss core practices in MLOps that will help data science teams scale to the enterprise level. You’ll learn the primary functions of MLOps, and what tasks are suggested to accelerate your teams machine learning pipeline. Join us in a discussion with cnvrg.io Solutions Architect, Aaron Schneider, and learn how teams use MLOps for more productive machine learning workflows. - Reduce friction between science and engineering - Deploy your models to production faster - Health, diagnostics and governance of ML models - Kubernetes as a core platform for MLOps - Support advanced use-cases like continual learning with MLOps

DeepScale: Real-Time Perception for Automated Driving

Forrest Iandola

The Steep Forces Driving Cloud Computing

Craig Rispin

What's hot

LLMs_talk_March23.pdf

ChaoYang81

Yurii Pashchenko: Zero-shot learning capabilities of CLIP model from OpenAI

Lviv Startup Club

Introduction to Transformer Model

Nuwan Sriyantha Bandara

Mother of Language`s Langchain

Jun-hang Lee

MLOps with Kubeflow

Saurabh Kaushik

gpt3_presentation.pdf

Giacomo Frisoni

Bert

Abdallah Bashir

Build an LLM-powered application using LangChain.pdf

AnastasiaSteele10

Fine tuning large LMs

SylvainGugger

End to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage

Animesh Singh

Deep learning for NLP and Transformer

Arvind Devaraj

Lecture 4: Transformers (Full Stack Deep Learning - Spring 2021)

Sergey Karayev

BERT introduction

Hanwha System / ICT

Transformer Seq2Sqe Models: Concepts, Trends & Limitations (DLI)

Deep Learning Italia

Customizing LLMs

Jim Steele

What is MLOps

Henrik Skogström

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Minh Pham

Landscape of AI/ML in 2023

HyunJoon Jung

Transformer Introduction (Seminar Material)

Yuta Niki

MLOps for production-level machine learning

cnvrg.io AI OS - Hands-on ML Workshops

What's hot (20)

LLMs_talk_March23.pdf

Yurii Pashchenko: Zero-shot learning capabilities of CLIP model from OpenAI

Introduction to Transformer Model

Mother of Language`s Langchain

MLOps with Kubeflow

gpt3_presentation.pdf

Bert

Build an LLM-powered application using LangChain.pdf

Fine tuning large LMs

End to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage

Deep learning for NLP and Transformer

Lecture 4: Transformers (Full Stack Deep Learning - Spring 2021)

BERT introduction

Transformer Seq2Sqe Models: Concepts, Trends & Limitations (DLI)

Customizing LLMs

What is MLOps

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Landscape of AI/ML in 2023

Transformer Introduction (Seminar Material)

MLOps for production-level machine learning

Similar to Reinventing Deep Learning  with Hugging Face Transformers

DeepScale: Real-Time Perception for Automated Driving

Forrest Iandola

The Steep Forces Driving Cloud Computing

Craig Rispin

DevOps Done Right The How and Why of Versioning Environment Artifacts

Perforce

If you have ever been tasked with figuring out how to deal with large sets of files or large binaries in a version control system, you’ve probably had problems with performance, reliability and scalability. While there are workarounds that can address some of these issues, the workarounds introduce their own complexity that can be difficult to implement and support. Gene Kim has talked many times (most recently at PuppetConf 2014) about the importance of not only versioning source code but other assets, too. Version control is more important than ever as more companies embrace DevOps and Continuous Delivery and Deployment.

2019 Performance Monitoring and Management Trends and Insights

OpsRamp

Join 451 Research's Senior Analyst Nancy Gohring and OpsRamp's Vice President of Marketing Darren Cunningham as they discuss the latest trends in IT monitoring and management. This interactive webinar will review the latest research and feature a live Q&A on what's hot, what's new, and what's next in this dynamic and distributed market. Sponsored by OpsRamp, this webinar will also provide an overview of OpsRamp's service-centric AIOps platform and how OpsRamp customers are controlling the chaos with a new approach to IT operations as a service. To learn more, visit https://www.opsramp.com/about-opsramp... Also, follow us on social media channels to learn about product highlights, news, announcements, events, conferences and more - Twitter - https://www.twitter.com/OpsRamp LinkedIn - https://www.linkedin.com/company/opsramp Facebook - https://www.facebook.com/OpsRampHQ/

Securing a great DX - DevSecOps Days Singapore 2018

Stefan Streichsbier

In the software engineering world, change is the only constant. And in the course of the last decades, the frequency of that change has exploded. What Agile has brought to software teams, DevOps is now bringing to the entire organization. And the results speak for themselves. The DevOps high-performers are killing it. Insane deploy frequencies of features, high reliability of applications, and high productivity of cross-functional teams have amplified the speed at which ideas become a reality. In parallel, Application Security was doing its own thing and to a large part remained oblivious to all the impressive improvements that were happening in software engineering. Because breaking an application doesn’t need any knowledge of how it was created in the first place. This talk will cover anti-patterns that are preventing application security from being adopted by development teams, such as: * Signals versus Noise * Lost in Translation * Make it easy

Making a Better World with Technology Innovations

Imesh Gunaratne

ISC 2016 Day 3 Recap

OpenPOWERorg

Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...

Burr Sutter

We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.

AI in the enterprise

Ganesan Narayanasamy

NVIDIA GTC21 AI Conference Highlights

Alex G. Lee, Ph.D. Esq. CLP

Selected Topics Modern Artificial Intelligence 1980s-2021 and Beyond A Vision for the Next Decade of Computing The Next Decade in AI: Four Steps Toward Robust Artificial Intelligence Keras and TensorFlow: The Next Five Years A Vision for the Future of ML Frameworks AI Implementation at Scale: Lessons from the Front Lines A Future with Self-Driving Vehicles Advances in Renewable Energy: Enabling Our Decarbonized Energy Future with Technology Innovations and Smart Operations Accelerating Health Care at Bayer with Science@Scale and Federated Learning Large-Scale Deep Learning Recommendation Models at Facebook Is AI at the Edge the Killer App for 5G? Deep Learning for Anomaly Detection From Storytelling to StoryLiving: A Vision for the Future of Immersive Entertainment A New Era in Virtual Cinematography Digital Transformation Is Here: Augmenting Human Capacity with Exponential Compute Rethinking Drug Discovery in the Era of Digital Biology Representation Learning for Autonomous Robots Architecting the Secure Accelerated Data Center of the Future Convergence of AI and HPC to Solve Grand Challenge Science Problems Presenting US HHS Artificial Intelligence Strategy 2021: AI Mission and Ambition Commentary by the CAIO

Big data and the challenge of extreme informationJohn Mancini

[DSC Adria 23] Tarry Singh Building High dencity startup.pdf

DataScienceConferenc1

Monitoring the #DevOps way

Theo Schlossnagle

OIT Technology, Communications, Japan

Christos Makiyama

Fabric for Deep Learning

Animesh Singh

Securing a Great Developer Experience - DevOps Indonesia Meetup by Stefan Str...

DevOps Indonesia

Innovations using PowerAI

Ganesan Narayanasamy

Monitoring of GPU Usage with Tensorflow Models Using Prometheus

Databricks

Understanding the dynamics of GPU utilization and workloads in containerized systems is critical to creating efficient software systems. We create a set of dashboards to monitor and evaluate GPU performance in the context of TensorFlow. We monitor performance in real time to gain insight into GPU load, GPU memory and temperature metrics in a Kubernetes GPU enabled system. Visualizing TensorFlow training job metrics in real time using Prometheus allows us to tune and optimize GPU usage. Also, because Tensor flow jobs can have both GPU and CPU implementations it is useful to view detailed real time performance data from each implementation and choose the best implementation. To illustrate our system, we will show a live demo gathering and visualizing GPU metrics on a GPU enabled Kubernetes cluster with Prometheus and Grafana.

Think Silicon at Open Coffee Athens XCIV

Open Coffee Greece

ThinkSilicon at Open Coffee Athens XCIV

Open Coffee Greece

Similar to Reinventing Deep Learning  with Hugging Face Transformers (20)

DeepScale: Real-Time Perception for Automated Driving

The Steep Forces Driving Cloud Computing

DevOps Done Right The How and Why of Versioning Environment Artifacts

2019 Performance Monitoring and Management Trends and Insights

Securing a great DX - DevSecOps Days Singapore 2018

Making a Better World with Technology Innovations

ISC 2016 Day 3 Recap

Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...

AI in the enterprise

NVIDIA GTC21 AI Conference Highlights

Big data and the challenge of extreme information

[DSC Adria 23] Tarry Singh Building High dencity startup.pdf

Monitoring the #DevOps way

OIT Technology, Communications, Japan

Fabric for Deep Learning

Securing a Great Developer Experience - DevOps Indonesia Meetup by Stefan Str...

Innovations using PowerAI

Monitoring of GPU Usage with Tensorflow Models Using Prometheus

Think Silicon at Open Coffee Athens XCIV

ThinkSilicon at Open Coffee Athens XCIV

More from Julien SIMON

Building Machine Learning Models Automatically (June 2020)

Julien SIMON

Starting your AI/ML project right (May 2020)

Julien SIMON

Scale Machine Learning from zero to millions of users (April 2020)

Julien SIMON

An Introduction to Generative Adversarial Networks (April 2020)

Julien SIMON

AIM410R1 Deep learning applications with TensorFlow, featuring Fannie Mae (De...

Julien SIMON

AIM361 Optimizing machine learning models with Amazon SageMaker (December 2019)

Julien SIMON

AIM410R Deep Learning Applications with TensorFlow, featuring Mobileye (Decem...

Julien SIMON

A pragmatic introduction to natural language processing models (October 2019)

Julien SIMON

Building smart applications with AWS AI services (October 2019)

Julien SIMON

Build, train and deploy ML models with SageMaker (October 2019)

Julien SIMON

The Future of AI (September 2019)

Julien SIMON

Building Machine Learning Inference Pipelines at Scale (July 2019)

Julien SIMON

Talk at OSCON, Portland, 18/07/2019 Real-life Machine Learning applications require more than a single model. Data may need pre-processing: normalization, feature engineering, dimensionality reduction, etc. Predictions may need post-processing: filtering, sorting, combining, etc. Our goal: build scalable ML pipelines with open source (Spark, Scikit-learn, XGBoost) and managed services (Amazon EMR, AWS Glue, Amazon SageMaker)

Train and Deploy Machine Learning Workloads with AWS Container Services (July...

Julien SIMON

Optimize your Machine Learning Workloads on AWS (July 2019)

Julien SIMON

Deep Learning on Amazon Sagemaker (July 2019)

Julien SIMON

Automate your Amazon SageMaker Workflows (July 2019)

Julien SIMON

Build, train and deploy ML models with Amazon SageMaker (May 2019)

Julien SIMON

Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)

Julien SIMON

Become a Machine Learning developer with AWS services (May 2019)

Julien SIMON

Scaling Machine Learning from zero to millions of users (May 2019)

Julien SIMON

More from Julien SIMON (20)