TechWiseTV Workshop: Improving Performance and Agility with Cisco HyperFlexRobb Boyd
Find out how organizations like yours are deriving business value from the HyperFlex HCI solution. Join us for a deep dive and Q&A at the TechWiseTV workshop.
TechWiseTV Hyperflex 4.0 Episode: http://cs.co/9009EW2Td
O futuro das empresas passa pelas constantes transformações digitais e, para isso, é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras. Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas para integração entre as equipes de desenvolvimento de software.
Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática. Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
DevOps began as a way to deliver availability and survive agile methodologies. Along the way to CI/CD, it has become an overwhelming set of tools cobbled together to deploy code. Simultaneously, applications moved to mobile and IoT devices and from simple application servers to front end, backend, cloud, and microservices. The monitor stage of DevOps has exceeded the human capability for comprehension.
We are missing things and that leads to outages. We need to augment ourselves with ML & automation.
During this session, I want you to think about your last war-room incident and consider whether you are reactive or proactive. By augmenting ourselves through AIOps, we move towards the nirvana of being preemptive.
SPEAKER BIO:
Marco Coulter, Technical Evangelist | AppDynamics
As the Technical Evangelist for AIOps at AppDynamics, Marco Coulter is passionate about the experience humans have when interacting with technology. A former startup CTO, Marco has progressed from operator to leadership roles at CSC, CA Technologies, and more recently 451 Research, where he led the data science team. He earned the nickname "the tech-whisperer" for his skills in translating business drivers for a technical audience and technical concepts for business leaders. When taking the rare break from technology, Marco can be found harvesting fresh vegetables from his NYC garden.
Meetup - DevSecOps: Colocando segurança na esteira
Material apresentado no 12º Meetup do Scrum-Aplicado - 18/09/2019 às 19hrs.
O futuro das empresas passa pelas constantes transformações digitais e, para isso,
é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras.
Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas
para integração entre as equipes de desenvolvimento de software.
Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática.
Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento
e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
O futuro das empresas passa pelas constantes transformações digitais e, para isso, é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras. Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas para integração entre as equipes de desenvolvimento de software. Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática. Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
Enterprise Video Hosting: Introducing the Intel Video PortalIT@Intel
Intel IT developed an enterprise video hosting solution in order to meet the needs of employees who wanted to create and share videos in an easy-to-use and secure manner.
This presentation was made on June 11, 2020.
Recording from the presentation can be viewed here: https://youtu.be/02Gb062U_M4
The manufacturing industry is adopting artificial intelligence (AI) at a fast rate. This century-old industry is complex but has seen constant transformation across all of its facets.
Led by big data analytics, miniaturization of sensors enabling the Internet of Things (IoT), and, now, AI machine learning (ML), manufacturers everywhere have embarked on an AI transformation that is opening up potential new revenue streams as well taking costs and time out of existing processes.
This talk will walk through a use case for enterprise AI solutions within the manufacturing sector. We will discuss the challenges, motivation, and tool selection process, then cover the solution development in detail.
Speaker Bio:
eRic is armed with the technical know-how of Data Science, Machines Learning, and Big Data Analytics. He. is equipped with skill-sets to value-add businesses exploring into areas of Artificial Intelligence (AI) with an AI consultation approach. Translating BDA, Machine Learning, and AI into Business Values.
eRic CHOO had spent the last 8 years in the IT industry from integration of Infrastructure (Storage and Back-up) solutions to Advance Analytics Software specializing in BDA, Machines Learning, and AI. Before joining the IT industry, he had vast experience in the Semiconductor industry, thus a deep understanding in advance manufacturing processes.
SIONG Jong Hang works as a Solutions Engineer/Data Scientist at H2O.ai based in Singapore where he helps business, government, academia, and non-profit organizations in their transformation into AI. Prior to H2O.ai, he has worked at the Quant Group at Bank of America Merrill Lynch in Hong Kong and Teradata in Singapore as a data scientist. He has completed data science projects for various verticals in Europe and Asia. After hours, he’s an avid learner and has attained 100 MOOC certificates in various fields such as AI, science, engineering, and maths. He has also authored articles to instill interest in science, technology as well as AI.
TechWiseTV Workshop: Improving Performance and Agility with Cisco HyperFlexRobb Boyd
Find out how organizations like yours are deriving business value from the HyperFlex HCI solution. Join us for a deep dive and Q&A at the TechWiseTV workshop.
TechWiseTV Hyperflex 4.0 Episode: http://cs.co/9009EW2Td
O futuro das empresas passa pelas constantes transformações digitais e, para isso, é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras. Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas para integração entre as equipes de desenvolvimento de software.
Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática. Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
DevOps began as a way to deliver availability and survive agile methodologies. Along the way to CI/CD, it has become an overwhelming set of tools cobbled together to deploy code. Simultaneously, applications moved to mobile and IoT devices and from simple application servers to front end, backend, cloud, and microservices. The monitor stage of DevOps has exceeded the human capability for comprehension.
We are missing things and that leads to outages. We need to augment ourselves with ML & automation.
During this session, I want you to think about your last war-room incident and consider whether you are reactive or proactive. By augmenting ourselves through AIOps, we move towards the nirvana of being preemptive.
SPEAKER BIO:
Marco Coulter, Technical Evangelist | AppDynamics
As the Technical Evangelist for AIOps at AppDynamics, Marco Coulter is passionate about the experience humans have when interacting with technology. A former startup CTO, Marco has progressed from operator to leadership roles at CSC, CA Technologies, and more recently 451 Research, where he led the data science team. He earned the nickname "the tech-whisperer" for his skills in translating business drivers for a technical audience and technical concepts for business leaders. When taking the rare break from technology, Marco can be found harvesting fresh vegetables from his NYC garden.
Meetup - DevSecOps: Colocando segurança na esteira
Material apresentado no 12º Meetup do Scrum-Aplicado - 18/09/2019 às 19hrs.
O futuro das empresas passa pelas constantes transformações digitais e, para isso,
é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras.
Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas
para integração entre as equipes de desenvolvimento de software.
Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática.
Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento
e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
O futuro das empresas passa pelas constantes transformações digitais e, para isso, é fundamental manter aplicações que atendam às exigências dos clientes e, sobretudo, seguras. Nesse cenário, nasceu o conceito de DevSecOps, descrevendo um conjunto de práticas para integração entre as equipes de desenvolvimento de software. Nesta palestra, entenderemos mais sobre conceitos e como aplicar DevSecOps na prática. Provocaremos discussões “saudáveis” sobre o modelo tradicional de desenvolvimento e este modelo ágil que está trazendo uma grande mudança de paradigma na construção de aplicações.
Enterprise Video Hosting: Introducing the Intel Video PortalIT@Intel
Intel IT developed an enterprise video hosting solution in order to meet the needs of employees who wanted to create and share videos in an easy-to-use and secure manner.
This presentation was made on June 11, 2020.
Recording from the presentation can be viewed here: https://youtu.be/02Gb062U_M4
The manufacturing industry is adopting artificial intelligence (AI) at a fast rate. This century-old industry is complex but has seen constant transformation across all of its facets.
Led by big data analytics, miniaturization of sensors enabling the Internet of Things (IoT), and, now, AI machine learning (ML), manufacturers everywhere have embarked on an AI transformation that is opening up potential new revenue streams as well taking costs and time out of existing processes.
This talk will walk through a use case for enterprise AI solutions within the manufacturing sector. We will discuss the challenges, motivation, and tool selection process, then cover the solution development in detail.
Speaker Bio:
eRic is armed with the technical know-how of Data Science, Machines Learning, and Big Data Analytics. He. is equipped with skill-sets to value-add businesses exploring into areas of Artificial Intelligence (AI) with an AI consultation approach. Translating BDA, Machine Learning, and AI into Business Values.
eRic CHOO had spent the last 8 years in the IT industry from integration of Infrastructure (Storage and Back-up) solutions to Advance Analytics Software specializing in BDA, Machines Learning, and AI. Before joining the IT industry, he had vast experience in the Semiconductor industry, thus a deep understanding in advance manufacturing processes.
SIONG Jong Hang works as a Solutions Engineer/Data Scientist at H2O.ai based in Singapore where he helps business, government, academia, and non-profit organizations in their transformation into AI. Prior to H2O.ai, he has worked at the Quant Group at Bank of America Merrill Lynch in Hong Kong and Teradata in Singapore as a data scientist. He has completed data science projects for various verticals in Europe and Asia. After hours, he’s an avid learner and has attained 100 MOOC certificates in various fields such as AI, science, engineering, and maths. He has also authored articles to instill interest in science, technology as well as AI.
Advanced Techniques to Accelerate Model Tuning | Software for AI Optimization...Intel® Software
Learn about the algorithms and associated implementations that power SigOpt, a platform for efficiently conducting model development and hyperparameter optimization. Get started on your AI Developer Journey @ software.intel.com/ai.
Nadine Schöne, Dataiku. The Complete Data Value Chain in a NutshellIT Arena
Dr. Nadine Schöne is a Senior Solutions Architect at Dataiku in Berlin. In this role, she deals with all aspects of the data value chain for all users – including integration of data sources, ETL, cooperation, statistics, modelling, but also operationalization, monitoring, automatization and security during production. She regularly talks at conferences, holds webinars and writes articles.
Speech Overview:
How can you get the most out of your data – while staying flexible in your choice of infrastructure and without having to integrate a multitude of tools for the different personas involved? Maximizing the value you get out of your data is a necessity today. Looking at the whole picture as well as careful planning are the key for success. We will have a look at the complete data value chain from end to end: from the data stores, collaboration features, data preparation, visualization and automation capabilities, and external compute to scheduling, operationalization, monitoring and security.
SigOpt CEO Scott Clark provides insights for modeling at scale in systematic trading. SigOpt works with algorithmic trading firms that collectively represent $300 billion in assets under management (AUM). In this presentation, Scott draws on this experience to provide a few critical insights to how these companies effectively model at scale. Alongside these insights, Scott shares a more specific case study from working with Two Sigma, a leading systematic investment manager.
Intelligent data summit: Self-Service Big Data and AI/ML: Reality or Myth?SnapLogic
Companies collect more data but struggle with how to glean the best insights. Use of Machine Learning also needs power data integration.
In this presentation, Janet Jaiswal, SnapLogic's VP of product marketing, reviews key strategies and technologies to deliver intelligent data via self-service ML models.
To learn more, visit https://www.snaplogic.com
From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...Sri Ambati
Numerai is an open, crowd-sourced hedge fund powered by predictions from data scientists around the world. In return, participants are rewarded with weekly payouts in crypto.
In this talk, Joe will give an overview of the Numerai tournament based on his own experience. He will then explain how he automates the time-consuming tasks such as testing different modelling strategies, scoring new datasets, submitting predictions to Numerai as well as monitoring model performance with H2O Driverless AI and R.
While the adoption of machine learning and deep learning techniques continue to grow, many organizations find it difficult to actually deploy these sophisticated models into production. It is common to see data scientists build powerful models, yet these models are not deployed because of the complexity of the technology used or lack of understanding related to the process of pushing these models into production.
As part of this talk, I will review several deployment design patterns for both real-time and batch use cases. I’ll show how these models can be deployed as scalable, distributed deployments within the cloud, scaled across hadoop clusters, as APIs, and deployed within streaming analytics pipelines. I will also touch on topics related to security, end-to-end governance, pitfalls, challenges, and useful tools across a variety of platforms. This presentation will involve demos and sample code for the the deployment design patterns.
This webinar, hosted by SigOpt co-founder and CEO Scott Clark, explains how advanced features can help you achieve your modeling goals. These features include metric definition and multimetric optimization, conditional parameters, and multitask optimization for long training cycles.
SigOpt at O'Reilly - Best Practices for Scaling Modeling PlatformsSigOpt
Companies are increasingly building modeling platforms to empower their researchers to efficiently scale the development and productionalization of their models. Scott Clark and Matt Greenwood share a case study from a leading algorithmic trading firm to illustrate best practices for building these types of platforms in any industry. Join in to learn how Two Sigma, a leading quantitative investment and technology firm, solved its model optimization problem.
Modern Thinking: Cómo el Big Data y Cognitive están cambiando la estrategia de Marketing
Por: Ismael Yuste, Strategic Cloud Engineer Google Cloud
Presentación: Introducción a las soluciones Big Data de Google
Using Data Science to Build an End-to-End Recommendation SystemVMware Tanzu
We get recommendations everyday: Facebook recommends people we should connect with; Amazon recommends products we should buy; and Google Maps recommends routes to take. What all these recommendation systems have in common are data science and modern software development.
Recommendation systems are also valuable for companies in industries as diverse as retail, telecommunications, and energy. In a recent engagement, for example, Pivotal data scientists and developers worked with a large energy company to build a machine learning-based product recommendation system to deliver intelligent and targeted product recommendations to customers to increase revenue.
In this webinar, Pivotal data scientist Ambarish Joshi will take you step-by-step through the engagement, explaining how he and his Pivotal colleagues worked with the customer to collect and analyze data, develop predictive models, and operationalize the resulting insights and surface them via APIs to customer-facing applications. In addition, you will learn how to:
- Apply agile practices to data science and analytics.
- Use test-driven development for feature engineering, model scoring, and validating scripts.
- Automate data science pipelines using pyspark scripts to generate recommendations.
- Apply a microservices-based architecture to integrate product recommendations into mobile applications and call center systems.
Presenters: Ambarish Joshi and Jeff Kelly, Pivotal
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
ICP for Data- Enterprise platform for AI, ML and Data ScienceKaran Sachdeva
IBM Cloud Private for Data, an ultimate platform for all AI, ML and Data Science workloads. Integrated analytics platform based on Containers and micro services. Works with Kubernetes and dockers, even with Redhat openshift. Delivers the variety of business use cases in all industries- FS, Telco, Retail, Manufacturing etc
How to build containerized architectures for deep learning - Data Festival 20...Antje Barth
When it comes to AI data scientists/engineers tend to focus on tools. Though the data platform that enables these tools is equally important, it’s often overlooked. In fact, 90% of the effort required for success in ML is not the algorithm – it’s the data logistics. In this workshop we will talk about common architecture blueprints to integrate AI in your data centers and how the right data platform choice can make all the difference in launching your AI use case into production! Presented at Data Festival Munich, 2019.
Optimizing BERT and Natural Language Models with SigOpt Experiment ManagementSigOpt
SigOpt Machine Learning Engineer Meghana Ravikumar explains how she reduced the size of a BERT natural language model trained on the SQUAD 2.0 question-answer database, to reduce its size while maintaining performance using a "distillation" process optimized with SigOpt's Experiment Management functionality.
SigOpt's Fay Kallel, Head of Product, and Jim Blomo, Head of Engineering, describe the latest updates to SigOpt, a suite of features that help you manage your modeling process.
More Related Content
Similar to Lessons for an enterprise approach to modeling at scale
Advanced Techniques to Accelerate Model Tuning | Software for AI Optimization...Intel® Software
Learn about the algorithms and associated implementations that power SigOpt, a platform for efficiently conducting model development and hyperparameter optimization. Get started on your AI Developer Journey @ software.intel.com/ai.
Nadine Schöne, Dataiku. The Complete Data Value Chain in a NutshellIT Arena
Dr. Nadine Schöne is a Senior Solutions Architect at Dataiku in Berlin. In this role, she deals with all aspects of the data value chain for all users – including integration of data sources, ETL, cooperation, statistics, modelling, but also operationalization, monitoring, automatization and security during production. She regularly talks at conferences, holds webinars and writes articles.
Speech Overview:
How can you get the most out of your data – while staying flexible in your choice of infrastructure and without having to integrate a multitude of tools for the different personas involved? Maximizing the value you get out of your data is a necessity today. Looking at the whole picture as well as careful planning are the key for success. We will have a look at the complete data value chain from end to end: from the data stores, collaboration features, data preparation, visualization and automation capabilities, and external compute to scheduling, operationalization, monitoring and security.
SigOpt CEO Scott Clark provides insights for modeling at scale in systematic trading. SigOpt works with algorithmic trading firms that collectively represent $300 billion in assets under management (AUM). In this presentation, Scott draws on this experience to provide a few critical insights to how these companies effectively model at scale. Alongside these insights, Scott shares a more specific case study from working with Two Sigma, a leading systematic investment manager.
Intelligent data summit: Self-Service Big Data and AI/ML: Reality or Myth?SnapLogic
Companies collect more data but struggle with how to glean the best insights. Use of Machine Learning also needs power data integration.
In this presentation, Janet Jaiswal, SnapLogic's VP of product marketing, reviews key strategies and technologies to deliver intelligent data via self-service ML models.
To learn more, visit https://www.snaplogic.com
From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...Sri Ambati
Numerai is an open, crowd-sourced hedge fund powered by predictions from data scientists around the world. In return, participants are rewarded with weekly payouts in crypto.
In this talk, Joe will give an overview of the Numerai tournament based on his own experience. He will then explain how he automates the time-consuming tasks such as testing different modelling strategies, scoring new datasets, submitting predictions to Numerai as well as monitoring model performance with H2O Driverless AI and R.
While the adoption of machine learning and deep learning techniques continue to grow, many organizations find it difficult to actually deploy these sophisticated models into production. It is common to see data scientists build powerful models, yet these models are not deployed because of the complexity of the technology used or lack of understanding related to the process of pushing these models into production.
As part of this talk, I will review several deployment design patterns for both real-time and batch use cases. I’ll show how these models can be deployed as scalable, distributed deployments within the cloud, scaled across hadoop clusters, as APIs, and deployed within streaming analytics pipelines. I will also touch on topics related to security, end-to-end governance, pitfalls, challenges, and useful tools across a variety of platforms. This presentation will involve demos and sample code for the the deployment design patterns.
This webinar, hosted by SigOpt co-founder and CEO Scott Clark, explains how advanced features can help you achieve your modeling goals. These features include metric definition and multimetric optimization, conditional parameters, and multitask optimization for long training cycles.
SigOpt at O'Reilly - Best Practices for Scaling Modeling PlatformsSigOpt
Companies are increasingly building modeling platforms to empower their researchers to efficiently scale the development and productionalization of their models. Scott Clark and Matt Greenwood share a case study from a leading algorithmic trading firm to illustrate best practices for building these types of platforms in any industry. Join in to learn how Two Sigma, a leading quantitative investment and technology firm, solved its model optimization problem.
Modern Thinking: Cómo el Big Data y Cognitive están cambiando la estrategia de Marketing
Por: Ismael Yuste, Strategic Cloud Engineer Google Cloud
Presentación: Introducción a las soluciones Big Data de Google
Using Data Science to Build an End-to-End Recommendation SystemVMware Tanzu
We get recommendations everyday: Facebook recommends people we should connect with; Amazon recommends products we should buy; and Google Maps recommends routes to take. What all these recommendation systems have in common are data science and modern software development.
Recommendation systems are also valuable for companies in industries as diverse as retail, telecommunications, and energy. In a recent engagement, for example, Pivotal data scientists and developers worked with a large energy company to build a machine learning-based product recommendation system to deliver intelligent and targeted product recommendations to customers to increase revenue.
In this webinar, Pivotal data scientist Ambarish Joshi will take you step-by-step through the engagement, explaining how he and his Pivotal colleagues worked with the customer to collect and analyze data, develop predictive models, and operationalize the resulting insights and surface them via APIs to customer-facing applications. In addition, you will learn how to:
- Apply agile practices to data science and analytics.
- Use test-driven development for feature engineering, model scoring, and validating scripts.
- Automate data science pipelines using pyspark scripts to generate recommendations.
- Apply a microservices-based architecture to integrate product recommendations into mobile applications and call center systems.
Presenters: Ambarish Joshi and Jeff Kelly, Pivotal
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
ICP for Data- Enterprise platform for AI, ML and Data ScienceKaran Sachdeva
IBM Cloud Private for Data, an ultimate platform for all AI, ML and Data Science workloads. Integrated analytics platform based on Containers and micro services. Works with Kubernetes and dockers, even with Redhat openshift. Delivers the variety of business use cases in all industries- FS, Telco, Retail, Manufacturing etc
How to build containerized architectures for deep learning - Data Festival 20...Antje Barth
When it comes to AI data scientists/engineers tend to focus on tools. Though the data platform that enables these tools is equally important, it’s often overlooked. In fact, 90% of the effort required for success in ML is not the algorithm – it’s the data logistics. In this workshop we will talk about common architecture blueprints to integrate AI in your data centers and how the right data platform choice can make all the difference in launching your AI use case into production! Presented at Data Festival Munich, 2019.
Similar to Lessons for an enterprise approach to modeling at scale (20)
Optimizing BERT and Natural Language Models with SigOpt Experiment ManagementSigOpt
SigOpt Machine Learning Engineer Meghana Ravikumar explains how she reduced the size of a BERT natural language model trained on the SQUAD 2.0 question-answer database, to reduce its size while maintaining performance using a "distillation" process optimized with SigOpt's Experiment Management functionality.
SigOpt's Fay Kallel, Head of Product, and Jim Blomo, Head of Engineering, describe the latest updates to SigOpt, a suite of features that help you manage your modeling process.
Efficient NLP by Distilling BERT and Multimetric OptimizationSigOpt
SigOpt ML Engineer Meghana Ravikumar explains how to use multimetric optimization to achieve a more efficient, compact BERT model to perform on a question-answering task.
SigOpt Research Engineer Michael McCourt and DarwinAI CTO Alexander Wong explain how they used SigOpt and hyperparameter optimization to successfully improve accuracy of detecting COVID-19 cases from chest X-Rays, using the COVID-Net model and the COVIDx open dataset.
Metric Management: a SigOpt Applied Use CaseSigOpt
These slides correspond to a recording of a live webcast of a demo of Metric Management functionality in SigOpt, keeping model size down while increasing validation accuracy for a road sign image classification problem.
Tuning for Systematic Trading: Talk 3: Training, Tuning, and Metric StrategySigOpt
This talk explains how you can train and tune efficiently using metric strategy to assign, store, and optimize a variety of metrics, even changing them over time. Tobias Andreassen, who supports a number of our systematic trading customers, explained how he helps customers tune more efficiently with these SigOpt features in real-world scenarios.
Tuning for Systematic Trading: Talk 2: Deep LearningSigOpt
This talk explains how to train deep learning and other expensive models with parallelism and multitask optimization to reduce wall clock time. Tobias Andreassen, who supports a number of our systematic trading customers, presented the intuition behind Bayesian optimization for model optimization with a single or multiple (often competing) metrics. Many times it makes sense to analyze a second metric to avoid myopic training runs that overfit on your data, or otherwise don’t represent or impede performance in real-world scenarios.
This talk discusses the intuition behind Bayesian optimization with and without multiple metrics. Tobias Andreassen, who supports a number of our systematic trading customers, presented the intuition behind Bayesian optimization for model optimization with a single or multiple (often competing) metrics. Many times it makes sense to analyze a second metric to avoid myopic training runs that overfit on your data, or otherwise don’t represent or impede performance in real-world scenarios.
Tuning Data Augmentation to Boost Model PerformanceSigOpt
In this webinar, SigOpt ML Engineer Meghana Ravikumar presents on and builds an image classifier trained on the Stanford Cars dataset to evaluate two approaches to transfer learning—fine tuning and feature extraction—and the impact of Multitask optimization, a more efficient form of Bayesian optimization, on these techniques. Once we define the most performant transfer learning technique for Stanford Cars, we will use image augmentation to double the size of the dataset to boost the classifier’s performance. Instead of manually tuning the hyperparameters associated with image augmentation, we will use Multitask Optimization to learn these hyperparameters using the downstream image classifier’s performance as the guide. In conjunction with model performance, we will also explore the features of these augmented images and the downstream implications for our image classifier.
Advanced Optimization for the Enterprise WebinarSigOpt
Building on the TWIML eBook, TWIMLcon event and TWIML podcast series that explore Machine Learning Platforms in great detail, this webinar examines the machine learning platforms that power enterprise leaders in AI. SigOpt CEO Scott Clark will provide an overview of critical technical capabilities that our customers have prioritized in their ML platforms.
Review these slides to learn about:
- Critical capabilities for data, experiment and model management
- Tradeoffs between building and buying these capabilities
- Lessons from the implementation of these platforms by AI leaders
Why focus on these platforms and the capabilities that power them? Nearly every company is investing in machine learning that differentiates products or generates revenue. These so-called "differentiated models" represent the biggest opportunity for AI to transform the business. Most of these teams find success hiring expert data scientists and machine learning engineers who can build these models. But most of these teams also struggle to create a more sustainable, scalable and reproducible process for model development, and have begun building ML platforms to tackle this challenge.
SigOpt founder and CEO, Scott Clark, PhD, explains the tradeoffs you'll want to consider when designing your modeling platform and integrating hyperparameter optimization to enhance data scientist productivity.
SigOpt helps your algorithmic traders and data scientists build better models faster. Learn how to integrate SigOpt into your modeling platform for quick ROI for your data science team.
Interactive Tradeoffs Between Competing Offline Metrics with Bayesian Optimiz...SigOpt
Many real world applications - machine learning models, simulators, etc. - have multiple competing metrics that define performance; these require practitioners to carefully consider potential tradeoffs. However, assessing and ranking this tradeoff is nontrivial, especially when the number of metrics is more than two. Often times, practitioners scalarize the metrics into a single objective, e.g., using a weighted sum.
In this talk, we pose this problem as a constrained multi-objective optimization problem. By setting and updating the constraints, we can efficiently explore only the region of the Pareto efficient frontier of the model/system of most interest. We motivate this problem with the application of an experimental design setting, where we are trying to fabricate high performance glass substrate for solar cell panels.
As data science workloads grow, so does their need for infrastructure. But, is it fair to ask data scientists to also become infrastructure experts? If not the data scientists, then, who is responsible for spinning up and managing data science infrastructure? This talk will address the context in which ML infrastructure is emerging, walk through two examples of ML infrastructure tools for launching hyperparameter optimization jobs, and end with some thoughts for building better tools in the future.
Originally given as a talk at the PyData Ann Arbor meetup (https://www.meetup.com/PyData-Ann-Arbor/events/260380989/)
SigOpt at Uber Science Symposium - Exploring the spectrum of black-box optimi...SigOpt
At the inaugural Uber science symposium, SigOpt research engineer Bolong (Harvey) Cheng shares insights on black-box optimization from his experience working with both leading academics and innovative enterprises.
Training and tuning models with lengthy training cycles like those in deep learning can be extremely expensive and may sometimes involve techniques that degrade performance. We'll explore recent research on optimization strategies to efficiently tune these types of deep learning models. We will provide benchmarks and comparisons to other popular methods for optimizing the models, and we'll recommend valuable areas for further applied research.
SigOpt at GTC - Reducing operational barriers to optimizationSigOpt
Advanced hardware like NVIDIA technology lowers technical barriers to model size and scope, but issues remain in areas like model performance and training infrastructure management. We'll discuss operational challenges to training models at scale with a particular focus on how training management and hyperparameter tuning can inform each other to accomplish specific goals. We'll also explore techniques like parallelism and scheduling, discuss their impact on model optimization, and compare various techniques. We'll also evaluate results of this approach. In particular, we'll focus on how new tools that automate training orchestration accelerate model development and increase the volume and quality of models in production.
SigOpt at MLconf - Reducing Operational Barriers to Model TrainingSigOpt
In this talk at MLconf NYC, Alexandra Johnson, platform engineering lead at SigOpt, discusses common operational challenges with scaling model training and how solutions are designed to
Machine learning infrastructure solve data scientists' problems using infrastructure tools. This talk shows the case study of building SigOpt Orchestrate, an ML infrastructure tool. The talk highlights how data scientists' concerns as user mapped to solutions with some of today's most popular infrastructure tools.
To learn more about SigOpt Orchestrate: https://sigopt.com/orchestrate
Originally given as a talk for UC Berkeley's Women in Electrical Engineering and Computer Science group on January 24, 2019.
Tuning the Untunable - Insights on Deep Learning OptimizationSigOpt
Patrick Hayes originally gave this talk at ODSC West in 2018. During this talk, Patrick discusses a couple key barriers to deep learning optimization and how SigOpt solves them. First, Patrick discusses the problem of lengthy training cycles and how novel techniques like multitask optimization are designed to use partial information to solve this challenge. Second, Patrick discusses automated cluster management and how solving this problem makes it much easier to manage training cycles for these models.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Strategies for Successful Data Migration Tools.pptxvarshanayak241
Data migration is a complex but essential task for organizations aiming to modernize their IT infrastructure and leverage new technologies. By understanding common challenges and implementing these strategies, businesses can achieve a successful migration with minimal disruption. Data Migration Tool like Ask On Data play a pivotal role in this journey, offering features that streamline the process, ensure data integrity, and maintain security. With the right approach and tools, organizations can turn the challenge of data migration into an opportunity for growth and innovation.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Your Digital Assistant.
Making complex approach simple. Straightforward process saves time. No more waiting to connect with people that matter to you. Safety first is not a cliché - Securely protect information in cloud storage to prevent any third party from accessing data.
Would you rather make your visitors feel burdened by making them wait? Or choose VizMan for a stress-free experience? VizMan is an automated visitor management system that works for any industries not limited to factories, societies, government institutes, and warehouses. A new age contactless way of logging information of visitors, employees, packages, and vehicles. VizMan is a digital logbook so it deters unnecessary use of paper or space since there is no requirement of bundles of registers that is left to collect dust in a corner of a room. Visitor’s essential details, helps in scheduling meetings for visitors and employees, and assists in supervising the attendance of the employees. With VizMan, visitors don’t need to wait for hours in long queues. VizMan handles visitors with the value they deserve because we know time is important to you.
Feasible Features
One Subscription, Four Modules – Admin, Employee, Receptionist, and Gatekeeper ensures confidentiality and prevents data from being manipulated
User Friendly – can be easily used on Android, iOS, and Web Interface
Multiple Accessibility – Log in through any device from any place at any time
One app for all industries – a Visitor Management System that works for any organisation.
Stress-free Sign-up
Visitor is registered and checked-in by the Receptionist
Host gets a notification, where they opt to Approve the meeting
Host notifies the Receptionist of the end of the meeting
Visitor is checked-out by the Receptionist
Host enters notes and remarks of the meeting
Customizable Components
Scheduling Meetings – Host can invite visitors for meetings and also approve, reject and reschedule meetings
Single/Bulk invites – Invitations can be sent individually to a visitor or collectively to many visitors
VIP Visitors – Additional security of data for VIP visitors to avoid misuse of information
Courier Management – Keeps a check on deliveries like commodities being delivered in and out of establishments
Alerts & Notifications – Get notified on SMS, email, and application
Parking Management – Manage availability of parking space
Individual log-in – Every user has their own log-in id
Visitor/Meeting Analytics – Evaluate notes and remarks of the meeting stored in the system
Visitor Management System is a secure and user friendly database manager that records, filters, tracks the visitors to your organization.
"Secure Your Premises with VizMan (VMS) – Get It Now"
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Advanced Flow Concepts Every Developer Should KnowPeter Caitens
Tim Combridge from Sensible Giraffe and Salesforce Ben presents some important tips that all developers should know when dealing with Flows in Salesforce.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Lessons for an enterprise approach to modeling at scale
1. Property of SigOpt, Inc. - Private & Confidential
Lessons for an Enterprise
Approach to Modeling at Scale
Nick Payton
Head of Marketing & Partnerships
2. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
Empower experts everywhere to
amplify and accelerate their
modeling impact
3. Property of SigOpt, Inc. - Private & Confidential
DevOps Builds and Maintains Proprietary Infrastructure
Tasks that depend on your particular infrastructure
(e.g., model lifecycle management, model deployment)
Experts Focus on Data Science
Tasks that benefit from domain expertise
(e.g., metric-function selection)
Our model management philosophy
Software Automates Repeatable Tasks
Tasks that do not benefit from domain expertise
(e.g., training orchestration, model tuning)
4. Property of SigOpt, Inc. - Private & Confidential
We never
access your
data or models
Iterative, automated optimization
Built specifically
for scalable
enterprise use
cases
5. Property of SigOpt, Inc. - Private & Confidential
Benefits: Better, cheaper, faster model development
90% Cost Savings
Maximize utilization of compute
https://aws.amazon.com/blogs/machine-learning/fast
-cnn-tuning-with-aws-gpu-instances-and-sigopt/
10x Faster Time to Tune
Less expert time per model
https://devblogs.nvidia.com/sigopt-deep-learning-hy
perparameter-optimization/
Better Performance
No free lunch, but optimize any model
https://arxiv.org/pdf/1603.09441.pdf
6. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
How does the enterprise maximize
the value of their AI/ML investment?
7. Property of SigOpt, Inc. - Private & Confidential
Source: Kai-Fu Lee, “AI Superpowers: China, Silicon Valley and the New World Order”
Four “waves” of AI progress
Wave 1
Internet AI
Wave 2
Business AI
Wave 3
Perception AI
Wave 4
Autonomous AI
General Data
General Purpose
General Problems
Proprietary Data
Proprietary Purpose
Proprietary Problems
Sensor Data
IoT/Edge Purpose
IoT/Edge Problems
Integrated Data
Multi-Purpose
Real-World Problems
8. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
“Differentiated”
Models
Augment Experts
“Repeatable”
Models
Replace Experts
9. Property of SigOpt, Inc. - Private & Confidential
Hypothesis
Differentiated models will unlock ROI on AI
10. Property of SigOpt, Inc. - Private & Confidential
But differentiated models require a different workflow
Source: Nick Elprin Presentation at Domino REV 2018
11. Property of SigOpt, Inc. - Private & Confidential
This workflow may require a modeling platform
12. Property of SigOpt, Inc. - Private & Confidential
Source: Gartner, “How to Operationalize Machine Learning and Data Science Projects,” July 2018
13. Property of SigOpt, Inc. - Private & Confidential
Source: Gartner, “How to Operationalize Machine Learning and Data Science Projects,” July 2018
3 distinct processes
>20 individual tasks
1 of many approaches
Varies by team
Where to start?
14. Property of SigOpt, Inc. - Private & Confidential
5 Lessons for an Enterprise
Approach to Modeling at Scale
15. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
Divide labor between
machines and experts
1
17. Property of SigOpt, Inc. - Private & Confidential
ML
Engineer
Data Features Models Training Tuning Deploy Monitor
ML
Engineer
ML
Engineer
ML
Engineer
ML
Engineer
DevOps DevOps
18. Property of SigOpt, Inc. - Private & Confidential
Experimentation Production
Data Features Models
Training Tuning
Deploy Monitor
ML Engineer DevOps
Objective Metric
Objective Function
Business Outcome
Domain
Expertise
Solutions
Experiment Management, Infrastructure Orchestration, Optimization
20. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
2
Solve for flexibility
(with plug-and-play APIs)
21. Property of SigOpt, Inc. - Private & Confidential
Source: AI & Compute, OpenAI Blog, May 2018
22. Property of SigOpt, Inc. - Private & Confidential
GBMs Neural Nets GANs
Reinforcement
Learning
23. Property of SigOpt, Inc. - Private & Confidential
Source: Shivon Zilis, http://www.shivonzilis.com/
24. Property of SigOpt, Inc. - Private & Confidential
Source: Shivon Zilis, http://www.shivonzilis.com/
25. Property of SigOpt, Inc. - Private & Confidential
Lock yourself into a closed system at
your own risk
26. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
3 Analyze and
reproduce any model
27. Property of SigOpt, Inc. - Private & Confidential
Your models are a significant investment
Source: HTTPS://WWW.STATISTA.COM/STATISTICS/607612/WORLDWIDE-ARTIFICIAL-INTELLIGENCE-FOR-ENTERPRISE-APPLICATIONS/
28. Property of SigOpt, Inc. - Private & Confidential
And a growing need to interpret, understand models
29. Property of SigOpt, Inc. - Private & Confidential
Example in SigOpt’s solution
Uncover model insights with
parameter importance
Monitor performance improvement as
the experiment progresses via API, the
web or your mobile phone
Cycle through analysis, suggestions,
history, and other experiment insights
30. Property of SigOpt, Inc. - Private & Confidential
Experiment management is model
analysis and reproducibility
31. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
4 Optimize throughout
the process
32. Property of SigOpt, Inc. - Private & Confidential
The “suboptimal optimization” problem
Random forest
Grid search
75%
CNN
Grid search
65%
CNN
Bayesian optimization
85%
33. Property of SigOpt, Inc. - Private & Confidential
The “leaving optimization to the last mile” problem
Data Features Models Training Tuning Deploy Monitor
FIXED FIXED FIXED
Performance Leakage
34. Property of SigOpt, Inc. - Private & Confidential
The “performance drift in production” problem
Data Features Models Training Tuning Deploy Monitor
Static
Performance Drift
35. Property of SigOpt, Inc. - Private & Confidential
Retune withOptimize with
Optimization impacts every step in your process
Data Features Models Training Tuning Deploy Monitor
Automate Experimentation
Cluster
Management
Hyperparameter
Optimization
Web UX with Insights, Metadata, Visuals
36. Property of SigOpt, Inc. - Private & Confidential
Advanced optimization techniques are critical
Multitask Optimization
Tune “expensive” deep learning models
Multimetric Optimization
Solve for competing business objectives
Conditional Parameters
Perform optimized architecture search
100 Parameters, 100x Parallelism
Efficiently optimize high-dimensional models
37. Property of SigOpt, Inc. - Private & Confidential
The “competing objective” problem
Accuracy Training Time
ROC AUC Inference Time
Loss Model Complexity
Conversion Rate Lifetime Value
Engagement Profit
Profit Drawdown
VS.
38. Property of SigOpt, Inc. - Private & Confidential
Finding the frontier
Accuracy v Training Time Accuracy v Inference Time % Loss v Per-Loss Magnitude
39. Property of SigOpt, Inc. - Private & ConfidentialProperty of SigOpt, Inc. - Private & Confidential
5 Build for variety and
reliability
40. Property of SigOpt, Inc. - Private & Confidential
Source: https://machinelearningmastery.com/a-tour-of-machine-learning-algorithms/
41. Property of SigOpt, Inc. - Private & Confidential
Open source may work Open source may not work
Programming Languages
Client Libraries
Modeling Frameworks
Notebook Management
Hyperparameter Optimization
Experiment Management
Training Management
Model Deployment
43. Property of SigOpt, Inc. - Private & Confidential
Considerations
On-Premise
Hybrid Infrastructure
Single-Cloud
Multi-Cloud
Single User(s)
One Team
Multi-team needs
Platform-driven modeling
Center of Excellence
Number of use cases
Variety of model types
Diversity of expertise
Sources of data
44. Property of SigOpt, Inc. - Private & Confidential
Standardization is critical to
modeling at scale
45. Property of SigOpt, Inc. - Private & Confidential
5 Lessons for an Enterprise
Approach to Modeling at Scale
46. Property of SigOpt, Inc. - Private & Confidential
Divide labor between machines and experts
Solve for flexibility
Analyze and reproduce any model
Optimize throughout the process
Build for variety and reliability
47. Property of SigOpt, Inc. - Private & Confidential
Realize the virtuous cycle of model development
1. Invest in tools to automate, optimize and manage the process
2. Improve team productivity and throughput
3. Free up capacity to apply expertise to metrics, outcomes
4. Amplify the business impact of models