At the inaugural Uber science symposium, SigOpt research engineer Bolong (Harvey) Cheng shares insights on black-box optimization from his experience working with both leading academics and innovative enterprises.
Adapted from a talk given to the 2012 PMI Global Congress EMEA, this presentation identifies the "fuzziness" of scope as a constraint and shows how it can be reduced by looking at scope in terms of multiple dimensions--including that of change within the project itself.
Behaviour Driven Development: Oltre i limiti del possibileIosif Itkin
The QA Financial Forum: Milan 2019
23 January at the Excelsior Hotel Gallia.
Anna-Maria Lukina, Exactpro Business Development Director
The QA Financial Forum: Milan is one of the leading fintech conferences in Italy. The event focuses on the latest achievements in software risk management and automation of software testing. The predominant theme of the Milan event will be Quality Assurance for the entire Software Development Life Cycle (SDLC).
The topics under discussion will feature:
- Technologies for Automation & AI
- DevOps & CI/CD
- Value Stream Management
- Test Data Management
- Regulatory Compliance
- App Security & DevSecOps
- Testing and quality assurance of Blockchain platforms
The official language of the event is Italian.
Converting an idea or even a lab prototype into a real, customer-ready product is no simple task. Steve Carkner of Panacis Medical discusses the topic of product development.
Queuing Theory and the Theory of Constraints are two powerful theories that can increase your velocity. This session explains both theories in simple terms then covers how they can be applied in the real world by agile teams. 21 simple velocity increasing experiments are described that you can immediately use.
The effects of Queuing Theory impact our lives on a daily basis. Scrum uses Queuing Theory at its core and you can amplify those effects.
The Theory of Constraints can identify the one constraint that is preventing your team from increasing its velocity. It also shows us how to remove that constraint in the cheapest way possible.
Андрій Просов “Управління очікуваннями клієнтів в проектах з використанням гн...Lviv Startup Club
Kharkiv Project Management Day
Андрій Просов “Управління очікуваннями клієнтів в проектах з використанням гнучкої методології розробки та фіксованою ціною”
Adapted from a talk given to the 2012 PMI Global Congress EMEA, this presentation identifies the "fuzziness" of scope as a constraint and shows how it can be reduced by looking at scope in terms of multiple dimensions--including that of change within the project itself.
Behaviour Driven Development: Oltre i limiti del possibileIosif Itkin
The QA Financial Forum: Milan 2019
23 January at the Excelsior Hotel Gallia.
Anna-Maria Lukina, Exactpro Business Development Director
The QA Financial Forum: Milan is one of the leading fintech conferences in Italy. The event focuses on the latest achievements in software risk management and automation of software testing. The predominant theme of the Milan event will be Quality Assurance for the entire Software Development Life Cycle (SDLC).
The topics under discussion will feature:
- Technologies for Automation & AI
- DevOps & CI/CD
- Value Stream Management
- Test Data Management
- Regulatory Compliance
- App Security & DevSecOps
- Testing and quality assurance of Blockchain platforms
The official language of the event is Italian.
Converting an idea or even a lab prototype into a real, customer-ready product is no simple task. Steve Carkner of Panacis Medical discusses the topic of product development.
Queuing Theory and the Theory of Constraints are two powerful theories that can increase your velocity. This session explains both theories in simple terms then covers how they can be applied in the real world by agile teams. 21 simple velocity increasing experiments are described that you can immediately use.
The effects of Queuing Theory impact our lives on a daily basis. Scrum uses Queuing Theory at its core and you can amplify those effects.
The Theory of Constraints can identify the one constraint that is preventing your team from increasing its velocity. It also shows us how to remove that constraint in the cheapest way possible.
Андрій Просов “Управління очікуваннями клієнтів в проектах з використанням гн...Lviv Startup Club
Kharkiv Project Management Day
Андрій Просов “Управління очікуваннями клієнтів в проектах з використанням гнучкої методології розробки та фіксованою ціною”
Product Idea Validation - 3 Factors to ConsiderRaahul Raghavan
This presentation will discuss 3 core factors which can add value and make a product validation cycle more effective. Presentation was prepared with a primary intention to touch upon the primary concepts.
Advanced Optimization for the Enterprise WebinarSigOpt
Building on the TWIML eBook, TWIMLcon event and TWIML podcast series that explore Machine Learning Platforms in great detail, this webinar examines the machine learning platforms that power enterprise leaders in AI. SigOpt CEO Scott Clark will provide an overview of critical technical capabilities that our customers have prioritized in their ML platforms.
Review these slides to learn about:
- Critical capabilities for data, experiment and model management
- Tradeoffs between building and buying these capabilities
- Lessons from the implementation of these platforms by AI leaders
Why focus on these platforms and the capabilities that power them? Nearly every company is investing in machine learning that differentiates products or generates revenue. These so-called "differentiated models" represent the biggest opportunity for AI to transform the business. Most of these teams find success hiring expert data scientists and machine learning engineers who can build these models. But most of these teams also struggle to create a more sustainable, scalable and reproducible process for model development, and have begun building ML platforms to tackle this challenge.
Greenfield projects are awesome – you can develop highest quality application using best practices on the market. But what if your bread actually is Legacy projects? Does it mean that you need to descend into darkness of QA absence? Does it mean that you can’t use Agile or modern communication practices like BDD?
Usability testing can help bridge the gap between developers, marketers, and stakeholders. Usability testing lets the design and development teams identify problems before they are coded. The earlier issues are identified and fixed, the less expensive the fixes will be in terms of both staff time and possible impact to the schedule. Usability testing is a great way to help teams prioritize website redesign efforts. In this session, we'll talk about the main types of usability tests and why it's better to usability test before deciding on making changes to the design. By conducting tests early, your team learns what to change. You'll learn what to keep. Usability testing early makes it easier to build the requirements, define the use cases, and even create QA test scripts, because you can drive all those things right off what you saw in the research. It will likely reduce your development costs because you’ll have data to make decisions, instead of driving everything off some strong-willed individual’s opinions of what users need. Pushing your user research as early as possible in the schedule is the best way to get value from your efforts.
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
You can utilize various forms of Generative Research to deepen your understanding of how people interact with your product or service.
Craig has amassed a vast toolkit of research methods, which he has employed to optimize websites and apps for over 500 companies. He'll share which methods yielded the highest return on investment, identified key customer pain points, and generated the best experiment ideas.
By sharing the top inspection methods essential for our work, Craig will provide advice for each technique. Anticipate insights on driving experiment hypotheses from research, a list of essential toolkit components for tomorrow, and additional resources for further reading.
Greenfield projects are awesome – you can develop highest quality application using best practices on the market. But what if your bread actually is Legacy projects? Does it mean that you need to descend into darkness of QA absence? This talk will show you how to be successful even with the oldest legacy projects out there through the introduction of Agile processes and tools like Behat.
How we integrate Machine Learning Algorithms into our IT Platform at Outfitte...OUTFITTERY
Outfittery's mission is to provide relevant fashion to men. In the past it was our stylists that put together the best outfits for our customers. But since about a year ago we started to rely more on intelligent algorithms to augment our human experts.
This transition to become a data driven company has left its marks on our IT landscape:
In the beginning we just did simple A/B tests. Then we wanted to use more complex logic so we added a generic data enrichment layer. Later we also provided easy configurability to steer processes. And this in turn enabled us to orchestrate our machine learning algorithms as self contained Docker containers within a Kubernetes cluster. All in all it's a nice setup that we are pretty happy with.
It then really took us some time to realise that we actually had built a delivery platform to deliver just any pure function that our data scientists come up with - directly into our microservice landscape. We just now started to use it that way; we just put their R&D experiments directly into production... :-)
This talk will guide you through this journey, explain how this platform is built, and what we do with it.
SigOpt CEO Scott Clark provides insights for modeling at scale in systematic trading. SigOpt works with algorithmic trading firms that collectively represent $300 billion in assets under management (AUM). In this presentation, Scott draws on this experience to provide a few critical insights to how these companies effectively model at scale. Alongside these insights, Scott shares a more specific case study from working with Two Sigma, a leading systematic investment manager.
Deep learning applications in e-commerce search: Dynamic talks Chicago 3/14/2019Grid Dynamics
In this talk, we will discuss how recent advancements in artificial intelligence are transforming traditional search technologies. Deep learning-based image analysis and natural language processing open exciting new horizons for search and recommendation applications across the industries. We’ll talk about how deep learning models can help conventional search engines to achieve better relevance. We will share our experience implementing innovative solutions for online retailers, finance and high tech customers.
GOTO Night: Decision Making Based on Machine LearningOUTFITTERY
Outfittery's mission is to provide relevant fashion to men. In the past it was our stylists that put together the best outfits for our customers. But since about a year ago we started to rely more on intelligent algorithms to augment our human experts.
This transition to become a data driven company has left its marks on our IT landscape: In the beginning we just did simple A/B tests.
Then we wanted to use more complex logic so we added a generic data enrichment layer. Later we also provided easy configurability to steer processes.
And this in turn enabled us to orchestrate our machine learning algorithms as self contained Docker containers within a Kubernetes cluster. All in all it's a nice setup that we are pretty happy with.
It then really took us some time to realise that we actually had built a delivery platform to deliver just any pure function that our data scientists come up with - directly into our microservices landscape. We just now started to use it that way; we just put their R&D experiments directly into production... :-)
This talk will guide you through this journey, explain how this platform is built, and what we do with it.
Optimizing BERT and Natural Language Models with SigOpt Experiment ManagementSigOpt
SigOpt Machine Learning Engineer Meghana Ravikumar explains how she reduced the size of a BERT natural language model trained on the SQUAD 2.0 question-answer database, to reduce its size while maintaining performance using a "distillation" process optimized with SigOpt's Experiment Management functionality.
SigOpt's Fay Kallel, Head of Product, and Jim Blomo, Head of Engineering, describe the latest updates to SigOpt, a suite of features that help you manage your modeling process.
More Related Content
Similar to SigOpt at Uber Science Symposium - Exploring the spectrum of black-box optimization through customer engagements
Product Idea Validation - 3 Factors to ConsiderRaahul Raghavan
This presentation will discuss 3 core factors which can add value and make a product validation cycle more effective. Presentation was prepared with a primary intention to touch upon the primary concepts.
Advanced Optimization for the Enterprise WebinarSigOpt
Building on the TWIML eBook, TWIMLcon event and TWIML podcast series that explore Machine Learning Platforms in great detail, this webinar examines the machine learning platforms that power enterprise leaders in AI. SigOpt CEO Scott Clark will provide an overview of critical technical capabilities that our customers have prioritized in their ML platforms.
Review these slides to learn about:
- Critical capabilities for data, experiment and model management
- Tradeoffs between building and buying these capabilities
- Lessons from the implementation of these platforms by AI leaders
Why focus on these platforms and the capabilities that power them? Nearly every company is investing in machine learning that differentiates products or generates revenue. These so-called "differentiated models" represent the biggest opportunity for AI to transform the business. Most of these teams find success hiring expert data scientists and machine learning engineers who can build these models. But most of these teams also struggle to create a more sustainable, scalable and reproducible process for model development, and have begun building ML platforms to tackle this challenge.
Greenfield projects are awesome – you can develop highest quality application using best practices on the market. But what if your bread actually is Legacy projects? Does it mean that you need to descend into darkness of QA absence? Does it mean that you can’t use Agile or modern communication practices like BDD?
Usability testing can help bridge the gap between developers, marketers, and stakeholders. Usability testing lets the design and development teams identify problems before they are coded. The earlier issues are identified and fixed, the less expensive the fixes will be in terms of both staff time and possible impact to the schedule. Usability testing is a great way to help teams prioritize website redesign efforts. In this session, we'll talk about the main types of usability tests and why it's better to usability test before deciding on making changes to the design. By conducting tests early, your team learns what to change. You'll learn what to keep. Usability testing early makes it easier to build the requirements, define the use cases, and even create QA test scripts, because you can drive all those things right off what you saw in the research. It will likely reduce your development costs because you’ll have data to make decisions, instead of driving everything off some strong-willed individual’s opinions of what users need. Pushing your user research as early as possible in the schedule is the best way to get value from your efforts.
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
You can utilize various forms of Generative Research to deepen your understanding of how people interact with your product or service.
Craig has amassed a vast toolkit of research methods, which he has employed to optimize websites and apps for over 500 companies. He'll share which methods yielded the highest return on investment, identified key customer pain points, and generated the best experiment ideas.
By sharing the top inspection methods essential for our work, Craig will provide advice for each technique. Anticipate insights on driving experiment hypotheses from research, a list of essential toolkit components for tomorrow, and additional resources for further reading.
Greenfield projects are awesome – you can develop highest quality application using best practices on the market. But what if your bread actually is Legacy projects? Does it mean that you need to descend into darkness of QA absence? This talk will show you how to be successful even with the oldest legacy projects out there through the introduction of Agile processes and tools like Behat.
How we integrate Machine Learning Algorithms into our IT Platform at Outfitte...OUTFITTERY
Outfittery's mission is to provide relevant fashion to men. In the past it was our stylists that put together the best outfits for our customers. But since about a year ago we started to rely more on intelligent algorithms to augment our human experts.
This transition to become a data driven company has left its marks on our IT landscape:
In the beginning we just did simple A/B tests. Then we wanted to use more complex logic so we added a generic data enrichment layer. Later we also provided easy configurability to steer processes. And this in turn enabled us to orchestrate our machine learning algorithms as self contained Docker containers within a Kubernetes cluster. All in all it's a nice setup that we are pretty happy with.
It then really took us some time to realise that we actually had built a delivery platform to deliver just any pure function that our data scientists come up with - directly into our microservice landscape. We just now started to use it that way; we just put their R&D experiments directly into production... :-)
This talk will guide you through this journey, explain how this platform is built, and what we do with it.
SigOpt CEO Scott Clark provides insights for modeling at scale in systematic trading. SigOpt works with algorithmic trading firms that collectively represent $300 billion in assets under management (AUM). In this presentation, Scott draws on this experience to provide a few critical insights to how these companies effectively model at scale. Alongside these insights, Scott shares a more specific case study from working with Two Sigma, a leading systematic investment manager.
Deep learning applications in e-commerce search: Dynamic talks Chicago 3/14/2019Grid Dynamics
In this talk, we will discuss how recent advancements in artificial intelligence are transforming traditional search technologies. Deep learning-based image analysis and natural language processing open exciting new horizons for search and recommendation applications across the industries. We’ll talk about how deep learning models can help conventional search engines to achieve better relevance. We will share our experience implementing innovative solutions for online retailers, finance and high tech customers.
GOTO Night: Decision Making Based on Machine LearningOUTFITTERY
Outfittery's mission is to provide relevant fashion to men. In the past it was our stylists that put together the best outfits for our customers. But since about a year ago we started to rely more on intelligent algorithms to augment our human experts.
This transition to become a data driven company has left its marks on our IT landscape: In the beginning we just did simple A/B tests.
Then we wanted to use more complex logic so we added a generic data enrichment layer. Later we also provided easy configurability to steer processes.
And this in turn enabled us to orchestrate our machine learning algorithms as self contained Docker containers within a Kubernetes cluster. All in all it's a nice setup that we are pretty happy with.
It then really took us some time to realise that we actually had built a delivery platform to deliver just any pure function that our data scientists come up with - directly into our microservices landscape. We just now started to use it that way; we just put their R&D experiments directly into production... :-)
This talk will guide you through this journey, explain how this platform is built, and what we do with it.
Optimizing BERT and Natural Language Models with SigOpt Experiment ManagementSigOpt
SigOpt Machine Learning Engineer Meghana Ravikumar explains how she reduced the size of a BERT natural language model trained on the SQUAD 2.0 question-answer database, to reduce its size while maintaining performance using a "distillation" process optimized with SigOpt's Experiment Management functionality.
SigOpt's Fay Kallel, Head of Product, and Jim Blomo, Head of Engineering, describe the latest updates to SigOpt, a suite of features that help you manage your modeling process.
Efficient NLP by Distilling BERT and Multimetric OptimizationSigOpt
SigOpt ML Engineer Meghana Ravikumar explains how to use multimetric optimization to achieve a more efficient, compact BERT model to perform on a question-answering task.
SigOpt Research Engineer Michael McCourt and DarwinAI CTO Alexander Wong explain how they used SigOpt and hyperparameter optimization to successfully improve accuracy of detecting COVID-19 cases from chest X-Rays, using the COVID-Net model and the COVIDx open dataset.
Metric Management: a SigOpt Applied Use CaseSigOpt
These slides correspond to a recording of a live webcast of a demo of Metric Management functionality in SigOpt, keeping model size down while increasing validation accuracy for a road sign image classification problem.
Tuning for Systematic Trading: Talk 3: Training, Tuning, and Metric StrategySigOpt
This talk explains how you can train and tune efficiently using metric strategy to assign, store, and optimize a variety of metrics, even changing them over time. Tobias Andreassen, who supports a number of our systematic trading customers, explained how he helps customers tune more efficiently with these SigOpt features in real-world scenarios.
Tuning for Systematic Trading: Talk 2: Deep LearningSigOpt
This talk explains how to train deep learning and other expensive models with parallelism and multitask optimization to reduce wall clock time. Tobias Andreassen, who supports a number of our systematic trading customers, presented the intuition behind Bayesian optimization for model optimization with a single or multiple (often competing) metrics. Many times it makes sense to analyze a second metric to avoid myopic training runs that overfit on your data, or otherwise don’t represent or impede performance in real-world scenarios.
This talk discusses the intuition behind Bayesian optimization with and without multiple metrics. Tobias Andreassen, who supports a number of our systematic trading customers, presented the intuition behind Bayesian optimization for model optimization with a single or multiple (often competing) metrics. Many times it makes sense to analyze a second metric to avoid myopic training runs that overfit on your data, or otherwise don’t represent or impede performance in real-world scenarios.
Tuning Data Augmentation to Boost Model PerformanceSigOpt
In this webinar, SigOpt ML Engineer Meghana Ravikumar presents on and builds an image classifier trained on the Stanford Cars dataset to evaluate two approaches to transfer learning—fine tuning and feature extraction—and the impact of Multitask optimization, a more efficient form of Bayesian optimization, on these techniques. Once we define the most performant transfer learning technique for Stanford Cars, we will use image augmentation to double the size of the dataset to boost the classifier’s performance. Instead of manually tuning the hyperparameters associated with image augmentation, we will use Multitask Optimization to learn these hyperparameters using the downstream image classifier’s performance as the guide. In conjunction with model performance, we will also explore the features of these augmented images and the downstream implications for our image classifier.
SigOpt founder and CEO, Scott Clark, PhD, explains the tradeoffs you'll want to consider when designing your modeling platform and integrating hyperparameter optimization to enhance data scientist productivity.
This webinar, hosted by SigOpt co-founder and CEO Scott Clark, explains how advanced features can help you achieve your modeling goals. These features include metric definition and multimetric optimization, conditional parameters, and multitask optimization for long training cycles.
SigOpt helps your algorithmic traders and data scientists build better models faster. Learn how to integrate SigOpt into your modeling platform for quick ROI for your data science team.
Interactive Tradeoffs Between Competing Offline Metrics with Bayesian Optimiz...SigOpt
Many real world applications - machine learning models, simulators, etc. - have multiple competing metrics that define performance; these require practitioners to carefully consider potential tradeoffs. However, assessing and ranking this tradeoff is nontrivial, especially when the number of metrics is more than two. Often times, practitioners scalarize the metrics into a single objective, e.g., using a weighted sum.
In this talk, we pose this problem as a constrained multi-objective optimization problem. By setting and updating the constraints, we can efficiently explore only the region of the Pareto efficient frontier of the model/system of most interest. We motivate this problem with the application of an experimental design setting, where we are trying to fabricate high performance glass substrate for solar cell panels.
As data science workloads grow, so does their need for infrastructure. But, is it fair to ask data scientists to also become infrastructure experts? If not the data scientists, then, who is responsible for spinning up and managing data science infrastructure? This talk will address the context in which ML infrastructure is emerging, walk through two examples of ML infrastructure tools for launching hyperparameter optimization jobs, and end with some thoughts for building better tools in the future.
Originally given as a talk at the PyData Ann Arbor meetup (https://www.meetup.com/PyData-Ann-Arbor/events/260380989/)
SigOpt at O'Reilly - Best Practices for Scaling Modeling PlatformsSigOpt
Companies are increasingly building modeling platforms to empower their researchers to efficiently scale the development and productionalization of their models. Scott Clark and Matt Greenwood share a case study from a leading algorithmic trading firm to illustrate best practices for building these types of platforms in any industry. Join in to learn how Two Sigma, a leading quantitative investment and technology firm, solved its model optimization problem.
Training and tuning models with lengthy training cycles like those in deep learning can be extremely expensive and may sometimes involve techniques that degrade performance. We'll explore recent research on optimization strategies to efficiently tune these types of deep learning models. We will provide benchmarks and comparisons to other popular methods for optimizing the models, and we'll recommend valuable areas for further applied research.
SigOpt at GTC - Reducing operational barriers to optimizationSigOpt
Advanced hardware like NVIDIA technology lowers technical barriers to model size and scope, but issues remain in areas like model performance and training infrastructure management. We'll discuss operational challenges to training models at scale with a particular focus on how training management and hyperparameter tuning can inform each other to accomplish specific goals. We'll also explore techniques like parallelism and scheduling, discuss their impact on model optimization, and compare various techniques. We'll also evaluate results of this approach. In particular, we'll focus on how new tools that automate training orchestration accelerate model development and increase the volume and quality of models in production.
SigOpt at MLconf - Reducing Operational Barriers to Model TrainingSigOpt
In this talk at MLconf NYC, Alexandra Johnson, platform engineering lead at SigOpt, discusses common operational challenges with scaling model training and how solutions are designed to
Machine learning infrastructure solve data scientists' problems using infrastructure tools. This talk shows the case study of building SigOpt Orchestrate, an ML infrastructure tool. The talk highlights how data scientists' concerns as user mapped to solutions with some of today's most popular infrastructure tools.
To learn more about SigOpt Orchestrate: https://sigopt.com/orchestrate
Originally given as a talk for UC Berkeley's Women in Electrical Engineering and Computer Science group on January 24, 2019.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
7. SigOpt. Confidential.
Material science research
Our Pitt collaborators wanted to use BO to
accelerate their research.
• Started using SigOpt as is and got some OK
results.
• Complicated experimental set-up and
SigOpt was not a 1-to-1 perfect fit.
• Were uninspired and had a lot of questions.
8. SigOpt. Confidential.
Find the fabrication process for an optical device (e.g., glass) that exhibits desirable physical and optical
properties.
• High transmission
• Low haze
• High liquid contact angle
Material science research
9. SigOpt. Confidential.
Find the fabrication process for an optical device (e.g., glass) that exhibits desirable physical and optical
properties.
• High transmission
• Low haze
• High liquid contact angle
Material science research
500 nm 100 nm 100 nm
11. SigOpt. Confidential.
Bayesian optimization for material science
What are our collaborator’s limitations? Their preferences? Their aspirations? Their fears?
Extremely budget conscious.
12. SigOpt. Confidential.
Bayesian optimization for material science
What are our collaborator’s limitations? Their preferences? Their aspirations? Their fears?
Fear of exploration.
13. SigOpt. Confidential.
Bayesian optimization for material science
What are our collaborator’s limitations? Their preferences? Their aspirations? Their fears?
Expertise is a double-edged sword.
14. SigOpt. Confidential.
Efficient search for the desirable material
Modification and Adaptation of BO
The researchers want:
• To leverage their expertise.
How we can help:
• Careful consideration of the input parameter
space.
15. SigOpt. Confidential.
Efficient search for the desirable material
Modification and Adaptation of BO
The researchers want:
• Lab equipment has limited precision.
How we can help:
• Understand how equipment precision
demands a discrete domain.
16. SigOpt. Confidential.
Efficient search for the desirable material
Modification and Adaptation of BO
The researchers want:
• Multiobjective optimization, on a budget.
How we can help:
• Pose the problem as a constrained
optimization problem to identify key points
on the Pareto frontier.
20. SigOpt. Confidential.
Optimization platform
Some of our customers cannot reveal anything
about their problems.
• Masking the input parameter names
• Misusage sometimes
• Vastly different access patterns
22. SigOpt. Confidential.
Optimization platform
True black-box optimization
What can we do in the absence of customer interaction?
• Nonstandard benchmarking of our optimizer
• Flexible design of the API
• Scalable computation workflow
26. SigOpt. Confidential.
Customer engagement at scale
Lessons we learned from working with our friends in Academia.
1. Customers’ problems may not be addressed immediately by the existing service.
2. Customers have inherent preferences to what is considered as success and what is considered as
failure.
Can we apply the lessons we have learned and serve a broad array of customers?
27. SigOpt. Confidential.
Professional services
When a customer’s problem cannot be immediately solved by plugging in the SigOpt API, the PS team can
help them by
• Understanding the customer’s success criteria.
• Building one-off projects to better interface SigOpt API with the customers.
28. SigOpt. Confidential.
Adjusting to customer expectations
Customers may judge their experience very differently from how we perceive it.
29. SigOpt. Confidential.
Adjusting to customer expectations
Customers may judge their experience very differently from how we perceive it.
• “Want more exploiting, less exploring because there is one region where there is an optimal value.
Not interested in exploring poor areas of performance.” - customer A
• “Want to make sure the optimizer is effectively exploring the parameter space. Don’t mind if there’s a
bit of extra work being done so long as it is sufficiently explored.” - customer B
30. SigOpt. Confidential.
Production throttles
Adjusting to customer biases
Production throttles are hooks that we can build
into the system to empower PS.
• Adjust the optimization behavior to meet the
customer’s demand.
• No redeployment of code.
31. SigOpt. Confidential.
Our spectrum thus far
Collaboration - Services - Black box
We have some customers with whom we have a collaborative relationship.
For most of customers, we treat their problems as completely black box.
We have identified opportunities to allow professional services to change the black box behavior without
changing the product structure.
Is this all?
32. SigOpt. Confidential.
Beyond black box
2016 BayesOpt workshop: We should “Open the black-box” and go “Beyond” black-box optimization.
What are some options?
• Address problems with a different goal (e.g., balancing competing objectives).
• Provide more information (level of noise for observations).
• Operate in a different workflow.
To do this, we must understand customer’s success criteria and failure modes.
33. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
We wanted to build a feature to effectively address neural network developers. We needed to identify the
appropriate part of the black box spectrum on which this feature should lie.
Academic
collaboration
Glass box Black box
Professional
services
Optimization
platform
34. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
Option 1: Hyperband
• Some customers had mentioned Hyperband, which could be implemented using a Bayesian
optimization strategy in the background.
35. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
Option 1: Hyperband
• Some customers had mentioned Hyperband, which could be implemented using a Bayesian
optimization strategy in the background.
Complication:
• When confronted with the required change in workflow (storing weights, work split across generations,
idle machines), and the prospect of stopping SGD before convergence, customers balked.
Conclusion:
• Workflow change was too much towards glass box.
36. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
Option 2: Multi-task BO
• We have a multi-task BO feature already in place; maybe neural network customers could be
convinced to use that.
37. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
Option 2: Multi-task BO
• We have a multi-task BO feature already in place; maybe neural network customers could be
convinced to use that.
Complication:
• During customer interviews, we found customers confused by the definition of tasks and how to define
them effectively. They also disliked stopping SGD runs before convergence.
Conclusion:
• Existing multi-task feature was too black box.
38. SigOpt. Confidential.
Special feature for neural networks
Beyond black box
Resolution: Training Monitor
• Respect the customer’s workflow (no change required).
• Customers report progress during training.
• Allow customers to monitor training and provide status updates regarding convergence.
• Better internal models are built from all the progress information.
Conclusion:
• Does this fall in the best location of the spectrum?
39. SigOpt. Confidential.
Black-box optimization
A spectrum from customer engagement
Academic
collaboration
Glass box Black box
Professional
services
Optimization
platform
HPO for neural
networks
40. SigOpt. Confidential.
Thank You
Paul Leu
Sajad Haghanifar
@University of Pittsburgh
The entire SigOpt team.
Special thanks to our gracious hosts, Jake, Matthias, and Uber.
Hope to see you next month at ICML & CVPR! SigOpt events are being planned ...