Velocity 2013 london developer-friendly web performance testing in continuous integration
•
0 likes•2,343 views
This document discusses integrating web performance testing into continuous integration workflows by leveraging existing UI tests. It proposes running UI tests multiple times to collect real user monitoring metrics and DevTools traces. These performance metrics would be analyzed over time to detect regressions. Developers would be notified of regressions and could fix issues more easily by bisecting changes using the collected data from continuous performance tests. This approach aims to make performance testing less of a specialized task and more integrated into regular development and testing cycles.
Report
Share
Report
Share
Download to read offline
Recommended
Елена Панина - Drupal performance testing. Тестирование производительности, м...
Performance testing of a Drupal site can help identify issues, evaluate optimization effectiveness, and report results to clients. Tools like JMeter are used to test criteria such as response time, throughput, and hits per second by emulating user behavior under increasing load. For one project, response time dropped from 9,000ms to 330ms, throughput increased from 6.2 to 114 transactions/second, and hits per second rose from 4 to 100 after optimizing caching with Memcache, ESI, and Varnish configuration. Caching code, functions, views, databases requests, HTML, images, and static assets can improve performance.
[E-Dev-Day 2015][3/4] QA Status Report (Stefan Schmidt)
During the EDD US in March I gave a outlook on what parts of our QA infrastructure needs to get improved. Most noteworthy mandatory test cases for new API's, jenkins builds for incoming patches as phab differentials and an increasing use of exactness for testing changes on an UI level. This talk will give a status report of these ongoing changes. What have been done and what got stuck and what is still ongoing.
Synchronizing parallel delivery flows in jenkins using groovy, build flow and...
Slides from my talk on Automation Nights 15.09-STHLM
https://www.youtube.com/watch?v=1YmnTCVBdmc&index=2&list=PLuvRKxeqrv4I_y8Vxz-09-EJuP6yELwEX
Introduction to DevOps. Continuous Integration by Myroslav Dmytrus
Continuous integration is a development practice where developers integrate code into a shared repository frequently, preferably several times a day. Every change is built and tested on an integration machine. The goal is to detect problems early to minimize integration issues. Continuous integration uses automated builds that are triggered on every code commit to provide rapid feedback. It helps teams integrate code and build quality in from the start.
Workshop New Relic - juni 2015
New Relic is a performance monitoring tool that can be used for three main purposes: 1) performance optimization of projects, 2) identifying elusive bugs and performance peaks during incidents, and 3) long-term performance monitoring for scalability. It tracks page response times, analyzes bottlenecks, sets alerts for error rates, and provides reports on application performance over time. The workshop discussed how New Relic can help optimize performance by identifying slow pages and recursive loads, as well as troubleshoot bugs and bottlenecks during incidents when problems cannot be reproduced.
HKG15-411: Browser Testing Framework for LHG
HKG15-411: Browser Testing Framework for LHG
---------------------------------------------------
Speaker: Trevor Woerner, Will Chen
Date: February 12, 2015
---------------------------------------------------
★ Session Summary ★
The purpose of this talk is to provide the audience with an introduction to the testing framework used in Web browser performance testing as implemented by LHG. The browser test suite is used to compare browser performance and compliance by using a series of benchmarks in key test categories. Sample browser results for both Android and RDK will be presented.
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250839
Video: https://www.youtube.com/watch?v=TtAMRnzB2nw
Etherpad: http://pad.linaro.org/p/hkg15-411
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
EFL QA: Where Are We and Where Should We Go?
The document discusses the current and missing parts of Samsung's open source QA process. It covers their use of compile-time testing, unit testing, and static analysis currently. Areas missing include runtime testing, graphical unit tests, code coverage, and pre-push continuous integration. The presentation proposes steps like making tests mandatory for new APIs, increasing test coverage 5-10% per release, improving graphical testing, and adding pre-push continuous integration through Jenkins and Phabricator hooks. It ends with questions about these proposals and announcements of job opportunities.
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
Managing changes with Salesforce or across the enterprise often requires tight turnarounds — and in some cases must be done within hours. In these situations, testing the changes and their impact on business processes is critical and must be completed faster because update and upgrade schedules can’t be controlled. Automated testing can make balancing quality control and rapid completion much easier.
In this technical webinar, you will learn:
- Why automated testing is essential
- How automated and manual testing work together
- The ways automated testing leads to higher quality products.
- How to maintain and scale testing processes over time
Watch today to learn how automated testing can take your enterprise solutions to the next level.
Recommended
Елена Панина - Drupal performance testing. Тестирование производительности, м...
Performance testing of a Drupal site can help identify issues, evaluate optimization effectiveness, and report results to clients. Tools like JMeter are used to test criteria such as response time, throughput, and hits per second by emulating user behavior under increasing load. For one project, response time dropped from 9,000ms to 330ms, throughput increased from 6.2 to 114 transactions/second, and hits per second rose from 4 to 100 after optimizing caching with Memcache, ESI, and Varnish configuration. Caching code, functions, views, databases requests, HTML, images, and static assets can improve performance.
[E-Dev-Day 2015][3/4] QA Status Report (Stefan Schmidt)
During the EDD US in March I gave a outlook on what parts of our QA infrastructure needs to get improved. Most noteworthy mandatory test cases for new API's, jenkins builds for incoming patches as phab differentials and an increasing use of exactness for testing changes on an UI level. This talk will give a status report of these ongoing changes. What have been done and what got stuck and what is still ongoing.
Synchronizing parallel delivery flows in jenkins using groovy, build flow and...
Slides from my talk on Automation Nights 15.09-STHLM
https://www.youtube.com/watch?v=1YmnTCVBdmc&index=2&list=PLuvRKxeqrv4I_y8Vxz-09-EJuP6yELwEX
Introduction to DevOps. Continuous Integration by Myroslav Dmytrus
Continuous integration is a development practice where developers integrate code into a shared repository frequently, preferably several times a day. Every change is built and tested on an integration machine. The goal is to detect problems early to minimize integration issues. Continuous integration uses automated builds that are triggered on every code commit to provide rapid feedback. It helps teams integrate code and build quality in from the start.
Workshop New Relic - juni 2015
New Relic is a performance monitoring tool that can be used for three main purposes: 1) performance optimization of projects, 2) identifying elusive bugs and performance peaks during incidents, and 3) long-term performance monitoring for scalability. It tracks page response times, analyzes bottlenecks, sets alerts for error rates, and provides reports on application performance over time. The workshop discussed how New Relic can help optimize performance by identifying slow pages and recursive loads, as well as troubleshoot bugs and bottlenecks during incidents when problems cannot be reproduced.
HKG15-411: Browser Testing Framework for LHG
HKG15-411: Browser Testing Framework for LHG
---------------------------------------------------
Speaker: Trevor Woerner, Will Chen
Date: February 12, 2015
---------------------------------------------------
★ Session Summary ★
The purpose of this talk is to provide the audience with an introduction to the testing framework used in Web browser performance testing as implemented by LHG. The browser test suite is used to compare browser performance and compliance by using a series of benchmarks in key test categories. Sample browser results for both Android and RDK will be presented.
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250839
Video: https://www.youtube.com/watch?v=TtAMRnzB2nw
Etherpad: http://pad.linaro.org/p/hkg15-411
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
EFL QA: Where Are We and Where Should We Go?
The document discusses the current and missing parts of Samsung's open source QA process. It covers their use of compile-time testing, unit testing, and static analysis currently. Areas missing include runtime testing, graphical unit tests, code coverage, and pre-push continuous integration. The presentation proposes steps like making tests mandatory for new APIs, increasing test coverage 5-10% per release, improving graphical testing, and adding pre-push continuous integration through Jenkins and Phabricator hooks. It ends with questions about these proposals and announcements of job opportunities.
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
Managing changes with Salesforce or across the enterprise often requires tight turnarounds — and in some cases must be done within hours. In these situations, testing the changes and their impact on business processes is critical and must be completed faster because update and upgrade schedules can’t be controlled. Automated testing can make balancing quality control and rapid completion much easier.
In this technical webinar, you will learn:
- Why automated testing is essential
- How automated and manual testing work together
- The ways automated testing leads to higher quality products.
- How to maintain and scale testing processes over time
Watch today to learn how automated testing can take your enterprise solutions to the next level.
QA Strategies for Testing Legacy Web Apps
Paul Miles, Software Development Manager at NPR, discusses QA strategies and tools his team uses to address the challenge of maintaining legacy products at NPR.
In this presentation, he covers:
- How to effectively strategize what types of tests to add to legacy software
- What cost-effective tools and testing strategies you can adopt in your organization
- Approaches about how to incorporate testing into your organization’s build pipelines
- How to foster testing centric culture in your organization
Using Crowdsourced Testing to Turbocharge your Development Team
Developer-owned QA testing is becoming more common as many organizations shift to leaner development processes and eschew traditional QA strategies.
This presentation discusses how crowdsourced testing can help teams offload repetitive testing work and streamline Agile testing processes. It also demonstrates how Rainforest Developer Experience (DevX) allows developers to increase productivity and minimize testing time with workflow-native crowdsourced testing.
Interested in seeing how Rainforest has helped companies save dev time and QA spend? Check out these success stories!
Guru: http://hubs.ly/H06lwC60
America's Test Kitchen: http://hubs.ly/H06lCX50
Ceilometer juno-midpoint
This document outlines the plans and work items for the Juno release of the Ceilometer project. Key areas of focus include addressing requirements from a gap analysis, paying down architectural debt by reimagining Ceilometer as a time-series data service, adopting new collaborative upstream processes, and completing work on events, SQL support, documentation and testing. Specific detailed work items are then outlined.
!!Readme
The document provides instructions for compiling and running a demonstration program for Raize Components using either Delphi or C++Builder. For Delphi, users simply need to load and compile the project file. For C++Builder, the steps include creating a new project, adding the main form file from the demo folder, removing the default file, enabling runtime packages, saving the project, and potentially editing the project file to include the necessary library files for linking.
Qtp testing
Test automation emulates user actions on an application by clicking buttons, selecting menus, navigating screens, and adding or extracting data. It provides speed, reliability, and avoids human errors for repetitive tasks. Test automation will avoid errors, establish reproducible test steps, and be useful for regression and compatibility testing to ensure stability. However, test automation cannot replace manual testing and will not find more bugs than the underlying test cases are designed to find.
Performance testing for developers
Learn how to get started with performance testing of your website, web app or API. This session is a Q&A with Load Impact founder and performance testing expert, Ragnar Lonn.
Chef tooling and TDD
The document discusses Chef tooling and test-driven development (TDD) workflows. It introduces several tools for linting, unit testing, integration testing, and validating the state of infrastructure after Chef runs. These include Cookstyle/Rubocop for linting, Foodcritic for warnings, ChefSpec for unit tests, Test Kitchen for integration on multiple platforms, and Inspec for post-convergence testing. Using these tools allows for automating testing and validation into continuous integration to catch errors and ensure idempotency and desired state.
Integrate matlab application into python
Convert Matlab application into executable binary stand alone application. After that I have also explained how to integrate it into Python. Sample code screenshots attached
Working process and git branch strategy
1. The document discusses different workflows and Git branch strategies for software development projects.
2. It shares prior experience with development workflows that include roles like project leader, engineer, product manager, tester, and processes like discussion, design, implementation, testing, and release.
3. The author proposes a better flow that focuses on finishing issues rather than versions, and having a clear project specification and tasks tracked in a dashboard.
How We Build Confidence with Continuous Integration and Automated Testing
Continuous integration and automated front end testing provide a small development team confidence in their work without a dedicated testing team. The solution involves running unit tests and automated front end tests on every code check-in through a continuous integration process managed across three servers for building, testing, and staging. This allows any new features to be constantly tested as they are added, catching issues early and providing confidence that changes did not break existing functionality.
Continuous Delivery in Practice (extended)
Extended version of a previously uploaded presentation:
10 practical field-proven tips for building a continuously delivered service, based on Kenshoo's experience with its RTB service - a critical, high throughput, highly available component, serving millions of requests per minute in under 50 milliseconds.
From coding practices to test automation, from monitoring tools to feature A/B testing - the entire development chain should be focused around removing blockers and manual steps between your code and your clients, without ever settling for quality. Join to see what makes our clients and developers happy and effective.
Seaside Web 2.0
The document discusses the capabilities of Seaside, a web framework for building dynamic web applications in Smalltalk. It covers topics like XHTML, CSS, RSS, AJAX, debugging, and JavaScript integration. Seaside allows developing web applications without having to deal with browser bugs and differences, and provides features like in-place editing, drag and drop, and sortable lists through its AJAX implementation in Smalltalk.
Continuous integration CloudParty 21 may 2014 - Milan
This document discusses continuous integration, which involves integrating code changes frequently from developers, ideally multiple times per day, and automatically testing the integrated codebase to provide quick feedback. Key aspects of continuous integration include maintaining a single code repository, automating builds, running self-testing of code through automated tests, having developers commit to the main code branch daily, automatically building and testing code on each commit, keeping the build fast, testing in the production environment clone, making the build status visible to all, automating deployments, and prioritizing fixing any broken builds. The presentation provides an example continuous integration workflow and tools used at Onebip including Phing for build automation and a deployment pipeline across different environments like CI, IT, UAT
Dev ops presentation
The document provides an introduction to DevOps. It explains that DevOps aims to integrate developers and operations teams to improve collaboration and productivity by automating infrastructure, workflows, and measuring application performance. This addresses issues where development teams faced delays deploying code and operations teams struggled with managing an increasing number of servers. DevOps adopts practices like automating infrastructure configuration and code deployment to enable continuous delivery and fast, reliable releases while allowing development and production environments to be identical.
Getting 100B Metrics to Disk
Awesome! Traffic to your site is really picking up and everything is lookin’ good. Well, except for that database back in the corner, but it will hold… right? No one really wants to deal with scaling the database tier, but hopefully your customers will drag you (perhaps kicking and screaming) to some sort of distributed database architecture.
This talk is all about scaling MySQL through hardware optimizations and sharding from a Site Engineering perspective. This includes real world examples of finding pain points, identifying risks, and evaluating cloud vs hardware scaling. I’ll also discus distributed database management, dealing with data purging, making consistent backups, and how to keep the site up when things go bad.
Data viz as_interface_makoto_inoue
This document discusses using data visualization as an interface for exploring minute-by-minute event data from sources like Premier League soccer matches and political transcripts. It proposes a "Data Driven Player" application that would allow users to visualize positional changes, traffic patterns, and compiled videos to find interesting moments in the source data. Publishers, data providers, and users would all benefit from such an app by gaining insights into user behavior and having an easy way to browse data.
Why Page Speed Isn't Enough - Tim Morrow - Velocity Europe 2012
Betfair has completed a ground-up re-write of our Sports betting web platform. We focused on the fundamentals of resiliency and performance. We measured and improved and measured again and in the process, saw our page load times drop by a factor of 5; on average our full page load is under 3 seconds. We met our promise to our customers.
But some of our customers kept telling us our new site was slow. Many sophisticated customers have chosen to stay using our previous platform; there is a big opportunity cost while those customers have not chosen to experience the new products and features we’ve delivered on the new platform.
All our indicators say our new site is fast and our customers should be happy. We all know a faster site means more money, but we’re not getting the benefits we expect.
In this talk, hear Tim Morrow tell the story of how making Betfair’s site faster for most customers actually made it 3x slower for their biggest customers. Truly, you get what you measure.
Velocity EU 2013 What is the velocity of an unladen swallow?
Seatwave was growing fast, success was unabated, and industry awards were landing on their doormat. Infrastructure had been revamped, load patterns were understood. Everything was going just great…
Until…
The marketing team planned Seatwave’s first UK TV campaign – all regions – simultaneously, but only told the engineering team the day before the first advert was due to run!
10 seconds into the advert the site melted and there was a collective thud as heads hit desks.
It was expensive lesson to learn but also the wake up call that forced everyone in Seatwave to focus on the performance of their site.
In this session we’ll share that pain we experienced, and how we improved performance so that when all our competitors crashed during the UKs largest concert ticket sale, we were able to take 20 days revenue in just 2 hours!
However, maintaining performance is a challenge, product owners want new features, the site starts to put on weight and slowly performance starts to degrade once more.
Will it take another disaster to focus everyone on performance or is there another way to avoid “boom and bust”?
We’ll talk about the steps we’re taking to avoid “boom and bust” by making both performance and the impact performance has on our customers visible to everyone across Seatwave including:
Our Adobe Site Catalyst installation with a custom implementation of the W3C Navigation Timing API allowing us to segment our business KPI’s by speed.
How we’re using a WebPageTest within continuous integration for our QA and production builds.
How we constantly review our performance against competitors using our own installation of the HTTPArchive.
Join us on our quest in search of the Holy Grail of truly understanding how web site performance affects our business, and the processes and systems we are putting in place to ensure we keep speed at the heart of our product development roadmap.
Performance and Metrics at Lonely Planet
Lonely Planet worked to improve the performance of their website to increase conversion rates and revenue. They found removing third-party content sped up page loads but hurt engagement. Experiments showed performance improvements between 100-200ms increased conversion. Cultural change was needed to prioritize performance, with expanded engineer roles and comprehensive, visible metrics. Tools like Fozzie and Flamsteed helped measure performance and capture real user monitoring data. Continuous experimentation and collaboration keep Lonely Planet staying fast.
Are Today’s Good Practices… Tomorrow’s Performance Anti-Patterns?
This document discusses how performance best practices may become anti-patterns as technologies evolve. It explores how techniques like data URIs, domain sharding, and CSS sprites could be negatively impacted by new protocols like SPDY. The author advocates experimenting with modern tools like mod_pagespeed to test different optimizations under various conditions and sharing results. Continued improvement of debugging tools is also important to help evaluate new approaches as the network landscape changes. Overall, the message is that situational optimization will become more important over rigid rules as complexity increases.
Bring the Noise
This talk was given at Velocity '13 in Santa Clara by Abe Stanway and Jon Cowie. It talks about how Etsy make sense of the 250k metrics they gather, using their new Kale stack.
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...
For the Velocity Conference Europe 2012 workshop day this presentation is about the essentials for creation and building a Web Performance dashboard. This with ultimate goal of providing the audience a framework for designing and building a web performance dashboard. The session will cover the following 3 items:
Design guidelines: What defines a web performance dashboard? How to make sure it’s actionable and for people to actually use it on day to day basis?
Data collection: Why performance data? The various ways there are to collect data (e.g. synthetic versus RUM data, Webpagetest, Mobile) and how to correlate the different types of data and tools
Building the dashboard: How to build the actual dashboard, providing an overview of the tools/techniques used
At the end of the workshop you will be able to design and build your own dashboard based on the framework provided, or to optimize the current dashboards within your organization.
More Related Content
What's hot
QA Strategies for Testing Legacy Web Apps
Paul Miles, Software Development Manager at NPR, discusses QA strategies and tools his team uses to address the challenge of maintaining legacy products at NPR.
In this presentation, he covers:
- How to effectively strategize what types of tests to add to legacy software
- What cost-effective tools and testing strategies you can adopt in your organization
- Approaches about how to incorporate testing into your organization’s build pipelines
- How to foster testing centric culture in your organization
Using Crowdsourced Testing to Turbocharge your Development Team
Developer-owned QA testing is becoming more common as many organizations shift to leaner development processes and eschew traditional QA strategies.
This presentation discusses how crowdsourced testing can help teams offload repetitive testing work and streamline Agile testing processes. It also demonstrates how Rainforest Developer Experience (DevX) allows developers to increase productivity and minimize testing time with workflow-native crowdsourced testing.
Interested in seeing how Rainforest has helped companies save dev time and QA spend? Check out these success stories!
Guru: http://hubs.ly/H06lwC60
America's Test Kitchen: http://hubs.ly/H06lCX50
Ceilometer juno-midpoint
This document outlines the plans and work items for the Juno release of the Ceilometer project. Key areas of focus include addressing requirements from a gap analysis, paying down architectural debt by reimagining Ceilometer as a time-series data service, adopting new collaborative upstream processes, and completing work on events, SQL support, documentation and testing. Specific detailed work items are then outlined.
!!Readme
The document provides instructions for compiling and running a demonstration program for Raize Components using either Delphi or C++Builder. For Delphi, users simply need to load and compile the project file. For C++Builder, the steps include creating a new project, adding the main form file from the demo folder, removing the default file, enabling runtime packages, saving the project, and potentially editing the project file to include the necessary library files for linking.
Qtp testing
Test automation emulates user actions on an application by clicking buttons, selecting menus, navigating screens, and adding or extracting data. It provides speed, reliability, and avoids human errors for repetitive tasks. Test automation will avoid errors, establish reproducible test steps, and be useful for regression and compatibility testing to ensure stability. However, test automation cannot replace manual testing and will not find more bugs than the underlying test cases are designed to find.
Performance testing for developers
Learn how to get started with performance testing of your website, web app or API. This session is a Q&A with Load Impact founder and performance testing expert, Ragnar Lonn.
Chef tooling and TDD
The document discusses Chef tooling and test-driven development (TDD) workflows. It introduces several tools for linting, unit testing, integration testing, and validating the state of infrastructure after Chef runs. These include Cookstyle/Rubocop for linting, Foodcritic for warnings, ChefSpec for unit tests, Test Kitchen for integration on multiple platforms, and Inspec for post-convergence testing. Using these tools allows for automating testing and validation into continuous integration to catch errors and ensure idempotency and desired state.
Integrate matlab application into python
Convert Matlab application into executable binary stand alone application. After that I have also explained how to integrate it into Python. Sample code screenshots attached
Working process and git branch strategy
1. The document discusses different workflows and Git branch strategies for software development projects.
2. It shares prior experience with development workflows that include roles like project leader, engineer, product manager, tester, and processes like discussion, design, implementation, testing, and release.
3. The author proposes a better flow that focuses on finishing issues rather than versions, and having a clear project specification and tasks tracked in a dashboard.
How We Build Confidence with Continuous Integration and Automated Testing
Continuous integration and automated front end testing provide a small development team confidence in their work without a dedicated testing team. The solution involves running unit tests and automated front end tests on every code check-in through a continuous integration process managed across three servers for building, testing, and staging. This allows any new features to be constantly tested as they are added, catching issues early and providing confidence that changes did not break existing functionality.
Continuous Delivery in Practice (extended)
Extended version of a previously uploaded presentation:
10 practical field-proven tips for building a continuously delivered service, based on Kenshoo's experience with its RTB service - a critical, high throughput, highly available component, serving millions of requests per minute in under 50 milliseconds.
From coding practices to test automation, from monitoring tools to feature A/B testing - the entire development chain should be focused around removing blockers and manual steps between your code and your clients, without ever settling for quality. Join to see what makes our clients and developers happy and effective.
Seaside Web 2.0
The document discusses the capabilities of Seaside, a web framework for building dynamic web applications in Smalltalk. It covers topics like XHTML, CSS, RSS, AJAX, debugging, and JavaScript integration. Seaside allows developing web applications without having to deal with browser bugs and differences, and provides features like in-place editing, drag and drop, and sortable lists through its AJAX implementation in Smalltalk.
Continuous integration CloudParty 21 may 2014 - Milan
This document discusses continuous integration, which involves integrating code changes frequently from developers, ideally multiple times per day, and automatically testing the integrated codebase to provide quick feedback. Key aspects of continuous integration include maintaining a single code repository, automating builds, running self-testing of code through automated tests, having developers commit to the main code branch daily, automatically building and testing code on each commit, keeping the build fast, testing in the production environment clone, making the build status visible to all, automating deployments, and prioritizing fixing any broken builds. The presentation provides an example continuous integration workflow and tools used at Onebip including Phing for build automation and a deployment pipeline across different environments like CI, IT, UAT
Dev ops presentation
The document provides an introduction to DevOps. It explains that DevOps aims to integrate developers and operations teams to improve collaboration and productivity by automating infrastructure, workflows, and measuring application performance. This addresses issues where development teams faced delays deploying code and operations teams struggled with managing an increasing number of servers. DevOps adopts practices like automating infrastructure configuration and code deployment to enable continuous delivery and fast, reliable releases while allowing development and production environments to be identical.
What's hot (14)
Using Crowdsourced Testing to Turbocharge your Development Team
Using Crowdsourced Testing to Turbocharge your Development Team
How We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated Testing
Continuous integration CloudParty 21 may 2014 - Milan
Continuous integration CloudParty 21 may 2014 - Milan
Viewers also liked
Getting 100B Metrics to Disk
Awesome! Traffic to your site is really picking up and everything is lookin’ good. Well, except for that database back in the corner, but it will hold… right? No one really wants to deal with scaling the database tier, but hopefully your customers will drag you (perhaps kicking and screaming) to some sort of distributed database architecture.
This talk is all about scaling MySQL through hardware optimizations and sharding from a Site Engineering perspective. This includes real world examples of finding pain points, identifying risks, and evaluating cloud vs hardware scaling. I’ll also discus distributed database management, dealing with data purging, making consistent backups, and how to keep the site up when things go bad.
Data viz as_interface_makoto_inoue
This document discusses using data visualization as an interface for exploring minute-by-minute event data from sources like Premier League soccer matches and political transcripts. It proposes a "Data Driven Player" application that would allow users to visualize positional changes, traffic patterns, and compiled videos to find interesting moments in the source data. Publishers, data providers, and users would all benefit from such an app by gaining insights into user behavior and having an easy way to browse data.
Why Page Speed Isn't Enough - Tim Morrow - Velocity Europe 2012
Betfair has completed a ground-up re-write of our Sports betting web platform. We focused on the fundamentals of resiliency and performance. We measured and improved and measured again and in the process, saw our page load times drop by a factor of 5; on average our full page load is under 3 seconds. We met our promise to our customers.
But some of our customers kept telling us our new site was slow. Many sophisticated customers have chosen to stay using our previous platform; there is a big opportunity cost while those customers have not chosen to experience the new products and features we’ve delivered on the new platform.
All our indicators say our new site is fast and our customers should be happy. We all know a faster site means more money, but we’re not getting the benefits we expect.
In this talk, hear Tim Morrow tell the story of how making Betfair’s site faster for most customers actually made it 3x slower for their biggest customers. Truly, you get what you measure.
Velocity EU 2013 What is the velocity of an unladen swallow?
Seatwave was growing fast, success was unabated, and industry awards were landing on their doormat. Infrastructure had been revamped, load patterns were understood. Everything was going just great…
Until…
The marketing team planned Seatwave’s first UK TV campaign – all regions – simultaneously, but only told the engineering team the day before the first advert was due to run!
10 seconds into the advert the site melted and there was a collective thud as heads hit desks.
It was expensive lesson to learn but also the wake up call that forced everyone in Seatwave to focus on the performance of their site.
In this session we’ll share that pain we experienced, and how we improved performance so that when all our competitors crashed during the UKs largest concert ticket sale, we were able to take 20 days revenue in just 2 hours!
However, maintaining performance is a challenge, product owners want new features, the site starts to put on weight and slowly performance starts to degrade once more.
Will it take another disaster to focus everyone on performance or is there another way to avoid “boom and bust”?
We’ll talk about the steps we’re taking to avoid “boom and bust” by making both performance and the impact performance has on our customers visible to everyone across Seatwave including:
Our Adobe Site Catalyst installation with a custom implementation of the W3C Navigation Timing API allowing us to segment our business KPI’s by speed.
How we’re using a WebPageTest within continuous integration for our QA and production builds.
How we constantly review our performance against competitors using our own installation of the HTTPArchive.
Join us on our quest in search of the Holy Grail of truly understanding how web site performance affects our business, and the processes and systems we are putting in place to ensure we keep speed at the heart of our product development roadmap.
Performance and Metrics at Lonely Planet
Lonely Planet worked to improve the performance of their website to increase conversion rates and revenue. They found removing third-party content sped up page loads but hurt engagement. Experiments showed performance improvements between 100-200ms increased conversion. Cultural change was needed to prioritize performance, with expanded engineer roles and comprehensive, visible metrics. Tools like Fozzie and Flamsteed helped measure performance and capture real user monitoring data. Continuous experimentation and collaboration keep Lonely Planet staying fast.
Are Today’s Good Practices… Tomorrow’s Performance Anti-Patterns?
This document discusses how performance best practices may become anti-patterns as technologies evolve. It explores how techniques like data URIs, domain sharding, and CSS sprites could be negatively impacted by new protocols like SPDY. The author advocates experimenting with modern tools like mod_pagespeed to test different optimizations under various conditions and sharing results. Continued improvement of debugging tools is also important to help evaluate new approaches as the network landscape changes. Overall, the message is that situational optimization will become more important over rigid rules as complexity increases.
Bring the Noise
This talk was given at Velocity '13 in Santa Clara by Abe Stanway and Jon Cowie. It talks about how Etsy make sense of the 250k metrics they gather, using their new Kale stack.
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...
For the Velocity Conference Europe 2012 workshop day this presentation is about the essentials for creation and building a Web Performance dashboard. This with ultimate goal of providing the audience a framework for designing and building a web performance dashboard. The session will cover the following 3 items:
Design guidelines: What defines a web performance dashboard? How to make sure it’s actionable and for people to actually use it on day to day basis?
Data collection: Why performance data? The various ways there are to collect data (e.g. synthetic versus RUM data, Webpagetest, Mobile) and how to correlate the different types of data and tools
Building the dashboard: How to build the actual dashboard, providing an overview of the tools/techniques used
At the end of the workshop you will be able to design and build your own dashboard based on the framework provided, or to optimize the current dashboards within your organization.
Velocity EU 2012 - Third party scripts and you
The document discusses strategies for loading third-party scripts asynchronously to improve page load performance. It notes that the frontend accounts for 80-90% of end user response time and recommends loading scripts asynchronously using techniques like async, defer, and loading scripts at the bottom of the page. It also discusses tools for monitoring performance when third-party scripts are blocked.
Integrating multiple CDNs at Etsy
We embarked on a project to use multiple CDNs concurrently at Etsy. This talk goes through how and why.
Be Mean to Your Code with Gauntlt and the Rugged Way // Velocity EU 2013 Work...
This is a hands-on workshop for working with Gauntlt. The first half is philosophy, theory and social commentary. The second half is the hands on workshop.
There are two options for working through the workshop. The recommended way is to use the virtual box image as there are a couple of security tools (arachni, nmap, ...) that we will be using. It is not required for you to use it though and you can just clone the repo if you have ruby 1.9.3 and bundler.
If you want to use the vagrant box setup for the workshop, please follow the instructions in 02_Using Vagrant Box.md and if you want to just use our own box, follow the directions in 03_Using Repo Only.md
This has been tested to work on linux and OS X. You can follow along using the instructions > https://gist.github.com/wickett/25d90a462706639446cc
Software enginering
Dokumen tersebut membahas tentang Context Diagram, Data Flow Diagram (DFD), dan Flow Map sebagai alat untuk merancang sistem berorientasi pada aliran data. Context Diagram menunjukkan sistem secara keseluruhan dengan satu proses, DFD menggambarkan aliran data sistem, dan Flow Map mendefinisikan hubungan antara bagian proses, proses, dan aliran data.
Jti vol1 no2_politeknik telkom_lisana_pembuatan aplikasi multimedia pembelajaran
Dokumen tersebut membahas tentang pembuatan aplikasi multimedia pembelajaran tentang cara berkendara yang baik. Aplikasi ini dibuat untuk mengatasi kelemahan pembelajaran melalui buku yang membosankan dan sulit mengukur pemahaman. Aplikasi ini berisi materi cara berkendara yang baik dan rambu-rambu lalu lintas beserta fitur evaluasi untuk mengukur pemahaman pengguna.
Belajar html!!
HTML adalah bahasa standar yang digunakan untuk membuat halaman web. HTML menggunakan tag-tag untuk menandai konten dan struktur dokumen. Tag-tag dasar HTML digunakan untuk membuat heading, paragraf, daftar, tabel, gambar, dan tautan.
Viewers also liked (14)
Why Page Speed Isn't Enough - Tim Morrow - Velocity Europe 2012
Why Page Speed Isn't Enough - Tim Morrow - Velocity Europe 2012
Velocity EU 2013 What is the velocity of an unladen swallow?
Velocity EU 2013 What is the velocity of an unladen swallow?
Are Today’s Good Practices… Tomorrow’s Performance Anti-Patterns?
Are Today’s Good Practices… Tomorrow’s Performance Anti-Patterns?
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...
Be Mean to Your Code with Gauntlt and the Rugged Way // Velocity EU 2013 Work...
Be Mean to Your Code with Gauntlt and the Rugged Way // Velocity EU 2013 Work...
Jti vol1 no2_politeknik telkom_lisana_pembuatan aplikasi multimedia pembelajaran
Jti vol1 no2_politeknik telkom_lisana_pembuatan aplikasi multimedia pembelajaran
Similar to Velocity 2013 london developer-friendly web performance testing in continuous integration
Integration testing - A&BP CC
Have you ever wondered what the best way would be to test emails? Or how you would go about testing a messaging queue?
Making sure your components are correctly interacting with each other is both a tester and developer’s concern. Join us to get a better understanding of what you should test and how, both manually and automated.
This session is the first ever in which we will have two units working together to give you a nuanced insight on all aspects of integration testing. We’ll start off exploring the world of integration testing, defining the terminology, and creating a general understanding of what phases and kinds of testing exist. Later on we’ll delve into integration test automation, ranging from database integration testing to selenium UI testing and even as far as LDAP integration testing.
We have a wide variety of demos prepared where we will show you how easy it is to test various components of your infrastructure. Some examples:
- Database testing (JPA)
- Arquillian, exploring container testing, EJB testing and more
- Email testing
- SOAP testing using SoapUI
- LDAP testing
- JMS testing
Cloud Native CI/CD with Spring Cloud Pipelines
Spring, Spring Boot and Spring Cloud are tools that allow developers to speed up the creation of new business features. But a new feature is only useful if it's in production. Companies spend a lot of time and resources on building their own deployment pipelines using a plethora of technologies. Spring Cloud Pipelines provides an opinionated way for getting your features to production in a fast, reliable, reproducible and fully automated way.
Cloud Native CI/CD with Spring Cloud Pipelines
The document discusses Spring Cloud Pipelines, which provides an opinionated continuous integration and continuous delivery (CI/CD) pipeline for deploying applications. It outlines the challenges of traditional CI/CD approaches and how Spring Cloud Pipelines addresses them by standardizing and automating the pipeline. The key aspects covered include:
- The anatomy of an opinionated pipeline, including environments like build, test, stage, and production.
- How the pipeline incorporates different types of automated testing at each stage, from unit to integration to smoke tests.
- The typical steps in the pipeline like building, testing API compatibility, deploying to environments, smoke testing, rolling back if needed, and deploying to production.
First Steps to DevOps
The DevOps methodology integrates development and operations so that system changes can get rolled out quickly without causing unplanned downtime. Industrial organizations that successfully implement DevOps will have a strong advantage, but knowing how to get started can be a real challenge.
DevOps Transformation: Learnings and Best Practices
The presentation delves into the best practices and approach for DevOps adoption. Understand key aspects of DevOps and how it brings about speed and efficiency in the software development lifecycle
Building a Complete Pipeline: The Essential Components of Continuous Testing ...
Full webinar recording --
In an era when testing is no longer limited to end-of-line waterfall-type process -- but is an integral and substantial part of the end-to-end development process -- it is ever more pressing to look under the hood of the tools, technologies, processes, and best practices utilized by top-notch testing teams that release world-class software.
In this webinar, we took an in-depth look at the technical aspects required to successfully scale continuous testing -- and discussed the tools and technologies used by leading engineering teams, including their approach to managing functional, performance and visual testing at scale.
We also took a hands-on approach: via a live demo, we showed how all of these come together to create a complete end-to-end quality pipeline that supports continuous testing at scale.
Introduction to Test Automation
A brief introduction to test automation covering different automation approaches, when to automate and by whom, commercial vs. open source tools, testability, and so on.
Expedia 3x3 presentation
The document describes LinkedIn's 3x3 mobile release process. Key points:
- Release new versions of the LinkedIn app 3 times per day, with a maximum of 3 hours from code commit to member availability.
- This allowed for faster iteration and feedback compared to previous monthly releases.
- The commit pipeline includes code review, static analysis, unit tests, UI tests, and staged releases to alpha and beta testers.
- Ensuring test stability and reliability was a challenge given the fast release cadence. Techniques included stabilizing the testing environment and framework, and improving test quality.
Continuous Delivery at Snyk
A deck from the first CDIsrael meetup, presenting our CD flow at Snyk, focusing on our testing framework. A day in a life of a developer - code, test, publish, deploy, monitor.
Dev ops
The document provides an introduction to DevOps, which promotes collaboration between development and operations teams. It discusses models used before DevOps, including the waterfall model and agile methodology. While agile methodology improved on waterfall by allowing for continuous development and testing, a lack of collaboration between teams remained an issue. DevOps aims to address this by having development and operations engineers work together throughout the entire lifecycle from design to deployment. This is intended to result in faster delivery of features to customers while also improving stability. The document outlines the DevOps lifecycle from continuous development to continuous monitoring.
Automated Testing of Web Applications
Testing is an important part of all software projects – and so is keeping sane. In order to not make the developers and testers lose their minds while verifying that a huge amount of features still work, the testing should be automated. What’s worse, the complexity of the underlying technologies often make it more challenging to test web applications than conventional software.
This talk will show you some tools and methodologies for automated testing of web apps and especially the user interface layer of web apps. It will discuss how to architect a web app for easy testing and what kind of tests should go where and in which situation. We’ll even have a look at how the customer requirements can be automatically tested and verified to work – exactly as specified by the ones paying the bills.
Test automation lessons from WebSphere Application Server
The document discusses WebSphere testing at IBM. It provides an overview of IBM's:
- Extensive testing resources including over 200 engineers and thousands of systems.
- Daily regression testing of over 1.7 million tests.
- Transition from waterfall to agile development which reduced cycle times and resources needed for testing.
- Use of cloud resources to speed up test deployment and automation.
- Focus on creating meaningful regressions through techniques like integration acceptance tests run continuously on each build.
StarWest 2019 - End to end testing: Stupid or Legit?
This document discusses end-to-end testing and how traditional testing tools are not keeping up with modern development practices like continuous integration and delivery (CI/CD). It introduces the concept of using a testing platform called mabl that enables easy creation of reusable modular end-to-end tests. Mabl provides features like root cause analysis, visual testing, performance monitoring and data-driven parameterized testing to help scale testing in a DevTestOps environment. A live demo is shown of creating data-driven tests using mabl.
Practical Software Testing Tools
Manual testing involves a human tester performing actions and verifying results, while automated testing uses a tool to playback and replay tests. The document discusses various software testing tools, including WinRunner for functional testing of Windows apps, SilkTest for web apps, and LoadRunner for performance and load testing. It provides overviews and demonstrations of the tools' functionality, such as recording and playing back tests, verifying results, and generating load to assess performance.
End to-end test automation at scale
Slides by Anton Hristov, Product Manager of mabl.
Watch the accompanying webinar: https://www.mabl.com/blog/end-to-end-automation-at-scale
Testing end-to-end user scenarios is challenging, yet more important than ever due to increased complexity, variety and importance of user interfaces. Delivering a quality user experience requires taking a holistic view of the end-to-end user journey, which can span across applications, browsers, devices and different modes of interaction such as touch and voice.
In this webinar, we will explore different ways mabl can help you create intelligent end-to-end tests that focus on the user journey and run at scale across browsers. No scripting necessary.
Learning outcomes:
Why we need to shift from quality assurance to quality intelligence
How to create intelligent tests quickly to increase coverage
What diagnostics information is available for root-cause analysis
When and how to reuse a set of steps across multiple tests
When and how to apply data-driven (parameterized) testing approach
AMC Networks Experiments Faster on the Server Side
Speeding up innovation only matters if it helps you drive positive outcomes. At AMC, experimentation enables the product and platform teams to challenge their assumptions, maximize impact, and evaluate ideas as painted door tests before investing in significant development. A commitment to test everything across 9 platforms fueled their search for the most scalable solution.
In this session, you'll learn how to:
Leverage server-side testing to experiment quickly
Scale across web, mobile, and OTT applications
Determine when client-side testing is more efficient
ENASE 2013 - SEM - (Francia) From Functional Test Scripts to Performance Test...
When modernizing systems the software is migrated from one platform to another. There are big risks concerning the performance the system should have in the new platform. A new system cannot take more time to perform the same operations than the previous one as the users will refuse it. Therefore, the preventive performance test is crucial to guarantee the success of the modernization project. However, the automation tasks for performance testing are too demanding, in terms of time and effort, as the tools work at a communication protocol level. Though not free, the functional testing automation is easier to accomplish than the performance testing automation as the tools work at a graphic user interface level; the tools are therefore more intuitive and they have to handle less variables and technical issues. In this article we present a tool that we developed for industrial usage to automatically generate performance tests scripts from automated functional tests. The tool has been used in several projects in the industry, achieving important effort savings and improving flexibility.
Automation Testing with Test Complete
Automation testing involves developing and executing tests that can run unattended, comparing actual and expected results. The major objectives of automation testing are to speed up testing, reduce costs and time, and increase quality. Automation testing is faster than manual testing and can test more scenarios. However, high upfront investment is required for tools and training. Both manual and automation testing are needed as automation does not cover all test cases. Popular automation testing tools include Selenium, QTP, and TestComplete.
MBLTDev15: Brigit Lyons, Soundcloud
The document discusses SoundCloud's approach to mobile testing, including:
- Engineers write unit and UI tests which are run continuously after each code change. Manual testing is also done before releases.
- A test runner service manages test execution across devices in parallel to improve efficiency compared to relying solely on Jenkins.
- An IntelliJ plugin was created to allow testing directly from the IDE for local development, integrating with the test runner service.
DevOps for TYPO3 Teams and Projects
The document discusses DevOps practices for TYPO3 projects. It defines DevOps as the confluence of development and operations. It highlights the importance of communication between different roles like developers, system administrators, and integrators. It also provides examples of tools and techniques that can be used at different stages of a TYPO3 project to facilitate DevOps practices, such as automated testing, deployment automation, and content synchronization.
Similar to Velocity 2013 london developer-friendly web performance testing in continuous integration (20)
DevOps Transformation: Learnings and Best Practices
DevOps Transformation: Learnings and Best Practices
Building a Complete Pipeline: The Essential Components of Continuous Testing ...
Building a Complete Pipeline: The Essential Components of Continuous Testing ...
Test automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application Server
StarWest 2019 - End to end testing: Stupid or Legit?
StarWest 2019 - End to end testing: Stupid or Legit?
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
ENASE 2013 - SEM - (Francia) From Functional Test Scripts to Performance Test...
ENASE 2013 - SEM - (Francia) From Functional Test Scripts to Performance Test...
Recently uploaded
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
“I’m still / I’m still / Chaining from the Block”
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
ここ3000字までしか入らないけどタイトルの方がたくさん文字入ると思います。
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Recently uploaded (20)
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Velocity 2013 london developer-friendly web performance testing in continuous integration
- 1. Developer-Friendly Web Performance Testing in Continuous Integration Michael Klepikov, Google Velocity Conference, London, 2013
- 2. Overview ● Web performance testing is hard ● Sidelines of web app lifecycle ● Move to mainstream ● Integrate with main UI continuous build ● Make fixes cheaper
- 3. Perf testing on sidelines ● Many awesome perf test tools ○ WebPageTest.org ● Domain of few experts ● High maintenance ● Hard to add to regular continuous build
- 4. Why hard to integrate? ● Focus on browser only ○ No control of server start/stop ○ CB must run at a specific changelist ● Own test scheduler (e.g. WebPageTest) ○ Impedance mismatch with main CB scheduler
- 5. Expensive to fix production ● Complex end to end system ○ Regression could be anywhere, not just browser ● Hard to find the culprit change ○ 100’s-1000’s of developer changes + cherrypicks ● Production release logistics
- 6. Dedicated Perf Tests Rot UI evolves Tests break Who fill fix?
- 7. Selenium 2.0 - WebDriver ● Pervasive adoption in web UI tests ● All major browsers, desktop and mobile ○ W3C standard ● No direct support for perf testing ○ Bad idea to measure around Selenium/WD API calls
- 8. Real User Monitoring ● Self-instrumentation + reporting in JS ● Arguably more important than perf testing ● Track metrics that matter ● Interactive pages (page-load meaningless) ● Easier to attribute than page-load time
- 9. Perf tests that ride on UI tests ● UI tests trigger RUM ● Intercept metrics ○ and DevTools traces ● UI tests stay green ○ keep perf tests green
- 10. Collect DevTools traces ● Selenium Logging API: LogType.PERFORMANCE ● Save in test results ● Compare before vs. after traces ○ Great aid for debugging regressions ● Test infrastructure does it transparently
- 11. Intercept RUM metrics ● Parse from the saved DevTools trace ○ …/report?a=10,b=220 ● Store to a database ○ Time Series of Time Series: changelists, iterations ● Graph, autodetect regressions ○ TSViewDB
- 12. Iterations ● Run many iterations of same UI test ○ At the same changelist ● Statistically viable ○ Keep in mind – the distribution is not normal! ● Test infrastructure does it transparently
- 13. RUM metrics from UI tests Graphs ! Detect regressions Drill down
- 14. WebPageTest: results UI only ● Don’t schedule tests on WPT ● Send perf test results to WPT server ○ Awesome UI, lots of useful analysis for free ● Link from main test results UI to WPT page ● TSViewDB integration, with drill-down
- 15. Performance Test Lifecycle Add Instrumentation Reporting to your (web) app Continuous Performance Tests Fix Push to Production Regression Alerts Real User Monitoring
- 16. Perf tests run longer: two CBs Main CB green builds bisect the culprit Perf CB
- 17. Caveats ● Do not predict absolute production latency! ○ Ideally server under test runs in isolation in CB ○ Limited variety of hardware, networks ● Only detect regressions ○ E.g. daily regression summary email
- 18. Conclusions ● Use UI functional tests as a base ● Intercept RUM, run many iterations ● Run continuously! ● Autodetect regressions, CL author to fix! ● Debug production less!
- 19. Q&A These slides: goo.gl/HdUCqL Intercept DevTools: youtu.be/0_kAPWSZNY4 Send results to WPT: gist.github.com/klepikov TSViewDB: github.com/google/tsviewdb