Web API Fragility: How Robust Is Your Mobile Application?
•Download as PPTX, PDF•
1 like•1,211 views
What happens when the web API (REST) starts to evolve? Will your mobile app still work? In this study we looked at 43 popular Android apps.
Report
Share
Report
Share
Recommended
How to Find Vulnerabilities and Bugs in Mobile Applications
As mobile devices, tools, operating systems, and web technologies rapidly evolve, testers must quickly adapt their thinking in this changing domain. Testers often struggle to find important vulnerabilities and bugs in mobile applications due to lack of guidance, experience, and the right resources. Raj Subramanian was a tester in that very situation. Hear what Raj learned from his experiences testing mobile applications previously at Orbitz and now at CSG Ascendon. CSG uses a cloud-based commerce and service delivery platform to deliver digital content to customers like SONY, Paramount, Cineplex, Disney, ESPN, COMCAST, Time Warner, Dish. He explores test techniques and tools you can use to get quick feedback about your mobile applications. With live demos and screenshots, Raj demonstrates things testers need to know about the mobile ecosystem and the tests that need to be in their suite. Take back test strategies and tools to apply in your real-world situations.
ATAGTR2017 SPEAKING EYE for differently abled people to see the web content
The presentation on SPEAKING EYE for differently abled people to see the web content was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Nadeeka Samanthi Wijewantha
Making the Transition from Manual to Automated Testing
The document discusses making the transition from manual to automated testing. It provides an agenda that covers planning the transition, keeping automation going once started, considerations in tool selection, and a demo of eureQa and Sauce Labs. The transition involves scoping what to automate, organizing tests for reuse, ensuring traceability, and selecting tools based on team strengths and capabilities. Key aspects of keeping automation running include ease of maintenance, integrating testing into development, and managing results through reporting and analytics.
Functional to Visual: AI-powered UI Testing from Testim and Applitools
As leaders in the application of AI to test automation, Applitools and Testim have come together to simplify test creation, maintenance and execution. Join this webinar to learn how you can elevate your approach to test automation with AI-powered codeless functional and visual UI testing.
Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
If you’re building sophisticated, data-intensive web applications but have not implemented a comprehensive end-to-end testing strategy, join our webinar to learn how. You’ll learn how you can create unit and end-to-end functional tests quickly and execute them on multiple browsers simultaneously, which in turn will increase team productivity and accelerate release cycles.
In this session, we will provide real-world examples including how we’ve tested our own complex web app framework Sencha Ext JS to show how you can scale the automated test suite to over thousands of test cases and cross-browser combinations for a complete regression cycle. We will demonstrate how we are able to test individual UI components, combinations of components, and finally as part of an application.
Join us and you will learn how to:
-Create a robust test strategy for Web Application Testing
-Implement page object design to improve long term maintenance
-Implement an automated DevOps process to execute tests in parallel, drastically reducing the time spent on a browser farm
CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Tole...
This document outlines an agenda for a presentation on mobile performance testing. The presentation will cover performance testing concepts and tools for both server-side and client-side testing. It will discuss load testing tools like JMeter and Taurus for server testing. For client testing, it will cover tools like PageSpeed, Yslow, and Monkop for analyzing mobile app performance on devices. The presentation will also demonstrate Continuous Integration of performance tests with Monkop and Taurus. Hands-on exercises will have attendees run a sample test with Monkop and Taurus to analyze results.
Get More out of Appium
Make your Appium scripts enterprise-grade with the Continuous Quality Lab™
Appium makes automated testing easy, but until now, Dev teams using Appium faced challenges efficiently scaling, controlling test devices, and recreating real end-user conditions.
Now, you can extend your Appium scripts to turbocharge app testing with Perfecto Mobile’s Continuous Quality Lab™.
Measuring your way_to_successful_automation_webinar
Developing a set of metrics is the first step to make in your transition to automation. A quantitative goal will help convince your boss what you need now and help you measure improvement over time.
In this Webinar, Rajeev Rai, the CEO of QASource, who has over 25 years of experience in QA and is a veteran at creating and managing high quality teams, will discuss metrics that helped him overcome challenges to drive automation success.
Recommended
How to Find Vulnerabilities and Bugs in Mobile Applications
As mobile devices, tools, operating systems, and web technologies rapidly evolve, testers must quickly adapt their thinking in this changing domain. Testers often struggle to find important vulnerabilities and bugs in mobile applications due to lack of guidance, experience, and the right resources. Raj Subramanian was a tester in that very situation. Hear what Raj learned from his experiences testing mobile applications previously at Orbitz and now at CSG Ascendon. CSG uses a cloud-based commerce and service delivery platform to deliver digital content to customers like SONY, Paramount, Cineplex, Disney, ESPN, COMCAST, Time Warner, Dish. He explores test techniques and tools you can use to get quick feedback about your mobile applications. With live demos and screenshots, Raj demonstrates things testers need to know about the mobile ecosystem and the tests that need to be in their suite. Take back test strategies and tools to apply in your real-world situations.
ATAGTR2017 SPEAKING EYE for differently abled people to see the web content
The presentation on SPEAKING EYE for differently abled people to see the web content was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Nadeeka Samanthi Wijewantha
Making the Transition from Manual to Automated Testing
The document discusses making the transition from manual to automated testing. It provides an agenda that covers planning the transition, keeping automation going once started, considerations in tool selection, and a demo of eureQa and Sauce Labs. The transition involves scoping what to automate, organizing tests for reuse, ensuring traceability, and selecting tools based on team strengths and capabilities. Key aspects of keeping automation running include ease of maintenance, integrating testing into development, and managing results through reporting and analytics.
Functional to Visual: AI-powered UI Testing from Testim and Applitools
As leaders in the application of AI to test automation, Applitools and Testim have come together to simplify test creation, maintenance and execution. Join this webinar to learn how you can elevate your approach to test automation with AI-powered codeless functional and visual UI testing.
Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
If you’re building sophisticated, data-intensive web applications but have not implemented a comprehensive end-to-end testing strategy, join our webinar to learn how. You’ll learn how you can create unit and end-to-end functional tests quickly and execute them on multiple browsers simultaneously, which in turn will increase team productivity and accelerate release cycles.
In this session, we will provide real-world examples including how we’ve tested our own complex web app framework Sencha Ext JS to show how you can scale the automated test suite to over thousands of test cases and cross-browser combinations for a complete regression cycle. We will demonstrate how we are able to test individual UI components, combinations of components, and finally as part of an application.
Join us and you will learn how to:
-Create a robust test strategy for Web Application Testing
-Implement page object design to improve long term maintenance
-Implement an automated DevOps process to execute tests in parallel, drastically reducing the time spent on a browser farm
CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Tole...
This document outlines an agenda for a presentation on mobile performance testing. The presentation will cover performance testing concepts and tools for both server-side and client-side testing. It will discuss load testing tools like JMeter and Taurus for server testing. For client testing, it will cover tools like PageSpeed, Yslow, and Monkop for analyzing mobile app performance on devices. The presentation will also demonstrate Continuous Integration of performance tests with Monkop and Taurus. Hands-on exercises will have attendees run a sample test with Monkop and Taurus to analyze results.
Get More out of Appium
Make your Appium scripts enterprise-grade with the Continuous Quality Lab™
Appium makes automated testing easy, but until now, Dev teams using Appium faced challenges efficiently scaling, controlling test devices, and recreating real end-user conditions.
Now, you can extend your Appium scripts to turbocharge app testing with Perfecto Mobile’s Continuous Quality Lab™.
Measuring your way_to_successful_automation_webinar
Developing a set of metrics is the first step to make in your transition to automation. A quantitative goal will help convince your boss what you need now and help you measure improvement over time.
In this Webinar, Rajeev Rai, the CEO of QASource, who has over 25 years of experience in QA and is a veteran at creating and managing high quality teams, will discuss metrics that helped him overcome challenges to drive automation success.
Key note Manish and Deepa
This document discusses continuous delivery and testing in software development. It emphasizes building quality in from the start through continuous integration, maintaining production-like environments, and automating deployments. A testing pipeline is recommended to provide increasing levels of testing from units to systems to catch defects early and provide fast feedback. Key principles for continuous delivery include collaborative teamwork, experimentation, and taking ownership for the larger purpose.
Learnings from Hybrid App Testing Jijesh Mohan
This document discusses testing a hybrid book reader application built with Phonegap, HTML5, and CSS3 for the iPad. It recommends testing the app on actual devices rather than simulators due to differences in user interactions, screen sizes, and orientations. The document outlines areas to focus testing on, including app performance, memory usage, compliance with App Store guidelines, handling of user gestures and touch events, and network connectivity in various conditions. Automated testing is suggested but noted to have limited support for hybrid apps. Testing across multiple devices using a mobile grid is proposed for report consolidation.
ATAGTR2017 Wearable App Testing
The presentation on Wearable App Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Himansha Tyagi
Testing Mobile App Performance
The mix of ever-smarter mobile devices and the constant connectivity of wireless networks have changed the way users access applications—and the way we develop and test them. Deployed applications deliver different content and functionality depending on whether the user is accessing them via a browser, smartphone, or tablet. And applications are accessed over myriad network configurations, including wireless and mobile networks. Brad Stoner presents an in-depth look at performance testing challenges for mobile applications including recording from devices, playing back device-specific requests, and accounting for variances in users’ geographical locations. Discover some of the best mobile performance testing approaches such as emulating mobile networks with varying connection speeds, packet loss, and latency during load tests. Find out when to use real devices vs. emulators to ensure high mobile application performance delivery to all end-users, at all times—on any device or network.
SauceCon 2017: Making Your Mobile App Automatable
When writing test automation, one of the most important factors for determining the amount of time and resources it will consume (and ultimately the success or failure of the endeavor) is the testability of the application. This talk will cover strategies for maximizing the automatability of the application by writing highly automobile user interfaces for mobile and web, writing a test plan designed for parallelization and concurrency, and by choosing the best techniques to reliably and quickly set up test scenarios.
Awesome Test Automation Made Simple w/ Dave Haeffner
Learn how to build simple and powerful automated tests that will work on the browsers you care about, cover visual testing and functional regressions, and be configured to run automatically through the use of a continuous integration (CI) server.
Mobile App Testing Best Practices
This document discusses building an ideal mobile app testing strategy. It recommends including various types of testing at different stages, such as unit testing, exploratory testing, build acceptance testing, and regression testing. It emphasizes testing apps on real devices rather than emulators to uncover issues related to hardware diversity, screen sizes, customizations, and memory/CPU. The document advocates enabling real device testing earlier in the process to lower bug fixing costs. It also recommends automating tests to speed up release cycles and integrating testing with continuous integration processes. The ideal strategy is described as using a cloud-based solution like Keynote Mobile Testing to provide on-demand access to many real devices for various types of automated and manual testing by development teams.
SauceCon 2017: test.allTheThings(): Digital Edition
TEST.ALLTHETHINGS() – DIGITAL EDITION
Asaf Saar – Director of Product Management, Sauce Labs
Testing responsive web sites is a challenging task when it span across Desktop and Mobile browsers. In this session Neil and Asaf will present the strategy and framework around testing responsive web sites using industry standard automation tools like Selenium and Appium against cloud based desktop browsers, real mobile devices, emulators and simulators.
Quality at Speed: More API Testing, Less UI Testing
Whether your company is a digital native or you’re just starting or well on your way to digital transformation, you know that your web services, mobile apps, and API programs need faster time-to-market without increasing risk.
More full-stack and backend developers as well as QA/testing, architecture, and DevOps leaders are trying to inject rocket fuel into their agile development by doing more API testing. But how much UI testing can be moved over to much faster API testing? And then, how short can you make your testing sprints with API testing?
With the right provisioning of UI, visual, and API testing, your organization can measurably improve DevOps metrics as you begin to do far more testing in much less time - without increasing on-hand IT resources.
In this webinar, Sauce Labs experts will clarify what parts of the “quality spectrum” are better covered by UI testing vs. API testing. Learn why API testing can be much faster and more reliable than UI testing, and how you can leverage API testing to achieve quality at speed.
Key Takeaways:
- Easily extend your Selenium and Appium UI testing suite with API testing automation for much faster, more reliable functional, integration, and load/performance testing
- Implement a CI/CD pipeline and DevOps workflows safely and securely with Sauce Labs full quality spectrum testing
- Achieve quality at speed with significant improvements in time to market and quality to market
Using Selenium To Test Mobile? Meet Appium!
Selenium is an industry standard for web testing. Most of test automation engineers are well versed with this tool, and even use its broad capabilities to execute some mobile tests. Inspired by Selenium and built based on testing approach Appium was created. It is an open-source tool for automating native, mobile web, and hybrid applications on iOS and Android platforms.
In this how-to webinar, we will show you how you can utilize your Selenium skills to scale your mobile testing with Appium. Join Giovanni Rago, Customer Success Manager at Sauce Labs, in this event that will give you new insights into the way you approach mobile testing.
Here are the main takeaways:
-- Difference between Selenium and Appium
-- Which Selenium skills can be used when testing in Appium
-- What’s the best testing strategy for mobile
-- How much more there is to learn about Appium
CA CD for Linkedin
CA Release Automation + Continuous Delivery Edition provides a fully integrated tool chain for continuous delivery across the entire application lifecycle. It leverages existing investments and tools while accelerating development through automated testing, full test coverage, access to simulated environments, and data on demand. The solution aims to deliver exceptional customer experience through total visibility and an open, integrated continuous delivery solution stack.
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
Now more than ever, engineering teams of all sizes are under pressure to deliver quality code more frequently. With the DevOps ecosystem growing larger every day, it might seem overwhelming to fully understand how to create an end-to-end solution that allows developers to continually commit new code with confidence, without having to slow down due to rollbacks. Achieving this true Continuous Deployment pipeline is difficult, but not impossible.
Join Neil Manvar, Solutions Architect from Sauce Labs, as he demonstrates a full CD pipeline containing a Pull Request build which will be used to test changes in isolation before code is merged into the master codebase. Using a JS based code tech stack, with AngularJS for the source code, Karma/Jasmine for unit tests and Protractor for functional (Selenium) tests, he will safely push quality code to production leveraging the following tools:
- Jenkins for CI / orchestration
- Github for Source Code Management
- Docker for creating/deploying container running the application
- Sauce Labs for running tests in various browser/OS combinations
By running through all of the various steps involved in deploying code changes safely and automatically to production, Neil will discuss the ways in which the PR Build creates a real time developer feedback and enforcement mechanism, thus eliminating bottlenecks. He will also discuss the implementation strategies, as well as challenges, along with results and culture changes that come with truly embracing DevOps methodologies.
The Essentials of Mobile App Performance Testing and Monitoring
Complexity across mobile carriers, locations and operating systems has made building mobile apps and monitoring their end user performance time consuming and expensive. The importance of testing mobile apps on iOS, Android and Windows Phone is increasing as more users embrace these devices. Join Correlsense and uTest for an online seminar which will teach you the steps to successful mobile application testing and performance management. We will discuss:
- The proliferation of mobile devices and the technical challenges they bring to end user experience monitoring
- Ways to prepare mobile applications for peak usage periods with the right load and performance testing techniques
- Tips and techniques for gaining visibility into the performance of mobile applications with the right monitoring tools
We will conclude with a discussion of the Correlsense and uTest solutions.
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
This document discusses strategies for building an API platform and discusses factors to consider like teams and the Dunbar number. It analyzes different strategies like single-team APIs that are optimized for a single team but have low reuse, ecosystem APIs that are optimized for adoption but have high overhead, and near-team APIs that reflect your organization. It also discusses structures for your organization like the centralized glacier which is stable but hard to experiment with, shipping your org which is easy for producers but hard for consumers, and keeping APIs internal which is easy for producers but unstable for consumers. The best strategy balances ease for consumers and producers while allowing for autonomy and central governance.
Appium for RubyMotion
After 16 months of development with over 4,200 commits from 105 contributors, Appium now has 1,139 stars and 922 forks on GitHub. It allows testing of mobile applications using the Selenium WebDriver protocol to access Apple's UIAutomation framework for iOS apps and Google's UiAutomator framework for Android apps without being tied to a specific programming language. Appium uses a client-server architecture to scale testing across devices and environments.
Integrate Visual AI Into Your Appium Scripts in Minutes
The document discusses challenges with traditional automated testing frameworks, such as tests being time-consuming to author and maintain, prone to flakiness, and unable to detect modern app defects. It introduces a visual AI platform that augments test frameworks with computer vision capabilities, allowing tests to be created faster with fewer brittle locators and providing more efficient and effective testing.
2018 State of Testing Survey Results
The survey summarizes results from 2,676 software testing professionals on the state of testing in 2018. Key findings include:
- API testing is growing, with 80% of respondents now testing APIs compared to 71% in 2017. Functional API testing takes most time.
- Agile is the dominant development methodology at 63% of respondents, and release cycles are getting shorter.
- Java is the most commonly tested language, and Chrome, Firefox and IE are the top browsers for UI testing.
- Automation is growing but not rapidly, with 54% automating API tests and 62% automating UI tests.
- Load testing of APIs is practiced by less than half of respondents.
SauceCon 2017: Testing @ the Speed of Concurrency
Learn the why, what and how of testing with concurrency. In this talk, Mike will take attendees on an automation journey of in-house machine testing into cloud-based testing. He will show what worked, what didn’t and discuss things to improve as the machines are increasingly doing the work.
Automation Pyramid - Make it right!
Test Automation is Good - provided you do it right way!
These slides give example of how right automation strategy made regression faster and easier.
Dimensions CM Summer VUG Presentation
Join us for the Summer 2015 VUG on August 19th, in which we will present, discuss and demonstrate how to optimize your development and delivery toolchain. In addition to shift-left, we will show how you can increase deployment automation and collaboration across Development and Release Operations.
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
We co-hosted a webinar with Neotys to shed some lights on
- How to overcome the challenges in mobile app performance and functional testing
- How to gain granular and actionable insights to measure and improve your app user experience
- Best practices to get the mobile readiness for 2017 Holiday Shopping Season
- A brief demo of the integration between Neoload and Bitbar Testing
Monitoring Solutions for APIs
How to monitor and manage the API experience with Apigee's tools to measure API latencies, manage SLAs, and more. At I Love APIs 2015
More Related Content
What's hot
Key note Manish and Deepa
This document discusses continuous delivery and testing in software development. It emphasizes building quality in from the start through continuous integration, maintaining production-like environments, and automating deployments. A testing pipeline is recommended to provide increasing levels of testing from units to systems to catch defects early and provide fast feedback. Key principles for continuous delivery include collaborative teamwork, experimentation, and taking ownership for the larger purpose.
Learnings from Hybrid App Testing Jijesh Mohan
This document discusses testing a hybrid book reader application built with Phonegap, HTML5, and CSS3 for the iPad. It recommends testing the app on actual devices rather than simulators due to differences in user interactions, screen sizes, and orientations. The document outlines areas to focus testing on, including app performance, memory usage, compliance with App Store guidelines, handling of user gestures and touch events, and network connectivity in various conditions. Automated testing is suggested but noted to have limited support for hybrid apps. Testing across multiple devices using a mobile grid is proposed for report consolidation.
ATAGTR2017 Wearable App Testing
The presentation on Wearable App Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Himansha Tyagi
Testing Mobile App Performance
The mix of ever-smarter mobile devices and the constant connectivity of wireless networks have changed the way users access applications—and the way we develop and test them. Deployed applications deliver different content and functionality depending on whether the user is accessing them via a browser, smartphone, or tablet. And applications are accessed over myriad network configurations, including wireless and mobile networks. Brad Stoner presents an in-depth look at performance testing challenges for mobile applications including recording from devices, playing back device-specific requests, and accounting for variances in users’ geographical locations. Discover some of the best mobile performance testing approaches such as emulating mobile networks with varying connection speeds, packet loss, and latency during load tests. Find out when to use real devices vs. emulators to ensure high mobile application performance delivery to all end-users, at all times—on any device or network.
SauceCon 2017: Making Your Mobile App Automatable
When writing test automation, one of the most important factors for determining the amount of time and resources it will consume (and ultimately the success or failure of the endeavor) is the testability of the application. This talk will cover strategies for maximizing the automatability of the application by writing highly automobile user interfaces for mobile and web, writing a test plan designed for parallelization and concurrency, and by choosing the best techniques to reliably and quickly set up test scenarios.
Awesome Test Automation Made Simple w/ Dave Haeffner
Learn how to build simple and powerful automated tests that will work on the browsers you care about, cover visual testing and functional regressions, and be configured to run automatically through the use of a continuous integration (CI) server.
Mobile App Testing Best Practices
This document discusses building an ideal mobile app testing strategy. It recommends including various types of testing at different stages, such as unit testing, exploratory testing, build acceptance testing, and regression testing. It emphasizes testing apps on real devices rather than emulators to uncover issues related to hardware diversity, screen sizes, customizations, and memory/CPU. The document advocates enabling real device testing earlier in the process to lower bug fixing costs. It also recommends automating tests to speed up release cycles and integrating testing with continuous integration processes. The ideal strategy is described as using a cloud-based solution like Keynote Mobile Testing to provide on-demand access to many real devices for various types of automated and manual testing by development teams.
SauceCon 2017: test.allTheThings(): Digital Edition
TEST.ALLTHETHINGS() – DIGITAL EDITION
Asaf Saar – Director of Product Management, Sauce Labs
Testing responsive web sites is a challenging task when it span across Desktop and Mobile browsers. In this session Neil and Asaf will present the strategy and framework around testing responsive web sites using industry standard automation tools like Selenium and Appium against cloud based desktop browsers, real mobile devices, emulators and simulators.
Quality at Speed: More API Testing, Less UI Testing
Whether your company is a digital native or you’re just starting or well on your way to digital transformation, you know that your web services, mobile apps, and API programs need faster time-to-market without increasing risk.
More full-stack and backend developers as well as QA/testing, architecture, and DevOps leaders are trying to inject rocket fuel into their agile development by doing more API testing. But how much UI testing can be moved over to much faster API testing? And then, how short can you make your testing sprints with API testing?
With the right provisioning of UI, visual, and API testing, your organization can measurably improve DevOps metrics as you begin to do far more testing in much less time - without increasing on-hand IT resources.
In this webinar, Sauce Labs experts will clarify what parts of the “quality spectrum” are better covered by UI testing vs. API testing. Learn why API testing can be much faster and more reliable than UI testing, and how you can leverage API testing to achieve quality at speed.
Key Takeaways:
- Easily extend your Selenium and Appium UI testing suite with API testing automation for much faster, more reliable functional, integration, and load/performance testing
- Implement a CI/CD pipeline and DevOps workflows safely and securely with Sauce Labs full quality spectrum testing
- Achieve quality at speed with significant improvements in time to market and quality to market
Using Selenium To Test Mobile? Meet Appium!
Selenium is an industry standard for web testing. Most of test automation engineers are well versed with this tool, and even use its broad capabilities to execute some mobile tests. Inspired by Selenium and built based on testing approach Appium was created. It is an open-source tool for automating native, mobile web, and hybrid applications on iOS and Android platforms.
In this how-to webinar, we will show you how you can utilize your Selenium skills to scale your mobile testing with Appium. Join Giovanni Rago, Customer Success Manager at Sauce Labs, in this event that will give you new insights into the way you approach mobile testing.
Here are the main takeaways:
-- Difference between Selenium and Appium
-- Which Selenium skills can be used when testing in Appium
-- What’s the best testing strategy for mobile
-- How much more there is to learn about Appium
CA CD for Linkedin
CA Release Automation + Continuous Delivery Edition provides a fully integrated tool chain for continuous delivery across the entire application lifecycle. It leverages existing investments and tools while accelerating development through automated testing, full test coverage, access to simulated environments, and data on demand. The solution aims to deliver exceptional customer experience through total visibility and an open, integrated continuous delivery solution stack.
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
Now more than ever, engineering teams of all sizes are under pressure to deliver quality code more frequently. With the DevOps ecosystem growing larger every day, it might seem overwhelming to fully understand how to create an end-to-end solution that allows developers to continually commit new code with confidence, without having to slow down due to rollbacks. Achieving this true Continuous Deployment pipeline is difficult, but not impossible.
Join Neil Manvar, Solutions Architect from Sauce Labs, as he demonstrates a full CD pipeline containing a Pull Request build which will be used to test changes in isolation before code is merged into the master codebase. Using a JS based code tech stack, with AngularJS for the source code, Karma/Jasmine for unit tests and Protractor for functional (Selenium) tests, he will safely push quality code to production leveraging the following tools:
- Jenkins for CI / orchestration
- Github for Source Code Management
- Docker for creating/deploying container running the application
- Sauce Labs for running tests in various browser/OS combinations
By running through all of the various steps involved in deploying code changes safely and automatically to production, Neil will discuss the ways in which the PR Build creates a real time developer feedback and enforcement mechanism, thus eliminating bottlenecks. He will also discuss the implementation strategies, as well as challenges, along with results and culture changes that come with truly embracing DevOps methodologies.
The Essentials of Mobile App Performance Testing and Monitoring
Complexity across mobile carriers, locations and operating systems has made building mobile apps and monitoring their end user performance time consuming and expensive. The importance of testing mobile apps on iOS, Android and Windows Phone is increasing as more users embrace these devices. Join Correlsense and uTest for an online seminar which will teach you the steps to successful mobile application testing and performance management. We will discuss:
- The proliferation of mobile devices and the technical challenges they bring to end user experience monitoring
- Ways to prepare mobile applications for peak usage periods with the right load and performance testing techniques
- Tips and techniques for gaining visibility into the performance of mobile applications with the right monitoring tools
We will conclude with a discussion of the Correlsense and uTest solutions.
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
This document discusses strategies for building an API platform and discusses factors to consider like teams and the Dunbar number. It analyzes different strategies like single-team APIs that are optimized for a single team but have low reuse, ecosystem APIs that are optimized for adoption but have high overhead, and near-team APIs that reflect your organization. It also discusses structures for your organization like the centralized glacier which is stable but hard to experiment with, shipping your org which is easy for producers but hard for consumers, and keeping APIs internal which is easy for producers but unstable for consumers. The best strategy balances ease for consumers and producers while allowing for autonomy and central governance.
Appium for RubyMotion
After 16 months of development with over 4,200 commits from 105 contributors, Appium now has 1,139 stars and 922 forks on GitHub. It allows testing of mobile applications using the Selenium WebDriver protocol to access Apple's UIAutomation framework for iOS apps and Google's UiAutomator framework for Android apps without being tied to a specific programming language. Appium uses a client-server architecture to scale testing across devices and environments.
Integrate Visual AI Into Your Appium Scripts in Minutes
The document discusses challenges with traditional automated testing frameworks, such as tests being time-consuming to author and maintain, prone to flakiness, and unable to detect modern app defects. It introduces a visual AI platform that augments test frameworks with computer vision capabilities, allowing tests to be created faster with fewer brittle locators and providing more efficient and effective testing.
2018 State of Testing Survey Results
The survey summarizes results from 2,676 software testing professionals on the state of testing in 2018. Key findings include:
- API testing is growing, with 80% of respondents now testing APIs compared to 71% in 2017. Functional API testing takes most time.
- Agile is the dominant development methodology at 63% of respondents, and release cycles are getting shorter.
- Java is the most commonly tested language, and Chrome, Firefox and IE are the top browsers for UI testing.
- Automation is growing but not rapidly, with 54% automating API tests and 62% automating UI tests.
- Load testing of APIs is practiced by less than half of respondents.
SauceCon 2017: Testing @ the Speed of Concurrency
Learn the why, what and how of testing with concurrency. In this talk, Mike will take attendees on an automation journey of in-house machine testing into cloud-based testing. He will show what worked, what didn’t and discuss things to improve as the machines are increasingly doing the work.
Automation Pyramid - Make it right!
Test Automation is Good - provided you do it right way!
These slides give example of how right automation strategy made regression faster and easier.
Dimensions CM Summer VUG Presentation
Join us for the Summer 2015 VUG on August 19th, in which we will present, discuss and demonstrate how to optimize your development and delivery toolchain. In addition to shift-left, we will show how you can increase deployment automation and collaboration across Development and Release Operations.
What's hot (20)
Awesome Test Automation Made Simple w/ Dave Haeffner
Awesome Test Automation Made Simple w/ Dave Haeffner
SauceCon 2017: test.allTheThings(): Digital Edition
SauceCon 2017: test.allTheThings(): Digital Edition
Quality at Speed: More API Testing, Less UI Testing
Quality at Speed: More API Testing, Less UI Testing
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
The Essentials of Mobile App Performance Testing and Monitoring
The Essentials of Mobile App Performance Testing and Monitoring
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
Integrate Visual AI Into Your Appium Scripts in Minutes
Integrate Visual AI Into Your Appium Scripts in Minutes
Similar to Web API Fragility: How Robust Is Your Mobile Application?
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
We co-hosted a webinar with Neotys to shed some lights on
- How to overcome the challenges in mobile app performance and functional testing
- How to gain granular and actionable insights to measure and improve your app user experience
- Best practices to get the mobile readiness for 2017 Holiday Shopping Season
- A brief demo of the integration between Neoload and Bitbar Testing
Monitoring Solutions for APIs
How to monitor and manage the API experience with Apigee's tools to measure API latencies, manage SLAs, and more. At I Love APIs 2015
Practical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User Monitoring
Watch replay here: https://info.dynatrace.com/apm_wc_devops_journey_series_end_user_monitoring_na_registration.html
Companies that have adopted DevOps Best Practices have 2555x faster lead times* in delivering new features to their end users. However, speed of delivery is not the only success metric! Success must also be measured on how end-users react to the speed of innovation.
Getting insights into how your end-users react to the changes you deploy allows you to share valuable feedback to the Dev and Biz teams. The teams can then see clearly how their changes impacted end-users and where fine tuning can improve infrastructure performance.
In this webcast Andreas Grabner, Chief DevOps Activist, and Brian Chandler, Systems Engineer, share practical tips that IT groups can start to implement quickly. You'll learn:
• Best approach for monitoring end-user mobile versus desktop versus tablet versus service end-points
• How to evaluate network bandwidth requirements by app, service and feature; to better understand and optimize resource consumption
• How to optimize your delivery chain in depth by understanding who is using your app, where, and on what device
• Clear view on which features are being used the most, the least, and what kind of behavior can be observed that is useful in tuning performance
If you are stuck in analysis paralysis, get insights that you can apply today!
*In addition, companies using DevOps are two times more likely to exceed profitability, market share and productivity goals (from the State of DevOps report by Puppet Labs 2016)
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
In mobile app spaces, with all these evolving technologies and competitors, 𝗽𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 plays an important role in terms of delivering a seamless end-user experience. Improving performance has become the top priority for all global mobile app companies as it directly impacts user experience, retention rates, conversions, and ultimately revenue. Even if we deliver a brilliant feature with performance issues, people will eventually stop using those apps. As high-performing apps are user favourites, we testers should also adopt performance-centric strategies while testing mobile apps.
In this talk, you will learn about:
Basic types of mobile apps.
An overview of important performance metrics to consider.
Basics and importance of mobile app performance testing with trends and parameters.
Factors to consider while evaluating an app’s performance & ideas to prepare a performance-oriented testing strategy.
Best practices and tools to consider for providing valuable insights to stakeholders.
Quick glance at the rise of 5G and its impact in the mobile app space.
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
Continuous Delivery only works if you combine automation with automatic metrics driven quality gates focusing on architectural, scalabilty and performance metrics.
In this presentation I start with several dashboard examples explaining key metrics in production and explain how to automate these metrics into your delivery pipeline.
Atmosphere 2016 - Andreas Grabner - Metrics Driven-DevOps: Delivering High Qu...
Becoming the next Uber is only possible when bringing your ideas faster to your end users. Some aspects of DevOps are perfect for that as it only works if Ops and Dev work closely together. But what does this mean for you as a developers? Delivering code faster with the high chance of failing faster?
In my opinion we need to look at Key Technical Metrics such as Memory Usage per User or Request, # of SQLs, # of Service Calls, Transferred Bytes, ... - these are metrics you need to track starting at your workstation all the way through CI into Ops – and don’t forget the Business: How often is the new feature really used? What does it cost to run it? Let these metrics act as Quality Gateways and stop builds early before they Crash your System: faster than ever.
In this session we look at how companies like Facebook, CreditOne and Co apply metric-driven DevOps. We look at use cases that crashed rapid deployments, identify metrics that identify the reason of the crash and learn how to use these metrics to steer your pipeline to build better code, deploy faster, without failing faster!
Encontrando la Aguja en el Rendimiento de Aplicaciones
En ocasiones resulta complicado entregar alta calidad de software con la velocidad que el mercado requiere. La propuesta de DevOps es mas allá de una metodología, un cambio cultural en la forma en que funcionan los equipos tanto de operación como de desarrollo, buscando aportar valor para la empresa mediante mejoras en el ciclo de vida de desarrollo y buscando un rendimiento optimo de las aplicaciones mediante herramientas tanto en la fase de desarrollo como de operación.
Interview questions for an Android Developer
Are you hiring for Android Developers in 2016?
Here you'll have a compilation of few interview questions for an android developer.
Mobile App Testing on Cloud
pCloudy is the most powerful cloud based App Testing Platform. It has the the most comprehensive set of Mobile Devices and Tools to Improve Quality of your App.
pCloudy (www.pcloudy.com) provides single click access to 500+ Android and IOS devices directly from your browser. You can use these real Mobile Devices to click-and-perform Manual Testing and Automation Testing for your App. You can also Integrate pCloudy with CI for continuous Automation.
Operationalize All the Network Things by Lori MacVittie
The document discusses how organizations are adopting Agile and DevOps practices to accelerate time to market, but the network is often a bottleneck in the deployment process. It argues that networks need to be "operationalized" like DevOps operationalizes development and operations, through collaboration, programmability, automation, and measurement. This involves applying DevOps principles to network operations by making the network programmable via APIs in order to optimize processes and accelerate application deployments.
Operationalize all the network things
Operationalize the network to affect positive cultural change across IT silos to accelerate time to market because the second place is the first loser in an application world.
Chapter 1. Why Performance Test
Performance testing is important because non-performant applications do not provide benefits to organizations and users. If applications do not deliver benefits, their continued use is questionable. Performance is important from the end-user perspective, as users do not want to experience long load times or frustration. Some common reasons for bad application performance include lack of performance considerations in design, leaving performance testing until late, and underestimating user loads.
Starting Your DevOps Journey – Practical Tips for Ops
To watch, please see:
https://info.dynatrace.com/apm_wc_getting_started_with_devops_na_registration.html
Starting Your DevOps Journey: Practical Tips for Ops
In this webinar, Andreas Grabner, Chief DevOps Activist at Dynatrace, shares practical tips that all IT groups from Dev to Ops can use to start their DevOps journey quickly. With experience from hundreds of DevOps deployments, Andi provides insights it would take your team months or years to learn firsthand.
- Learn how everyone on your Ops team can use APM to better understand and monitor SLAs, Performance and End User Impact of their applications.
- Foster better collaboration between Ops and architects by extending basic system monitoring to monolith and microservices architectures.
- Shift-left your testing and QA by working with metrics that you and the architects agreed on up front, resulting in early relevant feedback and faster code deployments.
- Hear why changing the cultural mindset from “fear of change” to “Continuous Innovation and Optimization” is critical for success.
Andi is joined by guest speaker, Brian Chandler, Systems Engineer at Raymond James, who shares commonly used Ops dashboards that increase collaboration across IT teams and pro-actively break down silos!
Twelve factor-app
The document discusses middleware and microservices architectures. Middleware makes it easier for developers to implement communication and input/output between applications and systems. It gained popularity in the 1980s as a way to connect newer apps to older legacy systems. Microservices architectures break applications into smaller, independent pieces that can be updated independently. While this improves scalability and maintainability, it also increases complexity and the security surface. The document provides examples of middleware and microservices architectures used by companies like Netflix and Twitter.
Progressive Web App
Progressive web apps (PWAs) are a new type of application that combines the best of the web and the best of native apps. PWAs use modern web capabilities to deliver fast, engaging mobile experiences that feel like native mobile applications to users. Some key characteristics of PWAs include being progressive, responsive, connectivity-independent, app-like, fresh, safe, discoverable, and installable. They aim to provide native-app experiences through features like push notifications, offline support, and the ability to launch from a home screen icon.
How to deal with mobile traffic expansion
Share of mobile traffic rises dramatically in the recent years. Products in Turkey, being a mobile driven market, has to deal with this rapid mobile traffic expansion. Several strategies including deeplinking and new technology approaches like Progressive Web Apps has to be implemented in order to cope with this new challange. This presentation briefly goes over those strategies and provide a guidance for mobile product managers and developers.
Webinar effective mobile performance testing using real devices
This document summarizes a webinar about effective mobile performance testing. It discusses:
1. The importance of testing mobile app performance given increasing user expectations and the risks of losing customers due to poor performance.
2. Challenges in mobile performance testing including supporting many different devices, carriers, and simulating real-world network conditions.
3. How network virtualization solutions can help by replicating production mobile networks in test environments to accurately test performance before deployment.
4. A demonstration of a mobile performance testing solution that monitors network conditions and analyzes app performance across various mobile networks and devices.
Mobile apps & Server Apis, the weak link? par Emanuele Pecorari
Mobile apps & Server Apis, the weak link ? Open discussion on the mobile apps, and server apis/webservices based on video's return on experience after the recent relaunch of its mobile apps.
http://fr.viadeo.com/en/profile/emanuele.pecorari
Connect Ops and Security with Flexible Web App and API Protection
Organizations continue to adopt container orchestration to drive efficiencies in their CI/CD pipelines. Given the current business climate with more employees working from home and consumers transacting more online, how can development and operations teams release at increasing velocity with protection baked in?
Connecting operations and security teams have not always been a smooth process: developers and operations staff are charged with site reliability, availability, and uptime while security staff is held responsible for securing an organization’s always-moving perimeter and valuable web layer assets. But the lines have started to blur between DevOps teams and security: you can’t guarantee uptime without baking effective application security tooling into your processes and infrastructure configurations.
A true next-generation, holistic web application and API protection platform does just that: operations teams can integrate security into their workflows and ensure new infrastructure and app code released to production is both effective and secure. Join application security experts Aneel Dadani and Orlando Barerra II from Signal Sciences to learn how your team can deploy at scale safely while gaining layer 7 visibility in production environments. Attendees will learn:
How to inspect web traffic in containers, at the API gateway, or the ingress
How DevOps teams can scale their application footprint to meet demand while securing your codebase in production
How development teams can gain visibility into how their apps and APIs are being used in production and what vulnerabilities may exist that they overlooked
Demo these application security concepts with Ansible, a simple yet powerful IT automation engine that companies use to accelerate DevOps initiatives, including baking application security into their infrastructure.
Thinking about the full stack to create great mobile experiences
Mobile apps are a critical part of your digital strategy: The app is often the “front door” to your brand for many customers.
Learn how you can measure and ensure optimal mobile experiences for your digital customers with New Relic. We’ll share three of the most commonly missing pieces we see in mobile app development today. And look at a real-world example of how New Relic has helped measure and debug some of the most complex issues that affect app users. Learn more: https://newrelic.com/solutions/digital-customer-experience
Similar to Web API Fragility: How Robust Is Your Mobile Application? (20)
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
Atmosphere 2016 - Andreas Grabner - Metrics Driven-DevOps: Delivering High Qu...
Atmosphere 2016 - Andreas Grabner - Metrics Driven-DevOps: Delivering High Qu...
Encontrando la Aguja en el Rendimiento de Aplicaciones
Encontrando la Aguja en el Rendimiento de Aplicaciones
Operationalize All the Network Things by Lori MacVittie
Operationalize All the Network Things by Lori MacVittie
Starting Your DevOps Journey – Practical Tips for Ops
Starting Your DevOps Journey – Practical Tips for Ops
Webinar effective mobile performance testing using real devices
Webinar effective mobile performance testing using real devices
Mobile apps & Server Apis, the weak link? par Emanuele Pecorari
Mobile apps & Server Apis, the weak link? par Emanuele Pecorari
Connect Ops and Security with Flexible Web App and API Protection
Connect Ops and Security with Flexible Web App and API Protection
Thinking about the full stack to create great mobile experiences
Thinking about the full stack to create great mobile experiences
More from Andy Zaidman
Automatic for the People
- The document summarizes a presentation given by Andy Zaidman at the International Conference on Automation of Software Test (AST 2023) in Melbourne, Australia on May 16th, 2023.
- It discusses findings from studies on how developers engineer test cases and their testing behaviors in IDEs, including strategies like being guided by documentation or code.
- It also presents recommendations to improve developer testing through better tool support, clear adequacy criteria in education, and a focus on improving the user and developer experience of testing tools and processes.
Software Analytics
- Dr. Andy Zaidman is an associate professor in software engineering at Delft University of Technology who studies software analytics.
- His research has found that developers often overestimate the amount of time spent on testing activities like writing test code compared to actual measurements, with testing found to account for 28-72% of time rather than the commonly assumed 50%.
- Metrics and analytics can help developers better understand their development behaviors, but intuition also provides value by detecting code smells that may be more urgent to address or easier to understand problems with than metric-based detections alone.
Fact or Fiction? What Software Analytics Can Do For Us
This document summarizes findings from software analytics research on developer testing practices. It finds that developers overestimate the amount of time spent on testing, with most spending 25-75% of their time on test code compared to an estimated 50%. Tests are rarely executed in IDEs, with only 20% failing, compared to 60% failing in IDEs. Most projects have test code but over half of developers did not interact with tests. Testing is crucial for continuous integration, with 98% of projects failing builds when tests fail. The research helps developers understand their own behaviors and identifies challenges for improving tools and education.
Software Analytics: The Dark Side and the Test Side
This document summarizes a keynote presentation on software testing and analytics. It discusses how common beliefs that testing takes up 50% of development time are not supported by recent software analytics research. This research observed 416 software engineers and found that actual time spent on testing ranged from 25-75%, with many developers overestimating their testing activities. It also found that testing practices like test-driven development and regular test execution are not widely followed in practice. Software analytics can help developers better understand their own testing behaviors.
First steps in testing analytics: Does test code quality matter?
Does investing in high quality developer test code really matter? And does it help a team to become more productive?
Studying Late Propagations in Code Clone Evolution Using Software Repository ...
Studying Late Propagations in Code Clone Evolution Using Software Repository Mining
Presented at the 8th International Workshop on Software Clones (IWSC 2014) held in Antwerp, Belgium
Paper by Hsiao Hui Mui, Andy Zaidman & Martin Pinzger
More from Andy Zaidman (6)
Fact or Fiction? What Software Analytics Can Do For Us
Fact or Fiction? What Software Analytics Can Do For Us
Software Analytics: The Dark Side and the Test Side
Software Analytics: The Dark Side and the Test Side
First steps in testing analytics: Does test code quality matter?
First steps in testing analytics: Does test code quality matter?
Studying Late Propagations in Code Clone Evolution Using Software Repository ...
Studying Late Propagations in Code Clone Evolution Using Software Repository ...
Web API Fragility: How Robust Is Your Mobile Application?
- 1. Web API Fragility How Robust Is Your Mobile Application? Tiago Espinha, Andy Zaidman, Gerd Gross MobileSoft 2015, Firenze, Italy
- 6. Developer decides when Web API provider decides when
- 8. v1 v2
- 9. What is the damage?
- 10. 43 Android apps Proxy server
- 12. Mutation operators on response message - Remove node - Add irrelevant node - Malformed response - Empty message response - Change of implicit data type - Data formatting disruption
- 13. Mutation operators on response message - Remove node - Add irrelevant node - Malformed response - Empty message response - Change of implicit data type - Data formatting disruption
- 14. App behaviour • Force close • Error message (no silent fail) • Timeout (versus indefinitely loading) • No indication
- 16. • >50% apps fail silently • Most apps fairly robust (30% crash on field removal) Recommendations • HATEAOS versioning of Web APIs • Better error reporting for users • Built-in validity checks for Web API response • Design for change when dealing with Web APIs