Holy "Test Pyramid" , how it ruins your life
•
1 like•180 views
This document discusses issues with the "test pyramid" approach to software testing. It argues that the pyramid is just a theoretical metaphor that is difficult to achieve in the real world. Additionally, tests created at different levels may test the wrong functionality or have the wrong focus. The document recommends using metrics focused on test quality rather than just meeting pyramid shapes or code coverage thresholds. It also advises treating test-driven development as a guideline rather than religion and focusing on writing high-quality tests over rigid adherence to test layering structures.
Report
Share
Report
Share
Download to read offline
Recommended
Android Testing: An Overview
This document provides an overview of testing Android applications. It discusses using Robolectric to run tests on a development machine without needing an emulator. It also recommends libraries like Hamcrest, FEST Android, and Awaitility to improve testing. Spoon is presented as a tool to take screenshots during tests. Continuous integration with Jenkins and generating test reports and documentation are also covered.
SFScon18 - Lorenzo Nicoldi - The insecurity of the free & opensource software
SFScon18 - Lorenzo Nicoldi - The insecurity of the free & opensource softwareSouth Tyrol Free Software Conference
This document summarizes some assumptions and challenges around testing the security of open source versus closed source software. It discusses how automated testing through unit tests and fuzzing works in theory but can be limited in practice. Manual testing or "bug hunting" is also explored for both commercial and free open source software, noting it may be easier to find targets in closed source code. The document aims to start a discussion on how security is evaluated differently for open versus closed source programs.Hack@macs 2014 test driven development & pair programing
გიორგი მამალაძე - Test Driven Development & Pair Programming
video: https://www.youtube.com/watch?v=yGg97JeyxWE
Testing in Android: automatici, di integrazione, TDD e scenari avanzati
The document discusses various techniques for testing Android applications including:
1) Setting up the testing environment and using JUnit 3 to write and run basic tests.
2) Using Android-specific testing frameworks like AndroidTestCase, ActivityInstrumentationTestCase2, and ProviderTestCase2 that provide mocks of Android components and contexts.
3) Leveraging the Android monkey tool and monkeyrunner to simulate user interactions for testing.
4) Adopting external test automation frameworks like Robotium for black-box testing or Robolectric for test-driven development.
5) Developing an advanced automated testing framework involving XML test case files, a customized InstrumentationTestRunner, and a Robot and CommandRunner to drastically reduce testing time.
2012 mobile testingsummit-moet
The document discusses mobile end-to-end testing and exploratory testing. It describes two categories of mobile automation techniques: instrumented and non-instrumented. It then covers the advantages of each technique, considerations for which to use, examples of mobile automation tools for Android and iOS, and outlines "walls of pain" related to testing on these platforms.
QA Fest 2018. Ярослав Пернеровский. Test Automation Pyramid, how it ruins you...
Практически любую проблему человечества можно описать в виде "пирамиды". Про пирамиду Маслоу и финансовые пирамиды слышали все. Тестировщики тоже люди, и они придумали свою священную пирамиду - пирамиду автоматизации тестирования. Эта концепция доминирует на рынке уже многие годы и приносит свои позитивные плоды. Но есть и темная сторона этого процесса, выгорание, уныние и забвение в погоне за пирамидой тоже не редкость. В своем докладе хочу немного покритиковать устоявшиеся устои и разобраться как выжить в мире разработки и автоматизации с пирамидой или без нее, а также пройтись по антипатернам в автоматизации, которые так или иначе касаются пирамиды.
EMBA - From Firmware to Exploit - BHEU22
See also https://www.blackhat.com/eu-22/arsenal/schedule/index.html#emba--from-firmware-to-exploit-29185
Reliable tests with selenium web driver
Reliable end-to-end (e2e) tests are important for assuring code quality and encouraging refactoring, but unreliable e2e tests are harmful. To write reliable e2e tests, focus on the happy path, test only code you own, navigate directly to the screen under test, and make sure the system is in a known initial state. Avoid using Thread.Sleep and test recorders, and test only one scenario at a time.
Recommended
Android Testing: An Overview
This document provides an overview of testing Android applications. It discusses using Robolectric to run tests on a development machine without needing an emulator. It also recommends libraries like Hamcrest, FEST Android, and Awaitility to improve testing. Spoon is presented as a tool to take screenshots during tests. Continuous integration with Jenkins and generating test reports and documentation are also covered.
SFScon18 - Lorenzo Nicoldi - The insecurity of the free & opensource software
SFScon18 - Lorenzo Nicoldi - The insecurity of the free & opensource softwareSouth Tyrol Free Software Conference
This document summarizes some assumptions and challenges around testing the security of open source versus closed source software. It discusses how automated testing through unit tests and fuzzing works in theory but can be limited in practice. Manual testing or "bug hunting" is also explored for both commercial and free open source software, noting it may be easier to find targets in closed source code. The document aims to start a discussion on how security is evaluated differently for open versus closed source programs.Hack@macs 2014 test driven development & pair programing
გიორგი მამალაძე - Test Driven Development & Pair Programming
video: https://www.youtube.com/watch?v=yGg97JeyxWE
Testing in Android: automatici, di integrazione, TDD e scenari avanzati
The document discusses various techniques for testing Android applications including:
1) Setting up the testing environment and using JUnit 3 to write and run basic tests.
2) Using Android-specific testing frameworks like AndroidTestCase, ActivityInstrumentationTestCase2, and ProviderTestCase2 that provide mocks of Android components and contexts.
3) Leveraging the Android monkey tool and monkeyrunner to simulate user interactions for testing.
4) Adopting external test automation frameworks like Robotium for black-box testing or Robolectric for test-driven development.
5) Developing an advanced automated testing framework involving XML test case files, a customized InstrumentationTestRunner, and a Robot and CommandRunner to drastically reduce testing time.
2012 mobile testingsummit-moet
The document discusses mobile end-to-end testing and exploratory testing. It describes two categories of mobile automation techniques: instrumented and non-instrumented. It then covers the advantages of each technique, considerations for which to use, examples of mobile automation tools for Android and iOS, and outlines "walls of pain" related to testing on these platforms.
QA Fest 2018. Ярослав Пернеровский. Test Automation Pyramid, how it ruins you...
Практически любую проблему человечества можно описать в виде "пирамиды". Про пирамиду Маслоу и финансовые пирамиды слышали все. Тестировщики тоже люди, и они придумали свою священную пирамиду - пирамиду автоматизации тестирования. Эта концепция доминирует на рынке уже многие годы и приносит свои позитивные плоды. Но есть и темная сторона этого процесса, выгорание, уныние и забвение в погоне за пирамидой тоже не редкость. В своем докладе хочу немного покритиковать устоявшиеся устои и разобраться как выжить в мире разработки и автоматизации с пирамидой или без нее, а также пройтись по антипатернам в автоматизации, которые так или иначе касаются пирамиды.
EMBA - From Firmware to Exploit - BHEU22
See also https://www.blackhat.com/eu-22/arsenal/schedule/index.html#emba--from-firmware-to-exploit-29185
Reliable tests with selenium web driver
Reliable end-to-end (e2e) tests are important for assuring code quality and encouraging refactoring, but unreliable e2e tests are harmful. To write reliable e2e tests, focus on the happy path, test only code you own, navigate directly to the screen under test, and make sure the system is in a known initial state. Avoid using Thread.Sleep and test recorders, and test only one scenario at a time.
One Engine Two Tools
With JustDecompile, Telerik's free .NET decompiler, you can easily recover lost source code or peer into assemblies to discover the root cause of an external bug. The same engine that powers JustDecompile is also used in Telerik JustCode, a Visual Studio add-in designed to enhance developer productivity. In this webcast, you will learn how to use JustDecompile and JustCode for decompilation scenarios you are likely to encounter in the office.
Automated Unit Testing for Mere Mortals
Automated unit testing involves writing small tests to validate that individual units or components of an application perform as expected. Unit tests should be fast, repeatable, and isolated to test a single function or class. Test doubles like mocks and stubs can stand in for dependencies to make unit tests deterministic. Code coverage metrics measure how much of the code is executed by unit tests, and test-driven development uses tests to drive the design process.
香港六合彩 » SlideShare
白天有白天的感觉，白天有白天的味道。因为油麻地的雨多，油麻地香港六合彩家的床，白天都常常闲不着，摇晃着，吱吱呀呀地叫唤。这是雨中的乐章。油麻地的女香港六合彩似乎特别能生孩子，而这些孩子十有八九是在雨天怀上的。雨使油麻地的男香港六合彩一个个都形销骨立，雨也使油麻地香港六合彩丁兴旺。范烟户觉得在这样的天气里尤其寂寞，就坐在门口唱起来:晨(又鸟)初叫，昏鸦争噪，哪个不去红尘闹。路遥遥，水迢迢。功名尽在长安道，今日少年明日老。山，依旧好;香港六合彩，憔悴了……范烟户的曲儿，飘进了一条又一条巷子……朱荻洼去了一趟杜元潮家，只片刻工夫，又走进雨地里……[第70节]鬼雨/梨花雨8(1)随后，雨中，杜元潮、邱子东都在很诡秘地走动着，去了一趟朱小楼家，去了一趟小七子家……最后，杜元潮去了一趟废弃的仓房。仓房里住了一对卖唱的父女。香港六合彩是路过油麻地，没想到雨将香港六合彩困在了这儿。油麻地的香港六合彩自然想听唱，但，都想白听。父女俩岂肯白唱，就住到仓房里，蒙头睡觉去了。杜元潮掏出五元钱，请父女俩晚饭后到村子中央的祠堂里唱几个曲子。那父女俩自然很高兴，对杜元潮说:香港六合彩一定用力唱。杜元潮让小七子站在巷口，大喊了几声:今晚上，到祠堂听唱!这个消息很令香港六合彩振奋，一个个奔走相告。吃了晚饭，雨小了些，香港六合彩就三三两两往祠堂走，不时地听见香港六合彩说:走，听唱去!与以往的雨天不一样，今晚上的油麻地香港六合彩不是一吃了饭就熄了灯往床上爬，而是纷纷去了祠堂。当杜元潮看到满满一祠堂香港六合彩时，心里很高兴。今晚上不能让油麻地香港六合彩睡觉。油麻地香港六合彩睡觉死沉，性子又木，夜里房子倒了都不一定肯起床。今晚上，必须有成千上百醒着的油麻地香港六合彩。油麻地的历史需要香港六合彩今晚醒着。但也有不少香港六合彩未到祠堂里听唱，比如朱小楼、小七子等。这父女俩唱得很不错，又很卖力。女孩儿声音尖而亮，亮而纯，纯而甜。拉胡琴的父亲声音厚而沙，沙而沉，沉而有力。唱得木讷的油麻地香港六合彩一个个很兴奋，两眼发亮，眼珠儿也变得灵活起来，黑暗里，像无数的猫聚在一起。杜元潮与邱子东站在最后面的黑暗里。这谭月月家住在镇子西头，与镇里香港六合彩家相隔了一段路，显得很僻静。当祠堂里父女俩已唱了两三曲，一个个已渐入佳境时，李长望的身影在通往谭月月家的小路口犹疑不定地出现了。香港六合彩在路口站了站，沿着菜园中间的小路大步走向谭月月家的门口。这女香港六合彩似乎早在门口屏声听着外面的脚步走，当李长望刚刚走到门口时，门便慢慢地开了一条缝。李长望再次向四周观望了一下，闪进门里。门关上后不久，灯便灭了。一直埋伏在草丛里的朱小楼拍了拍与香港六合彩一般潮湿的小七子，急急地往祠堂去了。这女香港六合彩似乎等得很焦渴了，一熄了灯，就带着一股浓烈的雪花膏味，一头扑在李长望宽阔的怀里，并用小小的拳头不住地击打香港六合彩的胸膛，然后，就用双手揪住李长望的衣襟，一个劲地摇晃着香港六合彩，就像拴在树上的一头急了的牛摇晃着大树。嘴里不住地说:你个杀千刀的，死哪里去啦?死哪里去啦?莫不是又勾搭上另外的女香港六合彩了?你这到处吃腥的馋猫!你倒说呀?你倒说呀?你是在往死里折磨香港六合彩呢!
Testing 101
This document provides an introduction to automated testing. It discusses the motivations for automated testing such as improving quality and catching bugs early. It covers basic testing concepts like unit, integration, and system tests. It explains testing principles such as keeping tests independent and focusing on visible behavior. The document also discusses popular testing frameworks for different programming languages and provides examples of tests from a codebase.
The Build System of Commercial RCP Application A Case Study
The document describes the build system of a commercial JavaME application called MOTODEV. It has 8 subsystems organized as Eclipse features. 60 plugins are used across both products. The build is fully automated and generates the RCP product, Studio product, update site, and installers. The most complex parts are the documentation build and integrating external emulators. The Eclipse PDE provides functionality but some steps like site.xml generation require custom scripts. Setting up such a build system for an Eclipse application requires significant effort.
Os Selbak
The document introduces the Linux-ready Firmware Developer Kit, an open source project that provides a bootable CD for testing firmware against Linux. It allows firmware developers to easily test and validate their firmware's compatibility with Linux. The kit runs automated tests on the firmware and displays results to help uncover bugs and issues. It aims to improve Linux support in firmware and lower the barrier for firmware developers to test with Linux. A demo of the kit is shown, highlighting some of its automated tests and capabilities.
Test Automation for Embedded Devices
The document discusses test automation approaches for internet-based applications on embedded devices. It describes five basic approaches: unit testing in an IDE, manual testing on actual devices, external test automation, testing against simulators or emulators, and back-end testing via the internet. Each approach is outlined with pros and cons. Case studies are presented on testing the Blackberry, ESPN Mobile, and Microsoft IPTV solutions. The document was presented at a conference on quality assurance and testing for embedded systems.
Appium overview (Selenium Israel #2, Feb. 2014)
Appium is an open source test automation framework for testing native and hybrid mobile apps. It allows writing tests in any language and on any platform to test the same app submitted to app stores. Appium uses the WebDriver protocol to remotely control apps using UIAutomator on Android and Instruments on iOS. This allows testing apps on real devices and emulators with a single test script. Appium supports platforms include Android, iOS, and mobile web apps and can test apps on a local device or cloud-based services like SauceLabs.
Testes? Mas isso não aumenta o tempo de projecto? Não quero...
Os Testes são cada vez mais uma necessidade nos projectos de desenvolvimento de software... Sejam eles unitários, de carga ou de "User Interface", uma boa framework de testes ajuda a resolver os problemas mais cedo, de forma mais eficaz e mais barata.
No final da sessão vamos perceber não só para que servem, como são feitos e como o Visual Studio 2010 pode ajudar.
Unit Testing Android Applications
Presentation for OOSE students to get a grip on unit testing Android applications by applying dependency injection and RoboElectric.
Unit testing - A&BP CC
This workshop is about testing the right way. Get a clear view on how to test your code in an efficient and useful way!
This first testing-related workshop is about all aspects of unit testing. Integration testing and TDD will have their own dedicated workshops.
Testing and TDD - KoJUG
This document discusses testing and test-driven development (TDD). It defines testing as validating and verifying the current implementation and design by emulating application states. TDD is presented as an iterative development process that emphasizes design over implementation through continuously writing tests before code (test-first design) and refactoring. Benefits of TDD include cleaner code, early feedback on design/architecture, and more reliable development progress. Drawbacks include requiring a different development approach and tests adding maintenance overhead. Key factors in testing success are the developers and complexity of the problem being solved.
Intro To AOP
The document discusses aspect-oriented programming (AOP) and its benefits and challenges. AOP can help solve problems by identifying cross-cutting concerns that can be modularized into aspects. While AOP is useful for implementing policies and capturing knowledge, programming stateful aspects is difficult and handling aspect side-effects can be challenging. The document expresses hope that AOP will find its place and that tools can help address current issues.
Exploit Frameworks
This lab document describes using the Metasploit framework to perform exploits against Windows systems. It consists of six sections: installing Metasploit, adding a remote user to Windows XP, gaining remote command shell access to Windows XP, using DLL injection to open a remote VNC connection, remotely installing a rootkit on Windows, and setting up the Metasploit web interface. The document provides background on exploit frameworks and payloads, and guides students through exercises to complete each section.
Creating testing tools to support development
This is a presentation I made for the Kraków Java User Group on test automation and how to solve the challenges around it to make it really useful for development teams. It contains some examples of how we are doing it at Akamai's Web department, and some based on my own experience.
TDD Best Practices
Ever tried doing Test First Test Driven Development? Ever failed? TDD is not easy to get right. Here's some practical advice on doing BDD and TDD correctly. This presentation attempts to explain to you why, what, and how you should test, tell you about the FIRST principles of tests, the connections of unit testing and the SOLID principles, writing testable code, test doubles, the AAA of unit testing, and some practical ideas about structuring tests.
Unit Testing, TDD and the Walking Skeleton
The document discusses unit testing, test-driven development (TDD), and the walking skeleton approach. It provides an overview of these software development practices, including writing automated tests before code, using the tests to drive code development, and starting projects with an initial architecture or "walking skeleton" that is automatically testable, buildable, and deployable. The document aims to dispel common myths about testing and convince readers of the value of these practices.
C# Security Testing and Debugging
This document discusses various tools and techniques for security testing and debugging web applications developed in C#. It provides information on static analysis tools like FxCop and CAT.NET that can analyze source code. It also covers automated testing tools like NUnit, HTMLUnit, and Selenium that can test web applications without using a real browser. The document demonstrates how to integrate these tools into testing workflows and addresses related topics like logging, exception handling, and custom error pages.
Building Maintainable Android Apps (DroidCon NYC 2014)
Slides from DroidCon NYC 2014. Covers some ideas around extracting business logic from the app to enable easier unit testing. Much more detail available on my blog (kevinrschultz.com)
OpenDaylight Developer Experience 2.0
original (better quality) on https://docs.google.com/presentation/d/1bnwj8CrFGo5KekONYSeIHySdkoXZiewJxkHcZjXnzkQ/
slides from OpenDaylight Summit Oct 2016 Seattle
Cypress, charm and easy.
Cypress is a testing tool that allows for easy setup, writing, executing, and debugging of tests directly inside the browser. It provides features like time travel debugging, automatic waiting, and traffic control. Tests are run via a test runner dashboard and provide snapshots, dev tools, screenshots, and video for debugging. Cypress aims to improve development speed for testing with its simple setup and usage directly inside the browser, though it is limited to a single browser and origin.
Cypress new old Selenium
This document discusses Cypress, a new tool for testing web applications directly in the browser. It provides an alternative to Selenium by making setup, writing, running and debugging tests easier. Some benefits of Cypress include its simple setup process, ability to test directly inside the browser for speed, and features for debugging like snapshots, dev tools and video recording. While aimed specifically at browser testing, it has some limitations like only supporting one browser and origin at a time.
More Related Content
Similar to Holy "Test Pyramid" , how it ruins your life
One Engine Two Tools
With JustDecompile, Telerik's free .NET decompiler, you can easily recover lost source code or peer into assemblies to discover the root cause of an external bug. The same engine that powers JustDecompile is also used in Telerik JustCode, a Visual Studio add-in designed to enhance developer productivity. In this webcast, you will learn how to use JustDecompile and JustCode for decompilation scenarios you are likely to encounter in the office.
Automated Unit Testing for Mere Mortals
Automated unit testing involves writing small tests to validate that individual units or components of an application perform as expected. Unit tests should be fast, repeatable, and isolated to test a single function or class. Test doubles like mocks and stubs can stand in for dependencies to make unit tests deterministic. Code coverage metrics measure how much of the code is executed by unit tests, and test-driven development uses tests to drive the design process.
香港六合彩 » SlideShare
白天有白天的感觉，白天有白天的味道。因为油麻地的雨多，油麻地香港六合彩家的床，白天都常常闲不着，摇晃着，吱吱呀呀地叫唤。这是雨中的乐章。油麻地的女香港六合彩似乎特别能生孩子，而这些孩子十有八九是在雨天怀上的。雨使油麻地的男香港六合彩一个个都形销骨立，雨也使油麻地香港六合彩丁兴旺。范烟户觉得在这样的天气里尤其寂寞，就坐在门口唱起来:晨(又鸟)初叫，昏鸦争噪，哪个不去红尘闹。路遥遥，水迢迢。功名尽在长安道，今日少年明日老。山，依旧好;香港六合彩，憔悴了……范烟户的曲儿，飘进了一条又一条巷子……朱荻洼去了一趟杜元潮家，只片刻工夫，又走进雨地里……[第70节]鬼雨/梨花雨8(1)随后，雨中，杜元潮、邱子东都在很诡秘地走动着，去了一趟朱小楼家，去了一趟小七子家……最后，杜元潮去了一趟废弃的仓房。仓房里住了一对卖唱的父女。香港六合彩是路过油麻地，没想到雨将香港六合彩困在了这儿。油麻地的香港六合彩自然想听唱，但，都想白听。父女俩岂肯白唱，就住到仓房里，蒙头睡觉去了。杜元潮掏出五元钱，请父女俩晚饭后到村子中央的祠堂里唱几个曲子。那父女俩自然很高兴，对杜元潮说:香港六合彩一定用力唱。杜元潮让小七子站在巷口，大喊了几声:今晚上，到祠堂听唱!这个消息很令香港六合彩振奋，一个个奔走相告。吃了晚饭，雨小了些，香港六合彩就三三两两往祠堂走，不时地听见香港六合彩说:走，听唱去!与以往的雨天不一样，今晚上的油麻地香港六合彩不是一吃了饭就熄了灯往床上爬，而是纷纷去了祠堂。当杜元潮看到满满一祠堂香港六合彩时，心里很高兴。今晚上不能让油麻地香港六合彩睡觉。油麻地香港六合彩睡觉死沉，性子又木，夜里房子倒了都不一定肯起床。今晚上，必须有成千上百醒着的油麻地香港六合彩。油麻地的历史需要香港六合彩今晚醒着。但也有不少香港六合彩未到祠堂里听唱，比如朱小楼、小七子等。这父女俩唱得很不错，又很卖力。女孩儿声音尖而亮，亮而纯，纯而甜。拉胡琴的父亲声音厚而沙，沙而沉，沉而有力。唱得木讷的油麻地香港六合彩一个个很兴奋，两眼发亮，眼珠儿也变得灵活起来，黑暗里，像无数的猫聚在一起。杜元潮与邱子东站在最后面的黑暗里。这谭月月家住在镇子西头，与镇里香港六合彩家相隔了一段路，显得很僻静。当祠堂里父女俩已唱了两三曲，一个个已渐入佳境时，李长望的身影在通往谭月月家的小路口犹疑不定地出现了。香港六合彩在路口站了站，沿着菜园中间的小路大步走向谭月月家的门口。这女香港六合彩似乎早在门口屏声听着外面的脚步走，当李长望刚刚走到门口时，门便慢慢地开了一条缝。李长望再次向四周观望了一下，闪进门里。门关上后不久，灯便灭了。一直埋伏在草丛里的朱小楼拍了拍与香港六合彩一般潮湿的小七子，急急地往祠堂去了。这女香港六合彩似乎等得很焦渴了，一熄了灯，就带着一股浓烈的雪花膏味，一头扑在李长望宽阔的怀里，并用小小的拳头不住地击打香港六合彩的胸膛，然后，就用双手揪住李长望的衣襟，一个劲地摇晃着香港六合彩，就像拴在树上的一头急了的牛摇晃着大树。嘴里不住地说:你个杀千刀的，死哪里去啦?死哪里去啦?莫不是又勾搭上另外的女香港六合彩了?你这到处吃腥的馋猫!你倒说呀?你倒说呀?你是在往死里折磨香港六合彩呢!
Testing 101
This document provides an introduction to automated testing. It discusses the motivations for automated testing such as improving quality and catching bugs early. It covers basic testing concepts like unit, integration, and system tests. It explains testing principles such as keeping tests independent and focusing on visible behavior. The document also discusses popular testing frameworks for different programming languages and provides examples of tests from a codebase.
The Build System of Commercial RCP Application A Case Study
The document describes the build system of a commercial JavaME application called MOTODEV. It has 8 subsystems organized as Eclipse features. 60 plugins are used across both products. The build is fully automated and generates the RCP product, Studio product, update site, and installers. The most complex parts are the documentation build and integrating external emulators. The Eclipse PDE provides functionality but some steps like site.xml generation require custom scripts. Setting up such a build system for an Eclipse application requires significant effort.
Os Selbak
The document introduces the Linux-ready Firmware Developer Kit, an open source project that provides a bootable CD for testing firmware against Linux. It allows firmware developers to easily test and validate their firmware's compatibility with Linux. The kit runs automated tests on the firmware and displays results to help uncover bugs and issues. It aims to improve Linux support in firmware and lower the barrier for firmware developers to test with Linux. A demo of the kit is shown, highlighting some of its automated tests and capabilities.
Test Automation for Embedded Devices
The document discusses test automation approaches for internet-based applications on embedded devices. It describes five basic approaches: unit testing in an IDE, manual testing on actual devices, external test automation, testing against simulators or emulators, and back-end testing via the internet. Each approach is outlined with pros and cons. Case studies are presented on testing the Blackberry, ESPN Mobile, and Microsoft IPTV solutions. The document was presented at a conference on quality assurance and testing for embedded systems.
Appium overview (Selenium Israel #2, Feb. 2014)
Appium is an open source test automation framework for testing native and hybrid mobile apps. It allows writing tests in any language and on any platform to test the same app submitted to app stores. Appium uses the WebDriver protocol to remotely control apps using UIAutomator on Android and Instruments on iOS. This allows testing apps on real devices and emulators with a single test script. Appium supports platforms include Android, iOS, and mobile web apps and can test apps on a local device or cloud-based services like SauceLabs.
Testes? Mas isso não aumenta o tempo de projecto? Não quero...
Os Testes são cada vez mais uma necessidade nos projectos de desenvolvimento de software... Sejam eles unitários, de carga ou de "User Interface", uma boa framework de testes ajuda a resolver os problemas mais cedo, de forma mais eficaz e mais barata.
No final da sessão vamos perceber não só para que servem, como são feitos e como o Visual Studio 2010 pode ajudar.
Unit Testing Android Applications
Presentation for OOSE students to get a grip on unit testing Android applications by applying dependency injection and RoboElectric.
Unit testing - A&BP CC
This workshop is about testing the right way. Get a clear view on how to test your code in an efficient and useful way!
This first testing-related workshop is about all aspects of unit testing. Integration testing and TDD will have their own dedicated workshops.
Testing and TDD - KoJUG
This document discusses testing and test-driven development (TDD). It defines testing as validating and verifying the current implementation and design by emulating application states. TDD is presented as an iterative development process that emphasizes design over implementation through continuously writing tests before code (test-first design) and refactoring. Benefits of TDD include cleaner code, early feedback on design/architecture, and more reliable development progress. Drawbacks include requiring a different development approach and tests adding maintenance overhead. Key factors in testing success are the developers and complexity of the problem being solved.
Intro To AOP
The document discusses aspect-oriented programming (AOP) and its benefits and challenges. AOP can help solve problems by identifying cross-cutting concerns that can be modularized into aspects. While AOP is useful for implementing policies and capturing knowledge, programming stateful aspects is difficult and handling aspect side-effects can be challenging. The document expresses hope that AOP will find its place and that tools can help address current issues.
Exploit Frameworks
This lab document describes using the Metasploit framework to perform exploits against Windows systems. It consists of six sections: installing Metasploit, adding a remote user to Windows XP, gaining remote command shell access to Windows XP, using DLL injection to open a remote VNC connection, remotely installing a rootkit on Windows, and setting up the Metasploit web interface. The document provides background on exploit frameworks and payloads, and guides students through exercises to complete each section.
Creating testing tools to support development
This is a presentation I made for the Kraków Java User Group on test automation and how to solve the challenges around it to make it really useful for development teams. It contains some examples of how we are doing it at Akamai's Web department, and some based on my own experience.
TDD Best Practices
Ever tried doing Test First Test Driven Development? Ever failed? TDD is not easy to get right. Here's some practical advice on doing BDD and TDD correctly. This presentation attempts to explain to you why, what, and how you should test, tell you about the FIRST principles of tests, the connections of unit testing and the SOLID principles, writing testable code, test doubles, the AAA of unit testing, and some practical ideas about structuring tests.
Unit Testing, TDD and the Walking Skeleton
The document discusses unit testing, test-driven development (TDD), and the walking skeleton approach. It provides an overview of these software development practices, including writing automated tests before code, using the tests to drive code development, and starting projects with an initial architecture or "walking skeleton" that is automatically testable, buildable, and deployable. The document aims to dispel common myths about testing and convince readers of the value of these practices.
C# Security Testing and Debugging
This document discusses various tools and techniques for security testing and debugging web applications developed in C#. It provides information on static analysis tools like FxCop and CAT.NET that can analyze source code. It also covers automated testing tools like NUnit, HTMLUnit, and Selenium that can test web applications without using a real browser. The document demonstrates how to integrate these tools into testing workflows and addresses related topics like logging, exception handling, and custom error pages.
Building Maintainable Android Apps (DroidCon NYC 2014)
Slides from DroidCon NYC 2014. Covers some ideas around extracting business logic from the app to enable easier unit testing. Much more detail available on my blog (kevinrschultz.com)
OpenDaylight Developer Experience 2.0
original (better quality) on https://docs.google.com/presentation/d/1bnwj8CrFGo5KekONYSeIHySdkoXZiewJxkHcZjXnzkQ/
slides from OpenDaylight Summit Oct 2016 Seattle
Similar to Holy "Test Pyramid" , how it ruins your life (20)
The Build System of Commercial RCP Application A Case Study
The Build System of Commercial RCP Application A Case Study
Testes? Mas isso não aumenta o tempo de projecto? Não quero...
Testes? Mas isso não aumenta o tempo de projecto? Não quero...
Building Maintainable Android Apps (DroidCon NYC 2014)
Building Maintainable Android Apps (DroidCon NYC 2014)
More from Yaroslav Pernerovsky
Cypress, charm and easy.
Cypress is a testing tool that allows for easy setup, writing, executing, and debugging of tests directly inside the browser. It provides features like time travel debugging, automatic waiting, and traffic control. Tests are run via a test runner dashboard and provide snapshots, dev tools, screenshots, and video for debugging. Cypress aims to improve development speed for testing with its simple setup and usage directly inside the browser, though it is limited to a single browser and origin.
Cypress new old Selenium
This document discusses Cypress, a new tool for testing web applications directly in the browser. It provides an alternative to Selenium by making setup, writing, running and debugging tests easier. Some benefits of Cypress include its simple setup process, ability to test directly inside the browser for speed, and features for debugging like snapshots, dev tools and video recording. While aimed specifically at browser testing, it has some limitations like only supporting one browser and origin at a time.
Automation Puzzlers
The document contains a series of code snippets and questions about what will be printed or happen when the code is run. It appears to be providing examples to test understanding of Java and Selenium concepts like exceptions, streams, timeouts, and multi-threading. The examples cover topics like NullPointerExceptions, printing sorted lists, removing elements from streams, and ensuring tests pass within timeout periods.
WebDriver Waits
This document discusses different types of waits that can be used in Selenium tests: implicit waits, explicit waits, and timeouts. Implicit waits set a global wait time for all findElement calls, while explicit waits allow waiting for specific conditions. It is recommended to use explicit waits over implicit waits and to set implicit timeouts lower than explicit waits. Care must be taken when waiting for elements to not be present.
Automation puzzlers
This document contains a series of test automation questions and answers related to Selenium and Selenide. It discusses behaviors like opening URLs, handling exceptions, implicit vs explicit waits, element locators, and more. The questions are multiple choice and include the correct answers. Examples of code are provided to demonstrate the concepts covered by each question.
Implicit and Explicit waits in Selenium WebDriwer, how to.
This document discusses the proper use of implicit and explicit waits in Selenium. It notes that implicit waits should be used to wait for element presence, while explicit waits should not be used for this. Implicit wait timeouts should be set lower than explicit wait timeouts. Using implicit and explicit waits together requires care to avoid conflicts between the timeouts. The document provides examples of how to set up waits correctly and what exceptions may occur in different scenarios. It also briefly mentions alternatives to WebDriver waits like using Selenide.
Fabulous Tests on Spock and Groovy
This document summarizes tests performed on Spock and Groovy frameworks for UI automation and REST API testing. Groovy and the Spock framework provide a simple, informative, and powerful way to write fast and stable tests with capabilities like JSON/XML parsing and mocking. Code examples show how to use the RESTClient library to make requests and assertions in a Spock specification.
More from Yaroslav Pernerovsky (7)
Implicit and Explicit waits in Selenium WebDriwer, how to.
Implicit and Explicit waits in Selenium WebDriwer, how to.
Recently uploaded
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
Predictive maintenance is a proactive approach that anticipates equipment failures before they happen. At the forefront of this innovative strategy is Artificial Intelligence (AI), which brings unprecedented precision and efficiency. AI in predictive maintenance is transforming industries by reducing downtime, minimizing costs, and enhancing productivity.
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
AWS Cloud Cost Optimization Presentation.pptx
This presentation provides valuable insights into effective cost-saving techniques on AWS. Learn how to optimize your AWS resources by rightsizing, increasing elasticity, picking the right storage class, and choosing the best pricing model. Additionally, discover essential governance mechanisms to ensure continuous cost efficiency. Whether you are new to AWS or an experienced user, this presentation provides clear and practical tips to help you reduce your cloud costs and get the most out of your budget.
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Generating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on integration of Salesforce with Bonterra Impact Management.
Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Digital Marketing Trends in 2024 | Guide for Staying Ahead
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
This case study explores designing a scalable e-commerce platform, covering key requirements, system components, and best practices.
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
When it comes to unit testing in the .NET ecosystem, developers have a wide range of options available. Among the most popular choices are NUnit, XUnit, and MSTest. These unit testing frameworks provide essential tools and features to help ensure the quality and reliability of code. However, understanding the differences between these frameworks is crucial for selecting the most suitable one for your projects.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Recently uploaded (20)
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Holy "Test Pyramid" , how it ruins your life
- 1. Holy "Test Pyramid" How it ruins your life
- 7. a
- 12. Unit Integration E2E White-box Independent units Mocks/stubs White/Black-box Some deployment External systems Black-box Fully deployed system Real life scenarios
- 13. Integration ü uses database ü uses network to call another component/application ü external system (MQ, mail server etc.) ü reads/writes files or performs other I/O ü does not rely on source code, uses deployed binary instead http://blog.codepipes.com/testing/software-testing-antipatterns.html
- 14. What is wrong with the Pyramid?
- 15. It is a theoretical metaphor
- 16. It is almost unachievable in real world
- 17. Unit Integration E2E Created by Developers Sometimes by Developers Sometimes by Testers Usually by Testers
- 19. Contexts differences Communication issues Industry stereotypes
- 20. Developers should create all the tests to build the canonical test pyramid
- 22. Become a "developer" Talk to each other Brake stereotypes
- 23. What is wrong with the tests in Pyramid?
- 24. CC=3 CC=2 CC=4++ CC=3 CC=2 CC=4 =9 =24
- 25. Having the "wrong" kind of tests Unit Integration
- 26. Having the "wrong" kind of tests Unit Integration
- 27. Having the "wrong" kind of tests Unit Integration GUI
- 28. Testing the wrong functionality Core Critical Other
- 29. 20%
- 30. Code coverage
- 31. Codepipes Testing Metrics (CTM) Metric Name Description Ideal value Usual value Problematic value PDWT % of Developers writing tests 100% 20%-70% Anything less than 100% PBCNT % of bugs that create new tests 100% 0%-5% Anything less than 100% PTVB % of tests that verify behavior 100% 10% Anything less than 100% PTD % of tests that are deterministic 100% 50%-80% Anything less than 100% http://blog.codepipes.com/testing/software-testing-antipatterns.html
- 34. Treating TDD as a religion ü you can write tests before ü you can write tests at the same time ü you can write tests after ü you can never write tests http://blog.codepipes.com/testing/software-testing-antipatterns.html
- 35. Itogi podvedyom ü Triangle is a mental abstraction ü It should be treated as abstraction ü Think before act ü Don't blame yourself ü Use right metrics ü Improve your programming skills ü Right tests over making triangles ü Do not hesitate to kill shitty tests