Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, presented by Applitools

Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, presented by Applitools

• 1.
  @BagmarAnand Unlocking the Power of ChatGPTand AI in Testing A Real-World Look Anand Bagmar Software Quality Evangelist
• 2.
  ABOUT ME BagmarAnand linkedin.com/in/anandbagmar/
• 3.
  Hype in AI
• 4.
  Gartner’s Hype Cycle forAI, 2021 report https://www.gartner.com/en/articles/the-4-trends-that-prevail- on-the-gartner-hype-cycle-for-ai-2021
• 5.
  https://www.gartner.com/en/articles/the-4-trends-that-prevail-on-the-gartner-hype-cycle-for-ai-2021
• 6.
  AGENDA • What isChatGPT? • Using ChatGPT in Testing • Using ChatGPT in Programming • Limitations of ChatGPT • Other AI Tools you can use • Pitfalls of AI • Summary • Q&A
• 7.
  @BagmarAnand ChatGPT https://openai.com/blog/chatgpt/
• 8.
  @BagmarAnand ChatGPT – inits own words
• 9.
  @BagmarAnand ChatGPT is evolving!
• 10.
  @BagmarAnand GPT-3 https://en.wikipedia.org/wiki/GPT-3
• 11.
  @BagmarAnand ChatGPT – InterestingStats https://www.demandsage.com/chatgpt-statistics/ • ChatGPT was launched on 30th November 2022. • The new and improved embedding model of ChatGPT was launched on 15th December 2022. • ChatGPT has crossed one million users within a week of its launch. • ChatGPT can only fetch data prior to the year 2021 as its training stopped in the year 2021. • Microsoft Azure supports OpenAI and provides them with the computational power required for running ChatGPT.
• 12.
  ChatGPT in Testing Example:Testing an eCommerce application – Amazon (USA)
• 13.
  @BagmarAnand Testing Approach • Gettingstarted • Framework • Design patterns • Code optimization • Reporting • Metrics • Test scenarios • Test cases • Test data • Risk • Coverage • Metrics Strategy Test Design Automation Test execution
• 14.
  @BagmarAnand Testing - Strategy •Getting started • Framework • Design patterns • Code optimization • Reporting • Metrics • Test scenarios • Test cases • Test data • Risk • Coverage • Metrics Strategy Test Design Automation Test execution
• 15.
  @BagmarAnand Testing - Strategy Questionasked: Create a test strategy for testing and automating Amazon USA
• 16.
  @BagmarAnand Testing - Strategy Questionasked: Create a test strategy for testing and automating Amazon USA
• 17.
  @BagmarAnand Testing - Strategy Questionasked: Create a test strategy for testing and automating Amazon USA This is not useful. Seems like a template
• 18.
  @BagmarAnand Testing - Strategy Follow-upquestion: Give a concrete strategy for the above use case
• 19.
  @BagmarAnand Testing - Strategy Follow-upquestion: Give a concrete strategy for the above use case
• 20.
  @BagmarAnand Testing - Strategy Follow-upquestion: Give a concrete strategy for the above use case
• 21.
  @BagmarAnand Testing - Strategy Follow-upquestion: Give a concrete strategy for the above use case
• 22.
  @BagmarAnand Testing - Strategy Follow-upquestion: Give a concrete strategy for the above use case This is promising. A great start!
• 23.
  @BagmarAnand Testing – Strategywith Risk Mitigation Next question: What risks and their mitigation strategies should be included in the above strategy?
• 24.
  @BagmarAnand Testing – Strategywith Risk Mitigation Next question: What risks and their mitigation strategies should be included in the above strategy?
• 25.
  @BagmarAnand Testing – Strategywith Risk Mitigation Next question: What risks and their mitigation strategies should be included in the above strategy?
• 26.
  @BagmarAnand Testing – TestDesign • Getting started • The 1st Test • Design patterns • Reporting • Metrics • Test scenarios • Test cases • Test data • Risk • Coverage • Metrics Strategy Test Design Automation Test execution
• 27.
  @BagmarAnand Test Design –Test Scenarios Next question: What are the most critical test scenarios I should test for this website?
• 28.
  @BagmarAnand Test Design –Test Scenarios Next question: What are the most critical test scenarios I should test for this website?
• 29.
  @BagmarAnand Test Design –Test Scenarios Next question: What are the most critical test scenarios I should test for this website? Great set of regression scenarios!
• 30.
  @BagmarAnand Test Design –Test Cases Next question: List 10 test cases for "Product Search and Filtering" scenario in order of priority
• 31.
  @BagmarAnand Test Design –Test Cases Next question: List 10 test cases for "Product Search and Filtering" scenario in order of priority
• 32.
  @BagmarAnand Test Design –Test Cases Next question: List 10 test cases for "Product Search and Filtering" scenario in order of priority Isn’t this amazing?
• 33.
  @BagmarAnand Test Design –Test Data Next question: What test data do I need to be available for performing the above test cases?
• 34.
  @BagmarAnand Test Design –Test Data Next question: What test data do I need to be available for performing the above test cases?
• 35.
  @BagmarAnand Test Design –Test Data Next question: What test data do I need to be available for performing the above test cases? Well – I was hoping for more specific, but it’s a start!
• 36.
  @BagmarAnand Testing - Automation •Getting started • The 1st Test • Design patterns • Reporting • Metrics • Test scenarios • Test cases • Test data • Risk • Coverage • Metrics Strategy Test Design Automation Test execution
• 37.
  @BagmarAnand Automation – Strategy Nextquestion: What is a good way to automate the above test cases?
• 38.
  @BagmarAnand Automation – Strategy Nextquestion: What is a good way to automate the above test cases?
• 39.
  @BagmarAnand Automation – GettingStarted Next question: I don't know Selenium. How should I learn?
• 40.
  @BagmarAnand Automation – GettingStarted Next question: I don't know Selenium. How should I learn?
• 41.
  @BagmarAnand Automation – GettingStarted Next question: I don't know Selenium. How should I learn? This answer took some time TestAutomationUniversity (TAU) was missed!
• 42.
  @BagmarAnand Automation – The1st Test Next question: Implement the 1st test case using Selenium Java with Junit
• 43.
  @BagmarAnand Automation – The1st Test Next question: Implement the 1st test case using Selenium Java with Junit
• 44.
  @BagmarAnand Automation – The1st Test Next question: Implement the 1st test case using Selenium Java with Junit
• 45.
  @BagmarAnand Automation – The1st Test Next question: Implement the 1st test case using Selenium Java with Junit
• 46.
  @BagmarAnand Automation – WithWebDriverManager Next question: Use WebDriverManager in the above example
• 47.
  @BagmarAnand Automation – WithWebDriverManager Next question: Use WebDriverManager in the above example
• 48.
  @BagmarAnand Automation – WithWebDriverManager Next question: Use WebDriverManager in the above example
• 49.
  @BagmarAnand Automation – WithWebDriverManager Next question: Use WebDriverManager in the above example
• 50.
  @BagmarAnand Automation – WithWebDriverManager Next question: Use WebDriverManager in the above example
• 51.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 52.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 53.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 54.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 55.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 56.
  @BagmarAnand Automation – DesignPatterns Next question: Implement the above test using Page- Object-Model design pattern
• 57.
  @BagmarAnand Testing – TestExecution • Getting started • The 1st Test • Design patterns • Reporting • Metrics • Test scenarios • Test cases • Test data • Risk • Coverage • Metrics Strategy Test Design Automation Test execution
• 58.
  @BagmarAnand Test Execution –Reports Next question: How to generate reports and metrics for automated tests?
• 59.
  @BagmarAnand Test Execution –Reports Next question: How to generate reports and metrics for automated tests?
• 60.
  @BagmarAnand Test Execution –Reports Next question: How to generate reports and metrics for automated tests?
• 61.
  @BagmarAnand Test Execution –Reports Next question: How to generate reports and metrics for automated tests? This is not what I was looking for!
• 62.
  @BagmarAnand Test Execution –Reports Follow-up question: Show an example to generate JunitReports for the automated tests
• 63.
  @BagmarAnand Test Execution –Reports Follow-up question: Show an example to generate JunitReports for the automated tests
• 64.
  @BagmarAnand Test Execution –Reports Follow-up question: Show an example to generate JunitReports for the automated tests
• 65.
  ChatGPT in Programming
• 66.
  @BagmarAnand ChatGPT in Programming Writing code Refactoring Debugging ...
• 67.
  @BagmarAnand Writing code Writing code Refactoring Debugging ...
• 68.
  @BagmarAnand Writing code Question asked: Implementcode for count- and-say https://leetcode.com/problems/count-and-say/
• 69.
  @BagmarAnand Writing code Question asked: Implementcode for count- and-say https://leetcode.com/problems/count-and-say/
• 70.
  @BagmarAnand Writing code Question asked: Implementcode for count- and-say https://leetcode.com/problems/count-and-say/
• 71.
  @BagmarAnand Writing code Question asked: Implementcode for count- and-say https://leetcode.com/problems/count-and-say/
• 72.
  @BagmarAnand Writing code Follow-up asked: Giveabove solution in Java
• 73.
  @BagmarAnand Writing code Follow-up asked: Giveabove solution in Java
• 74.
  @BagmarAnand Writing code Follow-up asked: Giveabove solution in Java This actually works J
• 75.
  @BagmarAnand Writing code Follow-up asked: Useproper variable names for above code
• 76.
  @BagmarAnand Writing code Follow-up asked: Useproper variable names for above code
• 77.
  @BagmarAnand Writing code Follow-up asked: Useproper variable names in the loops
• 78.
  @BagmarAnand Writing code Follow-up asked: Useproper variable names in the loops
• 79.
  @BagmarAnand Refactoring Writing code Refactoring Debugging ...
• 80.
  @BagmarAnand Refactor code Question asked: Givena link to code in Github, refactor it
• 81.
  @BagmarAnand Refactor code Question asked: Givena link to code in Github, refactor it
• 82.
  @BagmarAnand Refactor code Question asked: Givena link to code in Github, refactor it I have not verified the validity of this refactoring
• 83.
  @BagmarAnand Question asked: Given asnippet of code, refactor it Refactor code
• 84.
  @BagmarAnand Refactor code Question asked: Givena snippet of code, refactor it
• 85.
  @BagmarAnand Refactor code Question asked: Givena snippet of code, refactor it
• 86.
  @BagmarAnand Refactor code Question asked: Givena snippet of code, refactor it
• 87.
  @BagmarAnand Refactor code Question asked: Givena snippet of code, refactor it Large output pauses abruptly ”continue” proceeds
• 88.
  @BagmarAnand Refactor code Question asked: Givena snippet of code, refactor it
• 89.
  @BagmarAnand Complex code Question asked: Givena complex code, asked ChatGPT to refactor the code, and then reduce the complexity
• 90.
  @BagmarAnand Complex code Question asked: Givena complex code, asked ChatGPT to refactor the code, and then reduce the complexity
• 91.
  @BagmarAnand Complex code Question asked: Givena complex code, asked ChatGPT to refactor the code, and then reduce the complexity
• 92.
  @BagmarAnand Complex code Follow-up question: Reducecomplexity of above code
• 93.
  @BagmarAnand Complex code Follow-up question: Reducecomplexity of above code
• 94.
  @BagmarAnand Debugging Writing code Refactoring Debugging ...
• 95.
  @BagmarAnand Debugging Question asked: Given abuggy code, fix it
• 96.
  @BagmarAnand Debugging Question asked: Given abuggy code, fix it
• 97.
  @BagmarAnand Debugging Question asked: Given abuggy code, fix it
• 98.
  @BagmarAnand Debugging Question asked: Given abuggy code, fix it Not only fixed the code, ChatGPT also explained the error
• 99.
  Limitations of ChatGPT
• 100.
  @BagmarAnand Limitations of ChatGPT https://openai.com/blog/chatgpt/