SlideShare a Scribd company logo
Thanks
Ministry of Testing
Poppulo
1
@MinistryCork
2
Upcoming Events
@MinistryCork
TestBash UK, Liverpool Wednesday, the 20th of September 2023, for two days.
3
AI assisted testing using
postman and OpenAI
Sivaganesh Sivakumar
16-May-2023
Ministry of Testing Cork
@sivaganesh_siva 4
About me Sivaganesh Sivakumar
Senior software test engineer
India (originally), currently in Cork
Experience: 13+ years in multiple industries
Passionate about technology
Enjoys food and movies
First public speaking engagement
@sivaganesh_siva 5
https://www.postman.com/aviation-meteorologist-80909569
Overview
By the end of the session, we will be able to
• Understand the current state of AI and AI in software testing.
• Learn the basics of OpenAI APIs and their potential in testing.
• Develop a simple test use-case using postman and OpenAI APIs.
• Discover interesting AI-assisted testing implementations.
@sivaganesh_siva 6
AI – Types
Artificial Intelligence (AI), a term coined by Stanford Professor John
McCarthy in 1955, was defined by him as “the science and engineering of
making intelligent machines”
Artificial Narrow
Intelligence
Artificial General
Intelligence
Artificial Super
Intelligence
Based on capabilities Based on functionalities
Reactive
machine
Theory of mind Self-aware
Limited
memory
@sivaganesh_siva 7
Artificial Narrow
Intelligence
• Focusses on one narrow task
• Targets a single subset of cognitive
abilities and advances in that spectrum
@sivaganesh_siva 8
Artificial General
Intelligence
Autonomous system
that surpasses human
capabilities in the
majority of
economically valuable
tasks
@sivaganesh_siva 9
Artificial Super Intelligence
Skynet begins to learn at a geometric rate.
An intellect that is much
smarter than the best human
brains in practically every field,
including scientific creativity,
general wisdom and social
skills
https://nickbostrom.com/superintelligence
@sivaganesh_siva 10
Generative AI
https://github.blog/2023-04-07-what-developers-need-to-know-about-generative-ai/
Category of AI models and tools designed to create new content,
such as text, images, videos, music, or code.
@sivaganesh_siva 11
Text Generation -
ChatGPT
Image Generation –
DALL-E2,
Midjourney,
Microsoft Designer
Video Generation –
Stable Diffusion
Programming Code
Generation –
OpenAI Codex,
PaLM 2
Data Generation -
MostlyAI
Language translation
- Google Neural
Machine Translation,
ChatGPT, PaLM 2
Generative AI - implementations
• AlphaCode
• Google DeepMind
• Competitive programming
• Amazon Codewhisperer
• GitHub Copilot X
• openAI Codex
• ChatGPT
• GPT4
• GPT3.5
• Tabnine
Programming / Coding
@sivaganesh_siva 12
Generative AI - implementations
Issue Tracking / Communication / Observability
Atlassian Intelligence
New Relic
SlackGPT
@sivaganesh_siva 13
State of AI in software testing - Tools
Unit tests
Contract tests
Integration/API
tests
UI
• Majority of the AI assisted testing tools focus on UI/Visual validation and self healing features
• All the AI features are built within the tools and need subscriptions
@sivaganesh_siva 14
Where else can AI help us ?
We spend a lot of time outside of the core testing activities like test
automation, execution, test planning etc.
Automation test failure/report analysis
Bug prioritization
Monitoring and Observability
Code reviews
Complex test data generation
Performance report analysis
Documentation
@sivaganesh_siva
15
Where to get started ?
OpenAI APIs
• Pay-as-you-go pricing of the APIs
• Ability to choose between multiple frameworks
• python
• node
• curl
• postman etc.
• Freedom to explore with smaller experiments
• Cons include complexity with prompts and don’t have any
reference materials
@sivaganesh_siva 16
OpenAI APIs - models
Offers multiple models which can be used for content generation,
image generation, speech recognition etc
GPT-4 : Improved natural language and code generation
GPT-3.5: Advanced natural language and code generation
DALL·E: Image generation and editing using natural language prompts
Whisper: Audio-to-text conversion
Embeddings: Text-to-numerical conversion
Moderation: Fine-tuned model to detect sensitive/unsafe text
GPT-3: Natural language understanding and generation
Codex: Natural language to code translation
@sivaganesh_siva 17
OpenAI APIs – Usage fee
5$ Free API usage for the first month
@sivaganesh_siva 18
openAI APIs – Completions
• Fundamental API which is extremely flexible and powerful
• Given a prompt it returns a text completion as per the provided instructions
POST https://api.openai.com/v1/completions
POST https://api.openai.com/v1/chat/completions
Supports multiple models.
text-davinci-003/gpt-3.5-
turbo
Max tokens to limit the
response text.
Values between 0 to 2. 0
being more focused and
deterministic and 2 being
very random and creative
@sivaganesh_siva 19
Leveraging openAI using postman
1) Generate openAI API key
2) Fork openAI API collection in postman
3) Update the API key from step 1 in
postman
4) Start working with the APIs
Key steps to get started
@sivaganesh_siva 20
Leveraging openAI using postman
LIVE DEMO
@sivaganesh_siva 21
Ideas to explore further
API Fuzzing with OpenAI APIs and Traditional Fuzzing Engines
Traditional fuzzing engines:
- Examples: AFL, libFuzzer, honggfuzz
- Generate test inputs using random mutations and code coverage monitoring
- Effective for discovering vulnerabilities in software
AI-driven fuzzing with OpenAI APIs:
- Leverages natural language understanding and reasoning capabilities
- Generates context-aware and complex test cases
- Can target specific functionality and edge cases
Benefits of a hybrid approach:
- Combines the strengths of both traditional fuzzing engines and AI-based methods
- Increases efficiency and likelihood of discovering vulnerabilities
@sivaganesh_siva 22
Ideas to explore further
Leveraging OpenAI APIs for Test Automation result analysis
Objectives
- Summarize test automation reports
- Analyse AWS CloudWatch logs to identify issues
Benefits
- Accelerate issue identification and resolution
- Enhance team productivity through automated test result analysis
@sivaganesh_siva 23
Interesting implementations
@sivaganesh_siva 24
Interesting implementations
@sivaganesh_siva 25
Questions ?
@sivaganesh_siva 26

More Related Content

What's hot

API Testing Using REST Assured with TestNG
API Testing Using REST Assured with TestNGAPI Testing Using REST Assured with TestNG
API Testing Using REST Assured with TestNG
Siddharth Sharma
 
Testing RESTful Webservices using the REST-assured framework
Testing RESTful Webservices using the REST-assured frameworkTesting RESTful Webservices using the REST-assured framework
Testing RESTful Webservices using the REST-assured framework
Micha Kops
 
Rest assured
Rest assuredRest assured
Rest assured
Varun Deshpande
 
Platform engineering 101
Platform engineering 101Platform engineering 101
Platform engineering 101
Sander Knape
 
The Test Pyramid
The Test PyramidThe Test Pyramid
The Test Pyramid
Thiago Ghisi
 
Test your microservices with REST-Assured
Test your microservices with REST-AssuredTest your microservices with REST-Assured
Test your microservices with REST-Assured
Michel Schudel
 
Test Automation
Test AutomationTest Automation
Test Automation
nikos batsios
 
API Testing With Katalon Studio
API Testing With Katalon StudioAPI Testing With Katalon Studio
API Testing With Katalon Studio
Knoldus Inc.
 
What is an API Gateway?
What is an API Gateway?What is an API Gateway?
What is an API Gateway?
LunchBadger
 
Crafting an API Strategy with an API Marketplace
Crafting an API Strategy with an API MarketplaceCrafting an API Strategy with an API Marketplace
Crafting an API Strategy with an API Marketplace
WSO2
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
Udaiappa Ramachandran
 
API Test Automation Using Karate (Anil Kumar Moka)
API Test Automation Using Karate (Anil Kumar Moka)API Test Automation Using Karate (Anil Kumar Moka)
API Test Automation Using Karate (Anil Kumar Moka)
Peter Thomas
 
Belajar Postman test runner
Belajar Postman test runnerBelajar Postman test runner
Belajar Postman test runner
Fachrul Choliluddin
 
AzureOpenAI.pptx
AzureOpenAI.pptxAzureOpenAI.pptx
AzureOpenAI.pptx
Udaiappa Ramachandran
 
BDD with Cucumber
BDD with CucumberBDD with Cucumber
BDD with Cucumber
Knoldus Inc.
 
API Security Lifecycle
API Security LifecycleAPI Security Lifecycle
API Security Lifecycle
Apigee | Google Cloud
 
Postman: An Introduction for Testers
Postman: An Introduction for TestersPostman: An Introduction for Testers
Postman: An Introduction for Testers
Postman
 
REST API Design & Development
REST API Design & DevelopmentREST API Design & Development
REST API Design & Development
Ashok Pundit
 
Introduction to APIs & how to automate APIs testing with selenium web driver?
Introduction to APIs & how to automate APIs testing with selenium web driver?Introduction to APIs & how to automate APIs testing with selenium web driver?
Introduction to APIs & how to automate APIs testing with selenium web driver?
BugRaptors
 
API First Workflow: How could we have better API Docs through DevOps pipeline
API First Workflow: How could we have better API Docs through DevOps pipelineAPI First Workflow: How could we have better API Docs through DevOps pipeline
API First Workflow: How could we have better API Docs through DevOps pipeline
Pronovix
 

What's hot (20)

API Testing Using REST Assured with TestNG
API Testing Using REST Assured with TestNGAPI Testing Using REST Assured with TestNG
API Testing Using REST Assured with TestNG
 
Testing RESTful Webservices using the REST-assured framework
Testing RESTful Webservices using the REST-assured frameworkTesting RESTful Webservices using the REST-assured framework
Testing RESTful Webservices using the REST-assured framework
 
Rest assured
Rest assuredRest assured
Rest assured
 
Platform engineering 101
Platform engineering 101Platform engineering 101
Platform engineering 101
 
The Test Pyramid
The Test PyramidThe Test Pyramid
The Test Pyramid
 
Test your microservices with REST-Assured
Test your microservices with REST-AssuredTest your microservices with REST-Assured
Test your microservices with REST-Assured
 
Test Automation
Test AutomationTest Automation
Test Automation
 
API Testing With Katalon Studio
API Testing With Katalon StudioAPI Testing With Katalon Studio
API Testing With Katalon Studio
 
What is an API Gateway?
What is an API Gateway?What is an API Gateway?
What is an API Gateway?
 
Crafting an API Strategy with an API Marketplace
Crafting an API Strategy with an API MarketplaceCrafting an API Strategy with an API Marketplace
Crafting an API Strategy with an API Marketplace
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
 
API Test Automation Using Karate (Anil Kumar Moka)
API Test Automation Using Karate (Anil Kumar Moka)API Test Automation Using Karate (Anil Kumar Moka)
API Test Automation Using Karate (Anil Kumar Moka)
 
Belajar Postman test runner
Belajar Postman test runnerBelajar Postman test runner
Belajar Postman test runner
 
AzureOpenAI.pptx
AzureOpenAI.pptxAzureOpenAI.pptx
AzureOpenAI.pptx
 
BDD with Cucumber
BDD with CucumberBDD with Cucumber
BDD with Cucumber
 
API Security Lifecycle
API Security LifecycleAPI Security Lifecycle
API Security Lifecycle
 
Postman: An Introduction for Testers
Postman: An Introduction for TestersPostman: An Introduction for Testers
Postman: An Introduction for Testers
 
REST API Design & Development
REST API Design & DevelopmentREST API Design & Development
REST API Design & Development
 
Introduction to APIs & how to automate APIs testing with selenium web driver?
Introduction to APIs & how to automate APIs testing with selenium web driver?Introduction to APIs & how to automate APIs testing with selenium web driver?
Introduction to APIs & how to automate APIs testing with selenium web driver?
 
API First Workflow: How could we have better API Docs through DevOps pipeline
API First Workflow: How could we have better API Docs through DevOps pipelineAPI First Workflow: How could we have better API Docs through DevOps pipeline
API First Workflow: How could we have better API Docs through DevOps pipeline
 

Similar to AI assisted testing using postman and openAI.pdf

2022 APIsecure_Securing APIs with Open Standards
2022 APIsecure_Securing APIs with Open Standards2022 APIsecure_Securing APIs with Open Standards
2022 APIsecure_Securing APIs with Open Standards
APIsecure_ Official
 
Dev Dives MAY Deck .pdf
Dev Dives MAY Deck .pdfDev Dives MAY Deck .pdf
Dev Dives MAY Deck .pdf
Rohit Radhakrishnan
 
OpenAPI Intro (1).pdf
OpenAPI Intro (1).pdfOpenAPI Intro (1).pdf
OpenAPI Intro (1).pdf
Postman
 
How ChatGPT led OpenAPI's Recent Spike in Popularity
How ChatGPT led OpenAPI's Recent Spike in PopularityHow ChatGPT led OpenAPI's Recent Spike in Popularity
How ChatGPT led OpenAPI's Recent Spike in Popularity
Postman
 
Space Camp - API Contract Testing
Space Camp - API Contract TestingSpace Camp - API Contract Testing
Space Camp - API Contract Testing
Postman
 
API Testing with Frisby and Mocha
API Testing with Frisby and MochaAPI Testing with Frisby and Mocha
API Testing with Frisby and Mocha
Lyudmila Anisimova
 
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
apidays
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Applitools
 
Advanced Testing
Advanced TestingAdvanced Testing
Advanced Testing
Postman
 
Developing Brilliant and Powerful APIs in Ruby & Python
Developing Brilliant and Powerful APIs in Ruby & PythonDeveloping Brilliant and Powerful APIs in Ruby & Python
Developing Brilliant and Powerful APIs in Ruby & Python
SmartBear
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium
Perfecto by Perforce
 
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
Curiosity Software Ireland
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
QA or the Highway
 
Space Camp June 2022 - API First.pdf
Space Camp June 2022 - API First.pdfSpace Camp June 2022 - API First.pdf
Space Camp June 2022 - API First.pdf
Postman
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the Technologies
QASymphony
 
The Complete Guide to API Development in 2022.pdf
The Complete Guide to API Development in 2022.pdfThe Complete Guide to API Development in 2022.pdf
The Complete Guide to API Development in 2022.pdf
Concetto Labs
 
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
10 Useful Testing Tools for Open Source Projects @ TuxCon 201510 Useful Testing Tools for Open Source Projects @ TuxCon 2015
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
Peter Sabev
 
Top 11 api testing tools for 2022
Top 11 api testing tools for 2022Top 11 api testing tools for 2022
Top 11 api testing tools for 2022
Aparna Sharma
 
INTERFACE, by apidays - The 8 Key Components of a Modern API Stack by Iddo G...
INTERFACE, by apidays  - The 8 Key Components of a Modern API Stack by Iddo G...INTERFACE, by apidays  - The 8 Key Components of a Modern API Stack by Iddo G...
INTERFACE, by apidays - The 8 Key Components of a Modern API Stack by Iddo G...
apidays
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
QASymphony
 

Similar to AI assisted testing using postman and openAI.pdf (20)

2022 APIsecure_Securing APIs with Open Standards
2022 APIsecure_Securing APIs with Open Standards2022 APIsecure_Securing APIs with Open Standards
2022 APIsecure_Securing APIs with Open Standards
 
Dev Dives MAY Deck .pdf
Dev Dives MAY Deck .pdfDev Dives MAY Deck .pdf
Dev Dives MAY Deck .pdf
 
OpenAPI Intro (1).pdf
OpenAPI Intro (1).pdfOpenAPI Intro (1).pdf
OpenAPI Intro (1).pdf
 
How ChatGPT led OpenAPI's Recent Spike in Popularity
How ChatGPT led OpenAPI's Recent Spike in PopularityHow ChatGPT led OpenAPI's Recent Spike in Popularity
How ChatGPT led OpenAPI's Recent Spike in Popularity
 
Space Camp - API Contract Testing
Space Camp - API Contract TestingSpace Camp - API Contract Testing
Space Camp - API Contract Testing
 
API Testing with Frisby and Mocha
API Testing with Frisby and MochaAPI Testing with Frisby and Mocha
API Testing with Frisby and Mocha
 
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
Apidays Helsinki 2024 - There’s no AI without API, but what does this mean fo...
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
 
Advanced Testing
Advanced TestingAdvanced Testing
Advanced Testing
 
Developing Brilliant and Powerful APIs in Ruby & Python
Developing Brilliant and Powerful APIs in Ruby & PythonDeveloping Brilliant and Powerful APIs in Ruby & Python
Developing Brilliant and Powerful APIs in Ruby & Python
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium
 
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
 
Space Camp June 2022 - API First.pdf
Space Camp June 2022 - API First.pdfSpace Camp June 2022 - API First.pdf
Space Camp June 2022 - API First.pdf
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the Technologies
 
The Complete Guide to API Development in 2022.pdf
The Complete Guide to API Development in 2022.pdfThe Complete Guide to API Development in 2022.pdf
The Complete Guide to API Development in 2022.pdf
 
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
10 Useful Testing Tools for Open Source Projects @ TuxCon 201510 Useful Testing Tools for Open Source Projects @ TuxCon 2015
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
 
Top 11 api testing tools for 2022
Top 11 api testing tools for 2022Top 11 api testing tools for 2022
Top 11 api testing tools for 2022
 
INTERFACE, by apidays - The 8 Key Components of a Modern API Stack by Iddo G...
INTERFACE, by apidays  - The 8 Key Components of a Modern API Stack by Iddo G...INTERFACE, by apidays  - The 8 Key Components of a Modern API Stack by Iddo G...
INTERFACE, by apidays - The 8 Key Components of a Modern API Stack by Iddo G...
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
 

Recently uploaded

Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
MuhammadTufail242431
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
FluxPrime1
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
SamSarthak3
 
LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
ssuser9bd3ba
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
fxintegritypublishin
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
DuvanRamosGarzon1
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 

Recently uploaded (20)

Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
 
LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 

AI assisted testing using postman and openAI.pdf

  • 3. Upcoming Events @MinistryCork TestBash UK, Liverpool Wednesday, the 20th of September 2023, for two days. 3
  • 4. AI assisted testing using postman and OpenAI Sivaganesh Sivakumar 16-May-2023 Ministry of Testing Cork @sivaganesh_siva 4
  • 5. About me Sivaganesh Sivakumar Senior software test engineer India (originally), currently in Cork Experience: 13+ years in multiple industries Passionate about technology Enjoys food and movies First public speaking engagement @sivaganesh_siva 5 https://www.postman.com/aviation-meteorologist-80909569
  • 6. Overview By the end of the session, we will be able to • Understand the current state of AI and AI in software testing. • Learn the basics of OpenAI APIs and their potential in testing. • Develop a simple test use-case using postman and OpenAI APIs. • Discover interesting AI-assisted testing implementations. @sivaganesh_siva 6
  • 7. AI – Types Artificial Intelligence (AI), a term coined by Stanford Professor John McCarthy in 1955, was defined by him as “the science and engineering of making intelligent machines” Artificial Narrow Intelligence Artificial General Intelligence Artificial Super Intelligence Based on capabilities Based on functionalities Reactive machine Theory of mind Self-aware Limited memory @sivaganesh_siva 7
  • 8. Artificial Narrow Intelligence • Focusses on one narrow task • Targets a single subset of cognitive abilities and advances in that spectrum @sivaganesh_siva 8
  • 9. Artificial General Intelligence Autonomous system that surpasses human capabilities in the majority of economically valuable tasks @sivaganesh_siva 9
  • 10. Artificial Super Intelligence Skynet begins to learn at a geometric rate. An intellect that is much smarter than the best human brains in practically every field, including scientific creativity, general wisdom and social skills https://nickbostrom.com/superintelligence @sivaganesh_siva 10
  • 11. Generative AI https://github.blog/2023-04-07-what-developers-need-to-know-about-generative-ai/ Category of AI models and tools designed to create new content, such as text, images, videos, music, or code. @sivaganesh_siva 11 Text Generation - ChatGPT Image Generation – DALL-E2, Midjourney, Microsoft Designer Video Generation – Stable Diffusion Programming Code Generation – OpenAI Codex, PaLM 2 Data Generation - MostlyAI Language translation - Google Neural Machine Translation, ChatGPT, PaLM 2
  • 12. Generative AI - implementations • AlphaCode • Google DeepMind • Competitive programming • Amazon Codewhisperer • GitHub Copilot X • openAI Codex • ChatGPT • GPT4 • GPT3.5 • Tabnine Programming / Coding @sivaganesh_siva 12
  • 13. Generative AI - implementations Issue Tracking / Communication / Observability Atlassian Intelligence New Relic SlackGPT @sivaganesh_siva 13
  • 14. State of AI in software testing - Tools Unit tests Contract tests Integration/API tests UI • Majority of the AI assisted testing tools focus on UI/Visual validation and self healing features • All the AI features are built within the tools and need subscriptions @sivaganesh_siva 14
  • 15. Where else can AI help us ? We spend a lot of time outside of the core testing activities like test automation, execution, test planning etc. Automation test failure/report analysis Bug prioritization Monitoring and Observability Code reviews Complex test data generation Performance report analysis Documentation @sivaganesh_siva 15
  • 16. Where to get started ? OpenAI APIs • Pay-as-you-go pricing of the APIs • Ability to choose between multiple frameworks • python • node • curl • postman etc. • Freedom to explore with smaller experiments • Cons include complexity with prompts and don’t have any reference materials @sivaganesh_siva 16
  • 17. OpenAI APIs - models Offers multiple models which can be used for content generation, image generation, speech recognition etc GPT-4 : Improved natural language and code generation GPT-3.5: Advanced natural language and code generation DALL·E: Image generation and editing using natural language prompts Whisper: Audio-to-text conversion Embeddings: Text-to-numerical conversion Moderation: Fine-tuned model to detect sensitive/unsafe text GPT-3: Natural language understanding and generation Codex: Natural language to code translation @sivaganesh_siva 17
  • 18. OpenAI APIs – Usage fee 5$ Free API usage for the first month @sivaganesh_siva 18
  • 19. openAI APIs – Completions • Fundamental API which is extremely flexible and powerful • Given a prompt it returns a text completion as per the provided instructions POST https://api.openai.com/v1/completions POST https://api.openai.com/v1/chat/completions Supports multiple models. text-davinci-003/gpt-3.5- turbo Max tokens to limit the response text. Values between 0 to 2. 0 being more focused and deterministic and 2 being very random and creative @sivaganesh_siva 19
  • 20. Leveraging openAI using postman 1) Generate openAI API key 2) Fork openAI API collection in postman 3) Update the API key from step 1 in postman 4) Start working with the APIs Key steps to get started @sivaganesh_siva 20
  • 21. Leveraging openAI using postman LIVE DEMO @sivaganesh_siva 21
  • 22. Ideas to explore further API Fuzzing with OpenAI APIs and Traditional Fuzzing Engines Traditional fuzzing engines: - Examples: AFL, libFuzzer, honggfuzz - Generate test inputs using random mutations and code coverage monitoring - Effective for discovering vulnerabilities in software AI-driven fuzzing with OpenAI APIs: - Leverages natural language understanding and reasoning capabilities - Generates context-aware and complex test cases - Can target specific functionality and edge cases Benefits of a hybrid approach: - Combines the strengths of both traditional fuzzing engines and AI-based methods - Increases efficiency and likelihood of discovering vulnerabilities @sivaganesh_siva 22
  • 23. Ideas to explore further Leveraging OpenAI APIs for Test Automation result analysis Objectives - Summarize test automation reports - Analyse AWS CloudWatch logs to identify issues Benefits - Accelerate issue identification and resolution - Enhance team productivity through automated test result analysis @sivaganesh_siva 23