SlideShare a Scribd company logo
1 of 16
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
R E - D E F I N E Q U A L I T Y A S S U R A N C E :
J O U R N E Y F R O M C E N T R A L I S E D T O
D E C E N T R A L I S E D , D I S T R I B U T E D
B L O C K C H A I N T E S T I N G
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
ABOUT ME
Saurabh Bhardwaj
Vice President – QA Digital & Blockchain Practice
Saby-Saurabh-Bhardwaj
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
• "According to Gartner, by 2025, 55% of enterprise data will be
managed on Blockchain." This highlights the increasing adoption and
importance of Blockchain technology in various industries.
• "McKinsey estimates that Blockchain technology has the potential to
generate $3.1 trillion in business value by 2030." This demonstrates
the immense economic potential and significance of Blockchain in
transforming industries.
• "E&Y states that 92% of surveyed companies had invested in
Blockchain technology by 2021." This showcases the widespread
interest and intention of businesses to leverage Blockchain for their
operations.
Blockchain – Is it a good bet?
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Blockchain - Basics
“Blockchain” is a shared, immutable ledger that
facilitates the process of recording transactions and
tracking assets on a business networks.
“Block” refers to data and state being stored in
consecutive groups known as “blocks”. Ex - If you send
digital assets, the transaction data needs to be added to a
Block to be successful.
“Chain” refers to each block cryptographically reference
its parents / blocks getting chained together via
consensus. The data in a Block cannot be altered
(immutable).
“Consensus Mechanism” a system that validates a
transaction and marks it as authentic without the need for
a third party intermediary . Key- PoW, PoS, PoA,
IBFT/QBFT
“Ethereum” is primarily public Blockchain. It is
designed to be open , accessible, allowing
decentralized transitions, smart contracts,
dApps. We can also have private permission
Ethereum Blockchain..
“Hyperledger” is an open source for building
private and permissioned Blockchain networks,
designed for business and enterprise use cases
that prioritize privacy, scalability and
interoperability.
“Hyperledger Besu” is an Ethereum based
open source Blockchain platform that enables
the development of private and public enterprise
Blockchain applications, offering flexibility and
compatibility with Ethereum standards and
tooling.
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Blockchain – Smart Contracts
“Smart Contract” is a self-executing digital agreement
that automatically enforces the terms and conditions
coded within it, facilitating secure and trustless
transactions on a Blockchain.
Smart Contracts are written in a language called Solidity.
Solidity is statically typed and supports inheritance,
libraries and complex user defined types. Syntax is like
JavaScript
Use Case – Following are few key business use
cases that can be designed using smart contract
and make it work on a Blockchain decentralized
applications:
 SCM
 Property Ownership
 Ballot and Voting
 Retail , Judiciary, Medical
 Insurance, Mortgages, Financial Data
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Blockchain – Decentralised Apps (dApps)
dApps or Decentralized Apps are software applications that run on a decentralized networks, typically a Blockchain. dApps
can enable various functionalities such as financial services, gamming, social media and more while allowing users to retain
control over their data and interactions (web3.0).
In dApps , smart contract acts as the backbone, handling essential operations such as user authentication, data storage and
executing business logics. The user interfaces for these dApps consist of familiar languages such as HTML, CSS, and Java
scripts. Data is distributed across multiple nodes and makes it difficult for external hacks.
dApps could be a solution for many industries, including but not limited to:
 SCM
 Property Ownership
 Ballot and Voting
 Retail , Legal, Medical
 Insurance, Mortgages, Financial Data
One can create his/her own dApp, test it using (Ganache) or
testnet of your choice- Kovan, Rinkeby, Sokol, Görli, and Ropsten
on Ethereum free of cost!
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Blockchain – Testing
Blockchain Testing is a verification and validations of the
Blockchain’s various functional components:
o Network/Distributed Node testing
o DR/HA
o Deployment and validation of Smart Contracts
o dApp Testing
PN : Unlike traditional S/W Testing , in Blockchain testing
involves several components such block details, successful
mining, transactions including send and sign, wallet update,
onchain / offchain. Most of these require specialist
knowledge.
Smart Contract Testing – Verify & validate that the parties
involved in transactions are adhering to the rules also
simulate the expected and unexpected condition for every
contract.
PN: Involves validating the Methods, Validating Processing
and Validating the Encryption and Transmission.
Other testing includes:
• API Testing
• Node/Peer Testing
• Functional, Integration Testing
• Security, Performance Testing
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
 Ensuring the security and integrity of data across multiple nodes, validating smart contract logic, and detecting any
vulnerabilities upfront.
 Data privacy is a critical issue due to the immutability and transparency. Testing to address the confidentiality and
privacy concerns associated with sensitive information on the Blockchain.
 Smart contract verification is essential in ensuring the reliability of Blockchain systems. Testing processes should
include comprehensive audits & verifications to detect potential vulnerabilities and avoid costly exploits.
 Decentralized data handling is a key aspect of Blockchain testing, which involves validating data storage and retrieval
mechanisms across multiple nodes. Testing strategies need to ensure the consistency and availability of data in a
decentralized environment.
 Web3 testing focuses on the verification and validation of decentralized applications (dApps) built on Blockchain
technology. Testing methodologies should cover aspects such as user experience, functionality, and compatibility with
different Blockchain networks.
 Interoperability testing is crucial in ensuring the seamless integration and communication between different
Blockchain networks. Comprehensive testing frameworks should be developed to verify interoperability protocols and
standards.
Challenges
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Test Automation Framework
Pytest
Locust
Runner
Custom
plugin &
logger
Brownie/
Web3
Blockchain
Tests,
Pages,
Services
Custom plugin & logger
Locust –
Load Test
Reporting
Utilities
Functional –
UI & API
Local Config, Test
Data, Logger Folders
Storage
Automation Components
Master Slave
S1
S2
S3
Continuous Test Pipeline
Django Model & Views
API/UI
report
Endpoint
SQL or
Oracle
Reporting Dashboard
• Python automation framework
supports Brownie / Web3 for
Blockchain / DLT testing.
• Support UI, API Automation. &
Locust for Load test/
concurrency.
• Trigger via CI Pipeline.
• #GenAI Modules for
• Smart Contract Vulnerability
• Smart Contract Details Smart Contract
Vulnerability
#GenAI
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Beyond Traditional QA: Embracing New Techniques
 Fuzz Testing: Identify edge cases and vulnerabilities by injecting invalid data
to uncover defects.
 Mutation Testing: Analyze smart contract behavior by deliberately introducing
small changes.
 Property-Based Testing: Specify desired properties and automatically
generate test cases .
 Runtime Verification (RV): Continuously monitor smart contract execution for
anomalies.
 Security Audits: Meticulous analysis of smart contracts to detect exploits and
gas optimization opportunities.
 Concurrency Testing Tools: Simulate real-world usage patterns to gauge
performance under scalability demands.
Innovative Testing Methodologies
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
dApp Testing: Ensuring a Seamless User Experience
Best Practices for dApp Testing:
 Start early: Integrate testing throughout the
development process, not just at the end.
 Automate as much as possible: Automate repetitive
tasks to save time and resources.
 Use a combination of testing methods: Don't rely on a
single technique for comprehensive testing.
 Use the right tools: Choose tools specifically
designed for dApp testing.
 Focus on user needs: prioritize testing functionalities
that impact the user experience.
Benefits:
 Reduced Costs: Early bug detection and automated
testing significantly reduce costs.
 Enhanced Security: Comprehensive security testing
mitigates vulnerabilities & minimizes the risk.
 Improved Scalability: Performance testing ensures
the dApp can handle increasing user loads..
 Elevated User Satisfaction: increased engagement,
higher user retention, and a thriving dApp community.
 Competitive Advantage: A consistently refined and
improved dApp stands out in the marketplace.
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
 Transaction Speed and Latency: Measures time taken for transactions to be
processed and confirmed.
 Resource Consumption: Memory and CPU usage by nodes, impacting scalability
and cost
 Network Throughput: Number of transactions processed per second.
 Smart Contract Performance: Gas consumption and execution time of smart
contracts.
 Node Availability and Uptime: Ensures network stability and continuous operation.
 Security Incidents and Vulnerabilities: Measures effectiveness of security controls
and proactive risk mitigation.
 User Adoption and Engagement: Measures the level of dApp usage and user
satisfaction.
 Block Time: Time interval between consecutive blocks added to the chain
Key Performance Indices
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Thank You
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
5: Consensus Algorithm Testing: Effectiveness and Resilience
Building Trust: Validating the Backbone of Blockchain
• QBFT / IGFT / Byzantine Fault Tolerance (BFT): Testing consensus algorithms like Proof-of-
Work and Proof-of-Stake for their ability to reach agreement despite malicious actors.
• Fork Resilience: Evaluating the system's ability to recover from accidental or intentional
network forks.
• Incentive Mechanisms: Assessing the effectiveness of economic incentives in maintaining
network stability and participation.
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
6. Onchain vs Offchain Content Testing: Seamless Integration
Bridging the Gap: Seamless Communication and Data Exchange
• Data Availability: Verifying that onchain references point to readily available offchain data.
• Oracle Integration: Testing the accuracy and reliability of oracles that bridge onchain and
offchain data.
• Storage Optimization: Evaluating the cost-effectiveness of storing data onchain versus
leveraging offchain storage solutions..

More Related Content

Similar to #Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance – Journey from Centralized to Decentralized, Distributed Blockchain/Web3 testing" at #ATAGTR2023.

Similar to #Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance – Journey from Centralized to Decentralized, Distributed Blockchain/Web3 testing" at #ATAGTR2023. (20)

Blockchain for automation
Blockchain for automationBlockchain for automation
Blockchain for automation
 
Blockchain for automation
Blockchain for automation Blockchain for automation
Blockchain for automation
 
Distributed ledger technical research in central bank of brazil
Distributed ledger technical research in central bank of brazilDistributed ledger technical research in central bank of brazil
Distributed ledger technical research in central bank of brazil
 
Block-Chain Oriented Software Testing Approach
Block-Chain Oriented Software Testing ApproachBlock-Chain Oriented Software Testing Approach
Block-Chain Oriented Software Testing Approach
 
AN IDENTITY MANAGEMENT SYSTEM USING BLOCKCHAIN
AN IDENTITY MANAGEMENT SYSTEM USING BLOCKCHAINAN IDENTITY MANAGEMENT SYSTEM USING BLOCKCHAIN
AN IDENTITY MANAGEMENT SYSTEM USING BLOCKCHAIN
 
What Is A Smart Contract Audit?
What Is A Smart Contract Audit?What Is A Smart Contract Audit?
What Is A Smart Contract Audit?
 
Blockchain and IOT and the GxP Lab Slides
Blockchain and IOT and the GxP Lab SlidesBlockchain and IOT and the GxP Lab Slides
Blockchain and IOT and the GxP Lab Slides
 
Creating An E-Commerce web application using Blockchain
Creating An E-Commerce web application using BlockchainCreating An E-Commerce web application using Blockchain
Creating An E-Commerce web application using Blockchain
 
Decentralized Car Hailing Application
Decentralized Car Hailing ApplicationDecentralized Car Hailing Application
Decentralized Car Hailing Application
 
Blockchains For The IOT - EVRYTHNG
Blockchains For The IOT - EVRYTHNGBlockchains For The IOT - EVRYTHNG
Blockchains For The IOT - EVRYTHNG
 
Blockchain Based Car Rental App
Blockchain Based Car Rental AppBlockchain Based Car Rental App
Blockchain Based Car Rental App
 
IoT & Blockchain: Use Case Overview
IoT & Blockchain: Use Case Overview IoT & Blockchain: Use Case Overview
IoT & Blockchain: Use Case Overview
 
IRJET- Survey on Blockchain based Digital Certificate System
IRJET- Survey on Blockchain based Digital Certificate SystemIRJET- Survey on Blockchain based Digital Certificate System
IRJET- Survey on Blockchain based Digital Certificate System
 
Custom Blockchain App Development_ A Comprehensive Guide for 2024.pdf
Custom Blockchain App Development_ A Comprehensive Guide for 2024.pdfCustom Blockchain App Development_ A Comprehensive Guide for 2024.pdf
Custom Blockchain App Development_ A Comprehensive Guide for 2024.pdf
 
Blockchain testing strategy
Blockchain testing strategyBlockchain testing strategy
Blockchain testing strategy
 
DLT analytics and AI workshop 13 march 2019
DLT analytics and AI workshop   13 march  2019DLT analytics and AI workshop   13 march  2019
DLT analytics and AI workshop 13 march 2019
 
LAND REGISTRY SYSTEM USING BLOCKCHAIN
LAND REGISTRY SYSTEM USING BLOCKCHAINLAND REGISTRY SYSTEM USING BLOCKCHAIN
LAND REGISTRY SYSTEM USING BLOCKCHAIN
 
Oracle Blockchain Experience Day
Oracle Blockchain Experience DayOracle Blockchain Experience Day
Oracle Blockchain Experience Day
 
IRJET- Different Blockchain Platforms and Algorithms
IRJET-  	  Different Blockchain Platforms and AlgorithmsIRJET-  	  Different Blockchain Platforms and Algorithms
IRJET- Different Blockchain Platforms and Algorithms
 
Adoption Blockchain Smart Contracts in Developing Information Systems.pdf
Adoption Blockchain Smart Contracts in Developing Information Systems.pdfAdoption Blockchain Smart Contracts in Developing Information Systems.pdf
Adoption Blockchain Smart Contracts in Developing Information Systems.pdf
 

More from Agile Testing Alliance

More from Agile Testing Alliance (20)

#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...
 
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In T...
#Interactive Session by  Ajay Balamurugadas, "Where Are The Real Testers In T...#Interactive Session by  Ajay Balamurugadas, "Where Are The Real Testers In T...
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In T...
 
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Per...
#Interactive Session by  Jishnu Nambiar and  Mayur Ovhal, "Monitoring Web Per...#Interactive Session by  Jishnu Nambiar and  Mayur Ovhal, "Monitoring Web Per...
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Per...
 
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...
 
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...
 
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
 
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...
 
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...
 
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...
 
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...
 
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...
 
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
 
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...
 
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...
 
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...
 
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
 
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...
 
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Dat...
#Interactive Session by Aniket Diwakar Kadukar and  Padimiti Vaidik Eswar Dat...#Interactive Session by Aniket Diwakar Kadukar and  Padimiti Vaidik Eswar Dat...
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Dat...
 
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...
 
#Interactive Session by Sumit Mundhada, "Observability in Software Testing" a...
#Interactive Session by Sumit Mundhada, "Observability in Software Testing" a...#Interactive Session by Sumit Mundhada, "Observability in Software Testing" a...
#Interactive Session by Sumit Mundhada, "Observability in Software Testing" a...
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Modernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using BallerinaModernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using Ballerina
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Quantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingQuantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation Computing
 
API Governance and Monetization - The evolution of API governance
API Governance and Monetization -  The evolution of API governanceAPI Governance and Monetization -  The evolution of API governance
API Governance and Monetization - The evolution of API governance
 
Choreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software EngineeringChoreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software Engineering
 

#Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance – Journey from Centralized to Decentralized, Distributed Blockchain/Web3 testing" at #ATAGTR2023.

  • 1. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 R E - D E F I N E Q U A L I T Y A S S U R A N C E : J O U R N E Y F R O M C E N T R A L I S E D T O D E C E N T R A L I S E D , D I S T R I B U T E D B L O C K C H A I N T E S T I N G
  • 2. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 ABOUT ME Saurabh Bhardwaj Vice President – QA Digital & Blockchain Practice Saby-Saurabh-Bhardwaj
  • 3. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 • "According to Gartner, by 2025, 55% of enterprise data will be managed on Blockchain." This highlights the increasing adoption and importance of Blockchain technology in various industries. • "McKinsey estimates that Blockchain technology has the potential to generate $3.1 trillion in business value by 2030." This demonstrates the immense economic potential and significance of Blockchain in transforming industries. • "E&Y states that 92% of surveyed companies had invested in Blockchain technology by 2021." This showcases the widespread interest and intention of businesses to leverage Blockchain for their operations. Blockchain – Is it a good bet?
  • 4. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Blockchain - Basics “Blockchain” is a shared, immutable ledger that facilitates the process of recording transactions and tracking assets on a business networks. “Block” refers to data and state being stored in consecutive groups known as “blocks”. Ex - If you send digital assets, the transaction data needs to be added to a Block to be successful. “Chain” refers to each block cryptographically reference its parents / blocks getting chained together via consensus. The data in a Block cannot be altered (immutable). “Consensus Mechanism” a system that validates a transaction and marks it as authentic without the need for a third party intermediary . Key- PoW, PoS, PoA, IBFT/QBFT “Ethereum” is primarily public Blockchain. It is designed to be open , accessible, allowing decentralized transitions, smart contracts, dApps. We can also have private permission Ethereum Blockchain.. “Hyperledger” is an open source for building private and permissioned Blockchain networks, designed for business and enterprise use cases that prioritize privacy, scalability and interoperability. “Hyperledger Besu” is an Ethereum based open source Blockchain platform that enables the development of private and public enterprise Blockchain applications, offering flexibility and compatibility with Ethereum standards and tooling.
  • 5. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Blockchain – Smart Contracts “Smart Contract” is a self-executing digital agreement that automatically enforces the terms and conditions coded within it, facilitating secure and trustless transactions on a Blockchain. Smart Contracts are written in a language called Solidity. Solidity is statically typed and supports inheritance, libraries and complex user defined types. Syntax is like JavaScript Use Case – Following are few key business use cases that can be designed using smart contract and make it work on a Blockchain decentralized applications:  SCM  Property Ownership  Ballot and Voting  Retail , Judiciary, Medical  Insurance, Mortgages, Financial Data
  • 6. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Blockchain – Decentralised Apps (dApps) dApps or Decentralized Apps are software applications that run on a decentralized networks, typically a Blockchain. dApps can enable various functionalities such as financial services, gamming, social media and more while allowing users to retain control over their data and interactions (web3.0). In dApps , smart contract acts as the backbone, handling essential operations such as user authentication, data storage and executing business logics. The user interfaces for these dApps consist of familiar languages such as HTML, CSS, and Java scripts. Data is distributed across multiple nodes and makes it difficult for external hacks. dApps could be a solution for many industries, including but not limited to:  SCM  Property Ownership  Ballot and Voting  Retail , Legal, Medical  Insurance, Mortgages, Financial Data One can create his/her own dApp, test it using (Ganache) or testnet of your choice- Kovan, Rinkeby, Sokol, Görli, and Ropsten on Ethereum free of cost!
  • 7. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023
  • 8. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Blockchain – Testing Blockchain Testing is a verification and validations of the Blockchain’s various functional components: o Network/Distributed Node testing o DR/HA o Deployment and validation of Smart Contracts o dApp Testing PN : Unlike traditional S/W Testing , in Blockchain testing involves several components such block details, successful mining, transactions including send and sign, wallet update, onchain / offchain. Most of these require specialist knowledge. Smart Contract Testing – Verify & validate that the parties involved in transactions are adhering to the rules also simulate the expected and unexpected condition for every contract. PN: Involves validating the Methods, Validating Processing and Validating the Encryption and Transmission. Other testing includes: • API Testing • Node/Peer Testing • Functional, Integration Testing • Security, Performance Testing
  • 9. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023  Ensuring the security and integrity of data across multiple nodes, validating smart contract logic, and detecting any vulnerabilities upfront.  Data privacy is a critical issue due to the immutability and transparency. Testing to address the confidentiality and privacy concerns associated with sensitive information on the Blockchain.  Smart contract verification is essential in ensuring the reliability of Blockchain systems. Testing processes should include comprehensive audits & verifications to detect potential vulnerabilities and avoid costly exploits.  Decentralized data handling is a key aspect of Blockchain testing, which involves validating data storage and retrieval mechanisms across multiple nodes. Testing strategies need to ensure the consistency and availability of data in a decentralized environment.  Web3 testing focuses on the verification and validation of decentralized applications (dApps) built on Blockchain technology. Testing methodologies should cover aspects such as user experience, functionality, and compatibility with different Blockchain networks.  Interoperability testing is crucial in ensuring the seamless integration and communication between different Blockchain networks. Comprehensive testing frameworks should be developed to verify interoperability protocols and standards. Challenges
  • 10. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Test Automation Framework Pytest Locust Runner Custom plugin & logger Brownie/ Web3 Blockchain Tests, Pages, Services Custom plugin & logger Locust – Load Test Reporting Utilities Functional – UI & API Local Config, Test Data, Logger Folders Storage Automation Components Master Slave S1 S2 S3 Continuous Test Pipeline Django Model & Views API/UI report Endpoint SQL or Oracle Reporting Dashboard • Python automation framework supports Brownie / Web3 for Blockchain / DLT testing. • Support UI, API Automation. & Locust for Load test/ concurrency. • Trigger via CI Pipeline. • #GenAI Modules for • Smart Contract Vulnerability • Smart Contract Details Smart Contract Vulnerability #GenAI
  • 11. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Beyond Traditional QA: Embracing New Techniques  Fuzz Testing: Identify edge cases and vulnerabilities by injecting invalid data to uncover defects.  Mutation Testing: Analyze smart contract behavior by deliberately introducing small changes.  Property-Based Testing: Specify desired properties and automatically generate test cases .  Runtime Verification (RV): Continuously monitor smart contract execution for anomalies.  Security Audits: Meticulous analysis of smart contracts to detect exploits and gas optimization opportunities.  Concurrency Testing Tools: Simulate real-world usage patterns to gauge performance under scalability demands. Innovative Testing Methodologies
  • 12. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 dApp Testing: Ensuring a Seamless User Experience Best Practices for dApp Testing:  Start early: Integrate testing throughout the development process, not just at the end.  Automate as much as possible: Automate repetitive tasks to save time and resources.  Use a combination of testing methods: Don't rely on a single technique for comprehensive testing.  Use the right tools: Choose tools specifically designed for dApp testing.  Focus on user needs: prioritize testing functionalities that impact the user experience. Benefits:  Reduced Costs: Early bug detection and automated testing significantly reduce costs.  Enhanced Security: Comprehensive security testing mitigates vulnerabilities & minimizes the risk.  Improved Scalability: Performance testing ensures the dApp can handle increasing user loads..  Elevated User Satisfaction: increased engagement, higher user retention, and a thriving dApp community.  Competitive Advantage: A consistently refined and improved dApp stands out in the marketplace.
  • 13. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023  Transaction Speed and Latency: Measures time taken for transactions to be processed and confirmed.  Resource Consumption: Memory and CPU usage by nodes, impacting scalability and cost  Network Throughput: Number of transactions processed per second.  Smart Contract Performance: Gas consumption and execution time of smart contracts.  Node Availability and Uptime: Ensures network stability and continuous operation.  Security Incidents and Vulnerabilities: Measures effectiveness of security controls and proactive risk mitigation.  User Adoption and Engagement: Measures the level of dApp usage and user satisfaction.  Block Time: Time interval between consecutive blocks added to the chain Key Performance Indices
  • 14. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 Thank You
  • 15. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 5: Consensus Algorithm Testing: Effectiveness and Resilience Building Trust: Validating the Backbone of Blockchain • QBFT / IGFT / Byzantine Fault Tolerance (BFT): Testing consensus algorithms like Proof-of- Work and Proof-of-Stake for their ability to reach agreement despite malicious actors. • Fork Resilience: Evaluating the system's ability to recover from accidental or intentional network forks. • Incentive Mechanisms: Assessing the effectiveness of economic incentives in maintaining network stability and participation.
  • 16. G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 6. Onchain vs Offchain Content Testing: Seamless Integration Bridging the Gap: Seamless Communication and Data Exchange • Data Availability: Verifying that onchain references point to readily available offchain data. • Oracle Integration: Testing the accuracy and reliability of oracles that bridge onchain and offchain data. • Storage Optimization: Evaluating the cost-effectiveness of storing data onchain versus leveraging offchain storage solutions..

Editor's Notes

  1. capturing the essence of the evolving quality assurance landscape from centralized to decentralized systems. Blockchain and Web3.0 technologies necessitate a paradigm shift in testing methodologies, demanding innovative approaches to ensure quality and security
  2. Brownie, Web3 & Locust: A Power Trio for Large-scale Efficiency Brownie: Streamlines smart contract development, testing, and deployment.  Python-based framework for writing, testing, and deploying smart contracts. Web3: Connects Python test scripts to the Blockchain network seamlessly. JavaScript library for interacting with Ethereum nodes and dApps. Concurrency Testing / Locust: Enables scalable load testing to simulate real-world user traffic. Scalable performance testing framework for simulating user behavior and measuring response times. Speaker Notes This slide introduces a hybrid automation framework that leverages Brownie, Web3, and Locust modules. This powerful combination facilitates writing automated tests, interacting with the Blockchain network, and performing large-scale load testing, leading to faster development cycles and bug-free deployments. This slide introduces a powerful hybrid automation framework that leverages the strengths of Brownie, Web3, and Locust. Brownie facilitates smart contract development and testing, while Web3 enables interaction with the Ethereum network. Locust injects simulated user traffic, allowing developers to measure system performance and identify bottlenecks at scale. This combination promotes large-scale efficiencies and bug-free deployments in Blockchain projects
  3. Fuzz testing is a dynamic software testing technique that involves feeding invalid, unexpected, or malformed inputs into a system to identify vulnerabilities and crashes. It is a powerful tool for uncovering software defects that may not be found through traditional testing methods. Tools and Techniques: Mutation-based: AFL, LibFuzzer Generation-based: Peach Fuzzer, Radamsa Dictionary-based: Sulley, FuzzDB Other: Symbolic execution, Greybox fuzzing Mutation testing intentionally changes smart contract code to reveal hidden defects. This boosts test coverage, finds subtle bugs, and ultimately enhances security. Tools: SuMo (Solidity): Specifically designed for Solidity smart contracts. RegularMutator (Solidity): Offers advanced mutation operators. Deviant (general blockchain): Supports multiple blockchain platforms. Mythril (symbolic execution and mutation): Combines two powerful techniques. Remix (plugins for Ethereum): Provides a user-friendly interface. Property-based testing (PBT) revolutionizes blockchain and smart contract testing. Instead of writing individual test cases, developers define desired behaviors as properties. These properties represent the essential truths the code should uphold, regardless of input data. The testing framework then automatically generates diverse and exhaustive test cases based on these properties Available Tools: Echidna (Solidity): Popular framework specifically designed for Solidity smart contracts. Propertarium (general blockchain): Supports multiple platforms and offers diverse testing strategies. QuickCheck (general testing): Versatile framework adaptable to various languages and domains, including blockchain. Mythril (symbolic execution + PBT): Combines both techniques for enhanced testing capabilities Runtime Verification (RV) continuously monitors smart contracts during execution, safeguarding their security and reliability. By observing state changes and verifying against predefined specifications, RV detects vulnerabilities, catches errors, and offers transparency into contract behavior.
  4. Speaker Notes This slide focuses on testing the critical aspects of dApps: functionality, performance, and security. Functionality testing ensures features work as expected, performance testing evaluates speed and scalability, and security testing proactively identifies and mitigates potential risks, ultimately delivering a reliable and secure user experience This slide focuses on the critical aspects of testing dApps. Functional Testing ensures that the application behaves as intended, while Performance Testing guarantees smooth user experience and scalability. Security Testing is paramount in identifying and mitigating potential vulnerabilities that could compromise user funds or disrupt network operations
  5. Speaker Notes This slide focuses on key performance indicators (KPIs) crucial for private permissioned Blockchain testing in an enterprise setting. It visually represents each KPI with downloadable images and provides concise descriptions, highlighting their importance in measuring transaction speed, network performance, resource consumption, smart contract efficiency, security posture, data integrity, user adoption, and financial returns. By monitoring these KPIs and analyzing trends, enterprises can optimize their Blockchain deployments, ensure business objectives are met, and pave the way for a successful transition to decentralized technologies.
  6. Speaker Notes This slide dives into consensus algorithms, the bedrock of trust and immutability in Blockchain systems. Testing Byzantine Fault Tolerance, Proof-of-Stake, and Proof-of-Work algorithms ensures the network can withstand malicious attacks, maintain consensus, and operate reliably under various conditions. This slide highlights the crucial role of consensus algorithms in Blockchain systems and the importance of rigorous testing to ensure their effectiveness and resilience. BFT testing verifies the algorithm's ability to reach consensus even under malicious attacks. Fork Resilience testing assesses the system's ability to recover from network splits and maintain data consistency. Additionally, testing incentive mechanisms ensures that economic rewards adequately motivate miners or validators to maintain network integrity and stability.
  7. Speaker Notes This slide delves into the complexities of onchain and offchain content testing in Blockchain applications. Data Availability ensures that onchain references correspond to accessible offchain data, preventing broken links and invalid information. Oracle Integration testing verifies the accuracy and timeliness of data fetched from external sources through oracles. Storage Optimization involves balancing the cost and accessibility of storing data onchain versus utilizing offchain storage solutions. This slide addresses the crucial aspect of onchain and offchain content testing. Blockchain systems often integrate with external data and applications. This slide emphasizes the importance of verifying data integrity, oracle and API functionality, and ensuring seamless communication protocols between onchain and offchain components.