The document discusses testing practices at WSO2, an open source middleware company. It describes WSO2's engineering process, which is people-centric and influenced by the Apache way. It also outlines WSO2's agile testing principles and practices for testing SOA middleware, including unit, integration, end-to-end, performance, security, and cloud native testing. WSO2 utilizes a dedicated testing team that designs detailed test plans and executes tests in cycles to find and fix issues.
Building microservices sample applicationAnil Allewar
The slides provide details on how to build the sample Microservices application that covers the whole distributed system paradigm.
Please refer to the introduction to Microservices before following the contents in this slide
https://www.slideshare.net/anilallewar/introduction-to-microservices-78270318
Overview session of Microsoft's Azure Service Fabric Overview (v1.5.175), delivered at AzurePT community event in Lisbon, held March 26. The session describes all the main components of the platform, with a focus on its architecture.
Building microservices sample applicationAnil Allewar
The slides provide details on how to build the sample Microservices application that covers the whole distributed system paradigm.
Please refer to the introduction to Microservices before following the contents in this slide
https://www.slideshare.net/anilallewar/introduction-to-microservices-78270318
Overview session of Microsoft's Azure Service Fabric Overview (v1.5.175), delivered at AzurePT community event in Lisbon, held March 26. The session describes all the main components of the platform, with a focus on its architecture.
Här har ni en presentation om WebSphere Application Server.
Titta närmare på området på dessa länkar: Application Infrastructure (http://www-03.ibm.com/software/products/sv/category/SW600) respektive Connectivity & Integration (http://www-03.ibm.com/software/products/sv/category/SW666).
Azure service fabric for building micro service based applications. Comparison of monolythic application with cloud based micro service application, hosting over cloud containers like docker
IBM WebSphere Application Server Update - Technical University (March 2015)Ian Robinson
IBM WebSphere Application Server Update - presented to the WebSphere Technical University (March 2015) by Ian Robinson, WebSphere Foundation Chief Architect.
An organization's need to serve up web-based applications has changed drastically over the past 16 years and are continuing to change. No other application server in the industry today provides the range of capabilities found in IBM WebSphere Application Server - from rapidly developed and deployed lightweight applications to highly available, highly scaled, continuously available enterprise applications. This session describes the revolution that has occurred to the fastest and most flexible AppServer to run in every cloud, and the direction in which it is going.
Microservices have become a trendy development strategy. Hosting and running such services used to be pretty painful… but here it comes Service Fabric! Let's take a closer look at this platform, it's different development models and all the features it offers. And not only for microservices!
Microservices to Scale using Azure Service FabricMukul Jain
Digital Disruption Age expect our systems to have Agility and Scalability. MicroServices with Azure Service Fabric is helping teams and organisations to be ready for it
Tokyo Azure Meetup #5 - Microservices and Azure Service FabricTokyo Azure Meetup
Azure Service Fabric is now Generally Available!
In this meetup we will start from the beginning and define what is microservice.
Next we will have a deep dive in Azure Service Fabric. Azure Service Fabric is one of the most interesting Azure service. Used internally in Microsoft for 5 years and backing up one of the most demanding Azure services today such as Azure SQL, Document DB, Cortana and Skype for Business.
We will be talking about the two models that are supported by Azure Service Fabric:
- Reliable Services (We will explore the reasons for having both stateful and stateless offerings in this model)
- Reliable Actors
Then we will talk how you can create Azure Service Fabric cluster on premise or in another cloud.
We will demo deployments in Azure for the various models.
Azure Service Fabric is the most advanced and complete offering for developing and hosting microservices in Azure. It builds on years experience Microsoft acquired running one of the most demanding services such as Azure SQL. Moreover, Azure Service Fabric solves very difficult distributed computing problems such as data synchronization, zero downtime deployment, update and rollback operations at large scale.
Join us to learn more about Azure Service Fabric and start using it immediately after the meetup!
Please use the below URL to view webinar recording.
http://wso2.com/library/webinars/2015/01/understanding-the-wso2-platform/
In this webinar, attendees will understand
Capabilities of the platform
Why a unified platform leads to faster and more cost-effective implementation
How other organizations have benefited from the WSO2 platform
Jakarta EE und Microprofile sind bei Azure zu HauseEdward Burns
Jakarta/Java EE is an important technology to support on Azure. Enterprise Java is a heterogenous ecosystem with as much as a third of workloads still running on Jakarta EE application servers such as WebLogic, WebSphere/Open Liberty, JBoss EAP, WildFly, and Payara. This is particularly true for large enterprises that need to lift and shift their existing mission-critical, largely monolithic applications to Azure. Traditionally, Azure has not focused on strong support for such workloads but that is changing now and going forward.
This session will outline the efforts to better support Jakarta EE workloads on Azure. We will touch on the history of the open-standard enterprise Java movement and why open standards are and remain important to enterprises. We will discuss what is possible now, what is coming soon and what is further afield. This includes services, tools and guidance to better support Jakarta EE users opting for virtual machines, Kubernetes, or PaaS. It also includes integration with Azure services such as the Azure Service Bus through Jakarta EE APIs such as JMS.
Azure is a great place for all your Java. Microsoft Java experts lead a grand tour of Java on Azure. Learn how to reach cloud-scale with cloud-native innovation for enterprise Java applications.
Java on Your Terms with Azure
How to go beyond traditional Scrum principles and scale to globally distributed teams with Continuous Delivery and Subversion. Presented by Andy Singleton of Assembla and Scott Rudenstein of WANdisco. Presented Nov. 15, 2012. 30 minutes.
Här har ni en presentation om WebSphere Application Server.
Titta närmare på området på dessa länkar: Application Infrastructure (http://www-03.ibm.com/software/products/sv/category/SW600) respektive Connectivity & Integration (http://www-03.ibm.com/software/products/sv/category/SW666).
Azure service fabric for building micro service based applications. Comparison of monolythic application with cloud based micro service application, hosting over cloud containers like docker
IBM WebSphere Application Server Update - Technical University (March 2015)Ian Robinson
IBM WebSphere Application Server Update - presented to the WebSphere Technical University (March 2015) by Ian Robinson, WebSphere Foundation Chief Architect.
An organization's need to serve up web-based applications has changed drastically over the past 16 years and are continuing to change. No other application server in the industry today provides the range of capabilities found in IBM WebSphere Application Server - from rapidly developed and deployed lightweight applications to highly available, highly scaled, continuously available enterprise applications. This session describes the revolution that has occurred to the fastest and most flexible AppServer to run in every cloud, and the direction in which it is going.
Microservices have become a trendy development strategy. Hosting and running such services used to be pretty painful… but here it comes Service Fabric! Let's take a closer look at this platform, it's different development models and all the features it offers. And not only for microservices!
Microservices to Scale using Azure Service FabricMukul Jain
Digital Disruption Age expect our systems to have Agility and Scalability. MicroServices with Azure Service Fabric is helping teams and organisations to be ready for it
Tokyo Azure Meetup #5 - Microservices and Azure Service FabricTokyo Azure Meetup
Azure Service Fabric is now Generally Available!
In this meetup we will start from the beginning and define what is microservice.
Next we will have a deep dive in Azure Service Fabric. Azure Service Fabric is one of the most interesting Azure service. Used internally in Microsoft for 5 years and backing up one of the most demanding Azure services today such as Azure SQL, Document DB, Cortana and Skype for Business.
We will be talking about the two models that are supported by Azure Service Fabric:
- Reliable Services (We will explore the reasons for having both stateful and stateless offerings in this model)
- Reliable Actors
Then we will talk how you can create Azure Service Fabric cluster on premise or in another cloud.
We will demo deployments in Azure for the various models.
Azure Service Fabric is the most advanced and complete offering for developing and hosting microservices in Azure. It builds on years experience Microsoft acquired running one of the most demanding services such as Azure SQL. Moreover, Azure Service Fabric solves very difficult distributed computing problems such as data synchronization, zero downtime deployment, update and rollback operations at large scale.
Join us to learn more about Azure Service Fabric and start using it immediately after the meetup!
Please use the below URL to view webinar recording.
http://wso2.com/library/webinars/2015/01/understanding-the-wso2-platform/
In this webinar, attendees will understand
Capabilities of the platform
Why a unified platform leads to faster and more cost-effective implementation
How other organizations have benefited from the WSO2 platform
Jakarta EE und Microprofile sind bei Azure zu HauseEdward Burns
Jakarta/Java EE is an important technology to support on Azure. Enterprise Java is a heterogenous ecosystem with as much as a third of workloads still running on Jakarta EE application servers such as WebLogic, WebSphere/Open Liberty, JBoss EAP, WildFly, and Payara. This is particularly true for large enterprises that need to lift and shift their existing mission-critical, largely monolithic applications to Azure. Traditionally, Azure has not focused on strong support for such workloads but that is changing now and going forward.
This session will outline the efforts to better support Jakarta EE workloads on Azure. We will touch on the history of the open-standard enterprise Java movement and why open standards are and remain important to enterprises. We will discuss what is possible now, what is coming soon and what is further afield. This includes services, tools and guidance to better support Jakarta EE users opting for virtual machines, Kubernetes, or PaaS. It also includes integration with Azure services such as the Azure Service Bus through Jakarta EE APIs such as JMS.
Azure is a great place for all your Java. Microsoft Java experts lead a grand tour of Java on Azure. Learn how to reach cloud-scale with cloud-native innovation for enterprise Java applications.
Java on Your Terms with Azure
How to go beyond traditional Scrum principles and scale to globally distributed teams with Continuous Delivery and Subversion. Presented by Andy Singleton of Assembla and Scott Rudenstein of WANdisco. Presented Nov. 15, 2012. 30 minutes.
Agile Open Source Performance Testing Workshop for Business ManagersClever Moe
Use Selenium, soapUI, Sahi, TestMaker Performance Testing In Your Organization. These are slides from a free Webinar titled "The Agile Open Source Way To Load Test, Scalability Test, and Stress Test In Your Organization". Your organization may have adopted Agile Software Development Methodology and forgot about load and performance testing! Learn the Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
"Experiences Of Test Automation At Spotify" with Kristian KarlTEST Huddle
View webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-87-experiences-of-test-automation-at-spotify-
At Spotify, we want the manual testing effort to be focused as much as possible at feature testing, less on regression tests. But we still have to do regression. So, we tried to automate a big chunk of that. Regression tests are run on our Desktop, Android, iOS and WebPlayer clients, and also some backend services.
I will share with you how far we have come. What techniques, tools and methodologies we have tried. What experiences has been good, and what has been not that good.
Neev uses a scrum based Agile Development methodology, a proven Extended Delivery Center model of engagement - all designed to ensure high quality, timely deliverables.
Ashwini Malthankar
Organization: ThoughtWorks
Topic: Effective use of CI by QA
Presented in vodQA - THE TESTING SPIRIT! on Oct 7, 2010 in ThoughtWorks, Pune
CloudTest Lite is the newest member of SOASTA’s growing line of CloudTest editions. It is an enterprise-class offering that enables rapid test creation and real-time resolution for performance testing early and often throughout the development lifecycle. Delivering internal testing behind the firewall on a single server, customers can execute performance tests of up to 100 concurrent virtual users in development, QA, staging or production. With CloudTest Lite, customers can:
- Test Web and mobile applications, including applications using the latest technologies from HTML5 to REST Web services
- Quickly build tests with visual test creation tools
- Integrate application, system, and network monitoring data
- Analyze results in real-time through an interactive, integrated dashboard
- Easily upgrade to a more scalable CloudTest edition to meet expanding testing requirements
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformWSO2
At its core, the challenge of managing Human Resources data is an integration challenge: estimates range from 2-3 HR systems in use at a typical SMB, up to a few dozen systems implemented amongst enterprise HR departments, and these systems seldom integrate seamlessly between themselves. Providing a multi-tenant, cloud-native solution to integrate these hundreds of HR-related systems, normalize their disparate data models and then render that consolidated information for stakeholder decision making has been a substantial undertaking, but one significantly eased by leveraging Ballerina. In this session, we’ll cover:
The overall software architecture for VHR’s Cloud Data Platform
Critical decision points leading to adoption of Ballerina for the CDP
Ballerina’s role in multiple evolutionary steps to the current architecture
Roadmap for the CDP architecture and plans for Ballerina
WSO2’s partnership in bringing continual success for the CD
The integration landscape is changing rapidly with the introduction of technologies like GraphQL, gRPC, stream processing, iPaaS, and platformless. However, not all existing applications and industries can keep up with these new technologies. Certain industries, like manufacturing, logistics, and finance, still rely on well-established EDI-based message formats. Some applications use XML or CSV with file-based communications, while others have strict on premises deployment requirements. This talk focuses on how Ballerina's built-in integration capabilities can bridge the gap between "old" and "new" technologies, modernizing enterprise applications without disrupting business operations.
Platformless Horizons for Digital AdaptabilityWSO2
In this keynote, Asanka Abeysinghe, CTO,WSO2 will explore the shift towards platformless technology ecosystems and their importance in driving digital adaptability and innovation. We will discuss strategies for leveraging decentralized architectures and integrating diverse technologies, with a focus on building resilient, flexible, and future-ready IT infrastructures. We will also highlight WSO2's roadmap, emphasizing our commitment to supporting this transformative journey with our evolving product suite.
Quantum computers are rapidly evolving and are promising significant advantages in domains like machine learning or optimization, to name but a few areas. In this keynote we sketch the underpinnings of quantum computing, show some of the inherent advantages, highlight some application areas, and show how quantum applications are built.
WSO2CON 2024 - Designing Event-Driven Enterprises: Stories of Transformation
Testing in an Open Source Middleware Platform Space The WSO2 Way.
1. Testing in an Open-source Middleware
Platform Space: The WSO2 Way
Iranga Muthuthanthri
Technical Lead -QA
2. About WSO2
• Providing the only complete open source componentized cloud platform
o Dedicated to removing all the stumbling blocks to enterprise agility
o Enabling you to focus on business logic and business value
• Recognized by leading analyst firms as visionaries and leaders
o Gartner cites WSO2 as visionaries in all 3 categories of application infrastructure
o Forrester places WSO2 in top 2 for API Management
• Global corporation with offices in USA, UK & Sri Lanka
o 200+ employees and growing
• Business model of selling comprehensive support & maintenance for our products
4. Agenda
• Engineering process at WSO2.
• Product & Release Management.
• Testing Process at WSO2.
• Patch Verification Process.
5. Testament
The Problem:
• eBay wanted to move away from a home-grown middleware solution to a commercial ESB
• Required very fast response times (< 5ms)
• Benchmarked 10 ESBs
• Including Proprietary, Open Source, Hardware Solutions
• WSO2 was the only ESB to support their performance and manageability requirements
• 2-3x faster than the other software based solutions on eBay’s workload.
The Solution:
• 1.5 billion API calls during peak times (prior to 2011 Holiday season & Black Friday)
• No downtime experienced during 2010 & 2011 holiday peaks!
8. People Centric Process
•
• People centric process.
• User-engineer engagement model.
• Promotes constant communication in push mode give
and receive feedback.
• Build products users actually use and want.
• Get the "buy-in" from engineers to follow the process
instead of pushing down a model.
16. Support Model
•
• No Support Engineers.
• Engineering runs Support.
• SLA is Now!.
• Engineers understand the real usage of their creation.
• Engineers gets to know customers problems and pain.
• Learning hub to understand platform aspects.
Makes the next release cycle "Better".
19. WSO2 Testing Principles
•
• Quality is #1 priority of Engineering practice.
• Engineering owns and is responsible for quality.
• Everyone in Engineering does testing.
• Collaborative Test methodology.
20. Agile Testing Principles
Based on Agile principles
• Test early test often.
• Face to Face communication (Hackathon mode).
• Responsive to change.
• Frequent feedback.
21. SOA-Middleware Testing Challenges
•
• Complexity of testing due to "Headless" state.
• Difficulty in defect isolation.
• Distribution nature of production deployment environments.
• Multiple configuration points for component integrations.
22. SOA Middleware Test Practice
Data Server
Oracle/MySQ
Service L/MSSQL ...
Client
(Browser/ ESB
App)
Registry
Service
Identity
LDAP/AD..
Service
23. Types of Tests
•
• Unit Tests.
• Integration Tests.
• End to End Tests.
• Performance Tests.
• Security Tests.
24. Integration Level Phase
•
• Objective is to validate the integration scenarios of
heterogeneous WSO2 products.
E.g: The ESB - Message Broker integration scenario.
25. End to End Tests
•
• Platform aspects of testing.
• Objective is to validate that the platform provides an
application developer to build and launch the application in an
enterprise context.
E.g:
Authorize a request to a deployed web service in app server
through the entitlement mediator defined in the ESB referring to
the entitlement policy defined at the identity server.
26. Performance Tests
• Performance Tests to Measure:
o Throughput = requests served per second (data rate
/sec).
o Latency = How long each transaction takes ( time
between requests).
27. Reliability Tests
•
• Endurance tests:
o Long running tests : Tests running for a significant
periods of time (days,weeks).
• Volume tests:
o System loaded with incremental # of services, artifacts.
28. Security Tests
Security tests for the following threats are executed.
Threat Types of tests
Spoofing Authentication
Tampering Signature
Privilege Authorization
Information Disclosure Encryption
29. Cloud Testing
Test the Cloud native features for
• Multi Tenancy.
• Elasticity.
• Self Service.
• Billing & Metering.
30. "Dogfood" Tests
•
• Dogfood testing is about using own products for real
usage.
• Internal Patch Management Tool system developed
using WSO2 G-reg product.
• Usage introduced Product enhancements suggested
by Engineers.
32. Team
•
• Recognized as Team of the Year - 2010.
• Technically skilled team.
• 6+ years experienced SOA Testers.
• WSO2 Product experts.
• Apache Committers.
• Authors and reviewers of published books on SOA .
37. Tester...
Phase 1 - Test Planning
• For new products
- prepare detailed test plans for all features.
• For mature products
- add test cases for new features.
E.g.:-
https://docs.google.com/a/wso2.com/spreadsheet/ccc?key=0AvhVRxNoCg0KdHRVMm1pM2x
LUDREajdHRVlQekJRcUE#gid=20
38. Sources for Designing Test Plans
Support Issues
QSPs & Client
engagements POCs
Architecture &
Design Reviews
Samples
Competitive
Products
39. Tester...
Phase 2 - Generate Artifacts
• Create artifacts for each test scenario
- webapps, axis2 services
- synapse configurations
- configurable governance artifacts
- Jmeter scripts (to create APIs, publish, subscribe &
invoke in bulk)
- scripts for endurance testing
E.g.: - https://svn.wso2.org/repos/wso2/trunk/commons/qa/qa-artifacts
40. Tester...
Phase 3 (cycle 1) - Test Execution
• Setup product platforms in test lab
(with clustering/caching/mounting).
• Prioritize & execute selected set of test cases on
platform setups.
• Report all L1s, L2s, L3s, etc (issues related to UI,
features, samples & documentation).
• Update test progress in the test plan.
42. Tester...
Phase 3 (cycle 2) - Test Execution
• Verify all fixed issues in new build.
• Execute test cases and report more issues.
Phase 3 (cycle n) - Test Execution
• Do final round of testing (smoke test) on final RC (Release
Candidate).
• If no more L1s are found, release the product.
43. Automation Engineer...
• Automates
- UI & other features (security, throttling, etc).
- certain platform scenarios.
- volume test scenarios.
- certain performance test scenarios.
44. Automation Engineer...
• Code coverage for some products
Product LOC coverage Class coverage
ESB 38% 66%
G-Reg 46% 65%
DSS 49% 73%
CEP 57% 74%
MB 47% 90%
45. Support Patch Verification Process
Reports JIRA
Customer
Release the patch to the
customer
• Receives the JIRA Private
• Post the first response SVN
Signs the patch if successful
Checkout the patch &
Commits the patch verify the fix
Simulate customer
Support setup in test lab
Engineer
Provides information on Tester
the issue
Add integration tests for the patch
Public
SVN
Developer / Commits the fix for future releases
Automation Engineer