How to Achieve and Maintain HighQuality SaaS Software in the Cloud Lessons learned and best practices on how to set up tes...
Agenda• Fire side chat  – Introduction of the speakers  – Conversation between QA experts  – Q & A at the end
Howard GoldsteinVP of Marketing BlackLine Systems           • Built BlackLine’s marketing program             from the gro...
Donna McCollumQA Manager BlackLine Systems          • Managed BlackLine’s Quality            Assurance program for four ye...
Philip LewCEO and Founder XBOSoft         • Leads XBOSoft’s direction and           strategy as their CEO.         • Ph.D....
Housekeeping• The audience will be on mute for a clear conversation• Feel free to ask questions at anytime via the chat ba...
BlackLine Company overviewLA-based financial software provider, operatinggloballyFirst to market with automated accountrec...
GLOBAL    DEPLOYMENTBlackLine OnDemand users(89+ COUNTRIES)BlackLine Offices
BLACKLINE CLIENTS (PARTIAL)
•SIMPLE, SECURE ONDEMAND/SAAS OFFERING•REAL-TIME MONITORING AND REPORTING•CONTROLLED PROCESS•DATA INTEGRITY & INTEGRATION
BLACKLINE PROVIDESEFFICIENCY, SPEED & VISIBILITYREDUCED COSTS AND RISKSCONTROLLED FINANCIAL CLOSE
ROI & CUTTING COSTS• Auto-certification                           MeadWestVaco Corporation• Increased staff          ROI: ...
Regression Testing         Image from: http://www.testfacebook.com
Regression Testing Key Points• Impossible to test everything so implement  regression strategy based on context• Use Risk ...
Performance
Performance Key Points• Understand your users so you can develop  realistic performance scenario’s• Benchmark and Improve•...
Test Automation       Image from simply-the-test.blogspot.com
Key Points• What to automate depends on maturity of the  product and stability of modules and features• Team is more impor...
Best Practices & Lessons Learned• Daily Build’s• Goal 100% coverage, Risk Assessment when that’s not feasible.• Fast and a...
Q&A
Contact infoInformation on where to find the slides and therecording will be mailed.Please follow us on twitter @xbosoftRe...
THANK YOU!www.XBOSoft.comwww.blackline.com
How to Achieve and Maintain High Quality SaaS Software in the Cloud
How to Achieve and Maintain High Quality SaaS Software in the Cloud
How to Achieve and Maintain High Quality SaaS Software in the Cloud
Upcoming SlideShare
Loading in …5
×

How to Achieve and Maintain High Quality SaaS Software in the Cloud

1,105 views

Published on

These are the slide from a webinar that we did together with BlackLine Systems on August 8 2012.

During this webinar, Donna McCollum from Blackline Systems and Philip Lew from XBOSoft discussed lessons learned and best practices on how to set up test automation and performance testing for cloud software that is delivered with a SaaS model.

Key words:
Test Automation, Performance Testing, QA in the cloud, and QA for SaaS models.

Features:

• Learn best practices for QA, and performance, and automation testing for SaaS software
• Hear about particular QA issues for managing financial SaaS software in the cloud
• Understand the QA and testing strategies BlackLine Systems and XBOSoft implements to alleviate these issues

For a recording of this webinar, please visit:
http://blog.xbosoft.com/2012/08/09/performance-testing-and-test-automation-best-practices/


Key words:
Test Automation, Performance Testing, QA in the cloud, and QA for SaaS models.

Features:
• Learn best practices for quality assurance and performance and automation testing for SaaS software
• Hear about particular QA issues for managing financial SaaS software in the cloud
• Understand the QA and testing strategies BlackLine implements to alleviate these issues

For a recording of this webinar, please visit:
http://blog.xbosoft.com/2012/08/09/performance-testing-and-test-automation-best-practices/

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,105
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • This screen stays on while people wait for the webinar
  • If you cannot test all test cases in a test cycle, how do you decide what test cases to run?What percentage of test cases do you run to get good regression coverage?How much time / resources do you dedicated to exploratory testing in your regression tests?How do you track defects from regression tests?Is performance testing part of regression testing?
  • How important is performance for your product?What performance issues are typical for a SaaS product?How often do you run performance tests?
  • What tools do you use to automate?What percentage of QA resources do you devote to test automation?What percentage of your regression tests do
  • Testing on multiple devices, platforms and browsersDedicated QA, remote QA team, yet an integrated QA team
  • How to Achieve and Maintain High Quality SaaS Software in the Cloud

    1. 1. How to Achieve and Maintain HighQuality SaaS Software in the Cloud Lessons learned and best practices on how to set up test automation and performance testing
    2. 2. Agenda• Fire side chat – Introduction of the speakers – Conversation between QA experts – Q & A at the end
    3. 3. Howard GoldsteinVP of Marketing BlackLine Systems • Built BlackLine’s marketing program from the ground up. • Oversaw BlackLine’s expansion internationally into the EMEA and APAC markets. • Developed strategic partner relationships with leading global consulting firms.
    4. 4. Donna McCollumQA Manager BlackLine Systems • Managed BlackLine’s Quality Assurance program for four years. • Served as the key liaison to XBOSoft overseeing functional and regression testing. • Previously was Manager of Financial Technology at industry leader SunGard Treasury Systems. • Developed institutional trading software.
    5. 5. Philip LewCEO and Founder XBOSoft • Leads XBOSoft’s direction and strategy as their CEO. • Ph.D. research in software quality and usability. • Published in several IEEE and ACM journal magazines. • Presenter at various academic and trade conferences. • Industry leader in software quality and measurement.
    6. 6. Housekeeping• The audience will be on mute for a clear conversation• Feel free to ask questions at anytime via the chat bar and we will fit them in where appropriate.• Contact information will be given at the end and you will receive information on where to find the slide and the recording. Let’s get Started!
    7. 7. BlackLine Company overviewLA-based financial software provider, operatinggloballyFirst to market with automated accountreconciliation software475+ clients, many of which are in the Fortune 500More than 58,000 users worldwide ‘BlackLine Certified Implementation Professionals’ from allthe major advisory/consulting firms and all around the world
    8. 8. GLOBAL DEPLOYMENTBlackLine OnDemand users(89+ COUNTRIES)BlackLine Offices
    9. 9. BLACKLINE CLIENTS (PARTIAL)
    10. 10. •SIMPLE, SECURE ONDEMAND/SAAS OFFERING•REAL-TIME MONITORING AND REPORTING•CONTROLLED PROCESS•DATA INTEGRITY & INTEGRATION
    11. 11. BLACKLINE PROVIDESEFFICIENCY, SPEED & VISIBILITYREDUCED COSTS AND RISKSCONTROLLED FINANCIAL CLOSE
    12. 12. ROI & CUTTING COSTS• Auto-certification MeadWestVaco Corporation• Increased staff ROI: 495% Payback: 2 Months productivity Cox Communications• Reduced paper, ROI: 227% Payback: 6 Months printing, storage Education Management Corporation overhead, auditor fees ROI: 138% Payback: 10 Months• Improved process management Return on investment is one of the most important• Faster close indicators of value
    13. 13. Regression Testing Image from: http://www.testfacebook.com
    14. 14. Regression Testing Key Points• Impossible to test everything so implement regression strategy based on context• Use Risk Assessment based on actual data• Exploratory Testing• Defect Analysis
    15. 15. Performance
    16. 16. Performance Key Points• Understand your users so you can develop realistic performance scenario’s• Benchmark and Improve• Periodic Efforts
    17. 17. Test Automation Image from simply-the-test.blogspot.com
    18. 18. Key Points• What to automate depends on maturity of the product and stability of modules and features• Team is more important than the tool• Set up a frame work
    19. 19. Best Practices & Lessons Learned• Daily Build’s• Goal 100% coverage, Risk Assessment when that’s not feasible.• Fast and accurate: Accuracy is of primary importance, but performance is a very close second.• Automation is used where the product is mature and stable.• QTP is used, but the quality of your people and framework of the tests is more important.• The remote XBOSoft QA team and the BlackLine development and support teams work very closely together.• The follow-the-sun workflow works very well.
    20. 20. Q&A
    21. 21. Contact infoInformation on where to find the slides and therecording will be mailed.Please follow us on twitter @xbosoftRequest for info: services@xbosoft.com
    22. 22. THANK YOU!www.XBOSoft.comwww.blackline.com

    ×