• Like
Extreme Automation: Software Quality for the Next Generation Enterprise
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Extreme Automation: Software Quality for the Next Generation Enterprise

  • 112 views
Published

Software runs the business. The modern testing organization aspires to be a change agent and an inspiration for quality throughout the entire lifecycle. To be a change agent, the testing organization …

Software runs the business. The modern testing organization aspires to be a change agent and an inspiration for quality throughout the entire lifecycle. To be a change agent, the testing organization must have the right people and skill sets, the right processes in place to ensure proper governance, and the right technology to aid in the delivery of software in support of the business line. Traditionally, testing organizations have focused on the people and process aspect of solving quality issues. With the ever-increasing complexity of the software needed to run the enterprise, testing professionals must adopt technology to help solve some of the most challenging quality issues ever. In short, testing organizations must make the move to extreme automation and become proficient with modern tooling and its benefits. Theresa Lanowitz focuses on new and emerging technologies—proven and successful—to add to the workbench of the test professional.

Published in Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
112
On SlideShare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
11
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. K4 Keynote 5/8/2014 8:30:00 AM Extreme Automation: Software Quality for the Next Generation Enterprise Presented by: Theresa Lanowitz voke, inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Theresa Lanowitz voke, inc. Founder of voke, inc. Theresa Lanowitz is recognized as a strategic thinker in the application lifecycle, virtualization, cloud computing, and convergence markets. From 1999–2006 Theresa was a research analyst with Gartner where she pioneered the application quality ecosystem, championed the application security space, and identified new and emerging companies to watch. At Gartner, she was the founder and chairperson of the highly successful Application Development conference. Theresa’s professional career began with McDonnell Douglas where she worked on the C-17 transport plane. At Borland Software, Theresa shipped the Java development tool JBuilder. At Sun Microsystems, she was responsible for the strategic marketing of the Jini project.
  • 3. 4/29/2014 1 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Software Quality for the Next Generation Enterprise Theresa Lanowitz, voke Founder STAREAST | Orlando, FL | 8 May, 2014 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Agenda • About voke • Global Trends • Next Generation Enterprise • Extreme Automation - Lifecycle Virtualization - Development Testing - Mobility • Embracing Extreme Automation • Net/Net
  • 4. 4/29/2014 2 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏About voke © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ About voke • Independent industry analyst firm • Founded in 2006 by Theresa Lanowitz • Firm focuses on the application lifecycle and its transformation including virtualization, cloud computing, embedded systems, mobile and device software • Provides strategic, independent, and impartial advice and market observations through quantitative and qualitative research
  • 5. 4/29/2014 3 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Global Trends © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Current Reality
  • 6. 4/29/2014 4 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Goldman Sachs – August 20, 2013 An internal system that Goldman Sachs uses to help prepare in meeting market demand for equity options inadvertently produced orders with inaccurate price limits and sent them to exchanges. Goldman Sachs placed four senior technology specialists on administrative leave after a programming error caused the investment bank to send faulty stock-options orders. © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ NASDAQ – August 22, 2013 A “computer malfunction” froze thousands of securities listed on the Nasdaq Stock Market for three hours. Many of the country’s most-traded shares ground to a standstill as brokers were unable to execute orders.
  • 7. 4/29/2014 5 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Standard & Poor’s Warning – September 20, 2013 A rash of electronic breakdowns could trigger cuts in credit ratings for stock exchanges, warns ratings agency Standard & Poor’s. The ratings agency expects exchanges to maintain enough liquid capital to cover unexpected losses caused by electronic disruptions. © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ More Software Failures Daily
  • 8. 4/29/2014 6 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Why Are Software Failures Making Headlines? • Economy - Lack of investment during Global Financial Crisis (GFC) • Faster, faster, faster - Faster is not equal to better • Old technology - Most organizations are not up to date on current software platforms - Most organizations are not leveraging the power of modern solutions © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. YouTube reported a peak of more than 8 million concurrent livestreams of Felix Baumgartner’s 24-mile/38.6 km fall to Earth. ◉ Red Bull Stratos & YouTube – October 14, 2012
  • 9. 4/29/2014 7 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Next Generation Enterprise © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
  • 10. 4/29/2014 8 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
  • 11. 4/29/2014 9 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Parity – A Basic Requirement © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Testing Roadmap – Critical for Business Success Chaos Establish Testing Role Dev and Testing Parity IT & Business Alignment Change Agent
  • 12. 4/29/2014 10 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Next Generation Enterprise © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Extreme Automation
  • 13. 4/29/2014 11 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. The concept of leveraging modern tools to break through barriers and overcome historic challenges to mitigate risk and manage complexity throughout the software supply chain. Source: voke – February 2014 ◉ Extreme Automation – Definition © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Factors Driving Extreme Automation Need 1. Composite applications 2. Software supply chain 3. Consumerization of IT 4. Demand for quality 5. Mobile 6. Cloud 7. Competitive business differentiation through software Source: voke – February 2014
  • 14. 4/29/2014 12 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Classic Challenge – Deliver All Three Cost Quality Schedule © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ People, Process, Technology – Building Blocks People Process Technology • Internal skills • Trusted partners and providers • Customer advocate • Relationship manager • Process designation • Communication • Collaboration • Optimized • Testing platform ?
  • 15. 4/29/2014 13 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Minimize Risk – Move to Extreme Automation How Development Ensures Working Software Technology Companies Enterprise Companies Continuous Integration 61% 47% Code reviews 60% 64% Automated unit tests 63% 38% Manual unit tests 46% 56% Automated functional testing 51% 40% Manual functional testing 59% 64% Performance testing 58% 42% Source code analysis tools used 29% 11% Code refactoring 39% 20% Database refactoring 20% 9% Design patterns 21% 16% Domain-driven design 14% 4% Source: voke Market SnapshotTM Report: Agile Realities – July 11, 2012 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Lifecycle Virtualization
  • 16. 4/29/2014 14 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Server Desktop Lifecycle (Service and Lab) Market Adoption Phase Mature Trending Evolving Technology Phase Stable and full featured Stable with emerging features Stable and evolving Primary Users Data center Service center Dev, test, and operations Vendors VMware, Microsoft, Citrix Citrix, Microsoft, VMware CA, HP, IBM, Microsoft, Parasoft, Skytap, Tricentis ◉ Evolution of Virtualization © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Service Virtualization – Enabling development and test teams to simulate and model their dependencies of unavailable or limited services. Removes constraints and wait times frequently experienced by development and test teams to access components, architectures, databases, mainframes, etc. Source: voke Market SnapshotTM Report: Service Virtualization – December 2012 Virtual Lab Management – The creation of a virtual instance of a physical environment to enable anyone to access a virtual equivalent of any environment on demand at any time without the need to wait for a physical machine set-up or additional hardware. Source: voke Market SnapshotTM Report: Virtual Lab Management – March 2010 ◉ Lifecycle Virtualization – Definitions
  • 17. 4/29/2014 15 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Access to Required Systems 33 Average number of systems needed for dev or test 18 Average number of systems with unrestricted access for dev or test Source: voke Market SnapshotTM Report: Service Virtualization – December 2012 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Lab Access – Wait Time 96% Wait for access Wait Time to Access Lab Participant Percentages None – immediate access 4% 1 hour or less 7% 2-4 hours 14% 5-8 hours 11% 2-4 days 38% 1 week 11% 2-4 weeks 14% 10 weeks 1% Source: voke Market SnapshotTM Report: Service Virtualization – December 2012
  • 18. 4/29/2014 16 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Lab Access – Restrictions 69% Time restrictions Lab Access Restrictions Participant Percentages 4 hours or less 31% 5-7 hours 6% 1-2 days 22% 1 week 6% 4-6 weeks 4% No restrictions 31% Source: voke Market SnapshotTM Report: Service Virtualization – December 2012 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Category Metric Reduced Wait Times 64% -achieved a 50% – 100% reduction in wait time Greater Availability of Services 75% - achieved a 50% or greater increase in availability of services Decreased Software Cycles 55% - achieved a 25% - 50% reduction in overall software cycle Increased Test Coverage 59% - achieved 50% - 90% increase in test coverage Shorter Test Cycle Times Average 58% decrease in test cycle length Improved Time-to-Market Average 24% faster time-to-market Fewer Production Defects Average 22% reduction of production defects Source: voke Market SnapshotTM Report: Service Virtualization – December 2012 ◉ ROI Service Virtualization – Summary
  • 19. 4/29/2014 17 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Development Testing © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Development Testing – Definition Complement traditional blackbox functional testing. Transform the software testing activity from reactive to proactive by moving testing upstream to identify and remediate defects earlier in the lifecycle. Source: voke – February 2014
  • 20. 4/29/2014 18 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Development Testing – Overview Primary User Tool Types Function Vendors Developers Static code analysis Defect prevention • Memory leaks • Deadlocks • Race conditions Coverity Parasoft Developers Dynamic code analysis Detect dependencies based on system execution Coverity Parasoft Developers Unit testing Smallest testable part of an application to ensure code meets its design and behaves as intended Coverity Microsoft Parasoft Developers QA professionals Application security testing Identify security vulnerabilities through scanning and penetration testing Coverity HP IBM Parasoft Development Managers Policy Management Define consistent coding standards across teams Coverity Parasoft © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Development Testing – Benefits • Test at every phase of the application lifecycle • Collaborate and communicate with development to increase test coverage • Remediate defects earlier in the lifecycle to save time and money • Reduce traditional testing cycle by focusing testing on areas that require more thorough testing (increase code coverage) • Reduce the number of defects entering production
  • 21. 4/29/2014 19 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏Mobility © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Evolution of Complexity – Testing Challenges Mainframe Client/Server Web Mobile Complexity
  • 22. 4/29/2014 20 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Pillars of Testing – Adding Mobile Does it work? Does it perform? Is it secure? Functional Performance Security Load Stress Endurance Networks Platforms Requirements Manual Regression Exploratory Networks Platforms UserExperience Scans Penetration StaticAnalysis Device Data Compliance = Additive for mobile Infrastructure © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Mobile Apps – Best Practices • Mobile testing IS application testing • Extend enterprise best practices to incorporate mobile uniqueness - Gestures - Location • Leverage existing skills in QA - Platform tooling - Automation - Performance - Security • Include new team members with specific mobile skills - Hardware - Infrastructure - OS - Networking
  • 23. 4/29/2014 21 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏ Embracing Extreme Automation © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Extreme Automation – Benefits • Goal – Extreme Automation • Automation is critical - Traditional applications - Mobile • Reduces risk associated with multi-platform delivery - Mobile demand • Reduces overall software cycle time • Increases code coverage • Assists in managing the dynamic nature of mobility • Enhances visibility into the software supply chain and reduces risk • Enhances communication and collaboration throughout the entire lifecycle
  • 24. 4/29/2014 22 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Extreme Automation – Getting There People Process Technology Leverage relationships with vendors Select pilot projects for new technology Get current and stay current on existing tools Leverage relationships with professional service providers Form a CoE for new technology Evaluate new tools offered by current suppliers Update internal skills to focus on achieving extreme automation Leverage a CoE model to go from pilot project to department / enterprise use Explore innovation from other vendors © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Embrace New Technology – Innovate Technology Market Vendor/Product Benefit to Quality Automated Testing • HP Sprinter • Microsoft Visual Studio Test Professional • Tricentis Tosca Testsuite • Dynamic creation of test cases • Increase testing across platforms Lifecycle Virtualization • CA Lisa • HP Service Virtualization • IBM Rational Test Virtualization Server • Microsoft Visual Studio Lab Manager • Parasoft Virtualize • Skytap • Tricentis Tosca Virtualize • Reduce wait times • Increase availability of services • Reduce defects entering production • Reduce overall software cycle time • Reduce test cycle time • Increase code coverage Development Testing • Coverity Development Testing Platform • Microsoft Visual Studio • Parasoft Development Testing • Prevent defects from leaving development • Increase predictability • Increase visibility across the lifecycle • Increase collaboration Continuous Integration • Electric Cloud Electric Commander • Microsoft Visual Studio • Prevent broken builds from entering QA • Automate build/test/deploy process Requirements • HP Requirements Management • IBM Rational Requisite Pro • Microsoft Visual Studio • Provide a single view across lifecycle • Trace requirements across lifecycle • Prevent requirements defects from entering production Performance • HP Performance Center • IBM Rational Performance Tester • Microsoft Visual Studio • Neotys NeoLoad • Prevent and manage non-functional defects • Retain customer engagement Application Security • Coverity Security Advisor • HP Security Solution • IBM Security AppScan • Parasoft Application Security Solution • Reduce security vulnerabilities from entering production • Manage security risks of applications
  • 25. 4/29/2014 23 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏ Net/Net © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Net/Net • Software and the brand are linked • Testing organization is a customer advocate and brand protector • Embrace people, process, AND technology • Deliver on extreme automation - Reduce the risk of failure in production • Lifecycle virtualization is real and proven - Increase time-to-market - Reduce defects entering production - Reduce software cycle - Reduce test cycle time - Increase test coverage • Move testing upstream with development testing - Increase code coverage • Mobile testing IS application testing - Identify YOUR mobile strategy
  • 26. 4/29/2014 24 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ Learn More at www.vokeinc.com • Become a Research client at www.vokeinc.com - voke Market Snapshot: Service Virtualization - voke Category Snapshot: Lifecycle Virtualization - voke Market Snapshot: Virtual Lab Management - voke Market Snapshot: Agile Realities - voke Strategic Brief: Cost of Rework - voke Market Mover Array: Testing Platforms - voke Market Mover Array: Application Lifecycle Management • Follow voke on Twitter: @vokeinc • Take our surveys © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Thank You!!!
  • 27. 4/29/2014 25 © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ๏ Q&A © 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. ◉ voke Contact voke, inc. 2248 Meridian Boulevard Suite H Minden, NV 89423 P: +1.866.895.9045 W: www.vokeinc.com T: @vokeinc