University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Roger Snook, RCSnook@us.ibm.com +1.703.943.1170
WorldWide DevOps for Mobile and Hybrid Cloud Enablement Lead
On completion you will be able to:
 Understand the mobile application development marketplace
and challenges
 Get an overview of a DevOps approach and learn to
accelerate these DevOps practices:
– STEER: direct your application based on continuous feedback
from testers and users
– DEVELOP: integrate feedback directly into your development process
and use existing services or mobile apps to finish faster
– TEST: apply efficient manual testing approaches and explore test
automation where it counts
– DEPLOY: leverage hybrid cloud to address your agile and enterprise
services delivery
Cloud Software
Operate Develop/
Test
Deploy
Steer
DevOps
Continuous
Feedback

2
(B2C)

Mobile continues to explode in the enterprise (B2E)
2014 2016 2018
(2014) 60% of
large companies
used 3 or fewer
mobile apps1
The number of
custom mobile
apps will double
compared to 20142
The number of
enterprise mobile
apps is expected
to quadruple3
More than half
of b2e apps will
be created by
the enterprise6
85% of companies
have a mobile
backlog of up
to 20 app4
Mobile app
development will
out number PC
projects 4:15

Systems of Engagement
Systems of Record
Cloud
Develop Test Release
Rapid deployments
Transactional systems or packaged apps
Production
Environment
AppStore
IntegrationDevelop Test
Frequent deployments
Few deployments
Release
Challenge: User Experience goes beyond just a User Interface
85% expect the mobile
experience to be better
than using a laptop or
desktop
100% of mobile teams use
agile methods.
90% of Mobile apps
are dependent on
enterprise or cloud
services and their
development teams

Dev/Tester Ops teamVP/Dir App DevLOB/Marketing
I need to
Accelerate
delivery of our
mobile/cloud apps
I need
infrastructure to
Develop new
capabilities,
Build/run/manage
mobile apps
I need Workable
dev/test
environments and
Real time feedback
on mobile/cloud
apps
I don’t have
Skills or
resources to
stand-up a
mobile
infrastructure.
Challenge: How do you balance speed with quality while making apps?
>45% of
customers
>60% drop
in downloads
>70% of budgets4-6 weeks
experience
production
delays
when rating on an
app moves from
4.7 to 4.3
Devoted to
maintenance
and operations
to deliver even
minor
application
changes to
customers

IBM DevOps Point of View
Enterprise capability for continuous software delivery that enables organizations
to seize market opportunities and reduce time to customer feedback
Accelerate
software delivery –
for faster time to value
Reduce time to customer
feedback –
for improved customer
experience
Continuous
Customer
Feedback &
Optimization
Collaborative
Development
Continuous Release
and Deployment
Continuous
Monitoring
Continuous
Business Planning
Continuous
Testing
Balance speed, cost,
quality and risk –
for increased capacity
to innovate
Operate Develop/
Test
Deploy
Steer
DevOps
Continuous
Feedback

Successful Projects require these three elements:
• Process – the success “recipe”
• Agile
• DevOps
• People (Right skills: developers, testers,
operational experience, LOB/Marketing)
• Tools – to accelerate
the process with…
Operate Develop/
Test
Deploy
Steer
DevOps
Continuous
Feedback

Tools: IBM Delivers Value/ROI in these two areas:
Buy Ready-Made* Software
Components, Apps,
Services, Runtimes
*Ready-Made = Time to design, develop, AND Test
Automate (manual)
Processes
Operate Develop/
Test
Deploy
Steer
DevOps
Continuous
Feedback

15 minutes
PER BUG
REPORT:
savings adds
up quickly!
(ALL software has bugs – since 1947)
Bug, Feedback Reporting has come a long way!

http://Ibm.biz/mobilequalitycloud 10
IBM Mobile Quality Assurance for Bluemix
IBM MobileFirst Platform Quality Assurance
Focus: In-app bug and feedback reporting

Quickly report data-rich bugs saving you 10-15 minutes of
data entry, then transition those into your Sprints
Report the bug from the app experience Bugs/Crashes appears in your work queue

Voice of the Customer: Tangerine Bank’s value with MQA
YouTube Video

Collect/Assess your feedback before it goes public or
simply continuously offer feedback to Steer your apps
Capture feedback in the app experience Assess Feedback

No matter how much you test your mobile app,
your users will have an opinion
To Steer: you need to know!

Discover what’s trending with top review clusters

Compare your app against your competitors

http://Ibm.biz/mobilequalitycloud 17
IBM Mobile Quality Assurance for Bluemix
IBM MobileFirst Platform Quality Assurance
Focus: User Sentiment Analysis

MQA: On-Premise or SaaS: The choice is yours
IBM MobileFirst Platform
IBM Bluemix
Mobile Quality Assurance
SaaS
On-PremiseQuality
Assurance

IBM DevOps for Mobile offerings
Continuously Deliver High Quality Mobile Apps, Rapidly Respond to Feedback
MobileFirst Platform, Bluemix
– Other on-premise IDEs (RAD/RSA/RDz/RDPower), HATS
DevOps Services/Bluemix (or on premise RTC, CLM)
– Agile process support for mobile teams, task tracking
Rational Quality Manager
– Collaborate on Test Plans, Cases, Execution
Rational Test Workbench
– Mobile app UI testing, Performance Testing
Rational Test Virtualization Server
– Virtualize backend systems for mobile apps
“MQA” MobileFirst Quality Assurance
UrbanCode Deploy - Automate mobile app deployments
Collaborative Development
Continuous Release and Deployment
Continuous Testing
Operate Develop/
Test
Deploy
Steer
DevOps
Continuous
Feedback

Sprint1:
Hello World
• Coding-focused
• Native SDK (iOS,
Android), single platform
focus
• Single or paired
developers, no defined
team collaboration
• Solo Manual testing
• Stakeholder focused UX
design, Visual Design
Sprint 2:
Hello DevOps
• Tactical developer
productivity gains with
Automated Deployment
pipeline (UrbanCode)
• Code-centric testing, unit
testing (Selenium et al)
• Streamlined bug reporting
for manual testing “in the
wild” (MQA)
• Multiplatform focus for
developer productivity
(MobileFirst formerly
Worklight)
Sprint 3:
Team Sport
• Developer to
Professional Tester
transition to Automated
UI Testing (RTW MTE)
• Collaborative Quality
Control (RQM)
• Agile planning, Team-
centric work item
tracking, integrated,
change/design
Management (DevOps
Services/RTC/RSA
Design Manager)
•Minimize appstore risks
with Performance and
Virtualization Testing
(RTW)
•Engage user feedback,
Application Quality
Feedback and Analytics
(MQA)
•Secure Services and App
(AppScan)
Manual, slow, error prone,
fragmented, app quality concerns
Automated, repeatable,
accurate, integrated.
Sprint 5:
Enterprise DevOps
•Enterprise Developer
integration ((DevOps
Services/RTC, Enterprise
IDEs: RDz, RDPower,
HATS)
•Customer Experience
Management, Application
Usage Analytics
(TeaLeaf)
•Integrated Campaign
Management (Xtify)
Enterprise-Class DevOps for Mobile Application Development
Example of a DevOps Transformation from Developer-focused to Enterprise-focused
Continuous Release and DeploymentContinuous Testing
Repeatable
Practiced
Collaborative Development
Reliable
Scaled
Sprint 4:
AppStore

Mobile App Challenge: Balancing Speed & Quality
There’s just never enough time to test “everything”!
Goals
Test Cases
Frequency
Methodology
Basic acceptance, build
acceptance
Functional testing
across all existing areas
of product
Compatibility across
devices
Very high value to
automate!
High value to
automate
Medium value to
automate
# of Devices
Optimal Test
Strategy
Automated Testing Automated Testing Manual or Automated
Testing
Smoke
Testing
Regression
Testing
Compatibility
Testing
Deep testing of new
areas of
functionality
Low value to
automate
Manual Testing
New Feature
Testing
Not automated
Exploratory
Testing
Exploration of functionality
from customer viewpoint
Manual Testing

Optimal Test
Strategy
Automated
Testing
Automated
Testing
Manual or
Automated Testing
Manual Testing Manual Testing
Accelerating Testing Strategy with “FURPS”
Tools Smoke
Testing
Regression
Testing
Compatibility
Testing
New Feature
Testing
Exploratory
Testing
Tooling Simple, Rapid
Record/Playback
(ongoing
verification) with
Rational Test
Workbench
(Mobile Test
Edition)
Report results into
Rational Quality
Manager
Functional
regression
test:
Rational Test
Workbench
Mobile Test
Edition
Performance
or
Virtualization
testing with
full Rational
Test
Workbench
Rational Test
Workbench with
Keynote Device
Anywhere
Streamline
bug reporting
– in-app bug
reporting with:
Mobile
Quality
Assurance
(MQA)
Manage
overall test
plans with
Rational
Quality
Manager
Streamline bug
reporting – in-app
bug reporting OR
in-app user
feedback OR
support A/B
testing or “dark
launch” testing
with over-the-air
distribution of:
Mobile Quality
Assurance (MQA)

University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

More Related Content

What's hot

Viewers also liked

Similar to University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

More from Roger Snook

Recently uploaded

University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud