SlideShare a Scribd company logo
Berlin
meetup group
http://bad.tools
@BadToolkit
#badtoolkit
glenn.crossley@thebadtoolkit.com
Welcome Berlin
• BAD Toolkit Overview – feel free to ask Questions
• Q&A – Challenges you are facing
• Networking
About Me… Glenn Crossley
But we all want to be successful…..
All our companies are different
The most successful companies
(Market Leaders) are the ones who are able
to rapidly pivot direction to meet the needs
of the customer.
Each team and individual is loyal to their own ways of working and methodology
So how do you get all these people collaborating?
Business Change Project Manager Architect Development QA ServiceBusiness Analyst
What if your company can't pivot!
End to End Agility – Will allow you to pivot!
Which version of Agile should we implement?
We are a traditional bank
and are risk adverse
We have teams located
across the globe with
different cultures
We are a start-up and
want to share our journey
to success with the world
Certification Frameworks Books & Proprietary Frameworks Everyone is Different
What if there was something that…
• Compliments what
organisations already do well
• Supports incremental agile
adoption
• Free to implement
• Supported by global
community
• Kept up to date by real users
• Is industry agnosticSingle
Toolkit
We are a start-up and
want to share our journey
to success with the world
We have teams located
across the globe with
different cultures
Background
The Blended Agile Delivery (BAD) Toolkit is an open source set of tools and techniques that help teams deliver
managed change within Lean and Agile principles.
It is the culmination of decades of experience as well as leveraging the experience and knowledge of thought
leaders across the globe.
Connected People with the Toolkit:
Why Open Source?
In June 2014, Elon, in broken English (a
reference to an Internet meme),
announced that “all our
patents are belong to you,” opening
up all of Tesla's patents to anyone who
wants to use them “in good faith.” This
announcement ignited the Internet.
What it Covers
Toolkit Adoption
Different Talks
Align Ideas to
Strategic
Investment
Rapid
Feedback on
the Concept
Understand
the work
Incremental
Delivery
Run & Evolve
VMOST Discovery Inception Delivery Dev Ops
Idea to
Funding
Team
Structures
Product Areas
Scaling
Org
Start-up Squads Tribes Empires
ProcessPeople
Values &
Culture
Values
So what can we
expect to see in the
BAD Toolkit?
VMOST Canvas
“Eliminate wasted
investment by focusing
teams on delivering the right
thing at the right time to
achieve your strategic goals”
Austen Bell
VMOST Creator
Prioritise and Near, Far, Further
Cone of Uncertainty
Discovery
The purpose of Discovery is to find out if an idea is viable. The techniques used during Discovery are designed to reduce the
risk of building the wrong thing, whilst swiftly determining how to deliver the solution (or not).
How will our customers know that we have delivered what they need?
E-mail marketing campaign will be needed to inform customers
that the functionality is available.
It is expected that this will be a multi stage messaging campaign.
i.e.
1) functionality is coming
2) functionality is here
3) why aren t you using the functionality
4) etc.
Single sentence explaining what the idea is. Format: If We Then
If we Build a responsive My Loans website that gives people self service functionality
Then we will reduce costs as customers will not call the contact centre as much
Name of the person who takes on responsibility for the idea and will
push it through.
Bob Smith
(Customer) Demographics
Who do we want to target with this idea?
Customers with 1+ loans
Customers who use Apple Mobile Devices
Who do we want to avoid / exclude from this idea?
New Applicants (those without a loan)
Fraudulent Customers
Business Driver
What do we hope to get out of this?
Reduction in calls to contact centre (41%)
Increase in upsell to customers with only
one loan (10%)
Why should we do it now?
Decrease in value of pound means that our
monthly offshore contact centre costs have
gone up by 30%
Plans are in place for next FY to scale
business by moving into the near prime
market.
Reasons for Confidence in the Idea:
Why do we (internally) think that it will give us what we expect?
80% of customers who call the Contact Centre use an IOS device
52% of all monthly calls to the contact centre are to manage basic account functions
Why will our targeted customers think this is a good idea?
1) Call answering / issue resolution time is in top 3 of complaints logged.
2) The ability to self serv on basic account functions has been top of our customer
feedback survey for last 8 months.
Approach / Solution
What are we going to do / build / change? Can it be delivered in phases?
IOS native app that lets the user:
- manage account details (address, etc.)
- manage payment details (payment method, direct debit date, etc.)
- make a payment (single payment / settle loan)
The app will also contain banners / upsell promotions that will be tailored to the individual users (ie different users will see different
banners based on their borrowed amount / APR rates / etc.)
Post Launch
What does success look like for this project?
What are the metrics we need to think about during delivery?
Project delivers agreed scope
Multiple releases (MVP, R1, etc.) used to deliver the project
What will we do to Test & Optimise the delivered functionality?
Design / look and feel of upsell banners
Location of upsell banners within the app
Business idea Idea Owner / Sponser
There are 3 options available to us after delivery – Evolve the idea and build on it, 2)Remove
the functionality or 3) Leave it and pivot onto the next idea. What will make us choose 1,2 or 3?
Evolve reduction in calls,
>8% increase in upsell
Pivot - reduction in calls &
0.1 - 8% increase in upsell
Rollback... <2% reduction in contact centre calls &
<0.1% increase in upsell
What touch points / impact will it have on existing business functions? Do we need any new
capabilities?
Impact on Contact Centre
- Head count
- Office Space
Will need for mobile device strategy / policies
Will need to consider app store brand presence (reviews, etc.)
Provides an increase in customer analytics (in app behaviours)
Success
Evolve / Roll Back / Pivot
Business Impact
MVT / Optimisation
Marketing
Pros
Paper prototypes had 78% acceptance
amongst IOS users
Cons
1) Limited (but some) IOS development
experience in Team
2) Complicated App Store submission process
Questions / Concerns
Future support (how do we support the
next version of IOS / device / screen
resolution / etc.)
Concept Card Example:
Native IOS my account app for a loans provider
Why:
Who:
How:
What:
Idea (From VMOST):
If we Build a responsive My Loans website that gives people self service functionality
Then we will reduce costs as customers will not call the contact centre as much
Reduce number of calls that go through the contact centre
(both inbound & outbound)
New Applicants Active Customers
(single and multiple loans)
Defaulting Customers Outbound CSA
Offer support
during application
process
Simplify the
application
process
Update Details Manage Active
Loan(s)
Make debt
recovery process
easier
Upsell loans to
existing customers
Live Chat How To
Guides
Pre-
Populate
Data
Integrate data with
Comparison sites (i.e.
Money Supermarket)
Re-design
Application
Flow
Mobile
IVR
Web
Self Service
Account
Management
Historical Data
Mine (MI)
Address
Change
Name
Change
Contact Details
Change
Manage Loan
Details
Change
Payment
Details
Change
Payment
Date
View
Statement(s)
Make
Payment
Ad-hoc
Payment
Settle
Loan
Auto-email
functionality
Integrate with
debt recovery
companies
Targeted
Marketing
messages
Concept Scope
This functionality equates to 52% of all
calls that pass through the contact
centre
Auto
Payment
Holidays
Full Scope
All functionality would equate to 70%
of all calls that pass through the
contact centre
Additional Benefit
This functionality could equate to
c. £500k per year in additional
revenue
by Gojko Adzic
Lean Inception
The aim of the Inception stage is to increases the team's confidence in the costs and benefits involved. This is done by allowing teams to
understand the idea and break the idea down into medium sized blocks that can be prioritised.
The output of Inception is a Go / No Go decision that has a more detailed understanding of the effort involved and the expected returns.
Key to the types of work items:
My Loans
(Native App)
Project Mapping Example:
My Account functionality for a loans provider
Project
Theme
Epic
Story / Bug / Spike / Tech Debt
FrameworkReports
System
Access
Account
Loan(s)
Static
Content
Phase 0
(Setup Tasks)
Site Structure
App Deployment
Login
(Basic)
Login
(Enhanced)
Registration
View Account
DetailsUpdate
Account DetailsMarketing
Preferences
Settle Loan
Update
Direct Debit
Info
Make
Payment
Statements
(Enhanced)
Statements
(Basic)
Static Pages
Tailored
Banners
Banners
(Basic)
MI ReportsUsage Reports
Set Up Test
Environment
Set Up Dev
Environment
Set Up Test Data
Create Grid
Site Footer
Site Header
Download
Report
App Usage Report
Deployment
Mechanism
Login
Logged In Header Bar
Logout
Forgotten Password
Captcha
LDAP Integration
Remember Me
Find Account
Register
(Set Password)
View Personal Details
View Contact Details
View Address
Change
Surname
Change
Address
Change
Contact Details
Update
Preferences
View Current
Preferences
Settle Loan
Get Settlement
Quote
Change
Payment Date
Change Card
Make Late
Payment
Make ad-hoc
Payment
Show last 6 statements
Find Statement
Show Current
Statement (Balance)
Export Statement
Auto Display rules
(AB Testing)
Tailored Offers
Banner
Time Critical Offers
Banner
Cross Sell Banner on
Home Page
Cross Sell Banner on
Statement
Contact Us Page
Help Pages
T&Cs Page
Mind Map - PTEST
Month
Capacity
Epics
Depend-
encies
JUL
Capacity: 72 days
Holidays, etc.: 6 days
Available (estimate): 66 days
JUN
Capacity: 72 days
Holidays, etc.: 6 days
Available (estimate): 66 days
MAY
Capacity: 72 days
Holidays, etc.: 6 days
Available (estimate): 66 days
APR
Capacity: 72 days
Holidays, etc.: 10 days
Available (estimate): 62 days
MAR
Capacity: 72 days
Holidays, etc.: 0 days
Available (estimate): 72 days
FEB
Capacity: 72 days
Holidays, etc.: 0 days
Available (estimate): 72 days
JAN
Capacity: 72 days
Holidays, etc.: 6 days
Available (estimate): 66 days
Launch Tasks
DEC
Capacity: 72 days
Holidays, etc.: 12 days
Available (estimate): 60 days
Epic Board Example:
My Account functionality for a loans provider
Release 2
I Can Update DD details / view
all statements / see promo
banners
Bugs (Placeholder)
Enhanced Banners
Launch Tasks
MI Reports
Launch Tasks
XS J S J
Release 4
I Can view detailed MI Reports
Release 3
I Can see tailored promo
banners
Registration
Enhanced
Statements
Marketing
Preferences
Basic Banners
Update Direct
Debit Details
Settle Loan
Launch Tasks
Bugs Placeholder
Usage Reports
Release 1
I Can Make an ad-hoc
payment / settle my loan
S J
S J
S J S KXS J
XL L
XL J
L LL J
M L
S K
M J
L J Estimation Calculation Table (Days)
Complexity
T-Shirt
XS 1 3
S 6 8
M 11 13
L 16 18
XL 21 25
5
10
15
20
30
10% Call Reduction
8% Call Reduction
3% Increase in upsell
7% increase in upsell
Bugs / Fixes
Deliverables
(Strategic)
Releases
Other work
(Non – Strategic)
Technical
Enabler / Debt
Key:
We can reduce 23% call reduction into the
call centre
Launch Tasks
Make Payment
Bugs Placeholder
Enhanced Login
MVP
I Can login / view statement /
view and update my account
details
Basic Statements
Update Account
Details
Static Pages
App Deployment
Mechanism
View Account
Details
Phase 0 –
Set up Tasks
Basic Login
Site Structure
Framework
S J
S K
L L
L L
L J
M J
L KM K
L J
M J
M J
23% Call Reduction
Focus on Business Outcomes
Epic Board
MVP
I Can
• Login
• View a statement
• View my account
• Update my account
details
(On an IOS device)
Release 1
I Can
• Make a payment
• Settle my loan
(On an IOS device)
Release 2
I Can
• Update my payment
details
• View all statements
• See basic promo
banners
(On an IOS device)
Release 3
I Can
• See tailored / personal
promo banners
(On an IOS device)
Release 4
I Can
• View detailed MI
reports
– weeks – weeks – weeks 2 - 3 weeks 1 - 2 weeks
23% call
reduction
10% call
reduction
8% call
reduction
- -
- -
3% increase
in upsell
7% increase
in Upsell
-
Release Proposition Example:
My Account functionality for a loans provider
Benefits
– weeks – weeks 16 - 21 weeks 18 - 24 weeks 19 - 26 weeks
23%
Reduction
33%
Reduction
41%
Reduction
41%
Reduction
41%
Reduction
3% Upsell 10% Upsell 10% Upsell
Timeline
Release Plan
Elaboration
Sprint Burn Down Chart
Squads
Sprint Capacity: 40 pts
Sprint Capacity: 40 pts
Sprint Planning
Squad
Story
Story
Story
Tech Task
Bug
Story
Tech Task
Story
Story
Story
Story
Story
Story
Tech Task
Bug
Story
Ready for
Sprint In Sprint
During the Sprint Planning session:
• Squad identifies expected capacity for sprint
• Highest priority work items (that are ready) are sense checked by the
team to fill the capacity
• For each work item, the team ask themselves:
- Do we understand what we re trying to do?
- Did the 3 Amigos get it (broadly) right?
- Is there anything that means this couldn t be done in the sprint?
3 pts
8 pts
5 pts
3 pts
13 pts
8 pts
3 pts
3 pts
21 pts
8 pts
40
pts
Focus: Story Level
Requirements
Sprint Planning will:
• Select the work to fill the
available sprint capacity
• Ensure that nothing obvious has
been missed during previous 3
Amigo sessions
• Define the Sprint goal
Sprint Planning will not:
• Drive out requirements or
possible solutions for stories
• Consider anything that has not
been through 3 Amigos or does
not have an estimate
3 pts
8 pts
5 pts
3 pts
13 pts
8 pts
Story
Tech Task
Story
Story
Scrum Master
Technical Lead
Technical Product
Owner
Engineering
QE
Backlog Management
You Run It...You Build It...
Operational Metrics
How we operate
Values & Squad Charter
Delivery
Operational KPIs
Sprint Backlog
Implementation
In Done
Deployed
to Test
Exp. Test UAT
In Done In Done
Ready for
Release
... ...
...
...
...
...
...
...
......
...
......
...
...
...
Defect Triage
• Expedite Lane on the sprint delivery boards is used to move emergency work through the pipeline
• Work is prioritised above all inflight tasks in order to get it out of the door asap.
• Lower SLA priority work can be fed into the delivery processes, using techniques such as service class WIP limits to
help deliver the work.
• Ensures that full SDLC process is adhered to and work isn t rushed out just to achieve SLA targets.
SLA support of issues will be delivered by fast tracking work through
the delivery process.
Technical Product Owner embedded within the squad to prioritise issues coming in from
Live. Issues are Triaged (with support from squad) to identify what needs urgent
attention and what can be added to the backlog
HighMediumLow
HighMediumLow
Severity
CustomerImpact
• Triage methodology used by squad to assess priority of
live issues
• High priority emergency issues ones are fast tracked
through the squad
• Lower priority work is classified as incremental
improvements and to the backlog for future
prioritisation
• Triage is owned by the Product Owner, with support
from the BA & Tester
As Required
Product
Owner
Focus: Issues
Squad
SLA Support
A day in the life of a Squad
Co-Location
• Desk area: Each squad area has a number of desks with long flat tables preferred to promote pairing and
flexibility. Although desks are dedicated to named individuals to promote practices such as pairing and
collaboration, desk moves are common to ensure co-location of people working on the same thing.
• Where co-location is not possible (due to geographical boundaries) then the squad focus on tools (such
as virtual collaboration tools) and working practices (such as shifting working hours) that minimise the
disruption caused to delivery.
Tools & Equipment
• Hardware: Laptops and docking stations are linked to twin screens to maximize productivity.
• Consumables: Squads need constant feeding with stationary such as Post-Its, Sharpies, Index Cards, etc.
Collaboration
• War Room: Each team has a meeting room with videoconferencing to avoid potential booking delays.
This separate space provides team members with privacy when required.
• Break Out Area: An informal collaboration space is required to provide a second space away from the
formal work area. This separate space is ideal for presentations, design breakouts and informal
discussions.
Information Radiators
• Whiteboards: Most walls are whiteboards to facilitate co-creation, innovation and the sharing of ideas.
They are also useful for agile modeling, Kanban boards and big visible charts.
• Screens: Large wall-mounted monitors are housed in the team area for information sharing, the desk
area for agile dashboards and the huddle room for videoconferencing.
Our EnvironmentStructure
Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5
Product Owner
Mission
Validation
Scrum Master
SDLC
Team
Ease of Release
Org. Support



 














  

Continual Improvement
Daily
Focus: Story Level
• Monitoring what is important to the Squad over time
• Allows them to identify trends and take action to rectify
issues
• Allows continual inspection and adaption within the squad
• Defined Squad Charter that defines the team
beliefs and values
• Builds upon higher level (org) values and Agile
principles
• Protects the team from individual personalities
& acts as a reference point for new starters
Continual
Product
Owner
Focus: Live Service
SRE
SDLC Delivery (Sprint) Board
• Standardised SDLC used to define ways of working
across all teams
• Defines segregation of duties within the team
• Aim of SDLC is to release functionality into production
• Process flow visualises what the team is working on
• Allows self forming and prioritisation within the sprint
• Forms basis of delivery capability reporting (i.e. throughput per sprint)
• Can be physical (Whiteboard) or virtual (Jira) depending on co-location of
squad members
The majority of the squad s time will be taken up with tasks focused on delivery of the next most important thing into production. This is usually in the
form of User Stories within the sprint backlog.
Delivered functionality can be released to Live in a hidden state, for example feature toggled off. This enables the squad to continually ship code to
production, whilst also allowing the organisation to optimize the time it goes in front of end users.
Delivery Metrics
Delivery KPIs Quality KPIs
Continual
Focus: Delivery
• Focuses on the capability of the squad to deliver
work items.
• Different metrics used dependant on the
methodology (ie burn downs, vs CFDs)
• Used to highlight blockers to improve delivery –
progress is reported on at epic level.
• Focuses on the quality of the software delivered.
• Aim is to focus on NFRs as well as reducing the
overhead of maintaining the code
• Can be used to drive the need for tech debt within
the product backlog
Continual Improvement within delivery is achieved by focusing on KPIs within the SDLC. These metrics are grouped
into two areas: Delivery Metrics, which show how the team s ability to deliver improves over time, and Quality
Metrics, which shows how the cost of the product is minimised.
Once live, the product is owned by the squad who continually support it by using data to drive decisions.
The Squad take ownership of product monitoring to ensure service is maintained. Alerting is used to inform the squad of current issues (basic alerting) or
upcoming problems (pro-active alerting) and Logging and log aggregation tools are employed to facilitate problem resolution.
• Shows how the product / service is operating
within the real world
• Wall boards and other tools used to focus on
monitoring & alerting of the product
• Allows the squad to move into a dev-ops
model where they fully own the product from
cradle to grave
ROI Totalizer
£ Agreed
Evolution
Point
Agreed Roll
Back Point
Benefits KPIs
• Focuses on the value shipped by the
team
• Links in with the expected benefits of
the initiative
• Can be used to drive Multi Variant
Testing or Product Evolution decisions
– minutes
Squad
Elaboration
• Allows the squad to understand the
story, ahead of taking it into delivery
• Focuses on INVEST principles and
shared understanding of the work
Actual
Predicted
Days
StoryPoints
Squad
Story Elaboration Board
• Team works 1-2 sprints ahead in breaking
things down.
• Protects Squad from investing in things that
aren t ready
• Ensures known dependencies are in place
Epic Breakdown
(Story Backlog)
Daily
Product
Owner
Engineer
Focus: Epic / Story
QA
Squads undertake their backlog management at a story level to ensure that the work going into sprint planning is sufficiently understood that there
should be no known surprises.
By using lean principles to work Just In Time the squad elaborates the stories ahead of the Sprint to minimise wasted effort. This allows them to
reduce the time taken for sprint planning as it becomes a capacity discussion rather than an understanding and elaboration workshop.
• Defines Story level backlog for a specific
Epic
• Allows team to prioritise / descope any
work that is not critical to that outcome
Incremental Improvements
• Incremental changes are based on feedback and existing
circumstances with the shipped product.
• Often driven by operational metrics these can be either
customer facing improvements, non-critical bugs, or tech
debt.
• Whilst the ideas for improvements can come from
anywhere, the Technical Product Owner acts as guardian of
what they wish the squad to invest in.
• Large changes that don t align to the original goals of the in
flight initiative are added as a new initiative.
Continual
Product
Owner
Customer
Focus: Customer
Feedback
Operating Costs
Default Rates
Time
Profit
Data & Insight
• Used to measure how the internal and
external landscape has changed post feature
release
• Comprises of internal insight (i.e. KPIs) and
external insight (such as customer feedback)
• May require the assistance of teams outside
of the delivery squad to obtain insight
...
...
......
...
...
...
...
.........
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Epic
Story Story
Story
Tech
Task
Story
Product Owner
Idea !
You Own It...
Kanban Goal Meeting
Virtual Sprints
• The team wrap the continual
delivery nature of Kanban with
virtual time boxes
• This provides a structured time
frame for the team to assign goals
to.
• It also allows natural review
points to introduce other
ceremonies (i.e. team
retrospectives)
• Often called scrum ban
Kanban Goals
Goals are usually focus on one of 3
areas:
• Metrics – i.e. reduce fortnightly
cycle time to 3.4 days
• Flow – i.e. reduce the number of
cards in Ready for Test to 1
• Delivery – i.e. get all cards
associated with Login complete by
Friday
Stretch Goals (expected vs exceptional)
can be used to define success
Non Time-box Variations
• Delivery boxes (rather than time
boxes) could be used to set goals
• i.e. The 8 user stories needed for
Login will have a cycle time of less
than 4 days.
• This allows the team to centre
their focus on delivery around the
actual product, rather than an
artificial timebox.
Whilst Kanban is focused on a continual delivery flow, rather than a time boxed delivery window, teams can still agree
short term delivery goals to help focus in flight decision making.
Engineer QA
PO
Delivery Teams are comprised of one or more Squads with a
shared focus of building and supporting a product initiative.
Guard rails exist around the number and roles of individuals
within the squad to ensure that it remains a scalable unit.
Self-contained, mini-startup unit - Co-located
Skills include Development, Test, ID, OM, Design and SRE
Automates everything as we build in support of making their
Service(s) easy to deploy and operate
Time from check in to library to live in production key metric
Squad works from the prioritized backlog; may be responsible for
more than one service
Operates their Service(s), meaning that once a problem is observed,
resolves the problem quickly (within SLA) and then eliminates root
cause(s) to avoid future problems
Everyone is on pager duty at some point
Analyses available data – of the operation of the service, of usage /
consumption / business metrics of the service, culture measures, of
development velocity
Encouraged to apply Lean (e.g. Pair Programming, MVP, learning using
metrics and A/B to find out what resonates)
Scrum master rotates among members periodically
Squad Roadmap Planning
Every Sprint / Month
Product
Owner
Focus: Initiative
Ad-hoc
Squad
Members
Squads will prioritise delivery based off a defined roadmap, showing a high level view of what they will
be building and when. This is usually framed by the delivery of a product initiative and will show the
team s component deliverables, grouped by release. Dependencies are called out with estimated
timeframes to mitigate risk to the team.
This roadmap is initially drafted when the initiative is broken down during inception, but is continually
updated after every time box (sprint / month) to report on progress.
• Allows future capacity management and
reporting for the squad
• Shows Epic level deliverables
• Epics prioritised by Technical Product Owner
(with input from squad)
• Grouped by time box (i.e. Month / Sprint)
based on delivery capacity
• Allows re-prioritisation by the product owner
at any point
...
...
...
...
...
...
...
...
...
...
...
...
...
Jan Feb Mar Apr May
Feature / Epic Board
Further information: http://bad.tools
Organisational Design: Squads & Delivery Teams
Feb 2019
Austen Bell | The BAD Toolkit Ltd.
Estimation
Decomposition
Implementation – BAD Squad
BADx
BAD Training
Next event we will look at…
Align Ideas to
Strategic
Investment
Rapid
Feedback on
the Concept
Understand
the work
Incremental
Delivery
Run & Evolve
VMOST Discovery Inception Delivery Dev Ops
Values &
Culture
Team
Structures
Product Areas Org
Values Squads Tribes Empires
ProcessPeople
Find out More
www.bad.tools
#vmost #badtoolkit
Try it
yourself
We can Help
Implement it
info@burendo.com
Thank You – Q&A Time
The BAD Toolkit

More Related Content

What's hot

Delight 2013 | Digital Experience Workshop
Delight 2013 | Digital Experience WorkshopDelight 2013 | Digital Experience Workshop
Delight 2013 | Digital Experience Workshop
Delight Summit
 
Mobile Application Development India
Mobile Application Development IndiaMobile Application Development India
Mobile Application Development India
Bhupendra (Bob)
 
Designbrief
DesignbriefDesignbrief
Designbrief
AlessandroSingh
 
Movebot ENGR245 Lean LaunchPad Stanford 2018
Movebot ENGR245 Lean LaunchPad Stanford 2018Movebot ENGR245 Lean LaunchPad Stanford 2018
Movebot ENGR245 Lean LaunchPad Stanford 2018
Stanford University
 
LTV prediction - How to save millions with ML
LTV prediction - How to save millions with MLLTV prediction - How to save millions with ML
LTV prediction - How to save millions with ML
Viktor Gregor
 
Digital transformation
Digital transformationDigital transformation
Digital transformation
Prashanth Panduranga
 
User Experience Audit by Gridle
User Experience Audit by GridleUser Experience Audit by Gridle
User Experience Audit by Gridle
Clientjoy.io
 
Voice of Customers programs in B2B
Voice of Customers programs in B2BVoice of Customers programs in B2B
Voice of Customers programs in B2B
Gideon Cohen
 
Accenture: Bennet Harvey
Accenture: Bennet HarveyAccenture: Bennet Harvey
Accenture: Bennet Harvey
GamePlanConference
 
The Net Promoter Score - What can NPS Tell you about your User Experience
The Net Promoter Score - What can NPS Tell you about your User ExperienceThe Net Promoter Score - What can NPS Tell you about your User Experience
The Net Promoter Score - What can NPS Tell you about your User Experience
UXPA International
 
Product-led growth
Product-led growthProduct-led growth
Product-led growth
Adrian Escude
 
Jrb first call deck
Jrb first call deckJrb first call deck
Jrb first call deck
JonathanRobertson
 
5 Signs You're Ready to Adopt Customer Journey Analytics
5 Signs You're Ready to Adopt Customer Journey Analytics5 Signs You're Ready to Adopt Customer Journey Analytics
5 Signs You're Ready to Adopt Customer Journey Analytics
Pointillist
 
Adobe Summit 2018 Top Takeaways
Adobe Summit 2018 Top TakeawaysAdobe Summit 2018 Top Takeaways
Adobe Summit 2018 Top Takeaways
Invoca
 
Product Management Career Conversation
Product Management Career ConversationProduct Management Career Conversation
Product Management Career Conversation
SupportGCI
 
Designing Culture to Drive Customer Experience
Designing Culture to Drive Customer Experience Designing Culture to Drive Customer Experience
Designing Culture to Drive Customer Experience
James Prentis
 
The search for Product-Market Fit
The search for Product-Market FitThe search for Product-Market Fit
The search for Product-Market Fit
Jérôme Kehrli
 
Product Management and CX Approaches: Friends or Foes?
Product Management and CX Approaches: Friends or Foes?Product Management and CX Approaches: Friends or Foes?
Product Management and CX Approaches: Friends or Foes?
James Prentis
 

What's hot (18)

Delight 2013 | Digital Experience Workshop
Delight 2013 | Digital Experience WorkshopDelight 2013 | Digital Experience Workshop
Delight 2013 | Digital Experience Workshop
 
Mobile Application Development India
Mobile Application Development IndiaMobile Application Development India
Mobile Application Development India
 
Designbrief
DesignbriefDesignbrief
Designbrief
 
Movebot ENGR245 Lean LaunchPad Stanford 2018
Movebot ENGR245 Lean LaunchPad Stanford 2018Movebot ENGR245 Lean LaunchPad Stanford 2018
Movebot ENGR245 Lean LaunchPad Stanford 2018
 
LTV prediction - How to save millions with ML
LTV prediction - How to save millions with MLLTV prediction - How to save millions with ML
LTV prediction - How to save millions with ML
 
Digital transformation
Digital transformationDigital transformation
Digital transformation
 
User Experience Audit by Gridle
User Experience Audit by GridleUser Experience Audit by Gridle
User Experience Audit by Gridle
 
Voice of Customers programs in B2B
Voice of Customers programs in B2BVoice of Customers programs in B2B
Voice of Customers programs in B2B
 
Accenture: Bennet Harvey
Accenture: Bennet HarveyAccenture: Bennet Harvey
Accenture: Bennet Harvey
 
The Net Promoter Score - What can NPS Tell you about your User Experience
The Net Promoter Score - What can NPS Tell you about your User ExperienceThe Net Promoter Score - What can NPS Tell you about your User Experience
The Net Promoter Score - What can NPS Tell you about your User Experience
 
Product-led growth
Product-led growthProduct-led growth
Product-led growth
 
Jrb first call deck
Jrb first call deckJrb first call deck
Jrb first call deck
 
5 Signs You're Ready to Adopt Customer Journey Analytics
5 Signs You're Ready to Adopt Customer Journey Analytics5 Signs You're Ready to Adopt Customer Journey Analytics
5 Signs You're Ready to Adopt Customer Journey Analytics
 
Adobe Summit 2018 Top Takeaways
Adobe Summit 2018 Top TakeawaysAdobe Summit 2018 Top Takeaways
Adobe Summit 2018 Top Takeaways
 
Product Management Career Conversation
Product Management Career ConversationProduct Management Career Conversation
Product Management Career Conversation
 
Designing Culture to Drive Customer Experience
Designing Culture to Drive Customer Experience Designing Culture to Drive Customer Experience
Designing Culture to Drive Customer Experience
 
The search for Product-Market Fit
The search for Product-Market FitThe search for Product-Market Fit
The search for Product-Market Fit
 
Product Management and CX Approaches: Friends or Foes?
Product Management and CX Approaches: Friends or Foes?Product Management and CX Approaches: Friends or Foes?
Product Management and CX Approaches: Friends or Foes?
 

Similar to BAD Toolkit - Berlin Overview

Developing a cult of analytics
Developing a cult of analyticsDeveloping a cult of analytics
Developing a cult of analytics
Steve Jackson
 
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
Vanguard Technology
 
Blitzscaling Session 9: Village Stage
Blitzscaling Session 9: Village StageBlitzscaling Session 9: Village Stage
Blitzscaling Session 9: Village Stage
Greylock Partners
 
Voice of Customer and Beyond
Voice of Customer and BeyondVoice of Customer and Beyond
Voice of Customer and BeyondLucieColt
 
Voice of Customer and Beyond
Voice of Customer and BeyondVoice of Customer and Beyond
Voice of Customer and BeyondLucieColt
 
How To Create an Effective MSP Marketing Plan
How To Create an Effective MSP Marketing PlanHow To Create an Effective MSP Marketing Plan
How To Create an Effective MSP Marketing Plan
David Castro
 
Just for MSPs: How to Create an Effective Marketing Plan that Delivers Results
Just for MSPs: How to Create an Effective Marketing Plan that Delivers ResultsJust for MSPs: How to Create an Effective Marketing Plan that Delivers Results
Just for MSPs: How to Create an Effective Marketing Plan that Delivers Results
Kaseya
 
NextTen Voice of Customer and Beyond...
NextTen Voice of Customer and Beyond...NextTen Voice of Customer and Beyond...
NextTen Voice of Customer and Beyond...
LucieColt
 
Chp14 Tactical Execution
Chp14 Tactical ExecutionChp14 Tactical Execution
Chp14 Tactical ExecutionChuong Nguyen
 
How GetNinjas uses data to make smarter product decisions
How GetNinjas uses data to make smarter product decisionsHow GetNinjas uses data to make smarter product decisions
How GetNinjas uses data to make smarter product decisions
Bernardo Srulzon
 
UX Design Workshop - Tableau CRM Edition
UX Design Workshop - Tableau CRM EditionUX Design Workshop - Tableau CRM Edition
UX Design Workshop - Tableau CRM Edition
rikkehovgaard
 
Frakture Deck
Frakture DeckFrakture Deck
Frakture Deck
Chris Lundberg
 
Casewise - 7 steps to business architecture
Casewise - 7 steps to business architectureCasewise - 7 steps to business architecture
Casewise - 7 steps to business architectureJean-Patrick Ascenci
 
Mi0039 e-commerce
Mi0039  e-commerceMi0039  e-commerce
Mi0039 e-commerce
smumbahelp
 
World's Best Bank - The presentation
World's Best Bank - The presentationWorld's Best Bank - The presentation
World's Best Bank - The presentation
Robin Speculand
 
Six Building Blocks Of Digital Transformation Powerpoint Presentation Slides
Six Building Blocks Of Digital Transformation Powerpoint Presentation SlidesSix Building Blocks Of Digital Transformation Powerpoint Presentation Slides
Six Building Blocks Of Digital Transformation Powerpoint Presentation Slides
SlideTeam
 
Chat Bots For Your Business: How And Why?
Chat Bots For Your Business: How And Why?Chat Bots For Your Business: How And Why?
Chat Bots For Your Business: How And Why?
GNS
 
E C L004 Dokich 091807
E C L004  Dokich 091807E C L004  Dokich 091807
E C L004 Dokich 091807
Dreamforce07
 
Six Building Blocks Of Digital Transformation PowerPoint Presentation Slides
Six Building Blocks Of Digital Transformation PowerPoint Presentation SlidesSix Building Blocks Of Digital Transformation PowerPoint Presentation Slides
Six Building Blocks Of Digital Transformation PowerPoint Presentation Slides
SlideTeam
 
Microsoft Digital Advisory Services
Microsoft Digital Advisory ServicesMicrosoft Digital Advisory Services
Microsoft Digital Advisory Services
Maria Fonsell
 

Similar to BAD Toolkit - Berlin Overview (20)

Developing a cult of analytics
Developing a cult of analyticsDeveloping a cult of analytics
Developing a cult of analytics
 
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
ASAE Tech Conference: Don't Blame The Sofware: 5 Vital Considerations Before ...
 
Blitzscaling Session 9: Village Stage
Blitzscaling Session 9: Village StageBlitzscaling Session 9: Village Stage
Blitzscaling Session 9: Village Stage
 
Voice of Customer and Beyond
Voice of Customer and BeyondVoice of Customer and Beyond
Voice of Customer and Beyond
 
Voice of Customer and Beyond
Voice of Customer and BeyondVoice of Customer and Beyond
Voice of Customer and Beyond
 
How To Create an Effective MSP Marketing Plan
How To Create an Effective MSP Marketing PlanHow To Create an Effective MSP Marketing Plan
How To Create an Effective MSP Marketing Plan
 
Just for MSPs: How to Create an Effective Marketing Plan that Delivers Results
Just for MSPs: How to Create an Effective Marketing Plan that Delivers ResultsJust for MSPs: How to Create an Effective Marketing Plan that Delivers Results
Just for MSPs: How to Create an Effective Marketing Plan that Delivers Results
 
NextTen Voice of Customer and Beyond...
NextTen Voice of Customer and Beyond...NextTen Voice of Customer and Beyond...
NextTen Voice of Customer and Beyond...
 
Chp14 Tactical Execution
Chp14 Tactical ExecutionChp14 Tactical Execution
Chp14 Tactical Execution
 
How GetNinjas uses data to make smarter product decisions
How GetNinjas uses data to make smarter product decisionsHow GetNinjas uses data to make smarter product decisions
How GetNinjas uses data to make smarter product decisions
 
UX Design Workshop - Tableau CRM Edition
UX Design Workshop - Tableau CRM EditionUX Design Workshop - Tableau CRM Edition
UX Design Workshop - Tableau CRM Edition
 
Frakture Deck
Frakture DeckFrakture Deck
Frakture Deck
 
Casewise - 7 steps to business architecture
Casewise - 7 steps to business architectureCasewise - 7 steps to business architecture
Casewise - 7 steps to business architecture
 
Mi0039 e-commerce
Mi0039  e-commerceMi0039  e-commerce
Mi0039 e-commerce
 
World's Best Bank - The presentation
World's Best Bank - The presentationWorld's Best Bank - The presentation
World's Best Bank - The presentation
 
Six Building Blocks Of Digital Transformation Powerpoint Presentation Slides
Six Building Blocks Of Digital Transformation Powerpoint Presentation SlidesSix Building Blocks Of Digital Transformation Powerpoint Presentation Slides
Six Building Blocks Of Digital Transformation Powerpoint Presentation Slides
 
Chat Bots For Your Business: How And Why?
Chat Bots For Your Business: How And Why?Chat Bots For Your Business: How And Why?
Chat Bots For Your Business: How And Why?
 
E C L004 Dokich 091807
E C L004  Dokich 091807E C L004  Dokich 091807
E C L004 Dokich 091807
 
Six Building Blocks Of Digital Transformation PowerPoint Presentation Slides
Six Building Blocks Of Digital Transformation PowerPoint Presentation SlidesSix Building Blocks Of Digital Transformation PowerPoint Presentation Slides
Six Building Blocks Of Digital Transformation PowerPoint Presentation Slides
 
Microsoft Digital Advisory Services
Microsoft Digital Advisory ServicesMicrosoft Digital Advisory Services
Microsoft Digital Advisory Services
 

Recently uploaded

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 

Recently uploaded (20)

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 

BAD Toolkit - Berlin Overview

  • 2. Welcome Berlin • BAD Toolkit Overview – feel free to ask Questions • Q&A – Challenges you are facing • Networking
  • 3. About Me… Glenn Crossley
  • 4. But we all want to be successful….. All our companies are different
  • 5. The most successful companies (Market Leaders) are the ones who are able to rapidly pivot direction to meet the needs of the customer.
  • 6. Each team and individual is loyal to their own ways of working and methodology So how do you get all these people collaborating? Business Change Project Manager Architect Development QA ServiceBusiness Analyst What if your company can't pivot!
  • 7. End to End Agility – Will allow you to pivot!
  • 8. Which version of Agile should we implement? We are a traditional bank and are risk adverse We have teams located across the globe with different cultures We are a start-up and want to share our journey to success with the world Certification Frameworks Books & Proprietary Frameworks Everyone is Different
  • 9. What if there was something that… • Compliments what organisations already do well • Supports incremental agile adoption • Free to implement • Supported by global community • Kept up to date by real users • Is industry agnosticSingle Toolkit We are a start-up and want to share our journey to success with the world We have teams located across the globe with different cultures
  • 10. Background The Blended Agile Delivery (BAD) Toolkit is an open source set of tools and techniques that help teams deliver managed change within Lean and Agile principles. It is the culmination of decades of experience as well as leveraging the experience and knowledge of thought leaders across the globe. Connected People with the Toolkit:
  • 11. Why Open Source? In June 2014, Elon, in broken English (a reference to an Internet meme), announced that “all our patents are belong to you,” opening up all of Tesla's patents to anyone who wants to use them “in good faith.” This announcement ignited the Internet.
  • 14. Different Talks Align Ideas to Strategic Investment Rapid Feedback on the Concept Understand the work Incremental Delivery Run & Evolve VMOST Discovery Inception Delivery Dev Ops Idea to Funding Team Structures Product Areas Scaling Org Start-up Squads Tribes Empires ProcessPeople Values & Culture Values
  • 15. So what can we expect to see in the BAD Toolkit?
  • 16. VMOST Canvas “Eliminate wasted investment by focusing teams on delivering the right thing at the right time to achieve your strategic goals” Austen Bell VMOST Creator
  • 17. Prioritise and Near, Far, Further
  • 19. Discovery The purpose of Discovery is to find out if an idea is viable. The techniques used during Discovery are designed to reduce the risk of building the wrong thing, whilst swiftly determining how to deliver the solution (or not).
  • 20. How will our customers know that we have delivered what they need? E-mail marketing campaign will be needed to inform customers that the functionality is available. It is expected that this will be a multi stage messaging campaign. i.e. 1) functionality is coming 2) functionality is here 3) why aren t you using the functionality 4) etc. Single sentence explaining what the idea is. Format: If We Then If we Build a responsive My Loans website that gives people self service functionality Then we will reduce costs as customers will not call the contact centre as much Name of the person who takes on responsibility for the idea and will push it through. Bob Smith (Customer) Demographics Who do we want to target with this idea? Customers with 1+ loans Customers who use Apple Mobile Devices Who do we want to avoid / exclude from this idea? New Applicants (those without a loan) Fraudulent Customers Business Driver What do we hope to get out of this? Reduction in calls to contact centre (41%) Increase in upsell to customers with only one loan (10%) Why should we do it now? Decrease in value of pound means that our monthly offshore contact centre costs have gone up by 30% Plans are in place for next FY to scale business by moving into the near prime market. Reasons for Confidence in the Idea: Why do we (internally) think that it will give us what we expect? 80% of customers who call the Contact Centre use an IOS device 52% of all monthly calls to the contact centre are to manage basic account functions Why will our targeted customers think this is a good idea? 1) Call answering / issue resolution time is in top 3 of complaints logged. 2) The ability to self serv on basic account functions has been top of our customer feedback survey for last 8 months. Approach / Solution What are we going to do / build / change? Can it be delivered in phases? IOS native app that lets the user: - manage account details (address, etc.) - manage payment details (payment method, direct debit date, etc.) - make a payment (single payment / settle loan) The app will also contain banners / upsell promotions that will be tailored to the individual users (ie different users will see different banners based on their borrowed amount / APR rates / etc.) Post Launch What does success look like for this project? What are the metrics we need to think about during delivery? Project delivers agreed scope Multiple releases (MVP, R1, etc.) used to deliver the project What will we do to Test & Optimise the delivered functionality? Design / look and feel of upsell banners Location of upsell banners within the app Business idea Idea Owner / Sponser There are 3 options available to us after delivery – Evolve the idea and build on it, 2)Remove the functionality or 3) Leave it and pivot onto the next idea. What will make us choose 1,2 or 3? Evolve reduction in calls, >8% increase in upsell Pivot - reduction in calls & 0.1 - 8% increase in upsell Rollback... <2% reduction in contact centre calls & <0.1% increase in upsell What touch points / impact will it have on existing business functions? Do we need any new capabilities? Impact on Contact Centre - Head count - Office Space Will need for mobile device strategy / policies Will need to consider app store brand presence (reviews, etc.) Provides an increase in customer analytics (in app behaviours) Success Evolve / Roll Back / Pivot Business Impact MVT / Optimisation Marketing Pros Paper prototypes had 78% acceptance amongst IOS users Cons 1) Limited (but some) IOS development experience in Team 2) Complicated App Store submission process Questions / Concerns Future support (how do we support the next version of IOS / device / screen resolution / etc.) Concept Card Example: Native IOS my account app for a loans provider
  • 21. Why: Who: How: What: Idea (From VMOST): If we Build a responsive My Loans website that gives people self service functionality Then we will reduce costs as customers will not call the contact centre as much Reduce number of calls that go through the contact centre (both inbound & outbound) New Applicants Active Customers (single and multiple loans) Defaulting Customers Outbound CSA Offer support during application process Simplify the application process Update Details Manage Active Loan(s) Make debt recovery process easier Upsell loans to existing customers Live Chat How To Guides Pre- Populate Data Integrate data with Comparison sites (i.e. Money Supermarket) Re-design Application Flow Mobile IVR Web Self Service Account Management Historical Data Mine (MI) Address Change Name Change Contact Details Change Manage Loan Details Change Payment Details Change Payment Date View Statement(s) Make Payment Ad-hoc Payment Settle Loan Auto-email functionality Integrate with debt recovery companies Targeted Marketing messages Concept Scope This functionality equates to 52% of all calls that pass through the contact centre Auto Payment Holidays Full Scope All functionality would equate to 70% of all calls that pass through the contact centre Additional Benefit This functionality could equate to c. £500k per year in additional revenue by Gojko Adzic
  • 22. Lean Inception The aim of the Inception stage is to increases the team's confidence in the costs and benefits involved. This is done by allowing teams to understand the idea and break the idea down into medium sized blocks that can be prioritised. The output of Inception is a Go / No Go decision that has a more detailed understanding of the effort involved and the expected returns.
  • 23. Key to the types of work items: My Loans (Native App) Project Mapping Example: My Account functionality for a loans provider Project Theme Epic Story / Bug / Spike / Tech Debt FrameworkReports System Access Account Loan(s) Static Content Phase 0 (Setup Tasks) Site Structure App Deployment Login (Basic) Login (Enhanced) Registration View Account DetailsUpdate Account DetailsMarketing Preferences Settle Loan Update Direct Debit Info Make Payment Statements (Enhanced) Statements (Basic) Static Pages Tailored Banners Banners (Basic) MI ReportsUsage Reports Set Up Test Environment Set Up Dev Environment Set Up Test Data Create Grid Site Footer Site Header Download Report App Usage Report Deployment Mechanism Login Logged In Header Bar Logout Forgotten Password Captcha LDAP Integration Remember Me Find Account Register (Set Password) View Personal Details View Contact Details View Address Change Surname Change Address Change Contact Details Update Preferences View Current Preferences Settle Loan Get Settlement Quote Change Payment Date Change Card Make Late Payment Make ad-hoc Payment Show last 6 statements Find Statement Show Current Statement (Balance) Export Statement Auto Display rules (AB Testing) Tailored Offers Banner Time Critical Offers Banner Cross Sell Banner on Home Page Cross Sell Banner on Statement Contact Us Page Help Pages T&Cs Page Mind Map - PTEST
  • 24. Month Capacity Epics Depend- encies JUL Capacity: 72 days Holidays, etc.: 6 days Available (estimate): 66 days JUN Capacity: 72 days Holidays, etc.: 6 days Available (estimate): 66 days MAY Capacity: 72 days Holidays, etc.: 6 days Available (estimate): 66 days APR Capacity: 72 days Holidays, etc.: 10 days Available (estimate): 62 days MAR Capacity: 72 days Holidays, etc.: 0 days Available (estimate): 72 days FEB Capacity: 72 days Holidays, etc.: 0 days Available (estimate): 72 days JAN Capacity: 72 days Holidays, etc.: 6 days Available (estimate): 66 days Launch Tasks DEC Capacity: 72 days Holidays, etc.: 12 days Available (estimate): 60 days Epic Board Example: My Account functionality for a loans provider Release 2 I Can Update DD details / view all statements / see promo banners Bugs (Placeholder) Enhanced Banners Launch Tasks MI Reports Launch Tasks XS J S J Release 4 I Can view detailed MI Reports Release 3 I Can see tailored promo banners Registration Enhanced Statements Marketing Preferences Basic Banners Update Direct Debit Details Settle Loan Launch Tasks Bugs Placeholder Usage Reports Release 1 I Can Make an ad-hoc payment / settle my loan S J S J S J S KXS J XL L XL J L LL J M L S K M J L J Estimation Calculation Table (Days) Complexity T-Shirt XS 1 3 S 6 8 M 11 13 L 16 18 XL 21 25 5 10 15 20 30 10% Call Reduction 8% Call Reduction 3% Increase in upsell 7% increase in upsell Bugs / Fixes Deliverables (Strategic) Releases Other work (Non – Strategic) Technical Enabler / Debt Key: We can reduce 23% call reduction into the call centre Launch Tasks Make Payment Bugs Placeholder Enhanced Login MVP I Can login / view statement / view and update my account details Basic Statements Update Account Details Static Pages App Deployment Mechanism View Account Details Phase 0 – Set up Tasks Basic Login Site Structure Framework S J S K L L L L L J M J L KM K L J M J M J 23% Call Reduction Focus on Business Outcomes Epic Board
  • 25. MVP I Can • Login • View a statement • View my account • Update my account details (On an IOS device) Release 1 I Can • Make a payment • Settle my loan (On an IOS device) Release 2 I Can • Update my payment details • View all statements • See basic promo banners (On an IOS device) Release 3 I Can • See tailored / personal promo banners (On an IOS device) Release 4 I Can • View detailed MI reports – weeks – weeks – weeks 2 - 3 weeks 1 - 2 weeks 23% call reduction 10% call reduction 8% call reduction - - - - 3% increase in upsell 7% increase in Upsell - Release Proposition Example: My Account functionality for a loans provider Benefits – weeks – weeks 16 - 21 weeks 18 - 24 weeks 19 - 26 weeks 23% Reduction 33% Reduction 41% Reduction 41% Reduction 41% Reduction 3% Upsell 10% Upsell 10% Upsell Timeline Release Plan
  • 26.
  • 28. Sprint Burn Down Chart Squads Sprint Capacity: 40 pts Sprint Capacity: 40 pts Sprint Planning Squad Story Story Story Tech Task Bug Story Tech Task Story Story Story Story Story Story Tech Task Bug Story Ready for Sprint In Sprint During the Sprint Planning session: • Squad identifies expected capacity for sprint • Highest priority work items (that are ready) are sense checked by the team to fill the capacity • For each work item, the team ask themselves: - Do we understand what we re trying to do? - Did the 3 Amigos get it (broadly) right? - Is there anything that means this couldn t be done in the sprint? 3 pts 8 pts 5 pts 3 pts 13 pts 8 pts 3 pts 3 pts 21 pts 8 pts 40 pts Focus: Story Level Requirements Sprint Planning will: • Select the work to fill the available sprint capacity • Ensure that nothing obvious has been missed during previous 3 Amigo sessions • Define the Sprint goal Sprint Planning will not: • Drive out requirements or possible solutions for stories • Consider anything that has not been through 3 Amigos or does not have an estimate 3 pts 8 pts 5 pts 3 pts 13 pts 8 pts Story Tech Task Story Story Scrum Master Technical Lead Technical Product Owner Engineering QE Backlog Management You Run It...You Build It... Operational Metrics How we operate Values & Squad Charter Delivery Operational KPIs Sprint Backlog Implementation In Done Deployed to Test Exp. Test UAT In Done In Done Ready for Release ... ... ... ... ... ... ... ... ...... ... ...... ... ... ... Defect Triage • Expedite Lane on the sprint delivery boards is used to move emergency work through the pipeline • Work is prioritised above all inflight tasks in order to get it out of the door asap. • Lower SLA priority work can be fed into the delivery processes, using techniques such as service class WIP limits to help deliver the work. • Ensures that full SDLC process is adhered to and work isn t rushed out just to achieve SLA targets. SLA support of issues will be delivered by fast tracking work through the delivery process. Technical Product Owner embedded within the squad to prioritise issues coming in from Live. Issues are Triaged (with support from squad) to identify what needs urgent attention and what can be added to the backlog HighMediumLow HighMediumLow Severity CustomerImpact • Triage methodology used by squad to assess priority of live issues • High priority emergency issues ones are fast tracked through the squad • Lower priority work is classified as incremental improvements and to the backlog for future prioritisation • Triage is owned by the Product Owner, with support from the BA & Tester As Required Product Owner Focus: Issues Squad SLA Support A day in the life of a Squad Co-Location • Desk area: Each squad area has a number of desks with long flat tables preferred to promote pairing and flexibility. Although desks are dedicated to named individuals to promote practices such as pairing and collaboration, desk moves are common to ensure co-location of people working on the same thing. • Where co-location is not possible (due to geographical boundaries) then the squad focus on tools (such as virtual collaboration tools) and working practices (such as shifting working hours) that minimise the disruption caused to delivery. Tools & Equipment • Hardware: Laptops and docking stations are linked to twin screens to maximize productivity. • Consumables: Squads need constant feeding with stationary such as Post-Its, Sharpies, Index Cards, etc. Collaboration • War Room: Each team has a meeting room with videoconferencing to avoid potential booking delays. This separate space provides team members with privacy when required. • Break Out Area: An informal collaboration space is required to provide a second space away from the formal work area. This separate space is ideal for presentations, design breakouts and informal discussions. Information Radiators • Whiteboards: Most walls are whiteboards to facilitate co-creation, innovation and the sharing of ideas. They are also useful for agile modeling, Kanban boards and big visible charts. • Screens: Large wall-mounted monitors are housed in the team area for information sharing, the desk area for agile dashboards and the huddle room for videoconferencing. Our EnvironmentStructure Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5 Product Owner Mission Validation Scrum Master SDLC Team Ease of Release Org. Support                        Continual Improvement Daily Focus: Story Level • Monitoring what is important to the Squad over time • Allows them to identify trends and take action to rectify issues • Allows continual inspection and adaption within the squad • Defined Squad Charter that defines the team beliefs and values • Builds upon higher level (org) values and Agile principles • Protects the team from individual personalities & acts as a reference point for new starters Continual Product Owner Focus: Live Service SRE SDLC Delivery (Sprint) Board • Standardised SDLC used to define ways of working across all teams • Defines segregation of duties within the team • Aim of SDLC is to release functionality into production • Process flow visualises what the team is working on • Allows self forming and prioritisation within the sprint • Forms basis of delivery capability reporting (i.e. throughput per sprint) • Can be physical (Whiteboard) or virtual (Jira) depending on co-location of squad members The majority of the squad s time will be taken up with tasks focused on delivery of the next most important thing into production. This is usually in the form of User Stories within the sprint backlog. Delivered functionality can be released to Live in a hidden state, for example feature toggled off. This enables the squad to continually ship code to production, whilst also allowing the organisation to optimize the time it goes in front of end users. Delivery Metrics Delivery KPIs Quality KPIs Continual Focus: Delivery • Focuses on the capability of the squad to deliver work items. • Different metrics used dependant on the methodology (ie burn downs, vs CFDs) • Used to highlight blockers to improve delivery – progress is reported on at epic level. • Focuses on the quality of the software delivered. • Aim is to focus on NFRs as well as reducing the overhead of maintaining the code • Can be used to drive the need for tech debt within the product backlog Continual Improvement within delivery is achieved by focusing on KPIs within the SDLC. These metrics are grouped into two areas: Delivery Metrics, which show how the team s ability to deliver improves over time, and Quality Metrics, which shows how the cost of the product is minimised. Once live, the product is owned by the squad who continually support it by using data to drive decisions. The Squad take ownership of product monitoring to ensure service is maintained. Alerting is used to inform the squad of current issues (basic alerting) or upcoming problems (pro-active alerting) and Logging and log aggregation tools are employed to facilitate problem resolution. • Shows how the product / service is operating within the real world • Wall boards and other tools used to focus on monitoring & alerting of the product • Allows the squad to move into a dev-ops model where they fully own the product from cradle to grave ROI Totalizer £ Agreed Evolution Point Agreed Roll Back Point Benefits KPIs • Focuses on the value shipped by the team • Links in with the expected benefits of the initiative • Can be used to drive Multi Variant Testing or Product Evolution decisions – minutes Squad Elaboration • Allows the squad to understand the story, ahead of taking it into delivery • Focuses on INVEST principles and shared understanding of the work Actual Predicted Days StoryPoints Squad Story Elaboration Board • Team works 1-2 sprints ahead in breaking things down. • Protects Squad from investing in things that aren t ready • Ensures known dependencies are in place Epic Breakdown (Story Backlog) Daily Product Owner Engineer Focus: Epic / Story QA Squads undertake their backlog management at a story level to ensure that the work going into sprint planning is sufficiently understood that there should be no known surprises. By using lean principles to work Just In Time the squad elaborates the stories ahead of the Sprint to minimise wasted effort. This allows them to reduce the time taken for sprint planning as it becomes a capacity discussion rather than an understanding and elaboration workshop. • Defines Story level backlog for a specific Epic • Allows team to prioritise / descope any work that is not critical to that outcome Incremental Improvements • Incremental changes are based on feedback and existing circumstances with the shipped product. • Often driven by operational metrics these can be either customer facing improvements, non-critical bugs, or tech debt. • Whilst the ideas for improvements can come from anywhere, the Technical Product Owner acts as guardian of what they wish the squad to invest in. • Large changes that don t align to the original goals of the in flight initiative are added as a new initiative. Continual Product Owner Customer Focus: Customer Feedback Operating Costs Default Rates Time Profit Data & Insight • Used to measure how the internal and external landscape has changed post feature release • Comprises of internal insight (i.e. KPIs) and external insight (such as customer feedback) • May require the assistance of teams outside of the delivery squad to obtain insight ... ... ...... ... ... ... ... ......... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... Epic Story Story Story Tech Task Story Product Owner Idea ! You Own It... Kanban Goal Meeting Virtual Sprints • The team wrap the continual delivery nature of Kanban with virtual time boxes • This provides a structured time frame for the team to assign goals to. • It also allows natural review points to introduce other ceremonies (i.e. team retrospectives) • Often called scrum ban Kanban Goals Goals are usually focus on one of 3 areas: • Metrics – i.e. reduce fortnightly cycle time to 3.4 days • Flow – i.e. reduce the number of cards in Ready for Test to 1 • Delivery – i.e. get all cards associated with Login complete by Friday Stretch Goals (expected vs exceptional) can be used to define success Non Time-box Variations • Delivery boxes (rather than time boxes) could be used to set goals • i.e. The 8 user stories needed for Login will have a cycle time of less than 4 days. • This allows the team to centre their focus on delivery around the actual product, rather than an artificial timebox. Whilst Kanban is focused on a continual delivery flow, rather than a time boxed delivery window, teams can still agree short term delivery goals to help focus in flight decision making. Engineer QA PO Delivery Teams are comprised of one or more Squads with a shared focus of building and supporting a product initiative. Guard rails exist around the number and roles of individuals within the squad to ensure that it remains a scalable unit. Self-contained, mini-startup unit - Co-located Skills include Development, Test, ID, OM, Design and SRE Automates everything as we build in support of making their Service(s) easy to deploy and operate Time from check in to library to live in production key metric Squad works from the prioritized backlog; may be responsible for more than one service Operates their Service(s), meaning that once a problem is observed, resolves the problem quickly (within SLA) and then eliminates root cause(s) to avoid future problems Everyone is on pager duty at some point Analyses available data – of the operation of the service, of usage / consumption / business metrics of the service, culture measures, of development velocity Encouraged to apply Lean (e.g. Pair Programming, MVP, learning using metrics and A/B to find out what resonates) Scrum master rotates among members periodically Squad Roadmap Planning Every Sprint / Month Product Owner Focus: Initiative Ad-hoc Squad Members Squads will prioritise delivery based off a defined roadmap, showing a high level view of what they will be building and when. This is usually framed by the delivery of a product initiative and will show the team s component deliverables, grouped by release. Dependencies are called out with estimated timeframes to mitigate risk to the team. This roadmap is initially drafted when the initiative is broken down during inception, but is continually updated after every time box (sprint / month) to report on progress. • Allows future capacity management and reporting for the squad • Shows Epic level deliverables • Epics prioritised by Technical Product Owner (with input from squad) • Grouped by time box (i.e. Month / Sprint) based on delivery capacity • Allows re-prioritisation by the product owner at any point ... ... ... ... ... ... ... ... ... ... ... ... ... Jan Feb Mar Apr May Feature / Epic Board Further information: http://bad.tools Organisational Design: Squads & Delivery Teams Feb 2019 Austen Bell | The BAD Toolkit Ltd.
  • 32. BADx
  • 34. Next event we will look at… Align Ideas to Strategic Investment Rapid Feedback on the Concept Understand the work Incremental Delivery Run & Evolve VMOST Discovery Inception Delivery Dev Ops Values & Culture Team Structures Product Areas Org Values Squads Tribes Empires ProcessPeople
  • 35. Find out More www.bad.tools #vmost #badtoolkit Try it yourself We can Help Implement it info@burendo.com
  • 36. Thank You – Q&A Time The BAD Toolkit