This talk is about how TripAdvisor Restaurants is implementing an Objectives and Key Results (OKR) framework to keep the handful of cross-functional Agile teams working towards our common goal. I’ll share how we got here, what we’ve learned, and where we’re headed. This talk will cover; How we define OKRs and how it has changed and grown with the team. What is an effective Objective? Key Results? How do we break down our quarterly/yearly OKRs down to individual sprints? This is Agile, right? How do we change things? Sounds really cool, but does it work? What’s next?

1. MAKE SOME NOISE!
#ProductTank
SPONSORED BY

4. TONIGHT’S EVENT SPONSORED BY
Thanks, Shopify!

5. Jonathan Laroque
Director of Product, Slice Labs
Jobs to be Done: A Primer
Benoît des Ligneris, Ph. D.
Sr. Product Manager, Shopify
MoSCoW Prioritization Method
Jeremy Biffis
Technical Manager, TripAdvisor
Objectives and Key Results at TripAdvisor
TONIGHT’S PRODUCTTANK SPEAKERS

6. Objectives and Key Results
at TripAdvisor
Jeremy Biffis
Technical Manager, TripAdvisor
#ProductTankOttawa

7. Objectives and Key Results
TripAdvisor Restaurants
7
Jeremy Biffis
Technical Manager,
TripAdvisor Restaurants

8. 8
● A framework to set goals
within your organization
● Objectives are what you want
to achieve
● Key Results are how you get
there
What Objectives & Key Results?

9. 9
WHAT is to be achieved:
● Concrete, significant, and action oriented
● Easy to tell when it has been completed
● Something hard to get, but reachable
● Must deliver VALUE -- The “So That” test
● Needs to be concise and easily understood
Objective
Definitions

10. 10
HOW we achieve the objective:
● Measurable and reportable
● These can be milestones along the way to completing the objective
● Achieving all of the KRs should complete the corresponding Objective
● Should be time bound
Key Result
Definitions

11. A Sample OKR
Objective:
Increase customers’ perceived value of Premium to add $x in annualized revenue.
Key Results:
● Build and ship 2 new features by Dec 1, 2019
● Improve conversion rate through cart by 5%
● Reduce value-based churn in December by 2%

12. Our OKR process

13. Our OKR process

14. Our OKR process

15. Our OKR process

16. What are the Advantages?
16
● We are MUCH more effective
● We stay focused on what matters
● Allows us to say ‘No’ to things that are not
part of the plan
● Gives us a framework to understand what
happens when we want to make a change
to the plan
● Have to consider the business side of
things

17. Everyone is committed to our success
17
● Every engineer knows what the OKRs that
we are committed to because they helped
to make them!
● We push these KRs through Slack
channels, email blasts, and a TV in our
office
● Teams are working better together with
shared Objectives and know what is
expected of them

18. 18
Objective: Key Result
Demonstrably increase Premium sales by adding new
subscriber benefits and features.
Add $xxxxx new annualized revenue
Better enable Key Accounts Team to sell their products. Unlock $xxxx in new Key Accounts Team MRR
Enhance invoicing and implement best practices for
accounting
- Reduce billing failures by 75%
- Support Key Accounts sales
- Add monitoring / alerting when key accounting issues
arise.
Some not so great OKRs

19. What we came up with
Objective: Increase customers’ perceived value of Premium to add
$xxxx in annualized revenue.
Key Results
● Build and ship 2 new features by Dec 1, 2019
● Improve conversion rate through cart by 5%
● Reduce value-based churn in December by 2%
Objective: Give proper tools & products to KASM team to realize
$xxxx in incremental MRR in Q4
Key Results
● Enable Premium manual billing by Oct 15, 2019
● Increase lead generation by 20 locations per month
● Eliminate dependencies on development in the sales process
by Dec 31, 2019
19
Objective
Drastically reduce the number of billing issues dealt with by
accounting and support.
Key Results
● Document how complex billing accounts should look like by
Nov 15, 2019
● Create a script/job to identify non-compliant billing accounts
in the database by Nov 30, 2019
● Reduce non-compliant billing accounts by 75%
● 100% correct billing accounts created after Dec 25, 2019
● Maximum of 2 reported billing issues per week after Dec 1,
2019

20. We are more Effective
20
75% Growth in Team

21. We are more Effective
21
300% Growth in Story Points delivered