SlideShare a Scribd company logo
1 of 36
Download to read offline
Resource Hugging
July 2013
About me
Paul Robbins
API Product Manager
About Knewton
Education Technology start-up
Focus on personalized learning by utilizing
big data and machine learning
Scope Creep
Uncontrolled changes to a project plan
Why
Unclear requirements and goals
Why
Deficient change management
Why
Poor communication
Resource Hugging
n. A type of scope creep where stakeholders
believe they will never get these resources
back on their project for a long time
Case Study
The New York Times Best Sellers
Case Study - Best Sellers
Project Overview:
■ New design w/ NYT custom webfonts
■ Switch to APIs backed data
■ Ability to navigate to previous weeks
Case Study - Best Sellers
New design
Case Study - Best Sellers
API backed data
Case Study - Best Sellers
Case Study - Best Sellers
View previous week's lists
Case Study - Best Sellers
Case Study - Best Sellers
What went wrong from the start:
■ Only "requirements" were the just the project
goals
■ Product owner was really just business
development lead
■ Features driven by design team
Case Study - Best Sellers
6 weeks in, launch approaching...
Case Study - Best Sellers
Case Study - Best Sellers
"But we want it to go back to 5 previous
years worth of history"
■ API only supported 18 months
■ Previously used data store wasn't organized to
be historic (was treated like an article in the
paper, publish once and move on)
Case Study - Best Sellers
"Buy button should go directly to book
URL"
■ Old application went to a "list" view on Amazon
or local bookseller website
■ "Can you add in B&N links the week of launch,
too?"
Case Study - Best Sellers
3 months in, we finally launched
A certain kind of scope
creep
Wasn't just a desire for a more robust
product, they were truly worried no
developer team would touch their
product for another two years
Primary scope creep
Initial scope creep should have been
addressed
■ Actual requirements, not just "mimic" old logic
■ Clearer tracking of changes
■ More concrete milestone and launch dates
Resource hugging
Requires some additional strategies:
Resource hugging
Actually iterate
■ Schedule a phase II for 2-3 weeks after launch
■ Bug fixes, user feedback, etc
■ Ensure items descoped from phase I are
addressed (or publicly cut) from phase II
Resource hugging
Matrix the developers, not the team
■ Have an assigned team
■ Members may swap teams
■ Teams may expand or contract
Resource hugging
Close-out as important as kick-off
■ Post mortem on negative impacts
■ Discuss why features were left on the table
■ Measure success and organize check-ins
Not just new projects
Resource hugging happens often on
projects in "maintenance mode"
Maintenance mode
You decide to fix bugs or add features,
but not make a new project
■ People come out of the woodwork with new
requests -- "now is my only chance"
■ 1 week of "bugs" becomes a month of dragged
out drudgery
Maintenance mode
Have a running backlog of bugs and new
features
■ Keep it constantly up to date
■ Draw a circle around the changes as part of this
"bug fix" round and stick to that list
■ Any other bombardment of new request goes
into the queue for prioritization on the next
round
Stop hugging me
Call out when resource hugging happens
■ Refer to the rationale of other higher priorities,
make the plan of record known
■ Be diligent in managing all aspects of scope
creep and resource hugging likelihood will be
diminished
Questions?
Paul Robbins
API Product Manager
Knewton
@robbinspaul
paul@knewton.com

More Related Content

Viewers also liked

Managing Scope Creep & Client Expectations
Managing Scope Creep & Client ExpectationsManaging Scope Creep & Client Expectations
Managing Scope Creep & Client ExpectationsTera Simon
 
Top client retention strategies
Top client retention strategiesTop client retention strategies
Top client retention strategiesVeronika Tondon
 
Client management.ppt
Client management.pptClient management.ppt
Client management.pptAlex de Jong
 
Customer Relationship Management (CRM)
Customer Relationship Management (CRM)Customer Relationship Management (CRM)
Customer Relationship Management (CRM)Jaiser Abbas
 

Viewers also liked (7)

Managing Scope Creep & Client Expectations
Managing Scope Creep & Client ExpectationsManaging Scope Creep & Client Expectations
Managing Scope Creep & Client Expectations
 
Social Media
Social MediaSocial Media
Social Media
 
Client management
Client managementClient management
Client management
 
Top client retention strategies
Top client retention strategiesTop client retention strategies
Top client retention strategies
 
Client management.ppt
Client management.pptClient management.ppt
Client management.ppt
 
Customer Relationship Management (CRM)
Customer Relationship Management (CRM)Customer Relationship Management (CRM)
Customer Relationship Management (CRM)
 
Crm final ppt
Crm final pptCrm final ppt
Crm final ppt
 

Similar to Resource hugging presentation

Agile: Not Just for Sofware
Agile: Not Just for SofwareAgile: Not Just for Sofware
Agile: Not Just for SofwareJohn Carter
 
Feature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PMFeature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PMProduct School
 
Agile Methods to Develop Tangible Products Quickly
Agile Methods to Develop Tangible Products QuicklyAgile Methods to Develop Tangible Products Quickly
Agile Methods to Develop Tangible Products QuicklyJohn Carter
 
Primavera- Increasing Utilization through Change Management
Primavera- Increasing Utilization through Change ManagementPrimavera- Increasing Utilization through Change Management
Primavera- Increasing Utilization through Change Managementp6academy
 
Applying Agile Team Management
Applying Agile Team ManagementApplying Agile Team Management
Applying Agile Team ManagementHuan Ho
 
How to Create a Product Management Process That Doesn't Suck
How to Create a Product Management Process That Doesn't SuckHow to Create a Product Management Process That Doesn't Suck
How to Create a Product Management Process That Doesn't SuckIntelligent_ly
 
The Development Graveyard: How Software Projects Die
The Development Graveyard: How Software Projects DieThe Development Graveyard: How Software Projects Die
The Development Graveyard: How Software Projects DieErika Barron
 
Agile practices for management
Agile practices for managementAgile practices for management
Agile practices for managementIcalia Labs
 
Req-usingDesignSprint.pdf
Req-usingDesignSprint.pdfReq-usingDesignSprint.pdf
Req-usingDesignSprint.pdfBoykepaulus1
 
5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PM5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PMProduct School
 
Lci la chapter lean intro 071410 no pics
Lci la chapter lean intro 071410 no picsLci la chapter lean intro 071410 no pics
Lci la chapter lean intro 071410 no picshaganone
 
Learning from the Trenches: Scrum for Hardware
Learning from the Trenches: Scrum for HardwareLearning from the Trenches: Scrum for Hardware
Learning from the Trenches: Scrum for HardwareJohn Carter
 
Applying both of waterfall and iterative development
Applying both of waterfall and iterative developmentApplying both of waterfall and iterative development
Applying both of waterfall and iterative developmentDeny Prasetia
 
Myths of Product Development
Myths of Product DevelopmentMyths of Product Development
Myths of Product DevelopmentShoaib Shaukat
 
Build your winning product in two weeks
Build your winning product in two weeksBuild your winning product in two weeks
Build your winning product in two weeksQuan Truong
 
Beyond Projects/#NoProjects
Beyond Projects/#NoProjectsBeyond Projects/#NoProjects
Beyond Projects/#NoProjectsallan kelly
 
Post Mortems: The Anatomy of Market Research Process Improvement
Post Mortems: The Anatomy of Market Research Process ImprovementPost Mortems: The Anatomy of Market Research Process Improvement
Post Mortems: The Anatomy of Market Research Process ImprovementKathryn Korostoff
 

Similar to Resource hugging presentation (20)

Agile: Not Just for Sofware
Agile: Not Just for SofwareAgile: Not Just for Sofware
Agile: Not Just for Sofware
 
Feature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PMFeature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PM
 
Agile Methods to Develop Tangible Products Quickly
Agile Methods to Develop Tangible Products QuicklyAgile Methods to Develop Tangible Products Quickly
Agile Methods to Develop Tangible Products Quickly
 
Primavera- Increasing Utilization through Change Management
Primavera- Increasing Utilization through Change ManagementPrimavera- Increasing Utilization through Change Management
Primavera- Increasing Utilization through Change Management
 
Applying Agile Team Management
Applying Agile Team ManagementApplying Agile Team Management
Applying Agile Team Management
 
How to Create a Product Management Process That Doesn't Suck
How to Create a Product Management Process That Doesn't SuckHow to Create a Product Management Process That Doesn't Suck
How to Create a Product Management Process That Doesn't Suck
 
Agile Methodology
Agile MethodologyAgile Methodology
Agile Methodology
 
The Development Graveyard: How Software Projects Die
The Development Graveyard: How Software Projects DieThe Development Graveyard: How Software Projects Die
The Development Graveyard: How Software Projects Die
 
Agile practices for management
Agile practices for managementAgile practices for management
Agile practices for management
 
Req-usingDesignSprint.pdf
Req-usingDesignSprint.pdfReq-usingDesignSprint.pdf
Req-usingDesignSprint.pdf
 
Adamson "Initiating the Project"
Adamson "Initiating the Project"Adamson "Initiating the Project"
Adamson "Initiating the Project"
 
5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PM5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PM
 
Lci la chapter lean intro 071410 no pics
Lci la chapter lean intro 071410 no picsLci la chapter lean intro 071410 no pics
Lci la chapter lean intro 071410 no pics
 
Learning from the Trenches: Scrum for Hardware
Learning from the Trenches: Scrum for HardwareLearning from the Trenches: Scrum for Hardware
Learning from the Trenches: Scrum for Hardware
 
Applying both of waterfall and iterative development
Applying both of waterfall and iterative developmentApplying both of waterfall and iterative development
Applying both of waterfall and iterative development
 
Myths of Product Development
Myths of Product DevelopmentMyths of Product Development
Myths of Product Development
 
mg7.pptx
mg7.pptxmg7.pptx
mg7.pptx
 
Build your winning product in two weeks
Build your winning product in two weeksBuild your winning product in two weeks
Build your winning product in two weeks
 
Beyond Projects/#NoProjects
Beyond Projects/#NoProjectsBeyond Projects/#NoProjects
Beyond Projects/#NoProjects
 
Post Mortems: The Anatomy of Market Research Process Improvement
Post Mortems: The Anatomy of Market Research Process ImprovementPost Mortems: The Anatomy of Market Research Process Improvement
Post Mortems: The Anatomy of Market Research Process Improvement
 

Recently uploaded

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 

Recently uploaded (20)

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 

Resource hugging presentation

  • 2. About me Paul Robbins API Product Manager
  • 3. About Knewton Education Technology start-up Focus on personalized learning by utilizing big data and machine learning
  • 8. Resource Hugging n. A type of scope creep where stakeholders believe they will never get these resources back on their project for a long time
  • 9. Case Study The New York Times Best Sellers
  • 10. Case Study - Best Sellers Project Overview: ■ New design w/ NYT custom webfonts ■ Switch to APIs backed data ■ Ability to navigate to previous weeks
  • 11. Case Study - Best Sellers New design
  • 12.
  • 13.
  • 14. Case Study - Best Sellers API backed data
  • 15. Case Study - Best Sellers
  • 16. Case Study - Best Sellers View previous week's lists
  • 17. Case Study - Best Sellers
  • 18. Case Study - Best Sellers What went wrong from the start: ■ Only "requirements" were the just the project goals ■ Product owner was really just business development lead ■ Features driven by design team
  • 19. Case Study - Best Sellers 6 weeks in, launch approaching...
  • 20. Case Study - Best Sellers
  • 21. Case Study - Best Sellers "But we want it to go back to 5 previous years worth of history" ■ API only supported 18 months ■ Previously used data store wasn't organized to be historic (was treated like an article in the paper, publish once and move on)
  • 22. Case Study - Best Sellers "Buy button should go directly to book URL" ■ Old application went to a "list" view on Amazon or local bookseller website ■ "Can you add in B&N links the week of launch, too?"
  • 23.
  • 24. Case Study - Best Sellers 3 months in, we finally launched
  • 25.
  • 26. A certain kind of scope creep Wasn't just a desire for a more robust product, they were truly worried no developer team would touch their product for another two years
  • 27. Primary scope creep Initial scope creep should have been addressed ■ Actual requirements, not just "mimic" old logic ■ Clearer tracking of changes ■ More concrete milestone and launch dates
  • 28. Resource hugging Requires some additional strategies:
  • 29. Resource hugging Actually iterate ■ Schedule a phase II for 2-3 weeks after launch ■ Bug fixes, user feedback, etc ■ Ensure items descoped from phase I are addressed (or publicly cut) from phase II
  • 30. Resource hugging Matrix the developers, not the team ■ Have an assigned team ■ Members may swap teams ■ Teams may expand or contract
  • 31. Resource hugging Close-out as important as kick-off ■ Post mortem on negative impacts ■ Discuss why features were left on the table ■ Measure success and organize check-ins
  • 32. Not just new projects Resource hugging happens often on projects in "maintenance mode"
  • 33. Maintenance mode You decide to fix bugs or add features, but not make a new project ■ People come out of the woodwork with new requests -- "now is my only chance" ■ 1 week of "bugs" becomes a month of dragged out drudgery
  • 34. Maintenance mode Have a running backlog of bugs and new features ■ Keep it constantly up to date ■ Draw a circle around the changes as part of this "bug fix" round and stick to that list ■ Any other bombardment of new request goes into the queue for prioritization on the next round
  • 35. Stop hugging me Call out when resource hugging happens ■ Refer to the rationale of other higher priorities, make the plan of record known ■ Be diligent in managing all aspects of scope creep and resource hugging likelihood will be diminished
  • 36. Questions? Paul Robbins API Product Manager Knewton @robbinspaul paul@knewton.com