Data Driven Product Development

•

2 likes•467 views

How to develop a product leaving all decisions to make by the users? Through to make hypotheses, metrics, ab tests and data analysis, all decisions is on users. That presentation focus on how this process works on GloboPlay.

Data & Analytics

H Y P O T H E S E S , M E T R I C S , A / B T E S T A N D D ATA A N A LY S I S
Data Driven Product Development
J U L Y / 2 0 1 8 @ F I S L
A B

Software Engineer @ GloboPlay
MSc in Computer Science @ UFCG
M a r c o R o s n e r
A B

Status
Hypotheses
Metrics
A/B test
Data analysis
Conclusions
What is the next step?
Agenda
A B

H Y P O T H E S E S
If we focus on subscription when user
trying to watching videos, we believe that
we got more subscribers.
M E T R I C
Subscriptions and Conversion
D U R AT I O N
1 week
D E V I C E S
Onboarding Subscribers

Desktop Controle
S A M P L E : 8 4 %
A LT E R N AT I V E S

without-disclaimer
S A M P L E : 8 %
with-disclaimer
S A M P L E : 8 %
A LT E R N AT I V E S

H Y P O T H E S E S
If we focus on more information about the
video, we got more engagement with our
users
M E T R I C S
Video flow
D U R AT I O N
1 week
D E V I C E S
Changes on Video Stage

vs.
D E F A U L T N E W
A LT E R N AT I V E S

H Y P O T H E S E S
If we focus on show more videos on
playlist, we got more engagement with our
users
M E T R I C S
Video flow
D U R AT I O N
1 week
D E V I C E S
Changes on video playlist

D E F A U L T N E W
vs.
A LT E R N AT I V E S

Marco Rosner
marco.rosner@corp.globo.com
@marcorosner

Similar to Data Driven Product Development

Grants Managers Share and Learn Webinar by WizeHIve

WizeHive

Social Video - What's Next?

Brightcove

Realtime Learning: Using Triggers to Know What the ?$# is Going On

Domino Data Lab

The Power of Bringing Your Fans Into the Marketing Mix

BSI

Online Tool Utilization for Nonprofits

Ash Shepherd

Lean Startup Zurich- An Introduction to Lean Startup Methodology

Neha Shah

Applying Lessons from API Development to Healthcare Enterprise Integrations

Redox Engine

Intro to Data Analytics with Oscar's Director of Product

Product School

As a product manager, you probably know specific ways to gather data to inform your product decisions, like the ever-popular A/B test. But as they say, you wouldn't put a round peg in a square hole. What about the times when it doesn't make sense to A/B test, because you have too small a sample size? Do you just do it anyway, because your company's product culture requires that you have those numbers? Tim Herbig will share his hands-on approach to working with analytics in agile product management. Tim will discuss the line between being data-informed versus data-driven. The audience will leave with an analysis toolkit filled with the right data tools for every scenario. Data validation won't be an issue again.

Analytics in Action: How to Build Data-Informed Products

Aggregage

Analytics in Action: How to Build Data-Informed Products

Hannah Flynn

Social Video Analytics

Repustate

The Harvard Humanitarian Initiative research team led by Jennifer Chan and Melissa Tully, supported by the Knight Foundation, conducted evaluation research. Over the year, they interviewed Kenyan Ushahidi deployers, specifically those participating in Uchaguzi, Unsung Heros and Building Bridges, and had community members help shape the research deliverables. Evaluation to action was a key goal of the project. Their research resulted in the creation of three toolboxes to assist users in the various stages of their Ushahidi deployments: Assessment, Implementation and Outputs.

Ushahidi Deployment - Output Toolbox

Ushahidi

Witness curriculum 1-powerpoint-setting ground rules and feedback sessions-2011

WITNESScurriculum

Akhil_Portfolio.pdf

Akhil Pillai

Although we haven't formally tested our hypothesized Value Proposition with businesses yet, our findings show End-User Value Proposition is in fact valid. (In our view, this is what matters the most as these end-users represent the driving force for the businesses that serve them.) Our value proposition to businesses: - Better audience engagement - User-generated content - Analytics - Lead generation through discussion spread over different social channels Our value proposition to end-users: - Better discussion experience - Richer experience with the ability to take notes, ask questions and see others' notes and questions IN context - Social media integration of comments and discussions - Higher retention as you get to highlight, write and annotate the video like you'd do with a book

"Testing Our Value Proposition" by Adventure Lab - Venture Lab 2012

Annie Paul

LSC Technology Initiative Grant Conference 2015 | Session Materials - Trust t...

Legal Services Corporation

Why an Indian Oxygen Plant Manufacturer is a good Choice?

Trimech India

How Data Can Make You More Creative

Todd Green

YouTube Trending List: An Analysis of the Factors that Influence Video Trendi...

Brendan Sigale

Online Live Tv: The Future of Live Linear Consumption in the Philippines

Martin Andanar

Similar to Data Driven Product Development (20)

Grants Managers Share and Learn Webinar by WizeHIve

Social Video - What's Next?

Realtime Learning: Using Triggers to Know What the ?$# is Going On

The Power of Bringing Your Fans Into the Marketing Mix

Online Tool Utilization for Nonprofits

Lean Startup Zurich- An Introduction to Lean Startup Methodology

Applying Lessons from API Development to Healthcare Enterprise Integrations

Intro to Data Analytics with Oscar's Director of Product

Analytics in Action: How to Build Data-Informed Products

Social Video Analytics

Ushahidi Deployment - Output Toolbox

Witness curriculum 1-powerpoint-setting ground rules and feedback sessions-2011

Akhil_Portfolio.pdf

"Testing Our Value Proposition" by Adventure Lab - Venture Lab 2012

LSC Technology Initiative Grant Conference 2015 | Session Materials - Trust t...

Why an Indian Oxygen Plant Manufacturer is a good Choice?

How Data Can Make You More Creative

YouTube Trending List: An Analysis of the Factors that Influence Video Trendi...

Online Live Tv: The Future of Live Linear Consumption in the Philippines

Recently uploaded

MQU毕业证原版定制【微信：176555708】【麦考瑞大学毕业证成绩单-学位证】【微信：176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。 ◆◆◆◆◆ — — — — — — — — 【留学教育】留学归国服务中心 — — — — — -◆◆◆◆◆ 【主营项目】一.毕业证【微信：176555708】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！二.真实使馆公证(即留学回国人员证明,不成功不收费) 三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度) 如果您处于以下几种情况： ◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【微信：176555708】 ◇面对父母的压力，希望尽快拿到； ◇不清楚认证流程以及材料该如何准备； ◇回国时间很长，忘记办理； ◇回国马上就要找工作，办给用人单位看； ◇企事业单位必须要求办理的 ◇需要报考公务员、购买免税车、落转户口 ◇申请留学生创业基金留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分→ 【关于价格问题（保证一手价格）我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！学历顾问：微信：176555708

一比一原版麦考瑞大学毕业证成绩单如何办理

cyebo

basics of data science with application areas.pdf

vyankatesh1

Jpolillo Amazon PPC - Bid Optimization Sample

James Polillo

Artificial_General_Intelligence__storm_gen_article.pdf

scitechtalktv

2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...

elinavihriala

2024 Q1 Tableau User Group Leader Quarterly Call

lward7

Tabula.io Cheatsheet: automate your data workflows

alex933524

Exploratory Data Analysis - Dilip S.pptx

DilipVasan

WSU毕业证原版定制【微信：176555708】【西悉尼大学毕业证成绩单-学位证】【微信：176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。 ◆◆◆◆◆ — — — — — — — — 【留学教育】留学归国服务中心 — — — — — -◆◆◆◆◆ 【主营项目】一.毕业证【微信：176555708】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！二.真实使馆公证(即留学回国人员证明,不成功不收费) 三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度) 如果您处于以下几种情况： ◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【微信：176555708】 ◇面对父母的压力，希望尽快拿到； ◇不清楚认证流程以及材料该如何准备； ◇回国时间很长，忘记办理； ◇回国马上就要找工作，办给用人单位看； ◇企事业单位必须要求办理的 ◇需要报考公务员、购买免税车、落转户口 ◇申请留学生创业基金留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分→ 【关于价格问题（保证一手价格）我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！学历顾问：微信：176555708

一比一原版西悉尼大学毕业证成绩单如何办理

pyhepag

Fuzzy Sets decision making under information of uncertainty

RafigAliyev2

Pi is not launched yet on any exchange, it is not sellable, but you can actually exchange your pi network coins to other currencies such as Bitcoin, USDT and many others. By selling your pi network coins to investors and holders of the coins. How can I find a pi network investor Lol, you don't need to find a investor all you have to do is to sell your pi coins to a vendor [ buys from miners and resells to the holders] I will leave the telegram handle of my personal pi network vendor to trade Pi coins with. @Pi_vendor_247 Thanks for reading 🙏

how can i exchange pi coins for others currency like Bitcoin

DOT TECH

Pre-ProductionImproveddsfjgndflghtgg.pptx

Stephen266013

Even tho pi not launched globally, crypto whales, holders, investors are looking forward to hold up to 20,000 pi coins before mainnet launch in 2026. All a miner or pioneer has to do to sell is to get in contact with a legitimate pi vendor ( a person that buys pi coins from miners and resell them to investors) I will leave the telegram contact of my personal pi vendor: @Pi_vendor_247 #pi network #pi 2024 #sell pi

How can I successfully sell my pi coins in Philippines?

DOT TECH

2024 Q2 Orange County (CA) Tableau User Group Meeting

Alison Pitt

Supply chain analytics to combat the effects of Ukraine-Russia-conflict

Jack Cole

Saudi Arabia [ Abortion pills) Jeddah/riaydh/dammam/+966572737505☎️] cytotec tablets uses abortion pills 💊💊 How effective is the abortion pill? 💊💊 +966572737505) "Abortion pills in Jeddah" how to get cytotec tablets in Riyadh " Abortion pills in dammam*💊💊 The abortion pill is very effective. If you’re taking mifepristone and misoprostol, it depends on how far along the pregnancy is, and how many doses of medicine you take:💊💊 +966572737505) how to buy cytotec pills At 8 weeks pregnant or less, it works about 94-98% of the time. +966572737505[ 💊💊💊 At 8-9 weeks pregnant, it works about 94-96% of the time. +966572737505) At 9-10 weeks pregnant, it works about 91-93% of the time. +966572737505)💊💊 If you take an extra dose of misoprostol, it works about 99% of the time. At 10-11 weeks pregnant, it works about 87% of the time. +966572737505) If you take an extra dose of misoprostol, it works about 98% of the time. In general, taking both mifepristone and+966572737505 misoprostol works a bit better than taking misoprostol only. +966572737505 Taking misoprostol alone works to end the+966572737505 pregnancy about 85-95% of the time — depending on how far along the+966572737505 pregnancy is and how you take the medicine. +966572737505 The abortion pill usually works, but if it doesn’t, you can take more medicine or have an in-clinic abortion. +966572737505 When can I take the abortion pill?+966572737505 In general, you can have a medication abortion up to 77 days (11 weeks)+966572737505 after the first day of your last period. If it’s been 78 days or more since the first day of your last+966572737505 period, you can have an in-clinic abortion to end your pregnancy.+966572737505 Why do people choose the abortion pill? Which kind of abortion you choose all depends on your personal+966572737505 preference and situation. With+966572737505 medication+966572737505 abortion, some people like that you don’t need to have a procedure in a doctor’s office. You can have your medication abortion on your own+966572737505 schedule, at home or in another comfortable place that you choose.+966572737505 You get to decide who you want to be with during your abortion, or you can go it alone. Because+966572737505 medication abortion is similar to a miscarriage, many people feel like it’s more “natural” and less invasive. And some+966572737505 people may not have an in-clinic abortion provider close by, so abortion pills are more available to+966572737505 them. +966572737505 Your doctor, nurse, or health center staff can help you decide which kind of abortion is best for you. +966572737505 More questions from patients: Saudi Arabia+966572737505 CYTOTEC Misoprostol Tablets. Misoprostol is a medication that can prevent stomach ulcers if you also take NSAID medications. It reduces the amount of acid in your stomach, which protects your stomach lining. The brand name of this medication is Cytotec®.+966573737505) Unwanted Kit is a combination of two medicines

Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec

Abortion pills in Riyadh +966572737505 get cytotec

AI Imagen for data-storytelling Infographics.pdf

MichaelSenkow

How I opened a fake bank account and didn't go to prison

Payment Village

Slip-and-fall Injuries: Top Workers' Comp Claims

Bisnar Chase Personal Injury Attorneys

Bridge the Gap Between Data and Decisions: Master Data Science Course using Machine Learning Empower yourself with the in-demand skills of data science and machine learning through our dynamic Applied Hybrid Training program! This innovative data science course seamlessly blends classroom instruction with online learning, providing a well-rounded foundation for your data science journey. Learn to unlock the power of data and leverage machine learning algorithms to solve real-world challenges. Uncover the Magic Behind the Data: Machine Learning Fundamentals: Demystify the concepts of machine learning algorithms and explore their practical applications across various industries. Python Programming Prowess: Gain hands-on experience with Python, the language of choice for data science. Learn how to leverage its libraries and tools to implement machine learning models effectively. Data Wrangling Expertise: Master techniques for handling and manipulating datasets from diverse fields. Understand how to prepare data for optimal use with machine learning algorithms. Actionable Insights from Algorithms: Discover how to interpret machine learning outputs and translate them into actionable insights that drive real-world results. Data Communication Mastery: Learn to communicate your data science findings with clarity and impact, effectively presenting the results of your machine learning models. By the end of this Data Science Course using Machine Learning, you will have enough knowledge and hands-on expertise in Python to use and apply them in the real world around you. Also, you will be able to get prepared for certifications of Data Camp and Cognitive AI.

Machine Learning For Career Growth..pptx

benishzehra469

Recently uploaded (20)

一比一原版麦考瑞大学毕业证成绩单如何办理

basics of data science with application areas.pdf

Jpolillo Amazon PPC - Bid Optimization Sample

Artificial_General_Intelligence__storm_gen_article.pdf

2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...

2024 Q1 Tableau User Group Leader Quarterly Call

Tabula.io Cheatsheet: automate your data workflows

Exploratory Data Analysis - Dilip S.pptx

一比一原版西悉尼大学毕业证成绩单如何办理

Fuzzy Sets decision making under information of uncertainty

how can i exchange pi coins for others currency like Bitcoin

Pre-ProductionImproveddsfjgndflghtgg.pptx

How can I successfully sell my pi coins in Philippines?

2024 Q2 Orange County (CA) Tableau User Group Meeting

Supply chain analytics to combat the effects of Ukraine-Russia-conflict

Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec

AI Imagen for data-storytelling Infographics.pdf

How I opened a fake bank account and didn't go to prison

Slip-and-fall Injuries: Top Workers' Comp Claims

Machine Learning For Career Growth..pptx

Data Driven Product Development

1. H Y P O T H E S E S , M E T R I C S , A / B T E S T A N D D ATA A N A LY S I S Data Driven Product Development J U L Y / 2 0 1 8 @ F I S L A B

2. Software Engineer @ GloboPlay MSc in Computer Science @ UFCG M a r c o R o s n e r A B

3. Status Hypotheses Metrics A/B test Data analysis Conclusions What is the next step? Agenda A B

4. Status

5. Building a culture A B

6. Growth time A B

7. ~70 AB tests in 2017 A B

8. Building knowledge A B

9. Hypotheses

10. What is the problem?

11. Which are the solutions?

12. What is a good sample size?

13. Document it!

14. Metrics

15. One Metric That Matters

16. Supporting metrics

17. How much time is needed?

18. Document it!

19. Keep watching

20. A/B test

21. A B What is an AB test?

22. AB test structure on Globo.com A B

23. How to code an A/B test? A B

24. H Y P O T H E S E S If we focus on subscription when user trying to watching videos, we believe that we got more subscribers. M E T R I C Subscriptions and Conversion D U R AT I O N 1 week D E V I C E S Onboarding Subscribers

25. Desktop Controle S A M P L E : 8 4 % A LT E R N AT I V E S

26. without-disclaimer S A M P L E : 8 % with-disclaimer S A M P L E : 8 % A LT E R N AT I V E S

27. H Y P O T H E S E S If we focus on more information about the video, we got more engagement with our users M E T R I C S Video flow D U R AT I O N 1 week D E V I C E S Changes on Video Stage

28. vs. D E F A U L T N E W A LT E R N AT I V E S

29. H Y P O T H E S E S If we focus on show more videos on playlist, we got more engagement with our users M E T R I C S Video flow D U R AT I O N 1 week D E V I C E S Changes on video playlist

30. D E F A U L T N E W vs. A LT E R N AT I V E S

31. Data analysis

32. Growth time

33. Notebook

34. Conﬁdence index

35. Conclusions

36. Focus on user A B

37. Building a Culture A B

38. Building knowledge A B

39. Understand your product A B

40. Understand your users A B

41. Understand your context A B