What is Firebase? How do we use it to measure user engagement and how do we do A/B tests?

1. Introduction To

2. • Firebase is a mobile and web application development platform acquired by Google.
• All-in-one backend solutions for the developers.
• Platform independent.
• Firebase automatically generates server-side codes which helps the developers to build
rich collaborating apps or websites.

3. Allows you to measure user engagement and track user behavior within your
application.
• User activity by cohort
• Conversion events
• In-app purchases or Google AdMob.
• Dashboard.
• How stable is your app
• How people react to the new version
• Retention of new users.
• Demographic Details

4. • AB TESTING
• Also known as split testing in which we
test different versions at the same time.
• We notice which version gets the best
response from the user.
• Monitor one or two results (Level
completion, Mode selection, etc)

8. Types Ab testing
There are Three operations on which we can perform
AB testing
• Notification AB Testing
• Remote or app configuration AB Testing
• In-app Purchasing AB Testing

9. Notification AB Testing
• Overview: Experimenting with different versions of
notifications sent to users to determine which content, timing,
or format is more effective in engaging users
• Purpose: The primary goal is to optimize the performance of
push notifications, in-app messages, or any other form of
communication delivered outside the app.
• Examples: Testing different wording, images, or timing of
push notifications to see which variation leads to higher click-
through rates or user engagement.

10. App configuration
• Overview: Experiment with different configurations or
settings within the app to identify the most effective
setup for user engagement or specific features.
• Purpose: To find the optimal combination of features,
UI elements, or settings that improve user satisfaction,
retention, or other key performance metrics.
• Examples: Testing variations of user interface layouts,
color schemes, feature placements, or default settings
to see which configuration results in better user
experiences and outcomes.

11. • Overview: Experiment with different pricing
models, promotional offers, or purchase-related
features to maximize revenue generated from in-
app transactions.
• Purpose: To identify the pricing strategy or
promotional tactics that lead to higher conversion
rates and increased revenue from in-app purchases
• Examples: Testing different price points for virtual
goods, offering discounts or bundles, or
experimenting with the timing and placement of
purchase prompts to understand their impact on
user spending.
In-App Purchase A/B Testing:

12. How AB Testing works
• Measure
• Test
• Evaluate
• Optimize
This process needs to continue as far as many iterations possible it's a continuous process
that never ends, and practical real issues limit it to some extent where testing stops and
marketing begins.

13. Measuring
Measuring is one of the most important aspects of AB testing Nothing can be tested
properly unless it has been measured. Many factors can be measured but the key
factors are.
• Hits or delivered visitors.
• CTR (Click through ratio).
• Sales.
• Conversion vs CTR.

14. Testing
Testing is the procedure of creating two variations and
measuring their success agains one constant.

15. Evaluation
The evaluation process compares the vectors that have been measured.
The control is then set to the best-performing variation (A or B which
becomes the new A)
The exact definition of best performance will depend on the goals of
the marketing process.

16. Optimization
The optimization process takes the best-performing A/B spits by category
( design, layout, etc ) and then combines them to produce the best overall
content test.
It is quite an important aspect to continue the test even after the optimization is
completed the whole process is not over because small changes can make a huge
difference in converting leads into the paying customers.