2. Goal: Understand user base and how
they interact with the product
Novices
Power Users
● Who are the users?
● Which SQL errors do they make?
● How can we make users'
experience better?
● Why do users churn?
● Can we personalize product
response for different users?
3. Goal: Understand user base and how
they interact with the product
● Who are the users?
● Which SQL errors do they make?
● How can we make users'
experience better?
● Why do users churn?
● Can we personalize product
response for different users?
Novices
Power Users
4. Time
Churn – Are users getting frustrated?
Successful
query
SQL
error
7. Churning Users = Tutorial Users
Recommendation: prompt tutorial users to connect their
own data at tutorial conclusion
8. Can we personalize product
response for different users?
Expert?
Novice?New User
9. Classifying Experts vs. Novices
Bag of
SQL
keywords
Formatting based:
– White space
– Parentheses
Keyword diversity
Is it an Error?
Error type
Random
Forest
10. Bag of
SQL
keywords
Formatting based:
– White space
– Parentheses
Keyword diversity
Is it an Error?
Error type
Random
Forest
AUC = 0.66
Classifying Experts vs. Novices
12. Summary
● Who are the users?
● Which SQL errors do they make?
● How can we make users'
experience better?
● Do users churn out of frustration?
● Can we personalize product
response for different users?
Expert?
Novice?