The document discusses the implementation and challenges of machine learning in the ad tech industry, focusing on real-time bidding (RTB) workflows and model training methodologies. It highlights the use of various algorithms, including logistic regression and deep learning, detailing the machine learning stack developed to address specific needs not met by existing frameworks. Additionally, it emphasizes the importance of feature transformation, model deployment, and the evaluation of models through offline experiments.

1. Cyrille Dubarry
Han Ju
Machine Learning for AdTech in Action
Machine Learning for
AdTech in Action
#SAISML11
1

2. AdTech
introduction
2

3. #SAISML11
Search and Performance
3

4. #SAISML11
Video/Display and Branding
4

5. #SAISML11
Workflow of a user browsing
5
€
UID
UID
Bid
Win
Banner
Action
Search VS
Display
Performance VS
Branding

6. Real Time Bidding
6

7. #SAISML11
RTB workflow
7
What does the winner pay?
Bidder 1
Bidder 2
…
Bidder n
Connexion UID
Bid request
Bid request
Bid request
Bid 1
Bid n

8. #SAISML11
{
2nd price auction
8
Bid =
True Value
2nd price
{
Profit
True Value
2nd price
Missed
Profit
Bid
{ True Value
2nd price
Loss
Bid

9. #SAISML11
True Value for Video Branding
Assumption: the bidder is paid a fixed amount CPV if and only if the
video ad is watched entirely.
True Value?
9

10. Estimating the
True Value
10

11. #SAISML11
Which constraints?
- Features: several hundred thousands modalities
- Training frequency: several times a day
- Number of predictions: a million per second
11

12. #SAISML11
Logistic regression VS DNN
12
https://cloud.google.com/blog/big-data/2017/02/using-google-cloud-machine-learning-to-predict-clicks-at-scale
Training set (23 days) Validation set (1 day)
Validation metric:
Prediction model Score = -LLH Training time Prediction complexity
Logistic regression 0.1293 70 min 40
Logistic regression with crosses 0.1272 142 min 86
Deep learning (11 layers x 1062 neurons)
1 epoch
0.1257 26h 40x1062+10x1062^2+1062
= 11 321 982
Deep learning (11 layers x 1062 neurons)
3 epochs
0.1250 78h 11 321 982
Training
time

13. #SAISML11
Reminder: Logistic Regression
13
x: features including historical and contextual information
w: model parameters

14. Machine Learning
Stack at Teads
14

15. #SAISML11
ML stack at Teads
- Motivation
- Model training
- Model serving
- Offline experiments
15

16. #SAISML11
Classic setup
16
OnlineOffline
Training Logs
Ad Delivering System
Tracking System
Data Pipeline
Model Training
Trained Model

17. #SAISML11
Challenges
Real-time prediction
17
150 ms response time in RTB business
40,000 requests / second
1,000,000 model predictions / second
Model serving outside of Spark

18. #SAISML11
Challenges
Flexible and reliable model improvement cycle
Production Model
Offline Experiment
Online AB-test
Features
18

19. #SAISML11
Why build our own stack?
No available framework/library back in 2015 that satisfied
all our needs
MLlib limitations
- GLM vector size limitations
- Model serving with spark dependency
Decided to do it ourselves
- Scala and Spark
19

20. Model Training
20

21. #SAISML11
Model training
21
Different use cases in different
teams
- Not the same features
- Not the same model
settings
Model training steps should
be configurable by using a
configuration object

22. #SAISML11 22
DataFrame
DataFrame
Feature transform
S3
"transform" : [
{
"type" : "Bucketize",
"input" : "ad_duration",
"output" : "ad_duration_bucket",
"thresholds" : [
10.0,
15.0,
20.0,
25.0,
30.0,
45.0,
75.0,
120.0
]
},
...
],
...
Feature transformation

23. #SAISML11 23
DataFrame
DataFrame
RDD[LabeledPoint]
Feature transform
Feature vectorize
S3Feature vectorization
...,
"vectorize" : [
{
"type" : "ConstantVectorize",
"value" : 1.0
},
{
"type" : "HashVectorize",
"inputs" : [
"ad_duration_bucket",
...
],
"inputTypes" : ...,
],
"size" : 2145483000
}
],
"label" : {
"input" : "event_billable_dbl"
},
...

24. #SAISML11 24
DataFrame
DataFrame
RDD[LabeledPoint]
Predictor
Feature transform
Feature vectorize
Model training
S3
S3
Online service
Model training
- Initial model
- Model seeding
...,
"initialModel" : {
"type" : "Logistic",
"intercept" : 0.0,
"slopes" : {
"type" : "Sparse",
"indices" : [
],
"values" : [
],
"length" : 2145483000
}
},
...

25. #SAISML11 25
DataFrame
DataFrame
RDD[LabeledPoint]
Predictor
Feature transform
Feature vectorize
Model training
S3
S3
Online service
Model training
- Other settings
...,
"loss" : {
"type" : "LogisticLoss"
},
"regularization" : {
"type" : "L2",
"alpha" : 29.0,
...
},
"optimization" : {
"type" : "LBFGS",
"maxIterations" : 150,
"tolerance" : 1.0E-4
},
...

26. #SAISML11
Model training
26
(DataFrame, TrainingConfig) => Predictor

27. #SAISML11
Model training deployment
Model name tag
- Unique identifier of a production model
Example:
prod-team1-vtr-prediction-2018-07-15
27
def getTrainingConfig(tag: String): TrainingConfig
def getLatest(tag: String): Predictor

28. #SAISML11
Model training deployment
28
Job Declaration
TrainingJob(
modelTag = "prod-be-vtr-prediction-2018-07-15",
jobLevel = Level.Day,
defaultClusterOptions = EmrOptions(coreInstanceCount
= 200),
timeout = Some(24.hours),
group = Group.beProd,
module = Module.libPrediction("clustering"),
logPath = "s3a://...",
logSize = 1,
defaultConf = Seq(
"spark.sql.shuffle.partitions" -> "20000"
),
mainClass = Some("...")
)
Jenkins Job
Deploy

29. #SAISML11
Model training deployment
29
Job Declaration
Scheduler
Jenkins Job EMR
Deploy
Trigger

30. #SAISML11 30

31. Model Serving
31

32. #SAISML11
Model serving
32
Impl as a scala library
- Dependency of online system
codebase
Fast and lightweight
- Prefer native code than a prediction
service
- Avoid http calls
- No Spark dependency

33. #SAISML11
Predictor
Configuration of model scoring
Components
- Feature transform
- Feature vectorization
- Trained model
Same feature generation as in training
- Vectors are the same online and
offline
33
{
"transform" : [...],
"vectorize" : [...],
"model" : {
"type" : "Logistic",
"intercept" : -0.59580942,
"slopes" : {
"type" : "Sparse",
"indices" : [
5385, 6271, ...
],
"values" : [
-0.002536684,
0.026973965,
...
],
"length" : 2145483000
}
}
}

34. #SAISML11
Online feature transform
34
case class PredictionKey private (values: Vector[Any], schema: Type) {
def add[T: Convert](name: String, t: T): PredictionKey = {...}
def value(idx: Int): Any = {...}
def get[T: Convert](name: String): T = {...}
def get[T: Convert](idx: Int): T = {...}
}

35. #SAISML11 35
Predictor
Prediction data
Prediction score
PredictionKey
PredictionKey
Vector
Model application
Vectorize
Transform
Prediction Function
Predictor load
S3 Online system

36. #SAISML11 36
Average model prediction scoring takes 55 microseconds in our production system
(prediction function application time)

37. Offline
Experiments
37

38. #SAISML11
Offline experiment
Internal tool to evaluate ML models on historical data
38
Simplify experiment
process
Formalize the
testing protocol
Keep track of the
experiment results
Wide range of
metrics with
confidence interval

39. #SAISML11
Offline experiment
39
Iteration 1 Training Set
Validation
Set
Training duration
Validation
duration
Validation start date
Iteration 2 Training Set
Validation
Set
Iteration 3 Training Set
Validation
Set

40. #SAISML11
Experiment creation
40
Notebook as main interface of
experiments
- jupyter notebook
- jupyter-scala kernel
Weighted metrics computation
Result projections
- Aggregate the result
metrics by categories (day,
business model, country,
etc.)
Jupyter-scala kernel: https://github.com/jupyter-scala/jupyter-scala/

41. #SAISML11
Result visualization
41

42. #SAISML11
Offline experiment
42
3000 480000
experiments launched
by different teams
during last 18 months
hours of logs analysed,
all experiments
combined

43. Thanks!
43

44. #SAISML11
Follow us!
Our engineering blog on medium:
https://medium.com/teads-engineering
44