輪読会資料

1. Let me Choose:
From Verbal Context to Font Selection
2020/10/31
Amirreza Shirani†, Franck Dernoncourt‡, Jose Echevarria‡, Paul Asente‡,
Nedim Lipka‡ and Thamar Solorio†
†University of Houston ‡Adobe Research
ACL 2020

2. Background
https://ja-jp.facebook.com/
SNS
https://www.shonenjump.com/j/
rensai/kimetsu.html
https://www.kirin.co.jp/products/
softdrink/kitchen/ad/
https://www.honda.co.jp/
2
, .
( ) . (Doyle and Bottomley, 2006)
, , , . (O’Donovan et al., 2014;
Brum- berger, 2003b; Juni and Gross, 2008; Mackiewicz and Moeller, 2005; Amare and Manning, 2012)
, , . (Brumberger 2003)

3. Background
Google Fonts
https://fonts.google.com/?query=serif
MyFonts
,
1 )
2 ) Font family
.
( ) MyFonts, Typekit, Google Fonts
O’Donovan et al. (2014)
○
.
○
.
https://www.myfonts.com/
3

4. Purpose
.
.
.
.
“Can we recommend fonts
by only considering the input text ?”
?
Motivation The quick brown fox jumps over the lazy dog
?
4

5. Contributions
, .
Short Text Font Dataset .
, 10 .
, End-to-end .
, .
5

6. Dataset
Adobe Spark※ 1309
Adobe
○ , , ,
○ 10
Short Text Font Dataset
1. 9 ,
3 .
2. , 1 , 0.6 , 0.3 .
3. 1 .
F0
F1
F2
F3
F4
F5
F6
F7
F8
F9
6

7. Points
,
.
, ,
.
,
.
(O’Donovan et al., 2014; Shinahara et al., 2019)
Font Dataset ,
7
.
(Brumberger 2003)

8. -
Experiment
,
x ∈ X y = {y0, y1, …, y9}
.
,
x y
dx
y0
, dx
y1
, …, dx
y9
9
∑
i=0
dx
yi
= 1
○ GloVe-BiLSTM : Glove embeddings + BiLSTM
○ NRC Model : NRC Emotion, Intensity, VAD lexicons + BiLSTM
○ BERT Model : BERT feature + NN (2 layers)
○ Emoji Model : Deep-Moji feature + NN (2 layers)
“Good Vibes Only!“x ∈ X
Font
Prediction
dx
y0
, dx
y1
, …, dx
y9
Classifier
Pre-trained Model
Ground truth
F0 F1 F2 F3 F4 F5 F6 F7 F8 F9
Prediction
F0 F1 F2 F3 F4 F5 F6 F7 F8 F9
KL divergence ( )
8

9. Experiment
Font Recall (FR) (Kar et al. (2018); Carneiro et al. (2007))
F
F-score
, Fk = {1,3,5}
FR :=
∑
|F|
i=1
|Ri |
|F|
: ( )
: Recall
|F|
Ri i
BERT .
Emoji Model BERT
.
,
.
9

10. Experiment
, ?
○ F4, F9 “ ” ,
“Heart”,”Love” ❤,💖,💕
○ F3 “ ” ,
“ ”, “ ” 😑,😅,😠
F0
F1
F2
F3
F4
F5
F6
F7
F8
F9
10

11. Let me Choose: From Verbal Context to Font Selection
Amirreza Shirani†, Franck Dernoncourt‡, Jose Echevarria‡, Paul Asente‡, Nedim Lipka‡ and Thamar Solorio†
.
.
,
.
BERT ,
Baseline . .
, KL
, .
, ,
.
.
.
11