Pycon Korea 2020 - "대본 프롬프터 서비스에서의 문장 유사도 알고리즘 개발 경험 공유" 주제 연설

2. SK - Tremo
c3.chat -
SW 10th - ScriptSlide
jihoon522@naver.com
https://github.com/thisishoon

4. 01. Background
02. Process
03. Develop
04. Experience
- ?

5. / ,
/ .
,
What
washingtonpost news image

6. Demo

7. ,
.
,
.

8. 01. Background
02. Process
03. Develop
04. Experience
- ?
- ?

9. How?

10. How?

11. How?
Speech to Text

12. STT API
STT
System
Architecture

13. “ ”
“ ”
“ ”
“ ”
“ ”
“ ?”
response per 0.1 - 0.5 second Async Function for performance
여러분들은 파이썬 프로그래밍
언어에 대해서 어떻게 생각하시나요?
“ ”

14. “ Python Programming ?!”
“ Python Programming ”
, ,
“ ”
여러분들은 파이썬 프로그래밍
언어에 대해서 어떻게 생각하시나요?
STT

15.
.
Triple-S Algorithm
(Spoken-Sentence-Similarity)

16. origin_sentence
-
,
,
.
speech_sentence
0.55

17. -
origin_sentence
speech_sentence
1.
origin_sentence
speech_sentence
2.
' ', ' ', ' ', ' ', ' ', ' ', ' ',
' ', ' ', ' ', ' ', ' ', ' ',
' ', ' ', ' ', ' ', ' ', ' ', ' ',
' ', ' ', ' ', ' ', ' '
' ', ' ', ' ', ' '
0.5
0.36

18. - TF_IDF,
0.46

19. - ,
0.12
0.48

20. NLP
-
1
1.
( 0.1~0.5 )
2.
( / )
( - , , )
3.
( , )
( STT )

21. 01. Background
02. Process
03. Develop
04. Experience
- ?
- ?
- ?

22. NLP
-
1
-
[ ]
2
- , ,
- ,
-
( / )
-
[ ]

23. Triple-S Algorithm -
- N-Word Window , 3~5
.
- , ,
.
- ,

24. ScriptSlide
?“
여러분들은 파이썬에 대해서
어떻게 생각하시나요?

25. ScriptSlide

26. ScriptSlide

27. About Triple-S Algorithm
1. ‘LCS ’ ( )
.
- Edit Distance
- Longest Common Sentence (LCS)
- KMP
[ ]
[ ]
0 0 0 0 0 0 0 0
0 1 1 1 1 1 1 1
0 1 2 2 2 2 2 2
0 1 2 3 3 3 3 3
0 1 2 3 3 3 3 3
0 1 2 3 3 3 3 3
0 1 2 3 4 4 4 4
0 1 2 3 4 4 4 4

28. About Triple-S Algorithm
1. ‘LCS ’ (Triple-S Algorithm )
Code Example

29. 2. - ‘Threshold’ ‘ ’
-
-
-
Threshold .
‘ ’
y = x
* ,
Threshold
Threshold
About Triple-S Algorithm

30. 2. - ‘Threshold’ ‘ ’
About Triple-S Algorithm
Code Example

31. 3. ,
y = log2 x
,
Bi-gram
y = log2 x
y = log x
/
* ‘ ’, ‘ ’ ‘ ’, ‘ ’
( )
About Triple-S Algorithm

32. 3. ,
y = log2 x
About Triple-S Algorithm
Code Example

33. 3. ,
y = log2 x
y = log x
/
( )
About Triple-S Algorithm
“ ?”
“ ?”

34. 3. ,
,
Bi-gram
* ‘ ’, ‘ ’ ‘ ’, ‘ ’
About Triple-S Algorithm
“ ?”
“ ?”

35. 3. ,
,
Bi-gram
* ‘ ’, ‘ ’ ‘ ’, ‘ ’
About Triple-S Algorithm
Code Example

36. ,
4. Highlight
3~4
‘ ’
About Triple-S Algorithm
Demo

37. 5.
,
“ …
.
.
( )
About Triple-S Algorithm
Demo

38. 5.
,
“ …
.
.
( )
About Triple-S Algorithm
Code Example

39. Triple-S Algorithm(Spoken, Sentence Similarity)
70
77.5
85
92.5
100
Test1 Test2 Test3 Test1 Test2 Test3
Triple-S Score
( 89%)
95%
( 79%)
91%
Test1: 2019 (44 )
Test2: 73 (44 )
Test3: 73 (30 )
:
* : Edit Distance
* Triple-S Score: Triple-S Algorithm
About Triple-S Algorithm

40. 01. Background
02. Process
03. Develop
04. Experience
- ?
- ?
- ?
- ?

41. G Suite Marketplace TOP 38
Experience
1.
,
2. 2
90,000 ,
3. , NLP

42. E-mail : jihoon522@naver.com
Github: https://github.com/thisishoon
Linked-in: https://www.linkedin.com/in/thisishoon/