第5回 SHIBUYA synapse VTuberを支えるAI技術 〜AIによる表現の可能性〜 誰の声でも目標の声に変換できる音声変換技術の資料です。 https://shibuya.ai/info/05/

1. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
Sep. 10, 2019
Kentaro Tachibana
AI System Dept.
DeNA Co., Ltd.

2. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
●
●
2008 17
●
2014 17 9
● VoiceTra
2017 10 DeNA
●
https://www.slideshare.net/KentaroTachibana1SlideShare

3. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n
VTuber
n
n
iPhone

4. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1/2
n 0/ S rH
Y ieA 2 O 07 0/ H
) (( H S t y t v
1 0E 7 7 E ga n lE ieA M bA
R V
t A A Aao
https://www.userlocal.jp/news/20190506vh/ C
VTuberu
WVTuberT G W

5. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
2/2
n VTuber
n
SHOWROOM V REALITY
n PC
VT-4

6. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n 2019
n
VTuber
2017 2019
2017/ VTuber
2019/1 VT-4 Voice transfer HW
2019/3 Vocal effector CHERRY PIE Mac
2019/4 Voidol Mac
2019/6
2017/10 voice iOS
2008
Win

7. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n
Plugin

8. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n
n
n

9. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1.
2.

10. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1.
n
VT-4
n

11. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
/
ref: http://www.speech.zone/td-psola-the-hard-way/
n ( )
Overlap and add
n ( )
Overlap and add

12. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
/
ref: http://www.speech.zone/td-psola-the-hard-way/
n (pitch ) n (pitch )
Pitch
1.
2.

13. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1.
2.

14. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
- - 1/2
ref: https://ahcweb01.naist.jp/lecture/2017/sp/material/lecture3.pdf
n

15. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
- - 2/2
n
ref: https://ahcweb01.naist.jp/lecture/2017/sp/material/lecture3.pdf
F0 +

16. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
2.
n
F0

17. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
2.
n
F0

18. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
- -
n
F0
1.
2.
3.

19. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1.
1.
2.
2.
1.
2.
3.

20. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
F0
.
.
.
.
.
.
1. 2.
1.
2.
3.

21. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
1/2
n
1.
→
2.
→
n
1.
2.
3.

22. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
2/2
F0
1. 2.
o / ha / yo h GAN
→
GAN GAN

23. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
2/2
F0
1. 2.
o / ha / yo h GAN
→
GAN GAN
1.
2.
3. GAN

24. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.

25. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n Unity plugin
300msec
Unity C++ /coreML
buffer
buffer
Buffer

26. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.

27. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.

28. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
n
VTuber
n
n
n iPhone

29. Copyright (C) 2018 DeNA Co.,Ltd. All Rights Reserved.
voice https://crimsontech.jp/apps/rcvoice/
VT-4: https://www.roland.com/us/products/vt-4/
Voidol https://crimsontech.jp/apps/voidol/
https://vr.gree.net/lab/vc/
CHERRY PIE https://blog.crypton.co.jp/l/2019/03/vocefx/