Successfully reported this slideshow.
Your SlideShare is downloading. ×

【DL輪読会】Diagnosing Vision-and-Language Navigation: What Really Matters

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad

Check these out next

1 of 27 Ad
Advertisement

More Related Content

More from Deep Learning JP (20)

Recently uploaded (20)

Advertisement

【DL輪読会】Diagnosing Vision-and-Language Navigation: What Really Matters

  1. 1. DEEP LEARNING JP [DL Papers] http://deeplearning.jp/ %JBHOPTJOH7JTJPOBOE-BOHVBHF/BWJHBUJPO 8IBU3FBMMZ.BUUFST ൃදऀѨ‫ٱ‬ᖒ‫ ܓ‬দඌ‫ݚ‬%
  2. 2. ॻࢽ৘ใ w λΠτϧ%JBHOPTJOH7JTJPOBOE-BOHVBHF/BWJHBUJPO8IBU3FBMMZ.BUUFST w ஶऀ8BOSPOH;IV :VBOLBJ2J 1SBEZVNOB/BSBZBOB ,B[PP4POF 4VHBUP #BTV 9JOSJD8BOH 2J8V .JHVFMDLTUFJO 8JMMJBN:BOH8BOH w 6$4BOUB#BSCBSB 6OJWFSTJUZPGEFMBJEF (PPHMF 6$4BOUB$SV[ w ౤ߘઌBSYJW w ֓ཁ7JTJPOBOEMBOHVBHFOBWJHBUJPOʹ͓͚ΔΤʔδΣϯτͷ‫ڍ‬ಈ෼ੳ
  3. 3. എ‫ܠ‬7JTJPOBOEMBOHVBHFOBWJHBUJPO 7-/ w 7-/ w ‫ࣔࢦޠݴ‬ΛΤʔδΣϯτʹ༩͑ͯφϏήʔγϣϯΛߦΘͤΔ λεΫ w ‫ڧ‬Խֶशɾ໛฿ֶशͳͲͰΤʔδΣϯτΛ‫܇‬࿅͢Δ w ΤʔδΣϯτͷ‫؍‬ଌɿ w ‫ࣔࢦޠݴ‬ɿΤϐιʔυ͝ͱ w ը૾ɿλΠϜεςοϓ͝ͱ w ΞΫγϣϯɿ w UVSOMFGU UVSOSJHIU HPGPSXBSEͳͲʢ͋Δఔ౓ந৅Խ͞ Εͨ΋ͷΛ࢖͏͜ͱ͕‫ݱ‬ঢ়Ұൠతʣ OEFSTPOFUBM
  4. 4. എ‫ܠ‬7-/ͷఀ଺ w ӈਤ7-/ͷੑೳͷભҠ ʢ3PPNUP3PPN‫ڥ؀‬ʣ w ۙ೥ੑೳͷ޲্͕ಷԽʁ w ਓؒͷੑೳʹ͸ԕ͍ʁ
  5. 5. ࿦จͷ໨త w ‫ط‬ଘͷφϏήʔγϣϯΤʔδΣϯτ͕ϚϧνϞʔμϧʢ‫ޠݴ‬ɾը૾ʣͷೖ ྗΛͲͷΑ͏ʹཧղ͍ͯ͠Δͷ͔෼ੳΛߦ͏ w ͦΕʹΑΓɼ‫ط‬ଘͷ7-/ख๏͕ग़དྷ͍ͯΔ͜ͱɾग़དྷ͍ͯͳ͍͜ͱΛ໌Β ͔ʹ͠ɼ৽͍͠‫ڀݚ‬ͷํ޲ੑΛ༩͑Δ
  6. 6. σʔληοτʢ‫ڥ؀‬ʣ *OEPPSOWJSPONFOU 3PPNUPSPPN 33 OEFSTPOFUBM 0VUEPPSOWJSPONFOU 5PVDIEPXO 5% $IFOFUBM
  7. 7. Ϟσϧ w *OEPPS 33 w 33OWEPQ 5BOFUBM 3//ϕʔε
  8. 8. BUUFOUJPO
  9. 9. ಛघͳESPQPVU w 137-/5 )BPFUBM 5SBOTGPSNFSCBTFEBHFOU w 7-/ˠ#35 )POHFUBM 5SBOTGPSNFSCBTFEBHFOU
  10. 10. 3FDVSSFOU.FDIBOJTN w 0VUEPPS 5% w 3$0/$5 $IFOFUBM 3//ϕʔεɼ506$)%08/ͷ‫ݪ‬ஶ࿦จͷϕʔεϥΠϯ w 3$ 9JBOHFUBM 3//ϕʔε
  11. 11. BUUFOUJPO w 7-/5SBOTGPSNFS ;IVFUBM 5SBOTGPSNFSCBTFEBHFOU
  12. 12. 3FTFBSDI2VFTUJPOT w ΤʔδΣϯτ͸‫ࣔࢦޠݴ‬ͷʮΦϒδΣΫτʯ΍ʮํ޲ʯʹؔ͢ΔτʔΫ ϯΛར༻Ͱ͖͍ͯΔ͔ w ΤʔδΣϯτ͸ը૾ೖྗΛͲ͏஌͍֮ͯ͠Δ͔ w ‫཭ڑ‬తʹ͍ۙԕ͍΋ͷʹ஫ҙΛ޲͚Δ͔ w ‫ݸ‬ʑͷ෺ମγʔϯશମʹ஫ҙΛ޲͚Δ͔ w ΤʔδΣϯτ͸‫ͱޠݴ‬ը૾ͷFOUJUZΛ݁ͼ͚ͭΔ͜ͱ͸Ͱ͖Δ͔
  13. 13. ࣮‫ݧ‬ w ໨తɿΤʔδΣϯτ͕ɼ‫಺ࣔࢦޠݴ‬ͷʮΦϒδΣΫτʯͱʮํ޲ʯʹؔ͢Δ৘ใΛར༻Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿʮΦϒδΣΫτʯͱʮํ޲ʯʹؔ͢Δ୯‫ʹޠ‬ϚεΫΛ͔͚ΔհೖΛߦͳͬͨ࣌ͷɼΤʔδΣϯτͷ ੑೳΛௐࠪʢϥϯμϜʹϚεΫΛ͔͚Δ৔߹ͱൺֱʣ w ϚεΫΛ͔͚Δͷ͸ςετ࣌ͷΈ
  14. 14. ࣮‫ݧ‬ΦϒδΣΫττʔΫϯ΁ͷհೖ݁Ռ w 33Ͱ͸ɼΦϒδΣΫτʹհೖͨ͠ํ͕ɼϥϯμϜʹհೖ͢ΔΑΓੑೳ௿Լ w 5%Ͱ͸ΦϒδΣΫτʹհೖͯ͠΋ੑೳ͕ൺֱత௿Լ͠ͳ͍
  15. 15. ࣮‫޲ํݧ‬τʔΫϯ΁ͷհೖ݁Ռ w 33Ͱ΋5%Ͱ΋ɼํ޲ͷհೖʹΑͬͯϥϯμϜհೖΑΓ΋ੑೳ௿Լ
  16. 16. ࣮‫݁ݧ‬࿦ w ໨తɿΤʔδΣϯτ͕ɼ‫಺ࣔࢦޠݴ‬ͷʮΦϒδΣΫτʯͱʮํ޲ʯʹؔ͢Δ৘ใΛ ར༻Ͱ͖͍ͯΔ͔֬ೝ w ݁࿦ɿ w 33‫Ͱڥ؀‬͸ɼΦϒδΣΫτɾํ޲ͷτʔΫϯΛΤʔδΣϯτ͕ར༻Ͱ͖͍ͯΔ w 5%‫Ͱڥ؀‬͸ɼΦϒδΣΫτʹؔ͢Δ৘ใΛΤʔδΣϯτ͕ར༻Ͱ͖͍ͯͳ͍
  17. 17. ࣮‫ݧ‬ w ໨తɿΤʔδΣϯτ͕ը૾಺ͷʮΦϒδΣΫτʯʹؔ͢Δ৘ใΛར༻Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿΦϒδΣΫτΛ#PVOEJOH#PYͰ‫ݕ‬஌͠ɼNBTLΛ͔͚ͨͱ͖ͷΤʔδΣϯτͷ ੑೳΛௐࠪ w 33‫ڥ؀‬ͷΈͰ࣮ࢪ
  18. 18. ࣮‫݁ݧ‬Ռ w NBTL͢ΔΦϒδΣΫτ͕૿͑Δ͝ͱʹΤʔδΣϯτͷੑೳ͕௿Լ w NBTL͢ΔΦϒδΣΫτͱΤʔδΣϯτͷ‫཭ڑ‬͸ɼ 5SBOTGPSNFSCBTFEΤʔδΣϯτͷ৔߹ ͋·Γੑೳʹؔ܎ͳ͍ʢ‫͕཭ڑ‬ԕ͍ ΄Ͳ#PVOEJOH#PY͕খ͍͞ʹ1JYFMྖҬ͕খ͍͞ʹ΋͔͔ΘΒͣɼੑೳʹؔ܎ͳ͍ʣ w ΤʔδΣϯτ͸લ‫ܠ‬ɾഎ‫ܠ‬ͷΦϒδΣΫτΛҙࢥܾఆʹར༻͍ͯ͠Δ
  19. 19. ࣮‫݁ݧ‬࿦ w ໨తɿΤʔδΣϯτ͕ɼը૾಺ͷʮΦϒδΣΫτʯʹؔ͢Δ৘ใΛͲΕͩ ͚ར༻Ͱ͖͍ͯΔ͔Λ֬ೝ w ݁࿦ɿ w ΤʔδΣϯτ͸ը૾಺ͷΦϒδΣΫτʹؔ͢Δ৘ใΛར༻͍ͯ͠Δ w ΤʔδΣϯτͱΦϒδΣΫτͷ‫཭ڑ‬͸ 5SBOTGPSNFSCBTFEΤʔδΣϯ τͷ৔߹ ͋·Γؔ܎ͳ͍
  20. 20. ࣮‫ݧ‬ w ໨తɿΤʔδΣϯτ͕ɼ‫಺ࣔࢦޠݴ‬ͷʮΦϒδΣΫτʯͱը૾಺ͷʮΦϒδΣΫτʯΛ݁ͼ͚ͭΔ͜ͱ͕Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿ w ‫΁ࣔࢦޠݴ‬ͷհೖ w ը૾΁ͷհೖ
  21. 21. ࣮‫ݧ‬ w ํ๏ɿʮΦϒδΣΫτʯʹؔ͢Δ୯‫ޠ‬Λଞͷ୯ ‫Ͱޠ‬ஔ͖‫͑׵‬Δͱ͍ͬͨૢ࡞Λߦͳͬͨ࣌ͷɼ ΤʔδΣϯτͷੑೳΛௐࠪ w ݁Ռɿ w 5SBOTGPSNFS‫ܥ‬ͷख๏͸SFQMBDFʹΑͬͯੑೳ ͕େ͖͘௿Լ͢Δ w 5SBOTGPSNFS‫ܥ‬ͷख๏͸ɼΦϒδΣΫτʹ ؔ͢Δ‫ޠݴ‬ɾࢹ֮৘ใΛ݁ͼ͚ͭΔ͜ͱ͕Մೳ
  22. 22. ࣮‫ݧ‬ w ํ๏ɿը૾಺͔ΒʮΦϒδΣΫτʯΛ#PVOEJOH#PYͰ‫ݕ‬஌͠ɼ‫ͦͰ಺ࣔࢦޠݴ‬ͷΦϒδΣΫτ͕‫͞ٴݴ‬Ε͍ͯΔ৔߹ͷΈNBTL Λ͔͚Δ w JF λεΫʹͱͬͯඞཁͳΦϒδΣΫτʹϚεΫΛ͔͚Δ w ݁ՌɿϥϯμϜʹϚεΫΛ͔͚ͨ৔߹ͱɼ͋·Γੑೳ͕มΘΒͳ͍ w ߟ࡯ɿ࣮‫ݧ‬ΑΓɼ‫΁ޠݴ‬ͷհೖ͸ੑೳʹେ͖ͳӨ‫ڹ‬ɽ࣮‫ݧ‬ΑΓɼը૾΁ͷհೖ͸ੑೳʹখ͞ͳӨ‫ڹ‬ w ը૾ͱ‫ޠݴ‬ͷΦϒδΣΫτΛରͰରԠ͍ͤͯ͞ΔΘ͚Ͱ͸ͳ͘ɼը૾ͷ(MPCBMͳಛ௃Λ‫ͱޠݴ‬ରԠ͚͍ͮͯΔͷͰ͸ʁ
  23. 23. ࣮‫݁ݧ‬࿦ w ໨తɿΤʔδΣϯτ͕ɼ‫಺ࣔࢦޠݴ‬ͷʮΦϒδΣΫτͱը૾಺ͷʮΦϒδΣ ΫτʯΛ݁ͼ͚ͭΔ͜ͱ͕Ͱ͖͍ͯΔ͔֬ೝ w ݁࿦ɿ w 5SBOTGPSNFS‫ܥ‬ͷख๏͸ɼΦϒδΣΫτʹؔ͢Δ‫ޠݴ‬ɾࢹ֮৘ใΛ݁ͼ ͚ͭΔ͜ͱ͕Մೳ w ͨͩ͠ɼࢹ֮৘ใͷதͷΦϒδΣΫτͷ#PVOEJOH#PYͱ‫ޠݴ‬Λਖ਼֬ʹ݁ ͼ͚͍ͭͯΔͷͰ͸ͳ͘ɼγʔϯશମͱ‫ޠݴ‬Λ݁ͼ͚ͭͯཧղ͍ͯ͠ΔՄ ೳੑ͕͋Δ
  24. 24. 3FTFBSDI2VFTUJPOTͱ,FZpOEJOHT·ͱΊ w ‫ࣔࢦޠݴ‬ͷʮΦϒδΣΫτʯ΍ʮํ޲ʯʹؔ͢ΔτʔΫϯΛར༻Ͱ͖͍ͯΔ͔ w 5PVDIEPXO‫Ͱڥ؀‬͸ɼΤʔδΣϯτ͕ΦϒδΣΫτʹؔ͢Δ৘ใΛ͋·Γར༻Ͱ͖͍ͯͳ ͍ɽΑΓ‫*ͳྗڧ‬NBHF'FBUVSFYUSBDUPS 0CKFDU%FUFDUPST͕ඞཁʁ w ΤʔδΣϯτ͸ը૾ೖྗΛͲ͏஌͍֮ͯ͠Δ͔ w ‫཭ڑ‬తʹ͍ۙԕ͍ΦϒδΣΫτʹ஫ҙΛ޲͚Δ͔ 5SBOTGPSNFSCBTFEͩͱ ؔ܎ͳͦ͞͏ w ‫ݸ‬ʑͷ෺ମγʔϯશମʹ஫ҙΛ޲͚Δ͔γʔϯશମ΋ར༻͍ͯ͠Δ w ΤʔδΣϯτ͸ςΩετͱը૾ͷFOUJUZΛ݁ͼ͚ͭΔ͜ͱ͸Ͱ͖Δ͔ w ඞͣ͠΋݁ͼ͍͍ͭͯͳ͍ɽ͋ΔΦϒδΣΫτʹؔ͢Δ୯‫ͱޠ‬ɼͦΕʹରԠ͢ΔγʔϯશମΛ ݁ͼ͚͍ͭͯΔՄೳੑ͕͋Δ
  25. 25. ·ͱΊ w φϏήʔγϣϯΤʔδΣϯτ͕‫ͱޠݴ‬ը૾ͷϚϧνϞʔμϧσʔλΛͲͷ Α͏ʹղऍ͍ͯ͠Δ͔ௐࠪΛߦͬͨ w ͜ͷ࿦จͷ஌‫ݟ‬ΛλεΫͷઃఆ΍φϏήʔγϣϯΤʔδΣϯτͷઃ‫ʹܭ‬໾ ཱͯͯཉ͍͠ w 5PVDIEPXO‫Ͱڥ؀‬͸ɼΑΓ‫*ͳྗڧ‬NBHF'FBUVSFYUSBDUPS 0CKFDU%FUFDUPST͕ඞཁ w (MPCBMͳը૾ಛ௃ʢγʔϯશମʣͷ໾ׂʹ͍ͭͯ͞ΒͳΔ‫͕ڀݚ‬ඞཁ
  26. 26. ൃදऀͷ‫ײ‬૝ w ΤʔδΣϯτͷ‫ڍ‬ಈͷௐࠪΛߦ͏ํ๏ͱͯ͠ࢀߟʹͳΓ·ͨ͠ɽ w ࣮‫ݧ‬ͷɼ‫಺ޠݴ‬ͷΦϒδΣΫττʔΫϯʹհೖ͢Δ৔߹ͱɼը૾಺ͷΦ ϒδΣΫτ#PVOEJOH#PYʹհೖ͢Δ৔߹Ͱɼੑೳ͕ҟͳΔͱ͍͏ͷ͸໘ ന͍Ͱ͢ɽ w 'JHVSFͷɼʮਓؒͷੑೳʹ‫ٴ‬͹ͳ͍ʯͱ͍͏ٞ࿦ʹ͍ͭͯ͸ɼαϯϓ ϧαΠζΛແ‫૿ʹݶ‬΍͢͜ͱ͕Ͱ͖ͳ͍ͷͰɼσʔλͷ‫ݶ‬ք͔ΞϧΰϦζ Ϝͷ‫ݶ‬ք͔‫ۃݟ‬ΊΔ͜ͱ͕Ͱ͖ͳ͍ͷ͕໰୊ͩͱࢥ͍·ͨ͠ɽ7-/ʹ͓͍ ͯ΋αϯϓϧαΠζΛແ‫૿ʹݶ‬΍ͤΔγϛϡϨʔλ͕ཉ͍͠Ͱ͢ɽ
  27. 27. ࢀߟจ‫ݙ‬ w OEFSTPOFUBM$713 7JTJPOBOE-BOHVBHF/BWJHBUJPO*OUFSQSFUJOHWJTVBMMZ HSPVOEFEOBWJHBUJPOJOTUSVDUJPOTJOSFBMFOWJSPONFOUT w $IFOFUBM$713 5PVDIEPXO/BUVSBM-BOHVBHF/BWJHBUJPOBOE4QBUJBM3FBTPOJOH JO7JTVBM4USFFUOWJSPONFOUT w 5BOFUBM-FBSOJOHUPOBWJHBUFVOTFFOFOWJSPONFOUT#BDLUSBOTMBUJPOXJUIFOWJSPO NFOUBMESPQPVU w )POHFUBMSFDVSSFOUWJTJPOBOEMBOHVBHF#35GPSOBWJHBUJPO w )BPFUBM$713 5PXBSETMFBSOJOHBHFOFSJDBHFOUGPSWJTJPOBOEMBOHVBHF OBWJHBUJPOWJBQSFUSBJOJOH w 9JBOHFUBM./-1 -FBSOJOHUPTUPQTJNQMFZFUF⒎FDUJWFBQQSPBDIUPVSCBO WJTJPOMBOHVBHFOBWJHBUJPO w ;IVFUBM.VMUJNPEBMUFYUTUZMFUSBOTGFSGPSPVUEPPSWJTJPOBOEMBOHVBHFOBWJHBUJPO
  28. 28. QQFOEJY
  29. 29. 137-/5 w JNBHFUFYUBDUJPOͷUSJQMFUΛ༻͍ͨࣄલֶशʢ࠶‫ߏؼ‬଄͸ೖΕͳ͍ʣ w 7-/ʹ࢖͏৔߹͸ɼԼ‫ه‬ͷUSBOTGPSNFS͔Βൈ͖ग़ͨ͠XPSEFNCFEEJOHΛɼैདྷͷ -45.ϕʔεTFRTFRϞσϧ΁ͷೖྗͱͯ͠࢖͏
  30. 30. 7-/ˠ#35 w Λ࠶‫ؼ‬తʹѻ ͏͜ͱͰɼ෦ ෼‫؍‬ଌʹରԠ ͤ͞Δ st
  31. 31. 7-/5SBOTGPSNFS w $SPTT.PEBM ODPEFSʹ 5SBOTGPSNFSΛ ࠾༻ w *OTUSVDUJPO ODPEFSͰ͸ɼ #35ʹΑΔ୯‫ޠ‬ ຒΊࠐΈͷฏ‫ۉ‬Λ औΔ͜ͱͰจষຒ ΊࠐΈΛ࡞Δ

×