Ubiquity: Designing a Multilingual Natural Language Interface

9,325 views

Published on

Slides from a presentation on Ubiquity at the workshop on Information Access in a Multilingual World at ACM SIGIR 2009 in Boston.

Full paper available at http://mitcho.com/academic/ .

Published in: Technology
1 Comment
6 Likes
Statistics
Notes
  • outstanding demonstration..convinced me to have a hardlook at my business model..brilliant
    Sharika
    http://winkhealth.com http://financewink.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
9,325
On SlideShare
0
From Embeds
0
Number of Embeds
117
Actions
Shares
0
Downloads
91
Comments
1
Likes
6
Embeds 0
No embeds

No notes for slide

Ubiquity: Designing a Multilingual Natural Language Interface

  1. ubiquity: designing a multilingual natural language interface mitcho Michael Yoshitaka Erlewine 2009 SIGIR Workshop on Information Access in a Multilingual World Boston, July 23rd, 2009
  2. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  3. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  4. USER INFORMATION INTERFACE
  5. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
  6. USER INFORMATION INTERFACE
  7. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
  8. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe this ta lk
  9. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  10. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  11. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  12. “We create communities of people involved in making the Internet experience better for all of us... The Internet is a global public resource that must remain open and accessible.” —Mozilla Manifesto
  13. Afrikaans English (US) Gaeilge Português (Europeu) Shqip Esperanto Italiano ਪ"ਜਾਬੀ ‫ﻋﺮﺑﻲ‬ Eesti keel română অসমীয়া suomi Русский Kannada Euskara Français српски Беларуская Frysk සිංහල Kurdî বাংলা (ভারত) Galego slovenčina Latviešu Български ქართული slovensko lietuvių kalba català Deutsch Español (de Argentina) Македонски ( ) Ελληνικά Español (de España) मराठी ગ"જરાતી Svenska ( ) Norsk bokmål Telugu Hrvatski ‫עברית‬ Norsk nynorsk ไทย Čeština !ह#दी (भारत) occitan (lengadocian) Українська Dansk Magyar ‫ﻓﺎﺭﺳﯽ‬ Tiếng Việt Nederlands íslenska Polski Cymraeg English (British) Bahasa Indonesia Português (do Brasil)
  14. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  15. BUILDING A SCALABLE INTERFACE PARADIGM
  16. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s...
  17. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them?
  18. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm...
  19. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons?
  20. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons? • add more menus?
  21. CC-BY-SA: flickr.com/photos/daveduarte/2678853923/
  22. ACM interactions 2008
  23. CC-BY: flickr.com/photos/striatic/1629254/
  24. ?
  25. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
  26. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
  27. a natural language interface
  28. ubiquity ubiquity.mozilla.com
  29. [demo 1] inserting a map into email (video not included in PDF)
  30. without ubiquity
  31. without ubiquity
  32. without ubiquity
  33. without ubiquity
  34. [demo 1] inserting a map into email: one step with ubiquity (video not included in PDF)
  35. [demo 2] translating and emailing web content (video not included in PDF)
  36. without ubiquity
  37. without ubiquity
  38. without ubiquity
  39. without ubiquity
  40. without ubiquity
  41. [demo 2] translating and emailing web content: fast and straightforward with ubiquity (video not included in PDF)
  42. goal: how?
  43. goal: accomplish more on the web how?
  44. goal: accomplish more on the web how? connect the web with language
  45. verbs* *JavaScript
  46. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  47. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
  48. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
  49. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese, a scrambling language) • Tarō-ni ball-o nager=o Tarō-dat ball-acc throw=imper •
  50. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese) • ... nager=o (imperative) • ... nager=u (infinitive) • ... nage=te (linking form)
  51. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  52. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  53. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  54. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  55. parser (animation not included in PDF)
  56. parser (animation not included in PDF)
  57. parser (animation not included in PDF)
  58. parser (animation not included in PDF) N N V
  59. parser (animation not included in PDF) N N V goal object
  60. parser (animation not included in PDF) N N V goal object V ( goal, object )
  61. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
  62. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
  63. LOCALIZING UBIQUITY Argument identification via semantic role
  64. LOCALIZING UBIQUITY Argument identification via semantic role
  65. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  66. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  67. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  68. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  69. [demo 3] ubiquity in Japanese: “hello to Spanish” (video not included in PDF)
  70. LOCALIZING UBIQUITY • Support for various linguistic structures • Equal support for verb-initial and -final languages • Smart argument-first suggestions
  71. LOCALIZING UBIQUITY Minimal language descriptions branching:
'left', usespaces:
false, joindelimiter:
'', anaphora:
["これ",
"それ",
"あれ"], roles:
[ 

{role:
'object',
delimiter:
'を'}, 

{role:
'goal',
delimiter:
'に'}, 

{role:
'source',
delimiter:
'から'}, 

{role:
'position',
delimiter:
'で'}, 

{role:
'position',
delimiter:
'に'}, 

{role:
'instrument',
delimiter:
'で'}, 

{role:
'alias',
delimiter:
'として'}, ]
  72. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  73. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  74. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  75. ubiquity 0.5 with Parser 2
  76. ubiquity 0.5 with Parser 2 Català Italiano Dansk Language settings: English Português Español Svenska Français
  77. ubiquity 0.5 with Parser 2
  78. ubiquity 0.5 with Parser 2 Català Dansk English Português
  79. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  80. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  81. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  82. Thank you! Questions? mitcho Michael Yoshitaka Erlewine by-nc-sa mitcho.com @mitchoyoshitaka

×