Ubiquity: Designing a Multilingual Natural Language Interface

  • 4,183 views
Uploaded on

Slides from a presentation on Ubiquity at the workshop on Information Access in a Multilingual World at ACM SIGIR 2009 in Boston. …

Slides from a presentation on Ubiquity at the workshop on Information Access in a Multilingual World at ACM SIGIR 2009 in Boston.

Full paper available at http://mitcho.com/academic/ .

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • outstanding demonstration..convinced me to have a hardlook at my business model..brilliant
    Sharika
    http://winkhealth.com http://financewink.com
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
4,183
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
81
Comments
1
Likes
6

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. ubiquity: designing a multilingual natural language interface mitcho Michael Yoshitaka Erlewine 2009 SIGIR Workshop on Information Access in a Multilingual World Boston, July 23rd, 2009
  • 2. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  • 3. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  • 4. USER INFORMATION INTERFACE
  • 5. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
  • 6. USER INFORMATION INTERFACE
  • 7. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
  • 8. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe this ta lk
  • 9. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  • 10. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  • 11. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
  • 12. “We create communities of people involved in making the Internet experience better for all of us... The Internet is a global public resource that must remain open and accessible.” —Mozilla Manifesto
  • 13. Afrikaans English (US) Gaeilge Português (Europeu) Shqip Esperanto Italiano ਪ"ਜਾਬੀ ‫ﻋﺮﺑﻲ‬ Eesti keel română অসমীয়া suomi Русский Kannada Euskara Français српски Беларуская Frysk සිංහල Kurdî বাংলা (ভারত) Galego slovenčina Latviešu Български ქართული slovensko lietuvių kalba català Deutsch Español (de Argentina) Македонски ( ) Ελληνικά Español (de España) मराठी ગ"જરાતી Svenska ( ) Norsk bokmål Telugu Hrvatski ‫עברית‬ Norsk nynorsk ไทย Čeština !ह#दी (भारत) occitan (lengadocian) Українська Dansk Magyar ‫ﻓﺎﺭﺳﯽ‬ Tiếng Việt Nederlands íslenska Polski Cymraeg English (British) Bahasa Indonesia Português (do Brasil)
  • 14. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  • 15. BUILDING A SCALABLE INTERFACE PARADIGM
  • 16. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s...
  • 17. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them?
  • 18. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm...
  • 19. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons?
  • 20. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons? • add more menus?
  • 21. CC-BY-SA: flickr.com/photos/daveduarte/2678853923/
  • 22. ACM interactions 2008
  • 23. CC-BY: flickr.com/photos/striatic/1629254/
  • 24. ?
  • 25. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
  • 26. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
  • 27. a natural language interface
  • 28. ubiquity ubiquity.mozilla.com
  • 29. [demo 1] inserting a map into email (video not included in PDF)
  • 30. without ubiquity
  • 31. without ubiquity
  • 32. without ubiquity
  • 33. without ubiquity
  • 34. [demo 1] inserting a map into email: one step with ubiquity (video not included in PDF)
  • 35. [demo 2] translating and emailing web content (video not included in PDF)
  • 36. without ubiquity
  • 37. without ubiquity
  • 38. without ubiquity
  • 39. without ubiquity
  • 40. without ubiquity
  • 41. [demo 2] translating and emailing web content: fast and straightforward with ubiquity (video not included in PDF)
  • 42. goal: how?
  • 43. goal: accomplish more on the web how?
  • 44. goal: accomplish more on the web how? connect the web with language
  • 45. verbs* *JavaScript
  • 46. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
  • 47. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
  • 48. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
  • 49. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese, a scrambling language) • Tarō-ni ball-o nager=o Tarō-dat ball-acc throw=imper •
  • 50. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese) • ... nager=o (imperative) • ... nager=u (infinitive) • ... nage=te (linking form)
  • 51. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  • 52. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  • 53. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  • 54. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
  • 55. parser (animation not included in PDF)
  • 56. parser (animation not included in PDF)
  • 57. parser (animation not included in PDF)
  • 58. parser (animation not included in PDF) N N V
  • 59. parser (animation not included in PDF) N N V goal object
  • 60. parser (animation not included in PDF) N N V goal object V ( goal, object )
  • 61. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
  • 62. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
  • 63. LOCALIZING UBIQUITY Argument identification via semantic role
  • 64. LOCALIZING UBIQUITY Argument identification via semantic role
  • 65. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  • 66. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  • 67. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  • 68. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
  • 69. [demo 3] ubiquity in Japanese: “hello to Spanish” (video not included in PDF)
  • 70. LOCALIZING UBIQUITY • Support for various linguistic structures • Equal support for verb-initial and -final languages • Smart argument-first suggestions
  • 71. LOCALIZING UBIQUITY Minimal language descriptions branching:
'left', usespaces:
false, joindelimiter:
'', anaphora:
["これ",
"それ",
"あれ"], roles:
[ 

{role:
'object',
delimiter:
'を'}, 

{role:
'goal',
delimiter:
'に'}, 

{role:
'source',
delimiter:
'から'}, 

{role:
'position',
delimiter:
'で'}, 

{role:
'position',
delimiter:
'に'}, 

{role:
'instrument',
delimiter:
'で'}, 

{role:
'alias',
delimiter:
'として'}, ]
  • 72. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  • 73. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  • 74. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
  • 75. ubiquity 0.5 with Parser 2
  • 76. ubiquity 0.5 with Parser 2 Català Italiano Dansk Language settings: English Português Español Svenska Français
  • 77. ubiquity 0.5 with Parser 2
  • 78. ubiquity 0.5 with Parser 2 Català Dansk English Português
  • 79. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  • 80. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  • 81. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
  • 82. Thank you! Questions? mitcho Michael Yoshitaka Erlewine by-nc-sa mitcho.com @mitchoyoshitaka