Search

Ubiquity: Designing a Multilingual Natural Language Interface

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    Notes on slide 1

    4 Favorites

    Ubiquity: Designing a Multilingual Natural Language Interface - Presentation Transcript

    1. ubiquity: designing a multilingual natural language interface mitcho Michael Yoshitaka Erlewine 2009 SIGIR Workshop on Information Access in a Multilingual World Boston, July 23rd, 2009
    2. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
    3. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
    4. USER INFORMATION INTERFACE
    5. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
    6. USER INFORMATION INTERFACE
    7. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe
    8. USER INFORMATION English Deutsch Español Français INTERFACE Português Русский Italiano Polski Türkçe this ta lk
    9. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
    10. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
    11. EQUIPOTENT MULTILINGUAL INTERFACES • not just translating content or localizing interfaces • ensuring equal access to information • ensuring equal generativity and potential of the platform
    12. “We create communities of people involved in making the Internet experience better for all of us... The Internet is a global public resource that must remain open and accessible.” —Mozilla Manifesto
    13. Afrikaans English (US) Gaeilge Português (Europeu) Shqip Esperanto Italiano ਪ"ਜਾਬੀ ‫ﻋﺮﺑﻲ‬ Eesti keel română অসমীয়া suomi Русский Kannada Euskara Français српски Беларуская Frysk සිංහල Kurdî বাংলা (ভারত) Galego slovenčina Latviešu Български ქართული slovensko lietuvių kalba català Deutsch Español (de Argentina) Македонски ( ) Ελληνικά Español (de España) मराठी ગ"જરાતી Svenska ( ) Norsk bokmål Telugu Hrvatski ‫עברית‬ Norsk nynorsk ไทย Čeština !ह#दी (भारत) occitan (lengadocian) Українська Dansk Magyar ‫ﻓﺎﺭﺳﯽ‬ Tiếng Việt Nederlands íslenska Polski Cymraeg English (British) Bahasa Indonesia Português (do Brasil)
    14. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
    15. BUILDING A SCALABLE INTERFACE PARADIGM
    16. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s...
    17. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them?
    18. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm...
    19. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons?
    20. BUILDING A SCALABLE INTERFACE PARADIGM The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons? • add more menus?
    21. CC-BY-SA: flickr.com/photos/daveduarte/2678853923/
    22. ACM interactions 2008
    23. CC-BY: flickr.com/photos/striatic/1629254/
    24. ?
    25. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
    26. Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: flickr.com/photos/ seanosh/3307290530/
    27. a natural language interface
    28. ubiquity ubiquity.mozilla.com
    29. [demo 1] inserting a map into email (video not included in PDF)
    30. without ubiquity
    31. without ubiquity
    32. without ubiquity
    33. without ubiquity
    34. [demo 1] inserting a map into email: one step with ubiquity (video not included in PDF)
    35. [demo 2] translating and emailing web content (video not included in PDF)
    36. without ubiquity
    37. without ubiquity
    38. without ubiquity
    39. without ubiquity
    40. without ubiquity
    41. [demo 2] translating and emailing web content: fast and straightforward with ubiquity (video not included in PDF)
    42. goal: how?
    43. goal: accomplish more on the web how?
    44. goal: accomplish more on the web how? connect the web with language
    45. verbs* *JavaScript
    46. ubiquity: designing a multilingual natural language interface • focus on multilingual delivery and interfaces • reconsidering the text-based interface • localizing ubiquity
    47. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
    48. LOCALIZING UBIQUITY • The goal: “natural syntax” • Users must expect that not all natural inputs are understandable. • But the parser must not add restrictions which go against the user’s natural syntax.
    49. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese, a scrambling language) • Tarō-ni ball-o nager=o Tarō-dat ball-acc throw=imper •
    50. LOCALIZING UBIQUITY • EX: The following must behave equivalently: (Japanese) • ... nager=o (imperative) • ... nager=u (infinitive) • ... nage=te (linking form)
    51. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
    52. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
    53. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
    54. LOCALIZING UBIQUITY • Putting theoretical linguistic research and insights into practice • Writing individual language parsers is difficult and time-intensive • A Principles and Parameters model • One universal parser with minimal language settings
    55. parser (animation not included in PDF)
    56. parser (animation not included in PDF)
    57. parser (animation not included in PDF)
    58. parser (animation not included in PDF) N N V
    59. parser (animation not included in PDF) N N V goal object
    60. parser (animation not included in PDF) N N V goal object V ( goal, object )
    61. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
    62. LOCALIZING UBIQUITY Argument identification via semantic role CmdUtils.CreateCommand({ 

names:
["email",
"mail"],
 

arguments:
[ 



{role:
"object",
nountype:
noun_arb_text}, 



{role:
"goal",
nountype:
noun_type_contact} 

], ...
    63. LOCALIZING UBIQUITY Argument identification via semantic role
    64. LOCALIZING UBIQUITY Argument identification via semantic role
    65. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
    66. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
    67. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
    68. LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de
    69. [demo 3] ubiquity in Japanese: “hello to Spanish” (video not included in PDF)
    70. LOCALIZING UBIQUITY • Support for various linguistic structures • Equal support for verb-initial and -final languages • Smart argument-first suggestions
    71. LOCALIZING UBIQUITY Minimal language descriptions branching:
'left', usespaces:
false, joindelimiter:
'', anaphora:
["これ",
"それ",
"あれ"], roles:
[ 

{role:
'object',
delimiter:
'を'}, 

{role:
'goal',
delimiter:
'に'}, 

{role:
'source',
delimiter:
'から'}, 

{role:
'position',
delimiter:
'で'}, 

{role:
'position',
delimiter:
'に'}, 

{role:
'instrument',
delimiter:
'で'}, 

{role:
'alias',
delimiter:
'として'}, ]
    72. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
    73. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
    74. LOCALIZING UBIQUITY • An equipotent multilingual platform par excellence • Equivalent underlying parse structures • Commands via semantic role: write once, use in any language • Easy to add new languages
    75. ubiquity 0.5 with Parser 2
    76. ubiquity 0.5 with Parser 2 Català Italiano Dansk Language settings: English Português Español Svenska Français
    77. ubiquity 0.5 with Parser 2
    78. ubiquity 0.5 with Parser 2 Català Dansk English Português
    79. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
    80. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
    81. ubiquity: designing a multilingual natural language interface • Conclusion • broad and equal access to information requires equipotent multilingual interfaces • ubiquity: an equipotent platform par excellence • challenging internationalization possible through application of linguistic research
    82. Thank you! Questions? mitcho Michael Yoshitaka Erlewine by-nc-sa mitcho.com @mitchoyoshitaka

    + Michael Yoshitaka ErlewineMichael Yoshitaka Erlewine, 4 months ago

    custom

    1733 views, 4 favs, 3 embeds more stats

    Slides from a presentation on Ubiquity at the works more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 1733
      • 1641 on SlideShare
      • 92 from embeds
    • Comments 0
    • Favorites 4
    • Downloads 42
    Most viewed embeds
    • 74 views on http://ubiquity.mozilla.com
    • 17 views on http://mitcho.com
    • 1 views on http://www.slideshare.net

    more

    All embeds
    • 74 views on http://ubiquity.mozilla.com
    • 17 views on http://mitcho.com
    • 1 views on http://www.slideshare.net

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories

    Tags

    more
    -->
    Search
    RSS Feed
    What's new?

    © 2009 SlideShare Inc. All Rights Reserved