Mashup the Browser with Ubiquity and Jetpack

mashup the browser with ubiquity and Jetpack mitcho Michael Yoshitaka Erlewine TechMaine 17th Annual Conference Portland, Maine, December 10, 2009

mitcho ?linguist, coder, teacher Mozilla Labs, MIT mitcho.com @mitchoyoshitaka CC-BY-NC-SA: flickr.com/photos/jimgris/3538639095/

envisioning the future of the web

envisioning the future of the web • the you-centric web: • social identity • interacting with the web • hackability

envisioning the future of the web • the you-centric web: • social identity • interacting with the web today • hackability

you live your life online

your social graph is online

aza = window.people.find({name:“Aza Raskin”}); aza.send(“Greetings from TechMaine!”);

your browser should be yours

mashup the browser with ubiquity and Jetpack three problems: 1. interaction 2. language 3. hackability

how do we interact with the web?

how do we interact with the computer?

CC-BY-NC-SA: ﬂickr.com/ photos/pixcat/2324175139/

can you spot the difference?

The web is offering more and more functionality and API’s... ...but how do you use them? • Following the GUI paradigm... • add more buttons? • add more menus?

CC-BY-SA: flickr.com/photos/daveduarte/2678853923/

from http://tecfa.unige.ch/~nova/img/lopez1.png

Aza Raskin CC-BY-NC: flickr.com/photos/ santheo/2360961001/

ACM interactions 2008

Aza Raskin on text-based interfaces “Standard GUIs, with their drop-down menus, check buttons, and tree-lists, cannot compare to the range of options that a text interface effortlessly provides. With just five alphanumeric characters, we can choose one out of 100,000,000 possible sequences... It’s difficult to come up with a non-text-based interface that can perform as well.” CC-BY-SA: ﬂickr.com/photos/ seanosh/3307290530/

CC-BY: flickr.com/photos/striatic/1629254/

Aza Raskin on text-based interfaces “...maybe this confusion isn’t the fault of command-line interfaces in general; maybe it’s just the command lines we’re used to. If commands were memorable, and their syntax forgiving, perhaps we wouldn’t be so scared to reconsider these interface paradigms.” CC-BY-SA: ﬂickr.com/photos/ seanosh/3307290530/

a natural language interface

ubiquity ubiquity.mozilla.com

ubiquity DEMO

ubiquity goal: accomplish more on the web how? connect the web with language

ubiquity verbs* *JavaScript

ubiquity ubiquity.mozilla.com

The multilingual internet: 1. The web is disconnected by language.

The Internet, 2005 CC-BY: commons.wikimedia.org/wiki/ File:Internet_map_4096.png

The Internet, 2005: jp, cn, tw, au, de CC-BY: commons.wikimedia.org/wiki/ File:Internet_map_4096.png

The Internet, 2005 CC-BY: commons.wikimedia.org/wiki/ File:Internet_map_4096.png

The Internet, 2005: ut, it, pl, fr CC-BY: commons.wikimedia.org/wiki/ File:Internet_map_4096.png

The multilingual internet: 2. The tools of the future must be multilingual.

Afrikaans English (US) Gaeilge Português (Europeu) Shqip Esperanto Italiano ਪ"ਜਾਬੀ !"#$ Eesti keel română অসমীয়া suomi Kannada Русский Euskara Français српски Беларуская Frysk සිංහල Kurdî বাংলা (ভারত) Galego slovenčina Latviešu Български ქართული lietuvių kalba slovensko català Deutsch Español (de Argentina) Македонски (简 ) Ελληνικά Español (de España) मराठी ગ"જરાતી Svenska ( ) Norsk bokmål Telugu ‫עברית‬ Norsk nynorsk Hrvatski ไทย !ह#दी (भारत) occitan (lengadocian) Čeština Українська Dansk Magyar %&‫)(ر‬ Tiếng Việt Nederlands íslenska Polski Cymraeg English (British) Bahasa Indonesia Português (do Brasil)

localizing ubiquity • Writing a parser is hard • Principles and Parameters approach • a universal parser + individual language settings

parser

parser N N V goal object V ( goal, object )

localizing ubiquity Argument identification via semantic role

LOCALIZING UBIQUITY Argument identification via semantic role role English Japanese object ø o goal to ni, e location at, on de

localizing ubiquity DEMO: ubiquity in Japanese

localizing ubiquity Minimal language descriptions

ubiquity 0.5 Català Italiano Dansk Language settings: English Português Español Svenska Français

ubiquity 0.5 Català Dansk English Português

the web should be generative

the browser should be generative

Firefox Addons 1. addons.mozilla.org (AMO) 2. over 6000 in the wild 3. HTML, JavaScript, XUL 4. Extend Firefox contest

Firefox Addons 1. addons.mozilla.org (AMO) 2. over 6000 in the wild my favorites: Tree Style Tabs, del.icio.us, AdBlock, Firebug

Firefox Addons 1. addons.mozilla.org (AMO) 2. over 6000 in the wild 3. HTML, JavaScript, XUL 4. Extend Firefox contest

+ Firefox Addons largest extension platform ever

+ Firefox Addons 1.5 million downloads

but...

Firefox Addons 1. installs need restarts 2. not trivial to develop 3. requires manual upgrades 4. not designed for quick security review

Jetpack jetpack.mozillalabs.com

Jetpack the future of extending Firefox

Jetpack 1. JavaScript, HTML, CSS • • simple, secure, modular API 2. instant install 3. automatic upgrade

Jetpack DEMO 1: Helvetica

Jetpack DEMO 2: You Are Here

IP Query API (XML): ipinfodb.com/ip_query2.php?ip=techmaine.com

Jetpack DEMO 2: You Are Here

Jetpack jetpack.mozillalabs.com

a more personal web a more generative web a more natural web an open web

join us mozillalabs.com

“The best way to predict the future is to invent it” —Alan Kay

Thank you! Questions? mitcho Michael Yoshitaka Erlewine by-nc-sa mitcho.com @mitchoyoshitaka

http://mitcho.com	1073
http://ubiquity.mozilla.com	31
http://www.slideshare.net	7
http://translate.googleusercontent.com	4
http://speakerrate.com	2
http://fanyi.youdao.com	2
http://namwook.blogspot.com	1

Mashup the Browser with Ubiquity and Jetpack

by Michael Yoshitaka Erlewine

Accessibility

Categories

Upload Details

Usage Rights

7 Embeds 1,120

Statistics