1
Rich Mobile Applications
Enabling a real-time mobile web UX
Paul Golding (02-Dec-2008) v0.2
Copyright Paul Golding, 2008

2
The Thesis
Due to a number of key browser and
mobile platform trends, mobile web
applications will increasingly be
capable of real-time and
asynchronous functions that will
dramatically improve the user
experience, including impacts on
telephony, messaging and social
networking. This will lead to a new
breed of Rich Mobile Applications
(C) Copyright Paul Golding, 2008

3
Real-time?
Real-time here means ability for the web-based applications to respond to
asynchronous events as they happen in both the web and “native phone”
domains. For example, web application will be bought into focus in response
to IM message, text messages, phone calls, social network updates - they
will handle the events, consume the data and dispatch response(s).
Real-time is a key attribute of the mobile experience - it is what mobile is all
about!
(C) Copyright Paul Golding, 2008

4
Real-time?
Web

Page
Web page synchronised to user clicks
Phone events Web Web events
Page
 Web
Page
Web 2.0
Web page changes state asynchronously to user clicks
Copyright Paul Golding, 2008

5
Mobile Browsing 1,2,3..
Thus far, mobilisation of web has been mostly about accessing the web from a mobile.
Phase one was ‘cut-down’ web (e.g. WAP) and phase two was ‘full web’ on the mobile.
Full web still a relatively poor UX, but improving and highly motivated by the increased
digitisation of lifestyles due to Web 2.0 - i.e. we all spend more time online and need the
same basic ‘always browsable’ benefits that mobile telephony brought to telephony.
Phase three needs to be about making the web ‘always on’ (persistent) and enabling it to
merge (mash?) with the other mobile functions (e.g. telephony, messaging, location etc.)
Always browsable not the same as ‘always on’
(C) Copyright Paul Golding, 2008

6
Key browser trends...
(C) Copyright Paul Golding, 2008

7
Trend 1- Persistence
In order for a mobile application to be reactive to real-time events, it has to
be always running, or persistent.
Key technologies that support persistence are:
Widgets/Embedded web container
Offline storage
(C) Copyright Paul Golding, 2008

8
Widgets and Offline...
Widgets can support persistence by allowing the web application to always
be running and always be visible (in some way) to the user. Note that many
implementations today of widgets are NOT persistent! They do not run in the
background.
Offline storage supports persistence by allowing (a copy of) web-bound data
to be accessed and updated in real-time without a viable web connection
(C) Copyright Paul Golding, 2008

9
The advantage of persistence...
Widgets
Always on and able to react to events
Always visible to the user - easy to ‘bump into’
Offline
‘Web bound’ data always available
Outbound events can be asynchronous to network availability (e.g. updating
status, sending a message etc.)
Challenges: battery, data sync, widget UI (small screens)
(C) Copyright Paul Golding, 2008

10
Trend 2 - Push
We have persistence, but how do we make these apps reactive to events?
Not by AJAX-ian polling = bad for battery = bad for mobile!
Non-web push already exists - WAP Push, SMS, MIDP registry, Blackberry, Mobile Me: all
external to web runtime.
Mobile AJAX will likely incorporate COMET - true asynchronous push within the web
runtime. Example - lightstreaming. See http://blog.wirelesswanders.com/?s=push+ajax
Web
Page Web 2.0
Data pushed to the web page
(C) Copyright Paul Golding, 2008

11
Trend 3 - Browser APIs
Open AJAX mobile APIs
e.g. BONDI initiative (OMTP)
Telephony, messaging, address book, location, camera, media etc.
Note - most browsers already support embedding of phone numbers (OMA)
Web Device Web
Page APIs Page
Browser Browser
Javascript access to APIs
(C) Copyright Paul Golding, 2008

12
Trend 4 - embedded web
Making the web browser a component accessible natively - e.g. Qtopia,
Android [like Adobe Air on the desktop]
Client-side “mashing” possible, between web apps and between web and
native apps/data stores e.g. address book + dynamic Facebook updates
This architecture tends to support pattern of web-UI enabling of native apps
(e.g. iTunes). In other words, native-centric more than browser-centric
integration. Still valid, still useful.
Device Native
APIs App
Embedded
Browser
(C) Copyright Paul Golding, 2008

13
Trend 5 - MIDP Bridging
Ability to access MIDP helper applications from within the browser
environment
Numerous potential benefits to running helper functions in MIDP, but also
architectural challenges (at embedded level)
Fragmentation not so problematic if large part of the overall app will be
web-based
MIDP Web
Apps Page
Browser
(C) Copyright Paul Golding, 2008

14
Trend 6 - Helper Functions
Use of native phone applications to support the browser
Possible method is Netscape plug-in architecture and <object> tag
Emerging in browsers like Opera 9.5 and Torch Mobile’s Iris (partner solution
for Qtopia)
Add-ons architecture in Fennec
Helper Web
Apps Page
Browser
(C) Copyright Paul Golding, 2008

15
Trend 7 - Better Javascript
Faster performance (e.g. SquirrelFish in Webkit)
Richer libraries
Javascript could also be used to support inter web-app communication
pathways (e.g. in Widget framework)
Will Javascript become native to mobiles anyway (e.g. JavaFX Script)?
(C) Copyright Paul Golding, 2008

16
The ecosystem trends...
(C) Copyright Paul Golding, 2008

17
Web 2.0 Trend - Cloud Computing
Moving more of your data into the cloud - contacts, diary, documents, notes,
bookmarks, photos
Other data sets makes sense: text messages, call records, - moving towards
100% of “phone data” stored in the cloud
(C) Copyright Paul Golding, 2008

18
Web 2.0 Trend -Microformats
Data formats that make data more portable between web applications
Opportunities to move more mobile data into the cloud, keeping it open
and portable.
Emerging formats will enable “contextual” computing
<div id=\"hcard-Paul-Golding\" class=\"vcard\">
<span class=\"fn\">Paul Golding</span>
<a class=\"email\" href=\"mailto:goldingp@gmail.com\">goldingp@gmail.com</a>
<div class=\"adr\">
<div class=\"street-address\">9 Eton Way</div>
<span class=\"locality\">Windsor</span>
,
<span class=\"postal-code\">POSH 1</span>
<span class=\"country-name\">United Kingdom</span>
</div>
(C) Copyright Paul Golding, 2008

19
Moving “Phone” data to cloud
Browser Phone Data
Store The Cloud
Text messages
Call records
“Phone” APIs Address book Open API
Divert status
MMS
etc.
User’s mobile phone usage is reflected
back into the cloud into an open
skype Truphone Others
platform. It can then be subscribed by
other services enjoyed by the user -
e.g. Skype, Truphone etc.
(C) Copyright Paul Golding, 2008

20
Web 2.0 Trend - Social APIs
Google Social Graph API
Google Friend Connect
Movement generally towards GGG web architecture (Web
3.0)
Means very easy to port social connectivity to web runtime
from the phone - i.e. add a friend online, not in the address
book, not in the SIM
(C) Copyright Paul Golding, 2008

21
Social Applications
Browser Phone Data
Store The Cloud
Text messages
Call records
“Phone” APIs Address book Open API
Divert status
MMS
etc.
Social apps
Social APIs
(C) Copyright Paul Golding, 2008

22
Mobile is social
Messaging (real-time)
Native Apps
Mobile Internet
= Video (packet and switched)
Location
Proximity (BT, barcodes, RFID, geo-
tagging, GPS, “mobile compass”)
Telephony (IMS, call records)
Mobile is the ultimate connector! Presence/Address Book (offline
storage)
Mobile TV (Interactive services)
(C) Copyright Paul Golding, 2008

23
Mobile social networks - the trend will be towards the “here and now” (i.e.
real-time) aspects:
Dynamic/automatic status updates based on user’s context - trend already
happening with photo/location enabling of so many iPhone apps
Proximity updates - “bump into” things or people and have this reflected in my
social network (e.g. mobiles will replace business cards and handshaking)
‘As I think’ updates - e.g. ‘jotting at the speed of thought’ (thumbjot.com)
(C) Copyright Paul Golding, 2008

24
RMA before RIA
With the aforementioned mixable/mashable aspects of browsers with native
apps, a Rich Mobile Applications potentiality is emerging
RIA is usually all about the richness of the UI (e.g. Flash/Flex) whereas RMA
will be more about the richness of the connectivity in its broadest sense.
RIA also coming, but not so important
(C) Copyright Paul Golding, 2008

25
Use Case - Web address book
Fully networked, always up-to-date, shared address books
Offline means that the address book can now be web-bound, but also instantly
accessible without a connection
UX - my address book is easy to maintain, always up to date (even if a friend changes his/
her number - I get the update). It shows dynamic data about my contacts, such as
Facebook status, and can vector into other services, e.g. “creating social events” via
Facebook
In future, users will kill time by ‘surfing’ their address book. It won’t look like what it does
today. It doesn’t exist in one place - it is a mash-up using microformats.
The active address book is the quintessential Mobile 2.0 experience
(C) Copyright Paul Golding, 2008

26
Use Case - Rich ‘Caller’ ID
Calls/texts/emails always augmented by latest information from the user’s
social networks (from the web address book)
User can easily ‘bump into’ other stuff in real-time associated with their
contacts
(C) Copyright Paul Golding, 2008

27
Use Case - Rich ‘Social ID’
Rich caller ID in reverse: Web 2.0 experiences are augmented in real-time
by social connectivity available via my mobile
E.g. 1 - Direct association: read a blog article by Joe B and can click to
call Joe B, text Joe B, or otherwise ‘connect’ with Joe B via any means
possible via the enhanced address book
E.g. 2 - Semantic association: read a blog about ‘acupuncture’ and
immediately search for possible connections in my social network
(C) Copyright Paul Golding, 2008

28
Implications
Today Tomorrow
Mobile Mobile Mobile
Phone Phone Phone
Network Network Network
Web
2.0
Web
Browser Browser
2.0 Browser Web
2.0
Media Player Media Player Media Player
Other Other Other
e.g. Camera e.g. Camera e.g. Camera
Movement of real-time service logic and data away from the
operator and towards the Web!
Can this trend be extended up into the mobile network itself? This
trend already underway with limited ‘network APIs’ (e.g. Betavine)
(C) Copyright Paul Golding, 2008

29
Today: Silo mobile architecture...
Rich IO
Browser Messaging Comms
Media (Sensors)
Web Telco Telco OS OS
bound bound bound bound bound

30
Future: Rich Mobile Applications
Rich IO
Messaging Comms
Media (Sensors)
API API API API
Offline sync Browser
“Always on” web
Web 2.0 “Mobile OS”
(e.g. Widgetization)
API API
Telco Telco OS OS

31
Mobile network trends...
(C) Copyright Paul Golding, 2008

32
Operator trend - SIP/IMS
Mobile networks migration to all-IP infrastructure, such as SIP-based
IMS and XML/HTTP based XDMS (web standards, but not yet web-
based - still behind a wall)
In the network, SIP-based applications are easy to build, extend, mash-
up and deploy: SIP servlets, SLEE etc.
BUT - main technical hurdle has been IMS apps on devices and lack of
universal client - no such thing as a “SIP browser” -- or is there?
(C) Copyright Paul Golding, 2008

33
SIP ‘browser?’
Oh - it’s just a mobile web browser (or widgets)
Using a native SIP ‘dispatcher,’ possible to use the browser UI as the
front end for SIP apps? [Various integration points possible.]
In conjunction with widgets, we have always-connected UX via
browser
IMS/SIP apps instantly mashable!
IMS widgets the future?
OR...we use XMPP to do the same thing
(C) Copyright Paul Golding, 2008

34
Operator trend - Mobile TV
Another possible key trend is emergence of Mobile TV networks (DVB-H)
Interactivity is supported by mobile data, which is the possible mashing point
Availability of media player and ESG should be exposed via Mobile AJAX
‘standard’ to allow Rich Mobile TV (RMTV) applications to be created. Possible
new (and big) revenues stream from ‘because of’ effect - new genres of ‘social TV’
and ‘context TV’ will emerge.
Also possible using MIDP bridge (e.g. JSR 272 Mobile Broadcast API)
New breed of mobile TV mash-ups possible (including IPTV - I have designed
them!) BUT, again, subject to willingness to make the TV ecosystem open.
(C) Copyright Paul Golding, 2008

35
Other opportunity - Home
Expose PnP and DLNA protocols to the web runtime
Example is iPhone 2.0 “remote” application to control Apple TV and iTunes
(via Bonjour) = mega-cool app!
Use case: printing to PnP printers - “Do you want a copy of this picture (on
my mobile)? Let me share it on your printer.”
(C) Copyright Paul Golding, 2008

36
Challenges
Battery life - persistent applications can be “chatty”
Filtering - need way to control flow of real-time events and reactions on the handset -
technological and design-pattern solutions required.
Embedded platforms - not easy to enable concurrency on mobiles across multiple
‘run times’ (e.g. browser, native, MIDP, helper apps etc.) Solution is probably the new
breed of integrated run-times, like Qtopia, Android etc.
Persistent UX - not easy to allow users to interact frequently with concurrent web
applications. Solution is better display technologies. Still a long way to go, including
better use of 3D.
Standards - potentially many ways to enable rich mobile applications from the
browser. It is also an area of hot innovation, so need to ensure we don’t end up with
lots of incompatible solutions.
(C) Copyright Paul Golding, 2008

Possible Mobile 3.0 tipping points (TP)... 37
TP = Rich Mobile Browsers?
TP = Femtocells?
Rich Mobile
Apps
Agile Sensor
Access Proliferation
TP = RFID?
Smartphone
Adoption
Mobile 3.0? Cloud
(“always on mobile web”) Computing
TP = Android? App Social TP = Multi-network
Stores Computing content vending?
TP = iPhone? TP = Social APIs?
All of these technologies have already landed!
Mobile 3.0 = when most of our digital services will become mobilized

38
Summary
Mobile browser trends and Web 2.0 trends point towards a uniquely mobile browser
evolution that caters for the other stuff that mobiles do, taking into account the real-time
element of the mobile UX
New ‘rich mobile applications’ (RMA) will emerge where richness of connectivity (or
richness of context) is more important than the richness of UI that is the prevalent trend in
desktop browser evolution towards RIA
Other ‘background’ trends in the mobile networks (e.g. IMS, DVB-H) could play a part in
the evolution. In fact, RMA is a good technological fit for easier service creation with these
networks. Openness is a problem (for operators) but essential for proliferation of perpetual
mobile connectedness.
(C) Copyright Paul Golding, 2008

39
Conclusions
RMA is possibly the defining pivot of the next
generation of mobile applications (with or
without IMS).
It involves ultimately an ecosystem play
because mashing of other phone functions
with Web 2.0 only makes sense if there’s a
useful Web 2.0 ecosystem (e.g. cloud
computing) to support services
In other words, players in the ‘RMA race’ need
a technology/ecosystem strategy to win the
mobile platform wars that will eventually
reduce fragmentation. Most likely, there will be
three winners in the consumer space and two
in the enterprise space. I have my own ideas
- you can guess who :)
(C) Copyright Paul Golding, 2008

40
Thank you
Paul Golding
paul@wirelesswanders.com
wirelesswanders.com
Follow @pgolding
(C) Copyright Paul Golding, 2008