Web Trends and Technologies Shaping the Future

The Next Big Thing
Trends and Technologies that Will Shape the Web

Prof. Dr. Stefan Wrobel

Dr. Joachim Köhler, Daniel Schneider, Prof. Dr. Christian Bauckhage,
Michael Eble, Dr. Kristian Kersting, Jochen Schon, Daniel Stein,
Sebastian Tschöpel, Verena Würbel

Fraunhofer Institute for Intelligent Analysis
and Information Systems IAIS
Univ. Bonn

Prof. Dr. Stefan Wrobel

© Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS

Web Technologies

Prof. Dr. Stefan Wrobel 2


The Big Seven

Geeignetes
illustrierendes
Bild für Trend

Geeignetes
illustrierendes
Bild für Trend



Input Your Way
Holistic Interaction

© Fraunhofer HHI



Rest in Peace: The Single Input Technology Paradigm

User interaction has long been dominated by single technologies of choice

© Marcin Wichary (Flickr) © Boffy b (Wikimedia) © Masaru Kamkura (Flickr)

1950 1970 1990 2010
1960 1980 2000



Input Your Way
Holistic Interaction

Geeignetes
illustrierendes
Bild: Gesture,
Kinect oä

© Fraunhofer FIT

© Masaru Kamkura (Flickr)

© Samsung

  The combined use of multiple interaction paradigms at the
user’s choice will be standard
  Lock-in will no longer be accepted
  Apps and Services must adapt to be competitive
  Disruptive change will put slow movers out of market,
creating opportunities for others


The Stylus is Back Already
All Products Announced 2011

© Samsung

© Asus



Point Screen: Gesture Control

  Gesture control with camera based
hand tracking
  2 IR-cameras
Stop
Turn
Back
Yes Gesture based POI
  Graphical inventory
  Touristic information systems
Lafers new Cooking
  Medical information system for Studio Table d‘Or“
operations environment
  Control of devices
© Fraunhofer HHI
Developed by Fraunhofer HHI (all pictures on this chart)



Gesture recognition for contactless Screen Control

  Advantage: Overcome the sensitive
Multi-Touch Displays (ﬁngerprints,
dirt, etc. )
  Control by analyzing the
movements of the hands
  3D camera with robust image
processing algorithms
  Adaptive for multi-user scenario

Developed by Fraunhofer FIT

© Fraunhofer FIT



Speech Control, VoiceSearch

Google Voice Search App (iPhone, Android):
  Isolated words and phrases
  Large vocabulary including names,
many languages
  High accuracy “amazing!”
Nuance Dragon Dictation App
  Nuance aquires SVOX, Loquendo, …, in
2011, Apple wants to aquire Nuance
  Speech control, IVR and speech dictation
Fraunhofer IAIS:
  Robust recognition in adverse
environments



Future Talk: Brain Computer Interface

  Developed by Berlin Brain
Computer Interface (BBCI) Group,
including Fraunhofer First
  Cerebral electric activity is
recorded via the
electroencephalogram (EEG)
  Recorded signals are ampliﬁed and
transmitted to the computer,
which transforms them into device
control commands
  Youtube:
http://www.youtube.com/watch?
v=ZIIffTH5D-E

© Berlin Brain-Computer Interface



The Big Seven

Geeignetes
illustrierendes
Bild für Trend

Geeignetes
illustrierendes
Bild für Trend



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



High Media
Merged Reality

© Fraunhofer HHI
© Layar



High media enablers

  Mobile processing power on the rise:
multicore, special graphics processing
  High-density screens, 3d screens, pico-projection
  Augmented and virtual reality displays
  Ubiquitous and budget availability of media
production tools
  Changed consumer habits and expectations due
to games and social media sites

© Layar © Texas Instruments



High Media
Merged Reality

Users will soon expect more than classical windows and buttons
  Animated content
  Matching sound
  Non-linear video
  3D rendering and technology
  Augmented reality

Geeignete
bilder zu
illustration
dieser
Technolgien

© Leonard Low © Fraunhofer HHI © Muﬁn © Tucia.com (Flickr)



Hybrid-TV, Connected-TV, Smart-TV, Linked-TV:

  Sales in 2011:
3,5 Mio. hybrid TV devices
  Classical TV and WebTV are
converging
  New interactive TV-standard
© Fraunhofer FOKUS
HbbTV (Hybrid Broadcast
Broadband TV) integrates Web
technology in broadcast
environment
  IFA 2011: Car Conﬁgurator
  Fraunhofer Fokus test labor
  Fraunhofer IAIS (EU projects
LinkedTV and Live)
© Fraunhofer IAIS



Mobile Augmented Reality for Everyone
From cool gadget to business perspective

  Mobile Augmented Reality (MAR) …
  Using the smartphone’s capabilities, i.e. cameras, GPS, broadband connection,
tilt sensors, and compass to provide layers of metadata to the user’s physical
surrounding
  … for Everyone!
  The Cool-Gadget-Era is about
to end
  MAR is on the edge of wide
adoption & becoming a cost-
effective business perspective
  Already a large number of
gaming, marketing, education
& social networking apps

© Layar



Impact within the next years

  AR: Top 10 disruptive technologies 2008 – 2012 [Gartner, 2008]
  MAR: Q1 2011 market worth $11 million but
one of the most signiﬁcant growth markets to 2016 [Visiongain, 2011]
  MAR: Annual application revenues expected to approach $1.5 billion
by 2015, up from less than $2 million in 2010 [Juniper, 2011]
  MAR will be favored by growing
adoption of high-performance
mobile devices & unlimited
data plans

Global Smartphone User Forecast [Parks, 2011]



Business Perspectives

  Expected Top MAR revenue streams by 2014
  Incremental revenues, such as premium & subscription-based services
  Point of Sale, such as upfront (in-) app payments
  Advertising
  Applications will include
  Location-based
services
  Games
  Enterprise

Total MAR Market ($m) by revenue streams [Juniper, 2011]



Use cases

  The list of brands that used AR for marketing is long & prominent

  MAR for marketing is a recent attraction (Nike, ebay, Vodafone, Post …)
,
  MAR Platforms have the potential to close the gap between technology
& business use-case

  MAR Fraunhofer Competences



Trend: 3D (for Merged Reality )

  3D TV is moving forward
  Frost & Sullivan study
March 2011: Frost &
Sullivan: „3D TV: The Good,
© Fraunhofer HHI
the Bad and the Ugly“
  Study: „ 3D technology has
made quantum jumps in
capability and availability”
  Study: “Nevertheless, it is
clear that the 3D market is
still in an early adoption
phase”
© Frost & Sullivan study March 2011:
“3D TV: The Good, the Bad and the Ugly“

Shipments of 3D-TVs in Millions


Total Immersive: Football in 3D Video and Audio

  Immersive video technique for public
viewing of the next generation
(3D video and 3D audio)
  Panorama projection at TiME Lab of
Fraunhofer HHI in Berlin
  14 HD projectors with a resolution of
2000 X 7000 pixel, 180 degree display TiME Lab at Fraunhofer HHI

  128 loudspeakers using the IOSONO
sound technology of Fraunhofer IDMT
(„wave ﬁeld synthesis”)
  Field trials at Bundesliga matches
(BVB-Hoffenheim)

© Fraunhofer HHI



3D – Fanta4 Live Concert in 3D

  Automated 3D production process
with STAN (Stereoscopic Analyzer)
  Automatic analysis of stereo
images in real-time
  Usage in live scenarios possible
  Live Event: September 28, 2010 © Gerold Marks, DigitaleLeinwand.de

concert of the „Fantastischen Vier“
in 3D in 88 cinemas
  Full integration of 3D in the
production process
  Developed by Fraunhofer HHI

© Fraunhofer HHI



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



Big Data
Mashed, curated, amalgamated content creates value

Megabytes

Gigabytes

Terabytes

Petabytes

Exabytes


More data than ever
Explosive growth

Convergence Ubiquitous Intelligent
Systems

Users as
Producers © IDC White Paper – The Diverse and Exploding Digital Universe

Total digital output will surpass 1 Zettabyte this year [IDC, 2010]



Actual Storage Amounts – Annual New Data 2010

[IDC/McKinsey, 2011]



Big Data means Big Opportunities
Data is the new oil

  Through 2015, organizations integrating high-value, diverse, new
information types and sources into a coherent information
management infrastructure will outperform their industry peers by
more than 20%. [Gartner, 2011]

  Gain is estimated enormous, across sectors:: 300 billion $ annual in
health sector (US), 60% margin improvement in retail (US), 100
billion € annually in public administration (EU), 600 billion
consumer added value due to position data [McKinsey , Manyika
et.al. 2011]



Creating value based on big data
Mashups, selection, curation, amalgamation, condensation, combination

  Data in itself and individually is usually useless

  Individuals and organizations do not know how to deal with
volume, variety, velocity, complexity of big data

  Storing, databases and fast processing aren’t the answer

  Business opportunities for those who can intelligently
  Select data
  Recombine to create insight
  Create engaging user experience
  Involve crowdsourcing communities



Crowdsourcing at The Guardian

Example “The Guardian”:
  British Newspaper The Guardian
asked its readers to participate
in reviewing documents of the
British parliament's expenses.
  The Guardian gave his readers
the tools to click through the
documents and asked them to
classify these papers and
support the editorial
department.
  Until September 2011 a total of
28.600 readers have reviewed
224.000 documents.
© Guardian



Open Data



Dentists and Tubes
Services based on big data



FOKUS project government mashups

  Mobile applications for accessing government data
e.g. trafﬁc condition monitoring

© Fraunhofer FOKUS



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



Auto-Sense
Intelligent Analysis, Semantics and AI



The data iceberg

Database tables
20% Excel spreadsheets
Other data with ﬁxed structure

Email, Notes

80% Word documents
PDF. Power Point
Other text
Images
Video, audio


Auto-Sense or The challenge of semantics

intelligent analytic technologies

Very large set Manual Intelligent
of data Structuring Service



EmotionRadar
Extracting Information from Millions of Webpages Automatically

  Automatic monitoring of forum and social network posts for
statements about a product
  Summarization of emotions and current issues, brand monitoring



Speech-Based Video Citation for the ARD Mediathek

  Technolgy can open-up video archives for a
new audience
  Project with ARD: Speech-based citation of
TV Scenes in Social Networks
  In analogy to Copy & Paste in the text
domain:
  Use speech recognition output for citing
video fragments
  Exploit viral effects of social video scene
recommendation



Theseus UseCase Contentus – Technologies for the next
generation multimedia online archives

  Content owners:
libaries, broadcasters, publishers
  Challenge: Content is in analogue form
  Objectives:
  Content preservation
  Content indexing
  Content linking and search
  Content presentation
  Approach
  Semantic multimedia technologies



SpeakerText

© Humanoid



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



Total Mobility
Location is King!



We have to think in new patterns when everything
goes mobile



The number of people using high performance mobile
smart phones is rapidly rising



Total Mobility

M-Applications eGovernment

Social
Total
M-Commerce 1 Networks
Mobility

M-Publishing
M-Banking



„Total Mobility“ enables new business opportunities

  Pictures of shelves and products
are placed in a subway station

  The customer scans the QR-
Codes of the products with his
smart phone

  When the order is ﬁnished the
chosen products are delivered © Home Plus, Südkorea

directly to the customers home



Mobility Mining for Outdoor Advertising
Predicting Media Reach based on track data – ag.ma, SPR+

  How many people on each German
street segment?
  Basis for outdoor ad reach and pricing
since 2008
  What percentage of a target group is
seeing a poster board in a given time
period?
  Largest respresentative GPS study in
Germany

  Awarded „Best market research study“
Prize



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



Contextual2 Advertising
Better Context – Better Ads – More Revenue



Google Predictions on Digital Ads

In 2015… Users can directly inﬂuence 25%
of the ads they see.

50% of the ads will be “social”.
25% less (but better)
ads will be shown to a user.
35% of the ads will use
success criteria beyond clicks.

Source: Google Talk „There’s a perfect ad for everyone.”,
Interactive Advertising Bureau’s Innovation Days



Trends in Digital Advertisement Source: Tomorrow Focus Media,
„The Future of Online Display Ads“, 09-2011

  Mobile Marketing
Drastic growth through widely
spread smartphones
91%
© Wolf Gang (Flickr)

  Social Media
Viral potential of an ad is a key
succes factor (Millward & Brown, 81%
Digital Trends 2011)
Source: Sue Waiters (Flickr)

  Automation of Ad Planning
Better Ads through automatic
planning and targeting 91%
… of market experts
© ralphbijker (Flickr) expect growth!


Special Challenge: Contextual Ads for Videos

  Select relevant ads for a given video based on content
  Same topic, atmosphere or structure
  Information typically not available!

  Automatic linking between ad and video using Audiovisual Analysis
© saragoldsmith (Flickr)
  Speech Recognition
  Topic Analysis
  Atmosphere Analysis
  Video Structure Analysis
P t
Ad-Topic
knife
basil •  Automotive [0.0]
water •  Groceries [0.5]
leaves
•  Beauty [0.2]
•  Travel [0.1]
•  …


Ads in Apps: Contextual Ads for 2nd Screen Devices

  Many TV viewers use 2nd Screen in parallel
(iPad, smartphone, Laptop)

  The 2nd screen could display contextually relevant…
  Information about actors etc.
  Games
  Ads!

  Major Challenges
  Real-Time analysis of broadcast signal for selecting
contextually relevant ads / information / etc.
  Automatic Synchronization of devices



Present your Targeting Innovations at our Conference:

  Meet Online Marketing experts
  Discuss Innovations and challenges in
  Targeting Technologies
  Online Marketing
  Recommendation- and Data-Mining-Systems
  22.11.2011 Kameha Grand Bonn
  More information at www.iais.fraunhofer.de/ta
  Or get one of our brochures!



Online Computer Games:
From Retail to Online Ads and Purchasing Virtual Items

  Over 2/3 American households play
computer and video games

  Six of the top 10 best-selling computer
games in 2008 were online games [ESA, 2009]
ESA,

  The computer game market revenue
surpassed the movie box ofﬁce revenue
in 2001 and the recorded music market
revenue in 2007 [OECD, Paris; MCV UK]

  The boom of online games is happening
everywhere in the world
[BusinessWeek, Bloomberg L.P.]



New Trend: Games Analytics

  Digging for insights on human behavior in the terabyte-sized data logs
generated by computer games
  “You have over 10 million people playing World of Warcraft about 4 hours per
day, 7 days a week. And that’s on average; some play 80 hours per
week!” [Jaideep Srivastava, University of Minnesota, Twin Cities, USA @ IEEE International Conference on
Computational Intelligence, Copenhagen, August 18-21, 2010]

  Either as natural laboratories for
understanding human behavior and/or in
order to optimize the success of games
and maximize game revenue by
increasing player satisfaction

© Science



The Big Seven

Geeignetes
illustrierendes
Bild für Trend



Open Privacy
Making Ends Meet



The Importance of Privacy…?

  Another 25 years of development will lead us to a new world of
cheap and ubiquitous computing, in which privacy will be a
quaint obsession of our grandparents.

(Richard Jones, 2011, University of Shefﬁeld)

  If you asked me what I thought would be most likely thing that
people would want to change, no one at the company thought
it would have been simpler privacy controls.

(Mark Zuckerberg, 2010, Facebook CEO)



Open Privacy

  Privacy not a major concern – but still
major uproar about perceived misuses
  Each data scandal results in a massive
loss both in image and money
  Compromised data costs 204$ per
customer on average. Costs up to 31M$
for one incident [ponemon.org]
  Unclear where societal debate will end
  Open data needed for business and
customer value
  Design systems to be open yet
respect privacy by design



Privacy by Design – Privacy Preserving Data Analysis

  Open Privacy … by design
  anonymizing data „where it happens“
  open algorithms
  provable secure (similar to cryptography)
  …without obstructing knowledge discovery
opportunities

  EU-Project Local Inference in Massively Distributed
Systems: privacy aware knowledge discovery on
e.g. bluetooth sensors

  „Safe Zone“ Technology



The Big Seven

Input Your Way Big Data Total Mobility

Geeignetes
illustrierendes
Bild für Trend

Open Privacy

High Media Auto-Sense Contextual2 Adv



Web Trends and Technologies Shaping the Future

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (15)

Similar to Web Trends and Technologies Shaping the Future

Similar to Web Trends and Technologies Shaping the Future (20)

Recently uploaded

Recently uploaded (20)

Web Trends and Technologies Shaping the Future