This presentation provides an overview of multi-touch hardware, products, applications and market examples as well as samples of projects of TNO. More information on http://www.tno.nl/nui
touch screen technology contains some limitations with it, it is fast, accurate, user friendly and fun to operate .It is being widely accepted. With some modifications, it can completely replace mouse and keyboard completely in the near future.
touch screen technology contains some limitations with it, it is fast, accurate, user friendly and fun to operate .It is being widely accepted. With some modifications, it can completely replace mouse and keyboard completely in the near future.
Presentation on Touchless Touch Screen including a small video of touchless technology. Contributed by, Sanjit Sadhukhan, student of Guru Nanak Institute of Technology.
Video can be downloaded from https://www.youtube.com/watch?v=DfaiREjXTys that is on 12th slide.
That is touch screen technology as everything (laptop,desktop,mobiles,ATM machine) each and everything can be used by touch.so how it works.Take a tour of uploaded ppt.
It was the touch screens which initially created great foregone are the days when you have to fiddle with the touch screens and end scratching up. Touch screen displays are ubiquitous worldwide. Frequent touching a touchscreen display with a pointing device such as a finger can result in the gradual de-sensitization of the touchscreen to input and can ultimately lead to failure of the touchscreen. To avoid this a simple user interface for Touchless control of electrically operated equipment is being developed. Elliptic Labs innovative technology lets you control your gadgets like Computers, MP3 players or mobile phones without touching them. A simple user interface for Touchless control of electrically operated equipment. Unlike other systems which depend on distance to the sensor or sensor selection this system depends on hand and or finger motions, a hand wave in a certain direction, or a flick of the hand in one area, or holding the hand in one area or pointing with one finger for example. The device is based on optical pattern recognition using a solid state optical matrix sensor with a lens to detect hand motions. This sensor is then connected to a digital image processor, which interprets the patterns of motion and outputs the results as signals to control fixtures, appliances, machinery, or any device controllable through electrical signals.
Presentation on Touchless Touch Screen including a small video of touchless technology. Contributed by, Sanjit Sadhukhan, student of Guru Nanak Institute of Technology.
Video can be downloaded from https://www.youtube.com/watch?v=DfaiREjXTys that is on 12th slide.
That is touch screen technology as everything (laptop,desktop,mobiles,ATM machine) each and everything can be used by touch.so how it works.Take a tour of uploaded ppt.
It was the touch screens which initially created great foregone are the days when you have to fiddle with the touch screens and end scratching up. Touch screen displays are ubiquitous worldwide. Frequent touching a touchscreen display with a pointing device such as a finger can result in the gradual de-sensitization of the touchscreen to input and can ultimately lead to failure of the touchscreen. To avoid this a simple user interface for Touchless control of electrically operated equipment is being developed. Elliptic Labs innovative technology lets you control your gadgets like Computers, MP3 players or mobile phones without touching them. A simple user interface for Touchless control of electrically operated equipment. Unlike other systems which depend on distance to the sensor or sensor selection this system depends on hand and or finger motions, a hand wave in a certain direction, or a flick of the hand in one area, or holding the hand in one area or pointing with one finger for example. The device is based on optical pattern recognition using a solid state optical matrix sensor with a lens to detect hand motions. This sensor is then connected to a digital image processor, which interprets the patterns of motion and outputs the results as signals to control fixtures, appliances, machinery, or any device controllable through electrical signals.
Mobile Application Design & DevelopmentRonnie Liew
The mobile landscape is incredibly fragmented with a huge pool of devices and operating systems. This presentation shares tips and guidelines on how to navigate this maze and help design/develop better mobile applications.
Touch and Gesture Computing, What You Haven't Heardgoodfriday
Learn about new patterns, behaviors, and design approaches for touch and gesture interfaces from a practitioners point of view. Learn early lessons from applied knowledge of touch applications, devices, and design methods.
Even though touchscreen and gestural technology has been around for decades, Nintendo's Wii, Apple's iPhone and Microsoft Surface have heralded a new era of interaction design where gestures in space and touches on a screen will be as prominent as pointing and clicking.
But how do you create products for this new paradigm? While most of us know how to design for web and desktop applications, many are still wondering how to adequately design for interactive gestures. This talk covers the basics: ergonomics, a brief history of gestural technology, prototyping and documenting, and how to communicate the presence of a gestural interface to users.
Dan Saffer, a founder and principal designer at Kicker Studio, has designed interactive products since 1995 that are currently used by millions every day. Dan has led projects for large organizations like Nokia and Time Warner to start-ups such as Ning and Foxmarks. An international speaker and author, his acclaimed book Designing for Interaction (New Riders) has been called "a bookshelf must-have for anyone thinking of creating new designs" and has been translated into several languages. His new book, Designing Gestural Interfaces (O'Reilly) was published in December 2008.
Dan is an internationally-recognized thought leader on design who has spoken at conferences and taught workshops on interaction design all over the world. Dan's writings on design have appeared in BusinessWeek, Vitamin, and Boxes and Arrows. He has a Masters of Design in Interaction Design from Carnegie Mellon University.
Veel gemeenten willen of zijn aan de slag met digitaal burgertoezicht, zoals de inzet van WhatsApp-groepen. Om hen te ondersteunen bij de beleidsontwikkeling organiseert de VAR in samenwerking met het CCV en RVS-Midden Nederland het landelijk congres 'Gemeenten en digitaal burgertoezicht'. De toegang voor dit congres, dat op 11 oktober wordt gehouden, is gratis.
In Nederland zijn ruim 4.800 geregistreerde WhatsApp-groepen. Het totale aantal groepen ligt waarschijnlijk hoger. Onderzoek in Tilburg laat zien dat gebruik van WhatsApp-groepen kan leiden tot een flinke daling van het aantal inbraken.
https://hetccv.nl/nieuws/nieuws-detail/article/congres-gemeenten-en-digitaal-burgertoezicht/
In this annual review we show you the highlights of 2010 for our innovationcampus Kennispark Twente in Enschede. More information and a Dutch version is also available via www.kennispark.nl
A lecture on research directions in Augmented Reality as part of the COSC 426 class on AR. Taught by Mark Billinghurst from the HIT Lab NZ at the University of Canterbury.
This presentation was presented at BNO Spellbound Amsterdam in march 2011 and dives into the subject of Meta Products. It explains what Meta Products are and how they can be designed. The introduction contains some portfolio cases of Booreiland.
De Moderne Sherlock Holmes - Online burgerosporingTNO
Democratisering van kennis, opsporingsinformatie en tools zorgen er naast digitalserende criminaliteit, in rap tempo voor dat burgers en bedrijven steeds meer zelf aan opsporing doen. Social Media is een belangrijk onderdeel van dit nieuwe DNA, vooral ook als krachtig middel voor nieuwe vormen van samenwerking. Kunnen politie en justitie deze ontwikkelingen bijhouden en hoe verandert hun rol?
Deze presentatie bevat voorbeelden van burgeropsporing en bedrijfsopsporing op criminaliteitssoorten variërend van veel voorkomende criminaliteit (VVC), High Impact Crime (HiC), ondermijning en zelfs de grootste opsporingszaak die Nederland tot nu toe gekend heeft: de MH17.
Deze prs
Opening academisch jaar ad de jonge centrum
http://addejongecentrum.uva.nl/home/componenten/news-list/news-list/content/folder/2014/09/opening-academisch-jaar-17-september.html
Social media, the world of Facebook, Twitter and Youtube, have made an enormous
impact on our society.
Over the last five years, social media have changed the world of public order and
security as well as the investigation of crimes. One could even say a revolutionary
development is taking place. The meaning of this revolution might not be valued
yet, but it has and will continue to have great consequences when it comes to the
organization and methods of the police and it’s professional partners. Now, not only
the partners, but also civilians are playing an increasingly crucial part within the
security domain.
Er vindt een revolutie plaats in de tactische
opsporing: Social Media. Over deze revolutie in
de opsporing gaat het nieuwe boek van Reed
Business Education: Social media: het nieuwe DNA.
Via Social media heeft de maatschappij de
mogelijkheid (samen) aan opsporing te doen: de
opsporing democratiseert. Social media zitten in alle
lagen van de moderne genetwerkte maatschappij,
zijn overal en voor iedereen beschikbaar, en komen
nu tot in de haarvaten van de politieorganisatie (het
‘DNA’ van iedere agent). De ‘digitale’ rechercheur en
de moderne Sherlock Holmes werken in deze nieuwe
wereld samen. Door social media wordt de rol van
burgers nog belangrijker, want zij kunnen nu actief
meedoen met de opsporing.
Presentatie van maandag 28 april op de SMC0412 bijeenkomst op het politiebureau in Oss.
"Arnout de Vries (@ADeVries23) laat zien hoe de politie, justitie en de amateur elkaar kunnen versterken met social media en zo samen bouwen aan een veiligere maatschappij. Neem alvast een kijkje op www.socialmediadna.nl en raak net als ons geïnspireerd door deze kennisbank."
De avond gaat in op de online aspecten van openbare orde, opsporing, vervolging, rechtspraak, crisisbeheersing en communicatie.
Op woensdagmiddag 16 april 2014 organiseert het Instituut Fysieke Veiligheid (IFV) een congres met als thema ‘Digitale verstoring van de openbare orde’. Aanleiding voor deze bijeenkomst is een nieuw ontwikkeld scenario voor de Burgemeestersgame waarin digitale dilemma’s voor bestuurders centraal staan.
De Burgemeestersgame is een digitale serious game ontwikkeld door TNO, Thales/T-Xchange en de Hogeschool voor de Kunsten Utrecht. Het IFV zorgt er sinds 2012 voor dat de game ingezet kan worden in de veiligheidsregio’s en dat trainers worden opgeleid. Inmiddels wordt de Burgemeestersgame in meer dan vijftien veiligheidsregio’s gebruikt.
Tijdens dit congres wordt het nieuwe scenario toegelicht met behulp van een panel bestaande uit vertegenwoordigers van de politie en het Openbaar Ministerie, een communicatieadviseur en een veiligheidsambtenaar. Ook wordt vanuit hun perspectief dieper op een aantal interessante thema’s ingegaan. Het nieuwe scenario is grotendeels gebaseerd op ervaringen met Project X en de Facebookrellen in Haren en het sluiten van scholen in Leiden na een dreigbericht. Echter, ook dilemma’s die speelden na de aanslagen op de marathon van Boston en online burgeropsporing zoals bij de kopschoppers van Eindhoven komen aan bod. Rob Bats, oud-burgemeester van Haren, en experts op dit gebied vanuit de politie, het Openbaar Ministerie en de Nuclear Security Summit (NSS) delen hierover ervaringen met u.
Seminar cocreatie en opsporing bij de Politie Academie: De politie is voor de opsporing van daders van misdrijven vaak afhankelijk van de medewerking van de burger. Dat is eigenlijk nooit anders geweest, burgerparticipatie bij het politiewerk is van alle tijden. Binnen de politie wordt voortdurend geëxperimenteerd met innovatieve manieren om de burger bij het oplossen van misdrijven te betrekken. Cocreatie is zo'n specifieke vorm van burgerparticipatie. Bij cocreatie werken politie en burgers gezamenlijk aan een oplossing die voor beide partijen waarde creëert. Hierachter zit het idee dat de burger de veiligheid krijgt die hij verdient en waaraan hij zelf meewerkt. Cocreatie kenmerkt zich door een vergaande vorm van samenwerking waarbij burgers steeds meer invloed hebben op de aanpak van criminaliteit. Maar hoe kun je dit bereiken? Het contact van de politie met burgers is traditioneel informerend en zendend van aard, dus eenrichtingsverkeer. Dit is anno 2012 achterhaald, de politie c.q. overheid moet een manier vinden om contact met burgers te krijgen om in dialoog te treden. Dit betekent geen een- maar tweerichtingsverkeer.
Social media monitoring crisis management tno nifv congres 2012TNO
TNO laat zien hoe monitoring en analyse van sociale media, oftewel ‘slim kijken’ in de grote informatiebron, optimaal kan bijdragen aan slim communiceren en betere
risico- en crisisbeheersing. In de workshop worden toepassingsvoorbeelden getoond voor zowel de 'koude' als de 'warme' fase van crisisbeheersing. Dilemma’s als sociale beïnvloeding en ethiek worden bediscussieerd, maar ook wordt getoond wat er momenteel mogelijk is met diverse sociale media monitoring tools.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Epistemic Interaction - tuning interfaces to provide information for AI support
Multi-Touch Interaction Overview
1. Natural User Interfaces
Natural User
Hardware
Interfaces
Markets and
Markets and
Hardware and software applications
Software applications
History and future Timeline
Multi-touch interaction TNO work
TNO
Work
Arnoud de Jong
Arnout de Vries
TNO Information and Communication Technologies
Multi- Multi-
Summary
touch touch in
and
products the
Conclusions
1 movies
2. History of Multi-touch interaction
Pierre Wellner paper
Foundation
on multi touch and
iGesture Pad and NUI Group
First multi pinching motions
TouchStream keyboard
hand display by Fingerworks
Bell Labs Palm
Sony labs Microsoft Pre
First MT
SmartSkin surface PlayAnywhere
display
Toronto Mixed Reality table of Touch and object
university Microsoft Research detection Hitachi
Q2 2009
Smartboard
2002
1982
2005
1991
1999
2006
2001
1984
FX77 Duo
1980 2009
Jun 2007
2002
Q3 2008
Q1 2009
2003
1992
1982
1985
2006
Q1 2006
University of
2001
Movie:
3D multi-touch Toronto
Tron Microsoft
sensitive tablet Simon - first Multi-finger
Windows 7
smartphone Multi-hand
Multi-user Lucid
With Mitsubishi Touch
interaction iPhone
touchscreen MERL R&D Lab release
DiamondTouch
HP-150 world’s Microsoft
Surface
1983
first
Jeff Han SMART
touchscreen PC Movie: @TED table
Minority
report
2
14. Fraunhofer IGD multi-touch table
• The table is running on Linux
and uses the InstantReality
framework for displaying and
interacting.
• The finger tracking is done by
the Fraunhofer software
VisionLib which is not available
for pulic right now.
• Table size is 150x90 cm
14
15. Mitsubishi: DiamondTouch
• Front-projection on
typically 32" or 42"
diagonal
• Multiple touches
support by a single
user
• Distinguishes between
simultaneous inputs
from multiple users.
• DiamondTouch SDK
or DTFlash toolkit.
15
26. iPhone en iPod Touch
• The Apple iPhone has a
multitouch display for resizing,
zooming and rotating purposes.
• Multi touch sensative screen
• Motion sensor
• Types of multi touch gestures:
• Zoom, rotate
26
28. Palm Pre
• WebOS. It’s a web-centric multi-
touch platform that makes us of
CSS, XHTML and Javacript
making it accessible and
compatible with a wide range of
applications.
28
29. And more mobile phone devices
Meizu M8 HTC Touch Synaptics Onyx
Nokia N97
29
30. Apple: MacBook Air
• The Apple MacBook Air
has multitouch touchpad
for resizing, zooming
and rotating purposes.
30
32. MultiTouch Cell
• The MultiTouch LCDs are controlled by the MultiTouch CornerStone software.
Cornerstone handles the core multitouch functionality, tracking users hands as
they move on the screen.
32
33. Other vendors
Accenture Panasonic Hitachi
Philips Entertaible Perceptive Pixel Sony Smartskin
HP Misto Sharp optical LCD Touchable
34. Market share of products with multi-touch
• Multi-touch ability (or NUI) is competitor’s edge that is used in
marketing
• Market share is quickly rising
• 10 mio iPhones sold in first 6 months
• Table top sales booming since end 2008
Multi-touch is currently an “infant” technology
• Different multi-touch imlementations (Apple, Microsoft, HP, etc.)
• All are limited to a handful of gestures
• Still a lot of traditional GUI interaction
34
35. Future product list
• Input devices
• Apple Mighty Mouse
• Wacom tablets
• Handheld game consoles
• PSP2
• E-book readers
• Desktops
• Larger and flat tabletops
• TV screens
35
36. Natural User Interfaces (NUI’s)
Introduction
• Touch screen interaction
• Multi-touch screen interaction
The vision
• Evolution of computer user interfaces
Reality
• Natural User Interfaces (NUI)
• Tangible interfaces
• Multi modal interfaces
• NUI design
36
43. Multi-touch interaction
• In the realworld we do lots of actions with two hands
or more than one finger. e.g. driving a car
• Operating a mouse are serial, discrete events and
single point input
• Multi point interaction allows more parallel interaction
• Reduce task complexity of single input techniques
• Increases parallesm in multi-finger interaction reduces time
43
59. Overview of Human Computer Interfaces
Microsoft
Microsoft
Windows NT
Windows Vista
Alto PC Microsoft Microsoft
Xerox Parc Windows 1.0 Windows 95
Microsoft
MS-DOS Windows 98
Microsoft Microsoft Microsoft
Q2 2009
Windows 3.0 Windows XP Windows 7
1993
1995
2001
1982
1985
1998
2007
1990
1973
1970 2010
Jun 2007
1987
1997
Microsoft
2001
1984
1992
2005
2009
Windows
Snow
Tablet PC
Leopard?
Apple Macintosh edition
IBM OS/2 2.0
Apple Mac OS 8
Apple Mac OS X 10.5
Apple Mac OS X 10.0
Apple Mac Color
Note: Linux excluded
61. The vision of Natural User Experience
(NUE) is to deliver intuitive, seamless
experiences that unfold through natural
human input.”
• “Surfaces that respond to us”
• “The content is the interface”
61
62. Surface: design for emotion
• Natural & Intuitive
• Unique & Magical
• Social & Together
• Aware & Responsive
• Premium & Authentic
62
63. Surface guidelines
1. Seamless
2. Social
3. Spatial
4. Super realism
5. Contextual environments
6. Scaffolding
7. Performance aesthetics
8. Direct manipulation
64. User Interface Design for NUI’s
Difference in designing Tabletop interfaces?
• No fixed top-bottom orientation;
• Multiple “mouse cursors”;
• Multiple simultaneous users;
• Multiple user contexts;
• Multiple simultaneous actions, such as ‘drag & drop’;
• No more tradional data input means.
64
65. Multi-touch in the movies
• 1982: Tron
• 2002: Minority report
• 2005: The Island
• 2008: Quantum of Solace (James Bond)
• 2008: CSI: Miami
65
71. Markets and applications
• Entertainment: (serious) gaming and fun
• Public safety and crisis management
• Retail
• Public Places
• Healthcare
• Education
• Financial
• Office
• Industrial use
71
72. Healthcare
• Photo tool for dementia patients
• Tool for patient-doctor relationships
72
74. Public places
• Information centre New York
• Why?
• Intuitive, interactive and focussed
on discovering New York
• Target group: Tourists
• Device
• Gesturetek illuminate tables
• Application:
• Maps, POI, multimedia content
74
Information centre New York
79. Horeca
• Restaurants, hotels
• Viewing menu
• Entertainment (games, gambling)
• Tourist information
Surfaceware:
detect drink level
79
80. iBar: object recognizing bar
• Bar detects all objects on the surface
• It detects the shape, it doesn’t identify the object.
• future releases will also be able to identify objects
• http://www.i-bar.ch/info/
80
89. TNO Work
• Multi -touch in Control Rooms
• Multi –touch in Education
• Multi-touch : complex gesture support
• MiReCol: collaboration and co-design
• Slide overview + video Maurice
89
103. Serious gaming & multi touch interactie in het onderwijs
Research goal: Does the
combination of serious gaming and
multi touch interaction add value to
elementary education. Serious games
Target group: School children aged
8 until 12 with a social disorder
(PDD-NOS).
Multi touch
Results: a serious game was
developed to support and stimulate
several collaboration forms in
calculation tasks. Through multi-
touch and multi user interaction these
children could cooperate using one Education
system.
Partners: Bladergroenschool
(elementary school for special
education) and RENN4.
105. Supporting gesture interaction with gesture previews
Gestures
• In general: non-verbal communication.
• Specific: a set of measured movements over time.
• Examples: letter recognition, unlocking your iPhone.
Advanced gestures
• Multi-touch gestures: zooming an image.
• Collaborative gestures: clearing a drawing board.
Problem statement
• Most gestures have
no intrinsic meaning.
• Users have to know gestures
in advance.
• A steep learning curve
especially for complex systems
using advanced gestures.
107. Solution: gesture previews
• Overlay with visual feedback.
• Shows what gestures can be performed.
• Shows where others can join in.
• Indicates the meaning of gestures.
• Previews do not limit expert users.
• Increase detection rate, decrease learning curve.
108. Proof of Concept
• Bejeweled clone, uses gestures to identify users. With some twists.
• Gestures are stored in XML.
<?xml version="1.0" encoding="utf-8"?>
<root>
<segmentDeclaration name="line" uniformScaling="false"
<point x="0" y="0" />
<point x="0" y="0,1" />
</segmentDeclaration>
109. Wrap up
Knowledge
• Started at TNO just a few years ago, experimental. Now this topic is booming,
backed up by large vendors and coming to the market.
Hardware/software
• More vendors enabling MT for their devices
• Current software / applications are dedicated solutions
• Wide adoption needs more hardware and applications
Interaction
• Multi touch is part of the NUI paradigm shift in Human Machine Interaction
Markets / applications
• Wow-technology, but the real added value and useful applications still have to
prove themselves
TNO
• Added value in collaboration environments (crisismanagement, education and
many more projects)
109
110. Arnout de Vries
Senior scientist
Natural User Interfaces
Arnout.devries@tno.nl
http://www.tno.nl/nui