SlideShare a Scribd company logo
1 of 20
Accelerometers in NUI Smart-phones
Why use it?
Why use it? 
Why it hasn't been used diversely
Why it hasn't been used as diversely
A little bit about
How does it work?
Augmented Reality
Yellow Pages Layar
Twitter by Anca 3D Layar
ARcade (Beta)
Design and Layar
Design and Layar
Downsides of Layar
Downsides of Layar
Downsides
Problems with Accelerometer in Layar
Future use of Accelerometer in NUIs
Accelerometer in NUIs (cont.)
Conclusion

More Related Content

What's hot

google glasses
google glasses google glasses
google glasses srujanasru
 
UX test of Leap Motion Controller by UID
UX test of Leap Motion Controller by UID UX test of Leap Motion Controller by UID
UX test of Leap Motion Controller by UID Tobias Limbach
 
3d Video Conferencing: Opportunities and Pitfalls
3d Video Conferencing: Opportunities and Pitfalls3d Video Conferencing: Opportunities and Pitfalls
3d Video Conferencing: Opportunities and PitfallsTrueConf__
 
Prototyping in aframe
Prototyping in aframePrototyping in aframe
Prototyping in aframeKumar Ahir
 
Marker Based Augmented Reality
Marker Based Augmented RealityMarker Based Augmented Reality
Marker Based Augmented RealityArshiya Sayyed
 
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!Stephan Tanguay
 
Project Seminar on Leapmotion Technology
Project Seminar on Leapmotion TechnologyProject Seminar on Leapmotion Technology
Project Seminar on Leapmotion TechnologyAbhijit Dey
 
Developing for Leap Motion
Developing for Leap MotionDeveloping for Leap Motion
Developing for Leap MotionIris Classon
 
Design and create AR experiences with no code
Design and create  AR experiences with no codeDesign and create  AR experiences with no code
Design and create AR experiences with no codeKumar Ahir
 
A tiny device with a huge idea ''Leap Motion''
A tiny device with a huge idea ''Leap Motion''A tiny device with a huge idea ''Leap Motion''
A tiny device with a huge idea ''Leap Motion''Sazzad Saad
 
How AR is transforming ecommerce
How AR is transforming ecommerceHow AR is transforming ecommerce
How AR is transforming ecommerceAlex Nguyen
 

What's hot (15)

google glasses
google glasses google glasses
google glasses
 
UX test of Leap Motion Controller by UID
UX test of Leap Motion Controller by UID UX test of Leap Motion Controller by UID
UX test of Leap Motion Controller by UID
 
Leap motion
Leap motionLeap motion
Leap motion
 
3d Video Conferencing: Opportunities and Pitfalls
3d Video Conferencing: Opportunities and Pitfalls3d Video Conferencing: Opportunities and Pitfalls
3d Video Conferencing: Opportunities and Pitfalls
 
Prototyping in aframe
Prototyping in aframePrototyping in aframe
Prototyping in aframe
 
Marker Based Augmented Reality
Marker Based Augmented RealityMarker Based Augmented Reality
Marker Based Augmented Reality
 
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!
Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!
 
Leap motion
Leap motionLeap motion
Leap motion
 
Project Seminar on Leapmotion Technology
Project Seminar on Leapmotion TechnologyProject Seminar on Leapmotion Technology
Project Seminar on Leapmotion Technology
 
Hacking for salone: drone races
Hacking for salone: drone racesHacking for salone: drone races
Hacking for salone: drone races
 
Developing for Leap Motion
Developing for Leap MotionDeveloping for Leap Motion
Developing for Leap Motion
 
Project soli
Project  soliProject  soli
Project soli
 
Design and create AR experiences with no code
Design and create  AR experiences with no codeDesign and create  AR experiences with no code
Design and create AR experiences with no code
 
A tiny device with a huge idea ''Leap Motion''
A tiny device with a huge idea ''Leap Motion''A tiny device with a huge idea ''Leap Motion''
A tiny device with a huge idea ''Leap Motion''
 
How AR is transforming ecommerce
How AR is transforming ecommerceHow AR is transforming ecommerce
How AR is transforming ecommerce
 

Recently uploaded

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 

Recently uploaded (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 

Editor's Notes

  1. The accelerometer takes in data created by the movement of the phone.  Essentially an accelerometer brakes down to a weight surrounded by springs. When the phone is moved the weight is displaced and the spring compensates for the displacement. The force exerted by the spring to bring the weight back to center is measured to provide input to the phone. The springs themselves carry a small electrical current and what is measured is the fluctuations in current caused by the compression of the spring.
  2. The accelerometer provides an easy and familiar way of doing things for many applications. If you are using it in a game then it often largely mimics a steering wheel or other a tilted surface mimicking a force of gravity that we are constantly aware of. It can often do things more quickly than delving through a menu and can be used to bi pass security settings.
  3. For example because you and the other person involved bump your phones together once you are running the application, there is no need to go through a pass code of any kind. Often it provides a way to do something more quickly and with a level of sensitivity that is harder to achieve with a button because you have a range of inputs instead of a constant on or off.
  4. While the accelerometer can be used effectively for simple actions, it’s applications are somewhat limited. While there have been many games that use the accelerometer, use often doesn’t extend beyond being used as a controller. Most other applications are merely measuring the input in raw data of the device.  In most practical  applications it doesn’t make sense to use an accelerometer.
  5. Using the accelerometer to navigate a web page  for example wouldn’t make sense, and while there is some research in to using the accelerometer as a gestural interface, this is a steep learning curve and defeats the purpose of NUI. As a mechanism for controlling games such as the pre-downloaded app Need for Speed or Flyy, the accelerometer excels. But what about an app that isn’t pure time-wasting material?
  6. Layar is an Augmented Reality browser that, by combining all of the mobile phone’s user interface capabilities - gesture, camera, and accelerometer - create a unique user experience with its multiple functionalities. Layar was created in 2009 in the Netherlends for both iPhone and Android operating systems, though in the Android Market it’s truly flourished as the first Augmented Reality browser available.
  7. Layar uses a combination of GPS and the Accelerometer to determine your exact location. Then, depending on which “layer” you are viewing you have access to the same relevant information. At its most basic level, Layar returns information about local places of interest that users may find interesting: resturants, stores, and tourist attractions. This information is then displayed on the screen, using the smartphone’s camera as a “viewfinder” into this three dimensional map. Layar released a developer’s toolkit for creating layers for sifting through specific information. We’ll take a look at three Layers created for this app, all that access the accelerometer.  
  8. The technology functions by enhancing one’s current perception of reality. This is done by taking a live view of reality and outputing it to a screen presenting an enhanced view with added content  to it in the form of text, adding sound, or other on screen information. This creates the possibility of greater interactivity and social networking in a  real world environment. The difference between augmented reality and virtual reality is that virtual reality completely substitutes a completely simulated world.
  9. YellowPages was created by the company of the same name, a free layer that can uses local listings to help people find places through their search feature. You can determine how large of a radius it pulls information from (up to 10km around you) and what you want to return specifically. It will then return related matches to your search and how close they are to your current location, using the accelerometer to determine which ones you’re facing.
  10. Twitter by Anca 3D is a real-time layar designed to connect with other twitter users that have the gps location enabled on their tweets. Nearby users are determined by the location of their last GPS enabled-tweet, their avatars appearing in that location. From there you can see their last tweet and get access to a timestream of the user’s tweets, where you can follow the user.
  11. Ever wonder what being Pac-Man would feel like? With the help of this layar it’s possible to do so. ARcade Beta puts you in the place of Pac-Man, gathering pellets and fruit as you move around town. This is one of the functions where the accelerometer really shines, placing ghosts and other objects in your path at various heights that tilting the phone (and moving in another direction) allows you to avoid.  
  12. Drawing on Maeda’s 10 laws of simplicity we can take another look at this app and see how well it functions. Layar’s interface is relatively simple, but navigation through the seemingly endless amount of layers that one can use is complex enough that user response has been that it is seen as confusing and aggravating. The learning curve on this app is steep.    
  13. In context, the complex learning curve is necessary because the goal of the app is an augmented reality. But the crucial part of this app is that it provides the user with continually updating information in a “three-dimensional” space, which Layar is slow and painfully difficult to achieve. The individual layers take awhile to load, and because of the multiple NUIs that make up the app’s functions, it drains the battery power very quickly.
  14. In order for many of the applications to be of any use it you have to be in an area in which people have developed content for that area. If you live in a place like Peoria for example, you aren’t going to be able to do much besides play games and use an app like the yellowpage app that has the capitol to push a nationwide app.
  15. In Designing Gestural Interfaces the physical task of using gestures is explained. Layar forces you to hold your phone outstretched from your body at eye level so that you can see and interact with the real world objects in front of you. Many of the applications are tour based to guide you through museums and cities.
  16. So if you are using them you are probably not familiar with the area and thus you are going to rely heavily on the interface, meaning you will be wandering around with your phone outstretched in front of you looking like an idiot, spinning in circles in crowded areas. This can lead to tunnel vision and possibly a wonderfully memorable encounter with a chrome bumper and your ribcage.
  17. Because it is simply one of the NUI systems used in this app, its role is a smaller part. The amount of time that it takes to combine the 3D landmarks inside the app make the view feel a bit sluggish or unnatural.
  18. Is continually being experimented with in new ways. Many times the accelerometers in phones are being used to track the directional output from the device to experiment with an illusion of depth to screens. Other uses are using the phone as a musical instrument using the accelerometer to distort a note that you select on a grid on your phone.
  19. Greater use of augmented reality and more intuitive gestural interaction. Changing the screen orientation in 3D so that you can read the text easily when the phone is on a flat surface.Often used as a remote. Another use that is in the works is similar to how a theremin uses movement to bend and shift pitch in song. Instead of using your hand, the position of the phone registers how much the pitch shifts.
  20. In the end, the accelerometer as a NUI has only scratched the surface of its potential. Not because of a percieved lack of functionality, as Layar provides for us, but simply because current phones have a distinct lack of processing power needed to handle the incorporation needed in augmented reality apps. Are more possibilities available? Only time will tell.