Designing the future of Augmented RealityCarina Ngai
Presented on March 4th, 2016 at Interaction16 in Helsinki, Finland.
Until now, augmented reality has so far been mostly a sci-fi vision that overlays visual information to what we see in the physical world. It’s widely perceived as a “cool and interesting feature” for brands and advertising, but doesn’t have much practicality yet. To harness the real power of AR, which includes geolocation, image recognition, we believe that a more utilitarian visual search would be next.
To design for such possibilities, we begin to question even the fundamental basis of AR. For example, what would AR become beyond a rich visual layer? Will this change people’s motivation and behavior to use AR? How can we redefine AR to be a tool to give augmented information on objects? And how we can speculate its usage in the future?
Social Interaction Design For Augmented Reality: Patterns and Principles for ...Joe Lamantia
Augmented reality blends the real world and the Internet in real time, making many new kinds of proximity, context, and location based experiences possible for individuals and groups. Despite these many possibilities, we know from history that the long term value and impact of augmented reality for most people will depend on how well these experiences integrate with ordinary social settings, and support everyday interactions. Yet the interaction patterns and behavior we see in current AR experiences seem almost ‘anti-social’ by design. This is an important gap that design must close in order to create successful AR offerings. In other words, much like children going to school for the first time, AR must to learn to ‘play well with others’ to be valuable and successful. This presentation reviews the interaction design patterns common to augmented reality, suggests tools to help understand and improve the ’social maturity’ of AR products and applications, and shares design principles for creating genuinely social augmented experiences that integrate well with human social settings and interactions.
Designing for an Augmented Reality worldthomas.purves
How “Augmented Reality” and the mobile web changes everything
Mobile broadband access and ever-smarter phones are shaking the internet out its lofty cloud and bringing the web into the real world. As a result, the old “real world”, and many old ideas and many old business models will be running out of places to hide from the pervasive influence of the net.
Meanwhile, each of our smart phones are in many ways even better than the old clunky tools we used to use to surf the net. Our mobile devices are not only connected but, also bristling with sensors like radios, cameras, microphones, GPS etc. that can directly perceive and interact with the world around you. We’re reaching a point where it’s theoretically possible to point that device at almost anything: a landmark, a product on a store shelf, your friends or a crowd of people; and draw from the cloud and your social graph as much, or perhaps more, relevant information than you ever wanted to know. Oh, and the cloud will be watching you and whatever’s around you as well.
In the new augmented reality, the web surfs you.
The goal of this talk will be to provide you with a fast paced overview of what this new “augmented” reality will mean for how we socialize, for how we sell and market physical products, for architecture, for media and entertainment, for public policy, crime, privacy and, as well, few early signals for what might be the new killer apps.
If all that is not interesting enough, I will also bring free beer.
Virtual reality and augmented reality -Bournane AbdelkrimAbdelkrim Bournane
This is a presentation about virtual reality and augmented, it contains basics about the origin of VR and why does it work, and some application of AR and VR.
Designing the future of Augmented RealityCarina Ngai
Presented on March 4th, 2016 at Interaction16 in Helsinki, Finland.
Until now, augmented reality has so far been mostly a sci-fi vision that overlays visual information to what we see in the physical world. It’s widely perceived as a “cool and interesting feature” for brands and advertising, but doesn’t have much practicality yet. To harness the real power of AR, which includes geolocation, image recognition, we believe that a more utilitarian visual search would be next.
To design for such possibilities, we begin to question even the fundamental basis of AR. For example, what would AR become beyond a rich visual layer? Will this change people’s motivation and behavior to use AR? How can we redefine AR to be a tool to give augmented information on objects? And how we can speculate its usage in the future?
Social Interaction Design For Augmented Reality: Patterns and Principles for ...Joe Lamantia
Augmented reality blends the real world and the Internet in real time, making many new kinds of proximity, context, and location based experiences possible for individuals and groups. Despite these many possibilities, we know from history that the long term value and impact of augmented reality for most people will depend on how well these experiences integrate with ordinary social settings, and support everyday interactions. Yet the interaction patterns and behavior we see in current AR experiences seem almost ‘anti-social’ by design. This is an important gap that design must close in order to create successful AR offerings. In other words, much like children going to school for the first time, AR must to learn to ‘play well with others’ to be valuable and successful. This presentation reviews the interaction design patterns common to augmented reality, suggests tools to help understand and improve the ’social maturity’ of AR products and applications, and shares design principles for creating genuinely social augmented experiences that integrate well with human social settings and interactions.
Designing for an Augmented Reality worldthomas.purves
How “Augmented Reality” and the mobile web changes everything
Mobile broadband access and ever-smarter phones are shaking the internet out its lofty cloud and bringing the web into the real world. As a result, the old “real world”, and many old ideas and many old business models will be running out of places to hide from the pervasive influence of the net.
Meanwhile, each of our smart phones are in many ways even better than the old clunky tools we used to use to surf the net. Our mobile devices are not only connected but, also bristling with sensors like radios, cameras, microphones, GPS etc. that can directly perceive and interact with the world around you. We’re reaching a point where it’s theoretically possible to point that device at almost anything: a landmark, a product on a store shelf, your friends or a crowd of people; and draw from the cloud and your social graph as much, or perhaps more, relevant information than you ever wanted to know. Oh, and the cloud will be watching you and whatever’s around you as well.
In the new augmented reality, the web surfs you.
The goal of this talk will be to provide you with a fast paced overview of what this new “augmented” reality will mean for how we socialize, for how we sell and market physical products, for architecture, for media and entertainment, for public policy, crime, privacy and, as well, few early signals for what might be the new killer apps.
If all that is not interesting enough, I will also bring free beer.
Virtual reality and augmented reality -Bournane AbdelkrimAbdelkrim Bournane
This is a presentation about virtual reality and augmented, it contains basics about the origin of VR and why does it work, and some application of AR and VR.
A New Reality - Virtual Reality And Augmented RealityTim Gentle
Let's explore a new reality, both Virtual Reality And Augmented Reality. Let's learn what they are, how they are used and then let's create our some of our own. Presented at the 2016 Melbourne Mini Maker Faire
Virtual Reality (VR) & Augmented Reality (AR): Are You Ready?SilverTech
This on-demand webinar will help your organization prepare for a very near future in which virtual reality (VR) and augmented reality (AR) will change the way we consume and interact with content.
Glimpses into the future of mobile devices, the internet, and more - updated ...Michael Harries
First given at Mobile Monday Sydney on 2 November 2009.
A thought provoking look at the forces affecting the future of the mobile internet.
(Let me know what you think.)
Presentation for Handheld Librarian 3 as an intro to augmented reality services including what's happening in the fields of advertising, marketing, retail, shipping, gaming, and the wealth of GIS information overlay currently available. Social issues are briefly covered as well.
Tish Shute, Director AR/VR, Corporate Technology Strategy, Huawei
A talk from Inspire Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017.
XR is intelligent and interactive connecting real humans and physical objects with digital agents and entities. VR/AR will evolve into XR to become the future interface for Cloud Computing, IoT, Big Data, Prediction, Self-driving cars, Personalized Medicine, Robots, Drones, Cryptocurrency, Smart Cities, and AI. Social VR and AR will connect people in new and powerful ways but XR will connect the intelligence of people to the intelligence of machines in a space shared and understood by both. This talk will look at this new and intimate relationship between humans and intelligent agents.
http://AugmentedWorldExpo.com
Mixed Reality also referred as ‘Hybrid Reality’ is a combination of both virtual reality and physical reality which creates a completely new environment where both physical and digital objects co-exist & interact in real time.
How is augmented reality different from virtual reality?
This is one of the top trending questions nowadays. In this PPt, we will explain in detail about vr vs ar and significance of augmented reality.
If you're looking for augmented reality app development for your business, click for queries - https://bit.ly/2wouPFt
How to Design Augmented Reality Experience ?Deepak Kamboj
This Gartner presentation tells you about what is happening in the world of Augmented Reality and how you can design a Augmented Reality Experience for organisations.
For more interesting material on Augmented Reality, Please feel free to contact me and write to me. Thanks Deepak
Augmentet Reality, Smart Cities - Quo Vadis, DigitalisierungMatthias Stürmer
Matthias Stürmer
Geschäftsleiter der Parlamentarischen Gruppe Digitale Nachhaltigkeit & Leiter der Forschungsstelle Digitale Nachhaltigkeit am Institut für Wirtschaftsinformatik der Universität Bern. Dort befasst er sich als Oberassistent in der Lehre, Forschung und Beratung mit Open Source Software, Open Data, Open Government und Netzpolitik.
A New Reality - Virtual Reality And Augmented RealityTim Gentle
Let's explore a new reality, both Virtual Reality And Augmented Reality. Let's learn what they are, how they are used and then let's create our some of our own. Presented at the 2016 Melbourne Mini Maker Faire
Virtual Reality (VR) & Augmented Reality (AR): Are You Ready?SilverTech
This on-demand webinar will help your organization prepare for a very near future in which virtual reality (VR) and augmented reality (AR) will change the way we consume and interact with content.
Glimpses into the future of mobile devices, the internet, and more - updated ...Michael Harries
First given at Mobile Monday Sydney on 2 November 2009.
A thought provoking look at the forces affecting the future of the mobile internet.
(Let me know what you think.)
Presentation for Handheld Librarian 3 as an intro to augmented reality services including what's happening in the fields of advertising, marketing, retail, shipping, gaming, and the wealth of GIS information overlay currently available. Social issues are briefly covered as well.
Tish Shute, Director AR/VR, Corporate Technology Strategy, Huawei
A talk from Inspire Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017.
XR is intelligent and interactive connecting real humans and physical objects with digital agents and entities. VR/AR will evolve into XR to become the future interface for Cloud Computing, IoT, Big Data, Prediction, Self-driving cars, Personalized Medicine, Robots, Drones, Cryptocurrency, Smart Cities, and AI. Social VR and AR will connect people in new and powerful ways but XR will connect the intelligence of people to the intelligence of machines in a space shared and understood by both. This talk will look at this new and intimate relationship between humans and intelligent agents.
http://AugmentedWorldExpo.com
Mixed Reality also referred as ‘Hybrid Reality’ is a combination of both virtual reality and physical reality which creates a completely new environment where both physical and digital objects co-exist & interact in real time.
How is augmented reality different from virtual reality?
This is one of the top trending questions nowadays. In this PPt, we will explain in detail about vr vs ar and significance of augmented reality.
If you're looking for augmented reality app development for your business, click for queries - https://bit.ly/2wouPFt
How to Design Augmented Reality Experience ?Deepak Kamboj
This Gartner presentation tells you about what is happening in the world of Augmented Reality and how you can design a Augmented Reality Experience for organisations.
For more interesting material on Augmented Reality, Please feel free to contact me and write to me. Thanks Deepak
Augmentet Reality, Smart Cities - Quo Vadis, DigitalisierungMatthias Stürmer
Matthias Stürmer
Geschäftsleiter der Parlamentarischen Gruppe Digitale Nachhaltigkeit & Leiter der Forschungsstelle Digitale Nachhaltigkeit am Institut für Wirtschaftsinformatik der Universität Bern. Dort befasst er sich als Oberassistent in der Lehre, Forschung und Beratung mit Open Source Software, Open Data, Open Government und Netzpolitik.
Réalité virtuelle & augmentée : bienvenue dans la matrice !treize articles
Vous êtes plutôt Réalité augmentée ou Réalité virtuelle ? A vous de choisir vos limites ! Retrouvez notre Benchmark sur cette tendance en plein essor dans tous les domaines.
The final lecture in the COSC 426 graduate course in Augmented Reality. Taught by Mark Billinghurst from the HIT Lab NZ at the University of Canterbury on Sept. 19th 2012
Presentation on our 3-month research and prototyping project in augmented reality for mobile phones. Presented at MEIC5 event (Mobile Experience Innovation Center) at the Ontario College of Art and Design, Toronto, Canada. November 26, 2009.
Designing Augmented Reality Experiences for MobileTryMyUI
In this webinar, Professor Ed Johnston of Kean University shares best practices in creating augmented reality experiences and 360-degree imaging content for mobile. Ed and his research team at Kean University have created interactive posters and 360-degree images at Liberty Hall Museum, NJ, and he has had his creative works presented in Hong Kong, NY, and LA. Here, he talks about the process in the making and answers audience's questions on AR, VR, and 3D media.
Access the full webinar video here: http://goo.gl/UpfMiq
Presentation to WorldComp12: Engagement is the new standard of usability. Identity project as task-based versus experientially-based, then design for Flow and Narrative Transportation using research-based techniques. Introduces the Positive Engagement Evaluation Model.
Talk donné à la conférence Blend Web Mix 2016.
Tour d'horizon des applications actuelles et futures de la réalité virtuelle dans des domaines variés, ainsi que de l'importance du web pour le futur de la VR.
Interaction considerations with VR and ARLiv Erickson
Slides for O'Reilly Design 2016 - a few of the considerations for designing virtual and augmented reality applications, including physical comfort and environment / UI strategies.
Social Ideas: mUmBRELLA and TCO Social Media AcademyTCO
A presentation that explores the creation & planning of a specific Social Idea that harnesses owned & shared media to earn its own media! This will be useful to help understand how to plan & use tactical social media activities to gain awareness of your brand / business activities.
Augmented Citizen - Mobile Augmented Reality Summit @ MWC2010Willi Schroll
Augmented Citizen Manifesto @ Mobile Augmented Reality Summit @ MWC2010 +++ authors: Dan Romescu + Willi Schroll +++ presented by Dan Romescu at AR-Summit, Mobile World Congress 2010, Barcelona
Augmented Citizen - Mobile Augmented Reality Summit @ MWC2010Willi Schroll
Dan Romescu presented our ideas at MWC 2010 in Barcelona: "Augmented Citizen. Challenges and Solutions for an Open and Sustainable Outernet -- Dan Romescu + Willi Schroll"
Friendsters At Work: Displaying Social Media Streams in the WorkplaceJoe McCarthy
Presentation at the <a href="http://www.ischool.berkeley.edu/~dmb/ct-sns/">Workshop on Public Practices, Social Software: Examining Social Practices in Networked Publics</a> at the <a href="https://ebusiness.tc.msu.edu/cct2007/">3rd International Conference on Communities and Technologies (C&T 2007)</a>. Reports on plans and early progress on next generation proactive displays.
A few of us at Fallon attended SXSW Conference and we want to share what we saw, what is breaking, what is trending, and what is likely to impact your brands and communications within the next year. Austin comes to Minneapolis. SXSW meets SX35W.
Expect to view a series of short, lively, engaging, approachable presentations (no presentation longer than 5 minutes and 5 slides, with a mimimum of "geek-speak") that will showcase the conference highlights and outline the important things that you need to know now.
Lecture 8 of the COMP 4010 course taught at the University of South Australia. This lecture provides and introduction to VR technology. Taught by Mark Billinghurst on September 14th 2021 at the University of South Australia.
Futurus specializes in developing virtual and augmented reality applications for organizations to use for marketing, product visualization, experiential events, and training purposes. The company has an extensive portfolio of clients in industries such as consumer packaged goods, hospitality, medical, real estate, and manufacturing. As leaders in the XR space, we feel it is our responsibility to guide our clients responsibly in finding a solution that meets their goals while creating a valuable experience for the end-user.
The metaverse is removing the physical barriers to connecting people from anywhere in the world by using augmented reality and virtual reality. Content creators bring to life the ideas and space for people to join. Brands have a unique opportunity to take the physical and bring it in the virtual to connect with their consumers on a personal and authentic level.
“Why” and “how” are two crucial questions to ask when evaluating if it is worth investing resources. The former is a reflective question brands must ask themselves and figure out the purpose and goals of creating an immersive experience. The answer to this will help determine if the experience will be valuable to the end-user. The latter is what Futurus and leaders in the XR industry come into solve. As subject matter experts, we use our experience to figure out what will be most successful in achieving our clients’ goals. From there, we can create a custom solution that can be deployed and shared with consumers. Key Takeaways
• How brands can leverage virtual and augmented reality to engage with consumers
• Considerations for what technology and platform is most appropriate for the proposed use case
• Options for leveraging various types of immersive content
The second lecture in the 426 graduate class on Augmented Reality taught thy Mark Billinghurst at the HIT Lab NZ, University of Canterbury. The class was taught on July 19th 2013
Undeniably 2020 has been an unpredictable year. This originated some creativity for innovation as much as adaptation and acceleration of existent ideas.
Every so often at Cocoon we feel the need to review these technologies and approaches and filter what we feel is relevant for us and our clients into a document that we share internally and externally.
This year we gave this document a linear context: Digital Global Humanism.
Up until recently people were the central focus in digital businesses and ecosystems.
Businesses started by embracing humanism to achieve their results and to enable clients to access their products in the easiest ways possible.
But now we also need to remind people about their own responsibility for the Earth. We added this to our process of business transformation.
Into the twilight zone innovations for educationCynthia Calongne
Ten Colorado Technical University doctoral students and Dr. Cynthia Calongne presented their paper at the TCC 2011 Worldwide Online Conference April 13, 2011 called Into the Twilight Zone: Innovations for education, virtual worlds and emerging media.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
1. Challenge, Drama & Social
Engagement: Designing Mobile
Augmented Reality Experiences
Gene Becker
twitter @genebecker
gene@lightninglaboratories.com
2. a remarkable confluence of technologies
Cloud services
Robotics Augmented reality
Mobile
MMO platforms
Wireless
Social media
Displays
2000 - 2020 Digital media
Imaging
Gesture
Storage
Tagging
Sensing
Power 3D printing
Nano Bio
3. what is augmented reality?
Augmented reality is…
• a technology
• a field of research
• a vision of future computing
• an emerging commercial industry
• a new medium for creative expression
4. augmented reality is a technology
Augmented reality is the display of computer
graphics and media, overlaid and registered on
real-world environments, interactively in real time.
AR platforms exist at the intersection of several technical
disciplines, including computer graphics, machine vision,
sensing and sensor fusion, geographic information systems,
mobile systems, ubiquitous computing and the web.
7. AR research: first mobile AR system
Feiner et al, Touring Machine (1997), Columbia University
http://graphics.cs.columbia.edu/projects/mars/mars.html
8. visual search on the physical world concept design by mac funamizu
source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
9. querying the natural world concept design by mac funamizu
source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
10. computational print media concept design by mac funamizu
source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
11. seeing through space and time concept design by mac funamizu
source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
12. the end of personal privacy? concept by TAT
Augmented reality is the collapse of social nuance
and the end of personal privacy.
13. social augmented reality concept sketches by matthew buckland
Source: http://www.matthewbuckland.com/?p=1041
14. social augmented reality concept sketches by matthew buckland
Source: http://www.matthewbuckland.com/?p=1041
15. social augmented reality concept sketches by matthew buckland
Source: http://www.matthewbuckland.com/?p=1041
16. and just wait ‘til the glasses get here concept design by mac funamizu
source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
17. commercial mobile AR example: Layar
[video]
Layar demo video: http://www.youtube.com/watch?v=b64_16K2e08
19. augmented reality is a new medium
Augmented reality is a new medium of creative
expression that expands human experience
AR combines the web, images, sound, movies, games, search
engines, databases, advertising, social media…and explodes them
across the physical world of people, places and things, revealing
the invisible stories that are everywhere around us.
But we have a lot of work to do.
20. what makes a compelling experience?
Physical / Mental Self-Expression
Challenge & Creativity
see also: Flow and the psychology of
optimal experience (Csikszentmihalyi)
Challenge/
Expression
Dimensions
of
Compelling
Experience
Drama/
Physical Stimulation Social Competing
(sights, sounds, touch…) Sensation with others
Mental / Emotional Bonding, Sharing &
Stimulation, Imagination Cooperation
ref: Hull, Reid “Experience Design for Pervasive Computing”
21. the reality of AR experiences today
What works:
* Physical engagement
* Visually captivating
* Emotional “wow” factor Challenge/
* Invisible stories, revealed Expression
Dimensions
What doesn‟t: of
Compelling
* Awkward use models Experience
* No flow opportunities
* No social dimension Drama/
Social
Sensation
* Point experiences only
22. mobile AR issues & limitations
Technical limitations
• Sensor accuracy (GPS, compass etc)
• Indoor positioning
• Line of sight
• Device constraints (display, form factor, weight, battery, processor, network)
• Lack of interoperable standards e.g. for location (lat/long/alt, CRS, orientation)
• Relative positioning
• Object recognition & tracking
• Graphics issues (lighting, transparency, occlusion)
Use model issues
• Unnatural physical position
• Ambiguous social signals
• Cognitive model
Authoring limitations
• Platform specific
• Low level tools, complex workflow
• Focus on point interactions; no support for stories or interesting interactivity
23. visionary example: AR gaming HP concept video
HP vision video Roku’s Reward: http://www.youtube.com/watch?v=vCCyfkGKL_w
24. what makes a compelling AR experience?
Physical / Mental Self-Expression
Challenge & Creativity
running devising
strategies
wayfinding locating
powerups using physical
Challenge/ affordances
racing against time
collecting
Expression items
avoiding danger
(in game and real)
scoring points
Dimensions
physical/virtual of savoring the win
Compelling
confusion Experience racing against
real & in game other players
sounds
Drama/
Physical Stimulation Social Competing
(sights, sounds, touch…) Sensation with others
kiss Mental / Emotional story line fantasy Bonding, Sharing &
Stimulation, Imagination characters Cooperation
‘magic moments’ camaraderie sharing the surprise
ref: Hull, Reid “Experience Design for Pervasive Computing”
25. mobile AR experience design practices
1. Understand limitations and design around them
2. Design for challenge, expression and flow
3. Design for physical sensation & emotional drama
4. Design for social bonding, sharing, competition
5. Bring an interdisciplinary media production mindset
26. mobile AR experience design practices
1. Understand current limitations and design around them
• Use augments with appropriate requirements for precision & realism
• Emphasize audio for immersion, continuity, story
• Use ‘magic lens’ position sparingly
• Fail gracefully & transparently
27. mobile AR experience design practices
2. Design for challenge, expression and flow
• Make the experience the focus, not the technology
• Set clear goals, expectations and rules
• Design goals to balance between ability level and challenge (neither too easy nor
too difficult).
• Encourage focus and concentration, limit distractions and gratuitous interactions
• Provide direct and immediate feedback so the user can adjust their actions.
• Give users a sense of personal control over the situation or activity.
• Make activities intrinsically rewarding, so there is an effortlessness of action.
28. mobile AR experience design practices
3. Design for physical sensation & emotional drama
• Scout the location, know the environment & context deeply – sights,
sounds, smells, textures, weather, rhythms, moods
• Design for „magic moments‟ – mental immersion, physical/virtual
coincidence, synaesthetic confusion
• Emphasize sound design for immersion, continuity, story
• Develop a cross-media story universe
29. mobile AR experience design practices
4. Design for social bonding, sharing, competition
• Game mechanics drive competitive engagement – explicit
multiplayer competition, implicit scoring & leveling systems
• Social media integration to share broadly / vicariously
• Tight and loose multi-person activities encourage bonding and
shared experience
30. mobile AR experience design practices
5. Bring an interdisciplinary media production mindset
Creating mobile AR experiences draws on skills from a broad range of
creative disciplines including…
• Scriptwriting
• Direction
• Casting
• Art direction
• Sound design
• Special effects
• Interaction design
• Location scouting
• Production management
• Software development
• Systems management
• Testing & QA
• Gamerunning
• Tech support
31. mobile AR authoring demo
• a large scale driving experience overlaid on the Bay Area
• primarily audio AR
• scriptable behaviors on geographic regions
• context-aware behaviors
• authored on PC, experienced on mobile
32. AR history: sub
Questions?
Gene Becker
tw: @genebecker
web: www.lightninglaboratories.com
mail: gene@lightninglaboratories.com
Lightning Laboratories provides Research and
Consulting in augmented reality, ubiquitous
computing, social media and the Internet of
Things
