AR is the UI for Pervasive Computing

•

0 likes•964 views

Shakespeare said "All the world is a stage" and with pervasive computing this has never been more true. As Mark Weiser predicted our computers and sensors are rapidly dissolving into the background of the world around us. But if this technology is truly pervasive then where does the User Interface go? This question shows why Augmented Reality is much more than just the latest novelty. It is part of a structural change in the way we use and interact with the network. This presentation will look at the sensors around us, the standards that are developing and the challenges that lie ahead.

Technology Economy & Finance Business

AR is the UI for Pervasive Computing

by @nambor from

photo credit

it soaks up data through your senses

photo credit

but now we have digital sensors too

photo credit

they let our devices see, hear & feel

photo credit

new combinations are possible

photo credit

the web of things is here!

photo credit

html5 <video> & <canvas>

demonstration

photo credit

JSARToolkit fiducial tracking

demonstration

photo credit

Audio Visualiser in js & css

demonstration

photo credit

Javascript is getting fast

demonstration

photo credit

Javascript is getting threaded

demonstration

photo credit

getUserMedia = local camera access

demonstration

photo credit

Natural Feature Tracking in js

demonstration

photo credit

everyone's face is recognised

photo credit

orientation based key logging

photo credit

Strata #4
http://vimeo.com/26649742

we can now design
the way we see the world

speak into the microphone
& please smile for the cameras

questions?

it helps my
facial recognition software 8)

photo credit

New sensor based Web Standards developments have punched a hole in the web that is letting the real world leak into the browser. The getUserMedia API now lets us access cameras and microphones and JSARToolkit and javascript based Natural Feature Tracking like the examples from ICG Graz University have shown that browsers can now be taught to perceive the world around them. Combine this with the <canvas> and WebGL and you have a real working model for a Web Standards based Augmented Reality. On top of this we also have OGCs Sensor Web Enablement and new developments like the Sensor API and the rapid spread of networked sensors and wireless Arduino-ised devices. Massively distributed dynamic immersive visualisation is now the new structural form for the modern web.

streetARt case study for ARE2011

Rob Manson

Pervasive and Persuasive Computing

yahamid

Pervasive Computing : You're Already Knee Deep In It

Rob Manson

Pervasive computingPreethi AKNR

Pervasive Computing

Ankita Gupta

Pervasive ComputingVijayaLakshmi N

Is that sense-able?

Rob Manson

What does it mean when your apps can see, hear and feel? Digital sensors are flooding through our daily life. Mobile devices have microphones, cameras, accelerometers, digital compasses and now Near Field Communication (NFC) chips and scanners. But this is all just the very start. These small digital sensors are shrinking even further and just as Mark Weiser predicted they are soaking into the world around you. In this session Rob will explore how you can use these new streams of sensor data to create innovative and dynamic new user experiences. He’ll examine, from an experience point of view, what the challenges and constraints of sensor driven apps are and how you can deal with this deeply technical domain that covers issues such as sensor fusion, latency, calibration and newly extended mental models. But if that all sounds a bit dry and technical for you, don’t panic! Rob’s focus here is on how to create experiences using these technologies rather than the deep technical aspects themselves. However, he will help you get a clear overview of the work from the W3C Device API and Web Real Time Communication working groups, the ARStandards.org community and other related research activities. He’ll present tangible demonstrations that show how these new streams of “digital awareness” data can now be integrated into the experiences you create to literally bring your apps to life. This will leave you re-thinking your current projects and asking “Is that sense-able?”. Rob will also explore where we are headed with all of this and how to plan for this mind expanding journey. This is far from just a technical discussion. It will provide an introduction to the ethical and moral issues created by these sensors. Issues that we will all need to address in our own lives providing yet another aspect to the key question “Is that sensible?”

Shakespeare said “All the world is a stage” and with pervasive computing this has never been more true. As Mark Weiser predicted our computers and sensors are rapidly dissolving into the background of the world around us. But if this technology is truly pervasive then where does the User Interface go? This question shows why Augmented Reality is much more than just the latest novelty. It is part of a structural change in the way we use and interact with the network. This presentation will look at what this means for our sense of where and even who we are.

"Computer Vision and Machine Learning at the Edge," a Presentation from Qualc...

Edge AI and Vision Alliance

For the full video of this presentation, please visit: https://www.embedded-vision.com/platinum-members/qualcomm/embedded-vision-training/videos/pages/may-2017-embedded-vision-summit-mangan For more information about embedded vision, please visit: http://www.embedded-vision.com Michael Mangan, a member of the Product Manager Staff at Qualcomm Technologies, presents the "Computer Vision and Machine Learning at the Edge" tutorial at the May 2017 Embedded Vision Summit. Computer vision and machine learning techniques are applied to myriad use cases in smartphones today. As mobile technology expands beyond the smartphone vertical, both technologies will continue to fuel innovation, individually and in concert. In this presentation, Mangan discusses Qualcomm Technologies, Inc.’s use of and vision for the future of computer vision and machine learning at the edge.

Immersive Sydney - #WebXRWeek

Rob Manson

CTM Capabilitiestracyrawson

Face recognition for augmented reality and media management.Viewdle.2011.

Alexa Dovgopolaya

Applications and building blocks of the face recognition technology developed by Viewdle. Concepts and products of face recognition usage in cell phone augmented reality and photo-video content management and sharing are presented. Overview of the technology building blocks targeting different hardware and software environment is given. Among others face detection, feature detection, face tracking and face recognition operation in different environments and applications is considered. Prototypes of the products are presented.

VR Development with JavaScript

Schezarnie Racip

2013 426 Lecture 2: Augmented Reality Technology

Mark Billinghurst

Tech Review GenlOlivier Sarda

Image Recognition. Technology, Guidelines and Trends

Catchoom

Image Recognition has probably been one of the hottest topics throughout 2014 with announcements such as the launch of the Amazon FireFly app and several millions of VC capital and M&A in this space. Image recognition has the potential to become ubiquitous in our day-to-day interactions with real world objects that are connected with the digital world. This talk will be divided in four topics. First, it will cover basic aspects of the technology: the different approaches, the type of objects that are recognized, and the limitations of each technique through demonstrations. Second, the audience will be guided through the steps required to embed an image recognition solution into an app or service. Third, a number of vendor solutions will be described to give hands on pointers for those willing to start integrating such solutions. Finally, the talk will discuss the future of image recognition in different fields. You can watch the video of the presentation here: https://www.youtube.com/watch?v=ilbTvfchtQY

Final year presentationdeevon3d

The Extended Reality Landscape #Reality17

Rob Manson

33vuforiahandsonbeard091714-140926174454-phpapp01David Beard

Hands-On with the Qualcomm Vuforia Mobile Vision Platform (Beginning tutorial)

Qualcomm Developer Network

UplinQ - hands-on with the qualcomm vuforia mobile vision platform

Satya Harish

33vuforiahandsonbeard091714 140926174454-phpapp01David Beard

Adobe, Flash and HTML5

paultrani

Satheesh Subramanian (Blippar): The AR Browser : Where Visual Search meets Au...

AugmentedWorldExpo

A talk from the Work Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017. Satheesh Subramanian (Blippar): The AR Browser : Where Visual Search meets Augmented Reality The camera continues to evolve into a prominent input device for human computer interaction. As machine learning and computer vision technology advance, the camera will almost take the role of a third eye and will be expected to become the starting point of an information journey. Combined with wearable displays, it is imminent that the notion of a browser evolves too. This talk will discuss the evolution of visual search and how it can already be combined with augmented reality. http://AugmentedWorldExpo.com

Personal skills auditBenRayment

Introduction

sagayaaurelia1

Flash and HTML5 Compared

paultrani

The Power of AR & VR in Learning

Rob Manson

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

Rob Manson

This presentation was part of the ISMAR17 Workshop on "Standards for Mixed & Augmented Reality" in Nantes, France (https://arstandardsworkshop17.wordpress.com/program/). It provides an overview of the latest developments in web based Mixed Reality including the newly released Natural Feature Tracking from awe.media (see the intro video here https://youtu.be/5_HWgrcWWts). It takes a look at developments & APIs that are currently forming. It takes a look at what is still needed and how these API gaps may be dealt with. And it explores what is currently playing out in the market and how this is likely to evolve in the near-to-midterm future.

Similar to AR is the UI for Pervasive Computing

Now here is everywhere

Rob Manson

"Computer Vision and Machine Learning at the Edge," a Presentation from Qualc...

Edge AI and Vision Alliance

Immersive Sydney - #WebXRWeek

Rob Manson

CTM Capabilitiestracyrawson

Face recognition for augmented reality and media management.Viewdle.2011.

Alexa Dovgopolaya

VR Development with JavaScript

Schezarnie Racip

2013 426 Lecture 2: Augmented Reality Technology

Mark Billinghurst

Tech Review GenlOlivier Sarda

Image Recognition. Technology, Guidelines and Trends

Catchoom

Final year presentationdeevon3d

The Extended Reality Landscape #Reality17

Rob Manson

33vuforiahandsonbeard091714-140926174454-phpapp01David Beard

Hands-On with the Qualcomm Vuforia Mobile Vision Platform (Beginning tutorial)

Qualcomm Developer Network

UplinQ - hands-on with the qualcomm vuforia mobile vision platform

Satya Harish

33vuforiahandsonbeard091714 140926174454-phpapp01David Beard

Adobe, Flash and HTML5

paultrani

Satheesh Subramanian (Blippar): The AR Browser : Where Visual Search meets Au...

AugmentedWorldExpo

Personal skills auditBenRayment

Introduction

sagayaaurelia1

Flash and HTML5 Compared

paultrani

Similar to AR is the UI for Pervasive Computing (20)

Now here is everywhere

"Computer Vision and Machine Learning at the Edge," a Presentation from Qualc...

Immersive Sydney - #WebXRWeek

CTM Capabilities

Face recognition for augmented reality and media management.Viewdle.2011.

VR Development with JavaScript

2013 426 Lecture 2: Augmented Reality Technology

Tech Review Genl

Image Recognition. Technology, Guidelines and Trends

Final year presentation

The Extended Reality Landscape #Reality17

33vuforiahandsonbeard091714-140926174454-phpapp01

Hands-On with the Qualcomm Vuforia Mobile Vision Platform (Beginning tutorial)

UplinQ - hands-on with the qualcomm vuforia mobile vision platform

33vuforiahandsonbeard091714 140926174454-phpapp01

Adobe, Flash and HTML5

Satheesh Subramanian (Blippar): The AR Browser : Where Visual Search meets Au...

Personal skills audit

Introduction

Flash and HTML5 Compared

More from Rob Manson

The Power of AR & VR in Learning

Rob Manson

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

Rob Manson

Immersive Computing @ #YOWConnected 2017

Rob Manson

"Immersive" is the key defining factor of the next wave of computing. With each computing revolution the distance between the user and the computing experience has shrunk - with today's modern mobile devices making computing Pervasive. This next step is truly user-centered and puts you right at the heart of a deeply Immersive Experience. The key question that faces us now is "How do we get there from here?". Our near future seems to inevitably involve hyper-connected wearable and then embed-able computer displays. But how will we all migrate from today's mobile devices to this amazing new nerdvana? This session takes a detailed look at what makes "Immersive-ness" so important. What standards and market forces are driving this evolution. And how you can navigate your way through all the technological change this will bring.

Immersive - Sydney July 2017

Rob Manson

Computer Vision - now working  in over 2 Billion Web Browsers!

Rob Manson

This was presented at Augmented World Expo in Santa Clara (#AWE2017). A video of the live Natural Feature Tracking demo will be uploaded and linked from here soon. The key benefit of using AR in your web browser is how quick and easy it is to share. You can send a single web link through social media or email and the recipient can just tap on the link and it works. But up until recently this has not included Computer Vision based AR for a number of technical and market reasons. This presentation will position the web browser in the overall context of Computer Vision history, and we'll look at how this has evolved through developments including jsartoolkit.js, tracking.js and AR.js. We'll then dive deeper into the latest developments to show how OpenCV performs running in the browser and how this compares to native applications. This deep dive will compare the different feature detection/extraction algorithms and how they perform on some well known image data sets. The session will conclude with demos that show how this all works right now in over 2 Billion capable web browsers.

Build your own reality

Rob Manson

Web Standards for AR workshop at ISMAR13

Rob Manson

The future is un-Real

Rob Manson

The Augmented Web delivers AR to the masses

Rob Manson

Augmented Reality is just a feature!

Rob Manson

Introduction to AR

Rob Manson

Web Standards adoption in the AR market

Rob Manson

This market survey reviews how Web Standards have been adopted within the AR market across a wide range of commercial products and research projects. It aims to capture the state of the market at the end of 2012. This review provides a consolidated view of the use of Web Technologies within the AR industry and extrapolates how this trend is likely to evolve over the next 6-12 months. This review contributes to the ongoing development of AR Standards by providing system architects, implementors and marketers a clear and concise summary of this key intersection between AR and the Web.

Web Standards based Augmented Reality

Rob Manson

Augmented Reality lets you peel away the blinkers from your real world eyes to see the rich data and information that exists all around you. But up until now it has relied largely on proprietary tools and standards. Finally, we’re close to being able to augment our world using web technologies. Soon this will be a common part of the web browsing and mobile device experience. Now is the time to look at these future trends and the state of a specific list of API standardisation activities and the forces shaping them. We’ll also look at the current obstacles, risks and issues to explore what may prevent this landscape from evolving as it appears it will. This presentation aims to document the AR standardisation efforts over the last few years as well as what’s possible right now and in the near future from a distinctly web-based perspective.

What is web3?Rob Manson

ARSyd March 2011Rob Manson

Patterns of Interest - ISWAR Seoul 2010

Rob Manson

ARSyd September 2010

Rob Manson

Future of mobile in local Government

Rob Manson

There are 3 times as many mobile users globally as there are PC based internet users and in the future many people's first experience of the internet will be using their Mobile. No technology is more personal and local than the Mobile phone. This presentation looks at what is driving this rapid change and how can you can use it to benefit your Local Government. Then we look at what changes are on the horizon and how you can prepare for and manage this continuous flood of change.

The Pervasive Experience - project review July 2010

Rob Manson

XMediaLab Sydney 2010 (Scott & Rob)

Rob Manson

More from Rob Manson (20)

The Power of AR & VR in Learning

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

Immersive Computing @ #YOWConnected 2017

Immersive - Sydney July 2017

Computer Vision - now working  in over 2 Billion Web Browsers!

Build your own reality

Web Standards for AR workshop at ISMAR13

The future is un-Real

The Augmented Web delivers AR to the masses

Augmented Reality is just a feature!

Introduction to AR

Web Standards adoption in the AR market

Web Standards based Augmented Reality

What is web3?

ARSyd March 2011

Patterns of Interest - ISWAR Seoul 2010

ARSyd September 2010

Future of mobile in local Government

The Pervasive Experience - project review July 2010

XMediaLab Sydney 2010 (Scott & Rob)

Recently uploaded

Knowledge engineering: from people to machines and back

Elena Simperl

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

The Art of the Pitch: WordPress Relationships and Sales

Laura Byrne

Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes? All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Bits & Pixels using AI for Good.........

Alison B. Lowndes

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

The Future of Platform Engineering

Jemma Hussein Allen

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes