The document discusses various patents and inventions related to new technologies, such as eye tracking interfaces, 3D depth mapping, dual camera systems, holograms, gesture recognition, and discusses how companies like Apple, Google and Samsung are exploring interactions beyond the touchscreen through technologies like 3D Touch, Project Soli, and holograms to enable new types of user interfaces. Many of the patents aim to advance computing through more natural human-computer interaction using advanced sensors and display technologies.
Create Biz Opportunities by Using Technological DisruptionsHugo Gaston Ortega
Hosted by the "Manly Entrepreneurs" meetup I presented a 30 minute discussion which turned into a 2hr session. The room was full of passion and excitement, and due to the nature of the meetup, the audience was hungry to know about commercialization of disruptive technologies like Augmented Reality.
AWE Tel Aviv Startup Pitch: Yoav Hoshen with Superb Reality Ltd.AugmentedWorldExpo
A Startup Pitch from the Main Stage at AWE Tel Aviv 2018 - the World's #1 XR Conference & Expo in Tel Aviv, Israel, November 5, 2018.
http://AugmentedWorldExpo.com
For the full video of this presentation, please visit:
https://www.embedded-vision.com/industry-analysis/video-interviews-demos/embedded-vision-augmented-reality-trends-and-opportunities-
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Jon Peddie of Jon Peddie Research delivers the presentation "Embedded Vision in Augmented Reality: Trends and Opportunities" at the February 2017 Embedded Vision Alliance Member Meeting. Peddie presents highlights of his firm’s recent research on opportunities and challenges for embedded vision in augmented reality.
Create Biz Opportunities by Using Technological DisruptionsHugo Gaston Ortega
Hosted by the "Manly Entrepreneurs" meetup I presented a 30 minute discussion which turned into a 2hr session. The room was full of passion and excitement, and due to the nature of the meetup, the audience was hungry to know about commercialization of disruptive technologies like Augmented Reality.
AWE Tel Aviv Startup Pitch: Yoav Hoshen with Superb Reality Ltd.AugmentedWorldExpo
A Startup Pitch from the Main Stage at AWE Tel Aviv 2018 - the World's #1 XR Conference & Expo in Tel Aviv, Israel, November 5, 2018.
http://AugmentedWorldExpo.com
For the full video of this presentation, please visit:
https://www.embedded-vision.com/industry-analysis/video-interviews-demos/embedded-vision-augmented-reality-trends-and-opportunities-
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Jon Peddie of Jon Peddie Research delivers the presentation "Embedded Vision in Augmented Reality: Trends and Opportunities" at the February 2017 Embedded Vision Alliance Member Meeting. Peddie presents highlights of his firm’s recent research on opportunities and challenges for embedded vision in augmented reality.
Augmented Reality (AR) will be the next mobile computing platform, seamlessly merging the real world with virtual objects to support realistic, intelligent, and personalized experiences. Making this vision possible requires the next level of immersion, artificial intelligence, and connectivity within the thermal and power envelope of a wearable glasses.
Learn more at: https://www.qualcomm.com/invention/cognitive-technologies/immersive-experiences/augmented-reality
NCrafts.IO 2015 - Future of User eXperiencesVincent Guigui
Kinect, Oculus, Holograms, Wearables, Smart Objects...
Over the past few years, we have seen a rise of the new devices and sensors coming to our everyday life.
This session will explain the principles of interfaces, what is innovation and how to use these new devices to create more natural and more personal computing experiences by blurring the line between our world and the digital one.
Video available on NCrafts Vimeo Channel: https://vimeo.com/131932860
A lecture on Mobile Augmented Reality. A lecture given by Mark Billinghurst at the University of Canterbury on Friday September 13th 2013. This is part of the COSC 426 graduate course on Augmented Reality.
The Google Glass operating system is based on a version of Android, and it can run apps called Glassware that are optimized for the device. The glasses have built-in Wi-Fi and Bluetooth connectivity and a camera for taking photographs and videos
User Interfaces and User Centered Design Techniques for Augmented Reality and...Stuart Murphy
We chose to explore virtual and augmented reality (VR and AR) due to its recent emergence into the mainstream areas of gaming, mobile applications and various other systems. We felt it important to distinguish between VR and AR in both areas of interaction design and user interface evaluation and creation techniques. As it is a topic of great passion for us we wanted to instill the possibilities that this medium has to offer for interaction designers and UI developers.
Strava for Glass makes it easy to track your rides, visualize your progress, and challenge your friends, all while keeping your hands on the handlebars.
Slides for a talk Osama Ashawa, Principal of Design, and I presented at ConveyUX 2017 conference on March 2.
http://conveyux.com/sessions/design-dos-and-donts-for-great-ar/
Osama can be found here: https://www.linkedin.com/in/osama-ashawa-846b0248/
The experience of the mobile home screen being a bank of app icons that lead to independent destinations is dying. And that changes how we need to design and build digital products.
In this talk I show current trends and examples and explain what it means for User Experience Design and for businesses.
Augmented Reality (AR) will be the next mobile computing platform, seamlessly merging the real world with virtual objects to support realistic, intelligent, and personalized experiences. Making this vision possible requires the next level of immersion, artificial intelligence, and connectivity within the thermal and power envelope of a wearable glasses.
Learn more at: https://www.qualcomm.com/invention/cognitive-technologies/immersive-experiences/augmented-reality
NCrafts.IO 2015 - Future of User eXperiencesVincent Guigui
Kinect, Oculus, Holograms, Wearables, Smart Objects...
Over the past few years, we have seen a rise of the new devices and sensors coming to our everyday life.
This session will explain the principles of interfaces, what is innovation and how to use these new devices to create more natural and more personal computing experiences by blurring the line between our world and the digital one.
Video available on NCrafts Vimeo Channel: https://vimeo.com/131932860
A lecture on Mobile Augmented Reality. A lecture given by Mark Billinghurst at the University of Canterbury on Friday September 13th 2013. This is part of the COSC 426 graduate course on Augmented Reality.
The Google Glass operating system is based on a version of Android, and it can run apps called Glassware that are optimized for the device. The glasses have built-in Wi-Fi and Bluetooth connectivity and a camera for taking photographs and videos
User Interfaces and User Centered Design Techniques for Augmented Reality and...Stuart Murphy
We chose to explore virtual and augmented reality (VR and AR) due to its recent emergence into the mainstream areas of gaming, mobile applications and various other systems. We felt it important to distinguish between VR and AR in both areas of interaction design and user interface evaluation and creation techniques. As it is a topic of great passion for us we wanted to instill the possibilities that this medium has to offer for interaction designers and UI developers.
Strava for Glass makes it easy to track your rides, visualize your progress, and challenge your friends, all while keeping your hands on the handlebars.
Slides for a talk Osama Ashawa, Principal of Design, and I presented at ConveyUX 2017 conference on March 2.
http://conveyux.com/sessions/design-dos-and-donts-for-great-ar/
Osama can be found here: https://www.linkedin.com/in/osama-ashawa-846b0248/
The experience of the mobile home screen being a bank of app icons that lead to independent destinations is dying. And that changes how we need to design and build digital products.
In this talk I show current trends and examples and explain what it means for User Experience Design and for businesses.
Noah Harlan, Founder of Two Bulls, gave this presentation at the AllSeen Alliance's Partner Programme at Mobile World Congress 2015.
About Two Bulls: Two Bulls is Community Member of the AllSeen Alliance that works with some of the world’s top brands and innovative startups in designing and developing apps, services, products and ecosystems for mobile, desktop and emerging platforms. Its apps have been downloaded millions of times by users around the world. Noah Harlan, Two Bulls Founder, shares his thoughts on being a part of the Alliance, the road to interoperability and the importance of open source in realizing the Internet of Everything.
The release of the iPhone 6s and 6s plus was yet another prominent bench mark in the history of Apple. As usual, the release did not fail to disappoint its technophile
audience. Its adaptation of 3D facility has paved the way for a new insight into the feld of technology.
What is Tokenization? Are tokens the future of ownership?
-
The advantage of token-based social networks, and why tokens will disrupt all forms of ownership.
+ Updated version for NEXT Conference Hamburg +
https://nextconf.eu/event/how-deep-learning-is-changing-the-design-process/
Deep learning is a new and exciting subfield of machine learning which attempts to sidestep the whole feature design process. This session explains how it derives from AI, why it quietly became a part of user experience and how it also changes the actual design workflow. The talk highlights a range of use cases and doesn’t forget to illustrate why user experience design for artificial intelligence matters the other way around.
2017 How Deep Learning Changes the Design Process (Update)Alexander Meinhardt
+ Updated version for UX Camp Hamburg #uxcamphh +
Deep learning is a new and exciting subfield of machine learning which attempts to sidestep the whole feature design process. In this session, I'll explain how it derives from AI, why it quietly became a part of user experience and how it will change the actual design workflow. The talk highlights a few examples and doesn't forget to illustrate why user experience design for artificial intelligence matters the other way around.
In this session, I explain why user experience design for artificial intelligence matters. How you make machine learning transparent to users is one of the great design challenges of our time—but a necessary one.
In this talk, presented at the UX Forum in Munich, I had a look at the Artificial Intelligence landscape, and the differences between Machine Learning and Deep Learning. The session walks through a big range of use cases in fields such as object and face recognition and showcases how the design industry is charging up with new powers.
Resonate (http://resonate.io) is a festival at the intersection of art, media and technology. Held each year in Belgrade, Serbia, the conference provides an overview of current situation in the fields of music, visual arts and digital culture.
This session walks through speakers and personal highlights of the 2017 conference.
This talk, made with Kristina Bonitz (@kristinabonitz), tries to highlight the differences within the conversational design landscape and shows benefits and drawbacks alongside current examples.
Chat bots are programs that mimic conversation with people sometimes using artificial intelligence. They can transform the way you interact with the web from a series of self-initiated tasks to a quasi-conversation.
(c) 2017
Modern interaction design - see Flat Design - is more than ever based on letters.
This talk highlights strong examples and explains how to achieve an aesthetic and powerful set of typography for any project, and how to handle it in the digital workflow.
"Tone of voice" is a super important instrument to build personality into digital products. It's not about copywriting, it's an expression of the brand identity.
Prototypes are one of the most important steps in the design process, yet still confusing for some designers and project teams.
This session, made with Iker Ortiz de Arri (@ikertxo), showcases our workflow approach, answers the question how to choose the right prototyping tool for a project and and compares some of the major players in this exploding landscape.
What are the main and also often underlooked differences between native app development and web technologies when building a mobile product? What is the current stare of technology in terms of combing both?
This talk, made with Iker Ortiz de Arri (@ikertxo), showcases benefits, drawbacks and similarities from an UX point of view. It also features PWA (progressive web apps), Android Instant Apps, React, and more.
OFFF Barcelona (http://offf.barcelona) is a post-digital culture festival.
This session walks through speakers and personal highlights of the 2016 conference.
In this talk presented at the Swipe x PAGE Academy (http://page-online.de), we gave an overview of the Swipe workflow building mobile products, from an UX/UI point of view.
http://swipe.de
This talk presented at the Swipe x PAGE Academy (http://page-online.de) is about my personal work manifesto for building teams, atmosphere and greater products at Swipe (http://swipe.de).
This session as part of the Swipe x PAGE Academy (http://page-online.de) gave examples of how we create UX/UI at Swipe (http://swipe.de) efficiently when building digital products.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
2016 Current Patents & Inventions
1. P A T E N T S &
I N V E N T I O N S
K R U N C H T I M E
I NT E RACT IV E
2. P A T E N T S &
I N V E N T I O N S
Eye tracking
3. P A T E N T S &
I N V E N T I O N S
Covers a graphical user interface that actively tracks where you're
looking, allowing users to control an onscreen input or mouse
cursor with just their gaze.
Apple / US 8,937,591
4. P A T E N T S &
I N V E N T I O N S
Apple / US 8,937,591
5. P A T E N T S &
I N V E N T I O N S
The patent's main focus, however, is on preventing a common eye-
tracking issue called the Troxler Effect, an optical illusion which
can cause onscreen objects that are stationary to look like they're
disappearing.
You can see an example in the next slide of a stabilised image and
the Troxler Effect in action: Try staring at the cursor in the center
and you should notice the purple dots fade away after a few
seconds.
Troxler Effect
6. P A T E N T S &
I N V E N T I O N S
Troxler Effect
8. P A T E N T S &
I N V E N T I O N S
Face recognition for security
9. P A T E N T S &
I N V E N T I O N S
To solve the issue of having to lock or unlock a device manually,
Apple proposes that a product can be configured to lock itself if the
user's face is no longer present in front of the camera, and unlock
itself when the user's face reappears.
Apple / US 2012/0235790
10. P A T E N T S &
I N V E N T I O N S
Apple / US 2012/0235790
11. P A T E N T S &
I N V E N T I O N S
Using a forward-facing camera to recognise an individual user,
future iPhones and iPads from Apple could automatically customise
applications, settings and features to a user's personal
preferences once they pick up the device.
Each user could customise their personal profile with a unique
wallpaper, applications and settings, and that profile would be
immediately accessed once the iPad recognises a user's face.
Apple / US 2011/0317872
12. P A T E N T S &
I N V E N T I O N S
Apple / US 2011/0317872
14. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
15. P A T E N T S &
I N V E N T I O N S
Apple acquired LinX in April 2015, a camera module maker
working on multi-lens systems. Dual lens cameras pack
impressive image quality in a smaller size than single aperture
cameras, meaning the iPhone 7 Plus may lack a protruding camera
lens and be able to take SLR-quality photos — think Canon or Nikon
(depth of field).
Dual lens cameras
16. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
17. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
18. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
19. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
Noise reduction
Images captured by dual lens cameras are brighter and clearer,
with significantly reduced noise levels, compared to other
smartphone cameras.
20. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
21. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
2-3x optical zoom
Available detail when zoomed into a photo is also much greater.
22. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
23. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
Improved Indoor Photos
Sensors let in more light, for a photo that is clearer and sharper
with less noise.
24. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
25. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
Improved Low Light Photos
The technology is using multiple channels to increase the
sensitivity of the camera for better detail. It also keeps
exposure times short to cut down on the motion blurring that can
impact photo quality in conditions where lighting is not optimal.
26. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
27. P A T E N T S &
I N V E N T I O N S
Dual lens cameras
3D depth mapping
Useful applications include 3D scanning of objects, sizing of
objects, background removal and replacement and gesture
recognition. The depth maps also allow for improved refocusing; by
knowing the depth at every pixel, the feature allows for a
synthetic blur to be applied that emulates a shallow depth.
29. Dual lens cameras
Benefits Overview
• Depth of field
• Better color accuracy and uniformity
• HDR - higher dynamic range
• UHDR - ultra high dynamic range
• Low noise levels
• Higher resolution
• Low module costs
• Zero shutter lag
• Small size allows for slim devices and edge-to-edge displays
30. P A T E N T S &
I N V E N T I O N S
3D depth mapping
31. P A T E N T S &
I N V E N T I O N S
Covers a technology that will allow hand signals to control a
computer app or Apple TV via 3D depth mapping.
Apple / US
32. P A T E N T S &
I N V E N T I O N S
Apple / US
33. P A T E N T S &
I N V E N T I O N S
Apple / US
34. P A T E N T S &
I N V E N T I O N S
Covers a 3D sensing device that works with distinct gestures that
could control items on a display or TV, such as allowing a user to
select an tune on iTunes, or to activate a channel like Netflix without
the need of a remote control.
Apple / US
35. P A T E N T S &
I N V E N T I O N S
Apple / US
36. P A T E N T S &
I N V E N T I O N S
Apple / US
37. P A T E N T S &
I N V E N T I O N S
Covers user interfaces that are based on three-dimensional
sensing, such as Push, Wave and Up Air Gestures.
Apple / US 8,933,876
38. P A T E N T S &
I N V E N T I O N S
Apple / US 8,933,876
39. P A T E N T S &
I N V E N T I O N S
Covers a method for face detection, which includes capturing a
depth map and an image of a scene. One or more locations in the
image are selected to test for presence of human faces.
Apple / US
40. P A T E N T S &
I N V E N T I O N S
Apple / US
41. P A T E N T S &
I N V E N T I O N S
Covers receiving a depth map of a scene containing at least an
upper body of a humanoid form. The technology may again serve as
a simplified input to application programs, such as responding to
users' gestures.
Apple / US 9,047,507
42. P A T E N T S &
I N V E N T I O N S
Apple / US 9,047,507
43. P A T E N T S &
I N V E N T I O N S
New gestures
44. P A T E N T S &
I N V E N T I O N S
Covers detection and interpretation of real-world gestures for pinch
and zoom, security & more.
Apple / US 9,158,454
45. P A T E N T S &
I N V E N T I O N S
Apple / Knobs with audible feedback
46. P A T E N T S &
I N V E N T I O N S
Apple / ‚Right-click‘
47. P A T E N T S &
I N V E N T I O N S
Apple / ‚Okay‘ gesture
48. P A T E N T S &
I N V E N T I O N S
Google’s Project Soli has invented a new interaction
sensor using radar technology that can capture
motions of your fingers at up to 10,000 frames per
second. Simply put, this technology is so bafflingly
accurate that you could operate any device without
having to even touch it.
Google / Project Soli
49. P A T E N T S &
I N V E N T I O N S
This chip is actually a miniature gesture radar that
captures even the most complex hand movements at
close range, at unbelievably hyper speeds and
replicates hand gestures. Given the micro size of the
chip, it can almost be fitted into literally anything.
This technology, if the project is successful, can make
the need to touch a device to operate it redundant.
Google / Project Soli
50. P A T E N T S &
I N V E N T I O N S
Google / Project Soli
53. P A T E N T S &
I N V E N T I O N S
Covers technology that would allow a device to project holograms. A
light emission device would be placed right above the screen, and
another thicker material right above that image source.
Samsung / December 27, 2015
54. P A T E N T S &
I N V E N T I O N S
Samsung / December 27, 2015
55. P A T E N T S &
I N V E N T I O N S
Samsung / December 27, 2015
56. P A T E N T S &
I N V E N T I O N S
Covers a 3d display system that would mimic a hologram without
requiring special glasses. The device would be able to project
stereoscopic 3D images to multiple viewers at the same time with
complete freedom of movement.
Apple / US 7,843,449
57. P A T E N T S &
I N V E N T I O N S
Covers a device that would be able to direct multiple beams of light
through a display to generate an image, while also taking into
account the position of the user, who could interact with the 3d
holographic images.
Apple / US 8,847,919
58. P A T E N T S &
I N V E N T I O N S
Apple / US 8,847,919
59. P A T E N T S &
I N V E N T I O N S
Apple / US 8,847,919
60. P A T E N T S &
I N V E N T I O N S
Apple / US 8,847,919
61. P A T E N T S &
I N V E N T I O N S
3D interface effects
62. P A T E N T S &
I N V E N T I O N S
Covers interaction with a virtual 3D world inside the display and how
to prevent the GPU from constantly re-rendering.
Apple / US 8,913,056
63. P A T E N T S &
I N V E N T I O N S
Apple / US 8,913,056
64. P A T E N T S &
I N V E N T I O N S
Apple / US 8,913,056
65. P A T E N T S &
I N V E N T I O N S
Automated photo effects
66. P A T E N T S &
I N V E N T I O N S
Covers photo effects activated by sound, motion and location.
Unlike Instagram, users wouldn’t need to select an effect each time
they wanted to apply one.
Apple / US 8,933,960
68. P A T E N T S &
I N V E N T I O N S
Person-to-person payments
69. P A T E N T S &
I N V E N T I O N S
Covers identifying a proximate electronic device of a counter party
in a financial transaction, and may provide an encrypted payment
packet to the other electronic device.
Apple / US 2015/0186887
70. P A T E N T S &
I N V E N T I O N S
Apple / US 2015/0186887
71. P A T E N T S &
I N V E N T I O N S
Interactive toys
72. P A T E N T S &
I N V E N T I O N S
Covers agent interfaces for interactive electronics that support
social cues. A doll or toy may be configured to control one or more
media devices by detection of a movement or spoken word. Doing
so it would „wake up“ and „make eye-contact“.
Google / US 2015/0138333
73. P A T E N T S &
I N V E N T I O N S
Google / US 2015/0138333
74. P A T E N T S &
I N V E N T I O N S
The future of 3D Touch
76. P A T E N T S &
I N V E N T I O N S
3D Touch is a feature which senses how much pressure you apply to
the display. The amount of pressure needed to activate the feature
can be customized through a Light, Medium, or Firm setting.
Where we are
77. P A T E N T S &
I N V E N T I O N S
Quick actions (Home screen)
Peek and Pop (In-app)
Where we are
Allow apps to deep link and/or perform specific app actions from
the home screen.
Allow apps to let users preview content and perform related
actions within the app, before deciding if they want to view the full
content.
78. P A T E N T S &
I N V E N T I O N S
Shortcut actions
Use 3D Touch as an alternative type of “click” (like right-click on a
mouse) to let users skip a few steps, or avoid unnecessary steps in a
process.
Dynamic actions
Rely on the amount of pressure applied to signal a variety of
actions.
Where we are
80. P A T E N T S &
I N V E N T I O N S
Home screen shortcut actions
• Control Center : 3D Touch on WiFi or Bluetooth icon bring up
easy options to connect to a network or device
• Control Center : Stop the device from changing orientation
when watching a video
• Calendar: Create a meeting at the last Maps location viewed
1 / Examples
81. P A T E N T S &
I N V E N T I O N S
2 / Examples
In-app shortcut actions: iOS Mail
• Peek into „time reference“ shows a snippet of the calendar, and
adds a meeting from there
In-app shortcut actions: more
• Google search on a highlighted word
• Email an image to a favorite contact
82. P A T E N T S &
I N V E N T I O N S
In-app dynamic actions
• Using the amount of pressure applied to a photo to zoom into it
• Turn the iPhone into a kitchen scale
• 3D Touch for anything that has a “slider”: number of
passengers on a flight, radius of a circle in Foursquare
3 / Examples
83. P A T E N T S &
I N V E N T I O N S
Home screen dynamic actions
• 3D Touch as main UI
• Set a timer from the Clock app’s home screen icon by using
varying levels of pressure
• Instead of using the Hue app, change the brightness of its
smart lights by applying to the app’s home screen icon
• Instead of going into the Nest app, change the temperature
from the home screen
4 / Examples
84. P A T E N T S &
I N V E N T I O N S
Piano rhythm game that uses the pressure of a touch to dictate how
loud a note should be.
Dynamic actions: Magic Piano
86. P A T E N T S &
I N V E N T I O N S
A children game that makes letters and words react in an special
way depending on how hard you press.
Dynamic actions: Endless Alphabet
88. P A T E N T S &
I N V E N T I O N S
A new generation automotive concept that shows how dynamic
actions could be used for changing volume, among other things.
Dynamic actions: Synaptics prototype
90. P A T E N T S &
I N V E N T I O N S
Modular phones
91. P A T E N T S &
I N V E N T I O N S
The promise: A phone that you can easily upgrade, repair and
customise. A modular phone. One universal platform for the whole
world.
Modular Phones
92. P A T E N T S &
I N V E N T I O N S
Phonebloks is an open-source modular smartphone concept
created and designed by Dave Hakkens, primarily to reduce
electronic waste. By attaching individual third-party components to
a main board, a user would create a personalised smartphone.
In October 2013, Hakkens started collaborating with Motorola
and Google on Project Ara.
Phonebloks
93. P A T E N T S &
I N V E N T I O N S
Smartphones based on the Phonebloks system would be sold part by
part, as well as in starter sets. Bloks can be replaced at will to replace a
broken blok, to upgrade an existing blok, or to expand the functionality
of the phone into a specific direction. Bloks would be available in
Blokstore, "an app store for hardware", where users could buy new
and used bloks as well as sell back their old ones.
As of February 2014, the campaign had over 950,000 supporters
and a social reach of over 380 million people.
Phonebloks
95. P A T E N T S &
I N V E N T I O N S
ARA is an open hardware platform for creating highly modular
smartphones. It includes a structural frame that holds a display,
camera or an extra battery. It would allow users to swap out
malfunctioning modules or upgrade individual modules, providing longer
lifetime cycles and reducing electronic waste.
Scheduled to begin pilot testing in the United States in 2016.
Google / Project ARA
96. P A T E N T S &
I N V E N T I O N S
Two frame sizes will be available at first: "mini","medium", and a "large"
frame. Each frame is expected to cost around US$15.
Modules can provide cameras and speakers, but can also more
specialised features, such as medical devices, receipt printers, laser
pointers, pico projectors, night vision sensors, or game controller
buttons.
Modules can be hot-swapped without turning the phone off. They will be
available both at an official Google store and at third-party stores.
Google / Project ARA
98. P A T E N T S &
I N V E N T I O N S
PuzzlePhone is a modular smartphone, made in Finland. It’s made
out of three essential modules, the Heart, the Spine, and the Brain,
that can be upgraded, for maximum longevity and performance.
Earliest estimated delivery date is September 2016.
Puzzlephone
100. P A T E N T S &
I N V E N T I O N S
RePhone will let you create your own phone in minutes with
several modules, an accessible software and a customisable phone
case. The open source modular phone kit allows everyone to add
cellular communication to different objects.
RePhone Kit
102. P A T E N T S &
I N V E N T I O N S
RePhone is compatible with the Arduino platform, with the Pebble
smartwatch and with IFTTT for example to have a link with your pets,
toys, motorcycle, robots or drones.
It includes a Core Module GSM + BLE, an audio module, a
touchscreen, a battery and two precut Kraft Paper to assemble a
phone case. This DIY (Do It Yourself) platform lets you create your
personal case using a lot of materials, for example wood, plastic,
leather, etc. The company has also developed other modules with NFC,
GPS, 3G connection, a camera and basic sensors (Accelerometer,
Temperature Sensor, Light Sensor).
RePhone Kit
104. P A T E N T S &
I N V E N T I O N S
Fairphone is a Dutch company founded to develop a smartphone
which doesn’t contain conflict minerals (gold, tin, tantalum and
tungsten) and using fair labor conditions for the workforce along all the
supply chain.
Fairphone 1 sold 60.000 units, Fairphone 2 was released in 2015.
Fairphone
105. P A T E N T S &
I N V E N T I O N S
Fairphone 2 is an innovative smartphone in all its aspects. This
smartphone introduces a new and innovative modular construction
technology. Thanks to this architecture, anyone can do basic
maintenance on his or her phone without external support. It runs
Android 5.1 and a lot of high quality components.
Fairphone
106. P A T E N T S &
I N V E N T I O N S
The company has developed different types of modules: A Core unit
(memory, flash storage, modem, antennas, the SIMs and MicroSD card
and motion sensors), a display unit with the LCD screen and the
receiver module (receiver, headset connector, front-facing camera,
noise-cancelling microphone, ambient light and proximity sensor and the
notification LED). It also hosts a rear camera module and a speaker
unit, which includes also the vibration mechanism, main microphone and
a USB connector. The various modules may be replaced with other
components with better features, for example, an IR camera instead of
the normal rear-camera unit.
Fairphone
107. P A T E N T S &
I N V E N T I O N S
The company wants to raise awareness about the issues
surrounding mining and existing alternatives, in particular,
improve working conditions for miners, introduce local wages,
eliminate child labor and reduce environmental degradation caused by
mining practices. Other goals are to establish collaborative, mutually
beneficial, and transparent relationships with manufacturers to ensure
worker representation, safe working conditions and fair pay.
Fairphone
109. P A T E N T S &
I N V E N T I O N S
The G5 is a next-gen smartphone that introduces two modular
add-ons. It has an accessory slot at the bottom, which allows users to
remove the battery and to swap in different modules: LG CAM Plus, LG
Hi-Fi Plus” Bang & Olufsen DAC accessory, etc.
LG is supposed to launch G5 in April.
LG G5
113. P A T E N T S &
I N V E N T I O N S
Beyond the smartphone
114. P A T E N T S &
I N V E N T I O N S
Virtual & Augmented Reality
115. P A T E N T S &
I N V E N T I O N S
2016 will be the year of Virtual Reality, with companies like Samsung
with the Gear VR giveaway and Facebook with Social VR and
partnership with Samsung investing hard on it.
Virtual Reality
116. P A T E N T S &
I N V E N T I O N S
Head-mounted displays market will progress toward mainstream
adoption for consumers and enterprise use. New virtual reality products
for consumers, such as the HTC Vive, Oculus Rift, Sony PlayStation
VR, and Microsoft HoloLens are expected to be available along with
video games and entertainment content as well as business applications.
Film producers and sports leagues will augment their traditional content
through HMDs to enhance their customer experiences by creating
interactive attractions, movies, and sporting events that make the
content more personal and meaningful.
Virtual Reality
117. Virtual Reality
Samsung Gear VR
Free / 99 €
HTC Vive
Pre-orders 799 $
Oculus Rift
July 2016 - 599 $
Sony Playstation VR
October 2016 - 400 $
118. Virtual Reality
*Statista 2016
Samsung Gear VR
Oculus Rift
HTC Vive
Sony Playstation VR
Others
Sold pieces in Mio.
5,0 Mio.
3,6 Mio.
2,1 Mio.
1,4 Mio.
0,1 Mio.
VR Headsets unit sales forecast Worldwide in 2016
124. P A T E N T S &
I N V E N T I O N S
Apple had been creating a VR team and recent revelations
indicate that Apple is now accelerating their VR project. There are
patents that go back to iPod times. Apple has built a large team
that is experimenting with headsets and other technologies.
Hundreds of employees are part of a "secret research unit"
exploring AR and VR, building prototypes of virtual reality headsets
that are similar to the Oculus Rift and the Hololens from Microsoft.
Multiple prototypes of "possible headset configurations" have been
created in recent months, with Apple's interest reportedly
inspired by the Oculus Rift.
Virtual Reality
125. P A T E N T S &
I N V E N T I O N S
Virtual Reality
126. P A T E N T S &
I N V E N T I O N S
Apple has filed a patent related a device / glasses that projects
content, being aware of objects in its field of view, recognising
such objects as suitable for projection of content thereon. For
instance, like we see in the picture, the interface floating that lets
you buy a book, when looking at the physical book. The projection
device may adapt to the geometry and character of the objects by
controlling scale, distortion, focus of the projected content, and
varying the projected content itself.
Augmented Reality
127. P A T E N T S &
I N V E N T I O N S
Augmented Reality
128. P A T E N T S &
I N V E N T I O N S
HoloLens is a "mixed reality" computing platform, enabling
applications in which the live presentation of physical real-world
elements is incorporated with that of virtual elements.
Microsoft HoloLens
129. P A T E N T S &
I N V E N T I O N S
Consists of a smart-glasses headset (visor) that is a cordless,
self-contained Windows 10 computer.
Uses advanced sensors and spatial sound with a natural user
interface that the user interacts with through gaze, voice, and hand
gestures.
Microsoft HoloLens
130. P A T E N T S &
I N V E N T I O N S
Microsoft HoloLens
131. P A T E N T S &
I N V E N T I O N S
Microsoft HoloLens
132. P A T E N T S &
I N V E N T I O N S
Microsoft HoloLens
133. P A T E N T S &
I N V E N T I O N S
Microsoft HoloLens
134. P A T E N T S &
I N V E N T I O N S
Microsoft HoloLens
135. P A T E N T S &
I N V E N T I O N S
Magic Leap is a US startup that is working on a head-mounted
virtual retinal display.
Hardware not presented to public yet.
”A Google Glass on steroids that can seamlessly blend computer-
generated graphics with the real world“.
Magic Leap
136. P A T E N T S &
I N V E N T I O N S
Works by projecting light on your retina.
Your eyes can move around and focus on things, unlike using VR.
Aiming to be worn all day long in public while being social.
Promises to make virtual experiences happen more
naturally.
Magic Leap
137. P A T E N T S &
I N V E N T I O N S
„Dreams of being a full computer“.
Will run its own OS.
Comparable but arguably better than Microsoft HoloLens.
Magic Leap
138. P A T E N T S &
I N V E N T I O N S
Magic Leap Announces $793.5 million in New
Funding
Dania Beach, Florida, February 2, 2016 - Magic Leap, Inc.
announced $793.5 million in new funding today, led by Alibaba
Group. Continued investment comes from Google Inc.,
Qualcomm Incorporated, through its venture investment group,
Qualcomm Ventures, and others.
Magic Leap
140. P A T E N T S &
I N V E N T I O N S
Emergency Free Fall Orientation
141. P A T E N T S &
I N V E N T I O N S
Covers the characteristic of the gyroscopic
torque to be used to reorient the mobile device
during the free fall.
Apple / US 2016/0018223
If a device is oriented during free fall such that it will likely fall directly
onto its display, the characteristic of the gyroscopic torque may be
selected so that the device will instead impact on its edge or side.
142. P A T E N T S &
I N V E N T I O N S
Apple / US 2016/0018223