Download to read offline
More Related Content
Similar to Introduction to Augmented Reality in iOS Apps
![Augmented reality [1]](https://cdn.slidesharecdn.com/ss_thumbnails/augmentedreality1-110405083739-phpapp02-thumbnail.jpg?width=640&height=640&fit=bounds)
![Augmented reality [2]final copy2](https://cdn.slidesharecdn.com/ss_thumbnails/augmentedreality2finalcopy2-110405163203-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
![5G Explained! A High Level Overview [Introduction]](https://cdn.slidesharecdn.com/ss_thumbnails/5gexplainedahighleveloverview-260119165306-cc137a3e-thumbnail.jpg?width=640&height=640&fit=bounds)
Introduction to Augmented Reality in iOS Apps
- 2. • Augmented Reality/Virtual Reality • What is ARKit • Banking transformation using AR. • Fundamentals of ARKit • ARKit core classes. • Challenges of ARKit. • Live Demo. • Questions.
- 4. • ARKit usesVisual Inertial Odometry (VIO) to accurately track the world around it. • ARKit uses camera sensor data with CoreMotion data. • Detect horizontal planes and place virtual objects on them. • World's leading Global Investment firm has reported that augmented reality market across industries will reach $80 billion by 2025. • Gartner has listed AR / VR in top 10 strategic technology trends for 2017.
- 5. • AR homefinder apps: Commonwealth Bank of Australia (CBA in 2011) and Halifax bank in 2012. • AR Calendars- used by Federal Bank of India • Help customers to locate branches and ATMs, displaying offers and deals • Stockbroking apps for enhanced trading experience. • Product training and education
- 6. • Xcode 9.0or above • iOS11 + • iOS device with an A9 or later processor. • iPhone6s and above; iPhone SE • All iPad Pros and the current std 2017 iPads • ARKit apps cannot be tested on Simulator. • ‘arkit’ key in UIRequiredDeviceCapabilities in info.plist • app's Info.plist must include user-facing text for the NSCameraUsageDescription key so that the user can grant your app permission to access the camera.
- 7.
- 8. • ARSCNView • ARAnchor •ARSession • ARWorldTrackingConfiguration • ARHitTestResult
- 9.
- 10. • Lighting • Texturesand Surfaces • Fast movement of device • Long initializing times • Only detects horizontal planes yet
- 11.
Editor's Notes
- #4 Augmented Reality: AR is used in apps for smartphones and tablets. AR apps use your phone's camera to show you a view of the real world in front of you, then put a layer of digital information, including text and/or images, on top of that view. Virtual Reality: Virtual Reality is defined as "the use of computer technology to create a simulated environment.” When you view VR, you are viewing a completely different reality than the one in front of you. You can view virtual reality through a special VR viewer, such as the Oculus Rift. Other virtual reality viewers use your phone and VR apps, such as Google Cardboard or Daydream View. With virtual reality apps, you can explore places you have never been, such as the surface of Mars, the top of Mt. Everest, or areas deep under the sea. The New York Times has a virtual reality app that lets you experience virtual environments on Earth and other planets. Mixed Reality:-
- #5 VIO is a technique which fuses information from a camera and inertial sensors, specifically gyroscopes and accelerometers to estimate the 3D coordinates, distances and exact sizes of any object in real world. VIO by using coreMotion and camera of a phone, can create animated 3D graphics that it can visualize live in 6 degrees of freedom, following the device’s complex movements along 6 axes:up/down, back/forth, in/out and its pitch,yaw and roll. ARKit also makes use of the camera sensor to estimate the total amount of light available in a scene and applies the correct amount of lighting to virtual objects. ARKit can detect horizontal planes like tables and floors, and can track and place objects on smaller feature points as well. Gartner – American research and advisory firm
- #6 Once people get used to experiencing a digital layer over their everyday reality, new opportunities exist for financial services firms to engage with customers. ‘Homefinder’ apps use AR technology to enable users to view and pull up data on houses for sale as they pass them. AR calendar which provides relevant messages when viewed through a smartphone Industry leader bank in Poland has enabled AR feature on their mobile app. Customer can point the phone camera at the banner on their website and avail augmented 360-degree product information and avail attractive interest rates!! Combined with location-based services, AR solution can help in property searches, listing down all details of property, view properties and display special offers when a device is pointed at it. This can further be enhanced for personal lending services. Virtual trading desk. AR can help traders to see, understand and manipulate large volumes of complex data in real time. Turns any Brochure, Outdoors into an active, engaging advertisement with a digital layer of information.
- #7 True depth Camera in iphoneX and ARKit enable a revolutionary capability for robust face tracking in augmented reality apps. Advanced cameras in iphone 8, iphone 8plus and iphoneX are ‘calibrated’ for use with AR.
- #8 AVFoundation: Monitors device camera input and renders it on-screen. CoreMotion: Monitors device movement using internal hardware such as the gyroscope, accelerometer, and compass Vision(New): Applies high performance computer vision algorithms to identify the interesting features in a scene. CoreML(new): Generate predictions from pre-trained machine learning models. Graphic rendering frameworks: ARKit integrates well with Scenekit: Render 3D content into ARScene. SpriteKit: Render 2D content into an AR scene. Metal: Render 3D content into AR scene for advanced game development (aapple’s replacement of OpenGL)
- #9 ARSCNView : Renders a live video stream from your device camera in the view as a background to your 3D scene ARAnchor: A real-world position and orientation that can be used for placing objects in an AR scene. Custom anchors are added and removed throught a ARSession. ARKit also automatically adds anchors when you enable the planeDetection option in a world tracking session. ARSession — every Augmented Reality session requires an ARSession instance. It is responsible for controlling the camera, gathering all of the sensor data from the device etc to build this seamless experience. Run your session only when the view that will display it is onscreen. ARHitTestResult: using the hitTest(_:types:) method to search for a point in 3D space corresponding to a 2D point in the view. This is where ARKit magic happens! 3D point coordinates.
- #10 ARConfiguration: abstract class..don’t directly use instances of this class. But its subclasses that provides the kind of augmented reality experience you want to use in your app or game. ARWorldTracingConfig: is a configuration for tracking the devices orientation, position and for detecting feature points like surfaces that are recorded by the camera. Provides you the virtual coordinate space generated by your phone based on the camera and motion data.6DOF AROrientationTrackingConfiguration: Provides basic AR experiences that use the rear-facing camera and track only a device's orientation. 3DOF ARFaceTrackingConfiguration : A configuration that tracks the movement and expressions of the user’s face using the TrueDepth camera (iphone X).apps: 3Dphotoes with upcoming iPhone models.
- #11 Lighting: Computer vision algorithms, in general, behave poorly under bad lighting conditions. Same path with different lighting environments (all lights switched on, only ambient light, etc), and you will see how it affects plane detection. Textures and Surfaces : A white, flat wall without texture or differentiating points will not give you good planes. On the contrary, corners, rich textures and well-defined surfaces will help ARKit do a good job when detecting planes from the scene. Long initialization times, going into the background.: no plane detection is available during this time Test these by enabling feature points debugging option.