A talk from the Work Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018. Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applications AI/AR industry has attracted attention never seen before of academia and industry, into which numerous talents and resources have been invested. This talk will share with you some difficulties, misconceptions and experience in commercializing AR based on HiScene’s practice. http://AugmentedWorldExpo.com

1. AR for Industry in China:
From Concepts to Real Applications
Jian Liang
CTO

2. AR IS NOT NEW

4. Post production

5. Live

6. Before

7. After

8. 2020?

9. GAME!

10. 2B OR 2C,
THAT’S A QUESTION

12. QQ-AR
Olympic
Torch Relay
Partnered with Tencent
During the Rio 2016 Summer Olympic Games, “QQ-AR Torch Relay” covered 366
cities, 157 countries, and over 100M people, which created a Guinness World
Record as the largest online torch relay event ever.

13. Partnered with
Alipay and OREO
• OREO partnered with Alipay and HiScene to launch an AR based promotion.
Customers can AR-Scan 18 patterns of OREO biscuit combinations to trigger
different games and obtain various gifts.
• OREO received over 240M PV，13.8M reply, and 10.2M forwards on Weibo.com.
OREO
AR Promotion

14. QR or AR?

15. Mechanized production
Machine manufacturing
Electrification Age, assembly lines
Mass production, standardization
High automatization, unmanned/
flexible manpower line
Intelligent system, integration of
reality and virtuality
1970s Now18th
century
20th
century
Late Early
Machinery
manufacturing
equipment driven by
steam emerged
1st
Industrial Revolution
Mass production
driven by electricity
based on division of
labor emerged
2nd
Industrial Revolution
Electronic and IT
technologies helped to achieve
further automatization of
manufacturing process
3rd
Industrial Revolution
Cyber Physical System
4th
Industrial Revolution
Development of Industry

16. Information Production Labor Management Services
• On-site management: it is
hard to surveil
construction operation
with too many blind spots
• Staff management:
decentralized,
complicated working
environment, and it is
hard to record and surveil
construction operation
• Information management:
lack of the combination of
the back-stage historical
data and the real-time
work on the front site, the
non-realtime working data
on the first scene
• The combination of the
first scene and the back-
stage supporting system
• The exhibition modes of
the industrial products are
too simple; the creative
exhibition modes according
to visitors with different
backgrounds should be
explicit, instant, flexible,
and fantastic
• The sales and technology
brochures are too simple
(the stereoscopic
communication of all-round
sound, light, and electricity)
• The promotion of products
is hard to be visualized and
close to people
• Data are hard to get in
on-site operation (first-
hand construction
materials)
• The information-
collecting method of
electronic MIS system is
inefficient (afterwards
entry)
• The data system is hard
to interact in real time on
site (without efficient
information to support)
• In multi-task processing,
unsynchronized
information causes low
efficiency
• The technology and
maintenance staff are limited
(in quantity, region, etc.)
• The capacities of the
technology and maintenance
staff are unbalanced (in the
master of core technologies
and business experiences)
• The different levels of the
professionalization of the
technology and maintenance
staff (each one has his
strong points, specializing in
different aspects) result in
the uneven cost-efficiency
• The passing of the
experience of the technology
and maintenance staff is
insufficient
• The visualization of
working instruction is
poor
• The operation of
working instruction is
inconvenient
• The unified
management of on-site
working leaders is hard
• The information of the
on-site workers is not
synchronized
• For difficulties and
problems, the real-time
surveillance and
analysis capacities in
production process are
weak
Quality, Efficiency, Cost, Customer Satisfaction
On-site Industrial Services

17. AR advantages: for Made in China 2025
Free Hands Real-time
Information
3D
Augmentation
Remote
Collaboration
Intelligent AR glasses
support sound/gesture
recognition
Image recognition
Object recognition
Face detection alignment
Big data
AR recognition and rendering engine
Space recognition perception (SLAM)
Scenario recognition and reconstruction
SAAS AR Cloud
High quality audio and video
transmission technology
Remote expert collaboration
system
• AR provides a new way, combining the physical machine equipment with the information in the forms of model, graph and text, to overturn the status quo that the
information and the actual operation come apart and could not correspond exactly;
• AR system could push training to the production line, and make the working scenario systematized, digitalized, and informationized, facilitating staff management
and data management;
• Augmentation of the current environment/system is far better than replace, and AR is playing a role in augmenting the current intelligent manufacturing system to
become one of the core technologies in Made in China 2025.

18. AR智能制造
Operation Training
Working Guide
Inspection and Maintenance
Remote Collaboration
AR
Intelligent
Manufacturing

19. HiScene for AR

21. Industrial Solutions of HISCENE AR
HiAR Industry
Applied in: energy (power/oil) industry, mechanical equipment
manufacturing industry, aerospace industry, aeronautics industry,
military industry, auto industry, etc.

22. Scenario Recognition and
Reconstruction
3D Recognition and Tracing
Application Engine
2D Recognition and Tracing
Application Engine
Environmental Perception
Real-time Space Perception
(SLAM)
Algorithm
Base
Structural
Database
Knowledg
e Base
Data Transmission
Signaling
Control
AR
Communication
Cloud
Platform
AREditor
Remote Collaboration
System (HiLeia)
Gesture Interaction
Module
Sound Interaction
Module
User Interaction
Physical Touch
Interaction
Capture, storage, processing, and personalized push of data
On-site Work
Force
Basic
Services
Data processing center
3D Rendering Engine
Registration of Reality
and Virtuality
Integration of
Reality and Virtuality
Information Integration
MES/MIS
System
Information
HiAR Industry Application System
Double engines of Terminal + Cloud,
with complete closed loop
Remote
Experts
User Data

23. HiAR Glasses: First Binocular Intelligent AR Glasses in China
Open API
Open voice, gesture, SLAM and
other interfaces to build an AR
ecosystem together.
Natural Interaction
It integrates various natural
interactions including voice,
gesture, head pose tracking,
physical touch, etc.
Perfect Compatibility
It can adapt native Android
applications easily and meet different
development needs.
Simplest and Best
The all-in-one simplified industrial
design frees hands perfectly.
Ingenuity, quality and beauty.
Top-notch Configurations
The first usage of Qualcomm®
Snapdragon™ 820 processor in the
world, with low power consumption
and high performance, brings
pleasant AR experience with high
immersion.
Best Visual Effects
It adopts free curved optical waveguide
projection system, with wide-angle and
lightweight, equipped with 720P 1000nit
Standard Definition Highlight OLED Micro
Display, with triple brightness, and better
visual effect.
AR OS
The built-in self-developed AR
engine and 3D rendering engine
have overall upgrading oriented
towards AR, optimizing 3D visual
experience continuously as well as
gaining real perception of the world.

24. PART PARAMETER
Body
Integrated Aluminum-Magnesium alloy structure, metal texture,
the whole all-in-one machine weighs only 285g
Optical System
Shade lens (antireflection shade lens could adapt to the outdoor
environment)
Optical display lens (freeform optical surface waveguide, wide
field, thin and light)
Slot for myopia lens (myopia lens could be customized)
Display Screen Use Sony OLED, with the resolution of 1280*960
Cameras
One depth camera module and one RGB visual engine camera
(used for environment scanning and picture-taking,
photographing, etc.)
Processor
Equipped with Qualcomm Snapdragon 820 mobile processor
with the best performance in the world
Storage 4GB of RAM, 64GB of storage
Acoustic Design
Dual speakers, dual analog microphones, stereo surround, noise
reduction, natural blend sound texture
Operating System
Use the operating system with depth optimization, HiAR OS of
HISCENE based on Android 6.0
Endurance
9 hours of normal use, over 48 hours of standby time, deep
sleep mode, ultra-long standby time
Product Parameters

25. SAAS Cloud Platform
Basic Cloud Service Facility Service
Storage Computing Web
AR Application Service
2D
Recognition
3D
Recognition
Editor Rendering
Remote
Assistance
Application
Management
Content
Management
Data
Analysis
Application Development Tool
SDK AR Plug-in API
Software is service:
enterprise-level industry application
• Exhibition: wonderland application
• Manufacturing: Hedy remote assistance application
• H5 application: H5 marketing applications like photo wall
Platform is service:
standard and stable platform service suite
• HiAR SDK: integrating the functions of recognition,
rendering, etc.
• HiAR plug-in: mobile application plug-ins of recognition
and rendering
• Cloud API: cloud recognition

26. APPLICATIONS

27. Inspection and Maintenance

29. 29
Workforce Training

30. Demo and Marketing

31. Interactive Learning

32. 32
Operation Guidance

33. Operation is training, without the need for “experienced staff”
Visualization, scenario, and interactive information facilitate guide
Remote expert collaboration system offers customized assistance
Experiences and skills are recorded in details and would be shared completely
Assembling a plane’s wing comprising of 30 parts takes 50 steps. AR helps to reduce the learning time of the
trained staff by 35%, and increase the training success rate of staff without basis by 90%.
—— The Boeing Company
Training is more intelligent; a green hand could also be
professional.
Operation Training

34. Theory
Classes
On-site Guide of
Masters/
Technicians
Drilling On-site Work
Theory Classes On-site Work
Information
Storage
HR
√×
Information
Storage
Ordinary
Training
AR Training
AR transforms training masters from “experts” into powerful
internet information system
Masters
The sharing of experiences
and skills is optimized
Data

35. Standardization of inspection process
Multi tasks are dealt with quickly at the same time
Visualization of equipment operation and inspection data
Interconnection of MIS system, alarms of fault prevention
Record the process in real time; trace the source of accountability
Replacing the traditional methods of 2D drawings and object comparison with AR to examine the ships at the
end of manufacturing process helps to reduce the inspection time from 36 hours to 90 minutes, improving the
efficiency by 96%.
—— Newport News Shipbuilding in the United States
Make the inspection and maintenance of equipment
could also be “processed with one click”
Inspection and Maintenance

36. Daily
Inspection
Fault
Maintenance
Quick
Preparation
of Inspection
On Site at
Any Time
1. Inspection (within plan)
2. Maintenance (out of plan)
Daily routine, according to steps
Simple problems: process directly &
contact experts with cellphone
Contact the experts of the equipment
provider to offer support on site: high
cost, low efficiency
Inspection Tasks
• Recognition technology
supports quick diagnosis of
equipment
• Check and feedback of real-
time data diagnosis
• Get MIS system through
• Use words, arrows, cartoons,
etc. to augment the physical
equipment
• Safety alarm
• Remote expert’s real-time
guide
• Support remote video and
question annotation
• Allow remote collaboration
AR Inspection Workflow
Data/Model
Data Service
System
Information Command
HiAR Glasses
Task 1 Task 2

37. Real-time information guide, standardized operation process
All-round visualization of 3D models, cartoons, graphical and textual data
Free hands to facilitate the use of information system
All-round safety warning secures the safe operation and production
HiAR Cloud and AR big data make supports more intelligent
The interconnection of IoT equipment integrates field and management fully
The application of AR glasses in assembling work helps to shorten the working time by 25%, reduce the error rate
by 50%, and increases the efficiency by 8%-12%.
—— General Electric Company
Wearable intelligent production brain
Working Guide

38. Traditional
methods
Auxiliary LED
system
Precast AR
content support
Remote real-time
guide
AR+AI
Guide development in real time
Now FuturePast

39. Intelligent interaction, free hands, act freely
With the super-definition communication on screen in the first perspective,
you would have an immersed sense
The synchronized transmission of high-definition radio and video is stable and reliable
Frozen screen transmission without delay, AR real-time annotation guide
Support privatized deployment; secure the safety of enterprise’s information
Cross-platform, multi-terminal access, 4G, WiFi internet support
The AR technology connects on-site engineers and experts, which helps to reduce the average time of engineers solving
problems by two hours, with the decreased demand for staff. What’s more, the speed of customers solving technical
problems by themselves is increased by 76%, and the degree of satisfaction grows to 95%.
—— Xerox
Experts are “on site” at any time.
Remote Collaboration

40. Worker Expert
Communication
Video in the
first perspective
Real-time guide
Model guide
Communication
Problem
annotation
Data sharing
Multi-person
collaboration
Mobile
equipment
support
Remote Collaboration System

41. Low power consumption, low latency, 720P high-
definition video on the mobile terminal, and the
synchronized transmission of high-fidelity voice message
secure the super-long clear call
Real-time
annotation
Privatized
deployment
Various interaction methods like natural gesture,
intelligent sound, head gesture tracking, and physical
touch integration
Time-saving and
energy-saving
Freeze the screen with one click; annotate the picture in
real time; experts point out the problems remotely to
achieve direct communication
Applied to different internet deployment demands to make
personalized internet deployment and to secure the safety
of enterprise’s information
What you see is what the video records, without the need
to adjust the video frame in the operation frequently
Characteristic human-computer
interaction technology: ICCV algorithm;
international top-notch team
Quick and
efficient
Adaptive rate control algorithm, FEC
algorithm of low-density parity-check
(LDPC) technology, quick packet loos
retransmission is realized
Deep learning and accumulation of
tracking technology based on computer
vision
Flexible
and safe
High-definition
radio and video
transmission
Free hands
First
Perspective
High-definition camera with 13 million
pixels, with freeform optical surface
waveguide system
Cloud services facing AR, the first
SAAS level cloud service platform
support in the industry
Stable and
reliable
Accurate and
straightforward
Product’s Features

42. And…
brand promotion and innovative product sales of industrial enterprises
Brand Sales

43. Straightforward and vivid
Various interaction methods
Multi-type terminal support
“AR Online Car Exhibition” supported by HISCENE has achieved the exposure of 0.414 billion in total in five
days, with the participants up to 10.80 million, ten times that of a traditional car exhibition. HISCENE has also
provided AR marketing and exhibition services to Vatti, Kohler, SAIC Motor, and other enterprises, and has all
achieved good results.
Industry marketing could also be creative.
Exhibition and Marketing

44. Offline Activity
Plan
In the mobile internet era, the only standard of the advertisement marketing in any industry
has been attracting people’s attention and arousing their purchasing desires. The products
and services like the world smallest SDK, HiAR plug-in, editor, AR browser, etc. enable your
advertisement advertising the “language” with the sense of the times instead of the high-
profile self-entertainment.
Professional and creative enterprise exhibition hall is definitely icing on the cake for branding
and sales of enterprises. And HISCENE’s AR sandbox, interactive screen, AR marketing and
other services enriches your exhibition hall more than the façade of your company.
In a new product release conference, AR could not only promote activity ideas, but also
make the product endorse itself, helping the customers understand the functions and
advantages of the professional equipment easily just as they understand those of FMCG,
finally to achieve the goal of the new product “blooming” the market.
In exhibitions and other activities, cold professional industry equipment keeps people away
naturally, while with the multi-terminal presentation of AR glasses, interactive screen, iPAD,
cellphones, etc., the “AR exhibition” with various interaction methods is definitely a brilliant
attractor of audience, which increases the commercial conversion rate of offline activities.
AR instructions and AR related products permeate your marketing into every link of
after-sales services. That is, marketing goes wherever products go.
Marketing and Exhibition Plans of Industry AR
Conference Plan
Exhibition Hall
Plan
Advertisement
Marketing Plan
After-sales
Services Plan
“Audience attractor”
“Product endorses
itself”
“Standard equipment for
intelligent manufacturing
enterprises”
“Use 2C model to do
2B marketing”
“Product is
marketing”

45. CHALLENGES

47. Face Off

48. Out of View

49. Data! Data! Data!!!

50. OPPORTUNITIES

51. Environment
Equipment
Workforce
Cost
Government
support
Industry
recognition
Top players
ready to go
Innovations
rolling out fast

52. Accuracy
99？99.99？100？
Battery life
4hr？8hr？12hr？
Protection
IP54？IP67？
Comfort
500g？300g？50g？
Reliable, Available, Scalable

53. Hardware, Network, Contents
5G

54. Typical Cases in
Industrial Manufacturing

55. Hardware Supplier Recognition & Interaction Technology
& Artificial Intelligence
Industrial Cooperation Union
Industry Union: to build AR industry chain together
中国智能制造系统解决方
案供应商联盟

57. www.hiscene.com
Contact us：
086-400-775-2997
Shanghai | Beijing | Guangzhou | Kunming
The
Beginning!
business@hiscene.com