Recommended
Recommended
More Related Content
What's hot
What's hot (17)
Similar to Joakim Elvander (Sony): The Sony AR display, A Case Study.
Similar to Joakim Elvander (Sony): The Sony AR display, A Case Study. (20)
More from AugmentedWorldExpo
More from AugmentedWorldExpo (20)
Recently uploaded
Recently uploaded (20)
Joakim Elvander (Sony): The Sony AR display, A Case Study.
- 2. The Sony AR display: a case study Joakim Elvander Developer Advocate & Senior Partner Engineer Joakim.elvander@sony.com @devjelvander
- 5. AR IS THE 8TH MASS MEDIA Raimo van der Klein, Layar, 2009 Timo Ahonen, TEDx, 2012 1st mass media: Print (500 years old) including books, pamphlets, newspapers, magazines, billboards etc 2nd mass media: Recordings (from 1890s) such as music records, videogames, videotapes and DVDs etc 3rd mass media: Cinema (from 1910s) 4th mass media: Radio (from 1920s) 5th mass media: Television (from 1950s) 6th mass media: Internet (from 1991) 7th mass media: Mobile (from 1998)
- 7. © Sony
- 8. © Sony
- 9. © Sony
- 10. © Sony
- 12. © Sony
- 13. © Sony
- 14. © Sony
- 16. HIROSHI MUKAWA General Manager for Sony Integrated Solutions, and New Business Development, at Sony Semiconductor Solutions Corp.
- 17. AR DISPLAY MODULE LMX-001 The LMX-001 uses the same optical & display technology employed by SmartEyeglass SED-E1 SMARTEYEGLASS DEV. EDITION SED-E1
- 18. SMARTEYEGLASS USE CASES The LMX-001 uses the same augmented reality technology employed by SmartEyeglass, which has proven to be beneficial in a range of industries. LogisticsRemote guidance Production Real-time translation
- 19. CUSTOMIZED AR SOLUTIONS Slim profile: 1 mm Brightness: up to 2,000 nit Transmittance: > 85% The LMX-001 holographic waveguide display enables customized hardware and software AR development for use cases that require high precision and quality. *1.75 mm including protective plating
- 20. HOLOGRAPHIC WAVEGUIDE TECHNOLOGY The waveguide is a unique Sony technology that takes the light created in the optical engine and projects a virtual image through the holographic optical elements to the eyes of the wearer. Together with the protective plating, this technology enables more than 85% outside light transmittance, with lenses that are only 1.75 mm thin in total. LMX-001 is made up of two parts: the optical engine, which projects images and text using micro display (µDisplay) technology, and a holographic waveguide, an extremely thin transparent plate of glass measuring just 1mm.
- 21. PRODUCT LINEUP SmartEyeglass SED-E1 - For evaluation and testing Complete augmented reality glasses that comes with an SDK for host solution development for smartphones LMX-001 Development kit – For prototyping based on the reference design Development kit for Sony’s holographic waveguide display for customized HW and SW development of augmented reality solutions. LMX-001 - For production Including the optical display component and the driver chip.
- 22. LMX-001 • LMX-001 is the production kit for Sony’s holographic waveguide display. • This kit is a subset of the development kit and is optimized for serial production. • It includes the optical display component and the driver chip. Optical display component Driver chip <driver chip picture>
- 23. LMX-001 DEVELOPMENT KIT Development Kit • 3D model files of the display • Design guideline for comfortable viewing position • Bill of materials for the reference design • Controller circuit board design • Firmware source code • System block diagram • Hardware specification for display driver chip • Code samples for Android and Linux *Development license covers software and documents only *User agreements for OS license and compass sensor library are required *Purchase of compiler required Hardware • Monocular display • Controller puck All tools and components included to kick-start your development
- 24. Item Specification LMX-001 Monocular display Resolution 419 (H) × 138 (V) pixel Field of view Diagonal 20° (Horizontal 19° x Vertical 6°) Image color 8 bit monochrome green scale Brightness (max) 2,000 nit See-through transmittance More than 85% Eye relief 34.8 mm Eye-box size 9 mm (H) x 6 mm (V) Virtual image distance 8 m Dimension H: 23.0 x W: 90.1 x D: 26.6 mm Waveguide thickness 1.0 mm / 1.75 mm including protective plating Weight Approximately 10 g LMX-001 KEY SPECIFICATIONS
- 25. LMX-001 ANNOUNCED AT CES Sony’s new LMX-001 display allows companies to fully customize their AR solutions, Las Vegas (Jan 5-8, 2017) MORE THAN 1000 DEMO SESSIONS FOR LMX-001 CARRIED OUT EVERY DAY! News:
- 26. YAMAMOTO KOGAKU The best eyewear manufacture in Japan for both sports and industry segments.
- 28. ・Company profile ・Our products ・AR safety glasses
- 29. ・Company profile ・Our products ・AR safety glasses
- 31. Founded in 1911
- 34. ・Company profile ・Our products ・AR safety glasses
- 35. Safety Glasses
- 36. Safety Goggles
- 37. Ski Goggles
- 38. Swimming Goggles
- 39. Sunglasses
- 41. Optical Filter
- 42. ・Company profile ・Our products ・AR safety glasses
- 46. The glasses are adjustable at 3 different points for best comfort
- 47. Adjust the width You can adjust the width of the frames. 1
- 48. Flexible width setting of the temples The glasses use flexible temples to fit your face well. 2
- 49. The temples and ear-pieces can also be tilted You can tilt the temples and ear-pieces into five comfortable positions. 3
- 50. LMX-001 SN-770 Combine ＋ LMX-001 and SN-770.
- 52. Easy to remove LMX-001 can be removed from SN-770 easily.
- 53. A new way of working hands-free
- 54. For example in parts-picking operations Increase efficiency
- 55. Support a work process For example in engine assembly
- 56. TRY IT ON !!
- 57. THANK YOU FOR YOUR ATTENTION
Editor's Notes
- Hello! My name is Joakim Elvander, and I work as a developer advocate and partner engineer for Sony. Today we are going to talk briefly about the vision of the future we have at Sony, then about our current display targeting industrial use cases, and how a partner have integrated our display in their product. Many of the speakers at this excellent show, is talking about the state of AR today. For consumers, and for the industry.
- It is clear that the Hollywood impression of AR is affecting the demands and expectations of both consumers, and of the industry. These expectations are something that we have seen both becoming more down to earth, and getting closer to be realized, through more and more advanced products out there reaching for this futuristic vision.
- In the consumer space, very few, if anyone, would purchase a pair of AR or MR glasses for personal use today. They are bulky, have short battery life, and the suite of content that would motivate such a purchase is not quite there yet. But does that mean that the consumer space can be ignored for AR and MR? Of course not!
- In 2009, Raimo van der Klein from Layar named AR as being the 8th mass media, and this was further argued as being true by the mobile expert Tomi Ahonen in 2012. Back then, it was mostly AR implemented on mobile phones that gave them this glimpse of the potential of AR.
- Today, we can truly see that especially for wearable glasses, AR could completely disrupt and change many of the current media platforms. Just consider a currently imaginable pair of glasses (This is part is not a Sony promise!), with vastly superior processing power and better battery capacity than today, with a display technology that is able to come close to the spatial resolution of our own eyes. A Star Trek holodeck on your head basically. What could you do with it?
- Game developers and the entertainment industry of course already see many new ways of entertaining an audience, and that kind of consumer applications are already here, just consider Pokemon Go. But the big disruption would be how it really could replace almost any screen you have at work, in your home, or in your pocket today.
- For example, why would you use a smartphone with its small screen in the future, when you could have interactions (click) and information (click) in your entire field-of-view?
- At work, instead of being limited to one or more flat screens taking up desk space, you instead have almost all the screen real estate you want, while keeping your desk free to litter with other useful stuff :).
- If you want a bigger TV screen, or even a cinema screen, (click) why not just anchor a virtual one in your favorite place at home? Would that be worth 3000$ or more? It certainly would for me.
- The dystopic view of AR like the short film from the artist Keiichi Matsuda conveys, is hopefully not where we are heading. This is not what I think people would want to pay for, but of course there is the possibility, or risk, like on mobiles today, that advertising may be acceptable to get a cheaper price of the glasses or the applications running on them. But what do we in the industry do until technology has reached this disrupting level of advancement?
- At Sony we recognize that in B2B, companies are moving from curious but spurious discovery of the potential of AR and MR, to very tangible ROI gains from using this technology. And we see that the needs of various industries is what currently drives most of the requirements on glasses in the next few years, simply because where money can be saved, money can be earned. And for us manufacturers to reach the visions of tomorrow, we need to work on it today, and then of course the money needs to be made today : -)
- So what is the difference in fulfilling use-cases for the industry, compared to the consumer use-cases? Well, first of all, it’s not easy creating a single application fitting all industries in a field. They often need tailored solutions. This means a vertical development rather than horizontal. But this also in many cases makes it easier to create solutions with a high ROI, since they are specialized and narrower in scope. We have also seen that often, but not always of course, the industry needs more of the AR, and less of the MR. Why is that?
- The worker needs to see what he's doing, and he needs his hands free. So in many cases only the information needed right now needs to be displayed. Less is more, or otherwise you may distract the field worker, or the surgeon, or whatnot. Even though SLAM, deep neural networks and similar are probably crucial for consumer experiences in the future, I have seen when advicing customers that there are sometimes much easier and less costly solutions.
- For example, in Industrial IoT, you can use simple and cheap Bluetooth beacons to alert the glasses that you are close to a certain machine, and the glasses can then fetch the relevant information for displaying at that place and time. In the case of parts picking, you would hardly like to twist your head and body around to let the glass camera scan a barcode on a big box. Better to use a finger scanner and let an AR display show you the pick list or that you have scanned the wrong item. At Sony we believe that many of these verticals can be solved by creating simple and lightweight products that can easily fit under a hard hat for example. And that is where we think our LMX-001 display fits perfectly.
- I now have the pleasure of having our inventor and thought leader of our holographic waveguide display business with me here today, and I'm going to let him talk a bit about the display. After that we have the pleasure of having one of our display customers, Yamamoto Kogatu, with us to talk about how they are making use of our product. Please welcome Mr Hiroshi Mukawa-san, and thank you.
- 17
- There are several use cases using Sony SmartEyeglass such as Remote guidance, Production, logistics and real-time translation. We got a lot of feedbacks from customers for these two years and found out there are many customization requests in terms of frame design and system architecture specifications. But, at the same time, we thought it is difficult to satisfy all the customer requirements. As our core competence is a see-through eyewear display technology, we decided to provide our display modules to business customers outside of Sony who are willing to and able to make a final smartglass products using our display modules.
- 19
- This schematic shows the basic configuration of our display module. There are two parts. One is an optical engine, which consists of a LED, microdisplay and collimator. It is much the same as an electronic view finder. The other is a hologram waveguide, consists of simple glass plate and two holograms. (The operation principle is as follows.) The image light from a microdisplay goes through a collimator and enters the in-coupling hologram. The in-coupling hologram diffracts the light to satisfy total internal reflection within the glass plate. The light proceeds repeating TIR until it hits the out-coupling hologram. Then, the light is coupled out from the glass plate and projected onto user’s eye. By using holograms, we can make the light guide as thin as 1mm while keeping 19 degree horizontal FOV (because a hologram can deflect (steer) the light without inclining its reflection surface). Also, we can achieve very high see-through transparency because the hologram diffracts only the wavelength bandwidth of LED backlight. ------------------------------------------- Also, we can achieve very high see-through transparency because the hologram we are using is so called Volume hologram and it has very strong wavelength selectivity. And we designed the hologram to diffract only the wavelength bandwidth of LED backlight.
- Here is product lineup. We have tree products right now. Customers can evaluate their applications very quickly by using SmartEyeglass SED-E1, For prototyping glasses with new frame design, customers can use LMX-001 development kit which comes with display module and drive system used in SED-E1. For a final prototyping and volume production, LMX-001 would be enough.
- LMX-001 consists of a holographic waveguide display module and a display panel driver chip.
- Whereas, LMX-001 developer kit includes, Not only display module and controller but also all the design data such as…
- This is Display module specifications. FOV is 20 deg. diagonal. 2000nit brightness Eye relief is 35mm Eye box is 9 by 6 mm And weight is roughly 10grams
- We firstly announced LMX-001 AR eyewear display product at CES this year. There we demonstrated two prototypes. One is Motor bike helmet developed by Nolan. The other is safety goggle developed by Univet. Both companies are working hard to introduce their products into the market.
- Today we are vey happy to introduce our new partner YAMAMOTO KOGAKU who is the best eyewear manufacturer in Japan for sports segment known as SWANS brand and industry segment as well. Please welcome Yamamoto-san, a president of Yamamto Kogaku.
- Mukawa-san, thank you for introducing us as your new partner. Good morning everyone! Now, I would like to give you some background information on our company, YAMAMOTO KOGAKU.
- Today, I would like to introduce 3 topics, ‘company profile’, ‘our products’ and the new‘AR safety glasses’.
- First, let me talk about our company.
- Our head office is in Osaka which is the second largest city in Japan.
- Our company was established in 1911.
- Our business started from lens manufacturing.
- My great-grandfather founded our company and I am the fourth-generation CEO. We celebrated our 105th anniversary last year.
- Now, please let me introduce some of our main products.
- Our main products are industrial protective equipment including safety eyewear by “YAMAMOTO” brand and sporting goods represented by "SWANS" brand. Our protective eyewear is used by workers in many industries such as TOYOTA, KOMATSU, KAWASAKI and Sony.
- In addition, our goggles are particularly very popular among firefighters in Japan as shown in the picture. We support our customers by protecting their eyes. We try to provide the safer and more comfortable working environment for every working people through seeing things clearly.
- Our sporting goods brand, SWANS, has snow goggles.
- swimming goggles
- in addition to sports sunglasses. Currently, the top athletes are wearing our glasses and goggles in order to improve their performance in a variety of sports such as “golf”, “swimming” and “skiing”. Mr. Ryo Ishikawa, who is now trying hard to get in the tournament in US, also uses our sunglasses.
- We will support many players in 2020 Tokyo Olympics.
- We make various optical filters for eye protection such as “Polarization” , “photo chromatic” , “high contrast”. We have established light-controlling technologies of our own and we also make these filters in-house. So, we can customize the filters according to user's request.
- Let’s move on to the main topic, which is about our new product, AR safety glasses using Sony’s LMX-001’.
- This new product was developed through combining “LMX - 001” module by SONY and "SN - 770" safety eyewear by Yamamoto. Everybody is required to wear safety eyewear in manufacturing industry, and we expect that our AR safety glasses should be used in many key industries.
- This is the base product, SN-770 by Yamamoto. We use polycarbonate lens which has quite high impact resistance.
- This safety glasses are suitable for both women and men. In addition, they can wear this glasses over prescription glasses.
- This safety eyewear has three frame adjustment functions, so it is very easy to fit to your face.
- First, you can adjust the width of this glass.
- Then, the glass uses flexible temples material and it will fit to your face well.
- Lastly, you can tilt the temples into five different angles so that you can find the most comfortable position.
- I am glad that I could explain about good functions of SN-770. Ok, let’s combine LMX-001 and SN-770.
- Now, we have successfully combined them.
- LMX-001 can be removed from SN-770 easily. For example, a night shift worker and a day shift worker can share the same LMX-001 because it is so easy to remove and attach.
- The AR safety can make a new way of working, that is, totally hands-free, when you need instructions.
- There are various convenient methods of application at work. Here are two examples. The first one is that this product will increase efficiency at work. The picture shows how the new product can increase efficiency at picking operation. The glass will help you pick up the right product at the right location with such easiness because all necessary information is shown in the glass, just in front of your eyes.
- Another example is how the AR safety glasses support your work process. You can see your work process immediately in your glasses, so you can concentrate on your work even though both of your hands are busy. Also, customers can use customized application according to their use cases.
- Now, please come to Sony’s booth and try it on！ Experience the excellency of Japanese technology!
- Thank you for your attention.