Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cloud-Backed Mixed Reality with HoloLens & Azure Cognitive Services

1,718 views

Published on

In a modern world of cloud computing and virtual reality experiences, see how Mixed Reality from Microsoft intersects with the real world while connected to various cloud services in Azure. Learn how you can get started with HoloLens and the all-new Windows Mixed Reality immersive headsets, while leveraging reusable skills in C#, Visual Studio, Azure, and Cognitive Services.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Cloud-Backed Mixed Reality with HoloLens & Azure Cognitive Services

  1. 1. http://linkedin.com/in/shahedc http://www.meetup.com/DC-MS-Devs http://twitter.com/shahedC http://WakeUpAndCode.com
  2. 2. https://www.youtube.com/watch?v=aThCr0PsyuA
  3. 3. What is HoloLens?
  4. 4. Augmented Reality Mixed Reality Virtual Reality Augments the real world with helpful information Blends holograms with your real world Can transport you to a virtual world Replaces the real world
  5. 5. https://developer.microsoft.com/en-us/windows/mixed-reality/spectator_view
  6. 6. HoloLens: Dev Edition vs Commercial Suite http://hololens.com/buy
  7. 7. Windows Mixed Reality: More Devices! https://aka.ms/windows-mixed-reality
  8. 8. Getting Started Tools and Documentation
  9. 9. Start Here for Guides, Docs, Community https://developer.microsoft.com/en-us/windows/mixed-reality
  10. 10. https://developer.microsoft.com/en-us/windows/mixed-reality/install_the_tools Install the Tools: HoloLens
  11. 11. Things to Know • Gaze • Gesture • Voice • 3D vs 2D
  12. 12. Gaze https://developer.microsoft.com/en-US/windows/mixed-reality/gaze
  13. 13. Gestures https://developer.microsoft.com/en-US/windows/mixed-reality/gestures
  14. 14. Voice Input https://developer.microsoft.com/en-US/windows/mixed-reality/voice_input
  15. 15. Shahed Chowdhuri, Sr. Technical Evangelist @ Microsoft Commercial Software Engineering
  16. 16. Shahed Chowdhuri, Sr. Technical Evangelist @ Microsoft Commercial Software Engineering
  17. 17. Capture Image via HoloLens /// <summary> /// Begin process of Image Capturing and send To Azure Computer Vision service. /// </summary> private void ExecuteImageCaptureAndAnalysis() { // Set the camera resolution to be the highest possible Resolution cameraResolution = PhotoCapture.SupportedResolutions.OrderByDescending ((res) => res.width * res.height).First(); Texture2D targetTexture = new Texture2D(cameraResolution.width, cameraResolution.height); // Begin capture process, set the image format PhotoCapture.CreateAsync(false, delegate (PhotoCapture captureObject) { photoCaptureObject = captureObject; CameraParameters c = new CameraParameters(); c.hologramOpacity = 0.0f; c.cameraResolutionWidth = targetTexture.width; c.cameraResolutionHeight = targetTexture.height; c.pixelFormat = CapturePixelFormat.BGRA32; // Capture the image from the camera and save it in the App internal folder captureObject.StartPhotoModeAsync(c, delegate (PhotoCapture.PhotoCaptureResult result) { string filename = string.Format(@"CapturedImage{0}.jpg", tapsCount); string filePath = Path.Combine(Application.persistentDataPath, filename); VisionManager.instance.imagePath = filePath; photoCaptureObject.TakePhotoAsync (filePath, PhotoCaptureFileOutputFormat.JPG, OnCapturedPhotoToDisk); }); }); }
  18. 18. Prepare & send request to Azure…
  19. 19. … receive and process response!
  20. 20. Email: shchowd@microsoft.com  Twitter: @shahedC

×