Recommended
More Related Content
Similar to Minecraft Mixed reality implementation approach without green screen
Similar to Minecraft Mixed reality implementation approach without green screen (20)
Recently uploaded
Recently uploaded (20)
Minecraft Mixed reality implementation approach without green screen
- 2. For XR Only see it for yourself Only see it for yourself VR AR MR For everybody with perceive
- 3. For XR MR For everybody with interaction Only see it for yourself Only see it for yourself VR AR = +
- 4. Demo Video
- 5. Beat saber (Rhythm and reflexes) Audio shield (Color Perception) Difficulty in exporting data, Cannot customize content
- 6. My Framework HTC Vive Pro Kinect V2 Minecraft Java edition
- 7. Demo Video
- 8. HTC Vive Pro
- 9. HTC Vive Pro
- 10. Kinect V2 Without Green Screen
- 12. Kinect V2 Normal camera Kinect depth camera → With Kinect V2 SDK →
- 13. Minecraft
- 14. Minecraft Modify As a VR Engine
- 15. Minecraft Modify It has a lot of properties that can be used for research
- 16. MR Video Fusion
- 17. MR Video Fusion Normal camera Kinect depth camera Kinect depth camera with filter
- 18. MR Video Fusion
- 19. MR Video Fusion MR layerbackground layer Foreground UI layer
- 20. MR Video Fusion Open Broadcaster Software
- 21. Research Example
- 22. Research Example March on the spot March on the spot Just lift your leg gently
- 23. Elderly Rehabilitation Exercise Need to move but worry about falling
- 24. Research Example March on the spot Just lift your leg gently Increase your confidence through exercise Even if you're not moving
Editor's Notes
- Hello everyone Today I will introduce a framework system for studying mixed reality
- As I mentioned in my last presentation, Xr is a concept not a technologic But it will guide us about how to improve existing technologies.
- So How Can I Do It Better?
- As Current科润特 vr and ar devices The interaction and display are visible only to the user. Others are unable to engage and perceive泼系唔 the interaction.***** But mixed reality allows more people to perceive the digital virtual environment
- If we want to get mixed reality，****The easy way is to add vr and ar together. We can (in tui tive ly ) adjust the effect of vr and ar. Easy for us to observe and research
- So there is a demo video to show How can we see the VR environment
- Now we can easily convert VR games into mr videos. Observe the performance of users under VR.******** But a lot of in-game data can't be exported and doesn't fit into many research.
- But my framework Due to the features of the engine we can customize the content of the game and export the data at the same time This is the tool required for the overall framework composition
- So there is my framework demo video**** Pleases see it Use minecraft's powerful map editor We can build all kinds of experimental environments that we need
- The first is HTC vive, It can provide virtual reality environments
- It also provides real-time feedback to our users' action data
- in general We want to get a mixed reality effect, we need a green screen environment, , We can't adapt to every situation But I used Microsoft's Kinect ***** Thus did not need the green screen
- Kinect is a depth sensing camera*****
- He can separate the characters from the background in real time With sdk , We can easily achieve the green screen effect The problem with the pants is because of the special material My sweatpants will reflect some light impression capture effects
- Virtual reality software uses Minecraft Minecraft is written in java and is a popular game worldwide.*** There are even educational editions devoted to educational research that can be used by schools.**** It's also a powerful creative engine that can do a lot of things..**** Unfortunately the game itself is closed source software and cannot be directly modified into the engine we need
- But we can use a software called forge****** to rebuild the Minecraft. And we can got a lot of api****** Use those api, We can get a modified Minecraft***** As our virtual reality engine Called vivecraft
- Vivecraft has a lot of features We are free to modify it Get the data we want. Support multiple devices and multiplayer at the same time So that we can modify the variable conditions for research
- There is a demo for MR video fusion The first is normal camera
- Use Kinect with sdk we can got the depth camera witch green screen Use green filter we can got the User picture with transparent (Alpha Channel channel
- Use this picture as a layer*****
- Combine the background layer and foreground layer form vivecraft
- Import all layers into the rendering software called OBS****** Use obs to generate video in real time ***** or upload video to cloud broadcast to various screens Like Live Streaming
- So there is a research example with lai kecheng
- For example We can deply equipment to someone who March on the spot***** And get date form senser on she leg
- As we know When we doing Elderly Rehabilitation Exercise
- Use the Virtual reality environment You just lift your leg gently it will help you increase your confidence thorough virtual reality exercise Even if you re not moving