Download as PDF, PPTX
Uploaded byMarius Preda PhD
Point Cloud Compression in MPEG
The document discusses point cloud compression presented at the MPEG MP20 workshop in Hong Kong in October 2017. It outlines the importance of point clouds in 3D graphics and the need for compression technologies, detailing MPEG's initiatives and proposals for improving efficiency. The main conclusion is that integrating 2D and 3D compression methods can enhance point cloud compression and promote the development of immersive experiences.
Point Cloud Compression in MPEG
- 1. Point Cloud Compression inMPEG MP20 Workshop Hong-Kong October 2017 Institut MINES TELECOM, FRANCE Marius PREDA MPEG 3D Graphics Chair
- 2. What a PointCloud is and why we should care about? PX vs PC Visual synthesis Visual capture
- 3. PX vs PC HD,Full HD, 4K, 8K LDR, HDR Multi-camera Stereoscopy Visual synthesis Visual capture What a Point Cloud is and why we should care about?
- 4. PX vs PC Geometric primitives Visual synthesis Visual capture Whata Point Cloud is and why we should care about?
- 5. PX vs PC Geometric primitivesHD,Full HD, 4K, 8K LDR, HDR Stereoscopy Multi-camera Visual synthesis Visual capture What a Point Cloud is and why we should care about?
- 6. PX vs PC PointCloud – a convergence between 2 worlds Visual synthesis Visual capture What a Point Cloud is and why we should care about?
- 7. Point Cloud PX vsPC ¢ A set of 3D points • not ordered, • without relations between them ¢ Each point is defined by • (X, Y, Z) • (R, V, B) or (Y, U, V) • reflectance, transparency, …
- 8.
- 9. PC PX vs PC 800,000points -> 1 000 Mbps (uncompressed) Compression is required in order to make PC useful
- 10. Point Cloud Compression ¢ MPEG initiated the work on PCC in 2014 ¢ In April 2017 MPEG issued a Call for Proposals on PCC PX vs PC
- 11.
- 12. Point Cloud PX vsPC 360° background 3D objects free-‐view path
- 13.
- 14. Point Cloud Compression ¢ MPEG initiated the work on PCC in 2014 ¢ In April 2017 MPEG issued a Call for Proposals on PCC ¢ Nine technology leading companies responded and MPEG evaluated them in October 2017 (during Macao meeting) PX vs PC
- 15. Point Cloud Compression 0 2 4 6 8 10 1 2 3 4 5 6 7 8 9 10 11 12 13 14
- 16. Main outcome ¢ Decompositionof PC into 2D patches
- 17. Main outcome ¢ Decompositionof PC into 2D patches Decomposition into patches Geometry video frame(s) Color video frame(s) Video encoding Video encoding MUX Input point cloud Occupancy map Bitstream Packing OMap encoding Motion field video frames Video encoding Auxiliary patch- info compression
- 18. Main outcome ¢ Decompositionof PC into 2D patches Decomposition into patches Geometry video frame(s) Color video frame(s) Video encoding Video encoding MUX Input point cloud Occupancy map Bitstream Packing OMap encoding Motion field video frames Video encoding Auxiliary patch- info compression 8-16% PCC = 3 VC + DELTA DELTA is between 10% and 20% 2-4% Video encoder
- 19. MPEG PCC v0 PXvs PC 800,000 points -> 1 000 Mbps (uncompressed) 800,000 points -> 8 Mbps (MPEG PCC 2017)
- 20. Conclusion ¢ State-of-the-art pointcloud compression can be significantly improved by leveraging decades of 2D video coding technology development ¢ By combining 2D and 3D compression technologies, PCC provides synergies with existing hardware and software infrastructure for rapid deployment of new immersive experiences ¢ MPEG PCC is a solid basis for the next few decades in 3D graphics compression
- 21. Conclusion ¢ We areat the beginning of a new era when humanity will re-gain its third dimension!
- 22. Disclaimer ¢ Several picturesand videos used in this presentation are provided by 8i (https://8i.com/)