MPEG 3D graphics compression offer

1,196 views

Published on

I made this presentation in order to convince Web3D and Khronos folks that community and industry need one single standard for 3D graphics compression. It contains a list of MPEG-4 tools for graphics compression that are royalty free and for which open source software implementation exist. A JavaScript implementation of decoder and WebGL complaient MPEG-4 player is also introduced.

Published in: Technology, Art & Photos
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,196
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
20
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

MPEG 3D graphics compression offer

  1. 1. MPEG offer for 3D GraphicsCompressionWeb3D Conference, June 2013@San SebastienMarius PREDAInstitut MINES Telecom, FranceMPEG 3DG Chairman
  2. 2.  Hard problem Data heterogeneity Scene Geometry Attributes Animation Different Representation Methods Different Application Requirements3D Graphics Compression A good compression method is agnostic to the signal butexploits the signal nature3DG Comp: N dimensional problemImage and Video is easy, only color
  3. 3. MPEG 3DG TechnologiesMPEG-1/2(AV content)1992/4VRML1997• Part 11 - BIFS:-Binarisation of VRML-Extensions for streaming-Extensions for server command-Extensions for 2D graphics- Real time augmentation withaudio & video• Part 2 - Visual:- 3D Mesh compression- Face animation1998• Part 2 – Visual- Body animation1999MPEG-4 v.1MPEG-4 v.2First form of broadcast signal augmentation
  4. 4. MPEG 3DG TechnologiesMPEG-42003•AFX 2nd Edition:- Animation bymorphing- Multi-texturing2005• AFX 3rd Edition- WSS for terrainand cities- Frame basedanimation2007MPEG-4MPEG-4• Part 16 - AFX:- A rich set of 3Dgraphics tools- Compression ofgeometry,appearance,animation• AFX 4th Edition- Scalable complexitymesh coding2011MPEG-4A rich set of 3D Graphicsrepresentation andcompression tools
  5. 5. MPEG 3DG TechnologiesMPEG-42003•AFX 2nd Edition:- Animation bymorphing- Multi-texturing2005• AFX 3rd Edition- WSS for terrainand cities- Frame basedanimation2007MPEG-4MPEG-4• Part 16 - AFX:- A rich set of 3Dgraphics tools- Compression ofgeometry,appearance,animation• AFX 4th Edition- Scalable complexitymesh coding2011MPEG-42009• Part 25- Compression ofthird-party XML(X3D, COLLADA)MPEG-42004• Part 16- X3DInteractiveProfileMPEG-4
  6. 6. Today’s Topic : Royalty Free Static Geometry Compression: TFAN Animation and Animated Geometry Compression: BBA and FAMC Web 3D Graphics Coding Compression Benchmark PlatformFocus on 3D Object Compression
  7. 7.  Decompose a triangle mesh into a set oftriangle fans Encoder each triangle fan with a special codedepending on the configuration of itsneighborhood Arithmetically encode the TFAN codesTFans:1675,62937,2984 Low complexity: linear encoding/decoding complexity Handles directly (without stitching) arbitrary connectivity(manifold or not, oriented or not, with or without holes, any genus) Offers the possibility to preserve the Vertices Order(VO) and Triangles Order (TO)PrincipleAdvantagesTriangle FANConnectivity encoding
  8. 8. Triangle FANFrom K. Mammou, Phd Thesis 2008
  9. 9. Bone-base Animation - BBA GeometrySeamless mesh: shapes sharingthe same vertices list TextureImage Mapping on verticessub-set HierarchySkeleton layerMuscle layer Animation Parameters1D controllers: bones and musclesCourtesy of VRLab, EPFLCourtesy of IMT
  10. 10.  Widely supported by ATs Able to build and animate anykind of skeletonCourtesy of Televirtual Realistic and high qualityanimationBone-base Animation - BBA
  11. 11. Frame #nUncompressedBBABinary fileFrame PPredictionArithmeticcodingQuantizationFrame IArithmeticcodingQuantizationSegment #nUncompressedBBADCTBinary fileSegment PPredictionDC QSegment IHuffman codingDC QDC Coeff. AC Coeff.Huffman codingAC QBone-base Animation - BBA Two compression methods: frame-based and DCT-based 5-30 kbps
  12. 12. Frame-based Mesh Compression -FAMC What if no skeleton is defined, only animated meshes? FAMC: cluster the verticesand encode cluster animationparameters plus corrections
  13. 13. Frame-based Mesh Compression -FAMCLPCA : Linear PCAAWC : Anisotropic Wavelets Compression CPCA : Clustered PCATWC : Temporal Wavelet-based Compression
  14. 14. Compression benchmarking more than 10 000 objects ofvarious kinds distortion vs bitrate encoding and decoding time per object and global statistics
  15. 15. Compression benchmarking API to integrate third partycodecs
  16. 16. 3D Studio MaxMPEG-4 FileExportMP4toJS ExportMPEG Web3DG FormatJSONDescriptionTexture(JPEG)SC3DMC BBAWeb3DCoding ScriptsGraphicsCodecWebGLEngineBBADecoderJSON ParserSC3DMCDecoderglIndexedFaceSetMPEG Web3DGJSONDescriptionTexture(JPEG)SC3DMCBBA{"object" : {"name": "rabbit","shapes":[{"filename": "rabbit_0.s3d","transform": [1.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0,0.0,0.0, 0.0, 1.0, 0.0, 0.0, 0.0, 0.0,1.0],"materials":[{"texture": "rabbit_0_0.jpg"}],"animation":{"anm_filename": "rabbit_0.anm","bba_streams": [{"name": "rabbit_0_0.bba","fileName": "rabbit_0_0.bba"}]}}]}}Web 3D Graphics Coding
  17. 17. Web3DCoding ScriptsGraphicsCodecWebGLEngineBBADecoderJSON ParserSC3DMCDecoderglIndexedFaceSetMPEG Web3DGJSONDescriptionTexture(JPEG)SC3DMCBBA{"object" : {"name": "rabbit","shapes":[{"filename": "rabbit_0.s3d","transform": [1.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0,0.0,0.0, 0.0, 1.0, 0.0, 0.0, 0.0, 0.0,1.0],"materials":[{"texture": "rabbit_0_0.jpg"}],"animation":{"anm_filename": "rabbit_0.anm","bba_streams": [{"name": "rabbit_0_0.bba","fileName": "rabbit_0_0.bba"}]}}]}}AMD of MPEG-4 Part 16 JSON support for object graph light (textual) representation of bones hierarchy requirements for supporting GPU texture formatsWeb 3D Graphics Coding
  18. 18.  TFAN and BBA open source implementation 3DSMax to MPEG-4 (TFAN and BBA) open source exporter JS Implementation of TFAN and BBA decoders WebGL ImplementationOpen Resourceswww.MyMultimediaWorld.com : Software/OpenSource Tab
  19. 19.  The outside world is waiting us with a UNIQUE compressionsolution for A 3D Object Time to set the common base and work TOGETHER for acommon profile Many technologies are already available, time to do SELECTIONSConclusions

×