Overview - ISO/IEC 14496-16:2011/Amd 2:2014 (Multi‑resolution 3D mesh compression)
ISO/IEC 14496-16:2011/Amd 2:2014 is an amendment to Part 16 (Animation Framework eXtension, AFX) that defines Multi‑Resolution 3D Mesh Coding (MR3DMC). The amendment specifies a progressive, coarse‑to‑fine bitstream format for compressing manifold triangular 3D meshes (IndexedFaceSet), supporting single or multiple attributes per vertex or per triangle. The MR3DMC stream is encapsulated in an AFX stream (AFX object code 0x0C) and is intended to improve rate‑distortion performance while enabling scalable delivery of 3D geometry and attributes.
Key technical topics and requirements
- Progressive compression & spatial/quality scalability
- Decoding proceeds from coarse to fine using multiple spatial LODs (levels of detail) and quality LODs for progressive refinement.
- Lossless connectivity coding
- Ability to retrieve original connectivity (subject to vertex/triangle permutation) when required.
- Near‑lossless geometry/attribute control
- Encoder parameters and quantization settings (QPforGeometry, QPforNormal, QPforColor, etc.) enable bounded reconstruction error.
- Bitstream structure
- Two main components: a detailed header (streamSize, simplificationMode, numberOfSpatialLODs, quantMin/quantRange arrays, numberOfConnectedComponents, etc.) and the data stream describing base mesh and LODs.
- Decoder modules defined
- Base mesh described via a TFANIndexDecoder; additional classes include SpatialLODDecoder, ConnectivityLODDecoder, QualityLODDecoder, QPLayerLODDecoder and BitPlaneDecoder.
- Attribute handling and transforms
- Support for normals, colors, texture coordinates and other attributes; BitPlaneDecoder and transformMode indicate strategies for coding attribute residuals.
Practical applications and typical users
- Who benefits
- 3D codec implementers, graphics middleware engineers, game engine developers, VR/AR and real‑time streaming platform architects, and CAD/visualization tool vendors.
- Use cases
- Streaming 3D assets over constrained networks with progressive refinement, adaptive rendering on devices with different GPU/CPU capabilities, efficient storage and transmission of complex triangular meshes with controlled quality loss, and integration into MPEG‑4/AFX animation pipelines.
Related standards and context
- Part of the ISO/IEC 14496 (MPEG‑4) family - specifically Part 16: Animation Framework eXtension (AFX). This amendment extends AFX with MR3DMC primitives and bitstream syntax for multi‑resolution mesh coding.
- Keywords: multi-resolution 3D mesh compression, MR3DMC, Animation Framework eXtension, AFX, IndexedFaceSet, spatial LOD, quality LOD, lossless connectivity coding, TFANIndexDecoder, quantization parameters.
Open preview (PDF)Information technology — Coding of audio-visual objects — Part 16: Animation Framework eXtension (AFX) — Amendment 2: Multi-resolution 3D mesh compression
