Overview
ISO/IEC 23000-17:2018 - Multiple sensorial media application format (MSMAF) defines a multimedia file format for storing, interchanging, managing, editing and presenting multiple sensorial media (4D media) based on the ISO base media file format. The standard provides the overall file structure and metadata organization required to represent sensory effects (wind, vibration, scent, lighting, haptics, etc.) alongside traditional audio/video, enabling both offline (DVD, theatre) and online (IP-TV, streaming, MPEG-2 transport) services.
Key topics and technical requirements
- File structure and MSMAF boxes: Specifies boxes and their syntax/semantics (for example File Type, Sync Sample, Decoding Time to Sample, Sample Size boxes) that organize sensorial content within the ISO base media file format.
- Sensory Effect Metadata (SEM): Integrates SEM (as defined in ISO/IEC 23005-3) to describe effect properties and effect variables. SEM enables:
- Mapping of effects to target 4D devices (home servers, chairs, diffusers, lights).
- Control variables for device operation (e.g., intensity, duration, direction).
- Fragmentation and streaming: Uses XML streaming instructions (XSI, ISO/IEC 21000-7) to fragment SEM into process units, assign time information (processing timestamps), and mark random access points for streaming or editing.
- Fragmentation properties such as anchorElement and puMode (self, ancestors, descendants, etc.) are defined for robust SEM fragmentation and timed delivery.
- Encoding and packaging: Defines encoding process units and how multiple sensorial media are packaged to support editing, random access, and synchronized presentation.
- Supported components & metadata tables: Includes tables and examples that map SEM descriptors to device commands and show sample SEM XML fragments.
Practical applications and who uses it
- Content creators and studios producing 4D movies, immersive theatre, or theme-park experiences.
- System integrators and device manufacturers of haptic seats, scent diffusers, wind/air systems, LED lighting and other 4D actuators.
- Broadcasters, IPTV/OTT platforms and live-streaming services that deliver synchronized sensory effects.
- Middleware, server and player developers responsible for parsing SEM, mapping effects to hardware, and implementing fragmentation/streaming behavior.
- Researchers and standards experts working on multimedia interoperability and immersive media formats.
Related standards
ISO/IEC 23000-17:2018 is essential for teams building interoperable, time-synchronized multisensorial media workflows and devices, enabling reliable delivery of immersive 4D experiences.
Open preview (PDF)Information technology — Multimedia application format (MPEG-A) — Part 17: Multiple sensorial media application format