Overview
ISO/IEC 18181-3:2022 defines the conformance testing framework for the JPEG XL Image Coding System. It describes how to validate encoder and decoder implementations against the ISO/IEC 18181 series (JPEG XL) to ensure interoperability. The standard focuses on test methodology, test corpora structure, image-similarity criteria and pass/fail rules. Robustness and performance testing are explicitly outside its scope.
Key Topics and Requirements
- Test corpora structure
- Test cases are distributed as subdirectories containing a test.json, input.jxl, optional reference_image.npy / reference_preview.npy, reference.icc / original.icc, and sometimes reconstructed.jpeg.
- A provided conformance.py (and lcms2.py) demonstrates the test procedure implementation.
- NPY file format (subset)
- NPY files store sample arrays with dimensions (num_frames, height, width, num_channels) and little-endian IEEE-754 32-bit floats in raster order - a defined subset of NumPy’s format for reference images.
- Image similarity criteria
- Decoded images are compared in the color space specified by reference.icc (nominal [0,1] range).
- Three conditions for similarity: identical dimensions/frames/channels; per-sample peak error ≤ specified threshold; per-channel RMS error ≤ specified threshold. No clipping of out-of-range values is applied.
- Conformance per test case (JSON-driven)
- The JSON test descriptor controls thresholds and per-frame metadata checks (duration, name, timecode, intensity target, extra channel types, bit-depth fields). Discrepancies lead to non-conformance.
- Encoder and decoder test procedures
- Encoder conformance is proven when a reference decoder can fully decode the encoder’s codestreams across intended parameter ranges and image types.
- Decoder conformance levels are determined by passing all testcases listed in provided manifest files (e.g., main_level5.txt, main_level10.txt).
Applications and Who Uses It
- Software developers implementing JPEG XL encoders or decoders - for validating correctness and interoperability.
- Test labs and QA teams - for automated conformance suites and regression testing.
- Library and platform integrators - to ensure compliant media pipelines and consistent rendering across devices.
- Standards bodies and vendors - for certification and interoperability testing.
Related Standards
- ISO/IEC 18181-1: JPEG XL Core Coding System (referenced normative document)
- ISO/IEC 18181-2: JPEG XL reconstruction of JPEG bitstreams (reconstructed JPEG handling referenced)
Keywords: JPEG XL conformance testing, ISO/IEC 18181-3, encoder conformance, decoder conformance, test corpora, NPY reference images, ICC color profile, RMS error, peak error.
Open preview (PDF)Information technology — JPEG XL Image Coding System — Part 3: Conformance testing
