Overview
ISO/IEC 14598-6:2001 - "Software engineering - Product evaluation - Part 6: Documentation of evaluation modules" defines a standardized format and content for documenting an evaluation module. An evaluation module packages the evaluation technology (methods, techniques, inputs, data, tools and procedures) required to measure software quality characteristics within the context of the ISO/IEC 9126 and ISO/IEC 14598 multipart standards. The standard is intended for experts in evaluation technology - e.g., testing laboratories, research institutes, evaluators and QA groups - creating reusable, repeatable modules for software product evaluation.
Key Topics
- Evaluation module concept: a self-contained package that links evaluation techniques, metrics and measures to a specific software quality aspect.
- Documentation format (EM0–EM5, optional EMA):
- EM0: Foreword and introduction (rationale, relationship to other documents)
- EM1: Scope - characteristics, sub-characteristics, level of evaluation, techniques, applicability
- EM2: References
- EM3: Terms and definitions
- EM4: Inputs and metrics - required inputs, data elements, metrics and measures
- EM5: Interpretation of results - mapping measures to quality, reporting
- EMA (optional): Detailed application procedure, resources, evaluation instructions, documentation
- Requirements for conformance: documentation must follow the clause 6 format in the standard to be conformant.
- Support for repeatability and objectivity: standardized definitions and procedures help ensure evaluations are reproducible and comparable.
- Annex guidance and examples: informative annexes provide module development guidance and concrete examples (e.g., fault density, functionality, usability/quality in use).
Applications and Who Uses It
- Testing laboratories and research institutes developing new evaluation modules and metrics.
- Software evaluators and consultants applying consistent, documented techniques during product assessments.
- Developers, acquirers and QA teams who need standardized metrics and reporting for procurement, certification, or quality assurance.
- Organisations building libraries of evaluation modules to ensure consistent internal reuse and to catalog evaluation technology.
Practical uses include standardizing measurement procedures, supporting metric development, framing evaluation level and confidence, and creating repeatable test/reporting workflows.
Related Standards
- ISO/IEC 9126-1 (Product quality model) - referenced as the default quality model
- ISO/IEC 14598 parts 1–5 (Product evaluation processes: overview, planning, developer/acquirer/evaluator processes)
- ISO/IEC 12207 (Software life cycle processes) and related lifecycle standards
(See ISO/IEC 14598-6 for authoritative normative references and annex examples.)
Keywords: ISO/IEC 14598-6:2001, evaluation module, software product evaluation, ISO/IEC 9126, documentation of evaluation modules, metrics, testing laboratories, evaluation technology.
Open preview (PDF)Software engineering — Product evaluation — Part 6: Documentation of evaluation modules