The closeness of agreement between results of measurements of the same measurand carried out under changed conditions, such as different operators, instruments, locations, or time periods.
Reproducibility measures precision under varied conditions. While repeatability looks at consistency with everything held constant, reproducibility examines how well measurements agree when conditions change — different operators measuring the same part, the same measurement performed in different labs, or readings taken days or weeks apart. It captures the broader variability introduced by real-world factors.
Reproducibility is typically larger than repeatability because it includes additional sources of variation. In a Gage R&R study, the "second R" stands for reproducibility and specifically isolates the operator-to-operator variation. In interlaboratory comparisons, reproducibility quantifies the agreement between different laboratories measuring the same items using similar methods.
Understanding reproducibility is essential for calibration management because it reveals whether measurement results are reliable beyond a single controlled scenario. If an instrument shows good repeatability but poor reproducibility, the measurements depend heavily on who is performing them or the specific conditions in use. This insight drives decisions about operator training, environmental controls, and standardization of measurement procedures. ISO 17025 requires laboratories to participate in proficiency testing programs, which are fundamentally assessments of interlaboratory reproducibility.
In aerospace calibration labs, reproducibility is critical when validating torque wrenches used in aircraft assembly. When the same 100 Nm torque wrench is calibrated by different technicians using different primary standards (hydraulic vs. deadweight systems) at various times, results must agree within specified tolerances—typically ±2% for aerospace applications. A defense contractor's pressure calibration lab demonstrates reproducibility when their 10,000 PSI pressure transducers show consistent results whether calibrated on Monday morning by Tech A using Fluke 6270A or Friday afternoon by Tech B using DH PPC4. Medical device manufacturers face similar challenges with infusion pump flow calibrations—a 50 mL/hr setting must read consistently whether tested by different operators using gravimetric or volumetric methods. Poor reproducibility often surfaces during proficiency testing or audit findings, such as when two technicians calibrating identical digital multimeters at 10.000 VDC show disagreement exceeding the stated uncertainty. This typically indicates inadequate operator training, environmental controls, or reference standard drift, leading to suspended accreditation or customer qualification failures.
ISO/IEC 17025:2017 addresses reproducibility in Section 7.7.1 regarding measurement uncertainty and Section 7.2.1.1(f) for method validation requirements. The standard mandates labs demonstrate measurement reproducibility through interlaboratory comparisons and proficiency testing per Section 7.7.3. ISO 13485:2016 Section 7.6 requires medical device manufacturers prove measurement reproducibility for process validation. AS9100D Section 7.1.5.2.1 demands aerospace suppliers establish measurement system repeatability and reproducibility studies. ANSI/NCSL Z540.3-2006 Section 5.4.6.2 requires uncertainty budgets include reproducibility components. GUM (ISO/IEC Guide 98-3) Section 3.2.4 defines reproducibility conditions and Section 4.2.4 addresses Type A uncertainty evaluation from reproducibility studies. IATF 16949:2016 Section 7.1.5.3.1 mandates measurement system analysis including reproducibility verification. Auditors specifically examine: reproducibility data from multiple operators/instruments, statistical analysis methods, uncertainty calculations incorporating reproducibility components, and corrective actions when reproducibility limits are exceeded.
CalibrationOS captures reproducibility data through its Multi-Operator Validation module, automatically tracking when different technicians calibrate identical instruments under varying conditions. The system records operator ID, environmental conditions, reference standards used, and timestamps for each measurement series. Statistical analysis tools calculate reproducibility coefficients and generate control charts showing measurement agreement across operators, locations, and time periods. The Uncertainty Calculator module incorporates reproducibility components into expanded uncertainty calculations per GUM requirements. Audit Trail reports demonstrate reproducibility compliance by showing measurement consistency data, with automated alerts when reproducibility limits exceed acceptance criteria. Certificate generation includes reproducibility statements when required by specific standards. The Proficiency Testing module manages interlaboratory comparisons, automatically calculating En ratios and z-scores to verify reproducibility performance against peer laboratories, providing auditors with clear evidence of reproducibility validation.
Reproducibility is the variation in measurement results when conditions change, such as different operators, instruments, or time periods. It captures the broader real-world variability of a measurement system.
Repeatability measures variation under identical conditions (same operator, instrument, short time), while reproducibility measures variation when conditions change (different operators, instruments, or environments).
This article is licensed CC BY-SA 4.0. Share, adapt, and reuse with attribution to calibrationos.com/glossary/reproducibility.
Industry benchmarks, best practices, and calibration tips — delivered to your inbox.
AIAG average and range method — enter your measurement data and get %GRR, NDC, and pass/fail in seconds.
Open the Calculator