Measurement Resolution and Gauge Selection
Resolution is the smallest displayed increment; it is not accuracy, repeatability or uncertainty. Gauge selection must consider the entire measurement process and the decision interval.
Technical publication review required before indexing · Draft reviewed 13 August 2026
Engineering workflow
- Start with tolerance and decision risk.
- Check actual repeatability and uncertainty, not display digits alone.
- Consider fixture, operator, environment and calibration.
- Validate the selected system with representative parts.
Worked example
A display resolving 0.1 µm does not prove 0.1 µm measurement uncertainty. Noise, master uncertainty, fixture variation and temperature may dominate.
Convert dimensional unitsLimitations and checks
- Rules of thumb such as 10:1 require context and may not be sufficient.
- Conformance decisions can require guard bands.
Relevant AccuTouch next step
Use the calculation as a screening input, then confirm the actual gauge, fixture, software or automation configuration.
Compare verified instrument specifications