Definition: In AR and VR, jitter is small, fast and unwanted variation in the measured position or orientation of a tracked object. When a headset, controller or tablet does not move, motion tracking still gives slightly changing values. As a result, virtual content seems to shake.

English: Jitter, Tracking Jitter
German: Jitter, Tracking-Zittern

How It Works

Jitter occurs because each measurement contains noise. Typical causes are:

  • Sensor noise: Camera images, inertial sensors (IMU) and depth sensors never give exactly the same values.
  • Weak features: With optical tracking, smooth, reflective or single-color surfaces do not have distinct points. Poor light also increases the noise.
  • Occlusion and distance: When a marker or transmitter is partly covered or far away, the calculation becomes less accurate.
  • Processing load: Changing frame rates cause irregular updates.

Systems use filters to reduce jitter. Common filters are Kalman filters, which combine measurements with a motion model, and the adaptive 1€ filter, which smooths strongly for slow movements and weakly for fast ones. Each type of smoothing has a cost: it increases the delay (latency). Good tracking finds a balance between a steady image and a fast response.

Importance in Mechanical Engineering

  • AR overlays on real machines: When maintenance notes or part markers shake, it is difficult to see which screw or line they point to. For precise overlays, steady tracking is more important than very fast tracking.
  • Comfort in VR training: Unsteady images are tiring. Jitter and high latency can contribute to motion sickness, especially in longer sessions.
  • Operation with controllers: When the pointer ray shakes, it is difficult to select small parts in a design review. A study from Simon Fraser University shows that even small rotational and positional jitter decreases pointing performance in VR.
  • Trade show and presentation: In halls with changing light and many people, the risk increases. A test on site is worth it.

Frequently Asked Questions (FAQ)

Is jitter the same as drift?

No. Jitter is fast shaking around the correct position. Drift is a slow, increasing deviation, for example when a virtual object moves away over several minutes.

Can you remove jitter completely?

Not completely. Better sensors, good lighting, markers and filters can reduce it so much that it is no longer a problem.

How do you measure jitter?

Put the tracked device down so that it does not move, and record the position values. The spread of these values is the measure of the jitter.