headtracking Version française

Webcam or Kinect?

Every camera works with headtracking. The best value is a second-hand Kinect v2, but a webcam you already own costs nothing, and the automatic calibration gives it real 3D too.

CameraTracks onHead distanceMinimum distance
Kinect v2 (Xbox One)Infrared: the sensor lights the scene itselfMeasured by the depth sensorAbout 0.5 m (hardware limit)
Kinect v1 (Xbox 360)Colour to find the cabinet, then infrared for trackingMeasured by the depth sensorAbout 0.8 m (hardware limit)
WebcamColour imageWorked out from your shoulder widthAbout 0.4 to 0.5 m: head and shoulders must fit in the picture; a wide-angle lens lowers it

Kinect v2 (Xbox One): the sweet spot

Kinect v2 (Xbox One) sensor bar
Kinect v2 (Xbox One).
The Kinect v2 uses a lot of USB bandwidth. It sends colour (1920×1080 at 30 images per second), infrared and depth (512×424 at 30 images per second, uncompressed) and its four microphones, all at once. That is close to filling a USB 3.0 link on its own. Before blaming the camera or the adapter, make sure it is on a dedicated USB 3.0 root port: no hub, no front-panel port, no cheap extension cable.

Kinect v1 (Xbox 360)

Even cheaper and field-tested too. Its resolution is lower, but it is perfectly usable: it uses colour to find the cabinet, then tracks in infrared with its depth sensor. Its minimum distance of about 0.8 m can be a problem on small cabinets.

Webcam

A plain webcam works: the calibration from the lockbar and rails recovers its focal length, and the distance of your head comes from your shoulder width. It tracks on the colour image, so a dark game room is harder for it than for a Kinect. Head and shoulders must fit in the picture.

Mounting

A Kinect for Xbox 360, a Kinect for Xbox One and a small webcam on top of a pinball backbox
Cameras on top of the backbox of a real pincab: Kinect v1, Kinect v2 and a webcam.

Minicabs and small cabinets

Head tracking works on a minicab, but the short distance between the player and the camera decides everything.

More details: docs/MINICAB.md.