The marketing name is "hand tracking" or "bare-hand control"; the filing name is hand pose estimation. Magic Leap's granted patent US11775836B2, issued October 3, 2023, claims estimating a hand's pose — the full articulated arrangement of fingers and joints — from camera images using deep neural networks. Its CPC tags pair gesture-input (G06F 3/017) and hand-recognition (G06V 40/11) with neural-learning class G06N 3/084.
On the record, bare-hand control is the input modality that competes with controllers, and it lives or dies on pose estimation. The system has to infer a 3D hand skeleton from 2D camera views in real time, robust to lighting, occlusion (fingers hiding fingers), and motion. That inference is a deep-learning problem, which is why the claim sits at the intersection of computer vision and neural networks.
Why this is the harder path: controllers report their own position directly; hands must be reconstructed from the outside, with no sensors on them. Getting finger-level precision good enough to pinch, point, and type in mid-air without a controller is a substantial vision achievement, and the IP around it is correspondingly valuable.
Novel, or just renamed? Hand-pose estimation is an active research area with broad literature; the claim's interest is a specific deep-learning method suited to headset constraints. The field is old; the particular technique is the claimed work.
The strategic frame is that input is the headset platform moat, and the controller-versus-hands question is unsettled. Magic Leap — a pure-play AR company — holding strong hand-pose IP reflects a bet on bare-hand interaction as the natural endgame, a bet Meta and Apple also hedge.
Follow the filing, not the demo. When a headset lets you control it with your bare hands, the enabling work is hand-pose estimation like this 2023 grant — a deep-learning reconstruction of your fingers, dated and classified.