1: \begin{abstract}
2:
3: %% tcashman: 150 words
4: Realtime perceptual and interaction capabilities in mixed reality require a range of 3D tracking problems to be solved at low latency on resource-constrained hardware such as head-mounted devices.
5: Indeed, for devices such as HoloLens 2 where the CPU and GPU are left available for applications, multiple tracking subsystems are required to run on a continuous, real-time basis while sharing a single Digital Signal Processor.
6: %In order to solve model-fitting problems in this context,
7: To solve model-fitting problems for HoloLens 2 hand tracking, where the computational budget is approximately 100 times smaller than an iPhone 7, we introduce a new surface model: the `Phong surface'.
8: Using ideas from computer graphics, the Phong surface describes the same 3D shape as a triangulated mesh model, but with continuous surface normals which enable the use of lifting-based optimization, providing significant efficiency gains over ICP-based methods.
9: We show that Phong surfaces retain the convergence benefits of smoother surface models, while triangle meshes do not.
10:
11:
12: \keywords{model-fitting, optimization, hand tracking, pose estimation}
13: \end{abstract}
14: