1: \begin{abstract}
2: To efficiently adapt large models or to train generative models of neural representations, Hypernetworks have drawn interest.
3: While hypernetworks work well, training them is cumbersome, and often requires ground truth optimized weights for each sample.
4: However, obtaining each of these weights is a training problem of its own---one needs to train, e.g., adaptation weights or even an entire neural field for hypernetworks to regress to.
5: In this work, we propose a method to train hypernetworks, without the need for any per-sample ground truth.
6: Our key idea is to learn a Hypernetwork `Field' and estimate the entire trajectory of network weight training instead of simply its converged state.
7: In other words, we introduce an additional input to the Hypernetwork, the convergence state, which then makes it act as a neural field that models the entire convergence pathway of a task network.
8: A critical benefit in doing so is that the gradient of the estimated weights at any convergence state must then match the gradients of the original task---this constraint alone is sufficient to train the Hypernetwork Field.
9: We demonstrate the effectiveness of our method through the task of personalized image generation and 3D shape reconstruction from images and point clouds, demonstrating competitive results without any per-sample ground truth.
10: \end{abstract}
11: