d833feb53a86ca82.tex
1: \begin{abstract}
2:     We present a convolutional neural network (CNN) based solution for
3:     modeling physically plausible spatially varying surface
4:     reflectance functions (SVBRDF) from a single photograph of a
5:     planar material sample under unknown natural
6:     illumination. Gathering a sufficiently large set of labeled
7:     training pairs consisting of photographs of SVBRDF samples and
8:     corresponding reflectance parameters, is a difficult and arduous
9:     process.  To reduce the amount of required labeled training data,
10:     we propose to leverage the appearance information embedded in
11:     unlabeled images of spatially varying materials to self-augment
12:     the training process. Starting from an initial approximative
13:     network obtained from a small set of labeled training pairs, we
14:     estimate provisional model parameters for each unlabeled training
15:     exemplar. Given this provisional reflectance estimate, we then
16:     synthesize a novel temporary \emph{labeled} training pair by
17:     rendering the exact corresponding image under a new lighting
18:     condition. After refining the network using these additional
19:     training samples, we re-estimate the provisional model parameters
20:     for the unlabeled data and repeat the self-augmentation process
21:     until convergence.  We demonstrate the efficacy of the proposed
22:     network structure on spatially varying wood, metals, and plastics,
23:     as well as thoroughly validate the effectiveness of the
24:     self-augmentation training process.
25:     
26: \end{abstract}