1: \begin{abstract}

2: Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks.

3: To mitigate this problem, we propose a novel setting, namely \emph{learning from complementary labels} for multi-class classification.

4: A complementary label specifies a class that a pattern does \emph{not} belong to.

5: Collecting complementary labels would be less laborious than collecting ordinary labels,

6: since users do not have to carefully choose the correct class from a long list of candidate classes.

7: However, complementary labels are less informative than ordinary labels

8: and thus a suitable approach is needed to better learn from them.

9: In this paper, we show that an \emph{unbiased estimator} to the \emph{classification risk}

10: can be obtained only from complementarily labeled data,

11: if a loss function satisfies a particular symmetric condition.

12: We derive \emph{estimation error bounds} for the proposed method and prove that the \emph{optimal parametric convergence rate} is achieved.

13: We further show that learning from complementary labels can be easily combined with \emph{learning from ordinary labels} (i.e., ordinary supervised learning),

14: providing a highly practical implementation of the proposed method.

15: Finally, we experimentally demonstrate the usefulness of the proposed methods.

16: \end{abstract}

17: