1: \begin{abstract}
2: The minimization of the logistic loss is a popular approach to batch
3: supervised learning. Our paper starts from the surprising
4: observation that, when fitting linear (or kernelized) classifiers, the
5: minimization of the logistic loss is \textit{equivalent} to the
6: minimization of an exponential \textit{rado}-loss computed (i) over transformed data
7: that we call Rademacher observations (rados), and (ii) over the \textit{same} classifier as the one of
8: the logistic loss. Thus, a classifier learnt from rados can be \textit{directly} used to classify
9: \textit{observations}. We provide a learning algorithm over
10: rados with
11: boosting-compliant convergence rates on the \textit{logistic loss} (computed over
12: examples). Experiments on
13: domains with up to millions of examples, backed up by
14: theoretical arguments, display
15: that learning over a small set of random rados
16: can challenge the state of the art that learns over the
17: \textit{complete} set of examples. We show that rados comply with
18: various privacy requirements that make them good candidates for
19: machine learning in a privacy framework. We give several algebraic, geometric and
20: computational hardness results on reconstructing examples from
21: rados. We also show how it is possible to craft, and efficiently learn from,
22: rados in a differential privacy framework. Tests reveal that
23: learning from differentially private rados can compete with learning from
24: random rados, and hence with batch learning from examples,
25: achieving non-trivial privacy vs accuracy tradeoffs.
26: \end{abstract}