1: \begin{abstract}

2: 		We initiate the study of locally differentially private (LDP) learning with public features. 

3: 		We define semi-feature LDP, where some features are publicly available while the remaining ones, along with the label, require protection under local differential privacy.

4: 		Under semi-feature LDP, we demonstrate that the mini-max convergence rate for non-parametric regression is significantly reduced compared to that of classical LDP.

5: 		Then we propose \texttt{HistOfTree}, an estimator that fully leverages the information contained in both public and private features. 

6: 		Theoretically, \texttt{HistOfTree} reaches the mini-max optimal convergence rate.

7: 		Empirically, \texttt{HistOfTree} achieves superior performance on both synthetic and real data. 

8: 		We also explore scenarios where users have the flexibility to select features for protection manually. 

9: 		In such cases, we propose an estimator and a data-driven parameter tuning strategy, leading to analogous theoretical and empirical results.

10: 	\end{abstract}

11: