1: \begin{abstract}

2: In \emph{federated learning}~(FL), classifiers (e.g., deep networks) are trained on datasets from multiple centers without exchanging data across them, and thus improves \emph{sample efficiency}.

3: In the classical setting of FL, the \emph{same labeling criterion} is usually employed across all centers being involved in training.

4: This constraint greatly limits the applicability of FL.

5: For example, standards used for \emph{disease diagnosis} are more likely to be different across clinical centers, which mismatches the classical FL setting.

6: In this paper, we consider an important yet under-explored setting of FL, namely FL with \emph{mixed-type labels} where \emph{different labeling criteria} can be employed by various centers, leading to inter-center label space differences and challenging existing FL methods designed for the classical setting.

7: To effectively and efficiently train models with mixed-type labels, we propose a theory-guided and model-agnostic approach that can make use of the underlying correspondence between those label spaces and can be easily combined with various FL methods such as FedAvg.

8: We present \emph{convergence analysis} based on over-parameterized ReLU networks.

9: We show that the proposed method can achieve linear convergence in label projection, and demonstrate the impact of the parameters of our new setting on the convergence rate.

10: The proposed method is evaluated and the theoretical findings are validated on benchmark and medical datasets.

11: \end{abstract}

12: