1: \begin{abstract}
2: % Motivation -> why the problem, why the solution.
3: Distributed deep learning frameworks like federated learning (FL) and its variants are enabling personalized experiences across a wide range of web clients and mobile/IoT devices. However, these FL-based frameworks are constrained by computational resources at clients due to the exploding growth of model parameters (eg. billion parameter model).
4: %Distributed deep learning is enabling personalized experiences across a wide range of web clients and mobile/IoT devices.
5: % Federated Learning + Challenge
6: %Federated learning (FL) is the classical framework that trains the model entirely on-client and is limited by the computing resources of the clients. This is increasingly becoming impractical due to exploding growth of model sizes (eg. billion parameter models).
7: % Split Learning + Challenge
8: Split learning (SL), a recent framework, reduces client compute load by \textit{splitting} the model training between client and server. This flexibility is extremely useful for low-compute setups but is often achieved at cost of increase in bandwidth consumption and may result in sub-optimal convergence, especially when client data is heterogeneous.
9: % AdaSplit
10: In this work, we introduce \textit{AdaSplit} which enables efficiently scaling SL to low resource scenarios by reducing bandwidth consumption and improving performance across heterogeneous clients.
11: % Metric
12: To capture and benchmark this multi-dimensional nature of distributed deep learning, we also introduce \textit{C3-Score}, a metric to evaluate performance under resource budgets.
13: % Final
14: We validate the effectiveness of \textit{AdaSplit} under limited resources through extensive experimental comparison with strong federated and split learning baselines. We also present a sensitivity analysis of key design choices in AdaSplit which validates the ability of \textit{AdaSplit} to provide adaptive trade-offs across variable resource budgets.
15: \end{abstract}
16: