1: \begin{abstract}

2:     The remarkable instruction-following capability of large language models (LLMs) has sparked a growing interest in automatically learning suitable prompts. However, while many effective methods have been proposed, the \emph{cost} incurred during the learning process (e.g., accessing LLM and evaluating the responses) has not been considered. To overcome this limitation, this work explicitly incorporates a finite budget constraint into prompt learning. Towards developing principled solutions, a novel connection is established between prompt learning and fixed-budget best arm identification (BAI-FB) in multi-armed bandits (MAB). Based on this connection, a general framework \texttt{TRIPLE} (bes{\bf T} a{\bf R}m {\bf I}dentification for {\bf P}rompt {\bf LE}arning) is proposed to harness the power of BAI-FB in prompt learning systematically. Unique characteristics of prompt learning further lead to two embedding-based enhancements of \texttt{TRIPLE} by exploiting the ideas of clustering and function approximation. Extensive experiments on multiple well-adopted tasks using both GPT 3.5 and Llama2 demonstrate the significant performance improvement of \texttt{TRIPLE} over the previous baselines while satisfying the limited budget constraints. Code available at \href{https://github.com/ShenGroup/TRIPLE}{https://github.com/ShenGroup/TRIPLE}

3: \end{abstract}

4: