1: \begin{abstract}

2: Crafting an ideal prompt for Large Language Models (LLMs) is a challenging task that demands significant resources and expert human input. Existing work treats the optimization of prompt instruction and in-context learning examples as distinct problems, leading to sub-optimal prompt performance. This research addresses this limitation by establishing a unified in-context prompt optimization framework, which aims to achieve joint optimization of the prompt instruction and examples.

3: However, formulating such optimization in the discrete and high-dimensional natural language space introduces challenges in terms of convergence and computational efficiency.

4: To overcome these issues, we present \frameNamenospace, an efficient automatic prompt optimization framework that combines the generative capability of LLMs with the global search proficiency of evolution algorithms.

5: Our framework features a multi-phase design incorporating innovative LLM-based mutation operators to enhance search efficiency and accelerate convergence.

6: We conduct an extensive evaluation of our approach across 35 benchmark tasks. The results demonstrate that \frameName significantly outperforms the state-of-the-art baseline methods by a large margin whilst maintaining good efficiency.

7: \vspace{-4mm}

8: \end{abstract}

9: