1: \begin{abstract}

2: %   Prompt tuning has become a conventional method for lightweight adaptation of pre-trained models. Nonetheless, the common prompt optimization based on gradient backpropagation still faces challenges such as slow convergence and suboptimal optimization.

3: %   %

4: %   In this paper, we utilize a large language model (LLM) as a catalyst to facilitate the optimization and performance of gradient-based prompt tuning.

5: %   %

6: %   To integrate the inference of LLM into vanilla gradient-based prompt tuning, we interleave gradient-based optimization with interactions with LLM. In specific, we instruct LLM by task descriptions and prompt optimization trajectories recorded during gradient-based optimization and obtain improved prompts from LLM response as restarting points for the next stage of gradient optimization.

7: %   %

8: %   Benefiting from LLM's instruction following ability, understanding of task descriptions and reasoning capabilities regarding previous prompt optimization trajectories, our alternating optimization strategy combining gradient-based optimizer and LLM optimizer has consistently yielded improvements over several competitive prompt tuning methods. The results demonstrates that LLM has the capacity of providing complementary guidance for conventional gradient-based optimizer.

9: % \end{abstract}

10: