1: \begin{abstract}

2: 

3: 

4: Pre-training and fine-tuning have achieved significant advances in the information retrieval (IR). 

5: A typical approach is to fine-tune all the parameters of large-scale pre-trained models (PTMs) on downstream tasks. 

6: As the model size and the number of tasks increase greatly, such approach becomes less feasible and prohibitively expensive. 

7: Recently, a variety of parameter-efficient tuning methods have been proposed in natural language processing (NLP) that only fine-tune a small number of parameters while still attaining strong performance.

8: Yet there has been little effort to explore parameter-efficient tuning for IR. 

9: 

10: In this work, we first conduct a comprehensive study of existing parameter-efficient tuning methods at both the retrieval and re-ranking stages. 

11: Unlike the promising results in NLP, we find that these methods cannot achieve comparable performance to full fine-tuning at both stages when updating less than 1\% of the original model parameters. 

12: More importantly, we find that the existing methods are just parameter-efficient, but not learning-efficient as they suffer from unstable training and slow convergence.  

13: To analyze the underlying reason, we conduct a theoretical analysis and show that the separation of the inserted trainable modules makes the optimization difficult.

14: To alleviate this issue, we propose to inject additional modules alongside the \acp{PTM} to make the original scattered modules connected.

15: In this way, all the trainable modules can form a pathway to smooth the loss surface and thus help stabilize the training process.

16: Experiments at both retrieval and re-ranking stages show that our method outperforms existing parameter-efficient methods significantly, and achieves comparable or even better performance over full fine-tuning. 

17: 

18: 

19: 

20: 

21: 

22: \end{abstract}

23: