2df61f880bdbddc4.tex
1: \begin{abstract}
2: Vehicle Routing Problems (VRPs) are optimization problems with significant real-world implications in logistics, transportation, and supply chain management.
3: Despite the recent progress made in learning to solve individual VRP variants, there is a lack of a unified approach that can effectively tackle a wide range of tasks, which is crucial for real-world impact.
4: This paper introduces \our{}, a framework for developing foundation models for VRPs.
5: Our key idea is that a foundation model for VRPs should be able to model variants by treating each variant as a subset of a larger VRP problem, equipped with different attributes.
6: We introduce a parallelized environment that can handle any combination of attributes at the same time in a batched manner, and an efficient sampling procedure to train on a mix of problems at each optimization step that can greatly improve convergence robustness.
7: We also introduce novel Global Feature Embeddings that project instance-wise attributes efficiently onto the latent space and help the model understand different VRP variants.
8: Finally, we introduce Efficient Adapter Layers, a simple yet effective technique to finetune pre-trained \our{} models to solve novel variants with previously \textit{unseen} attributes outside of the original feature space.
9: We validate our approach through extensive experiments on 24 VRP variants, demonstrating competitive results over recent multi-task learning models.
10: We make our code openly available at \url{https://github.com/ai4co/routefinder}.
11: \end{abstract}
12: