1: \begin{abstract}

2: Stochastic multi-objective optimization (SMOO) has recently emerged as a powerful framework for addressing machine learning problems with multiple objectives.

3: The bias introduced by the nonlinearity of the subproblem solution mapping complicates the convergence analysis of multi-gradient methods.

4: In this paper, we propose a novel SMOO method called the Multi-gradient Stochastic Mirror Descent (MSMD) method, which incorporates stochastic mirror descent method to solve the SMOO subproblem, providing convergence guarantees.

5: By selecting an appropriate Bregman function, our method enables analytical solutions of the weighting vector and requires only a single gradient sample at each iteration.

6: We demonstrate the sublinear convergence rate of our MSMD method under four different inner and outer step setups.

7: For SMOO with preferences, we propose a variant of MSMD method and demonstrate its convergence rate.

8: Through extensive numerical experiments, we compare our method with both stochastic descent methods based on weighted sum and state-of-the-art SMOO methods. Our method consistently outperforms these methods in terms of generating superior Pareto fronts on benchmark test functions while also achieving competitive results in neural network training.

9: \end{abstract}