1: \begin{abstract}

2: % \large

3: Greedy algorithms have been successfully analyzed and applied in training neural networks for solving variational problems, ensuring guaranteed convergence orders.

4: However, their practical applicability is limited due to the subproblems, which often require an exhaustive search over a discrete dictionary and incur significant computational costs.

5: This limitation becomes critical, especially in high-dimensional problems.

6: In this paper, we propose a more practical approach of randomly discretizing the dictionary at each iteration of the greedy algorithm.

7: We quantify the required size of the randomized discrete dictionary and

8: prove that, with high probability, the proposed algorithm realizes a weak greedy algorithm, achieving optimal convergence orders.

9: %We prove the convergence of the algorithm to a required accuracy $\epsilon$ with a high probability, by showing that it is a realization of weak greedy algorithms, hence preserving the optimal convergence order.

10: Through numerous numerical experiments, we demonstrate the advantage of using randomized discrete dictionaries over a deterministic one by showing order of magnitude reductions in the size of the discrete dictionary, particularly in higher dimensions.

11: %Our work takes a further step in remedying the training challenges of shallow neural networks and facilitating their more practical application in high dimensional problems. 

12: % randomized discrete dictionary

13: % deterministic discrete dictionary 

14: % randomly discretized dictionary 

15: 

16: \end{abstract}

17: