1: \begin{abstract}

2: 	Several studies have discussed the impact different optimization techniques in the context of time

3: series forecasting across different architectures. This paper examines the effectiveness of Adam and

4: Nesterov’s Accelerated Gradient (NAG) optimization techniques on LSTM and GRU neural networks

5: for time series prediction, specifically stock market time-series. Our study was done by training

6: LSTM and GRU models with two different optimization techniques - Adam and Nesterov Accelerated

7: Gradient (NAG), comparing and evaluating their performance on Apple Inc’ closing price data over

8: the last decade. The GRU model optimized with Adam produced the lowest RMSE, outperforming the

9: other model-optimizer combinations in both accuracy and convergence speed. The GRU models with

10: both optimizers outperformed the LSTM models, whilst the Adam optimizer outperformed the NAG

11: optimizer for both model architectures. The results suggest that GRU models optimized with Adam

12: are well-suited for practitioners in time-series prediction, more specifically stock price time series

13: prediction producing accurate and computationally efficient models. The code for the experiments in

14: this project can be found at \url{https://github.com/AhmadMak/Time-Series-Optimization-Research}

15: \end{abstract}

16: