1: \begin{abstract}

2: The continual learning problem involves training models with limited capacity to perform well on a set of an unknown number of sequentially arriving tasks. 

3: While meta-learning shows great potential for reducing interference between old and new tasks, the current training procedures tend to be either slow or offline, and sensitive to many hyper-parameters. In this work, we propose \emph{Look-ahead MAML (La-MAML)}, a fast optimisation-based meta-learning algorithm for \emph{online}-continual learning, aided by a small episodic memory. Our proposed modulation of per-parameter learning rates in our meta-learning update allows us to draw connections to prior work on \emph{hypergradients} and \emph{meta-descent}. This provides a more flexible and efficient way to mitigate \emph{catastrophic forgetting} compared to conventional \emph{prior-based} methods.

4: \emph{La-MAML} achieves performance superior to other replay-based, prior-based and meta-learning based approaches for continual learning on real-world visual classification benchmarks.

5: % We also provide theoretical analysis on the convergence and expected regret of our proposed algorithm. 

6: 

7: \end{abstract}

8: