1: \begin{abstract}
2: This paper fortifies the recently introduced hierarchical-optimization
3: recursive least squares (HO-RLS) against outliers which contaminate
4: infrequently linear-regression models. Outliers are modeled as nuisance
5: variables and are estimated together with the linear filter/system variables
6: via a sparsity-inducing (non-)convexly regularized least-squares task. The
7: proposed outlier-robust HO-RLS builds on steepest-descent directions with a
8: constant step size (learning rate), needs no matrix inversion (lemma),
9: accommodates colored nominal noise of known correlation matrix, exhibits small
10: computational footprint, and offers theoretical guarantees, in a probabilistic
11: sense, for the convergence of the system estimates to the solutions of a
12: hierarchical-optimization problem: Minimize a convex loss, which models
13: a-priori knowledge about the unknown system, over the minimizers of the
14: classical ensemble LS loss. Extensive numerical tests on synthetically
15: generated data in both stationary and non-stationary scenarios showcase
16: notable improvements of the proposed scheme over state-of-the-art techniques.
17: \end{abstract}
18: