78ed760e0b5ef99e.tex
1: \begin{abstract}
2:   A key aspect of the design of evolutionary and
3:   swarm intelligence algorithms is studying their
4:   performance. Statistical comparisons are also a crucial part which
5:   allows for reliable conclusions to be drawn. In the present paper we
6:   gather and examine the approaches taken from different perspectives
7:   to summarise the assumptions made by these statistical tests, the
8:   conclusions reached and the steps followed to perform them
9:   correctly. In this paper, we conduct a survey on the current trends
10:   of the proposals of statistical analyses for the comparison of
11:   algorithms of computational intelligence and include a description
12:   of the statistical background of these tests. We illustrate the use
13:   of the most common tests in the context of the Competition on
14:   single-objective real parameter optimisation of the IEEE Congress on
15:   Evolutionary Computation (CEC) 2017 and describe the main advantages
16:   and drawbacks of the use of each kind of test and put forward some
17:   recommendations concerning their use.
18: 
19: %   We examine the application of some non-parametric tests and advanced
20: %   proposals, like the use of Page test to study the convergence of the
21: %   algorithms. The main contribution of this paper is an extensive
22: %   guideline on the use of the statistical tests along with the
23: %   description of the use of some existent Bayesian test presented in
24: %   classification algorithms comparison context to optimisation
25: %   algorithms comparison scenario, with the advantages and the qualms
26: %   of each test. 
27: \end{abstract}
28: