CMU-CALD-02-103
Center for Automated Learning and Discovery
School of Computer Science, Carnegie Mellon University



CMU-CALD-02-103

ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies

Matteo Matteucci

September 2002

CMU-CALD-02-103.pdf


In this paper we present ELeaRNT an evolutionary strategy which evolves rich neural network topologies in order to find an optimal domain-specific non-linear function approximator with a good generalization performance. The neural net-works evolved by the algorithm have a feed-forward topology with shortcut connections and arbitrary activation functions at each layer. This kind of topologies has not been thoroughly investigated in literature, but is particularly well suited for non-linear regression tasks.

The experimental results prove that, in such tasks, our algorithm can build, in a completely automated way, neural network topologies able to outperform classic neural network models designed by hand. Also when applied to classification problems, the performance of the obtained neural networks is fully comparable to that of classic neural networks and in some cases noticeably better.

14 pages


SCS Technical Report Collection
School of Computer Science homepage

This page maintained by reports@cs.cmu.edu