Before training a feed forward neural network, one needs to define its architecture. Even in simple feed-forward networks, the number of neurons of the hidden layer is a fundamental parameter, but it is not generally possible to compute its optimal value a priori. It is good practice to start from an initial number of neurons, then build, train and test several different networks with a similar hidden layer size, but this can be excessively expensive when the data to be learned are simple, while some real-time constraints have to be satisfied. This paper shows a heuristic method for dimensioning and initializing a network under such assumptions. The method has been tested on a project for waste water treatment monitoring.
A wawelet based heuristic to dimension Neural Networks for simple signal approximation / G. Colombini; D. Sottara; L. Luccarini; P. Mello. - STAMPA. - 204:(2009), pp. 110-115. (Intervento presentato al convegno Neural Nets WIRN09 - 19th Italian Workshop on Neural Nets tenutosi a Vietri sul Mare, Salerno, Italy nel May 28-30 2009) [10.3233/978-1-60750-072-8-110].
A wawelet based heuristic to dimension Neural Networks for simple signal approximation
SOTTARA, DAVIDE;MELLO, PAOLA
2009
Abstract
Before training a feed forward neural network, one needs to define its architecture. Even in simple feed-forward networks, the number of neurons of the hidden layer is a fundamental parameter, but it is not generally possible to compute its optimal value a priori. It is good practice to start from an initial number of neurons, then build, train and test several different networks with a similar hidden layer size, but this can be excessively expensive when the data to be learned are simple, while some real-time constraints have to be satisfied. This paper shows a heuristic method for dimensioning and initializing a network under such assumptions. The method has been tested on a project for waste water treatment monitoring.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.