Before training a feed forward neural network, one needs to define its architecture. Even in simple feed-forward networks, the number of neurons of the hidden layer is a fundamental parameter, but it is not generally possible to compute its optimal value a priori. It is good practice to start from an initial number of neurons, then build, train and test several different networks with a similar hidden layer size, but this can be excessively expensive when the data to be learned are simple, while some real-time constraints have to be satisfied. This paper shows a heuristic method for dimensioning and initializing a network under such assumptions. The method has been tested on a project for waste water treatment monitoring.
G. Colombini, D. Sottara, L. Luccarini, P. Mello (2009). A wawelet based heuristic to dimension Neural Networks for simple signal approximation. s.l : IOS Press [10.3233/978-1-60750-072-8-110].
A wawelet based heuristic to dimension Neural Networks for simple signal approximation
SOTTARA, DAVIDE;MELLO, PAOLA
2009
Abstract
Before training a feed forward neural network, one needs to define its architecture. Even in simple feed-forward networks, the number of neurons of the hidden layer is a fundamental parameter, but it is not generally possible to compute its optimal value a priori. It is good practice to start from an initial number of neurons, then build, train and test several different networks with a similar hidden layer size, but this can be excessively expensive when the data to be learned are simple, while some real-time constraints have to be satisfied. This paper shows a heuristic method for dimensioning and initializing a network under such assumptions. The method has been tested on a project for waste water treatment monitoring.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.