Sensitivity analysis for neural networks

Daniel S. Yeung, Ian Cloete, Daming Shi, Wing W. Y. Ng (auth.)3642025315, 9783642025310, 9783642025327

Artificial neural networks are used to model systems that receive inputs and produce outputs. The relationships between the inputs and outputs and the representation parameters are critical issues in the design of related engineering systems, and sensitivity analysis concerns methods for analyzing these relationships. Perturbations of neural networks are caused by machine imprecision, and they can be simulated by embedding disturbances in the original inputs or connection weights, allowing us to study the characteristics of a function under small perturbations of its parameters.

This is the first book to present a systematic description of sensitivity analysis methods for artificial neural networks. It covers sensitivity analysis of multilayer perceptron neural networks and radial basis function neural networks, two widely used models in the machine learning field. The authors examine the applications of such analysis in tasks such as feature selection, sample reduction, and network optimization. The book will be useful for engineers applying neural network sensitivity analysis to solve practical problems, and for researchers interested in foundational problems in neural networks.

Table of contents :
Front Matter….Pages i-viii
Introduction to Neural Networks….Pages 1-15
Principles of Sensitivity Analysis….Pages 17-24
Hyper-Rectangle Model….Pages 25-27
Sensitivity Analysis with Parameterized Activation Function….Pages 29-31
Localized Generalization Error Model….Pages 33-46
Critical Vector Learning for RBF Networks….Pages 47-53
Sensitivity Analysis of Prior Knowledge 1 ….Pages 55-67
Applications….Pages 69-82
Back Matter….Pages 83-86