Title

Preprocessing of training set for back propagation algorithm: histogram equalization

Publication Date

12-1-1994

Abstract

This paper introduces a data preprocessing algorithm that can improve the efficiency of the standard back propagation (BP) algorithm. The basic approach is transforming input data to a range that associates high-slopes of sigmoid where relatively large modification of weights occurs. This helps escaping of early trapping from prematured saturation. However, a simple and uniform transformation to such desired range can lead to a slow learning if the data have a heavily skewed distribution. In order to improve the performance of BP algorithm on such distribution, we propose a modified histogram equalization technique which enhances the spacing between data points in the heavily concentrated regions of skewed distribution. Our simulation study shows that this modified histogram equalization can significantly speed up the BP training as well as improving the generalization capability of the trained network.

Publication Title

IEEE International Conference on Neural Networks - Conference Proceedings

Disciplinary Repository

SSRN

Volume

1

First Page

425

Last Page

430

Open Access Status

OA Disciplinary Repository

Source Full-text URL

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1401918

Link to Full Text

Find in your library

Share

COinS