Abdul Hamid, Norhamreeza and Mohd Nawi, Nazri and Ghazali, Rozaida and Mohd Salleh, Mohd Najib (2011) Accelerating learning performance of back propagation algorithm by using adaptive gain together with adaptive momentum and adaptive learning rate on classification problems. International Journal of Software Engineering and its Applications, 5 (4). pp. 31-44.
![[img]](http://eprints.uthm.edu.my/style/images/fileicons/text.png) |
Text
J3714_e277896270c61202b64daf13c7d0f992.pdf Restricted to Registered users only Download (235kB) | Request a copy |
Abstract
The back propagation (BP) algorithm is a very popular learning approach in feedforward multilayer perceptron networks. However, the most serious problem associated with the BP is local minima problem and slow convergence speeds. Over the years, many improvements and modifications of the back propagation learning algorithm have been reported. In this research, we propose a new modified back propagation learning algorithm by introducing adaptive gain together with adaptive momentum and adaptive learning rate into weight update process. By computer simulations, we demonstrate that the proposed algorithm can give a better convergence rate and can find a good solution in early time compare to the conventional back propagation. We use two common benchmark classification problems to illustrate the improvement in convergence time.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Back propagation; convergence speed; adaptive gain; adaptive momentum; adaptive learning rate. |
| Subjects: | T Technology > T Technology (General) |
| Depositing User: | Mr. Abdul Rahim Mat Radzuan |
| Date Deposited: | 02 Nov 2022 06:43 |
| Last Modified: | 02 Nov 2022 06:43 |
| URI: | http://eprints.uthm.edu.my/id/eprint/7955 |
Actions (login required)
 |
View Item |