Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064


Amazon Sale


Research Paper | Mathematics | Saudi Arabia | Volume 3 Issue 9, September 2014

Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks

Kh. Sh. Mohamed, Y. Sh. Mohammed, A. A. Elzain, Kh. M. Makin, Elnoor. A. A. Noh

: In this paper, we study the Batch gradient method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks, assuming that the training samples are permuted stochastically in each cycle of iteration. The usual L1/2 Regularization term involves absolute value and is not differentiable at the origin, which typically causes oscillation of the gradient method of the error function during the training. However, using the Smoothing approximation techniques, the deficiency of the norm L1/2 Regularization term can be addressed. Corresponding convergence results of Smoothing L1/2 Regularization are proved, that is, the weak convergence result is proved under the uniformly boundedness assumption of the activation function and its derivatives.

Keywords: Pi-sigma Network, Batch Gradient Method, smoothing L1/2 Regularization, Momentum, boundedness, convergence

Edition: Volume 3 Issue 9, September 2014

Pages: 2002 - 2012

Share this Article

How to Cite this Article?

Kh. Sh. Mohamed, Y. Sh. Mohammed, A. A. Elzain, Kh. M. Makin, Elnoor. A. A. Noh, "Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=2015466, Volume 3 Issue 9, September 2014, 2002 - 2012

60 PDF Views | 58 PDF Downloads

Download Article PDF


Amazon Sale


Similar Articles with Keyword 'Batch Gradient Method'

Research Paper, Mathematics, Sudan, Volume 3 Issue 11, November 2014

Pages: 819 - 825

A Boundedness of a Batch Gradient Method with Smoothing L_(1?2)Regularization for Pi-sigma Neural Networks

Kh. Sh. Mohamed, Y. Sh. Mohammed, Abd Elmoniem A. Elzain, Mohamed El-Hafiz M. N, and Elnoor. A. A. Noh

Share this Article

Research Paper, Mathematics, Saudi Arabia, Volume 3 Issue 9, September 2014

Pages: 2002 - 2012

Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks

Kh. Sh. Mohamed, Y. Sh. Mohammed, A. A. Elzain, Kh. M. Makin, Elnoor. A. A. Noh

Share this Article

Similar Articles with Keyword 'Momentum'

Research Paper, Mathematics, India, Volume 4 Issue 11, November 2015

Pages: 2019 - 2023

Matter Symmetries of Linet-Tian Metric in General Theory of Relativity

R. S. Rane, S. S. Dabhane

Share this Article

Research Paper, Mathematics, Kenya, Volume 4 Issue 4, April 2015

Pages: 3115 - 3118

Effect of Tube Diameter on Natural Convection Heat Transfer in Circular Vertical Pipe Flows

Ateka J. N, Sigey J. K, Okelo J. O

Share this Article

Research Paper, Mathematics, Iraq, Volume 6 Issue 12, December 2017

Pages: 1509 - 1516

The Peristaltic Transport of MHD Powell - Eyring Fluid through Porous Medium in a Symmetric Channel with Slip Condition

Hayat Ali, Ahmed M. Abdulhadi

Share this Article

Research Paper, Mathematics, Egypt, Volume 7 Issue 8, August 2018

Pages: 1519 - 1526

Non Linear Radiation and Dissipation Effects on Natural Convection Flow of Viscoelastic Fluids between Vertical Plates Filled with Forchiemer-Darcy Medium

Karem Mahmoud Ewis

Share this Article

Research Paper, Mathematics, Kenya, Volume 2 Issue 10, October 2013

Pages: 82 - 87

Enhancement of Natural Convection Heat Transfer in a Square Enclosure with Localized Heating from Below

Onyango. O. M, Sigey. J. K, Okelo. J. A, Okwoyo. J. M

Share this Article

Similar Articles with Keyword 'boundedness'

Research Paper, Mathematics, Sudan, Volume 4 Issue 10, October 2015

Pages: 921 - 922

Conditions of Boundedness and Compactness Sum of Operators on Weighted Berman Space

Eltigani Ismail Hassan

Share this Article

Research Paper, Mathematics, Sudan, Volume 3 Issue 11, November 2014

Pages: 819 - 825

A Boundedness of a Batch Gradient Method with Smoothing L_(1?2)Regularization for Pi-sigma Neural Networks

Kh. Sh. Mohamed, Y. Sh. Mohammed, Abd Elmoniem A. Elzain, Mohamed El-Hafiz M. N, and Elnoor. A. A. Noh

Share this Article

Research Paper, Mathematics, Saudi Arabia, Volume 4 Issue 6, June 2015

Pages: 124 - 125

Conditions of Boundedness for Compact operators on Banach spaces

Mohammed Ahamed Osman Tom

Share this Article

Research Paper, Mathematics, Saudi Arabia, Volume 3 Issue 9, September 2014

Pages: 2002 - 2012

Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks

Kh. Sh. Mohamed, Y. Sh. Mohammed, A. A. Elzain, Kh. M. Makin, Elnoor. A. A. Noh

Share this Article

Research Paper, Mathematics, Nigeria, Volume 3 Issue 9, September 2014

Pages: 126 - 128

Generalization Sum of Boundedness of Toeplitz Operators

Eltigani Ismail Hassan

Share this Article

Similar Articles with Keyword 'convergence'

Research Paper, Mathematics, India, Volume 9 Issue 8, August 2020

Pages: 820 - 822

Extended Bolzano Weierstrass Theorem

Dr. K. L. Kaushik

Share this Article

Research Paper, Mathematics, India, Volume 6 Issue 3, March 2017

Pages: 1849 - 1851

Identifying Irrationals

R. Sivaraman

Share this Article

Research Paper, Mathematics, India, Volume 3 Issue 3, March 2014

Pages: 538 - 544

Approximation by Stancu Type Generalization of Beta Operators

Chandra Prakash, Rahul Tomar

Share this Article

Research Paper, Mathematics, India, Volume 3 Issue 6, June 2014

Pages: 2051 - 2053

Note On q-Beta Operators

Chandra Prakash, Rahul Tomar

Share this Article

Informative Article, Mathematics, India, Volume 4 Issue 5, May 2015

Pages: 1801 - 1803

Sequence of Real Numbers

Rajpal Rajbhar, Kapil Kumar

Share this Article
Top