International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 116

Research Paper | Mathematics | Saudi Arabia | Volume 3 Issue 9, September 2014


Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks

Kh. Sh. Mohamed [2] | Y. Sh. Mohammed [3] | A. A. Elzain | Kh. M. Makin | Elnoor. A. A. Noh [2]


Abstract: : In this paper, we study the Batch gradient method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks, assuming that the training samples are permuted stochastically in each cycle of iteration. The usual L1/2 Regularization term involves absolute value and is not differentiable at the origin, which typically causes oscillation of the gradient method of the error function during the training. However, using the Smoothing approximation techniques, the deficiency of the norm L1/2 Regularization term can be addressed. Corresponding convergence results of Smoothing L1/2 Regularization are proved, that is, the weak convergence result is proved under the uniformly boundedness assumption of the activation function and its derivatives.


Keywords: Pi-sigma Network, Batch Gradient Method, smoothing L1/2 Regularization, Momentum, boundedness, convergence


Edition: Volume 3 Issue 9, September 2014,


Pages: 2002 - 2012


How to Download this Article?

You Need to Register Your Email Address Before You Can Download the Article PDF


How to Cite this Article?

Kh. Sh. Mohamed, Y. Sh. Mohammed, A. A. Elzain, Kh. M. Makin, Elnoor. A. A. Noh, "Batch Gradient Method with Smoothing L1/2 Regularization and Momentum for Pi-sigma Networks", International Journal of Science and Research (IJSR), Volume 3 Issue 9, September 2014, pp. 2002-2012, https://www.ijsr.net/get_abstract.php?paper_id=2015466

Similar Articles with Keyword 'Momentum'

Downloads: 3 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Mathematics, Kenya, Volume 10 Issue 9, September 2021

Pages: 530 - 534

A Numerical Study of Turbulent Natural Convection in a Rectangular Enclosure with Localised Heating and Cooling

Clementine Kaluki Mutua | Kennedy Awuor | Emily Nafula John

Share this Article

Downloads: 3 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2

Research Paper, Mathematics, India, Volume 12 Issue 10, October 2023

Pages: 722 - 737

Dispersion of a Chemically Reacting Solute in a Three - Dimensional Newtonian Fluid Flow Through a Darcy - Brinkman Porous Medium

Srihari M Subodha | S Manjunath | N P Chandrashekara

Share this Article
Top