International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Open Access | Fully Refereed | Peer Reviewed

ISSN: 2319-7064




Downloads: 119

Research Paper | Computer Science & Engineering | India | Volume 3 Issue 8, August 2014


Adaptation to Best Fit Learning Rate in Batch Gradient Descent

Mohan Pandey, B. L. Pal


Abstract: The efficient training of a supervised machine learning system is commonly viewed as minimization of a cost function that depends on the parameters of the proposed hypothesis. This perspective gives some advantages to the development of better training algorithm, as the problem of minimization of a function is well known in many fields. Typically many learning system use gradient descent to minimize the cost function but has a problem of slow convergence and exploding on choosing learning rate beyond a threshold. We often make mistake on choosing learning rate as there is no known generic way of choosing learning rate and we need to do it manually. In this paper a method for the adaptation of learning rate is presented and also solving the problem of slow convergence and exploding of the algorithm. The main feature of proposed algorithm is that it speeds up the convergence rate and does not affect the result or number of epochs requires to converge on changing the learning rate.


Keywords: Batch training, On-line training, Epoch, Learning Rate, Gradient Descent, Hypothesis, Cost Function


Edition: Volume 3 Issue 8, August 2014,


Pages: 16 - 20


How to Cite this Article?

Mohan Pandey, B. L. Pal, "Adaptation to Best Fit Learning Rate in Batch Gradient Descent", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=2015173, Volume 3 Issue 8, August 2014, 16 - 20

How to Share this Article?

Enter Your Email Address


Similar Articles with Keyword 'Epoch'

Downloads: 110

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1325 - 1328

A Survey of Different Prediction Models & Role of Artificial Neural Networks for Natural Gas Consumption

Prabodh K Pradhan, Sunil Dhal

Share this Article

Downloads: 130 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020

Pages: 176 - 180

Product Recommendation System Using Machine Learning Based Collaborative Filtering Technique

Mrunal Gandhi, Tushar Nikam, Akshay Shahane, Mayur Shete, Dr. Kamini C. Nalavade

Share this Article

Similar Articles with Keyword 'Gradient Descent'

Downloads: 109

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1592 - 1597

Privacy Conserving Gradient Descent Method Applied for Neural Network with Distributed Datasets

Sachin P. Yadav, Amit B. Chougule

Share this Article

Downloads: 112

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1494 - 1496

Survey of Novel Process for Domain Adaptation and Cost Sensitive Online Classification in Data Mining

Ashish. S. Kale, S. P. Kosbatwar

Share this Article

Similar Articles with Keyword 'Hypothesis'

Downloads: 103

Research Paper, Computer Science & Engineering, Kenya, Volume 5 Issue 8, August 2016

Pages: 1210 - 1214

Towards Effective Data Preprocessing for Classification Using WEKA

Kariuki Paul Wahome, Wekesa Bongo, Dr. Rimiru Richard Maina

Share this Article

Downloads: 108

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 984 - 986

Survey for Detecting Malicious user using Trust Evaluation and User Correlation for Protecting Online Reputation Systems

Vrushali G. Chabilwad, A. D. Gujar

Share this Article

Similar Articles with Keyword 'Cost Function'

Downloads: 106

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015

Pages: 2113 - 2116

DMMI Methods for Theoretic Clustering using Data Mining

Ankita G. Joshi, R. R. Shelke

Share this Article

Downloads: 108

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 621 - 623

A Survey: By Using Frequent Pattern Growth Infrequent Weighted Itemset Mining

Vaidya Seema Bhagwan, A. B. Bagwan

Share this Article

Similar Articles with Keyword 'Batch'

Downloads: 100

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1058 - 1060

Data Integrity Proof in Cloud Computing using TPA with Privacy Preserving

Rushikesh P. Dhanokar

Share this Article

Downloads: 109

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 968 - 970

A Survey on Online Feature Selection

S. Nivetha, S. Nithya Roopa

Share this Article

Similar Articles with Keyword 'training'

Downloads: 87

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 10, October 2020

Pages: 1626 - 1628

Image Noise Reduction with Autoencoder using Tensor Flow

Jai Sehgal, Dr Yojna Arora

Share this Article

Downloads: 4

Comparative Studies, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 1560 - 1562

A Comparative Study on Different Training Model in Machine Learning

Priyanka S Jigalur, Dr. B. G. Prasad

Share this Article

Similar Articles with Keyword 'Online'

Downloads: 0

Research Paper, Computer Science & Engineering, China, Volume 10 Issue 12, December 2021

Pages: 820 - 822

Research on Public Opinion Security under Blockchain Architecture

Wang Hong-Mei

Share this Article

Downloads: 1

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1789 - 1791

The Survey Paper on Importance of Integration of Knowledge Management and Business Intelligence

Vina Lomte, Saloni Shah

Share this Article
Top