Research Paper | Computer Science & Engineering | India | Volume 3 Issue 8, August 2014
Adaptation to Best Fit Learning Rate in Batch Gradient Descent
Mohan Pandey, B. L. Pal
Abstract: The efficient training of a supervised machine learning system is commonly viewed as minimization of a cost function that depends on the parameters of the proposed hypothesis. This perspective gives some advantages to the development of better training algorithm, as the problem of minimization of a function is well known in many fields. Typically many learning system use gradient descent to minimize the cost function but has a problem of slow convergence and exploding on choosing learning rate beyond a threshold. We often make mistake on choosing learning rate as there is no known generic way of choosing learning rate and we need to do it manually. In this paper a method for the adaptation of learning rate is presented and also solving the problem of slow convergence and exploding of the algorithm. The main feature of proposed algorithm is that it speeds up the convergence rate and does not affect the result or number of epochs requires to converge on changing the learning rate.
Keywords: Batch training, On-line training, Epoch, Learning Rate, Gradient Descent, Hypothesis, Cost Function
Edition: Volume 3 Issue 8, August 2014,
Pages: 16 - 20
How to Cite this Article?
Mohan Pandey, B. L. Pal, "Adaptation to Best Fit Learning Rate in Batch Gradient Descent", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=2015173, Volume 3 Issue 8, August 2014, 16 - 20
How to Share this Article?
Similar Articles with Keyword 'Epoch'
A Survey of Different Prediction Models & Role of Artificial Neural Networks for Natural Gas Consumption
Prabodh K Pradhan, Sunil Dhal
Product Recommendation System Using Machine Learning Based Collaborative Filtering Technique
Mrunal Gandhi, Tushar Nikam, Akshay Shahane, Mayur Shete, Dr. Kamini C. Nalavade
Similar Articles with Keyword 'Gradient Descent'
Privacy Conserving Gradient Descent Method Applied for Neural Network with Distributed Datasets
Sachin P. Yadav, Amit B. Chougule
Survey of Novel Process for Domain Adaptation and Cost Sensitive Online Classification in Data Mining
Ashish. S. Kale, S. P. Kosbatwar
Similar Articles with Keyword 'Hypothesis'
Towards Effective Data Preprocessing for Classification Using WEKA
Kariuki Paul Wahome, Wekesa Bongo, Dr. Rimiru Richard Maina
Survey for Detecting Malicious user using Trust Evaluation and User Correlation for Protecting Online Reputation Systems
Vrushali G. Chabilwad, A. D. Gujar
Similar Articles with Keyword 'Cost Function'
DMMI Methods for Theoretic Clustering using Data Mining
Ankita G. Joshi, R. R. Shelke
A Survey: By Using Frequent Pattern Growth Infrequent Weighted Itemset Mining
Vaidya Seema Bhagwan, A. B. Bagwan
Similar Articles with Keyword 'Batch'
Data Integrity Proof in Cloud Computing using TPA with Privacy Preserving
Rushikesh P. Dhanokar
A Survey on Online Feature Selection
S. Nivetha, S. Nithya Roopa
Similar Articles with Keyword 'training'
Image Noise Reduction with Autoencoder using Tensor Flow
Jai Sehgal, Dr Yojna Arora
A Comparative Study on Different Training Model in Machine Learning
Priyanka S Jigalur, Dr. B. G. Prasad
Similar Articles with Keyword 'Online'
Research on Public Opinion Security under Blockchain Architecture
The Survey Paper on Importance of Integration of Knowledge Management and Business Intelligence
Vina Lomte, Saloni Shah