International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Open Access | Fully Refereed | Peer Reviewed

ISSN: 2319-7064


Downloads: 117 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper | Computer Science & Engineering | India | Volume 3 Issue 11, November 2014


Lightning Fast Distributed Machine Learning Framework

Madhu Sudhan H V


Abstract: According to IBM, Big Data can be expressed with 4 Vs, namely Volume, Velocity, Variety and Veracity. Lots of companies are incorporating Big Data in their business model to derive insights from the unstructured data. Big Data is analyzed using Statistical Methods and Machine Learning. Limiting factor using traditional technologies is the incompetence to use huge amounts of data to learn or train algorithms within a practical time. This problem can be handled by using in-memory and distributed machine learning techniques with the help of distributed data sets and by allocating learning to various workstations. A distributed machine learning framework is developed with Spark, Hadoop and Python to scale the machine learning algorithm and to reduce the intensive computation.


Keywords: Big Data, Distributed Machine Learning, Apache Spark, Python


Edition: Volume 3 Issue 11, November 2014,


Pages: 2913 - 2915


How to Cite this Article?

Madhu Sudhan H V, "Lightning Fast Distributed Machine Learning Framework", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=SUB14131, Volume 3 Issue 11, November 2014, 2913 - 2915

How to Share this Article?

Enter Your Email Address


Similar Articles with Keyword 'Big Data'

Downloads: 2 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2

Review Papers, Computer Science & Engineering, India, Volume 10 Issue 10, October 2021

Pages: 584 - 587

Big Data Getting Bigger: Catering Challenges

Daksh Mehta

Share this Article

Downloads: 105

Informative Article, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1482 - 1485

Overview of Big Data

Nivedita Manohar

Share this Article

Similar Articles with Keyword 'Python'

Downloads: 42

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 2, February 2021

Pages: 1673 - 1677

Convolution Neural Network Based Image Recognition

Sofia Hamid, Mrigana Walia

Share this Article

Downloads: 118

Research Paper, Computer Science & Engineering, Chad, Volume 5 Issue 5, May 2016

Pages: 1564 - 1571

Comparative Study of Data Mining Techniques on Heart Disease Prediction System: a case study for the ?Republic of Chad?

Alladoumbaye Ngueilbaye, Lin Lei, Hongzhi Wang

Share this Article

Similar Articles with Keyword 'Big'

Downloads: 2 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2

Review Papers, Computer Science & Engineering, India, Volume 10 Issue 10, October 2021

Pages: 584 - 587

Big Data Getting Bigger: Catering Challenges

Daksh Mehta

Share this Article

Downloads: 91

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 823 - 826

Survey Paper on Users Location Hiding In Geosocial Recommendation Applications

Mayura Phadnis, Kanchan Varpe

Share this Article

Similar Articles with Keyword 'Data'

Downloads: 515 | Weekly Hits: ⮙3 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 1454 - 1458

Heart Disease Prediction with Machine Learning Approaches

Megha Kamboj

Share this Article

Downloads: 86 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 10, October 2020

Pages: 1626 - 1628

Image Noise Reduction with Autoencoder using Tensor Flow

Jai Sehgal, Dr Yojna Arora

Share this Article

Similar Articles with Keyword 'Distributed'

Downloads: 105 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 5, May 2014

Pages: 1751 - 1754

Joining Delay; Packet Delivery and Limitations of EGMP

G. Anandhi, Dr. S. K. Srivatsa

Share this Article

Downloads: 0

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 9, September 2021

Pages: 939 - 945

Load Balancing in Cloud Computing Using Optimization Algorithm

Manpreet Kaur, Dr. Amandeep Kaur

Share this Article

Similar Articles with Keyword 'Machine'

Downloads: 136 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 11, November 2020

Pages: 457 - 461

Artificial Intelligence for Hiring

Ishan Borker, Ashok Veda

Share this Article

Downloads: 515 | Weekly Hits: ⮙3 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 1454 - 1458

Heart Disease Prediction with Machine Learning Approaches

Megha Kamboj

Share this Article

Similar Articles with Keyword 'Learning'

Downloads: 136 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 11, November 2020

Pages: 457 - 461

Artificial Intelligence for Hiring

Ishan Borker, Ashok Veda

Share this Article

Downloads: 515 | Weekly Hits: ⮙3 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 1454 - 1458

Heart Disease Prediction with Machine Learning Approaches

Megha Kamboj

Share this Article

Similar Articles with Keyword 'Apache'

Downloads: 107

Research Paper, Computer Science & Engineering, India, Volume 8 Issue 9, September 2019

Pages: 937 - 938

Updating XML Files using a Tool based on DOM Parser

Nehal Pandey, Deepak Pase, Priyanka Chaudhari

Share this Article

Downloads: 108

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015

Pages: 1424 - 1430

Hadoop Distributed File System and Map Reduce Processing on Multi-Node Cluster

Dr. G. Venkata Rami Reddy, CH. V. V. N. Srikanth Kumar

Share this Article

Similar Articles with Keyword 'Spark'

Downloads: 116

Research Paper, Computer Science & Engineering, India, Volume 7 Issue 9, September 2018

Pages: 865 - 868

BigData: A Case Study of Spark Mllib and Hive

Shubhajoy Das

Share this Article

Downloads: 155 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 8, August 2020

Pages: 223 - 227

Artificial Intelligence Console: A Revolution in Human Emotion

Manjushree T L

Share this Article
Top