Downloads: 2 | Views: 50 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Analysis Study Research Paper | Computer Science and Information Technology | United States of America | Volume 8 Issue 3, March 2019

Optimizing Neural Networks: A Comparative Analysis of Activation Functions in Deep Learning

Mainak Mitra ^[2] | Soumit Roy ^[3] | Vikram Maghnani

Abstract: This paper provides a comprehensive analysis of activation functions in multilayer neural networks. The study delves into the role of different activation functions and their impact when combined with various loss functions. It focuses on how activation functions contribute to neuron activation based on weight calculations and inclinations, thereby introducing nonlinearity in neuron outputs. The research highlights the importance of back-propagation in neural networks facilitated by activation functions. This study aims to offer clear guidance on selecting the appropriate activation function for specific problems and parameters.

Keywords: Neural Networks, Activation Functions, Deep Learning, Back-Propagation, Loss Functions

Edition: Volume 8 Issue 3, March 2019,

Pages: 1940 - 1949