Abstract:
Convolutional neural network models utilise various activation functions, which are crucial in determining whether a neuron is activated. These activation functions are typically categorised into linear and nonlinear types. Ten popular nonlinear activation functions are compared in this paper with four proposed custom activation functions for binary classification of a road image dataset, distinguishing between potholes and speed bumps. Accuracy results indicate that the Softplus activation function outperforms others, achieving an accuracy of 97.82 percent with 0.05 loss. The proposed activation functions rank within the top five, with accuracies as follows: ArcTan (96.80 percent), xArcTan (95.93 percent), weighted ArcTan1.5 (94.62 percent), weighted ArcTan1 (94.19 percent).