The answer
Rectified Linear Unit (ReLU) is an activation function defined as f(x) = max(0, x). It helps speed up training and prevents vanishing gradients.
What is a Neural Network? Deep Learning Foundations Explained
What is ReLU?
More FAQs in What is a Neural Network? Deep Learning Foundations Explained
A perceptron is the simplest form of a neural network, consisting of a single neuron with inputs, weights, a bias, and an output.
Without activation functions, a neural network is just a giant linear equation, making it incapable of learning complex non-linear patterns.
Generally, any neural network with two or more hidden layers is considered a deep neural network.
Still have questions?
Browse all our FAQs or reach out to our support team
Want to upskill yourself?
Your learning library
Small steps. Big possibilities.
Find your next course. Build something great.