ReLU function

The ReLU (rectified linear unit function) function is an ANN activation function which calculates a linear function of the inputs. If the result is positive, it outputs that result. If it is negative, it outputs 0.

The mathematical formula for the ReLU function is f (x) = max(0, x). The graph of the ReLU function is shown below.

ReLU function graph | Download Scientific Diagram

Related Cloud terms