Tag: activation functions

A R T
Ta Tl

tanh function

The tanh function, also known as the hyperbolic tangent function, is an activation function in artificial neural networks whose output values are constrained between the values of −1 and 1. The following screenshot provides a graph of function f(x)=tanh(x), as output from the Geogebra free online calculator.

TLU

TLU stands for threshold logic unit. TLU is an output neuron which calculates the weighted sum of input neurons and then implements a step function. This is used in the perceptron artificial neural network model.