tan h

#concept

What is the equation for tan h? What is it typically used for in neural nets? ? The hyperbolic tangent function (tanh) is given by It’s typically used as an activation function in neural networks to normalize the output of neurons to the range [-1, 1], which helps stabilize the learning process. tan h is a common type of activation function in neural nets.

Calculation:

References §

1. Build micrograd, a scalar-based neural network with Karpathy

Notes §