Activation Functions

Here is the list of all the activation functions currently available:

Function Representation
Atan
BentIdentity
BipolarSigmoid
ELU
Gaussian
Hardtanh
Identity
InverseSqrt
LeakyReLU
LeCunTanh
LogLog
LogSigmoid
ReLU
SELU
Sigmoid
Sinc
Softmax with
Softplus
Softsign
Swish
Tanh