Activation	Functional Form
Linear	\(g(t)=ct\)
Sigmoid	\(g(t)=1/(1+e^{-t})\)
Hyperbolic tangent	\(g(t)=(e^{t}-e^{-t})/(e^{t}+e^{-t})\)
Rectified linear unit	\(g(t)=\max\{0, t\}\)