Sigmoid function

The sigmoid function $\sigma: \mathbb{R} \rightarrow (0,1)$ is an attempt to continuously approximate the binary step activation function

$$\sigma(x) = \frac{1}{1+e^{-x}}.$$