The final stage of the LSTM is the output gate, and its purpose is to update the short-term memory. To achieve this, we take the newly generated long-term memory and process it through a hyperbolic tangent ( \tanh ) function creating a potential new short-term memory. We then multiply this potential memory by the output of the Sigmoid function ( \sigma_o ). This multiplication generates the final output as well as the input for the next hidden cell ( h^{\langle t \rangle} ) within the LSTM cell.
We have
\begin{aligned} \mathbf{o}^{(t)} &= \sigma_g(W_o\mathbf{x}^{(t)} + U_o\mathbf{h}^{(t-1)} + \mathbf{b}_o), \\ \mathbf{h}^{(t)} &= \mathbf{o}^{(t)} \otimes \sigma_h(\mathbf{c}^{(t)}). \\ \end{aligned}where \mathbf{W_o,U_o} are the weights of the output gate and \mathbf{b_o} is the bias of the output gate.