The LSTM is a unit cell that is made of three gates:
the input gate,
the forget gate,
and the output gate.
It also introduces a cell state c , which can be thought of as the
long-term memory, and a hidden state h which can be thought of as
the short-term memory.