LSTM Cell and Gates
- Each LSTM cell contains a memory cell \( C_t \) and three gates (forget \( f_t \), input \( i_t \), output \( o_t \)) that control information flow.
- Forget gate (\( f_t \)): chooses which information to erase from the previous cell state \( C_{t-1} \)
- Input gate (\( i_t \)): decides which new information \( \tilde{C}_t \) to add to the cell state.
- Output gate (\( o_t \)): controls which parts of the cell state become the output \( h_t \).
- The cell state update: \( C_t = f_t \odot C_{t-1} + i_t \odot \tilde{C}_t \)