Example Task: Character-level RNN Classification
- A classic example: feed a name (sequence of characters) one char at a time, and classify its language of origin.
- At each step, the RNN outputs a hidden state; we use the final hidden state to predict the class of the entire sequence.
- A character-level RNN reads words as a series of characters—outputting a prediction and ‘hidden state’ at each step, feeding the previous hidden state into the next step. We take the final prediction to be the output” .
- This illustrates sequence-to-one modeling: every output depends on all previous inputs.