To notice:
Specification of special states into which the lexer may be
- lexing a string, or a comment
- special action must be taken in the middle of lexing the token
- a particular set of regular expressions will apply to each state
Specification of actions to be taken when the lexer recognises specific events