This document describes the lexical analysis of tokens in a programming language. It lists tokens like operators, delimiters, keywords, identifiers, integer/real literals, and comments. It also describes the lexical states and transitions between states that are used to recognize these tokens when scanning source code.