The context of a lexer block without a type parameter: the Column and Line tracking fields, updated after every match. Read them as plain Ints (ctx.line, ctx.column).
In the context they are the position after the last match; in a lexeme they are the position where its token starts.
Value parameters
column
the current column within the line (1-based, in code points)
A copy of at most the next n characters of the input still to be tokenized, fewer at its end.
A copy of at most the next n characters of the input still to be tokenized, fewer at its end.
Meant for a custom ErrorHandling instance to look at what failed to match any token rule, e.g. to pick a recovery strategy based on what comes next. Only the requested characters are read and copied, and the result is safe to keep after the callback returns.
