TFPExpressionScanner.GetToken function

Declaration

function GetToken: TTokenType

Function result

Returns the type of token that was found

Description

The GetToken method advances the scanner to the next token in the source expression and returns the token type. The token text is made available through the Token property.

The method handles all aspects of tokenization including whitespace skipping, literal parsing, operator recognition, and error detection for invalid character sequences.