Function handle_simple_token

fn handle_simple_token(
    state: &mut LexerState<'_>,
    token_type: Tokentype,
    lexeme: &str,
    start_pos: usize,
)

Handles simple one-character tokens

Arguments

• state - The current lexer state
• token_type - The type of token to add
• lexeme - The string representation of the token
• start_pos - The starting position of the token in the input