Enum TokenKind 

pub enum TokenKind<'input, 'db> {
    Identifier(Identifier<'db>),
    Keyword(Keyword),
    Delimited {
        delimiter: Delimiter,
        text: &'input str,
    },
    OpChar(char),
    Literal(LiteralKind, TokenText<'db>),
    Error(Diagnostic),
}

Variants

Identifier(Identifier<'db>)

A program identifier

Keyword(Keyword)

A keyword

Delimited

A delimeted tree like {} or [] and the text that was in it.

Fields

delimiter: Delimiter

text: &'input str

OpChar(char)

An op-char like +, -, etc.

Literal(LiteralKind, TokenText<'db>)

An integer like 22

Error(Diagnostic)

Invalid characters

Trait Implementations

impl<'input, 'db> Clone for TokenKind<'input, 'db>

fn clone(&self) -> TokenKind<'input, 'db>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'input, 'db> Debug for TokenKind<'input, 'db>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.