A regex string that defines the rules for identifying a name. (Default: "a-zA-Z_\w*")
Nishant Aanjaney Jalan
0.0.1
The lexer is responsible to convert the given string into a stream of Tokens. The lexer take in multiple settings that configure how it behaves.
Nishant Aanjaney Jalan
0.0.1
A regex string that defines the rules for identifying a name. (Default: "a-zA-Z_\w*")
A pair of strings, the starting pattern and the ending pattern for a multiline comment block. (Default: null)
A list of strings that are considered as separators. (Default: [])
The string that defines how a single-line comment starts. Once identified, the lexer will skip the entire line. (Default: null)
The characters the lexer should not consider. (Default: "\s")
A pair of strings, the starting pattern and the ending pattern for a multiline comment block. (Default: null)
Nishant Aanjaney Jalan
0.0.1
A list of strings that are considered as separators. (Default: [])
Nishant Aanjaney Jalan
0.0.1
The string that defines how a single-line comment starts. Once identified, the lexer will skip the entire line. (Default: null)
Nishant Aanjaney Jalan
0.0.1
The characters the lexer should not consider. (Default: "\s")
Nishant Aanjaney Jalan
0.0.1
The lexer is responsible to convert the given string into a stream of Tokens. The lexer take in multiple settings that configure how it behaves.