Package | Description |
---|---|
net.percederberg.grammatica.parser |
Modifier and Type | Method and Description |
---|---|
void |
Tokenizer.addPattern(TokenPattern pattern)
Adds a new token pattern to the tokenizer.
|
protected Token |
Tokenizer.newToken(TokenPattern pattern,
java.lang.String image,
int line,
int column)
Factory method for creating a new token.
|
Constructor and Description |
---|
Token(TokenPattern pattern,
java.lang.String image,
int line,
int col)
Creates a new token.
|