Modifier and Type | Field and Description |
---|---|
static java.lang.String |
TOKENS |
Constructor and Description |
---|
AnyTokenizer() |
Modifier and Type | Method and Description |
---|---|
void |
tokenize(SourceCode sourceCode,
Tokens tokenEntries) |
public static final java.lang.String TOKENS
public void tokenize(SourceCode sourceCode, Tokens tokenEntries)