Package jfun.parsec.tokens

Provides some predefined tokens and Tokenizer implementations.

See:
          Description

Class Summary
MyToken Deprecated.
NamedToken A token that has a name.
TokenCharLiteral Deprecated.
TokenDecimal Deprecated.
TokenInteger Deprecated.
Tokenizers The facade class for all pre-built Tokenizer implementations.
TokenLong Deprecated.
TokenQuoted represents a string that is quoted by a open and close string.
TokenReserved Deprecated.
Tokens This class create some basic tokens.
TokenString Deprecated.
TokenStringLiteral Deprecated.
TokenWord Deprecated.
TypedToken<Type> Represents a token associated with a token type.
 

Enum Summary
TokenType This represents all pre-built token types.
 

Package jfun.parsec.tokens Description

Provides some predefined tokens and Tokenizer implementations. These tokens are being used by the default behavior of some lexers.

Package Specification

The code is developed and tested under Java 5.0.

Related Documentation

For overviews, tutorials, examples, guides, and tool documentation, please see README.txt: