Home | Trees | Indices | Help |
|
---|
|
Functions for tokenizing a text, based on a regular expression which matches tokens or gaps.
|
|||
|
|||
|
|||
|
|||
|
|||
|
|
|||
SPACE =
|
|||
NEWLINE =
|
|||
BLANKLINE =
|
|||
SHOEBOXSEP =
|
|
Tokenize the text at a single space character.
|
Tokenize the text into lines.
|
Tokenize the text into paragraphs (separated by blank lines).
|
Tokenize a Shoebox entry into its fields (separated by backslash markers).
|
Home | Trees | Indices | Help |
|
---|
Generated by Epydoc 3.0beta1 on Wed May 16 22:47:20 2007 | http://epydoc.sourceforge.net |