public final class CJKTokenizer extends Tokenizer
Constructor and Description |
---|
CJKTokenizer(Reader in)
Construct a token stream processing the given input.
|
public CJKTokenizer(Reader in)
in
- I/O readerpublic final Token next() throws IOException
next
in class TokenStream
IOException
- - throw IOException when read error Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.