org.apache.lucene.analysis.ngram
Class EdgeNGramTokenFilter
java.lang.Object
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.lucene.analysis.ngram.EdgeNGramTokenFilter
public class EdgeNGramTokenFilter
- extends TokenFilter
Tokenizes the given token into n-grams of given size(s).
- Author:
- Otis Gospodnetic
Nested Class Summary |
static class |
EdgeNGramTokenFilter.Side
Specifies which side of the input the n-gram should be generated from |
Method Summary |
Token |
next()
Returns the next token in the stream, or null at EOS. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
DEFAULT_SIDE
public static final EdgeNGramTokenFilter.Side DEFAULT_SIDE
DEFAULT_MAX_GRAM_SIZE
public static final int DEFAULT_MAX_GRAM_SIZE
- See Also:
- Constant Field Values
DEFAULT_MIN_GRAM_SIZE
public static final int DEFAULT_MIN_GRAM_SIZE
- See Also:
- Constant Field Values
EdgeNGramTokenFilter
protected EdgeNGramTokenFilter(TokenStream input)
EdgeNGramTokenFilter
public EdgeNGramTokenFilter(TokenStream input,
EdgeNGramTokenFilter.Side side,
int minGram,
int maxGram)
- Creates EdgeNGramTokenFilter that can generate n-grams in the sizes of the given range
- Parameters:
input
- TokenStream holding the input to be tokenizedside
- the EdgeNGramTokenFilter.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generate
EdgeNGramTokenFilter
public EdgeNGramTokenFilter(TokenStream input,
String sideLabel,
int minGram,
int maxGram)
- Creates EdgeNGramTokenFilter that can generate n-grams in the sizes of the given range
- Parameters:
input
- TokenStream holding the input to be tokenizedsideLabel
- the name of the EdgeNGramTokenFilter.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generate
next
public final Token next()
throws IOException
- Returns the next token in the stream, or null at EOS.
- Overrides:
next
in class TokenStream
- Throws:
IOException
Copyright © 2000-2008 Apache Software Foundation. All Rights Reserved.