public abstract class Analyzer extends Object
Typical implementations first build a Tokenizer, which breaks the stream of characters from the Reader into raw Tokens. One or more TokenFilters may then be applied to the output of the Tokenizer.
WARNING: You must override one of the methods defined by this class in your subclass or the Analyzer will enter an infinite loop.
Constructor and Description |
---|
Analyzer() |
Modifier and Type | Method and Description |
---|---|
int |
getPositionIncrementGap(String fieldName)
Invoked before indexing a Field instance if
terms have already been added to that field.
|
TokenStream |
tokenStream(Reader reader)
Deprecated.
use tokenStream(String, Reader) instead.
|
TokenStream |
tokenStream(String fieldName,
Reader reader)
Creates a TokenStream which tokenizes all the text in the provided
Reader.
|
public TokenStream tokenStream(String fieldName, Reader reader)
public TokenStream tokenStream(Reader reader)
tokenStream(String, Reader)
public int getPositionIncrementGap(String fieldName)
fieldName
- Field name being indexed.tokenStream(String,Reader)
Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.