Package org.apache.lucene.analysis
Class Analyzer.TokenStreamComponents
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer.TokenStreamComponents
-
- Enclosing class:
- Analyzer
public static final class Analyzer.TokenStreamComponents extends java.lang.Object
This class encapsulates the outer components of a token stream. It provides access to the source (aReader
Consumer
and the outer end (sink), an instance ofTokenFilter
which also serves as theTokenStream
returned byAnalyzer.tokenStream(String, Reader)
.
-
-
Field Summary
Fields Modifier and Type Field Description (package private) ReusableStringReader
reusableStringReader
Internal cache only used byAnalyzer.tokenStream(String, String)
.protected TokenStream
sink
Sink tokenstream, such as the outer tokenfilter decorating the chain.protected java.util.function.Consumer<java.io.Reader>
source
Original source of the tokens.
-
Constructor Summary
Constructors Constructor Description TokenStreamComponents(java.util.function.Consumer<java.io.Reader> source, TokenStream result)
Creates a newAnalyzer.TokenStreamComponents
instance.TokenStreamComponents(Tokenizer tokenizer)
Creates a newAnalyzer.TokenStreamComponents
from a TokenizerTokenStreamComponents(Tokenizer tokenizer, TokenStream result)
Creates a newAnalyzer.TokenStreamComponents
instance
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.util.function.Consumer<java.io.Reader>
getSource()
Returns the component's sourceTokenStream
getTokenStream()
Returns the sinkTokenStream
private void
setReader(java.io.Reader reader)
Resets the encapsulated components with the given reader.
-
-
-
Field Detail
-
source
protected final java.util.function.Consumer<java.io.Reader> source
Original source of the tokens.
-
sink
protected final TokenStream sink
Sink tokenstream, such as the outer tokenfilter decorating the chain. This can be the source if there are no filters.
-
reusableStringReader
transient ReusableStringReader reusableStringReader
Internal cache only used byAnalyzer.tokenStream(String, String)
.
-
-
Constructor Detail
-
TokenStreamComponents
public TokenStreamComponents(java.util.function.Consumer<java.io.Reader> source, TokenStream result)
Creates a newAnalyzer.TokenStreamComponents
instance.- Parameters:
source
- the source to set the reader onresult
- the analyzer's resulting token stream
-
TokenStreamComponents
public TokenStreamComponents(Tokenizer tokenizer, TokenStream result)
Creates a newAnalyzer.TokenStreamComponents
instance- Parameters:
tokenizer
- the analyzer's Tokenizerresult
- the analyzer's resulting token stream
-
TokenStreamComponents
public TokenStreamComponents(Tokenizer tokenizer)
Creates a newAnalyzer.TokenStreamComponents
from a Tokenizer
-
-
Method Detail
-
setReader
private void setReader(java.io.Reader reader)
Resets the encapsulated components with the given reader. If the components cannot be reset, an Exception should be thrown.- Parameters:
reader
- a reader to reset the source component
-
getTokenStream
public TokenStream getTokenStream()
Returns the sinkTokenStream
- Returns:
- the sink
TokenStream
-
getSource
public java.util.function.Consumer<java.io.Reader> getSource()
Returns the component's source
-
-