Uses of Class
org.apache.lucene.analysis.Token

Packages that use Token
org.apache.lucene.analysis API and code to convert text into indexable tokens. 
org.apache.lucene.analysis.br Analyzer for Brazilian. 
org.apache.lucene.analysis.cjk Analyzer for Chinese, Japanese and Korean. 
org.apache.lucene.analysis.cn Analyzer for Chinese. 
org.apache.lucene.analysis.de Analyzer for German. 
org.apache.lucene.analysis.el Analyzer for Greek. 
org.apache.lucene.analysis.fr Analyzer for French. 
org.apache.lucene.analysis.nl Analyzer for Dutch. 
org.apache.lucene.analysis.ru Analyzer for Russian. 
org.apache.lucene.analysis.snowball TokenFilter and Analyzer implementations that use Snowball stemmers. 
org.apache.lucene.analysis.standard A grammar-based tokenizer constructed with JavaCC. 
org.apache.lucene.index.memory High-performance single-document main memory Apache Lucene fulltext search index. 
org.apache.lucene.search.highlight The highlight package contains classes to provide "keyword in context" features typically used to highlight search terms in the text of results pages. 
 

Uses of Token in org.apache.lucene.analysis
 

Methods in org.apache.lucene.analysis that return Token
 Token CharTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 Token ISOLatin1AccentFilter.next()
           
 Token KeywordTokenizer.next()
           
 Token LengthFilter.next()
          Returns the next input Token whose termText() is the right len
 Token LowerCaseFilter.next()
           
 Token PorterStemFilter.next()
          Returns the next input Token, after being stemmed
 Token StopFilter.next()
          Returns the next input Token whose termText() is not a stop word.
abstract  Token TokenStream.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.analysis.br
 

Methods in org.apache.lucene.analysis.br that return Token
 Token BrazilianStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.cjk
 

Methods in org.apache.lucene.analysis.cjk that return Token
 Token CJKTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.analysis.cn
 

Methods in org.apache.lucene.analysis.cn that return Token
 Token ChineseFilter.next()
           
 Token ChineseTokenizer.next()
           
 

Uses of Token in org.apache.lucene.analysis.de
 

Methods in org.apache.lucene.analysis.de that return Token
 Token GermanStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.el
 

Methods in org.apache.lucene.analysis.el that return Token
 Token GreekLowerCaseFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.fr
 

Methods in org.apache.lucene.analysis.fr that return Token
 Token FrenchStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.nl
 

Methods in org.apache.lucene.analysis.nl that return Token
 Token DutchStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.ru
 

Methods in org.apache.lucene.analysis.ru that return Token
 Token RussianLowerCaseFilter.next()
           
 Token RussianStemFilter.next()
           
 

Uses of Token in org.apache.lucene.analysis.snowball
 

Methods in org.apache.lucene.analysis.snowball that return Token
 Token SnowballFilter.next()
          Returns the next input Token, after being stemmed
 

Uses of Token in org.apache.lucene.analysis.standard
 

Methods in org.apache.lucene.analysis.standard that return Token
 Token StandardFilter.next()
          Returns the next token in the stream, or null at EOS.
 Token StandardTokenizer.next()
          Returns the next token in the stream, or null at EOS.
 

Uses of Token in org.apache.lucene.index.memory
 

Methods in org.apache.lucene.index.memory that return Token
protected  Token SynonymTokenFilter.createToken(String synonym, Token current)
          Creates and returns a token for the given synonym of the current input token; Override for custom (stateless or stateful) behaviour, if desired.
 Token SynonymTokenFilter.next()
          Returns the next token in the stream, or null at EOS.
 

Methods in org.apache.lucene.index.memory with parameters of type Token
protected  Token SynonymTokenFilter.createToken(String synonym, Token current)
          Creates and returns a token for the given synonym of the current input token; Override for custom (stateless or stateful) behaviour, if desired.
 

Uses of Token in org.apache.lucene.search.highlight
 

Methods in org.apache.lucene.search.highlight that return Token
 Token TokenGroup.getToken(int index)
           
 

Methods in org.apache.lucene.search.highlight with parameters of type Token
 float QueryScorer.getTokenScore(Token token)
           
 float Scorer.getTokenScore(Token token)
          Called for each token in the current fragment
 boolean Fragmenter.isNewFragment(Token nextToken)
          Test to see if this token from the stream should be held in a new TextFragment
 boolean NullFragmenter.isNewFragment(Token token)
           
 boolean SimpleFragmenter.isNewFragment(Token token)
           
 



Copyright © 2000-2010 Apache Software Foundation. All Rights Reserved.