Package org.apache.solr.analysis

Class TokenizerChain

java.lang.Object
org.apache.lucene.analysis.Analyzer
org.apache.solr.analysis.SolrAnalyzer
org.apache.solr.analysis.TokenizerChain
All Implemented Interfaces:
Closeable, AutoCloseable
public final class TokenizerChain extends SolrAnalyzer
An analyzer that uses a tokenizer and a list of token filters to create a TokenStream.

It should probably be replaced with CustomAnalyzer.

Since:
3.1

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer

    org.apache.lucene.analysis.Analyzer.ReuseStrategy, org.apache.lucene.analysis.Analyzer.TokenStreamComponents

  • Field Summary

    Fields inherited from class org.apache.lucene.analysis.Analyzer

    GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY

  • Constructor Summary

    Constructors
    Constructor
    Description
    TokenizerChain(org.apache.lucene.analysis.CharFilterFactory[] charFilters, org.apache.lucene.analysis.TokenizerFactory tokenizer, org.apache.lucene.analysis.TokenFilterFactory[] filters)
    Creates a new TokenizerChain.
    TokenizerChain(org.apache.lucene.analysis.custom.CustomAnalyzer customAnalyzer)
    Copy from CustomAnalyzer.
    TokenizerChain(org.apache.lucene.analysis.TokenizerFactory tokenizer, org.apache.lucene.analysis.TokenFilterFactory[] filters)
    Creates a new TokenizerChain w/o any CharFilterFactories.

  • Method Summary

    Modifier and Type
    Method
    Description
    protected org.apache.lucene.analysis.Analyzer.TokenStreamComponents
    createComponents(String fieldName)
     
    org.apache.lucene.analysis.CharFilterFactory[]
    getCharFilterFactories()
     
    org.apache.lucene.analysis.Analyzer
    getMultiTermAnalyzer()
     
    org.apache.lucene.analysis.TokenFilterFactory[]
    getTokenFilterFactories()
     
    org.apache.lucene.analysis.TokenizerFactory
    getTokenizerFactory()
     
    Reader
    initReader(String fieldName, Reader reader)
     
    protected Reader
    initReaderForNormalization(String fieldName, Reader reader)
     
    protected org.apache.lucene.analysis.TokenStream
    normalize(String fieldName, org.apache.lucene.analysis.TokenStream in)
     
    String
    toString()
     

    Methods inherited from class org.apache.solr.analysis.SolrAnalyzer

    getPositionIncrementGap, setPositionIncrementGap

    Methods inherited from class org.apache.lucene.analysis.Analyzer

    attributeFactory, close, getOffsetGap, getReuseStrategy, normalize, tokenStream, tokenStream

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

  • Constructor Details

    • TokenizerChain

      public TokenizerChain(org.apache.lucene.analysis.custom.CustomAnalyzer customAnalyzer)
      Copy from CustomAnalyzer.

    • TokenizerChain

      public TokenizerChain(org.apache.lucene.analysis.TokenizerFactory tokenizer, org.apache.lucene.analysis.TokenFilterFactory[] filters)
      Creates a new TokenizerChain w/o any CharFilterFactories.
      Parameters:
      tokenizer - Factory for the Tokenizer to use, must not be null.
      filters - Factories for the TokenFilters to use - if null, will be treated as if empty.

    • TokenizerChain

      public TokenizerChain(org.apache.lucene.analysis.CharFilterFactory[] charFilters, org.apache.lucene.analysis.TokenizerFactory tokenizer, org.apache.lucene.analysis.TokenFilterFactory[] filters)
      Creates a new TokenizerChain.
      Parameters:
      charFilters - Factories for the CharFilters to use, if any - if null, will be treated as if empty.
      tokenizer - Factory for the Tokenizer to use, must not be null.
      filters - Factories for the TokenFilters to use if any- if null, will be treated as if empty.

  • Method Details

    • getCharFilterFactories

      public org.apache.lucene.analysis.CharFilterFactory[] getCharFilterFactories()
      Returns:
      array of CharFilterFactories, may be empty but never null

    • getTokenizerFactory

      public org.apache.lucene.analysis.TokenizerFactory getTokenizerFactory()
      Returns:
      the TokenizerFactory in use, will never be null

    • getTokenFilterFactories

      public org.apache.lucene.analysis.TokenFilterFactory[] getTokenFilterFactories()
      Returns:
      array of TokenFilterFactories, may be empty but never null

    • initReader

      public Reader initReader(String fieldName, Reader reader)
      Overrides:
      initReader in class SolrAnalyzer

    • initReaderForNormalization

      protected Reader initReaderForNormalization(String fieldName, Reader reader)
      Overrides:
      initReaderForNormalization in class org.apache.lucene.analysis.Analyzer

    • createComponents

      protected org.apache.lucene.analysis.Analyzer.TokenStreamComponents createComponents(String fieldName)
      Specified by:
      createComponents in class org.apache.lucene.analysis.Analyzer

    • normalize

      protected org.apache.lucene.analysis.TokenStream normalize(String fieldName, org.apache.lucene.analysis.TokenStream in)
      Overrides:
      normalize in class org.apache.lucene.analysis.Analyzer

    • toString

      public String toString()
      Overrides:
      toString in class Object

    • getMultiTermAnalyzer

      public org.apache.lucene.analysis.Analyzer getMultiTermAnalyzer()