Class SegTokenFilter


  • public class SegTokenFilter
    extends java.lang.Object

    Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into Utility.COMMON_DELIMITER

    • Constructor Detail

      • SegTokenFilter

        public SegTokenFilter()