This class is a scanner generated by
JFlex 1.4.3
on 9/18/12 10:57 AM from the specification file
/usr/src/RPM/BUILD/opengrok-0.9-src/src/org/opensolaris/opengrok/analysis/java/JavaSymbolTokenizer.lex
This class is a scanner generated by
JFlex 1.4.3
on 9/18/12 10:57 AM from the specification file
/usr/src/RPM/BUILD/opengrok-0.9-src/src/org/opensolaris/opengrok/analysis/java/JavaXref.lex
this class was created because of lucene 2.4.1 update which introduced char[] in Tokens instead of String
lucene 3.0.0 uses AttributeSource instead of Tokens to make things even easier :-D
Generally this is a "template" for all new Tokenizers, so be carefull when changing it,
it will impact almost ALL symbol tokenizers in OpenGrok ...