#include <rbbi.h>
Inheritance diagram for RuleBasedBreakIterator::
Public Methods | |
RuleBasedBreakIterator () | |
Default constructor. More... | |
RuleBasedBreakIterator (const RuleBasedBreakIterator &that) | |
Copy constructor. More... | |
RuleBasedBreakIterator (const UnicodeString &rules, UParseError &parseError, UErrorCode &status) | |
Construct a RuleBasedBreakIterator from a set of rules supplied as a string. More... | |
RuleBasedBreakIterator (UDataMemory *image, UErrorCode &status) | |
This constructor uses the udata interface to create a BreakIterator whose internal tables live in a memory-mapped file. More... | |
virtual | ~RuleBasedBreakIterator () |
Destructor. More... | |
RuleBasedBreakIterator & | operator= (const RuleBasedBreakIterator &that) |
Assignment operator. More... | |
virtual UBool | operator== (const BreakIterator &that) const |
Equality operator. More... | |
UBool | operator!= (const BreakIterator &that) const |
Not-equal operator. More... | |
virtual BreakIterator * | clone () const |
Returns a newly-constructed RuleBasedBreakIterator with the same behavior, and iterating over the same text, as this one. More... | |
virtual int32_t | hashCode (void) const |
Compute a hash code for this BreakIterator. More... | |
virtual const UnicodeString & | getRules (void) const |
Returns the description used to create this iterator. More... | |
virtual const CharacterIterator & | getText (void) const |
Return a CharacterIterator over the text being analyzed. More... | |
virtual void | adoptText (CharacterIterator *newText) |
Set the iterator to analyze a new piece of text. More... | |
virtual void | setText (const UnicodeString &newText) |
Set the iterator to analyze a new piece of text. More... | |
virtual int32_t | first (void) |
Sets the current iteration position to the beginning of the text. More... | |
virtual int32_t | last (void) |
Sets the current iteration position to the end of the text. More... | |
virtual int32_t | next (int32_t n) |
Advances the iterator either forward or backward the specified number of steps. More... | |
virtual int32_t | next (void) |
Advances the iterator to the next boundary position. More... | |
virtual int32_t | previous (void) |
Moves the iterator backwards, to the last boundary preceding this one. More... | |
virtual int32_t | following (int32_t offset) |
Sets the iterator to refer to the first boundary position following the specified position. More... | |
virtual int32_t | preceding (int32_t offset) |
Sets the iterator to refer to the last boundary position before the specified position. More... | |
virtual UBool | isBoundary (int32_t offset) |
Returns true if the specfied position is a boundary position. More... | |
virtual int32_t | current (void) const |
Returns the current iteration position. More... | |
virtual int32_t | getRuleStatus () const |
Return the status tag from the break rule that determined the most recently returned break position. More... | |
virtual UClassID | getDynamicClassID (void) const |
Returns a unique class ID POLYMORPHICALLY. More... | |
virtual BreakIterator * | createBufferClone (void *stackBuffer, int32_t &BufferSize, UErrorCode &status) |
Thread safe client-buffer-based cloning operation Do NOT call delete on a safeclone, since 'new' is not used to create it. More... | |
virtual const uint8_t * | getBinaryRules (uint32_t &length) |
Return the binary form of compiled break rules, which can then be used to create a new break iterator at some time in the future. More... | |
Static Public Methods | |
UClassID | getStaticClassID (void) |
Returns the class ID for this class. More... | |
Protected Methods | |
RuleBasedBreakIterator (RBBIDataHeader *data, UErrorCode &status) | |
Constructor from a flattened set of RBBI data in malloced memory. More... | |
virtual int32_t | handleNext (void) |
This method is the actual implementation of the next() method. More... | |
virtual int32_t | handlePrevious (void) |
This method backs the iterator back up to a "safe position" in the text. More... | |
virtual void | reset (void) |
Dumps caches and performs other actions associated with a complete change in text or iteration position. More... | |
virtual UBool | isDictionaryChar (UChar32) |
Return true if the category lookup for this char indicates that it is in the set of dictionary lookup chars. More... | |
void | init () |
Common initialization function, used by constructors and bufferClone. More... | |
Protected Attributes | |
CharacterIterator * | fText |
The character iterator through which this BreakIterator accesses the text. More... | |
RBBIDataWrapper * | fData |
The rule data for this BreakIterator instance. More... | |
int32_t | fLastBreakTag |
Rule {tag} value for the most recent match. More... | |
UBool | fLastBreakTagValid |
Rule tag value valid flag. More... | |
uint32_t | fDictionaryCharCount |
Counter for the number of characters encountered with the "dictionary" flag set. More... | |
Static Protected Attributes | |
UBool | fTrace |
Debugging flag. More... | |
Private Methods | |
int32_t | handlePrevious (const RBBIStateTable *statetable) |
This method backs the iterator back up to a "safe position" in the text. More... | |
int32_t | handleNext (const RBBIStateTable *statetable) |
This method is the actual implementation of the next() method. More... | |
Friends | |
class | RBBIRuleBuilder |
class | BreakIterator |
Instances of this class are most commonly created by the factory methods of BreakIterator::createWordInstance(), BreakIterator::createLineInstance(), etc., and then used via the abstract API in class BreakIterator
See the ICU User Guide for information on Break Iterator Rules.
This class is not intended to be subclassed. (Class DictionaryBasedBreakIterator is a subclass, but that relationship is effectively internal to the ICU implementation. The subclassing interface to RulesBasedBreakIterator is not part of the ICU API, and may not remain stable.
Definition at line 51 of file rbbi.h.
|
Constructor from a flattened set of RBBI data in malloced memory. RulesBasedBreakIterators built from a custom set of rules are created via this constructor; the rules are compiled into memory, then the break iterator is constructed here. The break iterator adopts the memory, and will free it when done.
|
|
Default constructor. Creates an empty shell of an iterator, with no rules or text to iterate over. Object can subsequently be assigned to.
|
|
Copy constructor. Will produce a break iterator with the same behavior, and which iterates over the same text, as the one passed in.
|
|
Construct a RuleBasedBreakIterator from a set of rules supplied as a string.
|
|
This constructor uses the udata interface to create a BreakIterator whose internal tables live in a memory-mapped file. "image" is an ICU UDataMemory handle for the pre-compiled break iterator tables.
|
|
Destructor.
|
|
Set the iterator to analyze a new piece of text. This function resets the current iteration position to the beginning of the text.
Reimplemented from BreakIterator. |
|
Returns a newly-constructed RuleBasedBreakIterator with the same behavior, and iterating over the same text, as this one. Differs from the copy constructor in that it is polymorphic, and will correctly clone (copy) a derived class. clone() is thread safe. Multiple threads may simultaeneously clone the same source break iterator.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Thread safe client-buffer-based cloning operation Do NOT call delete on a safeclone, since 'new' is not used to create it.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Returns the current iteration position.
Reimplemented from BreakIterator. |
|
Sets the current iteration position to the beginning of the text. (i.e., the CharacterIterator's starting offset).
Reimplemented from BreakIterator. |
|
Sets the iterator to refer to the first boundary position following the specified position.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Return the binary form of compiled break rules, which can then be used to create a new break iterator at some time in the future. Creating a break iterator from pre-compiled rules is much faster than building one from the source form of the break rules. The binary data can only be used with the same version of ICU and on the same platform type (processor endian-ness)
|
|
Returns a unique class ID POLYMORPHICALLY. Pure virtual override. This method is to implement a simple version of RTTI, since not all C++ compilers support genuine RTTI. Polymorphic operator==() and clone() methods call this method.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Return the status tag from the break rule that determined the most recently returned break position. The values appear in the rule source within brackets, {123}, for example. For rules that do not specify a status, a default value of 0 is returned.
Of the standard types of ICU break iterators, only the word break iterator provides status values. The values are defined in
|
|
Returns the description used to create this iterator.
|
|
Returns the class ID for this class. This is useful only for comparing to a return value from getDynamicClassID(). For example: Base* polymorphic_pointer = createPolymorphicObject(); if (polymorphic_pointer->getDynamicClassID() == Derived::getStaticClassID()) ...
Reimplemented in DictionaryBasedBreakIterator. |
|
Return a CharacterIterator over the text being analyzed. This version of this method returns the actual CharacterIterator we're using internally. Changing the state of this iterator can have undefined consequences. If you need to change it, clone it first.
Reimplemented from BreakIterator. |
|
This method is the actual implementation of the next() method. All iteration vectors through here. This method initializes the state machine to state 1 and advances through the text character by character until we reach the end of the text or the state machine transitions to state 0. We update our return value every time the state machine passes through a possible end state.
|
|
This method is the actual implementation of the next() method. All iteration vectors through here. This method initializes the state machine to state 1 and advances through the text character by character until we reach the end of the text or the state machine transitions to state 0. We update our return value every time the state machine passes through a possible end state.
|
|
This method backs the iterator back up to a "safe position" in the text. This is a position that we know, without any context, must be a break position. The various calling methods then iterate forward from this safe position to the appropriate position to return. (For more information, see the description of buildBackwardsStateTable() in RuleBasedBreakIterator.Builder.)
|
|
This method backs the iterator back up to a "safe position" in the text. This is a position that we know, without any context, must be a break position. The various calling methods then iterate forward from this safe position to the appropriate position to return. (For more information, see the description of buildBackwardsStateTable() in RuleBasedBreakIterator.Builder.)
|
|
Compute a hash code for this BreakIterator.
|
|
Common initialization function, used by constructors and bufferClone. (Also used by DictionaryBasedBreakIterator::createBufferClone().)
|
|
Returns true if the specfied position is a boundary position. As a side effect, leaves the iterator pointing to the first boundary position at or after "offset".
Reimplemented from BreakIterator. |
|
Return true if the category lookup for this char indicates that it is in the set of dictionary lookup chars. This function is intended for use by dictionary based break iterators.
|
|
Sets the current iteration position to the end of the text. (i.e., the CharacterIterator's ending offset).
Reimplemented from BreakIterator. |
|
Advances the iterator to the next boundary position.
Reimplemented from BreakIterator. |
|
Advances the iterator either forward or backward the specified number of steps. Negative values move backward, and positive values move forward. This is equivalent to repeatedly calling next() or previous().
Reimplemented from BreakIterator. |
|
Not-equal operator. If operator== returns TRUE, this returns FALSE, and vice versa.
Reimplemented from BreakIterator. |
|
Assignment operator. Sets this iterator to have the same behavior, and iterate over the same text, as the one passed in.
|
|
Equality operator. Returns TRUE if both BreakIterators are of the same class, have the same behavior, and iterate over the same text.
Reimplemented from BreakIterator. Referenced by operator!=().
|
|
Sets the iterator to refer to the last boundary position before the specified position.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Moves the iterator backwards, to the last boundary preceding this one.
Reimplemented from BreakIterator. Reimplemented in DictionaryBasedBreakIterator. |
|
Dumps caches and performs other actions associated with a complete change in text or iteration position. This function is a no-op in RuleBasedBreakIterator, but subclasses can and do override it.
|
|
Set the iterator to analyze a new piece of text. This function resets the current iteration position to the beginning of the text.
Reimplemented from BreakIterator. |
|
|
|
|
|
The rule data for this BreakIterator instance.
|
|
Counter for the number of characters encountered with the "dictionary" flag set. Normal RBBI iterators don't use it, although the code for updating it is live. Dictionary Based break iterators (a subclass of us) access this field directly. |
|
Rule {tag} value for the most recent match.
|
|
Rule tag value valid flag. Some iterator operations don't intrinsically set the correct tag value. This flag lets us lazily compute the value if we are ever asked for it. |
|
The character iterator through which this BreakIterator accesses the text.
|
|
Debugging flag. Trace operation of state machine when true. |