Extending from BreakIteratorTextTokenizer

Extend BreakIteratorTextTokenizer and realize this method:

newBreakIterator(): java.text.BreakIterator

This example demonstrates how to use the default com.isdduk.text.parsing.StdTextTokenizer:

import java.text.BreakIterator;
public class StdTextTokenizer extends BreakIteratorTextTokenizer {
…
public BreakIterator newBreakIterator(){
         return BreakIterator.getWordInstance();}
…
}