public interface Tokenizer
It is recommend that implementations extend AbstractTokenizer
rather then implement this interface.
| Modifier and Type | Method and Description |
|---|---|
List<String> |
tokenizeToList(String input)
Return tokenized version of a string as a list of tokens.
|
com.google.common.collect.Multiset<String> |
tokenizeToMultiset(String input)
Return tokenized version of a string as a multiset of tokens.
|
Set<String> |
tokenizeToSet(String input)
Return tokenized version of a string as a set of tokens.
|
List<String> tokenizeToList(String input)
input - input string to tokenizecom.google.common.collect.Multiset<String> tokenizeToMultiset(String input)
input - input string to tokenizeCopyright © 2014–2016. All rights reserved.