Package org.wso2.carbon.module.csv.util.parser

Class Tokenizer

java.lang.Object

org.wso2.carbon.module.csv.util.parser.Tokenizer

public class Tokenizer
extends Object

Tokenizer for the given columns selector query.

Constructor Summary

Constructors

Constructor	Description
Tokenizer()

Method Summary

Modifier and Type	Method	Description
void	addTokenInfo(String regex, int token)
List<Token>	getTokens()
void	tokenize(String str)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

addTokenInfo

public void addTokenInfo(String regex,
                         int token)

tokenize

public void tokenize(String str)

getTokens

public List<Token> getTokens()