com.shapesecurity.salvation

Class TokeniserWithLocation

java.lang.Object

com.shapesecurity.salvation.Tokeniser

com.shapesecurity.salvation.TokeniserWithLocation

public class TokeniserWithLocation
extends Tokeniser

Field Summary

Fields inherited from class com.shapesecurity.salvation.Tokeniser

index, length, sourceText, tokens

Method Summary

Modifier and Type	Method and Description
protected boolean	eat(java.util.function.Function<String,Token> ctor, Pattern pattern)
static Token[]	tokenise(String sourceText)

Methods inherited from class com.shapesecurity.salvation.Tokeniser

tokenise, trimRHSWS

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

tokenise

@Nonnull
public static Token[] tokenise(@Nonnull
                                        String sourceText)

eat

protected boolean eat(@Nonnull
                      java.util.function.Function<String,Token> ctor,
                      @Nonnull
                      Pattern pattern)

Overrides:

eat in class Tokeniser