io.siddhi.extension.execution.map

## Class TokenizeStreamProcessor

- java.lang.Object
- - io.siddhi.core.query.processor.stream.AbstractStreamProcessor<S>
  - - io.siddhi.core.query.processor.stream.StreamProcessor<io.siddhi.core.util.snapshot.state.State>
    - - io.siddhi.extension.execution.map.TokenizeStreamProcessor

- All Implemented Interfaces:
    io.siddhi.core.query.processor.Processor, io.siddhi.core.util.extension.holder.ExternalReferencedHolder

      public class TokenizeStreamProcessor
      extends io.siddhi.core.query.processor.stream.StreamProcessor<io.siddhi.core.util.snapshot.state.State>

  Implementation class for map:tokenize()

- - ### Field Summary

    - ### Fields inherited from class io.siddhi.core.query.processor.stream.AbstractStreamProcessor

      `attributeExpressionExecutors, attributeExpressionLength, complexEventPopulater, inputDefinition, metaStreamEvent, nextProcessor, siddhiQueryContext, stateHolder, streamEventClonerHolder`

  - ### Constructor Summary

    Constructors
    Constructor and Description
    `TokenizeStreamProcessor()`

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `io.siddhi.core.query.processor.ProcessingMode` | `getProcessingMode()`
    `List<io.siddhi.query.api.definition.Attribute>` | `getReturnAttributes()`
    `protected io.siddhi.core.util.snapshot.state.StateFactory<io.siddhi.core.util.snapshot.state.State>` | `init(io.siddhi.core.event.stream.MetaStreamEvent metaStreamEvent, io.siddhi.query.api.definition.AbstractDefinition abstractDefinition, io.siddhi.core.executor.ExpressionExecutor[] expressionExecutors, io.siddhi.core.util.config.ConfigReader configReader, io.siddhi.core.event.stream.holder.StreamEventClonerHolder streamEventClonerHolder, boolean outputExpectsExpiredEvents, boolean findToBeExecuted, io.siddhi.core.config.SiddhiQueryContext siddhiQueryContext)`
    `protected void` | `process(io.siddhi.core.event.ComplexEventChunk<io.siddhi.core.event.stream.StreamEvent> complexEventChunk, io.siddhi.core.query.processor.Processor processor, io.siddhi.core.event.stream.StreamEventCloner streamEventCloner, io.siddhi.core.event.stream.populater.ComplexEventPopulater complexEventPopulater, io.siddhi.core.util.snapshot.state.State state)`
    `void` | `start()`
    `void` | `stop()`

    - ### Methods inherited from class io.siddhi.core.query.processor.stream.StreamProcessor

      `processEventChunk`

    - ### Methods inherited from class io.siddhi.core.query.processor.stream.AbstractStreamProcessor

      `constructStreamEventPopulater, getNextProcessor, initProcessor, isStateful, process, process, setNextProcessor, setStreamEventCloner, setToLast`

    - ### Methods inherited from class java.lang.Object

      `clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- - ### Constructor Detail

    - #### TokenizeStreamProcessor

          public TokenizeStreamProcessor()

  - ### Method Detail

    - #### init

          protected io.siddhi.core.util.snapshot.state.StateFactory<io.siddhi.core.util.snapshot.state.State> init(io.siddhi.core.event.stream.MetaStreamEvent metaStreamEvent,
                                                                                                                   io.siddhi.query.api.definition.AbstractDefinition abstractDefinition,
                                                                                                                   io.siddhi.core.executor.ExpressionExecutor[] expressionExecutors,
                                                                                                                   io.siddhi.core.util.config.ConfigReader configReader,
                                                                                                                   io.siddhi.core.event.stream.holder.StreamEventClonerHolder streamEventClonerHolder,
                                                                                                                   boolean outputExpectsExpiredEvents,
                                                                                                                   boolean findToBeExecuted,
                                                                                                                   io.siddhi.core.config.SiddhiQueryContext siddhiQueryContext)

      Specified by:
        `init` in class `io.siddhi.core.query.processor.stream.AbstractStreamProcessor<io.siddhi.core.util.snapshot.state.State>`

    - #### process

          protected void process(io.siddhi.core.event.ComplexEventChunk<io.siddhi.core.event.stream.StreamEvent> complexEventChunk,
                                 io.siddhi.core.query.processor.Processor processor,
                                 io.siddhi.core.event.stream.StreamEventCloner streamEventCloner,
                                 io.siddhi.core.event.stream.populater.ComplexEventPopulater complexEventPopulater,
                                 io.siddhi.core.util.snapshot.state.State state)

      Specified by:
        `process` in class `io.siddhi.core.query.processor.stream.StreamProcessor<io.siddhi.core.util.snapshot.state.State>`

    - #### getReturnAttributes

          public List<io.siddhi.query.api.definition.Attribute> getReturnAttributes()

      Specified by:
        `getReturnAttributes` in class `io.siddhi.core.query.processor.stream.AbstractStreamProcessor<io.siddhi.core.util.snapshot.state.State>`

    - #### getProcessingMode

          public io.siddhi.core.query.processor.ProcessingMode getProcessingMode()

      Specified by:
        `getProcessingMode` in class `io.siddhi.core.query.processor.stream.AbstractStreamProcessor<io.siddhi.core.util.snapshot.state.State>`

    - #### start

          public void start()

    - #### stop

          public void stop()

Copyright © 2020 WSO2. All rights reserved.