| Modifier and Type | Method and Description |
|---|---|
MemoryManager |
Environment.getMemoryManager()
Returns the current
MemoryManager. |
| Constructor and Description |
|---|
FileChannelInputView(BlockChannelReader<org.apache.flink.core.memory.MemorySegment> reader,
MemoryManager memManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
int sizeOfLastBlock) |
FileChannelOutputView(BlockChannelWriter<org.apache.flink.core.memory.MemorySegment> writer,
MemoryManager memManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
int segmentSize) |
SeekableFileChannelInputView(IOManager ioManager,
FileIOChannel.ID channelId,
MemoryManager memManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
int sizeOfLastBlock) |
| Modifier and Type | Class and Description |
|---|---|
class |
DefaultMemoryManager |
| Modifier and Type | Method and Description |
|---|---|
MemoryManager |
RegularPactTask.getMemoryManager() |
MemoryManager |
PactTaskContext.getMemoryManager() |
| Constructor and Description |
|---|
TempBarrier(AbstractInvokable owner,
org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<T> serializerFactory,
MemoryManager memManager,
IOManager ioManager,
int numPages) |
| Modifier and Type | Method and Description |
|---|---|
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashMatchIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashMatchIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
<BT,PT> MutableHashTable<BT,PT> |
HashMatchIteratorBase.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashMatchIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashMatchIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
| Constructor and Description |
|---|
NonReusingBuildFirstHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
NonReusingBuildFirstReOpenableHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
NonReusingBuildSecondHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
NonReusingBuildSecondReOpenableHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
ReusingBuildFirstHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
ReusingBuildFirstReOpenableHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
ReusingBuildSecondHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
ReusingBuildSecondReOpenableHashMatchIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction) |
| Modifier and Type | Field and Description |
|---|---|
protected MemoryManager |
SpillingResettableIterator.memoryManager |
protected MemoryManager |
SpillingResettableMutableObjectIterator.memoryManager |
| Constructor and Description |
|---|
BlockResettableMutableObjectIterator(MemoryManager memoryManager,
org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numMemoryPages,
AbstractInvokable ownerTask) |
NonReusingBlockResettableIterator(MemoryManager memoryManager,
Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
NonReusingBlockResettableIterator(MemoryManager memoryManager,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
ReusingBlockResettableIterator(MemoryManager memoryManager,
Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
ReusingBlockResettableIterator(MemoryManager memoryManager,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
SpillingResettableIterator(Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
int numPages,
AbstractInvokable parentTask) |
SpillingResettableIterator(Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
List<org.apache.flink.core.memory.MemorySegment> memory) |
SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
int numPages,
AbstractInvokable parentTask) |
SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
List<org.apache.flink.core.memory.MemorySegment> memory) |
| Modifier and Type | Field and Description |
|---|---|
protected MemoryManager |
UnilateralSortMerger.SpillingThread.memManager |
protected MemoryManager |
UnilateralSortMerger.memoryManager
The memory manager through which memory is allocated and released.
|
| Modifier and Type | Method and Description |
|---|---|
protected UnilateralSortMerger.ThreadBase<E> |
CombiningUnilateralSortMerger.getSpillingThread(ExceptionHandler<IOException> exceptionHandler,
UnilateralSortMerger.CircularQueues<E> queues,
AbstractInvokable parentTask,
MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
List<org.apache.flink.core.memory.MemorySegment> sortReadMemory,
List<org.apache.flink.core.memory.MemorySegment> writeMemory,
int maxFileHandles) |
protected UnilateralSortMerger.ThreadBase<E> |
UnilateralSortMerger.getSpillingThread(ExceptionHandler<IOException> exceptionHandler,
UnilateralSortMerger.CircularQueues<E> queues,
AbstractInvokable parentTask,
MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
List<org.apache.flink.core.memory.MemorySegment> sortReadMemory,
List<org.apache.flink.core.memory.MemorySegment> writeMemory,
int maxFileHandles) |
| Constructor and Description |
|---|
CombiningSpillingThread(ExceptionHandler<IOException> exceptionHandler,
UnilateralSortMerger.CircularQueues<E> queues,
AbstractInvokable parentTask,
MemoryManager memManager,
IOManager ioManager,
org.apache.flink.api.common.typeutils.TypeSerializer<E> serializer,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
List<org.apache.flink.core.memory.MemorySegment> sortReadMemory,
List<org.apache.flink.core.memory.MemorySegment> writeMemory,
int maxNumFileHandles) |
CombiningUnilateralSortMerger(org.apache.flink.api.common.functions.GroupCombineFunction<E,E> combineStub,
MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
double memoryFraction,
int maxNumFileHandles,
float startSpillingFraction)
Creates a new sorter that reads the data from a given reader and provides an iterator returning that
data in a sorted manner.
|
CombiningUnilateralSortMerger(org.apache.flink.api.common.functions.GroupCombineFunction<E,E> combineStub,
MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
double memoryFraction,
int numSortBuffers,
int maxNumFileHandles,
float startSpillingFraction)
Creates a new sorter that reads the data from a given reader and provides an iterator returning that
data in a sorted manner.
|
LargeRecordHandler(org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
org.apache.flink.api.common.typeutils.TypeComparator<T> comparator,
IOManager ioManager,
MemoryManager memManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
AbstractInvokable memoryOwner,
int maxFilehandles) |
NonReusingMergeMatchIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
ReusingMergeMatchIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
SpillingThread(ExceptionHandler<IOException> exceptionHandler,
UnilateralSortMerger.CircularQueues<E> queues,
AbstractInvokable parentTask,
MemoryManager memManager,
IOManager ioManager,
org.apache.flink.api.common.typeutils.TypeSerializer<E> serializer,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
List<org.apache.flink.core.memory.MemorySegment> sortReadMemory,
List<org.apache.flink.core.memory.MemorySegment> writeMemory,
int maxNumFileHandles)
Creates the spilling thread.
|
UnilateralSortMerger(MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
double memoryFraction,
int maxNumFileHandles,
float startSpillingFraction) |
UnilateralSortMerger(MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
double memoryFraction,
int numSortBuffers,
int maxNumFileHandles,
float startSpillingFraction) |
UnilateralSortMerger(MemoryManager memoryManager,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
double memoryFraction,
int numSortBuffers,
int maxNumFileHandles,
float startSpillingFraction,
boolean noSpillingMemory,
boolean handleLargeRecords) |
UnilateralSortMerger(MemoryManager memoryManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
int numSortBuffers,
int maxNumFileHandles,
float startSpillingFraction,
boolean handleLargeRecords) |
UnilateralSortMerger(MemoryManager memoryManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
IOManager ioManager,
org.apache.flink.util.MutableObjectIterator<E> input,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<E> serializerFactory,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator,
int numSortBuffers,
int maxNumFileHandles,
float startSpillingFraction,
boolean noSpillingMemory,
boolean handleLargeRecords) |
| Modifier and Type | Method and Description |
|---|---|
MemoryManager |
RuntimeEnvironment.getMemoryManager() |
| Constructor and Description |
|---|
RuntimeEnvironment(org.apache.flink.api.common.JobID jobId,
JobVertexID jobVertexId,
ExecutionAttemptID executionId,
String taskName,
String taskNameWithSubtasks,
int subtaskIndex,
int parallelism,
org.apache.flink.configuration.Configuration jobConfiguration,
org.apache.flink.configuration.Configuration taskConfiguration,
ClassLoader userCodeClassLoader,
MemoryManager memManager,
IOManager ioManager,
BroadcastVariableManager bcVarManager,
InputSplitProvider splitProvider,
Map<String,Future<org.apache.flink.core.fs.Path>> distCacheEntries,
ResultPartitionWriter[] writers,
InputGate[] inputGates,
akka.actor.ActorRef jobManagerActor) |
Task(TaskDeploymentDescriptor tdd,
MemoryManager memManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
BroadcastVariableManager bcVarManager,
akka.actor.ActorRef taskManagerActor,
akka.actor.ActorRef jobManagerActor,
scala.concurrent.duration.FiniteDuration actorAskTimeout,
LibraryCacheManager libraryCache,
FileCache fileCache)
IMPORTANT: This constructor may not start any work that would need to
be undone in the case of a failing task deployment.
|
Copyright © 2014–2015 The Apache Software Foundation. All rights reserved.