org.apache.flink.runtime.io.network.buffer

Class NetworkBufferPool

java.lang.Object

org.apache.flink.runtime.io.network.buffer.NetworkBufferPool

All Implemented Interfaces:

BufferPoolFactory

public class NetworkBufferPool
extends Object
implements BufferPoolFactory

The NetworkBufferPool is a fixed size pool of MemorySegment instances for the network stack.

The NetworkBufferPool creates LocalBufferPools from which the individual tasks draw the buffers for the network data transfer. When new local buffer pools are created, the NetworkBufferPool dynamically redistributes the buffers between the pools.

Constructor Summary

Constructors

Constructor and Description
NetworkBufferPool(int numberOfSegmentsToAllocate, int segmentSize) Allocates all MemorySegment instances managed by this pool.

Method Summary

Modifier and Type	Method and Description
int	countBuffers()
BufferPool	createBufferPool(int numRequiredBuffers, int maxUsedBuffers) Tries to create a buffer pool, which is guaranteed to provide at least the number of required buffers.
BufferPool	createBufferPool(int numRequiredBuffers, int maxUsedBuffers, Optional<BufferPoolOwner> owner) Tries to create a buffer pool with an optional owner, which is guaranteed to provide at least the number of required buffers.
void	destroy()
void	destroyAllBufferPools() Destroys all buffer pools that allocate their buffers from this buffer pool (created via createBufferPool(int, int)).
void	destroyBufferPool(BufferPool bufferPool) Destroy callback for updating factory book keeping.
int	getMemorySegmentSize()
int	getNumberOfAvailableMemorySegments()
int	getNumberOfRegisteredBufferPools()
int	getTotalNumberOfMemorySegments()
boolean	isDestroyed()
void	recycle(org.apache.flink.core.memory.MemorySegment segment)
void	recycleMemorySegments(List<org.apache.flink.core.memory.MemorySegment> segments)
org.apache.flink.core.memory.MemorySegment	requestMemorySegment()
List<org.apache.flink.core.memory.MemorySegment>	requestMemorySegments(int numRequiredBuffers)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NetworkBufferPool

public NetworkBufferPool(int numberOfSegmentsToAllocate,
                         int segmentSize)

Allocates all MemorySegment instances managed by this pool.

Method Detail

requestMemorySegment

@Nullable
public org.apache.flink.core.memory.MemorySegment requestMemorySegment()

recycle

public void recycle(org.apache.flink.core.memory.MemorySegment segment)

requestMemorySegments

public List<org.apache.flink.core.memory.MemorySegment> requestMemorySegments(int numRequiredBuffers)
                                                                       throws IOException

Throws:

IOException

recycleMemorySegments

public void recycleMemorySegments(List<org.apache.flink.core.memory.MemorySegment> segments)
                           throws IOException

Throws:

IOException

destroy

public void destroy()

isDestroyed

public boolean isDestroyed()

getMemorySegmentSize

public int getMemorySegmentSize()

getTotalNumberOfMemorySegments

public int getTotalNumberOfMemorySegments()

getNumberOfAvailableMemorySegments

public int getNumberOfAvailableMemorySegments()

getNumberOfRegisteredBufferPools

public int getNumberOfRegisteredBufferPools()

countBuffers

public int countBuffers()

createBufferPool

public BufferPool createBufferPool(int numRequiredBuffers,
                                   int maxUsedBuffers)
                            throws IOException

Description copied from interface: BufferPoolFactory

Tries to create a buffer pool, which is guaranteed to provide at least the number of required buffers.

The buffer pool is of dynamic size with at least numRequiredBuffers buffers.

Specified by:

createBufferPool in interface BufferPoolFactory

Parameters:

numRequiredBuffers - minimum number of network buffers in this pool

maxUsedBuffers - maximum number of network buffers this pool offers

Throws:

IOException

createBufferPool

public BufferPool createBufferPool(int numRequiredBuffers,
                                   int maxUsedBuffers,
                                   Optional<BufferPoolOwner> owner)
                            throws IOException

Description copied from interface: BufferPoolFactory

Tries to create a buffer pool with an optional owner, which is guaranteed to provide at least the number of required buffers.

The buffer pool is of dynamic size with at least numRequiredBuffers buffers.

Specified by:

createBufferPool in interface BufferPoolFactory

Parameters:

numRequiredBuffers - minimum number of network buffers in this pool

maxUsedBuffers - maximum number of network buffers this pool offers

owner - the optional owner of this buffer pool to release memory when needed

Throws:

IOException

destroyBufferPool

public void destroyBufferPool(BufferPool bufferPool)
                       throws IOException

Description copied from interface: BufferPoolFactory

Destroy callback for updating factory book keeping.

Specified by:

destroyBufferPool in interface BufferPoolFactory

Throws:

IOException

destroyAllBufferPools

public void destroyAllBufferPools()

Destroys all buffer pools that allocate their buffers from this buffer pool (created via createBufferPool(int, int)).