org.apache.tez.runtime.library.common.shuffle

Class Fetcher

java.lang.Object

org.apache.tez.runtime.library.common.shuffle.Fetcher

All Implemented Interfaces:

Callable<FetchResult>

public class Fetcher
extends Object
implements Callable<FetchResult>

Responsible for fetching inputs served by the ShuffleHandler for a single host. Construct using Fetcher.FetcherBuilder

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Fetcher.FetcherBuilder Builder for the construction of Fetchers

Method Summary

Methods

Modifier and Type	Method and Description
FetchResult	call()
protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult	doHttpFetch()
protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult	doHttpFetch(org.apache.tez.runtime.library.common.shuffle.Fetcher.CachingCallBack callback)
protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult	doSharedFetch()
boolean	equals(Object obj)
protected org.apache.hadoop.fs.Path	getShuffleInputFileName(String pathComponent, String suffix)
protected TezIndexRecord	getTezIndexRecord(InputAttemptIdentifier srcAttemptId)
int	hashCode()
protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult	setupLocalDiskFetch()
void	shutdown()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Method Detail

call

public FetchResult call()
                 throws Exception

Specified by:

call in interface Callable<FetchResult>

Throws:

Exception

doSharedFetch

protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult doSharedFetch()
                                                                                       throws IOException

Throws:

IOException

doHttpFetch

protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult doHttpFetch()

doHttpFetch

protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult doHttpFetch(org.apache.tez.runtime.library.common.shuffle.Fetcher.CachingCallBack callback)

setupLocalDiskFetch

protected org.apache.tez.runtime.library.common.shuffle.Fetcher.HostFetchResult setupLocalDiskFetch()

getTezIndexRecord

protected TezIndexRecord getTezIndexRecord(InputAttemptIdentifier srcAttemptId)
                                    throws IOException

Throws:

IOException

getShuffleInputFileName

protected org.apache.hadoop.fs.Path getShuffleInputFileName(String pathComponent,
                                                String suffix)
                                                     throws IOException

Throws:

IOException

shutdown

public void shutdown()

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object