com.bigdata.service.ndx.pipeline

Class AbstractPendingSetSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>

java.lang.Object

com.bigdata.service.ndx.pipeline.AbstractSubtask<HS,M,E,L>

com.bigdata.service.ndx.pipeline.AbstractPendingSetSubtask<HS,M,E,L>

All Implemented Interfaces:

Callable<HS>

public abstract class AbstractPendingSetSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>
extends AbstractSubtask<HS,M,E,L>

Extended to assign chunks of work items to a remote IAsynchronousClientTask, to track the set of outstanding asynchronous operations for a specific client task (the "pending set"), and to close the client task when the sink not assign any more work to that client.

Version:

$Id$

Author:

Bryan Thompson

Field Summary

Fields

Modifier and Type	Field and Description
protected IAsynchronousClientTask<?,E>	clientTask

Fields inherited from class com.bigdata.service.ndx.pipeline.AbstractSubtask

buffer, lastChunkAvailableNanos, lastChunkNanos, locator, log, master, src, stats

Constructor Summary

Constructors

Constructor and Description
AbstractPendingSetSubtask(M master, L locator, IAsynchronousClientTask<?,E> clientTask, BlockingBuffer<E[]> buffer)

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	addPending(E e)
protected void	awaitPending() Wait until any asynchronous processing for the subtask is done.
protected void	cancelRemoteTask(boolean mayInterruptIfRunning) Cancel the remote task.
protected abstract Set<E>	getPendingSet() Return the pending set.
int	getPendingSetSize()
protected boolean	handleChunk(E[] chunk) Submits the chunk of resources for processing by the remote client task.
protected void	notifyClientOfRedirect(L locator, Throwable cause) Notify the client that the locator is stale.
protected boolean	removePending(E e)

Methods inherited from class com.bigdata.service.ndx.pipeline.AbstractSubtask

call, handleRedirect, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

clientTask

protected final IAsynchronousClientTask<?,E> clientTask

Constructor Detail

AbstractPendingSetSubtask

public AbstractPendingSetSubtask(M master,
                         L locator,
                         IAsynchronousClientTask<?,E> clientTask,
                         BlockingBuffer<E[]> buffer)

Parameters:

clientTask - The proxy for the remote client task.

Method Detail

getPendingSet

protected abstract Set<E> getPendingSet()

Return the pending set.

getPendingSetSize

public int getPendingSetSize()

cancelRemoteTask

protected final void cancelRemoteTask(boolean mayInterruptIfRunning)
                               throws InterruptedException

Description copied from class: AbstractSubtask

Cancel the remote task. This is an extension hook which is used if the remote task accepts chunks for processing and uses an asynchronous notification mechanism to indicate the success or failure of elements. The default implementation is a NOP.

Overrides:

cancelRemoteTask in class AbstractSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>

Throws:

InterruptedException

awaitPending

protected final void awaitPending()
                           throws InterruptedException

Description copied from class: AbstractSubtask

Wait until any asynchronous processing for the subtask is done. This is an extension hook which is used if the remote task accepts chunks for processing and uses an asynchronous notification mechanism to indicate the success or failure of elements. The default implementation is a NOP.

Overrides:

awaitPending in class AbstractSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>

Throws:

InterruptedException

addPending

protected final boolean addPending(E e)

removePending

protected final boolean removePending(E e)

handleChunk

protected boolean handleChunk(E[] chunk)
                       throws ExecutionException,
                              InterruptedException,
                              IOException

Submits the chunk of resources for processing by the remote client task. Clients should accept resources for asynchronous processing, notifying the sink as resources succeed or fail.

Specified by:

handleChunk in class AbstractSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>

Parameters:

chunk - A chunk of resources to be processed.

Returns:

true iff the client will not accept additional chunks.

Throws:

IOException - RMI error.

ExecutionException

InterruptedException

notifyClientOfRedirect

protected void notifyClientOfRedirect(L locator,
                          Throwable cause)

Description copied from class: AbstractSubtask

Notify the client that the locator is stale.

Specified by:

notifyClientOfRedirect in class AbstractSubtask<HS extends AbstractSubtaskStats,M extends AbstractPendingSetMasterTask<? extends AbstractPendingSetMasterStats<L,HS>,E,? extends AbstractPendingSetSubtask,L>,E,L>

Parameters:

locator - The locator.

cause - The cause.