MPGraphExecutor

class lsst.ctrl.mpexec.MPGraphExecutor(numProc: int, timeout: float, quantumExecutor: QuantumExecutor, *, startMethod: Optional[str] = None, failFast: bool = False, pdb: Optional[str] = None, executionGraphFixup: Optional[ExecutionGraphFixup] = None)

Bases: QuantumGraphExecutor

Implementation of QuantumGraphExecutor using same-host multiprocess execution of Quanta.

Parameters:

numProcint

Number of processes to use for executing tasks.

timeoutfloat

Time in seconds to wait for tasks to finish.

quantumExecutorQuantumExecutor

Executor for single quantum. For multiprocess-style execution when numProc is greater than one this instance must support pickle.

startMethodstr, optional

Start method from multiprocessing module, None selects the best one for current platform.

failFastbool, optional

If set to True then stop processing on first error from any task.

pdbstr, optional

Debugger to import and use (via the post_mortem function) in the event of an exception.

executionGraphFixupExecutionGraphFixup, optional

Instance used for modification of execution graph.

Methods Summary

execute(graph, butler)	Execute whole graph.
getReport()	Return execution report from last call to execute.

Methods Documentation

execute(graph: QuantumGraph, butler: Butler) → None

Execute whole graph.

Implementation of this method depends on particular execution model and it has to be provided by a subclass. Execution model determines what happens here; it can be either actual running of the task or, for example, generation of the scripts for delayed batch execution.

Parameters:

graphQuantumGraph

Execution graph.

butlerButler

Data butler instance

getReport() → Optional[Report]

Return execution report from last call to execute.

Returns:

reportReport, optional

Structure describing the status of the execution of a quantum graph. None is returned if implementation does not support this feature.

Raises:

RuntimeError

Raised if this method is called before execute.