MPGraphExecutor

class lsst.ctrl.mpexec.MPGraphExecutor(*args, **kwargs)

Bases: MPGraphExecutor

Implementation of QuantumGraphExecutor using same-host multiprocess execution of Quanta.

This is a deprecated backwards-compatibility shim for lsst.pipe.base.mp_graph_executor.MPGraphExecutor, which has the same functionality with very minor interface changes.

Parameters:

numProcint

Number of processes to use for executing tasks.

timeoutfloat

Time in seconds to wait for tasks to finish.

quantumExecutorlsst.pipe.base.quantum_graph_executor.QuantumExecutor

Executor for single quantum. For multiprocess-style execution when num_proc is greater than one this instance must support pickle.

startMethodstr, optional

Start method from multiprocessing module, None selects the best one for current platform.

failFastbool, optional

If set to True then stop processing on first error from any task.

pdbstr, optional

Debugger to import and use (via the post_mortem function) in the event of an exception.

executionGraphFixuplsst.pipe.base.execution_graph_fixup.ExecutionGraphFixup, optional

Instance used for modification of execution graph.

.. deprecated:: v30

The MPGraphExecutor class has moved to lsst.pipe.base.mp_graph_executor. This forwarding shim will be removed after v30.

Attributes Summary

executionGraphFixup
failFast
numProc
pdb
quantumExecutor
report
startMethod
timeout

Methods Summary

execute(graph)	Execute whole graph.
getReport()	Return execution report from last call to execute.

Attributes Documentation

executionGraphFixup

failFast

numProc

pdb

quantumExecutor

report

startMethod

timeout

Methods Documentation

execute(graph: QuantumGraph) → None

Execute whole graph.

Implementation of this method depends on particular execution model and it has to be provided by a subclass. Execution model determines what happens here; it can be either actual running of the task or, for example, generation of the scripts for delayed batch execution.

Parameters:

graphQuantumGraph

Execution graph.

getReport() → Report | None

Return execution report from last call to execute.

Returns:

reportReport, optional

Structure describing the status of the execution of a quantum graph. None is returned if implementation does not support this feature.

Raises:

RuntimeError

Raised if this method is called before execute.