LocalSrunWorkQueue#

class lsst.ctrl.bps.parsl.sites.LocalSrunWorkQueue(*args, **kwargs)#

Bases: WorkQueue

Configuration for a parsl.executors.WorkQueueExecutor that uses a parsl.providers.LocalProvider to manage resources.

This can be used directly as the site configuration within a multi-node allocation when Slurm is available. For running on a single node, e.g., a laptop, a parsl.launchers.SingleNodeLauncher is used, and Slurm need not be available.

The following BPS configuration parameters are recognized, overriding the defaults:

  • port (int): The port used by work_queue. Default: 0.

  • worker_options (`str`): Extra options to pass to work_queue workers. A typical option specifies the memory available per worker, e.g., ``"--memory=90000", which sets the available memory to 90 GB. Default: ""

  • wq_max_retries (int): The number of retries that work_queue will make in case of task failures. Set to None to have work_queue retry forever; set to 1 to have retries managed by Parsl. Default: 1.

  • nodes_per_block (int): The number of allocated nodes. Default: 1.

Methods Summary

get_executors()

Get a list of executors to be used in processing.

select_executor(job)

Get the label of the executor to use to execute a job.

Methods Documentation

get_executors() → list[ParslExecutor]#

Get a list of executors to be used in processing.

select_executor(job: ParslJob) → str#

Get the label of the executor to use to execute a job.

Parameters#

joblsst.ctrl.bps.parsl.ParslJob

Job to be executed.

Returns#

labelstr

Label of executor to use to execute job.