lsst.ctrl.bps.htcondor

Changes

Using lsst.ctrl.bps.htcondor

Contributing

lsst.ctrl.bps.htcondor is developed at https://github.com/lsst/ctrl_bps_htcondor. You can find Jira issues for this module under the ctrl_bps_htcondor component.

Python API reference

lsst.ctrl.bps.htcondor Package

Functions

condor_history([constraint, schedds])

Get information about completed jobs from HTCondor history.

condor_q([constraint, schedds])

Query HTCondor for current jobs.

condor_search([constraint, hist, schedds])

Search for running and finished jobs satisfying given criteria.

condor_status([constraint, coll])

Get information about HTCondor pool.

htc_backup_files(wms_path[, subdir, limit])

Backup select HTCondor files in the submit directory.

htc_check_dagman_output(wms_path)

Check the DAGMan output for error messages.

htc_create_submit_from_cmd(dag_filename[, ...])

Create a DAGMan job submit description.

htc_create_submit_from_dag(dag_filename[, ...])

Create a DAGMan job submit description.

htc_create_submit_from_file(submit_file)

Parse a submission file.

htc_escape(value)

Escape characters in given value based upon HTCondor syntax.

htc_submit_dag(sub)

Submit job for execution.

htc_version()

Return the version given by the HTCondor API.

htc_write_attribs(stream, attrs)

Write job attributes in HTCondor format to writeable stream.

htc_write_condor_file(filename, job_name, ...)

Write an HTCondor submit file.

pegasus_name_to_label(name)

Convert pegasus job name to a label for the report.

read_dag_info(wms_path)

Read custom DAGMan job information from the file.

read_dag_log(wms_path)

Read job information from the DAGMan log file.

read_dag_nodes_log(wms_path)

Read job information from the DAGMan nodes log file.

read_dag_status(wms_path)

Read the node status file for DAG summary information

read_node_status(wms_path)

Read entire node status file.

summary_from_dag(dir_name)

Build bps_run_summary string from dag file.

update_job_info(job_info, other_info)

Update results of a job query with results from another query.

write_dag_info(filename, dag_info)

Write custom job information about DAGMan job.

Classes

DagStatus(value[, names, module, qualname, ...])

HTCondor DAGMan's statuses for a DAG.

HTCDag([data, name])

HTCondor DAG.

HTCJob(name[, label, initcmds, initdagcmds, ...])

HTCondor job for use in building DAG.

HTCondorService(config)

HTCondor version of WMS service.

HTCondorWorkflow(name[, config])

Single HTCondor workflow.

JobStatus(value[, names, module, qualname, ...])

HTCondor's statuses for jobs.

NodeStatus(value[, names, module, qualname, ...])

HTCondor's statuses for DAGman nodes.

RestrictedDict(valid_keys[, init_data])

A dictionary that only allows certain keys.