ConsolidateSourceTableTask¶

ConsolidateSourceTableTask concatenates per-detector Source Tables (dataset sourceTable) into one per-visit Source Table (dataset sourceTable_visit). It only does I/O, and therefore has no run method. The inputs have already been transformed to the DPDD-specified columns. This task assumes that they are sufficiently narrow to fit all tables for a given visit in memory at once.

It is the third of three postprocessing tasks to convert a src table to a per-visit Source Table that conforms to the standard data model. The first is WriteSourceTableTask. The second is TransformSourceTableTask.

Processing summary¶

ConsolidateSourceTableTask reads in all detector-level Source Tables (dataset sourceTable) for a given visit, concatenates them, and writes the result out as a visit-level Source Table (dataset sourceTable_visit)

Python API summary¶

from lsst.pipe.tasks.postprocess import ConsolidateSourceTableTask

classConsolidateSourceTableTask(*, config=None, log=None, initInputs=None, **kwargs): Concatenate `sourceTable` list into a per-visit `sourceTable_visit`...

attributeconfig: Access configuration fields and retargetable subtasks.

methodrun(**kwargs): Run task algorithm on in-memory data...

Butler datasets¶

When run through the runQuantum method, ConsolidateSourceTableTask obtains datasets from the input Butler data repository and persists outputs to the output Butler data repository. Note that configurations for ConsolidateSourceTableTask, and its subtasks, affect what datasets are persisted and what their content is.

Input datasets¶

sourceTable: Per-detector, parquet-formatted Source Table that has been transformed to DPDD-specification

Output datasets¶

sourceTable_visit: Per-visit, parquet-formatted Source Table that has been transformed to DPDD-specification

Retargetable subtasks¶

No subtasks.

Configuration fields¶

connections¶

Data type: lsst.pipe.base.config.ConsolidateSourceTableConfigConnections
Field type: ConfigField

Configurations describing the connections of the PipelineTask to datatypes

saveLogOutput¶

Default: True
Field type: bool Field

Flag to enable/disable saving of log output for a task, enabled by default.

saveMetadata¶

Default: True
Field type: bool Field

Flag to enable/disable metadata saving for a task, enabled by default. Deprecated: This field is deprecated and will be removed after v26.

Navigation