DatasetTypeNode

class lsst.pipe.base.pipeline_graph.DatasetTypeNode(dataset_type: DatasetType, is_initial_query_constraint: bool, is_prerequisite: bool, producing_edge: WriteEdge | None, consuming_edges: Collection[ReadEdge])

Bases: object

A node in a pipeline graph that represents a resolved dataset type.

Notes

A dataset type node represents a common definition of the dataset type across the entire graph - it is never a component, and the storage class is the registry dataset type’s storage class or (if there isn’t one) the one defined by the producing task.

Dataset type nodes are intentionally not equality comparable, since there are many different (and useful) ways to compare these objects with no clear winner as the most obvious behavior.

Attributes Summary

dimensions	Dimensions of the dataset type.
is_calibration	Whether this dataset type can be included in CALIBRATION collections.
key	Key that identifies this dataset type in internal and exported networkx graphs.
name	Name of the dataset type.
storage_class	Storage class for this dataset type.
storage_class_name	String name of the storage class for this dataset type.

Methods Summary

generalize_ref(ref)

Convert a DatasetRef with the dataset type associated with some task to one with the common dataset type defined by this node.

Attributes Documentation

dimensions

Dimensions of the dataset type.

is_calibration

Whether this dataset type can be included in CALIBRATION collections.

key

Key that identifies this dataset type in internal and exported networkx graphs.

name

Name of the dataset type.

This is always the parent dataset type, never that of a component.

storage_class

Storage class for this dataset type.

storage_class_name

String name of the storage class for this dataset type.

Methods Documentation

generalize_ref(ref: DatasetRef) → DatasetRef

Convert a DatasetRef with the dataset type associated with some task to one with the common dataset type defined by this node.

Parameters:

reflsst.daf.butler.DatasetRef

Reference whose dataset type is convertible to this node’s, either because it is a component with the node’s dataset type as its parent, or because it has a compatible storage class.

Returns:

reflsst.daf.butler.DatasetRef

Reference with exactly this node’s dataset type.