DatasetRecordStorageManager¶
- class lsst.daf.butler.registry.interfaces.DatasetRecordStorageManager¶
Bases:
VersionedExtension
An interface that manages the tables that describe datasets.
DatasetRecordStorageManager
primarily serves as a container and factory forDatasetRecordStorage
instances, which each provide access to the records for a differentDatasetType
.Methods Summary
addDatasetForeignKey
(tableSpec, *[, name, ...])Add a foreign key (field and constraint) referencing the dataset table.
Return extension version as defined by current implementation.
Return full name of the extension.
find
(name)Return an object that provides access to the records associated with the given
DatasetType
name, if one exists.getCollectionSummary
(collection)Return a summary for the given collection.
getDatasetRef
(id)Return a
DatasetRef
for the given dataset primary key value.Return type used for columns storing dataset IDs.
initialize
(db, context, *, collections, ...)Construct an instance of the manager.
refresh
()Ensure all other operations on this manager are aware of any dataset types that may have been registered by other clients since it was initialized or last refreshed.
register
(datasetType)Ensure that this
Registry
can hold records for the givenDatasetType
, creating new tables as necessary.remove
(name)Remove the dataset type.
Return digest for schema piece managed by this extension.
supportsIdGenerationMode
(mode)Test whether the given dataset ID generation mode is supported by
insert
.Methods Documentation
- abstract classmethod addDatasetForeignKey(tableSpec: TableSpec, *, name: str = 'dataset', constraint: bool = True, onDelete: str | None = None, **kwargs: Any) FieldSpec ¶
Add a foreign key (field and constraint) referencing the dataset table.
- Parameters:
- tableSpec
ddl.TableSpec
Specification for the table that should reference the dataset table. Will be modified in place.
- name: `str`, optional
A name to use for the prefix of the new field; the full name is
{name}_id
.- onDelete: `str`, optional
One of “CASCADE” or “SET NULL”, indicating what should happen to the referencing row if the collection row is deleted.
None
indicates that this should be an integrity error.- constraint: `bool`, optional
If
False
(True
is default), add a field that can be joined to the dataset primary key, but do not add a foreign key constraint.- **kwargs
Additional keyword arguments are forwarded to the
ddl.FieldSpec
constructor (only thename
anddtype
arguments are otherwise provided).
- tableSpec
- Returns:
- idSpec
ddl.FieldSpec
Specification for the ID field.
- idSpec
- abstract classmethod currentVersion() VersionTuple | None ¶
Return extension version as defined by current implementation.
This method can return
None
if an extension does not require its version to be saved or checked.- Returns:
- version
VersionTuple
Current extension version or
None
.
- version
- classmethod extensionName() str ¶
Return full name of the extension.
This name should match the name defined in registry configuration. It is also stored in registry attributes. Default implementation returns full class name.
- Returns:
- name
str
Full extension name.
- name
- abstract find(name: str) DatasetRecordStorage | None ¶
Return an object that provides access to the records associated with the given
DatasetType
name, if one exists.- Parameters:
- name
str
Name of the dataset type.
- name
- Returns:
- records
DatasetRecordStorage
orNone
The object representing the records for the given dataset type, or
None
if there are no records for that dataset type.
- records
Notes
Dataset types registered by another client of the same repository since the last call to
initialize
orrefresh
may not be found.
- abstract getCollectionSummary(collection: CollectionRecord) CollectionSummary ¶
Return a summary for the given collection.
- Parameters:
- collection
CollectionRecord
Record describing the collection for which a summary is to be retrieved.
- collection
- Returns:
- summary
CollectionSummary
Summary of the dataset types and governor dimension values in this collection.
- summary
- abstract getDatasetRef(id: int | UUID) DatasetRef | None ¶
Return a
DatasetRef
for the given dataset primary key value.
- abstract classmethod getIdColumnType() type ¶
Return type used for columns storing dataset IDs.
This type is used for columns storing
DatasetRef.id
values, usually atype
subclass provided by SQLAlchemy.- Returns:
- dtype
type
Type used for dataset identification in database.
- dtype
- abstract classmethod initialize(db: Database, context: StaticTablesContext, *, collections: CollectionManager, dimensions: DimensionRecordStorageManager) DatasetRecordStorageManager ¶
Construct an instance of the manager.
- Parameters:
- db
Database
Interface to the underlying database engine and namespace.
- context
StaticTablesContext
Context object obtained from
Database.declareStaticTables
; used to declare any tables that should always be present.- collections: `CollectionManager`
Manager object for the collections in this
Registry
.- dimensions
DimensionRecordStorageManager
Manager object for the dimensions in this
Registry
.
- db
- Returns:
- manager
DatasetRecordStorageManager
An instance of a concrete
DatasetRecordStorageManager
subclass.
- manager
- abstract refresh() None ¶
Ensure all other operations on this manager are aware of any dataset types that may have been registered by other clients since it was initialized or last refreshed.
- abstract register(datasetType: DatasetType) Tuple[DatasetRecordStorage, bool] ¶
Ensure that this
Registry
can hold records for the givenDatasetType
, creating new tables as necessary.- Parameters:
- datasetType
DatasetType
Dataset type for which a table should created (as necessary) and an associated
DatasetRecordStorage
returned.
- datasetType
- Returns:
- records
DatasetRecordStorage
The object representing the records for the given dataset type.
- inserted
bool
True
if the dataset type did not exist in the registry before.
- records
Notes
This operation may not be invoked within a
Database.transaction
context.
- abstract remove(name: str) None ¶
Remove the dataset type.
- Parameters:
- name
str
Name of the dataset type.
- name
- abstract schemaDigest() str | None ¶
Return digest for schema piece managed by this extension.
- Returns:
Notes
There is no exact definition of digest format, any string should work. The only requirement for string contents is that it has to remain stable over time if schema does not change but it should produce different string for any change in the schema. In many cases default implementation in
_defaultSchemaDigest
can be used as a reasonable choice.
- abstract classmethod supportsIdGenerationMode(mode: DatasetIdGenEnum) bool ¶
Test whether the given dataset ID generation mode is supported by
insert
.- Parameters:
- mode
DatasetIdGenEnum
Enum value for the mode to test.
- mode
- Returns:
- supported
bool
Whether the given mode is supported.
- supported