LsstCamParseTask

class lsst.obs.lsst.ingest.LsstCamParseTask(config, *args, **kwargs)

Bases: lsst.pipe.tasks.ingest.ParseTask

Parser suitable for lsstCam data.

See LCA-13501 and LSE-400.

Attributes Summary

translator_class

Metadata translation support (astro_metadata_translator.MetadataTranslator).

Methods Summary

emptyMetadata()	Empty (clear) the metadata for this Task and all sub-Tasks.
getAllSchemaCatalogs()	Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict.
getDestination(butler, info, filename)	Get destination for the file
getExtensionName(md)	Get the name of a FITS extension.
getFullMetadata()	Get metadata for all tasks.
getFullName()	Get the task name as a hierarchical name including parent task names.
getInfo(filename)	Get information about the image from the filename and its contents
getInfoFromMetadata(md[, info])	Attempt to pull the desired information out of the header.
getName()	Get the name of the task.
getSchemaCatalogs()	Get the schemas generated by this task.
getTaskDict()	Get a dictionary of all tasks as a shallow copy.
makeField(doc)	Make a lsst.pex.config.ConfigurableField for this task.
makeSubtask(name, **keyArgs)	Create a subtask as a new instance as the name attribute of this task.
timer(name[, logLevel])	Context manager to log performance data for an arbitrary block of code.
translate_controller(md)
translate_date(md)	Retrieve the date of observation as an ISO format string.
translate_dateObs(md)	Retrieve the date of observation as an ISO format string.
translate_dayObs(md)	Generate the day that the observation was taken.
translate_detector(md)	Extract detector ID from metadata
translate_detectorName(md)	Extract ccd ID from CHIPID.
translate_expGroup(md)
translate_expId(md)
translate_expTime(md)
translate_filter(md)	Translate a full filter description into a mere filter name
translate_imageType(md)
translate_lsstSerial(md)
translate_object(md)
translate_obsid(md)
translate_raftName(md)	Extract raft ID from CHIPID.
translate_run(md)
translate_snap(md)	Extract snap number from metadata.
translate_testType(md)
translate_visit(md)
translate_wavelength(md)	Translate wavelength provided by teststand readout.

Attributes Documentation

translator_class = None

Metadata translation support (astro_metadata_translator.MetadataTranslator).

Notes

The default of None will attempt to guess the correct translator, but specifying one (e.g., in obs-package specific ingest) will be faster.

Methods Documentation

emptyMetadata()

Empty (clear) the metadata for this Task and all sub-Tasks.

getAllSchemaCatalogs()

Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict.

Returns

schemacatalogsdict

Keys are butler dataset type, values are a empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for all tasks in the hierarchy, from the top-level task down through all subtasks.

Notes

This method may be called on any task in the hierarchy; it will return the same answer, regardless.

The default implementation should always suffice. If your subtask uses schemas the override Task.getSchemaCatalogs, not this method.

getDestination(butler, info, filename)

Get destination for the file

@param butler Data butler @param info File properties, used as dataId for the butler @param filename Input filename @return Destination filename

static getExtensionName(md)

Get the name of a FITS extension.

Parameters

mdlsst.daf.base.PropertySet

FITS header metadata.

Returns

resultstr or None

The string from the EXTNAME header card if it exists. None otherwise.

getFullMetadata()

Get metadata for all tasks.

Returns

metadatalsst.daf.base.PropertySet

The PropertySet keys are the full task name. Values are metadata for the top-level task and all subtasks, sub-subtasks, etc.

Notes

The returned metadata includes timing information (if @timer.timeMethod is used) and any metadata set by the task. The name of each item consists of the full task name with . replaced by :, followed by . and the name of the item, e.g.:

topLevelTaskName:subtaskName:subsubtaskName.itemName

using : in the full task name disambiguates the rare situation that a task has a subtask and a metadata item with the same name.

getFullName()

Get the task name as a hierarchical name including parent task names.

Returns

fullNamestr

The full name consists of the name of the parent task and each subtask separated by periods. For example:

• The full name of top-level task “top” is simply “top”.

• The full name of subtask “sub” of top-level task “top” is “top.sub”.

• The full name of subtask “sub2” of subtask “sub” of top-level task “top” is “top.sub.sub2”.

getInfo(filename)

Get information about the image from the filename and its contents

Here, we open the image and parse the header.

Parameters

filenamestr

Name of file to inspect

Returns

infodict

File properties

linfolist of dict

List of file properties. Always contains the same as info because no extensions are read.

getInfoFromMetadata(md, info=None)

Attempt to pull the desired information out of the header.

Parameters

mdlsst.daf.base.PropertyList

FITS header.

infodict, optional

File properties, to be updated by this routine. If None it will be created.

Returns

infodict

Translated information from the metadata. Updated form of the input parameter.

Notes

This is done through two mechanisms:

• translation: a property is set directly from the relevant header

  keyword.

• translator: a property is set with the result of calling a method.

The translator methods receive the header metadata and should return the appropriate value, or None if the value cannot be determined.

This implementation constructs an ObservationInfo object prior to calling each translator method, making the translated information available through the observationInfo attribute.

getName()

Get the name of the task.

Returns

taskNamestr

Name of the task.

See also

getFullName

getSchemaCatalogs()

Get the schemas generated by this task.

Returns

schemaCatalogsdict

Keys are butler dataset type, values are an empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for this task.

See also

Task.getAllSchemaCatalogs

Notes

Warning

Subclasses that use schemas must override this method. The default implementation returns an empty dict.

This method may be called at any time after the Task is constructed, which means that all task schemas should be computed at construction time, not when data is actually processed. This reflects the philosophy that the schema should not depend on the data.

Returning catalogs rather than just schemas allows us to save e.g. slots for SourceCatalog as well.

getTaskDict()

Get a dictionary of all tasks as a shallow copy.

Returns

taskDictdict

Dictionary containing full task name: task object for the top-level task and all subtasks, sub-subtasks, etc.

classmethod makeField(doc)

Make a lsst.pex.config.ConfigurableField for this task.

Parameters

docstr

Help text for the field.

Returns

configurableFieldlsst.pex.config.ConfigurableField

A ConfigurableField for this task.

Examples

Provides a convenient way to specify this task is a subtask of another task.

Here is an example of use:

class OtherTaskConfig(lsst.pex.config.Config):
    aSubtask = ATaskClass.makeField("brief description of task")

makeSubtask(name, **keyArgs)

Create a subtask as a new instance as the name attribute of this task.

Parameters

namestr

Brief name of the subtask.

keyArgs

Extra keyword arguments used to construct the task. The following arguments are automatically provided and cannot be overridden:

• “config”.

• “parentTask”.

Notes

The subtask must be defined by Task.config.name, an instance of ConfigurableField or RegistryField.

timer(name, logLevel=10000)

Context manager to log performance data for an arbitrary block of code.

Parameters

namestr

Name of code being timed; data will be logged using item name: Start and End.

logLevel

A lsst.log level constant.

See also

timer.logInfo

Examples

Creating a timer context:

with self.timer("someCodeToTime"):
    pass  # code to time

translate_controller(md)

translate_date(md)

Retrieve the date of observation as an ISO format string.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

dateObsstr

The date that the data was taken in FITS ISO format, e.g. 2018-08-20T21:56:24.608.

translate_dateObs(md)

Retrieve the date of observation as an ISO format string.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

dateObsstr

The date that the data was taken in FITS ISO format, e.g. 2018-08-20T21:56:24.608.

translate_dayObs(md)

Generate the day that the observation was taken.

Parameters

mdPropertyList or PropertySet

image metadata

Returns

dayObsstr

The day that the data was taken, e.g. 1958-02-05.

translate_detector(md)

Extract detector ID from metadata

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

detIDint

Detector ID, e.g. 4.

translate_detectorName(md)

Extract ccd ID from CHIPID.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

ccdIDstr

Name of ccd, e.g. S01.

translate_expGroup(md)

translate_expId(md)

translate_expTime(md)

translate_filter(md)

Translate a full filter description into a mere filter name

Besides being an example of a translator, this is also generally useful. It will only be used if listed as a translator in the configuration.

translate_imageType(md)

translate_lsstSerial(md)

translate_object(md)

translate_obsid(md)

translate_raftName(md)

Extract raft ID from CHIPID.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

raftIDstr

Name of raft, e.g. R21.

translate_run(md)

translate_snap(md)

Extract snap number from metadata.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

snapint

Snap number (default: 0).

translate_testType(md)

translate_visit(md)

translate_wavelength(md)

Translate wavelength provided by teststand readout.

The teststand driving script asks for a wavelength, and then reads the value back to ensure that the correct position was moved to. This number is therefore read back with sub-nm precision. Typically the position is within 0.005nm of the desired position, so we warn if it’s not very close to an integer value.

Future users should be aware that the HIERARCH MONOCH-WAVELENG key is NOT the requested value, and therefore cannot be used as a cross-check that the wavelength was close to the one requested. The only record of the wavelength that was set is in the original filename.

Parameters

mdPropertyList or PropertySet

Image metadata.

Returns

wavelengthint

The recorded wavelength in nanometers as an int.