DipoleMeasurementTask

class lsst.ip.diffim.DipoleMeasurementTask(schema, algMetadata=None, **kwds)

Bases: lsst.meas.base.sfm.SingleFrameMeasurementTask

! @anchor DipoleMeasurementTask

@brief Measurement of Sources, specifically ones from difference images, for characterization as dipoles

@section ip_diffim_dipolemeas_Contents Contents

  • @ref ip_diffim_dipolemeas_Purpose
  • @ref ip_diffim_dipolemeas_Initialize
  • @ref ip_diffim_dipolemeas_IO
  • @ref ip_diffim_dipolemeas_Config
  • @ref ip_diffim_dipolemeas_Metadata
  • @ref ip_diffim_dipolemeas_Debug
  • @ref ip_diffim_dipolemeas_Example

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Purpose Description

This class provides a default configuration for running Source measurement on image differences.

These default plugins include: @dontinclude dipoleMeasurement.py @skip class DipoleMeasurementConfig @until self.doReplaceWithNoise

These plugins enabled by default allow the user to test the hypothesis that the Source is a dipole. This includes a set of measurements derived from intermediate base classes DipoleCentroidAlgorithm and DipoleFluxAlgorithm. Their respective algorithm control classes are defined in DipoleCentroidControl and DipoleFluxControl. Each centroid and flux measurement will have _neg (negative) and _pos (positive lobe) fields.

The first set of measurements uses a “naive” alrogithm for centroid and flux measurements, implemented in NaiveDipoleCentroidControl and NaiveDipoleFluxControl. The algorithm uses a naive 3x3 weighted moment around the nominal centroids of each peak in the Source Footprint. These algorithms fill the table fields ip_diffim_NaiveDipoleCentroid* and ip_diffim_NaiveDipoleFlux*

The second set of measurements undertakes a joint-Psf model on the negative and positive lobe simultaneously. This fit simultaneously solves for the negative and positive lobe centroids and fluxes using non-linear least squares minimization. The fields are stored in table elements ip_diffim_PsfDipoleFlux*.

Because this Task is just a config for SourceMeasurementTask, the same result may be acheived by manually editing the config and running SourceMeasurementTask. For example:

@code config = SingleFrameMeasurementConfig() config.plugins.names = [“base_PsfFlux”,

“ip_diffim_PsfDipoleFlux”, “ip_diffim_NaiveDipoleFlux”, “ip_diffim_NaiveDipoleCentroid”, “ip_diffim_ClassificationDipole”, “base_CircularApertureFlux”, “base_SkyCoord”]

config.slots.calibFlux = None config.slots.modelFlux = None config.slots.gaussianFlux = None config.slots.shape = None config.slots.centroid = “ip_diffim_NaiveDipoleCentroid” config.doReplaceWithNoise = False

schema = afwTable.SourceTable.makeMinimalSchema() task = SingleFrameMeasurementTask(schema, config=config)

task.run(sources, exposure) @endcode

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Initialize Task initialization

@copydoc __init__

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_IO Invoking the Task

@copydoc run

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Config Configuration parameters

See @ref DipoleMeasurementConfig

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Metadata Quantities set in Metadata

No specific values are set in the Task metadata. However, the Source schema are modified to store the results of the dipole-specific measurements.

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Debug Debug variables

The @link lsst.pipe.base.cmdLineTask.CmdLineTask command line task@endlink interface supports a flag @c -d/–debug to import @b debug.py from your @c PYTHONPATH. The relevant contents of debug.py for this Task include:

@code{.py}

import sys import lsstDebug def DebugInfo(name):

di = lsstDebug.getInfo(name) if name == “lsst.ip.diffim.dipoleMeasurement”:

di.display = True # enable debug output di.maskTransparency = 90 # ds9 mask transparency di.displayDiaSources = True # show exposure with dipole results

return di

lsstDebug.Info = DebugInfo lsstDebug.frame = 1

@endcode

#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

@section ip_diffim_dipolemeas_Example A complete example of using DipoleMeasurementTask

This code is dipoleMeasTask.py in the examples directory, and can be run as @em e.g. @code examples/dipoleMeasTask.py examples/dipoleMeasTask.py –debug examples/dipoleMeasTask.py –debug –image /path/to/image.fits @endcode

@dontinclude dipoleMeasTask.py Start the processing by parsing the command line, where the user has the option of enabling debugging output and/or sending their own image for demonstration (in case they have not downloaded the afwdata package). @skip main @until run

@dontinclude dipoleMeasTask.py The processing occurs in the run function. We first extract an exposure from disk or afwdata, displaying it if requested: @skip args @until mtv

Create a default source schema that we will append fields to as we add more algorithms: @skip makeMinimalSchema @until makeMinimalSchema

Create the detection and measurement Tasks, with some minor tweaking of their configs: @skip Create @until measureTask

Having fully initialied the schema, we create a Source table from it: @skip output @until SourceTable

Run detection: @skip Process @until detectionTask

Because we are looking for dipoles, we need to merge the positive and negative detections: @skip Merge @until numNeg

Finally, perform measurement (both standard and dipole-specialized) on the merged sources: @skip measureTask @until measureTask

Optionally display debugging information: @skip Display @until displayDipoles #-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Attributes Summary

NOISE_EXPOSURE_ID
NOISE_OFFSET
NOISE_SEED_MULTIPLIER
NOISE_SOURCE

Methods Summary

callMeasure(measRecord, *args, **kwds) !
callMeasureN(measCat, *args, **kwds) !
doMeasurement(plugin, measRecord, *args, **kwds) !
doMeasurementN(plugin, measCat, *args, **kwds) !
emptyMetadata() Empty (clear) the metadata for this Task and all sub-Tasks.
getAllSchemaCatalogs() Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict.
getFullMetadata() Get metadata for all tasks.
getFullName() Get the task name as a hierarchical name including parent task names.
getName() Get the name of the task.
getPluginLogName(pluginName)
getSchemaCatalogs() Get the schemas generated by this task.
getTaskDict() Get a dictionary of all tasks as a shallow copy.
initializePlugins(**kwds) Initialize the plugins (and slots) according to the configuration.
makeField(doc) Make a lsst.pex.config.ConfigurableField for this task.
makeSubtask(name, **keyArgs) Create a subtask as a new instance as the name attribute of this task.
measure(measCat, exposure) !
run(measCat, exposure[, noiseImage, …]) !
runPlugins(noiseReplacer, measCat, exposure) Function which calls the defined measument plugins on an exposure
timer(name[, logLevel]) Context manager to log performance data for an arbitrary block of code.

Attributes Documentation

NOISE_EXPOSURE_ID = 'NOISE_EXPOSURE_ID'
NOISE_OFFSET = 'NOISE_OFFSET'
NOISE_SEED_MULTIPLIER = 'NOISE_SEED_MULTIPLIER'
NOISE_SOURCE = 'NOISE_SOURCE'

Methods Documentation

callMeasure(measRecord, *args, **kwds)

! Call the measure() method on all plugins, handling exceptions in a consistent way.

@param[in,out] measRecord lsst.afw.table.SourceRecord that corresponds to the object being
measured, and where outputs should be written.

@param[in] *args Positional arguments forwarded to Plugin.measure() @param[in] **kwds Keyword arguments. Two are handled locally:

  • beginOrder: beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.
  • endOrder: ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.

the rest are forwarded to Plugin.measure()

This method can be used with plugins that have different signatures; the only requirement is that ‘measRecord’ be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.

This method should be considered “protected”; it is intended for use by derived classes, not users.

callMeasureN(measCat, *args, **kwds)

! Call the measureN() method on all plugins, handling exceptions in a consistent way.

@param[in,out] measCat lsst.afw.table.SourceCatalog containing records for just
the source family to be measured, and where outputs should be written.
@param[in] beginOrder beginning execution order (inclusive): measurements with
executionOrder < beginOrder are not executed. None for no limit.
@param[in] endOrder ending execution order (exclusive): measurements with
executionOrder >= endOrder are not executed. None for no limit.

@param[in] *args Positional arguments forwarded to Plugin.measure() @param[in] **kwds Keyword arguments. Two are handled locally:

  • beginOrder: beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.
  • endOrder: ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.

the rest are forwarded to Plugin.measure()

This method can be used with plugins that have different signatures; the only requirement is that ‘measRecord’ be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.

This method should be considered “protected”; it is intended for use by derived classes, not users.

doMeasurement(plugin, measRecord, *args, **kwds)

! Call the measure() method on the nominated plugin, handling exceptions in a consistent way.

@param[in] plugin Plugin that will measure @param[in,out] measRecord lsst.afw.table.SourceRecord that corresponds to the object being

measured, and where outputs should be written.

@param[in] *args Positional arguments forwarded to plugin.measure() @param[in] **kwds Keyword arguments forwarded to plugin.measure()

This method can be used with plugins that have different signatures; the only requirement is that the ‘plugin’ and ‘measRecord’ be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.

This method should be considered “protected”; it is intended for use by derived classes, not users.

doMeasurementN(plugin, measCat, *args, **kwds)

! Call the measureN() method on the nominated plugin, handling exceptions in a consistent way.

@param[in] plugin Plugin that will measure @param[in,out] measCat lsst.afw.table.SourceCatalog containing records for just

the source family to be measured, and where outputs should be written.

@param[in] *args Positional arguments forwarded to plugin.measureN() @param[in] **kwds Keyword arguments forwarded to plugin.measureN()

This method can be used with plugins that have different signatures; the only requirement is that the ‘plugin’ and ‘measCat’ be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.

This method should be considered “protected”; it is intended for use by derived classes, not users.

emptyMetadata()

Empty (clear) the metadata for this Task and all sub-Tasks.

getAllSchemaCatalogs()

Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict.

Returns:
schemacatalogs : dict

Keys are butler dataset type, values are a empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for all tasks in the hierarchy, from the top-level task down through all subtasks.

Notes

This method may be called on any task in the hierarchy; it will return the same answer, regardless.

The default implementation should always suffice. If your subtask uses schemas the override Task.getSchemaCatalogs, not this method.

getFullMetadata()

Get metadata for all tasks.

Returns:
metadata : lsst.daf.base.PropertySet

The PropertySet keys are the full task name. Values are metadata for the top-level task and all subtasks, sub-subtasks, etc..

Notes

The returned metadata includes timing information (if @timer.timeMethod is used) and any metadata set by the task. The name of each item consists of the full task name with . replaced by :, followed by . and the name of the item, e.g.:

topLevelTaskName:subtaskName:subsubtaskName.itemName

using : in the full task name disambiguates the rare situation that a task has a subtask and a metadata item with the same name.

getFullName()

Get the task name as a hierarchical name including parent task names.

Returns:
fullName : str

The full name consists of the name of the parent task and each subtask separated by periods. For example:

  • The full name of top-level task “top” is simply “top”.
  • The full name of subtask “sub” of top-level task “top” is “top.sub”.
  • The full name of subtask “sub2” of subtask “sub” of top-level task “top” is “top.sub.sub2”.
getName()

Get the name of the task.

Returns:
taskName : str

Name of the task.

See also

getFullName

getPluginLogName(pluginName)
getSchemaCatalogs()

Get the schemas generated by this task.

Returns:
schemaCatalogs : dict

Keys are butler dataset type, values are an empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for this task.

See also

Task.getAllSchemaCatalogs

Notes

Warning

Subclasses that use schemas must override this method. The default implemenation returns an empty dict.

This method may be called at any time after the Task is constructed, which means that all task schemas should be computed at construction time, not when data is actually processed. This reflects the philosophy that the schema should not depend on the data.

Returning catalogs rather than just schemas allows us to save e.g. slots for SourceCatalog as well.

getTaskDict()

Get a dictionary of all tasks as a shallow copy.

Returns:
taskDict : dict

Dictionary containing full task name: task object for the top-level task and all subtasks, sub-subtasks, etc..

initializePlugins(**kwds)

Initialize the plugins (and slots) according to the configuration.

Derived class constructors should call this method to fill the self.plugins attribute and add correspond output fields and slot aliases to the output schema.

In addition to the attributes added by BaseMeasurementTask.__init__, a self.schema attribute holding the output schema must also be present before this method is called, .

Keyword arguments are forwarded directly to plugin constructors, allowing derived classes to use plugins with different signatures.

classmethod makeField(doc)

Make a lsst.pex.config.ConfigurableField for this task.

Parameters:
doc : str

Help text for the field.

Returns:
configurableField : lsst.pex.config.ConfigurableField

A ConfigurableField for this task.

Examples

Provides a convenient way to specify this task is a subtask of another task.

Here is an example of use:

class OtherTaskConfig(lsst.pex.config.Config)
    aSubtask = ATaskClass.makeField("a brief description of what this task does")
makeSubtask(name, **keyArgs)

Create a subtask as a new instance as the name attribute of this task.

Parameters:
name : str

Brief name of the subtask.

keyArgs

Extra keyword arguments used to construct the task. The following arguments are automatically provided and cannot be overridden:

  • “config”.
  • “parentTask”.

Notes

The subtask must be defined by Task.config.name, an instance of pex_config ConfigurableField or RegistryField.

measure(measCat, exposure)

! Backwards-compatibility alias for run()

run(measCat, exposure, noiseImage=None, exposureId=None, beginOrder=None, endOrder=None)

! Run single frame measurement over an exposure and source catalog

@param[in,out] measCat lsst.afw.table.SourceCatalog to be filled with outputs. Must
contain all the SourceRecords to be measured (with Footprints attached), and have a schema that is a superset of self.schema.
@param[in] exposure lsst.afw.image.ExposureF, containing the pixel data to
be measured and the associated Psf, Wcs, etc.
@param[in] noiseImage optional lsst.afw.image.ImageF for test which need to control
noiseReplacement
@param[in] exposureId optional unique exposureId used to calculate random number
generator seed in the NoiseReplacer.
@param[in] beginOrder beginning execution order (inclusive): measurements with
executionOrder < beginOrder are not executed. None for no limit.
@param[in] endOrder ending execution order (exclusive): measurements with
executionOrder >= endOrder are not executed. None for no limit.
runPlugins(noiseReplacer, measCat, exposure, beginOrder=None, endOrder=None)

Function which calls the defined measument plugins on an exposure

Parameters:
noiseReplacer : lsst.meas.base.NoiseReplacer

noiseReplacer to fill sources not being measured with noise.

measCat : lsst.afw.table.SourceCatalog

SourceCatalog to be filled with outputs. Must contain all the SourceRecords to be measured (with Footprints attached), and have a schema that is a superset of self.schema.

exposure : lsst.afw.image.ExposureF

Exposure contaning the pixel data to be measured and the associated PSF, WCS, etc.

beginOrder : float

beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.

endOrder : float

ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.

timer(name, logLevel=10000)

Context manager to log performance data for an arbitrary block of code.

Parameters:
name : str

Name of code being timed; data will be logged using item name: Start and End.

logLevel

A lsst.log level constant.

See also

timer.logInfo

Examples

Creating a timer context:

with self.timer("someCodeToTime"):
    pass  # code to time