DipoleMeasurementTask¶
-
class
lsst.ip.diffim.
DipoleMeasurementTask
(schema, algMetadata=None, **kwds)¶ Bases:
lsst.meas.base.sfm.SingleFrameMeasurementTask
! @anchor DipoleMeasurementTask
@brief Measurement of Sources, specifically ones from difference images, for characterization as dipoles
@section ip_diffim_dipolemeas_Contents Contents
- @ref ip_diffim_dipolemeas_Purpose
- @ref ip_diffim_dipolemeas_Initialize
- @ref ip_diffim_dipolemeas_IO
- @ref ip_diffim_dipolemeas_Config
- @ref ip_diffim_dipolemeas_Metadata
- @ref ip_diffim_dipolemeas_Debug
- @ref ip_diffim_dipolemeas_Example
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Purpose Description
This class provides a default configuration for running Source measurement on image differences.
These default plugins include: @dontinclude dipoleMeasurement.py @skip class DipoleMeasurementConfig @until self.doReplaceWithNoise
These plugins enabled by default allow the user to test the hypothesis that the Source is a dipole. This includes a set of measurements derived from intermediate base classes DipoleCentroidAlgorithm and DipoleFluxAlgorithm. Their respective algorithm control classes are defined in DipoleCentroidControl and DipoleFluxControl. Each centroid and flux measurement will have _neg (negative) and _pos (positive lobe) fields.
The first set of measurements uses a “naive” alrogithm for centroid and flux measurements, implemented in NaiveDipoleCentroidControl and NaiveDipoleFluxControl. The algorithm uses a naive 3x3 weighted moment around the nominal centroids of each peak in the Source Footprint. These algorithms fill the table fields ip_diffim_NaiveDipoleCentroid* and ip_diffim_NaiveDipoleFlux*
The second set of measurements undertakes a joint-Psf model on the negative and positive lobe simultaneously. This fit simultaneously solves for the negative and positive lobe centroids and fluxes using non-linear least squares minimization. The fields are stored in table elements ip_diffim_PsfDipoleFlux*.
Because this Task is just a config for SourceMeasurementTask, the same result may be acheived by manually editing the config and running SourceMeasurementTask. For example:
@code config = SingleFrameMeasurementConfig() config.plugins.names = [“base_PsfFlux”,
“ip_diffim_PsfDipoleFlux”, “ip_diffim_NaiveDipoleFlux”, “ip_diffim_NaiveDipoleCentroid”, “ip_diffim_ClassificationDipole”, “base_CircularApertureFlux”, “base_SkyCoord”]config.slots.calibFlux = None config.slots.modelFlux = None config.slots.gaussianFlux = None config.slots.shape = None config.slots.centroid = “ip_diffim_NaiveDipoleCentroid” config.doReplaceWithNoise = False
schema = afwTable.SourceTable.makeMinimalSchema() task = SingleFrameMeasurementTask(schema, config=config)
task.run(sources, exposure) @endcode
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Initialize Task initialization
@copydoc __init__
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_IO Invoking the Task
@copydoc run
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Config Configuration parameters
See @ref DipoleMeasurementConfig
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Metadata Quantities set in Metadata
No specific values are set in the Task metadata. However, the Source schema are modified to store the results of the dipole-specific measurements.
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Debug Debug variables
The @link lsst.pipe.base.cmdLineTask.CmdLineTask command line task@endlink interface supports a flag @c -d/–debug to import @b debug.py from your @c PYTHONPATH. The relevant contents of debug.py for this Task include:
- @code{.py}
import sys import lsstDebug def DebugInfo(name):
di = lsstDebug.getInfo(name) if name == “lsst.ip.diffim.dipoleMeasurement”:
di.display = True # enable debug output di.maskTransparency = 90 # ds9 mask transparency di.displayDiaSources = True # show exposure with dipole resultsreturn di
lsstDebug.Info = DebugInfo lsstDebug.frame = 1
@endcode
#-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
@section ip_diffim_dipolemeas_Example A complete example of using DipoleMeasurementTask
This code is dipoleMeasTask.py in the examples directory, and can be run as @em e.g. @code examples/dipoleMeasTask.py examples/dipoleMeasTask.py –debug examples/dipoleMeasTask.py –debug –image /path/to/image.fits @endcode
@dontinclude dipoleMeasTask.py Start the processing by parsing the command line, where the user has the option of enabling debugging output and/or sending their own image for demonstration (in case they have not downloaded the afwdata package). @skip main @until run
@dontinclude dipoleMeasTask.py The processing occurs in the run function. We first extract an exposure from disk or afwdata, displaying it if requested: @skip args @until mtv
Create a default source schema that we will append fields to as we add more algorithms: @skip makeMinimalSchema @until makeMinimalSchema
Create the detection and measurement Tasks, with some minor tweaking of their configs: @skip Create @until measureTask
Having fully initialied the schema, we create a Source table from it: @skip output @until SourceTable
Run detection: @skip Process @until detectionTask
Because we are looking for dipoles, we need to merge the positive and negative detections: @skip Merge @until numNeg
Finally, perform measurement (both standard and dipole-specialized) on the merged sources: @skip measureTask @until measureTask
Optionally display debugging information: @skip Display @until displayDipoles #-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Attributes Summary
NOISE_EXPOSURE_ID
NOISE_OFFSET
NOISE_SEED_MULTIPLIER
NOISE_SOURCE
Methods Summary
callMeasure
(measRecord, *args, **kwds)! callMeasureN
(measCat, *args, **kwds)! doMeasurement
(plugin, measRecord, *args, **kwds)! doMeasurementN
(plugin, measCat, *args, **kwds)! emptyMetadata
()Empty (clear) the metadata for this Task and all sub-Tasks. getAllSchemaCatalogs
()Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict. getFullMetadata
()Get metadata for all tasks. getFullName
()Get the task name as a hierarchical name including parent task names. getName
()Get the name of the task. getPluginLogName
(pluginName)getSchemaCatalogs
()Get the schemas generated by this task. getTaskDict
()Get a dictionary of all tasks as a shallow copy. initializePlugins
(**kwds)Initialize the plugins (and slots) according to the configuration. makeField
(doc)Make a lsst.pex.config.ConfigurableField
for this task.makeSubtask
(name, **keyArgs)Create a subtask as a new instance as the name
attribute of this task.measure
(measCat, exposure)! run
(measCat, exposure[, noiseImage, …])! runPlugins
(noiseReplacer, measCat, exposure)Function which calls the defined measument plugins on an exposure timer
(name[, logLevel])Context manager to log performance data for an arbitrary block of code. Attributes Documentation
-
NOISE_EXPOSURE_ID
= 'NOISE_EXPOSURE_ID'¶
-
NOISE_OFFSET
= 'NOISE_OFFSET'¶
-
NOISE_SEED_MULTIPLIER
= 'NOISE_SEED_MULTIPLIER'¶
-
NOISE_SOURCE
= 'NOISE_SOURCE'¶
Methods Documentation
-
callMeasure
(measRecord, *args, **kwds)¶ ! Call the measure() method on all plugins, handling exceptions in a consistent way.
- @param[in,out] measRecord lsst.afw.table.SourceRecord that corresponds to the object being
- measured, and where outputs should be written.
@param[in] *args Positional arguments forwarded to Plugin.measure() @param[in] **kwds Keyword arguments. Two are handled locally:
- beginOrder: beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.
- endOrder: ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.
the rest are forwarded to Plugin.measure()
This method can be used with plugins that have different signatures; the only requirement is that ‘measRecord’ be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.
This method should be considered “protected”; it is intended for use by derived classes, not users.
-
callMeasureN
(measCat, *args, **kwds)¶ ! Call the measureN() method on all plugins, handling exceptions in a consistent way.
- @param[in,out] measCat lsst.afw.table.SourceCatalog containing records for just
- the source family to be measured, and where outputs should be written.
- @param[in] beginOrder beginning execution order (inclusive): measurements with
- executionOrder < beginOrder are not executed. None for no limit.
- @param[in] endOrder ending execution order (exclusive): measurements with
- executionOrder >= endOrder are not executed. None for no limit.
@param[in] *args Positional arguments forwarded to Plugin.measure() @param[in] **kwds Keyword arguments. Two are handled locally:
- beginOrder: beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.
- endOrder: ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.
the rest are forwarded to Plugin.measure()
This method can be used with plugins that have different signatures; the only requirement is that ‘measRecord’ be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.
This method should be considered “protected”; it is intended for use by derived classes, not users.
-
doMeasurement
(plugin, measRecord, *args, **kwds)¶ ! Call the measure() method on the nominated plugin, handling exceptions in a consistent way.
@param[in] plugin Plugin that will measure @param[in,out] measRecord lsst.afw.table.SourceRecord that corresponds to the object being
measured, and where outputs should be written.@param[in] *args Positional arguments forwarded to plugin.measure() @param[in] **kwds Keyword arguments forwarded to plugin.measure()
This method can be used with plugins that have different signatures; the only requirement is that the ‘plugin’ and ‘measRecord’ be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.
This method should be considered “protected”; it is intended for use by derived classes, not users.
-
doMeasurementN
(plugin, measCat, *args, **kwds)¶ ! Call the measureN() method on the nominated plugin, handling exceptions in a consistent way.
@param[in] plugin Plugin that will measure @param[in,out] measCat lsst.afw.table.SourceCatalog containing records for just
the source family to be measured, and where outputs should be written.@param[in] *args Positional arguments forwarded to plugin.measureN() @param[in] **kwds Keyword arguments forwarded to plugin.measureN()
This method can be used with plugins that have different signatures; the only requirement is that the ‘plugin’ and ‘measCat’ be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin.
This method should be considered “protected”; it is intended for use by derived classes, not users.
-
emptyMetadata
()¶ Empty (clear) the metadata for this Task and all sub-Tasks.
-
getAllSchemaCatalogs
()¶ Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict.
Returns: - schemacatalogs :
dict
Keys are butler dataset type, values are a empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for all tasks in the hierarchy, from the top-level task down through all subtasks.
Notes
This method may be called on any task in the hierarchy; it will return the same answer, regardless.
The default implementation should always suffice. If your subtask uses schemas the override
Task.getSchemaCatalogs
, not this method.- schemacatalogs :
-
getFullMetadata
()¶ Get metadata for all tasks.
Returns: - metadata :
lsst.daf.base.PropertySet
The
PropertySet
keys are the full task name. Values are metadata for the top-level task and all subtasks, sub-subtasks, etc..
Notes
The returned metadata includes timing information (if
@timer.timeMethod
is used) and any metadata set by the task. The name of each item consists of the full task name with.
replaced by:
, followed by.
and the name of the item, e.g.:topLevelTaskName:subtaskName:subsubtaskName.itemName
using
:
in the full task name disambiguates the rare situation that a task has a subtask and a metadata item with the same name.- metadata :
-
getFullName
()¶ Get the task name as a hierarchical name including parent task names.
Returns: - fullName :
str
The full name consists of the name of the parent task and each subtask separated by periods. For example:
- The full name of top-level task “top” is simply “top”.
- The full name of subtask “sub” of top-level task “top” is “top.sub”.
- The full name of subtask “sub2” of subtask “sub” of top-level task “top” is “top.sub.sub2”.
- fullName :
-
getPluginLogName
(pluginName)¶
-
getSchemaCatalogs
()¶ Get the schemas generated by this task.
Returns: - schemaCatalogs :
dict
Keys are butler dataset type, values are an empty catalog (an instance of the appropriate
lsst.afw.table
Catalog type) for this task.
See also
Task.getAllSchemaCatalogs
Notes
Warning
Subclasses that use schemas must override this method. The default implemenation returns an empty dict.
This method may be called at any time after the Task is constructed, which means that all task schemas should be computed at construction time, not when data is actually processed. This reflects the philosophy that the schema should not depend on the data.
Returning catalogs rather than just schemas allows us to save e.g. slots for SourceCatalog as well.
- schemaCatalogs :
-
getTaskDict
()¶ Get a dictionary of all tasks as a shallow copy.
Returns: - taskDict :
dict
Dictionary containing full task name: task object for the top-level task and all subtasks, sub-subtasks, etc..
- taskDict :
-
initializePlugins
(**kwds)¶ Initialize the plugins (and slots) according to the configuration.
Derived class constructors should call this method to fill the self.plugins attribute and add correspond output fields and slot aliases to the output schema.
In addition to the attributes added by BaseMeasurementTask.__init__, a self.schema attribute holding the output schema must also be present before this method is called, .
Keyword arguments are forwarded directly to plugin constructors, allowing derived classes to use plugins with different signatures.
-
classmethod
makeField
(doc)¶ Make a
lsst.pex.config.ConfigurableField
for this task.Parameters: - doc :
str
Help text for the field.
Returns: - configurableField :
lsst.pex.config.ConfigurableField
A
ConfigurableField
for this task.
Examples
Provides a convenient way to specify this task is a subtask of another task.
Here is an example of use:
class OtherTaskConfig(lsst.pex.config.Config) aSubtask = ATaskClass.makeField("a brief description of what this task does")
- doc :
-
makeSubtask
(name, **keyArgs)¶ Create a subtask as a new instance as the
name
attribute of this task.Parameters: - name :
str
Brief name of the subtask.
- keyArgs
Extra keyword arguments used to construct the task. The following arguments are automatically provided and cannot be overridden:
- “config”.
- “parentTask”.
Notes
The subtask must be defined by
Task.config.name
, an instance of pex_config ConfigurableField or RegistryField.- name :
-
measure
(measCat, exposure)¶ ! Backwards-compatibility alias for run()
-
run
(measCat, exposure, noiseImage=None, exposureId=None, beginOrder=None, endOrder=None)¶ ! Run single frame measurement over an exposure and source catalog
- @param[in,out] measCat lsst.afw.table.SourceCatalog to be filled with outputs. Must
- contain all the SourceRecords to be measured (with Footprints attached), and have a schema that is a superset of self.schema.
- @param[in] exposure lsst.afw.image.ExposureF, containing the pixel data to
- be measured and the associated Psf, Wcs, etc.
- @param[in] noiseImage optional lsst.afw.image.ImageF for test which need to control
- noiseReplacement
- @param[in] exposureId optional unique exposureId used to calculate random number
- generator seed in the NoiseReplacer.
- @param[in] beginOrder beginning execution order (inclusive): measurements with
- executionOrder < beginOrder are not executed. None for no limit.
- @param[in] endOrder ending execution order (exclusive): measurements with
- executionOrder >= endOrder are not executed. None for no limit.
-
runPlugins
(noiseReplacer, measCat, exposure, beginOrder=None, endOrder=None)¶ Function which calls the defined measument plugins on an exposure
Parameters: - noiseReplacer : lsst.meas.base.NoiseReplacer
noiseReplacer to fill sources not being measured with noise.
- measCat : lsst.afw.table.SourceCatalog
SourceCatalog to be filled with outputs. Must contain all the SourceRecords to be measured (with Footprints attached), and have a schema that is a superset of self.schema.
- exposure : lsst.afw.image.ExposureF
Exposure contaning the pixel data to be measured and the associated PSF, WCS, etc.
- beginOrder : float
beginning execution order (inclusive): measurements with executionOrder < beginOrder are not executed. None for no limit.
- endOrder : float
ending execution order (exclusive): measurements with executionOrder >= endOrder are not executed. None for no limit.
-
timer
(name, logLevel=10000)¶ Context manager to log performance data for an arbitrary block of code.
Parameters: - name :
str
Name of code being timed; data will be logged using item name:
Start
andEnd
.- logLevel
A
lsst.log
level constant.
See also
timer.logInfo
Examples
Creating a timer context:
with self.timer("someCodeToTime"): pass # code to time
- name :