lsst.pipe.tasks¶
lsst.pipe.tasks
provides many of the Task
classes that drive the LSST Science Pipelines.
The pipeline tasks listed here are useful data processing entry points for most users.
lsst.pipe.tasks
does not provide all the tasks and pipeline tasks in the LSST Science Pipelines.
For a complete list of all available tasks, see Task index and for an introduction to processing data see Getting started with the LSST Science Pipelines.
Using lsst.pipe.tasks¶
Contributing¶
lsst.pipe.tasks
is developed at https://github.com/lsst/pipe_tasks.
You can find Jira issues for this module under the pipe_tasks component.
Task reference¶
Pipeline tasks¶
- AssembleCoaddTask
Assemble a coadded image from a set of warps.
- CalibrateTask
Calibrate an exposure: measure sources and perform astrometric and photometric calibration.
- CharacterizeImageTask
Measure bright sources and use this to estimate background and PSF of an exposure.
- CompareWarpAssembleCoaddTask
Assemble a compareWarp coadded image from a set of warps by masking artifacts detected by comparing PSF-matched warps.
- ConsolidateHealSparsePropertyMapTask
Task to consolidate HealSparse property maps.
- ConsolidateSourceTableTask
Concatenate sourceTable list into a per-visit sourceTable_visit
- ConsolidateVisitSummaryTask
Task to consolidate per-detector visit metadata.
- DcrAssembleCoaddTask
Assemble DCR coadded images from a set of warps.
- DetectCoaddSourcesTask
Detect sources on a single filter coadd.
- FinalizeCharacterizationTask
Run final characterization on exposures.
- HealSparsePropertyMapTask
Task to compute Healsparse property maps.
- HighResolutionHipsTask
Task for making high resolution HiPS images.
- IsolatedStarAssociationTask
Associate sources into isolated star catalogs.
- MakeWarpTask
Warp and optionally PSF-Match calexps onto an a common projection.
- MeasureMergedCoaddSourcesTask
Deblend sources from main catalog in each coadd seperately and measure.
- MergeDetectionsTask
Merge sources detected in coadds of exposures obtained with different filters.
- MergeMeasurementsTask
Merge measurements from multiple bands.
- NumberDeblendChildSourcesMetricTask
Task that computes the number of science sources created through deblending.
- NumberDeblendedSourcesMetricTask
Task that computes the number of science sources that have been deblended.
- TransformSourceTableTask
Transform/standardize a source catalog
- WriteSourceTableTask
Write source table to DataFrame Parquet format.
Tasks¶
- CoaddInputRecorderTask
Subtask that handles filling a CoaddInputs object for a coadd exposure, tracking the CCDs and visits that went into a coadd.
- ComputeExposureSummaryStatsTask
Task to compute exposure summary statistics.
- ExampleSigmaClippedStatsTask
Example task to compute sigma-clipped mean and standard deviation of an image.
- ExampleSimpleStatsTask
Example task to compute mean and standard deviation of an image.
- HealSparseInputMapTask
Task for making a HealSparse input map.
- InterpImageTask
Interpolate over bad image pixels
- LoadReferenceCatalogTask
Load multi-band reference objects from a reference catalog.
- MakeDiscreteSkyMapTask
Make a DiscreteSkyMap in a repository, using the bounding box of a set of calexps.
- MaskStreaksTask
Find streaks or other straight lines in image data.
- MatchBackgroundsTask
Base class for data processing tasks.
- MeasurePsfTask
A task that selects stars from a catalog of sources and uses those to measure the PSF.
- PhotoCalTask
Calculate an Exposure's zero-point given a set of flux measurements of stars matched to an input catalogue.
- PropagateSourceFlagsTask
Task to propagate source flags to coadd objects.
- PropagateVisitFlagsTask
Task to propagate flags from single-frame measurements to coadd measurements.
- PsfWcsSelectImagesTask
Select images using their Wcs and cuts on the PSF properties.
- RegisterTask
Task to register (align) multiple images.
- RepairTask
Repair an exposures defects and cosmic rays via interpolation.
- ReserveIsolatedStarsTask
Reserve isolated stars with repeatable hash.
- ScaleVarianceTask
Scale the variance in a MaskedImage
- ScaleZeroPointTask
Compute scale factor to scale exposures to a desired photometric zero point.
- SetPrimaryFlagsTask
Add isPrimaryKey to a given schema.
- SnapCombineTask
Combine two snaps into a single visit image.
- WarpAndPsfMatchTask
A task to warp and PSF-match an exposure
- WcsSelectImagesTask
Select images using their Wcs.
Configurations¶
- Colorterm
Colorterm correction for one pair of filters
- ColortermDict
A mapping of physical filter label to Colorterm
- ColortermLibrary
A mapping of photometric reference catalog name or glob to ColortermDict
- CullPeaksConfig
Configuration for culling garbage peaks after merging footprints.
- DatabaseSelectImagesConfig
Base configuration for subclasses of BaseSelectImagesTask that use a database.
Python API reference¶
lsst.pipe.tasks.assembleCoadd Module¶
lsst.pipe.tasks.associationUtils Module¶
Utilities for interfacing with hpgeom. Originally implemented in http://github.com/LSSTDESC/dia_pipe and then translated to hpgeom.
Functions¶
|
Return healpix index given ra, dec in degrees |
|
Convert from healpix index to ra,dec in degrees |
|
Convert from equatorial ra,dec in degrees to x,y,z on unit sphere. |
|
Convert equatorial ra,dec in degrees to x,y,z on the unit sphere parameters |
|
Convert from ra,dec to spherical coordinates. |
|
Convert from and a array ra,dec to spherical coordinates. |
|
Get the list of healpix indices within max_rad, min_rad given in radians around ra,dec given in degrees |
lsst.pipe.tasks.background Module¶
Classes¶
|
Configuration for background measurement |
|
Background model for a focal plane camera |
|
Configuration for FocalPlaneBackground |
|
Configuration for MaskObjectsTask |
|
Iterative masking of objects on an Exposure |
|
Configuration for SkyMeasurementTask |
|
Task for creating, persisting and using sky frames |
|
Parameters controlling the measurement of sky statistics |
lsst.pipe.tasks.calexpCutout Module¶
Classes¶
|
Configuration for CalexpCutoutTask |
|
Task for computing cutouts on a specific calexp given positions, xspans, and yspans of the stamps. |
lsst.pipe.tasks.calibrate Module¶
Classes¶
|
Config for CalibrateTask. |
|
Calibrate an exposure: measure sources and perform astrometric and photometric calibration. |
lsst.pipe.tasks.characterizeImage Module¶
Classes¶
|
Config for CharacterizeImageTask. |
|
Measure bright sources and use this to estimate background and PSF of an exposure. |
lsst.pipe.tasks.coaddBase Module¶
Functions¶
|
Constructs SkyInfo used by coaddition tasks for multiple patchId formats. |
Classes¶
|
Base class for coaddition. |
lsst.pipe.tasks.coaddInputRecorder Module¶
Classes¶
|
Subtask that handles filling a CoaddInputs object for a coadd exposure, tracking the CCDs and visits that went into a coadd. |
lsst.pipe.tasks.colorterms Module¶
Classes¶
Exception class indicating we couldn't find a colorterm |
|
|
Colorterm correction for one pair of filters |
|
A mapping of physical filter label to Colorterm |
|
A mapping of photometric reference catalog name or glob to ColortermDict |
lsst.pipe.tasks.computeExposureSummaryStats Module¶
Classes¶
|
Task to compute exposure summary statistics. |
|
Config for ComputeExposureSummaryTask |
lsst.pipe.tasks.cosmicRayPostDiff Module¶
Classes¶
|
Config for CosmicRayPostDiffTask |
|
Detect and repair cosmic rays on an image difference. Given an output image from image differencing: - detect and repair cosmic rays - At the moment this task does NOT recompute the PSF or re-do source detection. To invoke the task, Call the |
lsst.pipe.tasks.dcrAssembleCoadd Module¶
lsst.pipe.tasks.deblendCoaddSourcesPipeline Module¶
Classes¶
|
|
|
|
|
|
|
lsst.pipe.tasks.diff_matched_tract_catalog Module¶
Classes¶
|
|
|
Load subsets of matched catalogs and output a merged catalog of matched sources. |
|
|
|
|
|
|
|
|
A statistic that can be applied to a set of values. |
|
|
The median of a set of values. |
|
The re-scaled interquartile range (sigma equivalent). |
|
The re-scaled median absolute deviation (sigma equivalent). |
|
An arbitrary percentile. |
lsst.pipe.tasks.drpAssociationPipe Module¶
Pipeline for running DiaSource association in a DRP context.
Classes¶
|
Driver pipeline for loading DiaSource catalogs in a patch/tract region and associating them. |
|
|
|
lsst.pipe.tasks.drpDiaCalculationPipe Module¶
Pipeline for computing DiaObject summary/light curve values.
Classes¶
|
Driver pipeline for loading DiaSource catalogs in a patch/tract region and associating them. |
|
|
|
lsst.pipe.tasks.exampleStatsTasks Module¶
Classes¶
|
Configuration for ExampleSigmaClippedStatsTask |
|
Example task to compute sigma-clipped mean and standard deviation of an image. |
|
Example task to compute mean and standard deviation of an image. |
lsst.pipe.tasks.extended_psf Module¶
Read preprocessed bright stars and stack to build an extended PSF model.
Classes¶
Single extended PSF over a focal plane region. |
|
|
Extended PSF model. |
|
Configuration parameters for StackBrightStarsTask. |
|
Stack bright stars together to build an extended PSF model. |
|
Configuration parameters for MeasureExtendedPsfTask. |
|
Build and save extended PSF model. |
|
Provides a list of detectors that define a region. |
lsst.pipe.tasks.finalizeCharacterization Module¶
Task to run a finalized image characterization, using additional data.
Classes¶
|
|
|
Configuration for FinalizeCharacterizationTask. |
|
Run final characterization on exposures. |
lsst.pipe.tasks.fit_multiband Module¶
Classes¶
|
A class to store a catalog, exposure, and metadata for a given dataId. |
lsst.pipe.tasks.functors Module¶
Functions¶
|
Initialize an object defined in a dictionary. |
|
Evaluate an expression on a DataFrame, knowing what the 'mag' function means. |
|
Append _instFlux to the column name if it doesn't have it already. |
|
Append _instFluxErr to the column name if it doesn't have it already. |
Classes¶
|
Define and execute a calculation on a DataFrame or Handle holding a DataFrame. |
|
Perform multiple calculations at once on a catalog. |
|
Arbitrary computation on a catalog. |
|
Get column with a specified name. |
|
Return the value of the index for each object. |
|
Base class for coordinate column, in degrees. |
|
Right Ascension, in degrees. |
|
Declination, in degrees. |
|
Compute the level 20 HtmIndex for the catalog. |
|
Compute calibrated magnitude. |
|
Compute calibrated magnitude uncertainty. |
|
Functor to calculate magnitude difference. |
|
Compute the color between two filters. |
|
This functor subtracts the trace of the PSF second moments from the trace of the second moments of the source. |
|
Functor to calculate the SDSS trace radius size for sources. |
|
Functor to calculate the SDSS trace radius size difference (%) between the object and the PSF model. |
|
Functor to calculate the HSM trace radius size for sources. |
|
Functor to calculate the HSM trace radius size difference (%) between the object and the PSF model. |
|
Functor to calculate the PSF FWHM with second moments measured from the HsmShapeAlgorithm plugin. |
|
Calculate \(e_1\) ellipticity component for sources, defined as: |
|
Calculate \(e_2\) ellipticity component for sources, defined as: |
|
Calculate the radius from the quadrupole moments. |
|
Computations using the stored localWcs. |
|
Compute the local pixel scale from the stored CDMatrix. |
|
Convert a value in units of pixels to units of arcseconds. |
|
Convert a value in units of pixels squared to units of arcseconds squared. |
|
Return the band used to seed multiband forced photometry. |
|
Base class for Object table calibrated fluxes and magnitudes. |
|
Convert instrumental flux to nanojanskys. |
|
Convert instrumental flux error to nanojanskys. |
|
Base class for calibrating the specified instrument flux column using the local photometric calibration. |
|
Compute calibrated fluxes using the local calibration value. |
|
Compute calibrated flux errors using the local calibration value. |
|
Compute absolute mean of dipole fluxes. |
|
Compute the error on the absolute mean of dipole fluxes. |
|
Compute the absolute difference of dipole fluxes. |
|
Compute the error on the absolute difference of dipole fluxes. |
|
Compute E(B-V) from dustmaps.sfd. |
lsst.pipe.tasks.healSparseMapping Module¶
Classes¶
|
Task for making a HealSparse input map. |
|
Configuration parameters for HealSparseInputMapTask |
|
Interface for reading and writing healsparse.HealSparseMap files. |
|
|
|
Configuration parameters for HealSparsePropertyMapTask |
|
Task to compute Healsparse property maps. |
Configuration parameters for ConsolidateHealSparsePropertyMapTask |
|
|
Task to consolidate HealSparse property maps. |
lsst.pipe.tasks.healSparseMappingProperties Module¶
Functions¶
|
A decorator to register a property map class in its base class's registry. |
|
Compute the approximate psf size and shape. |
Classes¶
|
|
|
Class for property map registry. |
Map of property maps to be run for a given task. |
|
|
Base class for property maps. |
|
Exposure time property map. |
|
PSF size property map. |
|
PSF shape e1 property map. |
|
PSF shape e2 property map. |
|
Number of exposures property map. |
|
Configuration for the PsfMaglim property map. |
|
PSF magnitude limit property map. |
|
Sky background property map. |
|
Sky noise property map. |
|
Effect of DCR on delta-RA property map. |
|
Effect of DCR on delta-Dec property map. |
|
Effect of DCR on psf shape e1 property map. |
|
Effect of DCR on psf shape e2 property map. |
|
Observation epoch (mjd) property map. |
lsst.pipe.tasks.hips Module¶
Tasks for making and manipulating HIPS images.
Classes¶
|
Task for making high resolution HiPS images. |
|
Configuration parameters for HighResolutionHipsTask. |
|
|
|
Task for making a HiPS tree with FITS and grayscale PNGs. |
|
Configuration parameters for GenerateHipsTask. |
|
Task for making a HiPS tree with color pngs. |
|
Configuration parameters for GenerateColorHipsTask. |
lsst.pipe.tasks.insertFakes Module¶
Insert fakes into deepCoadds
Classes¶
|
Config for inserting fake sources |
|
Insert fake objects into images. |
lsst.pipe.tasks.interpImage Module¶
Classes¶
|
Config for CloughTocher2DInterpolateTask. |
|
Interpolated over bad pixels using CloughTocher2DInterpolator. |
|
Config for InterpImageTask |
|
Interpolate over bad image pixels |
lsst.pipe.tasks.isolatedStarAssociation Module¶
Classes¶
|
|
|
Configuration for IsolatedStarAssociationTask. |
|
Associate sources into isolated star catalogs. |
lsst.pipe.tasks.loadReferenceCatalog Module¶
Load a full reference catalog in numpy/table/dataframe format.
This task will load multi-band reference objects, apply a reference selector, and apply color terms.
Classes¶
|
Config for LoadReferenceCatalogTask |
|
Load multi-band reference objects from a reference catalog. |
lsst.pipe.tasks.makeDiscreteSkyMap Module¶
Classes¶
|
Config for MakeDiscreteSkyMapTask. |
|
Make a DiscreteSkyMap in a repository, using the bounding box of a set of calexps. |
lsst.pipe.tasks.makeWarp Module¶
Classes¶
|
Warp and optionally PSF-Match calexps onto an a common projection. |
|
Config for MakeWarpTask. |
lsst.pipe.tasks.maskStreaks Module¶
Functions¶
|
Make detection mask and set the mask plane. |
Classes¶
|
Configuration parameters for |
|
Find streaks or other straight lines in image data. |
lsst.pipe.tasks.matchBackgrounds Module¶
Classes¶
|
|
|
lsst.pipe.tasks.matchFakes Module¶
Classes¶
|
Match a pre-existing catalog of fakes to a catalog of detections on a difference image. |
|
Config for MatchFakesTask. |
|
Config for MatchFakesTask. |
|
Match injected fakes to their detected sources in the catalog and compute their expected brightness in a difference image assuming perfect subtraction. |
lsst.pipe.tasks.match_tract_catalog Module¶
Classes¶
|
Config class for the MatchTractCatalogSubTask to define methods returning values that depend on multiple config settings. |
|
An abstract interface for subtasks of MatchTractCatalogTask to match two tract object catalogs. |
|
Configure a MatchTractCatalogTask, including a configurable matching subtask. |
|
Match sources in a reference tract catalog with those in a target catalog. |
lsst.pipe.tasks.match_tract_catalog_probabilistic Module¶
Classes¶
|
Config class for the MatchTractCatalogSubTask to define methods returning values that depend on multiple config settings. |
|
An abstract interface for subtasks of MatchTractCatalogTask to match two tract object catalogs. |
lsst.pipe.tasks.measurePsf Module¶
Classes¶
|
|
|
A task that selects stars from a catalog of sources and uses those to measure the PSF. |
lsst.pipe.tasks.mergeDetections Module¶
Classes¶
|
Configuration parameters for the MergeDetectionsTask. |
|
Merge sources detected in coadds of exposures obtained with different filters. |
lsst.pipe.tasks.mergeMeasurements Module¶
Classes¶
|
Configuration parameters for the MergeMeasurementsTask. |
|
Merge measurements from multiple bands. |
lsst.pipe.tasks.metrics Module¶
Classes¶
|
Task that computes the number of science sources that have been deblended. |
|
|
|
Task that computes the number of science sources created through deblending. |
|
lsst.pipe.tasks.multiBand Module¶
Classes¶
|
Configuration parameters for the DetectCoaddSourcesTask |
|
Detect sources on a single filter coadd. |
lsst.pipe.tasks.multiBandUtils Module¶
Classes¶
|
Configuration for culling garbage peaks after merging footprints. |
lsst.pipe.tasks.objectMasks Module¶
Classes¶
Class to support bright object masks |
|
|
Plugin for reading DS9 region file catalogs with Gen3 Butler. |
lsst.pipe.tasks.parquetTable Module¶
Classes¶
|
Thin wrapper to pyarrow's ParquetFile object |
|
Wrapper to access dataframe with multi-level column index from Parquet |
lsst.pipe.tasks.photoCal Module¶
Classes¶
|
Calculate an Exposure's zero-point given a set of flux measurements of stars matched to an input catalogue. |
|
Config for PhotoCal. |
lsst.pipe.tasks.postprocess Module¶
Classes¶
|
|
|
Write filter-merged source tables as a DataFrame in parquet format. |
|
|
|
Write source table to DataFrame Parquet format. |
|
|
|
Write source table to DataFrame Parquet format. |
|
Calculate columns from DataFrames or handles storing DataFrames. |
|
|
|
Base class for transforming/standardizing a catalog by applying functors that convert units and apply calibrations. |
|
|
|
Produce a flattened Object Table to match the format specified in sdm_schemas. |
|
|
|
Write patch-merged source tables to a tract-level DataFrame Parquet file. |
|
|
|
Transform/standardize a source catalog |
|
Config for ConsolidateVisitSummaryTask |
|
Task to consolidate per-detector visit metadata. |
|
|
|
Concatenate |
|
|
|
Produce a |
|
|
|
Produce a |
|
|
|
Merge and convert per-detector forced source catalogs to DataFrame Parquet format. |
|
|
|
Transform/standardize a ForcedSource catalog |
|
|
|
Concatenate any per-patch, dataframe list into a single per-tract DataFrame. |
lsst.pipe.tasks.processBrightStars Module¶
Extract bright star cutouts; normalize and warp to the same pixel grid.
Classes¶
|
Connections for ProcessBrightStarsTask. |
|
Configuration parameters for ProcessBrightStarsTask. |
|
Extract bright star cutouts; normalize and warp to the same pixel grid. |
lsst.pipe.tasks.processCcdWithFakes Module¶
Insert fake sources into calexps
Classes¶
|
Config for inserting fake sources |
|
Insert fake objects into calexps. |
|
|
|
As ProcessCcdWithFakes except add variablity to the fakes catalog magnitude in the observed band for this ccdVisit. |
lsst.pipe.tasks.propagateSourceFlags Module¶
Classes¶
|
Configuration for propagating source flags to coadd objects. |
|
Task to propagate source flags to coadd objects. |
lsst.pipe.tasks.propagateVisitFlags Module¶
Classes¶
|
Configuration for propagating flags to coadd. |
|
Task to propagate flags from single-frame measurements to coadd measurements. |
lsst.pipe.tasks.quickFrameMeasurement Module¶
Classes¶
|
Config class for the QuickFrameMeasurementTask. |
|
WARNING: An experimental new task with changable API! Do not rely on yet! |
lsst.pipe.tasks.read_curated_calibs Module¶
Functions¶
|
Read all data from the standard format at a particular root. |
lsst.pipe.tasks.registerImage Module¶
This module contains a Task to register (align) multiple images.
Classes¶
|
Task to register (align) multiple images. |
|
Configuration for RegisterTask. |
lsst.pipe.tasks.repair Module¶
Classes¶
|
|
|
Repair an exposures defects and cosmic rays via interpolation. |
lsst.pipe.tasks.reserveIsolatedStars Module¶
Task to make a flexible and repeatable selection of reserve stars.
Classes¶
|
Configuration for ReserveIsolatedStarsTask. |
|
Reserve isolated stars with repeatable hash. |
lsst.pipe.tasks.scaleZeroPoint Module¶
Classes¶
|
A class that scales an image. |
|
Multiplicative image scaler using interpolation over a grid of points. |
|
Compute scale factor to scale exposures to a desired photometric zero point. |
lsst.pipe.tasks.selectImages Module¶
Classes¶
|
Base task for selecting images suitable for coaddition. |
|
Data about a selected exposure. |
|
Select images using their Wcs. |
|
Select images using their Wcs and cuts on the PSF properties. |
|
Base configuration for subclasses of BaseSelectImagesTask that use a database. |
|
Select up to a maximum number of the best-seeing visits. |
|
Select a quantile of the best-seeing visits. |
lsst.pipe.tasks.setPrimaryFlags Module¶
Classes¶
|
|
|
Add isPrimaryKey to a given schema. |
lsst.pipe.tasks.simpleAssociation Module¶
Simple association algorithm for DRP. Adapted from http://github.com/LSSTDESC/dia_pipe
Classes¶
|
Configuration parameters for the SimpleAssociationTask |
|
Construct DiaObjects from a DataFrame of DIASources by spatially associating the sources. |
lsst.pipe.tasks.skyCorrection Module¶
Classes¶
|
Perform a full focal plane sky correction. |
|
lsst.pipe.tasks.snapCombine Module¶
Classes¶
|
|
|
Combine two snaps into a single visit image. |
lsst.pipe.tasks.statistic Module¶
Classes¶
Compute a statistic from a list of values. |
|
|
|
|
|
|
An arbitrary percentile. |
The standard deviation (sigma). |
|
|
The re-scaled inter-quartile range (sigma equivalent). |
|
The re-scaled median absolute deviation (sigma equivalent). |
lsst.pipe.tasks.visualizeVisit Module¶
Classes¶
|
Configuration for focal plane visualization. |
|
Bin the detectors of an exposure. |
|
Configuration for focal plane visualization. |
|
Task to mosaic binned products. |
lsst.pipe.tasks.warpAndPsfMatch Module¶
Classes¶
|
A task to warp and PSF-match an exposure |