Tickets Addressed in Release 17.0

  • DM-2639: Standardize primary method names, run/runDataRef, across PipeTasks [ci_ctio0m9, ctrl_pool, ip_isr, jointcal, meas_algorithms, meas_base, meas_mosaic, obs_lsstSim, pipe_base, pipe_drivers, pipe_tasks, synpipe]

  • DM-6640: IsrTask is not a valid CmdLineTask [ip_isr, obs_base, obs_cfht, obs_ctio0m9, obs_decam, obs_lsstSim, obs_monocam, obs_sdss, obs_subaru, obs_test]

  • DM-7556: Remove lsst_ci from demo in Jenkins and add to default product list [lsst_ci]

  • DM-7886: Replace pyfits with astropy.io.fits in all code [galsim, meas_deblender, meas_extensions_astrometryNet, meas_extensions_psfex, meas_mosaic, obs_base, obs_cfht, obs_lsstSim, obs_sdss, obs_subaru, obs_test, synpipe]

  • DM-8828: Support proper motions in reference catalogs [meas_algorithms, meas_astrom, meas_extensions_astrometryNet, obs_base]

  • DM-9358: Fix setting of calib_psf_candidate flag to match docstring description [pipe_tasks]

  • DM-9615: Convert DCR code to use Tasks [obs_base, obs_test, pipe_tasks]

  • DM-9840: Refactor meas_extenstions/psfexStarSelector to new BaseClass [meas_extensions_psfex]

  • DM-9852: Define DCR matched template data type [obs_base, obs_decam, obs_lsstSim]

  • DM-9933: Add C++11 inheritance safeguards to afw [afw, geom]

  • DM-9937: Add noexcept specifiers to applicable methods in afw [afw, geom, meas_algorithms, meas_extensions_psfex, meas_modelfit, meas_mosaic]

  • DM-9938: Make some afw types hashable [afw, daf_base, geom, utils]

  • DM-10111: Add overscan exclusion regions as an ISR config parameter [ip_isr]

  • DM-10302: Rename “*_flux” fields to “*_instFlux” in SourceCatalogs [afw, ip_diffim, jointcal, meas_algorithms, meas_astrom, meas_base, meas_extensions_astrometryNet, meas_extensions_convolved, meas_extensions_photometryKron, meas_extensions_psfex, meas_modelfit, meas_mosaic, obs_subaru, pipe_tasks, synpipe, validate_drp]

  • DM-10346: Allow depersist of old Calib objects as PhotoCalibs [afw]

  • DM-10384: Make a plan to address pybind11 build size issues [afw, base, geom, obs_subaru, sconsUtils, utils]

  • DM-11328: afwImage doesn’t roundtrip through numpy [utils]

  • DM-11395: Update testdata_jointcal refcats to new Indexed format [jointcal, testdata_jointcal]

  • DM-11558: pex_config numpydoc conversion and package documentation configuration [pex_config]

  • DM-11693: Rebuild runs pytest tests twice for every product [afw, ctrl_pool, daf_persistence, flake8, pep8_naming, pex_config, pex_exceptions, pipe_base, pytest, pytest_flake8, sconsUtils, utils]

  • DM-11725: Add coverage testing of unittest [sconsUtils, utils]

  • DM-11866: Propagate astrometry and photometry visit calibration flags to coadds [pipe_tasks]

  • DM-12105: Add apr-iconv package to our stack [apr_util]

  • DM-12315: Generalize ap_pipe to non-HiTS data [obs_decam, obs_subaru]

  • DM-12390: Butler doesn’t raise when failing to write data [daf_persistence]

  • DM-12618: Define Storage Classes for Butler [obs_subaru]

  • DM-12635: Write initial Gen2->Gen3 conversion script [obs_subaru]

  • DM-13054: Add colorterm config support to jointcal [jointcal, obs_subaru, pipe_tasks]

  • DM-13065: Adapt SIP fitter for writing approximations to general Wcss [afw, geom]

  • dm-13124: Add a layer in the layer control dialog for image [firefly_client]

  • DM-13222: Add getScalar and getArray methods to PropertySet and PropertyList and prefer them [daf_base]

  • DM-13270: cherry pick ccdImage method cleanups from DM-9071 [jointcal]

  • DM-13293: Make BF kernel measurement code fully stack compliant [cp_pipe, ip_isr, obs_base, obs_comCam, obs_subaru]

  • DM-13297: CoaddBoundedField persistence not exact [afw, meas_algorithms]

  • DM-13519: Implement per-object Galactic Extinction correction in color analysis QA plots [obs_subaru]

  • DM-13565: Put correct copyright/license headers in all jointcal files [jointcal]

  • DM-13670: Check residual vs. errors for photometry [jointcal]

  • DM-13887: Let ap_verify process multiple images per instance [pipe_base]

  • DM-13911: Create multiband classes [afw]

  • DM-13969: Resolve implied dependency of cp_pipe on eotest [cp_pipe]

  • DM-13976: Rename jointcal.gtransfo [jointcal]

  • DM-14072: Add getCutout method to Exposure [afw]

  • DM-14133: Enable Sphinx support for meas_astrom [meas_astrom]

  • DM-14159: Wrap matplotlib use in meas_mosaic [meas_mosaic, validate_drp]

  • DM-14170: Add descriptions for dcr datasets [obs_base]

  • DM-14172: Optimize cModel config parameters [meas_modelfit]

  • DM-14273: Add ap_verify to lsst_distrib [lsst_apps, lsst_distrib]

  • DM-14305: Upgrade Eigen to 3.3.4 [eigen]

  • DM-14325: deepDiff datasets not supported by HSC [obs_subaru]

  • DM-14363: Make afw::cameraGeom::Detector table-persistable [afw]

  • DM-14378: Add Gen3 conversion scripting and tests to ci_hsc [obs_subaru]

  • DM-14428: Add skypix and spatial relationships to Gen2->Gen3 conversion [skymap]

  • DM-14503: Finish implementing YAML storage for PropertyList/PropertySet [daf_base, daf_persistence]

  • DM-14510: Implement line search [jointcal]

  • DM-14520: Re-enable Dataset->DataUnit foreign keys [obs_subaru]

  • DM-14527: Implement RFC-483: fix image bbox slicing origin [afw, coadd_utils, ip_diffim, ip_isr, meas_algorithms, meas_base, meas_deblender, meas_extensions_photometryKron, meas_extensions_psfex, obs_base, obs_decam, obs_sdss, obs_subaru, pipe_drivers, pipe_tasks]

  • DM-14534: Fix measurementInvestigationLib.makeRerunCatalog parent keys [meas_base]

  • DM-14539: Add a data type to obs_subaru/obs_base for the star galaxy files [obs_base, obs_test]

  • DM-14574: implement magnitude-based photometric model [jointcal]

  • DM-14580: Create tests for BestSeeingWcsSelectImagesTask. [pipe_tasks]

  • DM-14625: Fix ndarray compiler warnings [meas_extensions_psfex, meas_extensions_simpleShape, meas_modelfit, meas_mosaic, shapelet]

  • DM-14670: Convert fgcmcal output stars to stack reference catalog format [obs_base]

  • DM-14690: Add ability to construct centered boxes [afw, geom]

  • DM-14699: Silence NumPy FutureWarnings in meas_deblender [meas_deblender]

  • DM-14720: Implement forced photometry on PVIs in AP pipe. [pipe_tasks]

  • DM-14725: Eliminate explicit use of ndarray::EigenView in C++ code [afw, ip_diffim, meas_astrom, meas_base, meas_modelfit, shapelet]

  • DM-14728: Add asEigenArray/Matrix returning Eigen::Map [ndarray]

  • DM-14738: Use DCR corrected templates in image differencing [ip_diffim, pipe_tasks]

  • DM-14740: Stop using ndarray::EigenView indirectly in C++ code [afw, meas_algorithms, meas_astrom, meas_base, meas_modelfit, shapelet]

  • DM-14753: Butler with multiple inputs does not properly load registry [daf_persistence]

  • DM-14764: Move kwargs check to before loading dataset [validate_drp]

  • DM-14765: Allow validateDrp to run w/o instrument, dataset_repo_url [validate_drp]

  • DM-14770: tests mis-call PropertySet.get [pipe_base]

  • DM-14781: Upgrade Eigen to 3.2.10 [eigen]

  • DM-14786: Implement ConstrainedMagnitude model [jointcal]

  • DM-14809: RingsSkyMap incorrect at south pole and RA=360 [skymap]

  • DM-14814: Change invalid pixel handling by Exposure::getCutout [afw]

  • DM-14819: Refactor LoadReferenceObjectsTask for SuperTask compatibility [meas_algorithms, pipe_base]

  • DM-14821: Provide packed integer versions of Gen3 data IDs [obs_subaru, skymap]

  • DM-14823: Clean up handling of extra data ID information in SuperTask.run [pipe_base]

  • DM-14828: Upgrade pybind11 to 2.2.3 [afw, astshim, base, coadd_utils, daf_base, daf_persistence, display_ds9, geom, ip_diffim, ip_isr, jointcal, log, meas_algorithms, meas_astrom, meas_base, meas_deblender, meas_extensions_astrometryNet, meas_extensions_photometryKron, meas_extensions_psfex, meas_extensions_shapeHSM, meas_extensions_simpleShape, meas_modelfit, meas_mosaic, obs_subaru, pex_config, pex_exceptions, pex_policy, pybind11, shapelet, sphgeom, utils]

  • DM-14834: Use pybind11’s native Eigen wrapping instead of ndarray EigenView [afw, geom, ip_diffim, jointcal, meas_astrom, meas_base, meas_extensions_simpleShape, meas_modelfit, ndarray, shapelet]

  • DM-14840: Make mask transparency and color “sticky” in display_firefly [afw, display_firefly]

  • DM-14841: NERSC password file has moved so fd leak checker fails tests [utils]

  • DM-14842: Fix deprecation warnings from PropertyList/Set.get [afw, daf_base, ip_diffim, jointcal, meas_algorithms, meas_astrom, meas_base, meas_extensions_psfex, meas_mosaic, obs_base, obs_cfht, obs_comCam, obs_ctio0m9, obs_decam, obs_lsstSim, obs_monocam, obs_sdss, obs_subaru, obs_test, pipe_base, pipe_tasks, synpipe]

  • DM-14844: Two FITS tests in afw assume they run relative to AFW_DIR [afw]

  • DM-14845: Uninitialized array in afw/tests/test_tableArchives.cc [afw]

  • DM-14857: Switch the default matcher to PessimisticB. [meas_astrom, obs_cfht, obs_subaru]

  • DM-14861: Disable CC requirement for obs_base [obs_base]

  • DM-14864: Make afw pybind11 wrappers compatible with pybind11 2.2.3 [afw]

  • DM-14868: Adapt validation_data_* processing to use HTM catalogs [lsst_ci, obs_cfht, validate_drp]

  • DM-14869: Verify ellipticity definition choice in validate_drp [validate_drp]

  • DM-14908: Convert obs_test to numpydoc [obs_test]

  • DM-14915: rewrite_shebang is not run in ctrl_orca [ctrl_orca]

  • DM-14928: Fix error in DM-14765 implementation [validate_drp]

  • DM-14932: Add utility functions for creating SkyWcss from boresight/rotator + cameraGeom [afw]

  • DM-14980: Reinstate the ability of a Detector to find the Camera in which it lives [afw]

  • DM-14997: Implement RFC-498: homogenize naming of calibration flags [jointcal, meas_algorithms, meas_astrom, meas_mosaic, obs_subaru, pipe_tasks]

  • DM-14998: Document schema naming conventions [afw]

  • DM-15005: Add a new AngleUnit: milliarcseconds [geom]

  • DM-15008: anetAstrometry.py uses self.distortionContext, which does not exist [meas_astrom, meas_extensions_astrometryNet]

  • DM-15011: implement separate Visit and Chip fitting for photometry [jointcal]

  • DM-15015: Misc fixes and updates to display_matplotlib [display_matplotlib]

  • DM-15023: meas_modelfit is not compatible with Eigen 3.3.4 [meas_modelfit]

  • DM-15034: Custom classes for DataUnit tuples/sets and Data IDs [obs_base, pipe_base, pipe_tasks, skymap]

  • DM-15043: Broken build in meas_algorithms [meas_algorithms]

  • DM-15045: Activate convolved measurements on undeblended sources [meas_extensions_convolved, obs_subaru]

  • DM-15046: When comparing angles in MatchPessimisticB, make sure all vectors are plane projected [meas_astrom]

  • DM-15056: lsst.afw.geom documentation build issue (lsst.afw.geom.all.doctree not found) and documenteer 0.3.0a5 [afw]

  • DM-15073: Initial functor.yaml file for DPDD Object table [obs_base, obs_subaru]

  • DM-15082: Switch to YamlStorage instead of BoostStorage in all obs packages [ip_diffim, meas_astrom, meas_deblender, obs_base, obs_cfht, obs_comCam, obs_ctio0m9, obs_decam, obs_lsstSim, obs_monocam, obs_sdss, obs_subaru, obs_test]

  • DM-15090: Stop using file in Python code [coadd_utils, display_ds9]

  • DM-15093: Disable y-band stray light correction after Jan 2018 [obs_subaru]

  • DM-15104: Move SourceDeblendTask out of MeasureCoaddSources [meas_deblender, obs_base, obs_subaru, pipe_drivers, pipe_tasks]

  • DM-15105: Fix bare except in obs_subaru and other pep8 fixes [obs_subaru]

  • DM-15106: Update the deblender to use multiband classes [meas_deblender]

  • DM-15126: Make meas_* compatible with pybind11 2.2 (as well as 2.1) [meas_base, meas_extensions_shapeHSM, meas_extensions_simpleShape]

  • DM-15132: Fix errors in jointcal pybind11 wrappers [jointcal]

  • DM-15139: Rename invert() and getInverse() to inverted() [afw, astshim, geom, jointcal, meas_algorithms, meas_astrom, meas_modelfit, obs_base, obs_monocam, obs_test, pipe_drivers, shapelet]

  • DM-15151: Set symbol visibility to hidden in pybind11 wrappers [afw, base, daf_base, meas_algorithms, meas_extensions_psfex, meas_modelfit, meas_mosaic, pex_exceptions, pex_policy, sconsUtils]

  • DM-15152: crosstalk correction was moved above assembleCcd, which broke it [ip_isr]

  • DM-15158: Add tests of dataIdContainer exceptions [pipe_base]

  • DM-15159: Demo of expanding test coverage using new pytest tools [pipe_base]

  • DM-15162: Improve documentation for DataIdContainer [pipe_base]

  • DM-15165: Add new tags for validate_drp metric definition and specifications [verify, verify_metrics]

  • DM-15166: Duplicated afw dependencies [afw]

  • DM-15168: check for crosstalk fails as a numpy array cannot be used as a boolean [afw]

  • DM-15171: Silence warnings about aperture correction of undeblended convolved measurements [obs_subaru]

  • DM-15182: Add facility to change matplotlib colormap [display_matplotlib]

  • DM-15187: Modernize sphgeom pickle support for pybind11 2.2 [sphgeom]

  • DM-15189: Write initial raw-data ingest system for Gen3 Butler [obs_base, obs_subaru]

  • DM-15190: Fix ip_diffim FutureWarning [ip_diffim]

  • DM-15194: display_matplotlib: dot fails to plot ellipses [display_matplotlib]

  • DM-15197: removal of Image.get() API broke display_matplotlib [display_matplotlib]

  • DM-15201: Forward python logging to lsst.log in pipe_base [log, pipe_base]

  • DM-15203: The ISR overscan correction algorithms are too naive [afw, ip_isr, obs_decam, obs_subaru, pipe_tasks]

  • DM-15208: validate_drp skipTEx is being ignored [validate_drp]

  • DM-15210: Update registry schema (and documentation thereof) following review [skymap]

  • DM-15218: Add API to afwDisplay.Display to select the colour map [afw]

  • DM-15220: Moving SuperTask to pipe_base [pipe_base]

  • DM-15222: firefly_client updates for new asinh stretch [firefly_client]

  • DM-15230: Fix MultibandExposure initialization [afw]

  • DM-15231: Fix bugs in showCamera [afw]

  • DM-15232: Add parameters for asinh and power law_gamma to display_firefly [display_firefly]

  • DM-15241: log error when final chi2 is large [jointcal]

  • DM-15244: Change fluxSigma to fluxErr and similarly for apCorr and covariances [afw, ip_diffim, jointcal, meas_algorithms, meas_astrom, meas_base, meas_extensions_astrometryNet, meas_extensions_convolved, meas_extensions_photometryKron, meas_extensions_psfex, meas_extensions_simpleShape, meas_modelfit, meas_mosaic, obs_subaru, pipe_tasks, synpipe, validate_drp]

  • DM-15248: Support textangle in ds9 text regions in Firefly [firefly_client]

  • DM-15249: Extend catalog upload to allow specifying a list of columns [firefly_client]

  • DM-15254: Option to normalize warps by Jointcal’s PhotoCalib [afw]

  • DM-15256: Include calibration repositories in Gen2->Gen3 conversion [obs_subaru]

  • DM-15268: Merge gen3-middleware branches to master [obs_subaru, skymap]

  • DM-15310: Refactor ForcedPhotImageTask (and children) per RFC-352 [meas_base]

  • DM-15311: Refactor MeasureCrosstalkTask per RFC-352 [ip_isr]

  • DM-15323: Adapt validate_drp for new obs_lsstCam [validate_drp]

  • DM-15324: Set default for RequireUnresolved source selector [meas_algorithms]

  • DM-15326: Create LSST footprint overlay on image [firefly_client]

  • DM-15328: –show history doesn’t support globs [pex_config, pipe_base]

  • DM-15333: Apply pan and scale at time of image display in display_firefly [display_firefly, firefly_client]

  • DM-15347: meas_base to numpydoc format [meas_base]

  • DM-15350: Fix segfault in sphgeom::HtmPixelization::pixel [sphgeom]

  • DM-15385: Update boost to v1.68 [boost]

  • DM-15389: Update PyYAML package to v1.13 [pyyaml]

  • DM-15390: FutureWarning in sconsUtils with python 3.7 [sconsUtils]

  • DM-15394: afw does not work with Boost v1.68 [afw]

  • DM-15400: Galsim does not work with boost 1.68 [galsim]

  • DM-15406: mosaic.py timeout error in readCatalog [afw]

  • DM-15410: measureCrosstalk was broken by the move of crosstalk correction to above assembly [ip_isr]

  • DM-15417: Remove deprecated getInverse and invert methods [afw, geom]

  • DM-15419: utils cache tests fail in python 3.7 and boost 1.68 [utils]

  • DM-15421: Change to use constrained models by default [jointcal]

  • DM-15428: Remove future from base [base]

  • DM-15429: Assertion failure in meas_mosaic diagnostics [meas_mosaic]

  • DM-15431: Add Jacobian BoundedField accessor to SkyWcs [afw, jointcal]

  • DM-15435: Remove python 2 support from pex packages [pex_config, pex_exceptions, pex_policy]

  • DM-15438: display_firefly setMaskTransparency is backwards [display_firefly]

  • DM-15440: Update sconsUtils to not use python_future [sconsUtils]

  • DM-15441: Update pipe_base to not use python_future [pipe_base]

  • DM-15442: Remove python 2 support to more packages and add pyList=[] [coadd_utils, meas_algorithms, meas_deblender, meas_extensions_convolved, meas_extensions_photometryKron, meas_extensions_psfex, meas_extensions_shapeHSM, validate_drp]

  • DM-15443: Update mpi4py [mpi4py]

  • DM-15445: Update utils to remove python_future [utils]

  • DM-15446: Remove python future from meas_modelfit [meas_modelfit]

  • DM-15452: Fix DCR multiband bugs introduced by new deblender [obs_base, pipe_tasks]

  • DM-15462: Failure in lsst_ci with numpy1.15 [validate_drp]

  • DM-15464: pybind11 seems to prefer python3.7 over python 3.6 [pybind11]

  • DM-15478: Exceptions from importing lsst.afw.image cause SIGABRT [pybind11]

  • DM-15479: Only set ds9 as a default afwDisplay backend if no backend is defined [afw]

  • DM-15500: Add FITS image, catalog readers that infer types from file [afw, daf_base, obs_decam, obs_lsstSim]

  • DM-15502: rsync data and support test stand data ingestion better [obs_comCam]

  • DM-15503: Improve raw data handling in gen2convert [obs_base, obs_subaru]

  • DM-15511: Remove pex logging from base package [base]

  • DM-15513: jointcal test outputs collide [jointcal]

  • DM-15515: Help turn on Travis for remaining repositories [ctrl_pool]

  • DM-15523: geom has random failure on macOS in polynomials test [geom]

  • DM-15528: Make cameraGeom::Camera round-trip persistable [afw, pipe_tasks]

  • DM-15530: scons -c deletes directories named “core” [sconsUtils]

  • DM-15531: Fix deblender defaults in in new DeblendCoaddSourcesTask [pipe_tasks]

  • DM-15534: Undefined variable names in MultibandDriver [pipe_drivers]

  • DM-15537: Rename Sensor to Detector in Gen3 schema [obs_base, obs_subaru]

  • DM-15539: pipe_tasks test_psfCandidateSelection.py missing setup_module [pipe_tasks]

  • DM-15553: update GalSim to version 2.0 [galsim, meas_extensions_shapeHSM]

  • DM-15563: Refactor Mask global state and make it thread-friendly [afw]

  • DM-15577: Fix typo in PackedIndex.h header guard [geom]

  • DM-15588: Remove home-brewed SQLite PPDB [obs_decam, obs_subaru]

  • DM-15599: Stop using boost persistence in afw [afw, daf_persistence, meas_algorithms, utils]

  • DM-15606: Add jointcal config defaults to at least obs_subaru [jointcal, obs_decam, obs_subaru]

  • DM-15613: Unsigned, uncompressed FITS images written with incorrect BZERO [afw]

  • DM-15635: Investigate filter throughput for DcrCoadds [ip_diffim, pipe_tasks]

  • DM-15636: Investigate DcrCoadd frequency regularization [ip_diffim, pipe_tasks]

  • DM-15638: Fix DcrCoadd subfilter order [ip_diffim]

  • DM-15652: Add missing calexp_camera dataset template to obs_decam [obs_decam]

  • DM-15653: Add native yaml serialization support to daf_base [daf_base, daf_persistence]

  • DM-15663: Start pipeline conversion process for DetectCoaddSources [pipe_tasks]

  • DM-15675: Make sure data IDs are expanded when adding Datasets and filling templates [obs_base]

  • DM-15676: Make PropertySet/List more dict-like [afw, daf_base]

  • DM-15681: convert skymap documentation to numpydoc [skymap]

  • DM-15682: Add str() for afw::Image and afw::Mask [afw]

  • DM-15684: convert ip_diffim documentation to numpydoc [ip_diffim]

  • DM-15717: afwDisplay fails on a DecoratedImage without WCS metadata [afw]

  • DM-15719: afw’s test testReadFitsWithOptions needs afwData [afw]

  • DM-15727: Disable CModel in forcedPhotCcd [obs_subaru]

  • DM-15751: Configure ability to build coadds with either Jointcal or meas_mosaic [jointcal, obs_subaru, pipe_tasks]

  • DM-15756: biasCorr calculation code results disagrees when using main task code [cp_pipe]

  • DM-15757: obs_decam’s apPipe config should default to CP calibs for now [obs_decam]

  • DM-15758: Help strings for subconfigurables [pex_config]

  • DM-15767: Remove pex_policy and Persistable usage from daf_persistence, obs_*, and Filter [afw, coadd_utils, daf_base, daf_persistence, ip_diffim, meas_algorithms, obs_base, obs_ctio0m9]

  • DM-15769: Better error message required for no input data [pipe_drivers]

  • DM-15771: Remove unused remnants of pex_policy [ctrl_orca]

  • DM-15772: Rename cpTask.py [cp_pipe]

  • DM-15774: Initial Sphinx-based Task documentation for packages [pipe_tasks]

  • DM-15776: Reimplement FitsStorage support for direct PropertyList reads [daf_persistence, obs_test]

  • DM-15789: Fix symbol visibility warnings in ndarray pybind11 converters [ndarray]

  • DM-15790: Compile pybind11 with hidden symbol visibility on linux [sconsUtils]

  • DM-15809: Replace boost::regex in utils package [utils]

  • DM-15812: convert obs_decam to numpydoc status [obs_decam]

  • DM-15823: Implement a source catalog / footprint browser for Firefly [display_firefly]

  • DM-15829: Fix shell handling inside sconsUtils commands to be Bourne compatible [sconsUtils]

  • DM-15831: Remove unused ra/dec angle handling methods from afw and utils [afw, obs_ctio0m9, utils]

  • DM-15836: Add helper code for invoking C++ templates from Python dtype arguments [utils]

  • DM-15837: mosaic.py error “Field with name ‘i_fluxErr’ not found” [meas_mosaic]

  • DM-15843: Clean up details of pipeline task conversion process [meas_base, pipe_tasks]

  • DM-15845: Convert MergeDetectionsTask into a pipelinetask [pipe_tasks]

  • DM-15851: sconsUtils does not reliably remove the .failed file [sconsUtils]

  • DM-15855: Convert shapelet documentation to numpydoc and remove Python 2 compatibility [shapelet]

  • DM-15857: jointcal of w_2018_38 fails to run [afw, meas_astrom, meas_extensions_astrometryNet, pipe_tasks]

  • DM-15862: Reduce ISR code duplication between ip_isr, obs_subaru, and obs_decam [ip_isr, obs_base, obs_decam, obs_subaru, obs_test]

  • DM-15865: PropertyList __copy__ is broken [daf_base]

  • DM-15871: Move daf_butler’s doImport function to utils [utils]

  • DM-15873: Fix pytest/py issue [pytest]

  • DM-15887: Make Pipeline work with non-standard storage classes [pipe_base]

  • DM-15897: Pipelinetask init should take kwargs [pipe_base]

  • DM-15902: The butler ignores [hdu] specifications in templates [daf_persistence]

  • DM-15914: Use obs_metadata in daf_butler [obs_base, obs_subaru]

  • DM-15916: Make meas_mosaic backwards compatible with *_flux –> *_instFlux rename [meas_mosaic]

  • DM-15923: doxygen does not build on macOS Mojave [doxygen]

  • DM-15927: cfitsio does not build on macOS Mojave [cfitsio]

  • DM-15974: Provide intro text for meas_base [meas_base]

  • DM-16013: Add color terms for NB1010 [obs_subaru]

  • DM-16017: Prototype a metrics-handling Task [verify]

  • DM-16018: assertAnglesAlmostEqual fails for NaN angles [geom]

  • DM-16021: Create a Jupyter extension to start Firefly slate in a tab [firefly_client]

  • DM-16023: Include alias maps in output schema when denormalizing matches [afw, meas_astrom]

  • DM-16026: Split apart inheritance relations of MergeDetectionsTask and MergeMeasurementsTask [pipe_tasks]

  • DM-16035: Link source table and footprints by id column [firefly_client]

  • DM-16039: healpy does not build on mojave [healpy]

  • DM-16043: Revert accidental dependency on numpy 1.14 [afw]

  • DM-16066: esutil does not build on macOS Mojave [esutil]

  • DM-16068: Some flux fields are not getting their units set [afw, meas_modelfit]

  • DM-16070: Implement RFC-534: Update naming of base_Blendedness fields [meas_base, meas_deblender]

  • DM-16082: nopytest_test_coadds.py throws warnings, and should be fixed [pipe_tasks]

  • DM-16128: Add fgcm and fgcmcal to lsst_distrib [lsst_distrib]

  • DM-16168: Update matchedVisitsMetricsTask [validate_drp]

  • DM-16170: mosaic.py error “Field with name ‘i_instFlux’ not found” [meas_mosaic]

  • DM-16183: w_2018_41 coaddDriver is broken with detectCoaddSources API changes [pipe_drivers]

  • DM-16208: Add magnitudeToInstFlux method that takes a Point to PhotoCalib [afw]

  • DM-16220: Use modern subprocess.run in sconsUtils [sconsUtils]

  • DM-16227: Implement collection integrity constraint inside the registry database [obs_base]

  • DM-16235: Jointcal PhotoCalib returns negative calibrations [afw, jointcal]

  • DM-16242: Fix bad error message for lack of linearizer [ip_isr]

  • DM-16253: Switch obs_decam and obs_cfht to astro_metadata_translator [obs_cfht, obs_decam]

  • DM-16275: PipelineTask should always use overridable methods to get DatasetTypes [pipe_base]

  • DM-16286: Update version checks in EUPS stub packages to match lsstsw minimums [astropy, matplotlib, numpy, scipy]

  • DM-16291: str(Image) tests too strict about formatting [afw]

  • DM-16294: Fix coadd dataset templates in obs_lsst and possibly elsewhere [obs_base, obs_cfht, obs_decam, obs_lsstSim, obs_sdss, obs_subaru]

  • DM-16295: Get cp_pipe etc working for ts8 for bootcamp [cp_pipe]

  • DM-16296: Update flake8/pycodestyle [afw, base, ctrl_pool, daf_persistence, flake8, geom, ip_diffim, ip_isr, jointcal, log, meas_algorithms, meas_astrom, meas_base, meas_deblender, meas_extensions_astrometryNet, meas_extensions_photometryKron, meas_modelfit, obs_base, obs_cfht, obs_comCam, obs_ctio0m9, obs_decam, obs_lsstSim, obs_sdss, obs_subaru, obs_test, pex_config, pex_policy, pipe_base, pipe_tasks, pycodestyle, pyflakes, sconsUtils, shapelet, skymap, synpipe, utils, validate_drp, verify]

  • DM-16305: Implement bbox integrator for PhotometryTransform [jointcal]

  • DM-16319: ap_verify source count metrics do not exist [verify_metrics]

  • DM-16321: treecorr does not build on macOS mojave [treecorr]

  • DM-16338: Add fluxErr to LoadReferenceObjectsTask makeMinimalSchema [ip_diffim, meas_algorithms, meas_astrom]

  • DM-16343: pytest-flake8 creates many forked processes [pytest_flake8]

  • DM-16347: DcrAssembleCoadd array size mismatch [pipe_tasks]

  • DM-16361: Optimize memory usage in MatchPessimisticB [meas_astrom]

  • DM-16384: Add Eigen interfaces to meas modelfit mixture models [meas_modelfit]

  • DM-16386: Recent data using obs_decam retrieves incorrect wcs with butler.get(“calexp_wcs”) [afw]

  • DM-16392: Aperture correction field keys not guaranteed to point the same offsets within a given reprocessing [meas_base]

  • DM-16400: Create a timing metric for ApPipeTask [verify_metrics]

  • DM-16401: Disable writing metadata for MergeDetections and MergeMeasurements Tasks [pipe_tasks]

  • DM-16405: Python client: add support for hue-preserving rgb [firefly_client]

  • DM-16413: Remove more paf files from obs_base [obs_base]

  • DM-16426: Remove errant print statement in multiband.py [pipe_tasks]

  • DM-16441: Speed up creation of footprints table for Firefly [display_firefly]

  • DM-16445: Add flake8 and travis configs to ctrl_orca [ctrl_orca]

  • DM-16451: Fix color parameter names for overlaying footprints [display_firefly]

  • DM-16467: isrTask conversion to pipelineTask [ip_isr]

  • DM-16468: Speed up and stabilize dcrModel convergence [pipe_tasks]

  • DM-16474: obs_comCam butler.get returns with “issubclass() arg 1 must be a class Collap” [obs_comCam]

  • DM-16491: Add flake8 and travis configs to ctrl_platform_lsstvc. [ctrl_platform_lsstvc]

  • DM-16493: Add flake8 and travis configs to daf_persistence [daf_persistence]

  • DM-16505: Docstring for pex_config Fields does not take into account optional status [pex_config]

  • DM-16518: Write footprints table for Firefly viewer in binary2 format [display_firefly]

  • DM-16520: Add flake8 and travis configs to display_firefly [display_firefly]

  • DM-16521: Add information for ctrl_platform_lsstvc and add queue option [ctrl_execute, ctrl_platform_lsstvc]

  • DM-16535: Implement MetricRegistry [verify]

  • DM-16550: Races in YAML tests in daf_persistence [daf_persistence]

  • DM-16558: removeMaskPlane function in multiband.py does not work [afw]

  • DM-16561: Brokenness when comparing configs with inheritance relationship [pex_config]

  • DM-16564: Update travis.yml in verify package [verify]

  • DM-16593: Decam VisitInfo ExposureId set incorrectly [obs_decam]

  • DM-16598: Add PhotoCalib.calibrateImage() option to compute variance without calib err term [afw, pipe_tasks]

  • DM-16599: merge_footprint_XXX flags are not being set/propagated [meas_deblender]

  • DM-16603: Fix dcrAssembleCoadd config issues [pipe_tasks]

  • DM-16612: Fix compiler warnings in Meas Modelfit [meas_modelfit]

  • DM-16632: dcrAssembleCoadd log should refer to patches/quadrants, not coords [pipe_tasks]

  • DM-16641: dcrAssembleCoadd makes too many nImages [pipe_tasks]

  • DM-16642: Generalize job metadata code [verify]

  • DM-16650: Use nJy in PhotoCalib as the unit for calibrated fluxes [afw, jointcal, meas_mosaic, pipe_tasks, utils]

  • DM-16654: Merge external PR for afw for/from Jim Chiang [afw]

  • DM-16690: Change totFlux column names in imageDifferenceTask [pipe_tasks]

  • DM-16693: Long Decam DCR run failures with invalid values [pipe_tasks]

  • DM-16703: Use fgcm-photoCalib dataset for fgcm output instead of jointcal-photoCalib [obs_subaru]

  • DM-16731: DcrCoadds are missing some mask planes [pipe_tasks]

  • DM-16765: Implement base tests in obs_lsst [obs_base]

  • DM-16781: Update user guide for display_firefly [display_firefly]

  • DM-16782: Update display_firefly to working firefly_client changes [display_firefly, firefly_client]

  • DM-16787: Incorrect URL in pipe_tasks documentation [pipe_tasks]

  • DM-16797: Add template string names and formatters to PipelineTask configs [pipe_base]

  • DM-16801: Add method to turn sequential indexes to pairs in skymap [skymap]

  • DM-16810: Butler schema changes to run on Oracle [obs_subaru]

  • DM-16813: Crosstalk correction doesn’t raise when no xtalk matrix found [ip_isr]

  • DM-16819: Make minimal Gen3 shim for Gen2 DataRef, ButlerSubset, and Butler [daf_persistence, obs_subaru, pipe_base]

  • DM-16822: Use pipe.base.*DatasetConfig in MetricTask configs [pipe_base, verify]

  • DM-16828: Add Job viewer to lsst.verify [verify]

  • DM-16830: Add versioning to PhotoCalib [afw]

  • DM-16844: Convert DeblendCoaddSourcesTask to PipelineTask framework [pipe_tasks]

  • DM-16855: Convert afw.cameraGeom to numpydoc [afw]

  • DM-16856: Convert afw.coord to numpydoc [afw]

  • DM-16858: Convert afw.display to numpydoc [afw]

  • DM-16860: Convert afw.formatters to numpydoc [afw]

  • DM-16862: Convert afw.math to numpydoc [afw]

  • DM-16864: Investigate relative DcrModel option [ip_diffim, pipe_tasks]

  • DM-16865: Convert meas_extensions_psfex to numpydoc format [meas_extensions_psfex]

  • DM-16867: Split pipe_supertask into two other packages [pipe_base]

  • DM-16868: Remove explicit schema variable RefMatchTask and inherited tasks. [meas_astrom]

  • DM-16872: Fix numpy warnings in afw [afw]

  • DM-16873: Convert MeasureMergedCoaddSources to Pipeline Task [meas_astrom, pipe_tasks]

  • DM-16901: Delete DeblendAndMeasureTask. [meas_deblender]

  • DM-16904: Pass butler object to adaptArgsAndRun in PipelineTask [pipe_base, pipe_tasks]

  • DM-17028: Write PipelineTask to Make Warps (MakeCoaddTempExp conversion) [pipe_tasks]

  • DM-17038: Re-factoring of ctrl_mpexec [pipe_base]

  • DM-17042: PipelineTask single-config override does not parse booleans correctly. [pipe_base]

  • DM-17043: Add selection on S/N in objectSizeStarSelector [meas_algorithms]

  • DM-17045: Convert AssembleCoaddTasks to PipelineTasks with Shims [pipe_base, pipe_tasks]

  • DM-17060: Fix non-merged ticket [pipe_base]

  • DM-17067: Move parsing of dataset-name-substitution option to ctrl_mpexec [pipe_base]

  • DM-17073: ISR is too chatty [ip_isr]

  • DM-17088: Fix collections import deprecation warning in python 3.7 [afw, daf_persistence, meas_modelfit, obs_decam, pex_config]

  • DM-17098: SkyMeasurementTask.measureScale doesn’t iterate over entire image [pipe_drivers]

  • DM-17146: Fix storageClass for DetectCoaddSources PipelineTask [pipe_tasks]

  • DM-17149: MergeDetectionTask PipelineTask mode should export peak schema [pipe_tasks]

  • DM-17195: processCcd failed with ‘INST-PA not found’ since w_2019_01 [obs_subaru]

  • DM-17284: Add ctrl_mpexec to lsst_distrib [lsst_distrib]

  • DM-17297: Remove CatalogStarSelector [ip_diffim, meas_astrom, pipe_tasks]

  • DM-17300: Add brightObjectMasks to gen2convert [pipe_tasks]

  • DM-17301: Update DetectCoaddSources for new PipelineTask utilities [pipe_tasks]

  • DM-17376: remove _camera global from obs_lsst [obs_base, obs_comCam, obs_ctio0m9]

  • DM-17382: Make CharacterizeImageTask a pipelineTask [pipe_tasks]

  • DM-17387: Add obs_lsst to the lsst_obs table file [lsst_obs]

  • DM-17390: Convert CalibrateTask into a PipelineTask [meas_algorithms, pipe_tasks]

  • DM-17398: Support execution of incomplete graphs [pipe_base]

  • DM-17399: Issue(s) with test_measure.py in meas_algorithms [meas_algorithms]

  • DM-17412: Make MergeMeasurementsTask a valid pipelineTask [pipe_tasks]

  • DM-17416: Fix origin parameter name in Gen2->Gen3 Butler shim [pipe_base]

  • DM-17432: Retire coadd_chisquared [pipe_tasks]

  • DM-17433: Remove unused code from coadd_utils [coadd_utils]

  • DM-17446: overscan improperly sets bounding boxes when leading/trailing columns are skipped [ip_isr]

  • DM-17449: Photocal not setting up DirectMatchTask correctly [pipe_tasks]

  • DM-17451: Invalid memory access for getX/getY when slots aren’t defined [afw]

  • DM-17452: slots are not propagated into MultiMatch output schema [afw]

  • DM-17474: Convert forcedPhotCoadd/Ccd to pipelineTask [meas_base]

  • DM-17480: gen3 attempts to remove nonexistent dataset [ip_isr]

  • DM-17489: Initial prototype of Gen3 interfaces for human-curated master calibrations [obs_subaru]

  • DM-17492: Fix problems in PipelineTasks uncovered by end to end tests [pipe_tasks]

  • DM-17493: Include Filter in Gen3 HSC raw formatter [obs_subaru]

  • DM-17495: Running PipelineTasks in parallel can lead to aborting on locks instead of blocking [obs_base]

  • DM-17496: QuantumGraph generation hits SQLite join limit [pipe_base]

  • DM-17535: 32 bits no longer suffice for imsim expId [meas_algorithms]

  • DM-17543: Rename lsst.verify.compatibility to gen2compatibility [verify]

  • DM-17545: Fix MeasureCoaddSources regression [pipe_tasks]

  • DM-17552: Check SQuaSH metric regressions using Match PessimisticB [meas_astrom, validate_drp]

  • DM-17564: Simple efficiency improvements for DcrAssembleCoadd [ip_diffim, pipe_tasks]

  • DM-17611: Performance optimizations to data ID code [skymap]

  • DM-17626: Enable travis flake8 tests in log [log]

  • DM-17651: Forward lsst.log to Python logging [log]

  • DM-17659: Fix F632 flake8 warnings [display_firefly, meas_modelfit, obs_lsstSim, synpipe]

  • DM-17675: Resolve flake8 errors in afw [afw, ctrl_orca, daf_persistence, firefly_client, meas_algorithms, meas_deblender, sconsUtils]

  • DM-17689: Expose maximum number of bits used by IdFactory [afw]

  • DM-17720: Improve user expression handling in pre-flight [pipe_base]

  • DM-17726: Update flake8 and pycodestyle to support max-doc-length [afw, astshim, base, coadd_utils, ctrl_orca, ctrl_pool, daf_base, daf_persistence, display_firefly, flake8, geom, ip_diffim, ip_isr, jointcal, meas_algorithms, meas_astrom, meas_base, meas_deblender, meas_extensions_astrometryNet, meas_extensions_convolved, meas_extensions_photometryKron, meas_extensions_shapeHSM, meas_modelfit, obs_base, obs_cfht, obs_decam, obs_sdss, obs_subaru, obs_test, pep8_naming, pex_config, pex_policy, pipe_base, pipe_drivers, pipe_tasks, pycodestyle, pyflakes, pytest_flake8, sconsUtils, skymap, utils, validate_drp, cp_pipe, display_ds9, obs_comCam, obs_ctio0m9, obs_lsstSim, synpipe, verify]

  • DM-17741: pytest extra chatty on failed tests due to fonts and matplotlib [log, pipe_base]

  • DM-17827: Update doc/ directories of packages for latest standards [afw, base, coadd_utils, display_ds9, ip_diffim, ip_isr, jointcal, log, meas_algorithms, meas_deblender, meas_extensions_photometryKron, meas_extensions_shapeHSM, meas_extensions_simpleShape, meas_modelfit, obs_base, obs_cfht, obs_lsstSim, obs_test, pex_exceptions, pipe_base, pipe_drivers, shapelet, utils, validate_drp, verify]

  • DM-17831: Convert sconsUtils to sphinx documentation [sconsUtils]

  • DM-17843: A new set of processCcd failure in HSC-RC2 reprocessing [meas_astrom]

  • DM-17871: Add DcrAssembleCoaddTask to docs [pipe_tasks]

  • DM-17874: Remove hierarchical logging context [log]

  • DM-17914: afw PhotoCalibTestCase failure using bleed environment [afw]

  • DM-17917: Add doUnresolved to ReferenceSourceSelector [meas_algorithms]

  • DM-17947: Remove the unused MultiBandDataIdContainer [pipe_drivers]