################################### Tickets Addressed in Release 18.0.0 ################################### - `DM-1448 `_: Move code for mock images into afw so it reusable. [ip_isr] - `DM-2579 `_: Calling AliasMap::get("") can return incorrect results [afw] - `DM-2891 `_: meas.algorithms.utils uses measurement algorithms that are no longer available [meas_algorithms] - `DM-2944 `_: SourceMeasurementTask still referenced in our stack [ip_diffim, meas_algorithms, meas_deblender, pipe_tasks] - `DM-3655 `_: LSST_CFG_PATH support broken because of recent sconsUtils change [sconsUtils] - `DM-10242 `_: Stop using astrometry_net by default [obs_cfht, obs_ctio0m9, obs_decam, obs_lsst, obs_subaru, pipe_tasks] - `DM-10800 `_: Merge matcherSourceSelector and matcherPessimisticSourceSelector [meas_algorithms, meas_astrom, obs_ctio0m9] - `DM-10826 `_: fix jointcal collectRefStar handling of position errors [jointcal, obs_decam, obs_lsst, obs_subaru] - `DM-11397 `_: Remove twinkles1 jointcal testdata and tests [jointcal, testdata_jointcal] - `DM-12384 `_: exit/raise when data is less than parameters [jointcal] - `DM-13053 `_: allow refcat selection improve fitting [jointcal] - `DM-13180 `_: Specifications without corresponding metric in verify_metrics [validate_drp, verify_metrics] - `DM-13432 `_: Remove all explicit imports of ds9 [afw, ip_diffim, ip_isr, meas_algorithms, meas_astrom, meas_base, meas_extensions_astrometryNet, meas_extensions_photometryKron, meas_extensions_psfex, obs_cfht, obs_subaru, pipe_tasks, synpipe] - `DM-13567 `_: Add tests to ap_pipe [ap_pipe] - `DM-13757 `_: enable jointcal config writing [jointcal, obs_base] - `DM-14459 `_: Add check to (Posix)Datastore that prevents silent overwrite [daf_butler] - `DM-15004 `_: Upgrading display_ds9 to numpydoc status [display_ds9] - `DM-15374 `_: Per dataset allow/deny lists for datastores [daf_butler] - `DM-15450 `_: Update deprecated use of time.clock() [pipe_base] - `DM-15514 `_: Write insertFakeObjectsTask to add fake sources for QA purposes. [meas_base, obs_base, obs_subaru, pipe_tasks] - `DM-15683 `_: Add tests for ip_isr/isrTask [ip_isr] - `DM-16268 `_: Rewrite meas_extensions_ngmix for better functionality and upstream collaboration [obs_base] - `DM-16292 `_: Calibration products need more metadata [astro_metadata_translator, pipe_drivers] - `DM-16429 `_: Ensure WCS (and other Exposure components) are retrieved properly when loaded individually [obs_base] - `DM-16501 `_: Propagate calexp_fakes through skyCorrection and coaddDriver [pipe_drivers] - `DM-16536 `_: Migrate all metrics from ap.verify.measurements [ap_association, ap_verify, ip_diffim, verify, verify_metrics] - `DM-16539 `_: Add level of indirection betwen calib identifier and exposure range in schema [ctrl_mpexec, daf_butler, ip_isr, obs_subaru, pipe_base, pipe_tasks] - `DM-16606 `_: ap_pipe should not create DB automatically [ap_pipe, ap_verify, dax_ppdb] - `DM-16699 `_: Initial atmospec development work [obs_base, obs_lsst] - `DM-16702 `_: Add reference stars to fgcmcal fit as an option [fgcm, fgcmcal, obs_base] - `DM-16736 `_: Let MetricsControllerTask store application-specific metadata [verify] - `DM-16859 `_: Convert afw.fits to numpydoc [afw] - `DM-16925 `_: Provide backwards-compatibility with Calib API [afw] - `DM-17004 `_: JointcalRunner.__call__ not receiving "butler" in kwargs [jointcal] - `DM-17025 `_: Improve filename template mechanisms in PosixDatastore and Butler [daf_butler] - `DM-17029 `_: Update LoadReferenceObjectsTask to output fluxes in nanojansky [jointcal, meas_algorithms, meas_extensions_astrometryNet, pipe_tasks, testdata_jointcal] - `DM-17074 `_: Bad pixel masking log message unneeded when nothing masked [ip_isr] - `DM-17248 `_: ap_verify should create .json files in the workspace by default [ap_verify] - `DM-17413 `_: Investigate performance of background tweak during dynamic detection [meas_algorithms] - `DM-17426 `_: Improve full-visit sky subtraction [obs_subaru, pipe_drivers] - `DM-17427 `_: Incorporate Goulding bright star masks [pipe_tasks] - `DM-17428 `_: Allow rotation before interpolating on coadd [obs_subaru, pipe_tasks] - `DM-17429 `_: PSFs on coadds are narrower than in model [obs_subaru] - `DM-17431 `_: Peak culling is removing real sources [afw] - `DM-17521 `_: Add warning when ap_pipe skips association [ap_pipe] - `DM-17522 `_: Write getting started notes on ip_diffim [ip_diffim, pipe_tasks] - `DM-17528 `_: Quantify impact of variable seeing on current DCR correction [ip_diffim] - `DM-17562 `_: Broken links in afw doxygen [afw] - `DM-17654 `_: PPDB Scaling Test in Google Cloud [dax_ppdb] - `DM-17663 `_: Make Registry table names lowercase [daf_butler, ip_isr, meas_base, obs_base, obs_subaru, pipe_tasks, skymap] - `DM-17757 `_: Key error when trying to use pipetask to output pipeline/quantum graph and then read it. [meas_base, pex_config] - `DM-17830 `_: Investigate color-dependent offsets from ref cat in jointcal vs. meas_mosaic [jointcal] - `DM-17845 `_: Fix warnings in image coaddition [pipe_tasks] - `DM-17866 `_: Support BOT data gen 2 ingest once data exists [obs_lsst] - `DM-17875 `_: DESC config updates for DC2 stars only refererence catalog [obs_lsst] - `DM-17912 `_: gen3 ip_isr can attempt to remove a non-existant dataset, causing KeyError [ip_isr] - `DM-17932 `_: Validate object type when reading pipeline or graph from pickle [ctrl_mpexec] - `DM-17950 `_: Make Schema picklable [afw] - `DM-17956 `_: Add option to output chi2 files at each outer fit iteration [jointcal] - `DM-17981 `_: Create heterogenous map [afw] - `DM-18022 `_: meas_modelfit test_truncatedGaussian.py failure using bleed environment [meas_modelfit] - `DM-18051 `_: Get defect machinery working for the AuxTel [obs_base, obs_lsst] - `DM-18065 `_: Bad logic in saturation interpolation config options [ip_isr] - `DM-18067 `_: Add fluxMag0 PhotoCalib factory function [afw] - `DM-18068 `_: Write pipe_analysis parquet tables as butler datasets [obs_base] - `DM-18167 `_: display_firefly needs to handle viewer_ids properly [display_firefly] - `DM-18174 `_: constructFlat fails when image is identically zero [obs_subaru, pipe_drivers] - `DM-18181 `_: Provide tool to validate datastore template configurations [daf_butler] - `DM-18189 `_: Investigate mapping of ip_diffim dipole fields to DPDD [ap_association, dax_ppdb] - `DM-18196 `_: Fix afw schema missmatch between ap_association and dax_ppdb [ap_association, dax_ppdb] - `DM-18203 `_: numpy unicode warnings in readTextCatalogTask.py [meas_algorithms] - `DM-18293 `_: Reduce FitTanSipWcsTask default order to 2 [meas_astrom, obs_ctio0m9, obs_decam, obs_lsst] - `DM-18314 `_: Namespace confusion prevents use of MatchOptimisticB with singleFrameDriver [meas_astrom] - `DM-18318 `_: Create initial subset of timeseries features for DIAObject [ap_association] - `DM-18327 `_: Upgrade third-party coord package to version 1.1 [coord] - `DM-18329 `_: Add jointcal templates to obs_lsst [obs_lsst] - `DM-18352 `_: update allocateNodes.py with ability to start HTCondor with partitionable slots [ctrl_execute, ctrl_platform_lsstvc] - `DM-18354 `_: afw test fails due to assertEqual on float [afw] - `DM-18356 `_: Create Gen3 Butler Templates for ci_hsc pipeline [daf_butler] - `DM-18367 `_: Get butler working with Oracle [ctrl_mpexec, daf_butler] - `DM-18372 `_: w_2019_10 pipelines.lsst.io build failure (matchOptimisticB task refactoring) [meas_astrom] - `DM-18387 `_: Write a task to make a visit->coadd match table [obs_base] - `DM-18393 `_: Add some needed features for testing at SLAC [afw, obs_base, obs_lsst] - `DM-18394 `_: Crash when running ap_pipe on calexp templates [pipe_tasks] - `DM-18400 `_: Number of matches is smaller than request [meas_astrom] - `DM-18403 `_: CoaddPsf.getWcs(i) segfaults on i=getComponentCount() [meas_algorithms] - `DM-18438 `_: Specify string lengths in PosixDatastoreRecords table [daf_butler] - `DM-18488 `_: Update pyyaml to v5.x [daf_base, daf_persistence, pyyaml] - `DM-18490 `_: Move TimingMetricTask to verify [ap_verify, verify] - `DM-18531 `_: convert skyCorrection to gen3 pipelineTask [pipe_drivers] - `DM-18544 `_: Add python-level deprecation warnings for Calib interface [afw] - `DM-18551 `_: update ccdExposureId_bits in obs_lsst for imSim and phoSim [obs_lsst] - `DM-18552 `_: Support for new brighter-fatter kernels reverted [ip_isr] - `DM-18556 `_: Adapt visit and coadd qa analysis scripts to run on DESC DC2 outputs [obs_lsst] - `DM-18565 `_: Fix artifacts at patch boundaries in DCR templates [ip_diffim] - `DM-18575 `_: Update imsim and phosim configs for star+galaxy reference catalogs [obs_lsst] - `DM-18576 `_: Issue warnings if translator methods are shadowed [astro_metadata_translator] - `DM-18577 `_: Fix PosixDataStore naming [daf_butler, obs_subaru] - `DM-18624 `_: speed up Table pickling [afw] - `DM-18638 `_: Check for at least 2 visits in AMx metric calculation. [validate_drp] - `DM-18643 `_: Move AstrometryTask source selection from "matcher" into AstrometryTask [meas_astrom, obs_cfht, obs_ctio0m9, obs_lsst, obs_subaru] - `DM-18678 `_: Update to boost 1.69 [afw, boost, meas_base, meas_modelfit] - `DM-18703 `_: constructFlat.py --config isr.doCrosstalkBeforeAssemble=False raises a LengthError exception [ip_isr] - `DM-18708 `_: Investigate ingest problems with BOT data [astro_metadata_translator, obs_lsst] - `DM-18735 `_: Convert dax_ppdb to use Pandas data frames (rather than afw::table) as an interface [dax_ppdb] - `DM-18742 `_: Speed up DcrModel convergence [ip_diffim, pipe_tasks] - `DM-18748 `_: Missing ExpTime in auxTel teststand images cause ingestImages.py to abort [astro_metadata_translator, obs_lsst] - `DM-18754 `_: macOS Jenkins nodes need to change default matplotlib backend [validate_drp] - `DM-18838 `_: Fix butlerRoot in OracleRegistry [daf_butler] - `DM-18839 `_: Remove explicit registry close in the butler [ctrl_mpexec, daf_butler] - `DM-18855 `_: Pex exceptions TypeError should not inherit from RuntimeError [pex_exceptions] - `DM-18863 `_: Investigate and fix warnings in daf_butler [daf_butler] - `DM-18864 `_: Update afw to support undefined values in FITS headers [afw] - `DM-18885 `_: Log number of MeasuredStars in Associations [jointcal] - `DM-18895 `_: Use std::ptrdiff_t as index type in jointcal Eigen objects [eigen, jointcal, jointcal_cholmod] - `DM-18905 `_: Use safe YAML loading in dax_ppdb [dax_ppdb] - `DM-18906 `_: Use safe YAML loading in verify [verify] - `DM-18908 `_: Update baseline versions in EUPS stub packages for new conda env [astropy, matplotlib, numpy, python, scipy] - `DM-18914 `_: Jenkins docs build failure [meas_base] - `DM-19015 `_: HSC warp making is broken with doApplyUberCal=True [meas_mosaic] - `DM-19075 `_: jointcal is ignoring ``writeChi2FilesOuterLoop`` [jointcal] - `DM-19188 `_: Add system for reading header corrections from external files [astro_metadata_translator, obs_lsst] - `DM-19236 `_: Remove errant cout when reading old Calibs [afw] - `DM-19242 `_: Recent changes to afw compression broke macos builds [afw] - `DM-19256 `_: Continue cameraGeom work to support BOT@SLAC [obs_lsst] - `DM-19265 `_: Jacobian lost in meas_mosaic photometric solution [meas_mosaic] - `DM-19270 `_: Set configs and lsstCamMapper.yaml for skyCorrection [obs_lsst] - `DM-19271 `_: Add transactions to gen3 skymap registry [skymap] - `DM-19272 `_: Make script for creating skymaps in gen3 bulter [pipe_tasks, skymap] - `DM-19277 `_: Update HSC defects again [obs_subaru] - `DM-19290 `_: Create an lsst.utils.deprecated that works with pybind11 [utils] - `DM-19293 `_: Clean up photoCalib examples in docstrings [afw] - `DM-19300 `_: Ignore ZQUANTIZ header keyword [afw] - `DM-19303 `_: Disable writing postISRCCD [obs_subaru] - `DM-19304 `_: Astrometric metric regression on CFHT [meas_astrom] - `DM-19310 `_: Update the raft definitions for TS8 camera test stand [obs_lsst] - `DM-19311 `_: Please update to pybind11 2.2.4 [pybind11] - `DM-19320 `_: Restructure obs_subaru HSC configs for Gen3 [obs_subaru] - `DM-19331 `_: Fix detector name for HSC [astro_metadata_translator] - `DM-19366 `_: afw unit tests do not run on some platforms [afw] - `DM-19371 `_: cameraGeom.showCamera applies nQuarter to processed images [afw] - `DM-19372 `_: Produce warning message when QuantumGraph is empty [ctrl_mpexec] - `DM-19373 `_: Add defect list support to butler gen 3 [daf_butler, ip_isr, meas_algorithms, obs_cfht, obs_subaru, pipe_tasks] - `DM-19382 `_: Refactor and reorder ISR steps to support writing pre-interpolated pixels [ip_isr, obs_base, obs_decam, obs_lsst, obs_subaru, pipe_tasks] - `DM-19383 `_: Fix BOT translator when DARKTIME is present [obs_lsst] - `DM-19387 `_: Vectorize dimension entry addition to gen3 registry [daf_butler] - `DM-19388 `_: Investigate timing of Pandas dax_ppdb interface [dax_ppdb] - `DM-19393 `_: Fix HSC y stray-light lookup In Gen2 [ip_isr, obs_subaru] - `DM-19404 `_: Make obs_cfht dependency in jointcal optional [jointcal] - `DM-19409 `_: Add getCenter to Box2I [geom] - `DM-19412 `_: Bad CCD rotations in visualizeVisit.py [pipe_drivers] - `DM-19428 `_: Add eups python as a dependency of pybind11 [pybind11] - `DM-19452 `_: jointcal should not depend on meas_extensions_astrometryNet [jointcal] - `DM-19456 `_: fix docstring for PhotoCalib.calibrateCatalog [afw] - `DM-19458 `_: FieldValidationError usage incorrect in many tasks [meas_algorithms, meas_extensions_psfex, pex_config] - `DM-19461 `_: Investigate and possibly fix afw::table Record allocation performance` [afw] - `DM-19467 `_: Add C++ iteration to GenericMap [afw] - `DM-19485 `_: Fix length of instrument name in gen 3 butler schema [daf_butler] - `DM-19506 `_: Adjust defect FITS files to be compatible with DS9 [meas_algorithms] - `DM-19517 `_: Calculate the PSF for DCR coadds [pipe_tasks] - `DM-19531 `_: Add option to include regions when ingesting gen3 images [obs_base] - `DM-19535 `_: Move MakeBrighterFatterKernelTaskRunner to cp_pipe/pairedVisitTaskRunner [cp_pipe] - `DM-19568 `_: Backwards-compatibility for maskPixelsFromDefectList is broken [ip_isr] - `DM-19573 `_: Allow color outputs from compilers under scons [sconsUtils] - `DM-19575 `_: Add Storable mixin to ExposureInfo components [afw] - `DM-19583 `_: Investigate butler gen 3 configuration system [daf_butler] - `DM-19585 `_: Fix length of instrument name in gen 3 butler schema (see also DM-19485) [daf_butler] - `DM-19598 `_: Remove lsst.ap.verify.measurements automodapi statement [ap_verify] - `DM-19614 `_: Write transmission curves in writeCuratedCalibrations [daf_butler, obs_subaru] - `DM-19615 `_: Change raw storage class in isr task [daf_butler, ip_isr] - `DM-19622 `_: Make PosixDatastore's internal table lowercase [daf_butler] - `DM-19623 `_: Change sqlalchemy syntax in addDimensionEntryList [daf_butler] - `DM-19627 `_: Add text file serialization to meas_algorithms Defects class [meas_algorithms] - `DM-19638 `_: Create parent task/script for bootstrapping Gen3 repos [daf_butler, log, obs_base, obs_subaru] - `DM-19641 `_: Use jointcal instead of meas_mosaic in obs_subaru HSC coaddition [obs_subaru] - `DM-19660 `_: Bug? The PSF is not warped during image differencing [afw, ip_diffim] - `DM-19664 `_: Set ``OBSTYPE`` rather than appending it [pipe_drivers] - `DM-19670 `_: Writing missing docstrings and docstring updates in ip_diffim [ip_diffim] - `DM-19671 `_: setConfigRoot sometimes needs to not update the root [daf_butler] - `DM-19674 `_: Reading fringe exposure can modify a WCS in another exposure [astshim] - `DM-19677 `_: Disable writing postISRCCDs in ProcessCcdTask [obs_decam, obs_subaru, pipe_tasks] - `DM-19682 `_: Fix DAYOBS calculation and allow for gen2 header correction for ingest [astro_metadata_translator, obs_lsst] - `DM-19693 `_: Generate correction files to patch up DAYOBS from 20190308_000139 to 20190329_000022 [obs_lsst] - `DM-19694 `_: Make Defects presize internal tables. [meas_algorithms] - `DM-19710 `_: Add astro_metadata_translator corrections for older HSC data [astro_metadata_translator] - `DM-19717 `_: Add setup_module to ip_isr unit tests. [ip_isr] - `DM-19720 `_: Change multiband.py to support meas_extensions_scarlet [pipe_drivers, pipe_tasks] - `DM-19732 `_: remnant ip_isr debug statement left in [ip_isr] - `DM-19752 `_: monowl string parse in gen2 butler ingest of ts8 data [obs_lsst] - `DM-19755 `_: Add a check in CameraMapper for duplicate mappings [obs_base] - `DM-19766 `_: DECam instcals fail to process with invalid DateTime [astro_metadata_translator, obs_subaru] - `DM-19768 `_: Fix jointcal handling of coordinate errors [jointcal] - `DM-19769 `_: Fix CmdLineTask --longlog time formatting [ap_pipe, ctrl_mpexec, pipe_base] - `DM-19797 `_: Error from loadReferenceObjects with a Gen3 HSC-RC2 repo [meas_algorithms] - `DM-19802 `_: Fix jointcal ra/dec bounding box calculations [jointcal] - `DM-19808 `_: Avoid duplication in deferred prelight follow-up queries [daf_butler] - `DM-19818 `_: Fix Gen3 Butler pickling broken on DM-19638 [daf_butler] - `DM-19871 `_: Fix validity range end in Gen3 calibration bootstrapping [daf_butler, obs_base] - `DM-19873 `_: Implement PropertySet.getitem and return get() [daf_base] - `DM-19877 `_: Replace PropertySet.get with getScalar or getArray [obs_lsst, pipe_drivers, pipe_tasks] - `DM-19884 `_: Add configs to __all__ in isrTask.py [ip_isr] - `DM-19887 `_: Switch skymap to geom rather than afwGeom [skymap] - `DM-19891 `_: Fix __eq__ for defects class [meas_algorithms] - `DM-19902 `_: String representation of Observatory coordinates flips lat/lon [afw] - `DM-19907 `_: Don't pad numerator with zeros in smoothArray during SkyCorrection [pipe_drivers] - `DM-19916 `_: Investigate URI inconsistencies in daf_butler LocationFactory [daf_butler] - `DM-19958 `_: Missing _mapper in Gen2 Butler repo gives confusing error [pipe_base] - `DM-19971 `_: Fixup for tickets/DM-19272 [pipe_tasks] - `DM-20008 `_: AuxTel translator in obs_lsst needs TSTART adjusted [obs_lsst] - `DM-20019 `_: Fix pickling of String Fields [afw] - `DM-20024 `_: BackgroundList.readFits doesn't close fits files [afw]