.. _release-v24-0-0-tickets: ################################### Tickets Addressed in Release 24.0.0 ################################### Tickets merged after w_2022_28 and backported --------------------------------------------- - `DM-19852 `_: skyCorrectionTask should be moved to pipe_tasks for Gen3 [drp_pipe, pipe_drivers, pipe_tasks, ap_pipe] - `DM-29835 `_: pipe_drivers background code needs migration [cp_pipe, daf_butler, pipe_tasks] - `DM-35082 `_: Store dimension universe in quantum graph [daf_butler, pipe_base] - `DM-35496 `_: ra/decl columns in sourceTable still aren't updated in recalibration step [pipe_tasks] - `DM-35530 `_: Fix improperly persisted source centers [meas_extensions_scarlet] - `DM-35600 `_: afw binary executable tests fail in nightly clean builds [afw] - `DM-35681 `_: Ensure DimensionUniverse is passed to QuantumGraph at construction [ctrl_mpexec, pipe_base] - `DM-35722 `_: Investigate failed measure jobs in w_2022_28 [meas_extensions_scarlet] - `DM-35777 `_: meas_base/test_diaCalculationPlugins fails with scipy 1.9 [meas_base] - `DM-36034 `_: Make middleware release notes for v24 [ctrl_bps_panda, ctrl_mpexec, daf_butler, ctrl_bps, pex_config, utils, resources, ctrl_bps_htcondor, obs_base, pipe_base] - `DM-36222 `_: Enable meas_extensions_shapeHSM to work with GalSim 2.4 [meas_extensions_shapeHSM] - `DM-36472 `_: Fix a bug in _validateGalsimInterpolant method [meas_extensions_piff] - `DM-37011 `_: Compile Release Note for 24.0.0 Science Pipelines release [pipe_tasks, ip_isr] Tickets merged before w_2022_28 ------------------------------- - `DM-6278 `_: Investigate proper precision for afw::image::Image pixel transforms [afw] - `DM-7148 `_: Futurize DictField, ConfigDictField [pex_config] - `DM-8146 `_: Remove deprecated FFTW API usage from meas_base [meas_base] - `DM-10227 `_: Replace raw arrays with vector in jointcal [jointcal] - `DM-12659 `_: Clean up Doxygen tagfile imports [meas_extensions_photometryKron, meas_extensions_convolved, meas_extensions_psfex, meas_extensions_shapeHSM, meas_extensions_simpleShape, shapelet, utils, sphgeom, jointcal_cholmod, sconsUtils, fgcmcal, obs_base, obs_subaru] - `DM-13899 `_: imageDifference.py uses outdated AstrometryTask API [pipe_tasks] - `DM-13943 `_: Deprecate VisitInfo.getExposureId() [ap_association, cp_pipe, pipe_tasks, afw, obs_decam, ip_isr, obs_base] - `DM-14589 `_: Remove .cache from list of clean targets after pytest upgrade [sconsUtils] - `DM-19374 `_: pipe_task's optional dependency on ip_diffim isn't [pipe_tasks] - `DM-20970 `_: timeMethod gives platform-dependent results [utils] - `DM-21215 `_: Update fgcm/fgcmcal to support arbitrary and variable camera orientations [obs_subaru, fgcmcal, fgcm] - `DM-21687 `_: Write a how-to document for PipelineTasks [pipe_base] - `DM-22521 `_: enable partial image reads in cp_pipe combine to avoid memory issues [cp_pipe] - `DM-22823 `_: Remove accidental Doxygen comments for namespace lsst [jointcal, base, afw, ip_isr, meas_algorithms, cpputils] - `DM-23308 `_: Qserv container-based builds [log, sphgeom] - `DM-23624 `_: Get MEDIAN_PER_ROW overscan correction moved to afw, or find numpy replacement [ip_isr] - `DM-24719 `_: New warnings for missing EUPS product dirs with conda env (w_2020_18) [sconsUtils] - `DM-24738 `_: Add background offset tracking to fgcmcal and test on HSC RC2/PDR2 [obs_subaru, fgcmcal, fgcm] - `DM-25839 `_: Write a tutorial for using the faro package [faro] - `DM-26063 `_: Create a user guide page for alert_packet on pipelines.lsst.io [alert_packet] - `DM-26140 `_: Centralize Gen 3 pipeline configuration info for ap_verify datasets [ap_verify_testdata, ap_pipe, ap_verify] - `DM-26231 `_: Remove defaultFilter in LoadReferenceObjectsConfig [meas_algorithms] - `DM-26987 `_: Update filtering of matched catalog to operate before creating GroupView [faro] - `DM-27013 `_: Change CalibrateTask refcat defaults to Gaia DR2 for astrometry and PS1 for photometry [ap_verify, obs_lsst, pipe_tasks, obs_cfht, obs_decam, pipelines_check, obs_subaru] - `DM-27106 `_: Add array-based overload to photoCalib method(s) [afw] - `DM-27117 `_: Add dummy pipeline to ap_verify testing [ap_verify_testdata, ap_verify] - `DM-27177 `_: Remove lsst.afw.image.Filter [ap_association, cp_pipe, daf_butler, obs_lsst, ap_pipe, jointcal, obs_cfht, pipe_tasks, afw, ip_diffim, obs_decam, ip_isr, meas_astrom, obs_base, obs_subaru] - `DM-27843 `_: add anyFilterMapsToThis support to ReferenceObjectLoader [meas_astrom, meas_algorithms] - `DM-28200 `_: Reduce jointcal info log verbosity [jointcal] - `DM-28334 `_: makeTransmissionCurves needs to be updated to use physical filter names [obs_subaru] - `DM-28352 `_: Deprecate validate_drp [lsst_distrib, faro] - `DM-28862 `_: Make Gen3 transform Source Table tasks work on all cameras [obs_lsst, pipe_tasks, obs_decam, obs_subaru] - `DM-28863 `_: Add metrics output and tests to gen3 jointcal [verify_metrics, jointcal] - `DM-28920 `_: Create gen3 auxtel calibrations [cp_verify, cp_pipe] - `DM-29008 `_: Make gen3 jointcal configs the default [obs_decam, jointcal, obs_subaru] - `DM-29042 `_: Remove support for old-style names in ap_verify [ap_verify] - `DM-29326 `_: Fix logic of the doVignette option in isrTask [cp_verify, cp_pipe, obs_subaru, ip_isr] - `DM-29340 `_: Write guide to using Gen 3 ap pipelines [ap_pipe] - `DM-29535 `_: Create gen3 cfht testdata_jointcal repos [testdata_jointcal, fgcmcal] - `DM-29542 `_: Move jointcal cfht tests to gen3 [jointcal] - `DM-29575 `_: bps restart command [ctrl_bps] - `DM-29614 `_: Have bps report show info from multiple submit nodes [ctrl_bps] - `DM-29731 `_: Implement RFC-695 [sdm_schemas] - `DM-29884 `_: Fix exception in Gen3+applyColorTerms logic branch of jointcal [jointcal] - `DM-29885 `_: Disable jointcal photometry in HSC via config [obs_subaru] - `DM-29955 `_: Add ExposureInfo id getter (replacement for VisitInfo.getExposureId()) [ap_association, cp_pipe, daf_butler, obs_lsst, pipe_tasks, afw, ip_diffim, obs_decam, ip_isr, obs_base] - `DM-30015 `_: Update stack package conf.py files for documenteer 0.6 [meas_extensions_psfex, meas_extensions_shapeHSM, meas_extensions_simpleShape, ap_pipe, jointcal, afw, meas_modelfit, display_firefly, fgcmcal, meas_extensions_photometryKron, log, meas_astrom, cbp, geom, meas_extensions_scarlet, dax_apdb, obs_decam, meas_base, ap_association, obs_cfht, base, ip_diffim, ip_isr, coadd_utils, display_ds9] - `DM-30108 `_: Add blending metrics useful for determining shredded galaxies or failed deblending [meas_extensions_scarlet, scarlet] - `DM-30163 `_: Python crashes when measuring flux from invalid shape parameters [meas_base] - `DM-30170 `_: Define crosstalk tests for cp_verify [cp_verify, cp_pipe] - `DM-30171 `_: Define PTC tests for cp_verify [cp_verify] - `DM-30172 `_: Define BFK tests for cp_verify [cp_verify, cp_pipe] - `DM-30229 `_: Get PSF shape from a source record [afw] - `DM-30266 `_: Convert Quantum and QuantumGraph IDs to UUIDs [ctrl_mpexec, daf_butler, ctrl_bps, pipelines_check, pipe_base] - `DM-30284 `_: Investigate differences in the coadd background between gen2 and gen3 [skymap, pipe_drivers, obs_lsst, pipe_tasks, coadd_utils, meas_base, obs_base, obs_subaru] - `DM-30624 `_: Document gen2 to gen3 refcat ingestion [meas_algorithms] - `DM-30648 `_: Add photodiode calibration class [cp_pipe, obs_lsst, pipe_tasks, ip_isr] - `DM-30651 `_: Switch DECam overscan correction to median per row [obs_decam] - `DM-30699 `_: Add new flux measurement to meas_extensions_trailedSources [meas_extensions_trailedSources] - `DM-30831 `_: Update Gen 3 DcrAssembleCoadd Task [pipe_tasks] - `DM-30891 `_: Create drp_pipe and move all DRP pipeline definitions there [obs_lsst, pipe_tasks, lsst_distrib, obs_decam, pipelines_check, obs_subaru] - `DM-30966 `_: Make Spectractions Gen3-serializable [daf_butler] - `DM-31060 `_: Clean up some log usage in Tasks [cp_verify, ap_association, pipe_tasks, meas_extensions_psfex] - `DM-31063 `_: Copy configs from obs_* packages to ap_pipe [ap_pipe] - `DM-31193 `_: Add new PSF chi2/npixels fields to apdb [ap_association, ap_verify] - `DM-31253 `_: Create test infrastructure for pipeline execution [daf_butler, ctrl_mpexec] - `DM-31254 `_: afw.geom.Polygon.createImage yields different data points for Intel and ARM [afw] - `DM-31287 `_: Butler registry _importDatasets considered dangerous with UUID [daf_butler] - `DM-31323 `_: Fix docstrings in code imported from Pierre Astier [cp_pipe] - `DM-31388 `_: Investigate low fake injection completeness in HSC COSMOS [pipe_tasks] - `DM-31459 `_: Update faro to use parquet tables for patch and tract-level metric calculation [faro] - `DM-31491 `_: Make a RC2 fakes pipeline [pipe_tasks, obs_subaru] - `DM-31592 `_: Fix overlength doc lines in ip_isr causing need for W505 in setup.cfg [ip_isr] - `DM-31611 `_: Improve reproducibility in faro ellipKPM test_te1 [faro] - `DM-31619 `_: Fully incorporate SSP object association in DiaPipe [ap_association, ap_pipe, dax_apdb] - `DM-31620 `_: Write SSP association metrics [verify_metrics, ap_association, ap_verify] - `DM-31662 `_: Fit trailed source model to detections made on image differences [ap_association, pipe_tasks] - `DM-31722 `_: Move utility code out of pipe_base and daf_butler into utils package [ctrl_mpexec, daf_butler, obs_lsst, ctrl_bps, obs_cfht, obs_decam, ip_isr, utils, pipe_base, meas_algorithms, obs_base, obs_subaru] - `DM-31723 `_: Move ButlerURI out of daf_butler into a standalone package [daf_butler, pipe_base] - `DM-31769 `_: Add user control over dataset constraints in QG generation queries [daf_butler, ctrl_mpexec, pipe_base] - `DM-31777 `_: Determine and use correct position for PSF shape determination in ImageDifferenceTask [ip_diffim, pipe_tasks] - `DM-31801 `_: Ensure all loggers include lsst prefix [cp_pipe, ctrl_mpexec, meas_base, meas_extensions_gaap, meas_extensions_scarlet, jointcal, obs_lsst, pipe_tasks, verify, afw, ip_diffim, obs_decam, ip_isr, meas_astrom, meas_deblender, pipe_base, meas_algorithms, obs_base, ap_verify] - `DM-31811 `_: Add detection significance to footprint peaks [afw, meas_algorithms] - `DM-31839 `_: Reduce memory usage in MatchPessemisticB [meas_astrom] - `DM-31860 `_: Add flux statistic task and sky object metrics into faro [verify_metrics, faro] - `DM-31880 `_: Add reference star color term q/a plots to fgcm [obs_subaru, fgcmcal, fgcm] - `DM-31895 `_: Rename/reorganize cp_pipe pipelines [cp_pipe] - `DM-31896 `_: Clarify PTC code [cp_pipe] - `DM-31899 `_: Update example bps yaml files to include execution butler configs [ap_pipe] - `DM-31934 `_: Replace HH:MM:SS conversion code with astropy equivalents. [ap_association] - `DM-31938 `_: Have PTC dataset unpad results [cp_pipe, ip_isr] - `DM-31950 `_: Add descriptions for DP0.2 and HSC Object/Source schema columns [sdm_schemas] - `DM-31964 `_: Fixup dimensions on ProcessCcdWithFakesTask/MatchFakesTask [obs_subaru, pipe_tasks, ap_verify] - `DM-31965 `_: TAP Datalink easier management of snippets [sdm_schemas] - `DM-31966 `_: Minimal viable pipetask python API [ctrl_mpexec, pipe_base] - `DM-31975 `_: Implement RFC-800 Add third party package Spectractor to lsst_distrib [lsst_distrib] - `DM-31976 `_: Change handling of collections and dataset types in dataset transfer [daf_butler, ctrl_mpexec, ctrl_bps] - `DM-31986 `_: "filter label mismatch" on loading cp_pipe calibration [cp_pipe] - `DM-31990 `_: Add configuration option to set coverage nside for survey-wide HealSparsePropertyMaps [pipe_tasks] - `DM-31997 `_: Fix rotation angle definitions for LATISS [obs_lsst] - `DM-32008 `_: Wrap `test_spoke` in C++/pybind11 [meas_astrom] - `DM-32010 `_: Write `_create_pattern_spokes` in C++/pybind [meas_astrom] - `DM-32027 `_: Rename outCollection to outputRun [ctrl_bps] - `DM-32029 `_: Add faro steps to DRP.yaml in obs_subaru [obs_subaru] - `DM-32034 `_: Create MatchProbabilistic (Pipeline)Task [meas_astrom, pipe_tasks] - `DM-32046 `_: Remove HTMIndexDiaPosition plugin from AP pipeline [ap_association, meas_base, pipe_tasks] - `DM-32047 `_: Add a requestMemoryMax config in ctrl_bps [ctrl_bps] - `DM-32048 `_: Update fgcmcal tests to use new pipetask API [fgcmcal] - `DM-32055 `_: Measure quality of nominal wcs for AuxTel [afw, obs_lsst] - `DM-32058 `_: Duplicate faro task in pipeline gives cryptic error [daf_butler, obs_base] - `DM-32059 `_: Keep example tasks from executing in default faro pipelines [faro] - `DM-32061 `_: export-calibs has problems with datasets using direct ingest [daf_butler] - `DM-32062 `_: Fix ap_verify with gen2 butler after APDB update [daf_persistence] - `DM-32065 `_: Skip gen2 test_read_CuratedCalibs in pipe_tasks [pipe_tasks] - `DM-32066 `_: BPS jobs with memory autoscaling enabled remain idle after the first run attempt [ctrl_bps] - `DM-32072 `_: Prototype better-scaling alternative to executive butler [daf_butler] - `DM-32074 `_: Modify how HTCondor plugin handles transfer of execution butler [ctrl_bps] - `DM-32079 `_: Dilate child footprints using PSF footprint [meas_extensions_scarlet] - `DM-32080 `_: Pipelines import parameters in the wrong order [pipe_base] - `DM-32097 `_: Backend for image cutout service [geom] - `DM-32124 `_: ValueError: Only one node is allowed to produce forcedSource [pipe_tasks] - `DM-32129 `_: Add a maximum mean offset threshold for SFM astrometry fit success [meas_astrom, obs_lsst] - `DM-32131 `_: Merge Cassandra branch of APDB [ap_association, dax_apdb] - `DM-32135 `_: Error in jointcal init when removing unneeded metrics [jointcal] - `DM-32141 `_: Get AuxTel SFM reductions working end-to-end [obs_lsst] - `DM-32142 `_: Copy lsst.log.utils.traceSetAt to lsst.utils.logging [utils] - `DM-32144 `_: SQLAlchemy warnings for cartesian product [daf_butler] - `DM-32198 `_: Set sentinel values for flag/integer columns for missing bands in Object tables [pipe_tasks] - `DM-32199 `_: If submit or prepare, have bps check early that WMS is in environment. [ctrl_bps] - `DM-32201 `_: HTCondor plugin bug if output collection contains period [ctrl_bps] - `DM-32207 `_: Add physical_filter to jointcal metrics [jointcal] - `DM-32210 `_: utils logging file name determination needs improvement [utils] - `DM-32217 `_: BPS displays cumulative timings instead of time intervals during a submission [ctrl_bps] - `DM-32218 `_: Add additional GAaP apertures in obs_subaru [sdm_schemas, obs_subaru] - `DM-32219 `_: Add HeavyFootprint addTo and subtractFrom methods [afw] - `DM-32220 `_: HTCondor plugin copying execution butler back from job [ctrl_bps] - `DM-32221 `_: faro should not use assertEqual in unit tests [faro] - `DM-32226 `_: Move of pipe_base timeMethod to utils breaks documenteer [ap_association, cp_pipe, meas_base, obs_base, ap_pipe, jointcal, meas_extensions_scarlet, pipe_tasks, verify, ip_diffim, obs_decam, ip_isr, meas_astrom, meas_deblender, fgcmcal, meas_algorithms, pipe_base] - `DM-32229 `_: Update faro TExTasks to take parquet table as input [faro] - `DM-32238 `_: Fix unexpected floating point values in drpAssociation task [pipe_tasks] - `DM-32239 `_: Fix psf width computation in meas_extensions_trailedSources [meas_extensions_trailedSources] - `DM-32241 `_: bps submit can take multiple hours [ctrl_bps] - `DM-32245 `_: Reprocess HiTS AP with fakes and an APDB [ap_pipe] - `DM-32250 `_: Enable mypy checking in pipe_base and obs_base [daf_butler, obs_base, pipe_base] - `DM-32252 `_: NoiseReplacer noiseSource='variance' is untested and broken. [meas_base] - `DM-32254 `_: Support python implementations of pixelizations [daf_butler, sphgeom] - `DM-32256 `_: Image cutout range backend and new queuing model [sphgeom] - `DM-32261 `_: Add SSO data to CI dataset [ap_verify_testdata, ap_verify] - `DM-32262 `_: Rename GAaP columns in obs_subaru [sdm_schemas, obs_subaru] - `DM-32269 `_: Investigate Piff "Unable to measure aperture correction" failure mode [meas_extensions_piff] - `DM-32285 `_: SDSS shape errors have yy and xy interchanged [meas_base] - `DM-32290 `_: A create-table failure led to registry corruption [daf_butler] - `DM-32294 `_: Clarify dataset ID vs. UUID in butler docs [daf_butler] - `DM-32298 `_: Issue with comcam visitInfo metadata at the summit [obs_lsst] - `DM-32299 `_: Write `_construct_pattern_and_shift_rot_matrix` in C++/pybind [meas_astrom] - `DM-32300 `_: Simplify `_build_distances_and_angles` to only use numpy arrays [meas_astrom] - `DM-32305 `_: lsst.daf.butler.Config slowness with large numbers of lookups [daf_butler] - `DM-32306 `_: refBand functor doesn't know that u-band exists [pipe_tasks] - `DM-32315 `_: DM-29955 breaks ci_hsc_gen2 [obs_decam, obs_lsst, obs_base] - `DM-32324 `_: Add forced source table to sdm_schemas and ci_imsim [sdm_schemas] - `DM-32330 `_: Register DECam narrow-band filters in skymap [skymap] - `DM-32333 `_: SourceTable should use LocalNanojansky functor on apFluxes [obs_lsst, obs_subaru] - `DM-32337 `_: Add "add_image" to AccumulatorMeanStack [meas_algorithms] - `DM-32366 `_: Setting no_good_pixels_mask=None crashes AccumulatorMeanStack [meas_algorithms] - `DM-32373 `_: Run Gen 3 single frame measurement on on validation_data_cfht [obs_cfht] - `DM-32376 `_: ap_verify gen3 fails to find jointcal_photoCalib dataset in graph generation [pipe_tasks] - `DM-32378 `_: Generate amp offset corrected sky frames [obs_subaru] - `DM-32386 `_: Deploy test cutout service on data-int [daf_butler] - `DM-32388 `_: Create calib generation script for ap_verify datasets [ap_verify] - `DM-32402 `_: Add cells to patches in skymaps [skymap, pipe_tasks] - `DM-32403 `_: Support ORDER BY and LIMIT in registry query methods [daf_butler] - `DM-32407 `_: Errors concerning a _SpecialTimespanBound when building an execution butler in some cases [daf_butler] - `DM-32408 `_: Write Python code to determine version string for pipeline package [ctrl_mpexec, daf_butler, pex_config, utils, sphgeom, pipe_base] - `DM-32411 `_: Change where translations are handled in WarpedPsf/CoaddPsf [meas_algorithms] - `DM-32414 `_: Exposure ID Gen 3 disassembled component broken [afw, obs_base, daf_butler] - `DM-32418 `_: Create and test datalinks for dp01_dc2_catalogs tables [sdm_schemas] - `DM-32430 `_: Create DECam DRP Processing Pipeline [obs_decam, jointcal] - `DM-32435 `_: Silent failure in executing memory-hungry job? [ctrl_bps] - `DM-32436 `_: Implement scarlet lite in meas_extensions_scarlet [pipe_tasks, proxmin, meas_extensions_scarlet, scarlet] - `DM-32437 `_: Reformat code and run black+isort in linting mode in middleware packages [ctrl_mpexec, daf_butler, utils, obs_base, pipe_base] - `DM-32448 `_: Backport incorrect GAaP field name [obs_lsst] - `DM-32449 `_: Fix error when external calibs are not found [faro] - `DM-32451 `_: Sort pipelines deterministically [pipe_base] - `DM-32454 `_: Dataset constraints in queryDimensionRecords can't involve extra dimensions [daf_butler] - `DM-32456 `_: pipe_tasks test_processCcd PSF shape changes with eigen 3.4.0 [jointcal] - `DM-32459 `_: Improve QG gen diagnostics and update FAQ accordingly [daf_butler, pipe_base] - `DM-32467 `_: Can't instantiate butler with pathlib Path object [daf_butler] - `DM-32470 `_: Dark verification in OCPS calibration script from DM-31897 fails because NOISe is too low with respect nominal readnoise [cp_verify] - `DM-32478 `_: scarlet MACOSX_DEPLOYMENT_TARGET wrangling is unnecessary [scarlet] - `DM-32483 `_: test_transforms.py fails on macosx-arm [geom] - `DM-32484 `_: test_projectedLikelihood.py fails for osx-arm64 [meas_modelfit] - `DM-32487 `_: fix compilation for osx-arm64 for jointcal [jointcal] - `DM-32491 `_: Provide butler registry lookup API [daf_butler] - `DM-32499 `_: deprecate butler prune-collections [daf_butler] - `DM-32502 `_: Add TE3 and TE4 specs to verify_metrics [verify_metrics] - `DM-32504 `_: SingleQuantumExecutor should log exception messages [ctrl_mpexec] - `DM-32513 `_: Hide certain datalink query parameters [sdm_schemas] - `DM-32517 `_: Remove debug print from astshim [astshim] - `DM-32535 `_: Change DCR interpolation order to 1 [pipe_tasks] - `DM-32549 `_: Add position to psf.getDeterminantRadius() calls [ip_diffim, pipe_tasks] - `DM-32553 `_: Update faro to use parquet tables for matched catalog metric calculation [faro] - `DM-32579 `_: Fix Memory monitoring for Rubin PanDA jobs [ctrl_bps] - `DM-32583 `_: Remove incorrect python linking and unnecessary macos flat_namespace [sconsUtils] - `DM-32594 `_: Remove dependency on inflection in bps_config [ctrl_bps] - `DM-32601 `_: Move remaining jointcal tests to gen3 [testdata_jointcal, jointcal] - `DM-32605 `_: Add healpix support to sphgeom with healpy [sphgeom] - `DM-32611 `_: Update lsst.faro.utils.filtermatches for parquet table inputs [faro] - `DM-32615 `_: Move jointcal cfht_minimal tests to gen3 [jointcal, obs_cfht] - `DM-32621 `_: ci_cpp_gen3 fails with TypeError [cp_pipe] - `DM-32624 `_: Override source selection criteria in SFM calibration stages for LSSTCam-imSim [obs_lsst, meas_algorithms] - `DM-32625 `_: Activate guards on SFM PSF quality for inclusion in coaddition for LSSTCam-imSim [obs_lsst, pipe_tasks, obs_subaru] - `DM-32648 `_: Change default branch name to "main" [daf_butler, lsst, sconsUtils, verify] - `DM-32649 `_: Move psf quality statistics calculation from selectImages to computeExposureSummaryStats [afw, pipe_tasks] - `DM-32657 `_: Abort bps submission if submit-side run directory already exists. [ctrl_bps] - `DM-32658 `_: Protect getmodule call in timeMethod [utils] - `DM-32661 `_: Optimization in utils/wrappers.py fails to optimize [utils] - `DM-32662 `_: Optimize afw.table.Catalog.__getitem__ [afw] - `DM-32663 `_: Avoid isinstance check in pex.config.Field.__get__ [pex_config] - `DM-32666 `_: Add GaussianFlux columns to SourceTable [sdm_schemas, obs_lsst, obs_subaru] - `DM-32670 `_: Running ISR and PTC task on BOT data on 189 CCDs fails at NCSA [cp_pipe] - `DM-32675 `_: Improvement PanDA plugin on using iDDS [ctrl_bps] - `DM-32679 `_: Change utils trace_set_at to also set lsst logger [ip_diffim, meas_modelfit, utils, meas_algorithms] - `DM-32682 `_: Create TaskMetadata class to replace PropertySet in pipe_base [cp_verify, ap_association, ip_isr, ctrl_mpexec, daf_butler, pipe_tasks, verify, ip_diffim, meas_extensions_piff, utils, daf_base, meas_algorithms, pipe_base] - `DM-32683 `_: Print refcat name in log when loading [meas_algorithms] - `DM-32687 `_: add a butler remove-collections command [daf_butler] - `DM-32694 `_: Split AP pipeline into ApPipeWithFakes [ap_association, ap_pipe, ap_verify] - `DM-32695 `_: Make PanDA's example run more easily on IDF [ctrl_bps] - `DM-32698 `_: Fix argument type in GraphBuilder skipExistingIn fallback logic [daf_butler] - `DM-32714 `_: Fix backwards compatibility broken by DM-32649 [pipe_tasks] - `DM-32731 `_: fix schema browser cname problem [sdm_schemas] - `DM-32732 `_: Remove github pages CNAME file from schema browser [sdm_schemas] - `DM-32733 `_: Config.loadFromStream doesn't actually accept a file-like object [pex_config] - `DM-32743 `_: Make a container that holds the current alert schema, and a script for uploading it to an alert registry [alert_packet] - `DM-32745 `_: Two CCDs in LSSTCam failed to plot with plotPhotonTransferCurve.py. [cp_pipe] - `DM-32746 `_: Two amps in LSSTCam showed poor PTC curve fits. [cp_pipe] - `DM-32747 `_: Many (>100) E2V amps had early PTC turn-off in LSSTCam [cp_pipe] - `DM-32749 `_: Multiple sdm_schema yamls use incorrect fits.tunit key [sdm_schemas] - `DM-32750 `_: Complain if unknown kwargs are given to Butler APIs [daf_butler] - `DM-32759 `_: Drop already-deprecated support for "root" in config files [pex_config] - `DM-32767 `_: Add INFO level logging to dispatchverify.py [verify] - `DM-32801 `_: Fix sphinx build in utils [utils] - `DM-32817 `_: Change usage of ButlerURI to ResourcePath [daf_butler, obs_base, ctrl_bps] - `DM-32818 `_: meas_extensions_piff should respect mask plane [meas_extensions_piff] - `DM-32819 `_: 'verifyFlatStatistics' returns "RXX_S00 SUCCESS" when listing failures [cp_verify] - `DM-32820 `_: Fix sphinx build in daf_butler with ButlerURI [daf_butler] - `DM-32821 `_: Change shell call to ast_link [sconsUtils] - `DM-32823 `_: afw ds9 test nukes current display [afw] - `DM-32827 `_: skyCorr backgrounds are not get applied during gen3 makeWarp [pipe_tasks] - `DM-32830 `_: panda_auth_reset [ctrl_bps] - `DM-32831 `_: add a butler remove-runs CLI command [daf_butler] - `DM-32840 `_: Fixup LATISS header that's so bad it can't be fixed by translator [obs_lsst] - `DM-32843 `_: Create middleware release notes for v23.0 [ctrl_mpexec, daf_butler, ctrl_bps, obs_base, pipe_base] - `DM-32883 `_: Investigate PropertySet to TaskMetadata migration [daf_butler, pipe_base] - `DM-32895 `_: Add matchObjectToTruth to obs_lsst's imsim DRP.yaml [obs_lsst] - `DM-32901 `_: DiscreteSkyMapConfig and TractBuilderConfigs do not appear in pipelines.lsst.io [skymap] - `DM-32950 `_: Fix daf_butler Quantum Unit Test [daf_butler] - `DM-32964 `_: SimplePipelineExecutor should validate and freeze the config [pipe_base] - `DM-32968 `_: Job put on hold if exit with signal 11 [ctrl_bps] - `DM-32986 `_: fix option handling in butler CLI presets files [daf_butler] - `DM-32988 `_: Update all ApPipe pipelines to use multi-tract difference imaging [ap_pipe] - `DM-32990 `_: PcaPsfDeterminerConfig doesn't constrain illegal values [meas_algorithms] - `DM-33001 `_: Design refactoring of ImageDifferenceTask [ip_diffim] - `DM-33010 `_: Synchronize CreateRandomApFakesTask with MatchFakesTask changes [pipe_tasks, ap_pipe] - `DM-33012 `_: Update faro base class refcat loader to return single DataFrame [faro] - `DM-33013 `_: Fix notebook printing of dimensionRecords [daf_butler] - `DM-33041 `_: PTC task not finding linearizer [cp_pipe] - `DM-33046 `_: Turn on defect correction by default for AuxTel/LATISS [obs_lsst] - `DM-33049 `_: butler.getting an over-constrained dataId raises [daf_butler] - `DM-33058 `_: Deprecate validation_data_hsc and validation_data_decam [lsst_ci, jointcal, faro] - `DM-33073 `_: Update Eigen to 3.3.9 [eigen] - `DM-33078 `_: Define ingest path for photodiode data [obs_lsst] - `DM-33085 `_: Fix cache key warning in butler sqlalchemy usage [daf_butler] - `DM-33086 `_: Have plan for dealing with post-ingest file compression [daf_butler, obs_base] - `DM-33096 `_: Enable empirical read noise calculation for DECam ISR [obs_decam] - `DM-33125 `_: Report slowest tests when scons runs tests [sconsUtils] - `DM-33138 `_: Add CTI correction to ip_isr [cp_pipe, ip_isr] - `DM-33140 `_: Change butler log message from warn to debug [daf_butler] - `DM-33142 `_: Append doCrosstalk False to obs_decam DRP.yaml [obs_decam] - `DM-33148 `_: Make dimension import/export less prone to conflicts [daf_butler] - `DM-33150 `_: Remove Gen 2 support from ap_verify [pipe_base, ap_verify_testdata, ap_verify] - `DM-33155 `_: Investigate dynamic task metadata type selection in pipelines [daf_butler, pipe_base, daf_base] - `DM-33157 `_: Fix doxygen errors in pipe_tasks [meas_astrom, meas_deblender, skymap, pipe_tasks] - `DM-33158 `_: Sort sourceTable_visit by detector [pipe_tasks] - `DM-33164 `_: order_by querying in butler registry is extremely slow and doesn't scale. [daf_butler] - `DM-33167 `_: Test and fix repr implementations for Box, Point, and Exten [geom] - `DM-33174 `_: Allow the Butler.removeRuns() method to accept the '@' character in the first iterable argument [daf_butler] - `DM-33193 `_: Exposure.getReadoutCorner method returns incorrect values for some LSST CCD amplifiers. [afw] - `DM-33195 `_: Update forcedPhotCoadd to use the correct input image in Gen3 [meas_base] - `DM-33200 `_: Fix lsst.afw.geom usage in two afw rst documents [afw] - `DM-33204 `_: Add deprecation message to ButlerURI class [daf_butler, pipe_base] - `DM-33214 `_: Add support for REASON and PROGRAM header in LSST files [obs_lsst] - `DM-33220 `_: lsst.verify tasks assume metadata is PropertySet [verify] - `DM-33221 `_: Create DiffMatchedTractCatalogTask to aggregate match statistics for metrics [pipe_tasks] - `DM-33225 `_: Run black/isort on pex_config and code coverage on PRs [pex_config] - `DM-33232 `_: Add corrections files for Auxtel One Degree Survey images [obs_lsst] - `DM-33242 `_: Add explicit PropertySet to TaskMetadata pipeline test [pipelines_check] - `DM-33254 `_: Remove Gen 2 support from ap_pipe [ap_pipe] - `DM-33256 `_: Remove Gen 2 support from verify [ap_association, ip_diffim, pipe_tasks, verify] - `DM-33260 `_: Enable testing of pipe_base in github action [pipe_base] - `DM-33267 `_: Enable black/isort on ctrl_bps [ctrl_bps] - `DM-33271 `_: Make daf_butler work with mypy 0.931 [daf_butler] - `DM-33278 `_: Improve handling of storage class conversion [daf_butler] - `DM-33279 `_: Add star matching task for input to fgcmcal, unique psf star selection, etc. [pipe_tasks] - `DM-33280 `_: Add Packages method to retrieve dictionary [base] - `DM-33293 `_: Add yaml linter to github action for corrections file [obs_lsst] - `DM-33297 `_: Add correction of systematic photodiode error [cp_pipe, obs_decam, ip_isr] - `DM-33300 `_: Drop connections that aren't needed in cp_verify [cp_verify] - `DM-33303 `_: Allow pipeline execution to support storage class conversion [daf_butler, ctrl_mpexec, pipe_base] - `DM-33313 `_: Implement APDB API changes needed to support PPDB replication [dax_apdb] - `DM-33314 `_: Research Cassandra APDB implementation options to support PPDB replication. [dax_apdb] - `DM-33325 `_: Update measurement uncertainties in meas_extensions_trailedSources [meas_extensions_trailedSources] - `DM-33326 `_: Fix round-tripping of spectractor spectra [daf_butler] - `DM-33327 `_: Improvements to processCcdWithFakes [pipe_tasks] - `DM-33331 `_: Monitor memory usage at select steps of BPS submission [utils, ctrl_bps] - `DM-33339 `_: pipetask is always doing fail-fast in single-process mode [ctrl_mpexec] - `DM-33345 `_: Investigate extremely slow execution butler creation [pipe_base] - `DM-33347 `_: moto3 breaks daf_butler tests [daf_butler] - `DM-33370 `_: Increase pipeline task default timeout value [ctrl_mpexec] - `DM-33377 `_: Modernize metadata set usage in meas_extensions_psfex [meas_extensions_psfex] - `DM-33394 `_: Reorganize ResourcePath unit tests [daf_butler] - `DM-33398 `_: ap_association test_skyBotEphemerisQuery.py uses mock instead of unittest.mock [ap_association] - `DM-33403 `_: Move Packages from base to utils [ctrl_mpexec, daf_butler, ctrl_bps, base, utils, obs_base, pipe_base] - `DM-33414 `_: Allow FileTemplate to take a UUID in the template [daf_butler] - `DM-33429 `_: Add ability to do both serial and parallel overscan correction [obs_subaru, obs_decam, ip_isr] - `DM-33440 `_: need to fix ap_verify for changes in DM-32988 [ap_verify] - `DM-33443 `_: afw.coord.Observatory writes longitudes out as degrees West instead of East. [afw] - `DM-33446 `_: Use TraceRadius in GAaP plugin [meas_extensions_gaap] - `DM-33470 `_: Remove daf_persistence from afw [afw] - `DM-33478 `_: pipe_tasks test is very slow on Apple Macbook Pro [pipe_tasks, daf_base] - `DM-33481 `_: Middleware: jobReport from LSST executable [ctrl_mpexec] - `DM-33487 `_: jointcal test mocks have a typo "autospect=True" [jointcal] - `DM-33488 `_: Add deletion support to LimitedButler and QuantumBackedButler [daf_butler, ctrl_mpexec] - `DM-33489 `_: Add unit tests for QuantumBackedButler [daf_butler] - `DM-33490 `_: Implement record import and export methods on concrete Datastores [daf_butler] - `DM-33492 `_: Add option to add UUIDs and RUNs to predicted DatasetRefs in QuantumGraphs [daf_butler, pipe_base] - `DM-33493 `_: Add option to save Datastore records to QGs [daf_butler, ctrl_mpexec, pipe_base] - `DM-33496 `_: Fix unit tests for linux-aarch64 [astshim, geom, jointcal, afw, pipelines_check, meas_base] - `DM-33512 `_: BF kernel generation fails with IndexError [cp_pipe] - `DM-33518 `_: Fix sphinx build in base following Packages move [base] - `DM-33519 `_: Update dev guide, daf_base, and (some of) afw for RFC-817 [afw, daf_base] - `DM-33521 `_: Split plugins out of ctrl_bps [lsst_distrib, ctrl_bps] - `DM-33523 `_: Remove gen2 support from obs_cfht [obs_cfht] - `DM-33525 `_: Write middleware release notes for v23.0.1 [pipe_base, ctrl_mpexec, ctrl_bps] - `DM-33530 `_: Spline fitter fails when insufficient length array input [ip_isr] - `DM-33547 `_: Remove gen2 support from fgcmcal [fgcmcal, obs_subaru] - `DM-33569 `_: Pipeline graph build fails when task metadata is new input [ctrl_mpexec, pipe_base] - `DM-33574 `_: Set storageClass to TaskMetadata in verifyStats [cp_verify] - `DM-33584 `_: Sort remove-runs output and filter out non-removed collections [daf_butler] - `DM-33591 `_: Add convenience method to Exposure to give the convex polygon associated with the bbox [afw] - `DM-33596 `_: "NoneType object is not subscriptable" in PsfWcsSelectImagesTask [pipe_tasks] - `DM-33600 `_: Inconsistencies in queryDimensionRecords [daf_butler, obs_base, pipe_base] - `DM-33613 `_: Cleanup obvious defects in joincal [jointcal] - `DM-33619 `_: Add unlink option to butler remove-runs [daf_butler] - `DM-33622 `_: Add support for numexpr to disable implicit threading [ctrl_mpexec, utils] - `DM-33633 `_: Verification pipetask at the summit (via Nublado terminal) fails with "-j 8" option but works without it [ctrl_mpexec] - `DM-33634 `_: Add pipetask purge and cleanup subcommands [ctrl_mpexec] - `DM-33638 `_: Check cache when checking for dataset existence in datastore [daf_butler, ctrl_mpexec] - `DM-33639 `_: Fix refcat ingest docs and convert message to ingest into a RUN collection [meas_algorithms] - `DM-33643 `_: Add Registry method to find collection parents [daf_butler] - `DM-33645 `_: Add new post-processing psf estimation task [pipe_tasks] - `DM-33684 `_: Race condition in table creation [daf_butler] - `DM-33690 `_: deblend quantum taking >> 16 GB and nearly 17 hours to complete [meas_extensions_scarlet] - `DM-33692 `_: HSC's ApTemplate pipeline is missing skyCorr step [ap_pipe] - `DM-33694 `_: Add matchObjectToTruth to sdm_schemas [sdm_schemas] - `DM-33700 `_: Preserve in-memory objects sent to metric measurement run method for offline analysis and development [faro] - `DM-33704 `_: Restore fgcm HTM matching for repeatability [fgcmcal, fgcm] - `DM-33705 `_: Fix doxygen warnings about obsolete tags [base] - `DM-33710 `_: Output a single storage container from ScarletDeblendTask [pipe_tasks, daf_butler, meas_base, meas_extensions_scarlet] - `DM-33727 `_: Allow sconsUtils to pass tests when the user has a pytest.ini [sconsUtils] - `DM-33740 `_: Implement RFC-799 and fix Spectractor packaging [lsst_distrib] - `DM-33745 `_: Refactor Task to make ImageDifference template [pipe_tasks, ip_diffim, ap_pipe, ap_verify] - `DM-33762 `_: Photo diode ingest can break with escapable characters in path [obs_lsst] - `DM-33766 `_: Photodiode test depends on other tests having run [obs_lsst] - `DM-33769 `_: Improve timeout, retry and connexion persistence of webDAV client [daf_butler] - `DM-33772 `_: Query datasets unexpectedly warns about storage class [daf_butler] - `DM-33783 `_: Remove internal parallelization from DefineVisitsTask and gen2to3 [obs_base, ap_verify] - `DM-33784 `_: Remove most of the ButlerURI tests from daf_butler [daf_butler] - `DM-33786 `_: assembleCoadd reports success even when some stripes are unsuccessful. [pipe_tasks] - `DM-33799 `_: Remove unneeded try/except in Registry sqlite code [daf_butler] - `DM-33805 `_: Modify sky object plots/metrics to exclude those in NO_DATA regions [faro] - `DM-33809 `_: Change the default logger level to INFO solely for lsst loggers [daf_butler] - `DM-33814 `_: Fix type annotations in sconsUtils version file [sconsUtils] - `DM-33817 `_: Enable mypy checking in ctrl_mpexec [ctrl_mpexec, pipe_base] - `DM-33820 `_: Emit periodic log messages during Faro data loading [faro] - `DM-33821 `_: Develop Chronograph metrics for known SSO attribution [ap_association] - `DM-33822 `_: Fix DcrModel WCS bug [ip_diffim, pipe_tasks] - `DM-33826 `_: ci_hsc_gen2 fails due to exception type change [obs_base] - `DM-33834 `_: Run weekly 8 on RC2 using scarlet templates [pipe_tasks] - `DM-33837 `_: MemoryMetricTask does not support new-style metadata [verify] - `DM-33843 `_: ip_diffim DipoleFit does not use lsst-prefixed logger [ip_diffim] - `DM-33848 `_: Make visit definition more permissive [obs_base] - `DM-33853 `_: Consider adding logging when reading in many datasets [pipe_base] - `DM-33854 `_: Need periodic log messages for forcedPhotCoadd during aperture corrections [meas_base] - `DM-33857 `_: Make Piff the default PsfDeterminer in DRP.yaml [pipe_tasks] - `DM-33870 `_: Allow Butler constructor to use repo aliases [daf_butler] - `DM-33887 `_: HTCondor plugin not supporting some htcondor submit file commands [ctrl_bps] - `DM-33888 `_: Add config parameter to grow streak footprints only during [pipe_tasks] - `DM-33890 `_: certifyCalibrations fails due to exception type change. [daf_butler] - `DM-33891 `_: Butler ingest-raws config parameters not accessible from command-line [obs_base] - `DM-33892 `_: Create matched difference faro metrics for DC2 [verify_metrics, pipe_tasks, faro] - `DM-33900 `_: cp_pipe: calculate the gain using a pair of flats [cp_pipe] - `DM-33902 `_: Long chained collections print badly via CLI [daf_butler, pipelines_check] - `DM-33904 `_: Registry.getCollectionParentChains isn't reliable [daf_butler] - `DM-33907 `_: Change physical_filter+detector+exposure WARNING to DEBUG [daf_butler] - `DM-33909 `_: Publish DP0.2 test slice schema [sdm_schemas] - `DM-33910 `_: Write PipelineTask to detect Cosmic Rays on difference images [pipe_tasks] - `DM-33919 `_: Add heartbeat logging support to utils [utils] - `DM-33921 `_: Replace in-place periodic loggers with PeriodicLogging class [meas_base, meas_extensions_scarlet] - `DM-33934 `_: Allow lsst.utils.packages to return all setup EUPS packages [utils] - `DM-33942 `_: Northern Spring 2022 Butler schema migration [daf_butler, obs_lsst, obs_cfht, obs_decam, pipe_base, obs_base, obs_subaru] - `DM-33946 `_: Configure basic healpix support in butler data repositories [daf_butler, ctrl_mpexec, pipe_base] - `DM-33948 `_: Add Per-object galactic extinction to Object Table [sdm_schemas, pipe_tasks] - `DM-33949 `_: Add objectTable_tract matched diff plots to analysis_drp [meas_astrom, pipe_tasks] - `DM-33950 `_: Periodic logger must issue messages from caller code [utils] - `DM-33959 `_: Calibrate Source Tables with Global Calibrations (jointcal/FGCM) [pipe_tasks] - `DM-33960 `_: Add astrometry residuals with refcat plots to analysis_drp [obs_lsst] - `DM-33963 `_: Add PipelineTask to aggregate memory/time usage from task metadata [pex_config, pipe_base, meas_algorithms] - `DM-33966 `_: Add PSF size residual plots in analysis_drp [pipe_tasks] - `DM-33977 `_: Nesting ConfigurableActionStructField config produces error [pipe_tasks] - `DM-33978 `_: Fix references to charImage.py in configs and make characterizeImage.py the default [obs_subaru] - `DM-33980 `_: Create MatchedCatalogTableMeasurement base class [faro] - `DM-33982 `_: Apply new finalized psf models to coadds/forced measurements [meas_base, pipe_tasks] - `DM-33992 `_: Create plotting pipelines in drp_pipe to run during regular DC2/ RC2 reprocessing [pipe_tasks] - `DM-33993 `_: Apply Galactic Extinction in ColorColorFitPlotTask [obs_decam, obs_subaru] - `DM-33999 `_: Investigate unicode collection names in butler [daf_butler] - `DM-34003 `_: Fix Warning in DipoleFitTask [ip_diffim] - `DM-34007 `_: daf_butler will print raw bytes with query-dimension-records [daf_butler] - `DM-34013 `_: Add minimumUnmaskedFraction config to PiffPsfDeterminerConfig [meas_extensions_piff] - `DM-34019 `_: EvaluateLocalPhotoCalib runs before photoCal during calibrate [pipe_tasks] - `DM-34037 `_: Reduce log level of trailed source measurement [meas_extensions_trailedSources] - `DM-34052 `_: Rename FractionalResidualColumns to FractionalDifferenceColumns [pipe_tasks] - `DM-34076 `_: ctrl_mpexec unit test fails in test_mpexec_timeout [ctrl_mpexec] - `DM-34101 `_: Pipelines should not activate non-essential features [cp_pipe] - `DM-34105 `_: Add instrument base class to pipe_base [ctrl_mpexec, daf_butler, obs_lsst, pipe_tasks, jointcal, ctrl_bps, utils, fgcmcal, obs_base, pipe_base] - `DM-34120 `_: InconsistentDataIdError raised for data that doesn't exist [daf_butler] - `DM-34136 `_: Add Visit and ccdVisit to sdm_schemas for DP0.2 ingest testing [sdm_schemas] - `DM-34155 `_: Miscellaneous pipeline cleanups from DM-33027 [ctrl_mpexec, pipe_base] - `DM-34158 `_: Allow parametric models in scarlet lite [scarlet] - `DM-34168 `_: Use better source selection in rho statistics [faro] - `DM-34172 `_: Butler cannot be initialized with directory-like ResourcePath [daf_butler] - `DM-34174 `_: Make fully gen3 replacement for PropagateVisitFlagsTask with dataframe inputs [pipe_tasks] - `DM-34175 `_: Simplify ingest with extended exposure table and related dimensions [obs_base, astro_metadata_translator] - `DM-34186 `_: Update ObservationInfo for RFC-836 schema change [astro_metadata_translator] - `DM-34196 `_: DM-31895 broke the piepelines.lsst.io build. [cp_pipe] - `DM-34200 `_: Update getTemplate connections [ap_pipe, ap_verify] - `DM-34202 `_: exception when creating qgraph where some datasets do not exist [daf_butler] - `DM-34203 `_: TRACE loggers are now active by default when invoked by pipetask [daf_butler] - `DM-34208 `_: Add support for creating TRACE loggers [ip_diffim, meas_extensions_gaap, utils] - `DM-34215 `_: Support dropping into debugger on exception [ctrl_mpexec] - `DM-34217 `_: Move ScaleVarianceTask [pipe_tasks, meas_algorithms] - `DM-34237 `_: Remove ap_verify dataset Gen 2 config files [ap_verify] - `DM-34247 `_: queryDataIds fails when a dataset existence constraint involves a dataset type with no dimensions [daf_butler] - `DM-34254 `_: ap_verify metrics report 0 completeness after switch to Piff [pipe_tasks, meas_extensions_piff, ap_pipe] - `DM-34261 `_: respond to click.Path api change [daf_butler, ctrl_mpexec] - `DM-34265 `_: bps should raise error if Quantum does not have a value required by cluster definition. [ctrl_bps] - `DM-34280 `_: Remove unused ctrl packages from lsst_distrib [lsst_distrib] - `DM-34290 `_: Add MJD times to CcdVisit/Visit tables [pipe_tasks] - `DM-34326 `_: Make Configurable actions add their targets to import list [pex_config] - `DM-34328 `_: Make queryCollections guarantee child order when flattenChains=True [daf_butler] - `DM-34331 `_: Turn on black for astro_metadata_translator [astro_metadata_translator] - `DM-34363 `_: Add trailFlux measurement to ap_association [ap_association, sdm_schemas] - `DM-34364 `_: Use PSF-matched template for image decorrelation [pipe_tasks] - `DM-34371 `_: finalizeCharacterization, fgcmcal, jointcal, others record visit key as 32-bit int [fgcmcal, pipe_tasks, jointcal, faro] - `DM-34375 `_: w_2022_15 breaks (some) pipelines [daf_butler] - `DM-34377 `_: Add support for postgresql testing for datastore [daf_butler] - `DM-34386 `_: Confusing doImport behavior with quoted strings [utils] - `DM-34390 `_: Move integration tests from pipe_tasks nopytest_test_coadds to ci_hsc_gen3 [pipe_tasks] - `DM-34391 `_: Change coadd defaults to use "finalized" psf models. [pipe_tasks] - `DM-34407 `_: cp_pipe flat construction fails due to missing vignette polygon [ip_isr] - `DM-34439 `_: Move pipe_tasks test_processCcd.py checks to pipelines_check [pipe_tasks, pipelines_check] - `DM-34444 `_: Remove BestSeeingWcsSelectImagesTask and associated tests. [pipe_tasks, ap_pipe] - `DM-34445 `_: Update ap_verify tutorial [ap_verify] - `DM-34452 `_: Deprecate calibrate.doInsertFakes and remove gen2-only tests. [pipe_tasks] - `DM-34454 `_: Update EUPS Eigen to 3.4.0 [eigen] - `DM-34460 `_: Incompletely defined storage classes cause butler query failure [daf_butler] - `DM-34466 `_: Write afterburner to re-calibrate src tables [pipe_tasks] - `DM-34480 `_: Switch APDB schema definition to felis [ap_association, sdm_schemas, ap_pipe, dax_apdb] - `DM-34481 `_: Fix cp_pipe fringe PipelineDataCycleError [ip_isr] - `DM-34483 `_: Butler Registry to ObsCore exporter [daf_butler] - `DM-34484 `_: Remove all test dependencies on obs_test, and remove obs_test from lsst_apps [lsst_apps, lsst_obs, pipe_tasks, meas_algorithms, meas_astrom] - `DM-34489 `_: Add faro flux stat task into RC2/DC2 pipelines [faro] - `DM-34497 `_: Reduce memory usage of "butler register-skymap" [skymap] - `DM-34502 `_: Turn off all extra measurement plugins in all AuxTel processing [obs_lsst] - `DM-34507 `_: Fix bug in ISR when doAttachTransmissionCurve and doUseOpticsTransmission are both False [ip_isr] - `DM-34516 `_: Make a better DECam skymap in shared-repo-land [obs_decam, obs_subaru] - `DM-34531 `_: Cleanup piff PSF determiner model size config options [pex_config] - `DM-34539 `_: Add detection significance to DIASources and apdb [ap_association, meas_base] - `DM-34559 `_: Make gen2 deprecation message more imminent [daf_persistence] - `DM-34566 `_: ip_diffim tests produce many warnings [ip_diffim] - `DM-34583 `_: Fix faro sky object metric lookup name [faro] - `DM-34584 `_: Piff PSF images should respect samplingSize [meas_extensions_piff] - `DM-34590 `_: --longlog requires an unnecessary argument [pipe_base] - `DM-34603 `_: Add trailed-source injection to insertFakes [pipe_tasks] - `DM-34610 `_: Update rubin-env to v4.0.0 and include rubin-extras [lsst, daf_persistence] - `DM-34616 `_: Avoid NULL/None for implied dimensions in test data IDs [daf_butler, pipe_tasks] - `DM-34621 `_: Use cache when possible in Psf compute*BBox implementations [afw, cpputils] - `DM-34630 `_: Add quantities useful for QA to ccdVisitTable [sdm_schemas, pipe_tasks] - `DM-34635 `_: Remove some detector dataId key columns from Source Table [sdm_schemas, pipe_tasks] - `DM-34644 `_: The decorrelated variance plane is scaled too low on DC2 data [ip_diffim, pipe_tasks] - `DM-34666 `_: Set macOS deployment target to 11 on arm Mac [sconsUtils] - `DM-34687 `_: Write task to create high-resolution HIPS-compatible coadd images [pipe_tasks] - `DM-34693 `_: Investigate lack of solar system matches in ap_verify runs [ap_association, obs_decam, obs_subaru] - `DM-34697 `_: FGCM breaks when less than 2 visits have seeing values [fgcmcal] - `DM-34698 `_: Default piff kernelSize to 25 [meas_extensions_piff, ap_pipe, pipelines_check, meas_algorithms] - `DM-34699 `_: Patch the ap_pipe config reset hack [ap_pipe] - `DM-34700 `_: Change Config File for cpPTC.yaml [cp_pipe] - `DM-34711 `_: Reprocess HSC Cosmos dataset with Fakes [ap_pipe] - `DM-34721 `_: Add topological-operation-tree Region class and intersection+union operators [sphgeom] - `DM-34752 `_: Move non-generic characterize/calibrate configs out of obs_lsst/config [obs_lsst] - `DM-34766 `_: Propagate debiased moments to sourceTable_visit dataset [sdm_schemas, pipe_tasks] - `DM-34768 `_: Deprecate characterizeImage refcat hooks [obs_lsst, pipe_tasks, ap_pipe, obs_cfht, obs_decam] - `DM-34770 `_: Remove deprecated uses of psf computeShape() and friends [afw, ip_diffim, meas_algorithms, meas_deblender, meas_base] - `DM-34777 `_: Scarlet should take in a position to compute PSF image [meas_extensions_scarlet] - `DM-34778 `_: Expose piff interpolant in meas_extensions_piff config [meas_extensions_piff, pipelines_check] - `DM-34780 `_: Update sdm_schemas for DP0.2 production run [sdm_schemas] - `DM-34786 `_: Run ci_hits with the new image differencing [ip_diffim] - `DM-34792 `_: Deprecate version 0 refcat code [meas_astrom, pipe_tasks, meas_algorithms] - `DM-34798 `_: fgcmcal chebyshev test tolerance is too tight on some build systems [fgcmcal] - `DM-34801 `_: Replace Diff_warpedExp with Diff_templateExp in diaPipe [ap_association, ap_pipe, ap_verify] - `DM-34809 `_: Add isolatedStarAssociation/finalizeCharacterization to DECam step2 [pipe_tasks] - `DM-34811 `_: Quantum graph ordering for component datasets [ctrl_mpexec] - `DM-34812 `_: MWCommand argument capture does not split values separated by an equal sign [daf_butler] - `DM-34814 `_: Express ObsCore data model in Felis for DP0.2 deployment [sdm_schemas] - `DM-34826 `_: Identify unnecessary configs and Tasks and test removal from ap_pipe [ap_pipe] - `DM-34830 `_: Increase template border size [ip_diffim] - `DM-34834 `_: IsolatedStarAssociationTask crashes if secondary band in tract has no overlap with primary band [pipe_tasks] - `DM-34855 `_: Add vectorized way of getting URIs for many datasets [daf_butler] - `DM-34856 `_: Remove daf_persistence from obs_subaru [jointcal, obs_subaru] - `DM-34862 `_: Migrate testdata_decam to gen3 [obs_decam] - `DM-34863 `_: Convert tests in obs_decam from gen2 to gen3 and remove gen2. [obs_decam] - `DM-34865 `_: Script for looking at ap_verify metrics [verify] - `DM-34876 `_: Add cloud to ctrl_bps GenericWorkflowJob [ctrl_bps] - `DM-34884 `_: Ignore schema checksums for daf_butler manager classes. [daf_butler] - `DM-34887 `_: add support to butler transfer-datasets to also transfer the dimension records it needs [daf_butler, pipe_base] - `DM-34908 `_: Consolidate task defaults and pipeline overrides [pipe_tasks] - `DM-34912 `_: Include pixel clipping and masks in "getGainFromFlatPair" as in "measureMeanVarCov" of "cpPtcSolve" [cp_pipe] - `DM-34914 `_: Defer import of healpy in sphgeom _healpixPixelization.py [sphgeom] - `DM-34919 `_: Remove gen2 support from obs_lsst [daf_butler, obs_lsst, obs_base] - `DM-34922 `_: Report ptc turnoff in ptcDataset from cpPtcSolve [cp_pipe, ip_isr] - `DM-34924 `_: Execution butler can't handle new StorageClass conversion [pipe_base] - `DM-34943 `_: FinalizeCharacterizationTask fails to set the exposure psf prior to computing aperture corrections [pipe_tasks] - `DM-34954 `_: Documenteer: Patch 0.5 series to unpin numpydoc 0.5 [pipe_base] - `DM-34955 `_: Deprecate creation of new data repositories with autoincrement integer dataset IDs [daf_butler] - `DM-34994 `_: fgcm dies in w_2022_22 verify_drp_metrics run [fgcm] - `DM-35006 `_: Fix dimension ordering in decorrelation afterburner [ip_diffim] - `DM-35008 `_: trailedSources tests very slow on macOS ARM [meas_base] - `DM-35035 `_: Remove gen2 support from obs_base [daf_butler, obs_lsst, pipe_tasks, obs_cfht, obs_decam, obs_base, obs_subaru] - `DM-35047 `_: Put middleware packages on pypi [ctrl_mpexec, daf_butler, pex_config, utils, sphgeom, astro_metadata_translator, pipe_base] - `DM-35060 `_: Only do minimal necessary processing in characterizeImage by default [pipe_tasks, pex_config, ap_pipe] - `DM-35066 `_: Print number of clusters in clustered graph [ctrl_bps] - `DM-35068 `_: New ip_diffim algorithm breaks on macOS [ip_diffim] - `DM-35071 `_: ap_verify can't import from old ap_verify dataset [ap_verify] - `DM-35083 `_: Prepare for upcoming version of spherematch which will change API functionality [pipe_tasks] - `DM-35090 `_: bps get DimensionUniverse from given butler [ctrl_bps] - `DM-35095 `_: Update cp_pipe documentation to remove instrument specific pipelines from example commands [cp_pipe] - `DM-35105 `_: Track down and fix bug leading to even-sized PSFs from DM-32411 [meas_algorithms] - `DM-35123 `_: TAP_SCHEMA updates for DP0.2 production data [sdm_schemas] - `DM-35125 `_: Add UCDs for main coordinate columns in DP0.2 tables [sdm_schemas] - `DM-35128 `_: Valgrind error in lsst::afw::math::LeastSquares::getDiagnostic [afw] - `DM-35135 `_: cpCombine partial reads interferes with amplifier-level scaling [cp_pipe] - `DM-35144 `_: Add ping subcommand to bps [ctrl_bps] - `DM-35153 `_: Fix collection order in SimplePipelineExecutor [ctrl_mpexec] - `DM-35160 `_: Fix bug in meas_extensions_scarlet.io [meas_extensions_scarlet] - `DM-35162 `_: Set the default doApplyFinalizedPsf value to False for makeWarp within ApTemplate.yaml [ap_pipe] - `DM-35169 `_: Add ccdVisitId to CcdVisit schema [sdm_schemas] - `DM-35173 `_: Add descriptions to CcdVisit and Visit Tables in sdm_schemas [sdm_schemas] - `DM-35174 `_: Add descriptions to diaObject table in sdm_schemas [sdm_schemas] - `DM-35175 `_: Debug convolveScience option of new image differencing [ip_diffim] - `DM-35186 `_: Add FOCUSZ into ExposureInfo [afw, obs_base, obs_lsst, astro_metadata_translator] - `DM-35191 `_: Add test matrix for build workflow [ctrl_mpexec, daf_butler, pex_config, utils, pipe_base] - `DM-35199 `_: Fix python package names [obs_base, ctrl_bps] - `DM-35220 `_: Use python dependencies from github [daf_butler, ctrl_mpexec, pipe_base] - `DM-35221 `_: Declare single-character columns in DP0.2 as variable-length in TAP output [sdm_schemas] - `DM-35252 `_: Add DECam config overrides into cpBias and cpFlat pipelines [cp_pipe] - `DM-35265 `_: Reduce usage of MeasurementError in SdssCentroid [meas_base] - `DM-35267 `_: Fix race condition when uploading documentation [astro_metadata_translator] - `DM-35272 `_: lsst-daf-butler requires psycopg2 to be useful, and does not list it as a dependency [daf_butler] - `DM-35278 `_: Increase version of ptcDataset and make it backwards compatible [ip_isr] - `DM-35281 `_: Investigate failed jobs in w_2022_24 [afw] - `DM-35292 `_: Remove MeasurementError in trailedSources [meas_extensions_trailedSources] - `DM-35310 `_: Add automatic version with pip install for ctrl_bps [ctrl_bps] - `DM-35312 `_: Introduce typing support in pex_config [pex_config, pipe_tasks] - `DM-35313 `_: Submissions fail when the config defines site-specific job attributes [ctrl_bps] - `DM-35316 `_: Add 'detector' information (and any other missing info) to PTC dataset metadata [cp_pipe, ip_isr] - `DM-35322 `_: ForcedPhotCcdFromDataFrameTask needs local calib plugins [sdm_schemas, meas_base] - `DM-35331 `_: Add tests of sky source handling in transformDiaSourceCat [ap_association] - `DM-35333 `_: Minor fixes to schema browser [sdm_schemas] - `DM-35347 `_: Switch PyPi packages to pyproject.toml from setup.cfg [ctrl_mpexec, daf_butler, ctrl_bps, pex_config, utils, sphgeom, pipe_base] - `DM-35348 `_: Fix security warning in butler tests [daf_butler] - `DM-35349 `_: Fix brighter fatter kernel backwards compatibility [ip_isr] - `DM-35355 `_: Add some docstrings to PiffPsf [meas_extensions_piff] - `DM-35359 `_: Set doApplyFinalizedPsf to False for all AP makeWarp steps, for reals [ap_pipe] - `DM-35372 `_: Fix documentation for config variable in maskStreaksTask [pipe_tasks] - `DM-35386 `_: Fix serialization of ConfigurableActionStructField when struct is empty [pipe_tasks] - `DM-35391 `_: butler query-data-ids DIMENSIONS should be made not optional [daf_butler] - `DM-35457 `_: Fix handling of FITS error messages passed to C++ exceptions [afw] - `DM-35458 `_: OOM during output write causes file corruption [daf_butler] - `DM-35459 `_: pyvo soda obscore tutorial notebook [sdm_schemas] - `DM-35460 `_: Programatic header fixup for AuxTel targets starting spec: [obs_lsst] - `DM-35469 `_: Fix error message with storage class redefinition [daf_butler] - `DM-35494 `_: Allow execution butler creation to transfer datasets [ctrl_mpexec, pipe_base] - `DM-35518 `_: Fix ROT_PA=None for comCam data [obs_lsst] - `DM-35524 `_: Fix inconsistent TS8 filter definitions [obs_lsst] - `DM-35528 `_: Update TS8 info in obs_lsst for FITS header changes and CCD replacement in slot S00 RTM-004 [obs_lsst] - `DM-35531 `_: Remove remaining gen2 cruft from obs_lsst [obs_lsst] - `DM-35551 `_: Rework HSC pipelines in drp_pipe to enable full-survey FGCM [pipe_tasks, pipelines_check] - `DM-35564 `_: ap_verify docs say datasets should be installed at run-time [ap_verify] - `DM-35565 `_: Typing fix for pex config [pex_config] - `DM-35574 `_: Add storage class for MetricMeasurementBundles [daf_butler] - `DM-35587 `_: Update sphgeom to use hpgeom in place of healpy [sphgeom] - `DM-35588 `_: Update pipe_tasks to use hpgeom in place of healpy [pipe_tasks] - `DM-35589 `_: Update fgcm and skymap to use hpgeom in place of healpy [skymap, afw, fgcmcal, fgcm] - `DM-35594 `_: Fully masked amplifiers can trigger read failures for PTC [ip_isr] - `DM-35598 `_: Publish ctrl_bps packages on PyPI [ctrl_bps] - `DM-35619 `_: Make task to get astrometry residuals with the reference catalog for analysis_tools [obs_lsst] - `DM-35639 `_: Switch AP and DRP pipelines to use new image differencing [verify_metrics, pipe_tasks, ap_pipe, ip_diffim, ap_verify] - `DM-35652 `_: Fix failing mypy GHA [daf_butler] - `DM-35654 `_: Add FinalizedPsf connection to new image differencing [ip_diffim] - `DM-35655 `_: Remove gen2 jointcal code and tests [jointcal] - `DM-35656 `_: Run analysis_tools' analysis pipeline in ci_imsim [obs_lsst, obs_subaru] - `DM-35670 `_: Remove gen2 support from pipe_tasks [obs_subaru, pipe_tasks, obs_base, obs_cfht] - `DM-35671 `_: Remove gen2 support from meas_algorithms [meas_algorithms] - `DM-35674 `_: Remove gen2 support from ip_diffim [ip_diffim, pipe_tasks] - `DM-35675 `_: Remove gen2 support from pipe_base [coadd_utils, verify, pipe_base] - `DM-35687 `_: Update weights in least squares fits in PTC task [cp_pipe] - `DM-35690 `_: Build GHA fail for python 3.8/3.9 on installing dependencies with pip [ctrl_mpexec, daf_butler, ctrl_bps, pex_config, utils, sphgeom, astro_metadata_translator, pipe_base] - `DM-35697 `_: Move profile context manager out of pipe_base.cmdLineTask [utils, jointcal, pipe_base] - `DM-35724 `_: Remove gen2 from coadd_utils [coadd_utils] - `DM-35725 `_: Remove Gen2 usage from meas_base [meas_base, pipe_tasks, obs_subaru] - `DM-35731 `_: Add __all__ to deferredCharge.py [cp_pipe] - `DM-35741 `_: Create DeferredDatasetHandle variant without a butler backing [daf_butler, pipe_base] - `DM-35752 `_: Error running pipetask with DatasetRef being None [pipe_base] - `DM-35772 `_: Remove gen2 support from ip_isr [ip_isr] - `DM-35773 `_: Remove gen2 support from cp_pipe [cp_pipe] - `DM-35775 `_: Fix remote file raw ingest [obs_base, astro_metadata_translator] - `DM-35790 `_: "Gain from flat pairs" returns a relative gain bias (w.r.t the PTC gain) of about 5% at 5k ADU [cp_pipe] - `DM-35792 `_: sconsUtils cannot install doc directories that do not contain a config file [sconsUtils] - `DM-35797 `_: Remove CmdLineTask from cp_verify [cp_verify] - `DM-35807 `_: expIdMasks in PTC dataset is an array of floats and not booleans when ptcFitType=FULLCOVARIANCE [cp_pipe] - `DM-35814 `_: Fix doc build for meas_base [meas_base] - `DM-35815 `_: Add method to find storage class to factory [daf_butler, pipe_base] - `DM-35817 `_: Turn off compatibility mode for image differencing [ip_diffim] - `DM-35821 `_: Fix CTI run errors [ip_isr] - `DM-35835 `_: Remove CmdLineTask from cp_pipe [cp_pipe] - `DM-35836 `_: Deprecate config.cycleNumber which is incorrectly used. [fgcmcal, obs_subaru] - `DM-35841 `_: Fix pipe_tasks docs for Winter2013ImageDifferenceTask removal [pipe_tasks] - `DM-35877 `_: Clean up some vestigial gen2 code [ap_association, cp_pipe, obs_lsst, pipe_tasks, jointcal, obs_cfht, obs_decam, ip_isr, meas_deblender, fgcmcal, meas_algorithms, obs_subaru] - `DM-35886 `_: Add color_riz to HiPS list [daf_butler] - `DM-35894 `_: sphgeom fails build and test GHA [sphgeom] - `DM-35895 `_: MultibandExposure.fromButler is gen2 only [afw] - `DM-35896 `_: Remove reference to daf_persistence in docs [display_firefly] - `DM-35897 `_: Remove unused gen2 methods from jointcal [jointcal] - `DM-35903 `_: Remove unused display code from meas_modelfit [meas_modelfit] - `DM-35904 `_: Remove gen2 reference from meas_astrom [meas_astrom]