.. _metrics-v13-0:
##############################################################
Characterization Metric Report: Science Pipelines Version 13.0
##############################################################
Measured using `validation_data_hsc`_, which consists of 8 HSC engineering images: 4 *r*-band, 2 *i*'-band, and 2 *y*-band.
Measurements were made on individual, separately-processed, single-frame images: Jointcal and/or meas_mosaic were not run.
For comparison, we provide the SRD required “minimum†value of each metric as defined in the Science Requirements Document (`LPM-17`_), and, where available, the target for this release as defined in the Data Management Development Milestone Roadmap (`LDM-240`_).
All values were computed using the :file:`examples/runHscTest.sh` script in the `validate_drp`_ package.
Photometric Performance
=======================
*Submitted by Michael Wood-Vasey*
procCalRep corresponds to requirement OSS-REQ-0275 (defined in `LSE-30`_).
All other photometric performance metrics follow LSS-REQ-0093 (`LSE-29`_) and `LPM-17`_ table 14.
+----------------+------+-------------------+-------------------+--------------+--------------------+
| Metric | Unit | SRD Requirement | Release 13 Target | Value | Comments |
+================+======+===================+===================+==============+====================+
| procCalRep | mmag | :math:`\leq 13` | 10.0 | --- | Need simulations |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*g* band) | mmag | :math:`\leq 8` | 12.0 | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*r* band) | mmag | :math:`\leq 8` | 12.0 | 14.3 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*i* band) | mmag | :math:`\leq 8` | 12.0 | 12.0 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*g* band) | % | :math:`\leq 20` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*r* band) | % | :math:`\leq 20` | --- | 30.6 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*i* band) | % | :math:`\leq 20` | --- | 18.2 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*g* band) | mmag | :math:`\leq 15` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*r* band) | mmag | :math:`\leq 15` | --- | 19.6 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*i* band) | mmag | :math:`\leq 15` | --- | 18.2 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*u* band) | mmag | :math:`\leq 12` | 13.0 | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*z* band) | mmag | :math:`\leq 12` | 13.0 | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA1 (*y* band) | mmag | :math:`\leq 12` | 13.0 | 24.3 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*u* band) | % | :math:`\leq 20` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*z* band) | % | :math:`\leq 20` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PF1 (*y* band) | % | :math:`\leq 20` | --- | 36.9 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*u* band) | mmag | :math:`\leq 22.5` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*z* band) | mmag | :math:`\leq 22.5` | --- | --- | No data |
+----------------+------+-------------------+-------------------+--------------+--------------------+
| PA2 (*y* band) | mmag | :math:`\leq 22.5` | --- | 33.6 | |
+----------------+------+-------------------+-------------------+--------------+--------------------+
Astrometric Performance
=======================
*Submitted by Michael Wood-Vasey*
The following metrics are defined following LSR-REQ-0094 (`LSE-29`_) and `LPM-17`_ table 18.
+----------------+------+-----------------+-------------------+--------------+
| Metric | Unit | SRD Requirement | Release 13 Target | Value |
+================+======+=================+===================+==============+
| AM1 (*r*-band) | mas | :math:`\leq 20` | 50.0 | 6.5 |
+----------------+------+-----------------+-------------------+--------------+
| AM1 (*i*-band) | mas | :math:`\leq 20` | 50.0 | 10.5 |
+----------------+------+-----------------+-------------------+--------------+
| AF1 (*r*-band) | % | :math:`\leq 20` | --- | 0.27 |
+----------------+------+-----------------+-------------------+--------------+
| AF1 (*i*-band) | % | :math:`\leq 20` | --- | 0.69 |
+----------------+------+-----------------+-------------------+--------------+
| AD1 (*r*-band) | mas | :math:`\leq 40` | --- | 6.5 |
+----------------+------+-----------------+-------------------+--------------+
| AD1 (*i*-band) | mas | :math:`\leq 40` | --- | 7.5 |
+----------------+------+-----------------+-------------------+--------------+
| AM2 (*r*-band) | mas | :math:`\leq 20` | 50.0 | 6.5 |
+----------------+------+-----------------+-------------------+--------------+
| AM2 (*i*-band) | mas | :math:`\leq 20` | 50.0 | 10.5 |
+----------------+------+-----------------+-------------------+--------------+
| AF2 (*r*-band) | % | :math:`\leq 20` | --- | 0.47 |
+----------------+------+-----------------+-------------------+--------------+
| AF2 (*i*-band) | % | :math:`\leq 20` | --- | 0.67 |
+----------------+------+-----------------+-------------------+--------------+
| AD2 (*r*-band) | mas | :math:`\leq 40` | --- | 6.6 |
+----------------+------+-----------------+-------------------+--------------+
| AD2 (*i*-band) | mas | :math:`\leq 40` | --- | 7.3 |
+----------------+------+-----------------+-------------------+--------------+
Ellipticity Correlations
========================
*Submitted by Michael Wood-Vasey*
The following metrics are defined following LSR-REQ-0097 (`LSE-29`_) and `LPM-17`_ table 27.
+----------------+------+------------------------------+--------------------------+----------------------------+
| Metric | Unit | SRD Requirement | Release 13 Target | Value |
+================+======+==============================+==========================+============================+
| TE1 (*r*-band) | --- | :math:`\leq 3\times 10^{-5}` | :math:`1 \times 10^{-3}` | :math:`7.9 \times 10^{-7}` |
+----------------+------+------------------------------+--------------------------+----------------------------+
| TE1 (*i*-band) | --- | :math:`\leq 3\times 10^{-5}` | :math:`1 \times 10^{-3}` | :math:`1.9 \times 10^{-6}` |
+----------------+------+------------------------------+--------------------------+----------------------------+
| TE2 (*r*-band) | --- | :math:`\leq 3\times 10^{-7}` | :math:`1 \times 10^{-3}` | :math:`1.8 \times 10^{-6}` |
+----------------+------+------------------------------+--------------------------+----------------------------+
| TE2 (*i*-band) | --- | :math:`\leq 3\times 10^{-7}` | :math:`1 \times 10^{-3}` | :math:`3.0 \times 10^{-7}` |
+----------------+------+------------------------------+--------------------------+----------------------------+
Computational Performance
=========================
Computational performance metrics were not re-measured for this release.
We expect no significant changes relative to the :ref:`report on version 12 <metrics-v12-0>`.
.. _validation_data_hsc: https://github.com/lsst/validation_data_hsc
.. _validate_drp: https://github.com/lsst/validate_drp
.. _LDM-240: http://ls.st/ldm-240
.. _LPM-17: http://ls.st/lpm-17
.. _LSE-29: http://ls.st/lse-29
.. _LSE-30: http://ls.st/lse-30