The dataset framework

The ap_verify system is designed to allow integration testing of the Alert Production pipeline on a variety of LSST precursor data. The dataset framework provides a common format and delivery system for the test data.

Overview

Datasets are implemented as Git LFS repositories with a specific format. They provide the raw and calibration data files needed for an ap_verify run, and identify the observatory used to take the data. The observatory’s obs package can then be used by ap_verify to ingest the data into the LSST system and run the pipeline.

In depth

• Packaging data as a dataset
• Installing datasets

Supported datasets

These datasets are maintained by the ap_verify group. There may be other datasets formatted for use with ap_verify.

• ap_verify_ci_hits2015 (HiTS 2015 with 2014 templates)

• ap_verify_ci_cosmos_pdr2 (Cosmos DR2 ultradeep fields)

• ap_verify_ci_dc2 (two overlapping LSSTCam ImSim images)