The dataset framework

The ap_verify system is designed to allow integration testing of the Alert Production pipeline on a variety of LSST precursor data. The dataset framework provides a common format and delivery system for the test data.

Overview

Datasets are implemented as Git LFS repositories with a specific format. They provide the raw and calibration data files needed for an ap_verify run, and identify the observatory used to take the data. The observatory’s obs package can then be used by ap_verify to ingest the data into the LSST system and run the pipeline.

Supported datasets

These datasets are maintained by the ap_verify group. There may be other datasets formatted for use with ap_verify.