Forward Global Photometric Calibration of the Dark Energy Survey

, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and

Published 2017 December 28 © 2017. The American Astronomical Society. All rights reserved.
, , Citation D. L. Burke et al 2018 AJ 155 41 DOI 10.3847/1538-3881/aa9f22

Download Article PDF
DownloadArticle ePub

You need an eReader or compatible software to experience the benefits of the ePub3 file format.

1538-3881/155/1/41

Abstract

Many scientific goals for the Dark Energy Survey (DES) require the calibration of optical/NIR broadband b = grizY photometry that is stable in time and uniform over the celestial sky to one percent or better. It is also necessary to limit to similar accuracy systematic uncertainty in the calibrated broadband magnitudes due to uncertainty in the spectrum of the source. Here we present a "Forward Global Calibration Method (FGCM)" for photometric calibration of the DES, and we present results of its application to the first three years of the survey (Y3A1). The FGCM combines data taken with auxiliary instrumentation at the observatory with data from the broadband survey imaging itself and models of the instrument and atmosphere to estimate the spatial and time dependences of the passbands of individual DES survey exposures. "Standard" passbands that are typical of the passbands encountered during the survey are chosen. The passband of any individual observation is combined with an estimate of the source spectral shape to yield a magnitude ${m}_{b}^{\mathrm{std}}$ in the standard system. This "chromatic correction" to the standard system is necessary to achieve subpercent calibrations and in particular, to resolve ambiguity between the broadband brightness of a source and the shape of its SED. The FGCM achieves a reproducible and stable photometric calibration of standard magnitudes ${m}_{b}^{\mathrm{std}}$ of stellar sources over the multiyear Y3A1 data sample with residual random calibration errors of $\sigma =6\mbox{--}7\,\mathrm{mmag}$ per exposure. The accuracy of the calibration is uniform across the $5000\,{\deg }^{2}$ DES footprint to within $\sigma =7\,\mathrm{mmag}$. The systematic uncertainties of magnitudes in the standard system due to the spectra of sources are less than $5\,\mathrm{mmag}$ for main-sequence stars with $0.5\lt g-i\lt 3.0$.

Export citation and abstract BibTeX RIS

1. Introduction

We present a "Forward Global Calibration Method (FGCM)" for photometric calibration of ground-based wideband optical/near-IR surveys such as the Dark Energy Survey (DES; DES Collaboration 2016) and the survey that will be carried out with the Large Synoptic Survey Telescope (LSST; LSST Science Collaboration et al. 2009). We have applied this method to the first three years of the DES campaign (Diehl et al. 2016) and achieve subpercent reproducibility and uniformity in the multiband photometry of this data set. This method also provides sufficiently detailed information on the shape of the passband of each survey exposure to account, with similar precision, for the dependence of the photometry on the spectral energy distribution (SED) of the source. This "chromatic correction" is required for the proper scientific interpretation of the observed wideband optical flux.

The FGCM is a photometric model-based approach (Stubbs & Tonry 2006; Burke et al. 2010) to the calibration of multiband imaging surveys. The FGCM does not rely on previously established "standard stars" or other celestial targets. In situ instrumentation is used to periodically measure the optical properties of the survey instrumental system, and additional dedicated equipment is used to continuously monitor atmospheric conditions during periods of survey operations. These auxiliary data are combined with repeated observations of stars found in the survey data to "forward" compute the fraction of photons in the telescope beam at the top of the atmosphere (TOA) that are predicted to be detected in the sensors of the camera. The FGCM iteratively solves for parameters of the photometric model that best fit the number of photons observed in the camera. The goal is to convert a broadband photometric measurement taken in any part of the focal plane at any time of the multiyear survey to the value it would have in an invariant reference passband.

The FGCM determination of passband "throughput" differs from other techniques that have been used to calibrate wide-field surveys (e.g., Glazebrook et al. 1994; MacDonald et al. 2004; Padmanabhan et al. 2008; Regnault et al. 2009; Schlafly et al. 2012; Magnier et al. 2016). These earlier works incorporate "ubercal" matrix formulations to obtain relative photometric normalizations for each exposure. But they neither fully describe the passbands through which exposures are taken nor do they account for the shapes of the SEDs of the calibration sources. This leaves ambiguity in the scientific interpretation of the observed broadband flux that can dominate the measurement uncertainties. The FGCM selects "photometric" survey exposures that best sample the time-dependent atmospheric and instrumental passbands through which the survey is conducted. It combines these with auxiliary data and photometric models to provide continuous calibration of the survey observing conditions. This approach provides the shapes of the observing passbands as well as their relative normalizations, and so, resolves a fundamental ambiguity in previously available broadband photometric calibrations.

The instrumental response of modern CCD-based survey instruments can vary continuously, but significant variations occur only over periods of days to weeks. For our purposes, the Earth's atmosphere can be characterized by a small set of constituents that must be tracked continuously throughout each night (Stubbs et al. 2007). Computation of the transmission of light from the TOA to the Earth's surface over a wide variety of these conditions can be done with extremely good accuracy with modern, and readily available, computer programs (MODTRAN; Berk et al. 1999; libRadTran: Mayer & Kylling 2005).

The FGCM is a two-step process. First, parameters that define the instrumental and atmospheric conditions during survey operations are fit to the broadband survey data to establish an extensive network of calibration stars that spans the survey footprint. The FGCM fit minimizes the dispersions of the repeated measurements of fully corrected standard magnitudes of the calibration stars. In this step, the FGCM process identifies those exposures that allow the best extraction of the observing conditions during a given night. The magnitudes of the calibration stars are not explicit free parameters of the fit, but rather computed from observed flux counts and the fitted photometric model parameters. Therefore, the FGCM yields an extremely efficient parameterization of the photometric calibration of the entire survey. In the second step, the calibration stars are used to determine the observing conditions for individual science exposures. This calibration step requires the exposures to neither have been used in the first step nor taken in "photometric" conditions, provided they have sufficient overlap with the calibration stars.

The features of the FGCM are as follows:

  • 1.  
    The instrumental response and the makeup of the atmosphere can be characterized at any time by a relatively small set of parameters.
  • 2.  
    These parameters vary in time slowly compared to the rate at which survey exposures are acquired.
  • 3.  
    We are free to choose survey exposures that best determine the calibration parameters and magnitudes of the calibration stars.
  • 4.  
    Data taken in any band will contribute to the calibration of all bands taken in the same period of time.
  • 5.  
    The FGCM incorporates data from auxiliary instrumentation when they are available; it remains robust, though less precise, when auxiliary data are unavailable.
  • 6.  
    The FGCM is sensitive to the shape of the observing passband and allows for the correction of the variation of the SEDs of celestial sources (Li et al. 2016).

The FGCM does not determine the absolute flux scales of the reference passbands. Absolute calibration may be achieved via HST CALSPEC34 standards (Bohlin 2007), several of which are included in the DES footprint. One of these (C26202) is within the footprint and dynamic range of normal DES science exposures, and so is particularly attractive as a possible source for absolute calibration. The possibility of using dedicated observations of stars with nearly thermal SEDs (e.g., DA white dwarfs) for the standardization of color has also been studied (Smith et al. 2015). However, absolute calibration is a topic that is outside the scope of the work presented in this text.

The DES consists of repeated tilings of approximately $5000\,{\deg }^{2}$ of the southern sky in the five wideband filters grizY with the Blanco telescope and DECam instrument (Flaugher et al. 2015) at the Cerro Tololo Inter-American Observatory (CTIO). Approximately 10 million relatively bright isolated stars are found in the DES footprint, and each will have been observed in each of the five bands typically eight times at the conclusion of the five-year survey. Additional data are acquired with an in situ multiwavelength illumination "DECal" system (Marshall et al. 2013) to measure the wavelength dependence of the transmission of light through the Blanco/DECam optical system (including the changeable filter) and the spectral response of the sensors in the camera. The DES also acquires real-time data from CTIO site meteorology instrumentation, the SUOMINET GPS system,35 and auxiliary "aTmCAM" instrumentation (Li et al. 2014) to track changes in conditions at the observatory and the makeup of the atmosphere above the observatory. The all-sky infrared cloud camera RASICAM (Reil et al. 2014) is used to guide observing operations.

The DES observations at CTIO are made over a combination of full and half nights equivalent to 105 full nights from August through February. Initial "Science Verification (SV)" observations were made in the 2012–2013 season to commission the instrument and survey strategy, and an "SVA1 Gold" data release36 is available for public use. These data were calibrated with a version of the earlier "ubercal" technique and successfully met the DES design requirement of 2% or better photometric accuracy (Tucker et al. 2007). The main survey began in 2013 August, and the third of the planned five-year science campaigns was completed in 2016 February. We report here on the FGCM calibration of this first three-year "Y3A1" data set.

In Section 2 of this paper, we first present the concept of broadband photometry with chromatic corrections and follow in Section 3 with the formulation of the FGCM calibration model. In Section 4, we next discuss the FGCM process and the execution of the calibration of the DES Y3A1 three-year data release. In Section 5, we define the FGCM metrics and tests, and present results of the performance of the FGCM calibration of Y3A1. In Section 6, we define and discuss the FGCM output data products and their use. Finally, in Section 7, we discuss plans for further improvements of the FGCM procedure.

2. Broadband Photometry with Chromatic Corrections

A digital camera on a ground-based astronomical telescope will count a fraction of the photons produced by a celestial source that reach the top of the Earth's atmosphere. For broadband observations, the number of analog-to-digital counts (ADU) in the camera produced by a source is proportional to the integral of the TOA flux ${F}_{\nu }(\lambda )$ from the source weighted by the observational passband transmission, ${S}_{b}(x,y,\mathrm{alt},\mathrm{az},t,\lambda )$, in the broadband filter $b=\{{grizY}\}$:

Equation (1)

where A is the area of the telescope pupil, g is the electronic gain of the camera sensors (electron/ADU), and ${\rm{\Delta }}T$ is the duration of the exposure. The units of flux ${F}_{\nu }(\lambda )$ are $\mathrm{erg}\,{\mathrm{cm}}^{-2}\,{{\rm{s}}}^{-1}\,{\mathrm{Hz}}^{-1}$, and the factor ${({h}_{\mathrm{Pl}}\lambda )}^{-1}d\lambda $ counts the number of photons per unit energy at a given wavelength (hPl is the Planck constant). The coordinates (x, y) are those of the source image in the focal plane of the camera, $(\mathrm{alt},\mathrm{az})$ are the altitude and azimuth of the telescope pointing, and t is the time and date (modified Julian date; MJD) of the observation. For convenience, we refer to this position- and time-variable observational passband as

Equation (2)

We define an observed TOA magnitude of a celestial source to be (Fukugita et al. 1996),

Equation (3)

where the AB flux normalization FAB = 3631 Jy ($1\mathrm{Jy}={10}^{-23}\,\mathrm{erg}\,{\mathrm{cm}}^{-2}\,{{\rm{s}}}^{-1}\,{\mathrm{Hz}}^{-1}$; Oke & Gunn 1983). With the measured ADU counts from Equation (1), this becomes

Equation (4)

where

Equation (5)

and ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ is defined as the integral over the observational passband b:

Equation (6)

The utility of Equations (3) and (4) is limited by the large variety of passbands that will be encountered during the course of the DES campaign. Even if each passband is known, proper scientific interpretation will depend on the knowledge of the wavelength dependence of the source SED. We seek to define a unique photometric quantity associated with each source that can be compared to other measurements and theoretical predictions, and we seek a method to obtain this quantity from the DES campaign data.

Consider the broadband magnitude that would be measured if the source were observed through a "standard" passband ${S}_{b}^{\mathrm{std}}(\lambda )$ that we choose at our convenience,

Equation (7)

The difference between this "standard" magnitude and a given observed magnitude is

Equation (8)

where ${{\mathbb{I}}}_{0}^{\mathrm{std}}$ is defined analogously to Equation (6) with the standard passband. Given knowledge of the source SED and observational passband, this gives a unique transformation to a magnitude in the corresponding standard passband.

In practice, direct use of Equation (8) is challenging. We do not generally have detailed SEDs for all of our photometrically identified calibration stars, and for the purposes of fitting model parameters, the amount of computing required to repeatedly perform the necessary integrations is impractical. However, as will be discussed in Section 5.4, it is sufficient to utilize in the fit a first-order expansion of the SED of each source that can be estimated from the observed colors of the star. We write

Equation (9)

where

Equation (10)

is the average slope of the SED across the passband. The prescription used by FGCM to compute suitably accurate SED slopes is given in Appendix A. For convenience, we additionally define the ratio

Equation (11)

The reference wavelength ${\lambda }_{b}$ is arbitrary; we define it as the photon-weighted mean wavelength of the instrumental passband,

Equation (12)

where ${S}_{b}^{\mathrm{inst}}$ is the focal-plane average instrumental system response excluding the atmosphere. With these definitions, Equation (8) becomes

Equation (13)

We further define an ${{\mathbb{I}}}_{1}$ integral similar to Equation (6),

Equation (14)

with a similar definition for the corresponding integral over the standard passband. It is also convenient to define the "normalized chromatic passband integral:"

Equation (15)

Note that in our linearized formulation ${{\mathbb{I}}}_{0}$, ${{\mathbb{I}}}_{1}$, and ${{\mathbb{I}}}_{10}$ are all independent of the source SED. We note that ${{\mathbb{I}}}_{0}$ is unitless, while ${{\mathbb{I}}}_{1}$ and ${{\mathbb{I}}}_{10}$ have units of length (${\rm{\mathring{\rm A} }}$).

Combining Equation (4) with Equation (13), we obtain

Equation (16)

The standard magnitude is determined by an "instrumental magnitude" given by raw ADU counts and exposure time, a "zeropoint" integral of the observational passband with AB normalization, and a "chromatic correction." Note that the chromatic correction will be zero if the observing passband is the standard passband, so it is advantageous to choose standard passbands that are most often encountered during the survey. The correction will also be zero if the SED is flat across the passband, and the correction is unaffected by the normalization of the passbands.

3. Forward Global Calibration Formulation

The DES data management (DESDM) software package (E. Morganson et al. 2017, in preparation) processes single DECam exposures using a dedicated version of the well-known "Source Extractor" software (Bertin & Arnouts 1996) to produce "FINALCUT" catalogs (FITS databases) of instrumental data from individual observations of celestial objects. Corrections have been applied to these data for a number of instrumental effects, including electronic bias and nonlinearity, variation in pixel-to-pixel response, and variation in the observing point-spread function (including dependence on source brightness). Sky backgrounds have been subtracted and images have been screened to remove those that exhibit a number of observing or instrumental effects (Bernstein et al. 2017b). The FINALCUT catalogs are queried (cf. Appendix D), and the observational data are processed with software that implements the FGCM photometric calibration.

The FGCM formulation follows the sequence in time over which the DES survey data are acquired. The FGCM model parameters include some that are continuous functions of time, some that vary nightly, some that vary over periods of months, and others that change only when some "event" occurs such as instrumental maintenance. The FGCM model does not include any ad hoc parameters unique to a given exposure. Assuming the instrumental properties do not depend on the atmospheric conditions, the observational passband (Equation (1)) can be separated into two functions:

Equation (17)

where ${S}^{\mathrm{atm}}$ is the transmittance (dimensionless) of photons from the TOA to the input pupil of the telescope, and ${S}_{b}^{\mathrm{inst}}$ is the response (CCD electrons/photon) of the instrumental system with optical filter b to photons that pass through the input pupil of the telescope.

3.1. Instrumental System Response

The response of the combined Blanco and DECam instrumental system can be factored into parts that are characterized and determined in different ways,

Equation (18)

where the independent variables (described in greater detail below) have been replaced with units that appropriately match the granularity and stability of the system: pixels in each CCD and MJD dates during an epoch of stable instrumental performance. New epochs are defined at the start of yearly operations and whenever the instrumental complement or performance of sensors is known to change. There were five such epochs defined over the course of Y3A1—two each in Y1 and Y2, while Y3 was an epoch unto itself. The epochs in Y1 and Y2 are each three to four months in duration and include ∼100 nights (or half nights) of DES observing.

None of the factors in Equation (18) include variations that might occur on hourly timescales such as those that could be caused by instability in the temperatures of the sensors or electronics. The average temperature of the DECam focal plane is maintained by an active thermal system and is found to vary by no more than 0.1°C over periods of weeks. The response of the sensors over this range is expected to vary less than 0.1% (Estrada et al. 2010), and any such instability is included in the FGCM performance metrics discussed below. We note also that only ${S}_{b}^{\mathrm{DECal}}$ has a specific wavelength dependence, and that this quantity includes nearly all of the loss of light through the system (Figure 1 below).

Figure 1.

Figure 1. Blanco/DECam instrumental passbands ${S}_{b}^{\mathrm{DECal}}$ measured with the DECal system. The solid color lines show the focal-plane average for the g band (blue-green), r band (light red), i band (dark red), z band (purple), and Y band (black). In addition, one light gray line plotted for each individual CCD shows the variation in response, which is especially pronounced for the g band. The variation of the blue edge of the i band is shown in more detail in Figure 2.

Standard image High-resolution image

3.1.1. Flat Fields and Star Flats: ${S}_{b}^{{flat}}$ and ${S}_{b}^{{starflat}}$

Pixel-to-pixel variations in the detection efficiency of in-band photons that pass through the telescope pupil are denoted by ${S}_{b}^{\mathrm{flat}}(\mathrm{pixel},\mathrm{epoch})$. Electronic bias and traditional broadband pixel-level "flat" frames for each filter band are obtained nightly, and averages for each observing epoch are computed from a subset of the images for each CCD. These are applied by DESDM to correct raw ADU counts during the processing of science images. This removes small spatial scale variations in sensor efficiency and variations in read-out amplifier gains. However, this technique introduces well-known errors (see, e.g., Regnault et al. 2009 and references therein), due to the non-uniformity of the illumination pattern produced by the flat-field screen, and worsens distortions of the projections of pixel shapes onto the celestial sky.

Dedicated exposures dithered across dense star fields are acquired once per observing epoch and used by DESDM during the processing of science images to correct for large-scale non-uniformity in the instrument response left by the flat-field process. These exposures are taken over a short period of time, and large-aperture photometry of well-separated stars is used to minimize systematic errors in these measurements (Bernstein et al. 2017a). The star-flat correction ${S}_{b}^{\mathrm{starflat}}(\mathrm{pixel},\mathrm{epoch})$ is defined for each filter band on a sub-CCD spatial scale for each epoch.

The philosophy of the FGCM is to consider the acquisition and use of nightly broadband flats and dithered star corrections by DESDM to be part of the overall system to be calibrated. These pixel-level corrections are incorporated into the FINALCUT instrumental magnitudes that are input to the FGCM process.

3.1.2. Superstar Flats: ${S}_{b}^{{superstar}}$

The FGCM allows for the refinement of the star flats, which we refer to as a "superstar" flat. Denoted by ${S}_{b}^{\mathrm{superstar}}(\mathrm{ccd},\mathrm{epoch})$, this correction is computed from the calibration exposures for each epoch for each CCD at the end of each cycle of the calibration fit (Section 4). In practice, this is effectively a modification of the DESDM processing, and therefore we apply this correction to the instrumental magnitudes before the next cycle of the fit. This improves the accuracy and efficiency of the fitting process. The superstar flats obtained for the Y3A1 calibration are discussed in Section 4.5.1, and examples are shown in Figures 7 and 8.

3.1.3. Opacity of Optical System: ${S}^{{optics}}$

The factor ${S}^{\mathrm{optics}}(\mathrm{MJD})$ includes the opacity of the optical system created by environmental dust that accumulates on the exposed optical surfaces. It also includes the degradation in the reflectivity of the primary mirror's bare aluminum surface coating over time. Dust is composed of particles with sizes that are large compared with the wavelength of optical light, so its opacity is independent of wavelength (i.e., gray). It is optically located at the input pupil of the telescope, so dust extinction is to good approximation independent of the location of the image in the focal plane. The Blanco primary mirror is wet-washed several times per year—a total of seven times during the DES Y3A1 three-year observing campaign. It is also cleaned weekly with CO2 gas. The optical thickness of dust contamination is discontinuous at each wash date and found to vary by several percent between wet washings.

The aluminized primary mirror was resurfaced in 2011 March. Engineering measurements show losses in reflectivity from the mirror of several percent per year over the course of DES Y3A1 operations. There is some evidence for wavelength dependence in the initial measurements, but little in those taken following washes during DES operations. No direct measurements of the absolute transparency of the exposed surface of the DECam entry window are available. The FGCM model combines the effects of dust and mirror reflectivity into a single time-dependent, wavelength-independent "gray" term normalized to unity on a date near the start of Y3A1 observing. The results from the opacity fits are discussed in Section 4.5.2 and Figure 9.

3.1.4. Wavelength Dependence from DECal: ${S}_{b}^{{DECal}}$

The in situ "DECal" system provides nearly monochromatic illumination of the DECam focal plane through the Blanco input pupil. This system was used to measure the detailed wavelength dependencies ${S}_{b}^{\mathrm{DECal}}(\mathrm{ccd},\lambda )$ of the grizY instrumental passbands at the beginning of DES operations and once per year during the campaign. These measurements are made with 2 nm FWHM spectral bins stepped in 2 nm increments across the nominal passband of each filter and in 10 nm increments at wavelengths that are nominally "out-of-band" (defined as wavelengths approximately 10 nm or more outside the main passband of the filter). These data account for the wavelength dependence of the reflectivity of the primary mirror, the filter passbands, and the sensor efficiency. The passbands are measured individually for each CCD in the DECam focal plane as shown in Figure 1. The normalization is arbitrarily chosen to be the average of the CCD responses over the central $\pm 400\,{\rm{\mathring{\rm A} }}$ of the i band. The light gray lines show the per-CCD variation, which is especially pronounced for the g band due to variations in the quantum efficiencies of the sensors at the blue side. In addition, Figure 2 shows the variation in the blue edge of the i-band passband as a function of radius from the center of the field of view; this is caused by the variation of the transmittance of the filter with incidence angle. The shapes of the passbands are measured with better than 0.1% precision and are found to be stable over the Y3A1 campaign to the accuracy with which they are measured.

Figure 2.

Figure 2. Radial variation of the blue edge of the i-band passband due to the filter. Each line represents one CCD, and the color represents the distance (degrees on the sky) of the CCD from the center of the field of view.

Standard image High-resolution image

3.1.5. Instrumental Fit Parameters

The vector of the parameters of the instrumental system used to fit the observed DES data,

Equation (19)

includes the opacity ${S}^{\mathrm{optics}}(\mathrm{MJD})$ of the optics after the primary mirror is washed on $\mathrm{wash}\_\mathrm{MJD}$ and the linear rate of change in the throughput of the optics during the period of time following each washing. All other characteristics of the instrumental system are measured quantities.

3.2. Atmospheric Extinction

Processes that attenuate light as it propagates through the atmosphere include absorption and scattering (Rayleigh) by molecular constituents (${{\rm{O}}}_{2}$, ${{\rm{O}}}_{3}$, and trace elements), absorption by precipitable water vapor (PWV), scattering (Mie) by airborne macroscopic particulate aerosols with physical dimensions comparable to the wavelength of visible light, and shadowing by larger ice crystals and water droplets in clouds that is independent of wavelength (gray).

The FGCM fitting model for atmospheric transmittance is written as

Equation (20)

where ${S}^{\mathrm{molecular}}$ accounts for absorption and scattering by dry gases, ${S}^{\mathrm{pwv}}$ accounts for absorption by water vapor, τ is the aerosol optical depth, and ${\rm{X}}$ is the airmass. The barometric pressure $\mathrm{bp}(\mathrm{mm})$, the zenith distance of the observation $\mathrm{zd}(\deg )$, and the time of the observation t (MJD) are acquired for each exposure. The airmass $X(\mathrm{zd})$ is computed separately for each exposure at the center of each CCD on the focal plane and includes corrections for the curvature of the Earth (Kasten & Young 1989), which become important at larger zenith distances. As discussed below, the model does not explicitly include possible extinction by cloud cover. We now describe in greater detail each of these terms and their corresponding parameterizations.

3.2.1. Molecular Absorption: ${S}^{{molecular}}$

Molecular Rayleigh scattering and absorption by oxygen and trace elements are determined to high precision via the barometric pressure, which is continuously acquired as part of the environmental monitoring of the observing site. Absorption of light by ozone can be characterized by one parameter—the integrated vertical column height which varies seasonally with small variations over periods of days. Therefore, we fit one parameter for ozone for each calibratable night.

3.2.2. Water Vapor Absorption: ${S}^{{pwv}}$

The FGCM parameterization of atmospheric transmission accounts for the time variations in PWV during observing nights. These are taken from measurements made with auxiliary information when they are available. Auxiliary data are assigned to a DES survey exposure if their MJD acquisition dates are most closely matched to, and are within $\pm 2.4\,\mathrm{hr}$ of, that survey exposure. The procedure adapts to missing auxiliary data by inserting a model that is linear in time through the night.

If a calibration exposure is successfully matched by auxiliary data, then the PWV is parameterized as

Equation (21)

where ${\mathrm{pwv}}_{\mathrm{AUX}}$ is the value from the auxiliary instrumentation matched to the exposure. The nightly ${\mathrm{pwv}}_{0}$ term accounts for possible instrumental calibration offsets in the auxiliary data, and the constant ${\mathrm{pwv}}_{1}$ (a single value for the entire run) accommodates possible theoretical or computational scale differences between the FGCM and auxiliary data reductions. If the auxiliary instrument does not provide data for an exposure, then the PWV is parameterized with the less accurate approximation

Equation (22)

where the value at $\mathrm{UT}=0$ ($\mathrm{pwv}(\mathrm{night})$) and the time derivative (${\mathrm{pwv}}_{s}(\mathrm{night})$) are FGCM fit parameters. The code allows for both cases within each night, and so requires three parameters per calibratable night plus the one overall scale parameter ${\mathrm{pwv}}_{1}$.

3.2.3. Aerosol Absorption: ${e}^{-(X\tau )}$

Scattering by aerosols can be more complex, but the corresponding optical depth for a single particulate species is well-described with two parameters as

Equation (23)

The normalization ${\tau }_{7750}$ and optical index α depend on the density, size, and shape of the aerosol particulate. The FGCM does not use any of the available MODTRAN aerosol models, as these are specific to types of sites.

Aerosol optical depth, like water vapor, can vary by several percent over hours, so the calibration measurements and process must account for variations of this magnitude on these timescales. The aerosol normalization ${\tau }_{7750}$ is parameterized in a manner similar to the PWV. When auxiliary data are available,

Equation (24)

or if no auxiliary data are available,

Equation (25)

Again, the code allows for both cases within each night, so it requires three parameters per calibratable night plus the one overall scale parameter ${\tau }_{1}$.

For our present modeling, we assume that the aerosols on any given night are dominated by a single species. Therefore, we require one value for the aerosol optical index α(night) for each calibratable night.

3.2.4. Atmospheric Fit Parameters

The vector of the atmospheric parameters used to fit the observed DES data,

Equation (26)

includes the vertical column height of ozone (Dobson), the vertical column height of PWV (mm), the vertical optical depth of aerosol (dimensionless), and the aerosol optical index (dimensionless). Section 4.5.3 below summarizes the input auxiliary data available during Y3A1 and the results of the FGCM fit.

3.3. Clouds, Photometric Conditions, and "Gray" Corrections

Observing operations for the DES are generally carried out only when the sky is relatively free of cloud cover. Even so, condensation of water droplets and ice can produce thin clouds that are invisible to the naked eye and have intricate spatial structure (e.g., Burke et al. 2014). This condensation process occurs along sharp boundaries in temperature and pressure determined by the volume density of PWV; this leads to the common characterization of observing conditions as either "photometric" or not.

The FGCM fitting model does not include a specific component for extinction by clouds, but a rigorous procedure is followed to identify photometric, or nearly photometric, exposures for use in the calibration fit. Estimates of the standard magnitudes $\overline{{m}_{b}^{\mathrm{std}}}$ of the calibration stars obtained in each cycle of the FGCM fitting process are used to estimate the extinction of each exposure that is not accounted for by the fitted parameter vectors. (See Section 4.2 below for a discussion of this process.) This estimate is used to select the sample of calibration exposures to be used in the next cycle of the fitting process. During the DES observing season, the conditions at CTIO are such that cloud formation does not occur for large periods of time on many nights. The FGCM finds that nearly 80% of the exposures taken in the Y3A1 campaign were acquired under photometric conditions and are used in the final fit cycle.

In the final step of the FGCM, an estimate of a "gray" correction is made from the observed ${m}_{b}^{\mathrm{std}}$ on each exposure that accounts for cloud extinction. This step is discussed in detail in Section 6.3 below, but we note here that this "gray" correction is an estimate of the cumulative effect from a number of sources that are not explicit in the fitting model. This includes possible instrumental effects (e.g., dome occultations and shutter timing errors) and residual errors in assignments of ADU counts to celestial sources (e.g., aperture corrections and subtraction of sky backgrounds). These may depend on the band of the exposure, but are assumed to have no explicit wavelength dependence across each band and so are labeled "gray."

3.4. Standard Passbands and Observational Look-Up Tables

Standard passbands were defined for the Y3A1 campaign, and look-up tables (LUTs) were pre-computed to allow rapid evaluation of the passband integrals ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ and ${{\mathbb{I}}}_{1}^{\mathrm{obs}}$ over a wide range of model parameter vectors.

The standard instrumental system responses were chosen to be the average responses of the CCDs in the focal plane shown in Figure 1. These were synthesized from DECal scans taken during the first two years of DECam operations. The standard atmospheric transmittance was computed with the MODTRAN IV code (Berk et al. 1999) with the parameters given in Table 1 chosen as typical of those encountered during the Y3A1 campaign. The transmissions of the various components of the standard atmosphere are shown in Figure 3, and the combined set of standard passbands is shown in Figure 4. Subsequent observations of the SDSS standard BD+17°4708 (Fukugita et al. 1996) indicate that these passbands should be multiplied by a factor $\approx 0.55$ if approximate normalization is desired. A code that contains these passbands, as well as tools to use them, is available for download.37 The photon-weighted average wavelength and the ${{\mathbb{I}}}_{0}^{\mathrm{std}}$ and ${{\mathbb{I}}}_{1}^{\mathrm{std}}$ integrals, and their ratio ${{\mathbb{I}}}_{10}^{\mathrm{std}}$ for these passbands, are given in Table 2.

Figure 3.

Figure 3. Standard atmosphere for the DES Y3A1 release computed with Gaussian 1 nm FWHM smoothing. The component values are listed in Table 1.

Standard image High-resolution image
Figure 4.

Figure 4. Standard passbands ${S}_{b}^{\mathrm{std}}(\lambda )$ for the DES Y3A1 release. As with Figure 1, the lines are g band (blue-green), r band (light red), i band (dark red), z band (purple), and Y band (black).

Standard image High-resolution image

Table 1.  Standard Atmosphere

Parameter Units Value
Barometric Pressure mb 778.0
Precipitable Water Vapor mm 3.0
Ozone Dobson 263.0
Aerosol Optical Depth None 0.030
Aerosol Optical Index None 1.00
Airmass None 1.2

Download table as:  ASCIITypeset image

Table 2.  Standard Photometric Passband Parameters

Band ${\lambda }_{b}$ ${{\mathbb{I}}}_{0}^{\mathrm{std}}$ ${{\mathbb{I}}}_{1}^{\mathrm{std}}$ ${{\mathbb{I}}}_{10}^{\mathrm{std}}$
  (Å)   (Å) (Å)
g 4766.0 0.163 4.333 26.58
r 6406.1 0.187 1.850 9.89
i 7794.9 0.174 1.344 7.72
z 9174.4 0.136 −2.163 −15.90
Y 9874.5 0.052 0.911 17.52

Download table as:  ASCIITypeset image

Look-up tables of the ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ and ${{\mathbb{I}}}_{1}^{\mathrm{obs}}$ integrals were computed at discrete points over a broad range of the atmospheric parameter vector ${{\boldsymbol{P}}}^{\mathrm{atm}}$ using the focal-plane averaged instrumental passbands in Figure 1. Variations across the focal plane in the ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ values are corrected by application of the superstar flats. The ${{\mathbb{I}}}_{1}^{\mathrm{obs}}$ integrals are corrected for the variation of the wavelength profile of the instrumental passband across the focal plane by using data acquired with DECal for individual CCDs and assuming standard atmospheric parameters. By definition, all of these corrections average to zero across the focal plane, so the standard passbands remain the reference. Interpolation of these discrete LUTs to continuous parameter space is done during the FGCM fitting and analysis procedures.

4. Forward Global Calibration Process

4.1. Overview

The FGCM includes several steps that are done once at the outset (cf., Appendix D). This includes SQL queries of the "FINALCUT" catalogs produced by DESDM to obtain both a "demand" list of exposures that are to be calibrated and a catalog of data from all observations of objects that are candidates to be used as calibration stars. These observations are then cross-matched by location on the celestial sky to assign them to unique objects. Selection is then made of candidate calibration stars, and a catalog of all observations of each candidate, which serves as the basis for the calibration fit and subsequent computation of calibration data products, is created.

The FGCM does not use any prior knowledge of properties of potential calibration stars. It begins with a bootstrap that uses the parameters of the standard passbands (Tables 1 and 2) as initial guesses for the model to be used to fit the observed data. Initial estimates of the ${m}_{b}^{\mathrm{obs}}$ magnitudes of the candidate calibration stars are made using a "bright observation" algorithm that identifies groups of observations near the brightest observation found. These are assumed to be approximately photometric, and the algorithm yields estimates of the magnitudes of stars and rough estimates of residual "gray" errors on each exposure.

From this start, the process becomes cyclical with the steps illustrated in Figure 5 (see also Appendix E):

  • 1.  
    Select calibration stars from those in the candidate pool with at least two observations in each of griz (Figure 5(a)).
  • 2.  
    Select calibration exposures with at least 600 calibration stars from those in the campaign exposure demand list (Figure 5(b)).
  • 3.  
    Select "calibratable" nights with at least 10 calibration exposures from those in the campaign exposure demand list (Figure 5(c)).
  • 4.  
    Iteratively fit all griz observations of all calibration stars on all calibration exposures taken on calibratable nights to obtain the best parameter vectors ${{\boldsymbol{P}}}^{\mathrm{atm}}$ and ${{\boldsymbol{P}}}^{\mathrm{inst}}$ (Figures 5(d), (e), and (f)).
  • 5.  
    When the fit converges (or reaches a maximum number of iterations): compute best estimates for the magnitudes of calibration stars and dispersions of their repeated measurements, update estimates of residual "gray" extinction on individual exposures, and update the superstar flats (Figures 5(e), (g), and (h)).
  • 6.  
    If the sample of calibration exposures shows sign of residual "gray" loss of flux (see Section 4.3), then remove occulted exposures and start a new cycle with updated parameter vectors and analysis data products.

Figure 5.

Figure 5. Flowchart of FGCM selection and fit procedure.

Standard image High-resolution image

The Y-band observations are not used in the fit because those data are preferentially taken when observing is not optimal. We "dead reckon" the Y-band magnitudes for calibration stars using the parameter vectors obtained from the fit to the griz magnitudes:

  • 1.  
    Select Y-band calibration stars and exposures (Figures 5(a) and (b)).
  • 2.  
    Compute Y-band magnitudes (${m}_{Y}^{\mathrm{std}}$) for the subset of griz calibration stars that were also observed on Y-band calibration exposures (Figure 5(e)).
  • 3.  
    Compute Y-band dispersions, estimate "gray" extinction on individual exposures, and update Y-band superstar flats (Figures 5(g) and (h)).
  • 4.  
    If the sample of Y-band exposures shows sign of significant loss of flux, then reselect Y-band calibration exposures and repeat.

We note that the precision of the final Y-band magnitudes is a useful internal "blind" diagnostic for the accuracy of the FGCM process (see Section 5.1).

As a final step following the fitting cycles, the FGCM process uses the final calibration star magnitudes ${m}_{b}^{\mathrm{std}}$ and parameter vectors ${{\boldsymbol{P}}}^{{inst}}$ and ${{\boldsymbol{P}}}^{\mathrm{atm}}$ to compute output data products for CCD images on science exposures in the campaign. At this point, the procedure is:

  • 1.  
    Compute ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ and ${{\mathbb{I}}}_{10}^{\mathrm{obs}}$ values from the FGCM fit parameter vectors.
  • 2.  
    Compute zeropoint values and chromatic corrections from the FGCM fit parameter vectors (cf., Equation (16)).
  • 3.  
    Use the standard magnitudes ($\overline{{m}^{\mathrm{std}}}$) of calibration stars to estimate residual "gray" corrections.
  • 4.  
    Assign quality flags and estimate errors of data products.

These computations are described in more detail in Section 6.

4.2. The FGCM Fit

The FGCM fitting step minimizes the weighted dispersion of repeated measurements of the ${m}_{b}^{\mathrm{std}}$ magnitudes (cf., Equation (16)) of calibration stars,

Equation (27)

where the summation is over all calibration objects j found on all griz calibration exposures i. The photometric error is defined as

Equation (28)

where the instrumental error ${\sigma }^{\mathrm{inst}}(i,j)$ is computed by DESDM from source and background ADU counts, and the parameter ${\sigma }_{0}^{\mathrm{phot}}=0.003$ is introduced to control possible underestimates of the errors assigned to the brightest objects. This value is estimated from the residuals of measurements of magnitudes of stars in the exposures used to construct the DESDM star flats (cf., Section 3.1.1). The error-weighted means of the calibrated magnitudes ${m}_{b}^{\mathrm{std}}(i,j)$ of each calibration star j,

Equation (29)

are taken as the best estimates of the true standard magnitudes; here, the summation is over exposures i in band b. The SciPy bounded fitting routine FMIN_L_BFGS_B38 (Zhu et al. 1997) is used to minimize the ${\chi }^{2}$ with the function value and derivatives with respect to all fit parameters explicitly computed. We note that it would be preferable here to use model-based estimates of the photometric errors rather than those taken from the data. However, the errors would themselves then depend on the fit parameters. The stability of this approach will be investigated for possible use in future versions and applications of the FGCM code.

The ${\chi }^{2}$ fitting statistic uses the standard magnitudes of stars with SEDs that span much of the stellar locus. This provides sensitivity to both the amplitude and shape of the observing passband. If the fit parameters are wrong for a given exposure, so too will be the chromatic corrections included in the computation of ${m}_{b}^{\mathrm{std}}$. As discussed in Appendix B, even within a single exposure, there is typically a sufficient range of stellar spectra to constrain the FGCM fit parameters with reasonable accuracy. It is an important feature of the FGCM that it extracts as much information as possible from each star that samples the observational passband of each exposure.

4.3. FGCM Calibration Exposures, Calibratable Nights, and Gray Corrections

As introduced in Section 3.3, there are a number of factors that affect the photometry that are not included in the FGCM fitting model. A key to the success of the FGCM fitting process is the ability to isolate a set of "photometric" exposures free of clouds and significant instrumental errors. To do this, the residual of each measurement i of the magnitude of each calibration star j is computed using the parameter vectors from the most recent fit cycle,

Equation (30)

The average value of this residue is then computed for the calibration stars j that are observed on each CCD image of each candidate calibration exposure i,

Equation (31)

with statistical error

Equation (32)

The statistical error on ${\mathrm{CCD}}^{\mathrm{gray}}$ is typically $\sim 1\mbox{--}2\,\mathrm{mmag}$, so structure on physical scales larger than the $\sim 0.2^\circ $ size of a DECam sensor can be resolved. To take advantage of this, the average and variance of the residual extinctions of the CCD images on each exposure are computed as

Equation (33)

and

Equation (34)

Both ${\mathrm{EXP}}^{\mathrm{gray}}$ and ${\mathrm{VAR}}^{\mathrm{gray}}$ are used in the selection of calibration exposures to use in the FGCM fit (cf., Appendix E). A night will be "calibratable" if a sufficient number of such calibration exposures were taken anytime during that night. The ${\mathrm{CCD}}^{\mathrm{gray}}$ and ${\mathrm{EXP}}^{\mathrm{gray}}$ quantities are also used in the second step of the FGCM process to estimate the "gray" corrections for residual errors that are not included in the FGCM model (see Section 6.3).

The FGCM yields detailed passbands for nearly all exposures taken on calibratable nights; this includes exposures that were not used in the fit as well as those that were. These passbands can be used to compute both ${{\mathbb{I}}}_{0}$ zeropoints for these exposures as well as chromatic corrections either with known or hypothetical SEDs of sources (Equation (7)), or linearized approximations based on the measured magnitudes of objects (Equation (16)).

4.4. FGCM Y3A1 Fit Execution

The Y3A1 fit was completed in four cycles. The distributions of ${\mathrm{EXP}}^{\mathrm{gray}}$ obtained in the i band at the conclusion of these cycles are shown in Figure 6. Similar distributions are obtained for all other bands; we show these for illustrative purposes. There is clearly an asymmetric outlier population with significant loss of flux (${\mathrm{EXP}}^{\mathrm{gray}}\lt 0)$ seen after the initial cycle (top-left panel in the figure). These bias the computed magnitudes of the calibration stars and prevent the fitting process from finding the optimal solution for the passband parameter vectors. Selection of calibration exposures at the end of each cycle of the fit is done by removing those found to be occulted with a cut selected by examining the non-occulted side of the distribution. The precision of the subsequent cycle improves and allows the cut value to be tightened. The FGCM fitting process is deemed to have converged when the distributions shown in the figure become nearly symmetrical, and the bias of the distribution is reduced to an acceptable level. We find that 2%–3% of candidate calibration exposures are removed on each cycle of the fitting process and that this is sufficient to reduce the bias by typically a factor of two. After completion of the final fit Cycle 3, the bias of the fitted Gaussian peak has been reduced to $\mu \approx 0.5\,\mathrm{mmag}$ and the width to $\sigma \approx 5\,\mathrm{mmag}$.

Figure 6.

Figure 6. Extinction in candidate FGCM i-band calibration exposures. The observed distributions of ${\mathrm{EXP}}^{\mathrm{gray}}$ (Equation (33)) are shown in blue, while black dashed lines show Gaussian fits. Over- or underflow counts are accumulated in bins at the extreme ends of the range. The top-left plot is produced by the initial fit cycle that starts with default Standard passbands (Cycle 0). The asymmetric extended tail at negative values is due to cloud cover or instrumental error. The subsequent plots show the progressive removal of exposures after continued fitting cycles sharpen the resolution, and tighter cuts can be made to remove exposures with significant loss of flux. The cut values are shown as vertical dashed lines. The top-right plot is produced by a continued fit to the sample with exposures with ${\mathrm{EXP}}^{\mathrm{gray}}\lt -0.050$ removed after Cycle 0. The bottom-left plot is produced after removing exposures with ${\mathrm{EXP}}^{\mathrm{gray}}\lt -0.025$ following Cycle 1. The bottom-right plot is the distribution produced by the final fit with exposures with ${\mathrm{EXP}}^{\mathrm{gray}}\lt -0.015$ removed after Cycle 2.

Standard image High-resolution image

It can be seen in Figure 6 that the final sample includes a residual excess of exposures with some unaccounted loss of flux. Cutting too tightly on ${\mathrm{EXP}}^{\mathrm{gray}}$ will bias the calibration star magnitudes in the sense opposite to that caused by exposures taken through very thin cloud layers that remain in the calibration sample. The FGCM minimizes this ambiguity by explicitly including in the final step of the process the "gray" correction introduced above.

It is important to note that the magnitudes of the calibration stars ($\overline{{m}_{b}^{\mathrm{std}}(j)}$) are not explicitly free parameters of the fit; they are functions of the observed ADU counts and the fitted parameter vectors ${{\boldsymbol{P}}}^{\mathrm{inst}}$ and ${{\boldsymbol{P}}}^{\mathrm{atm}}$. So, the ${\chi }^{2}$ function does not rigorously have the statistical properties of a chi-square, but it is what we seek to minimize. It is also very efficient and highly constrained. The FGCM calibration of the Y3A1 campaign used 2552 parameters to fit 133,265,234 degrees of freedom (DOF), and converged after four cycles (Figure 5) of 25, 50, 75, and 125 iterations.

4.5. FGCM Y3A1 Fit Results

We provide here a summary of the statistics of the Y3A1 campaign and the parameters obtained from the FGCM fitting step. A summary of statistics for the Y3A1 campaign is given in Table 3. A query of the DESDM FINALCUT tables found demand for calibration of 41,562 griz and 9770 Y-band wide-field and supernova field exposures that were taken during the campaign.39 There were 11,710,194 candidate calibration stars found on exposures for which a calibration was requested. At least one griz calibration exposure was taken on 351 scheduled observing nights or half nights, while at least 10 were taken on 335 nights. The Y3A1 FGCM calibration fit used 32,368 griz calibration exposures (78% of the total) taken on 317 calibratable nights. It produced standard magnitudes for 8,702,925 griz calibration stars spaced nearly uniformly across the DES footprint (≈0.5 calibration stars per square arcminute). Of these, 6,225,680 were also Y-band calibration sources.

Table 3.  DES Y3A1 Release Statistics

Statistic Value Comment
Total exposures 51,332 DESDM demand file
griz exposures 41,562  
griz cal exposures 32,368  
Y exposures 9770  
Nights with >1 cal exposure 351 Dome at least opened
Nights with >10 cal exposures 335 Minimum to attempt calibration
Calibratable nights 317 Some photometric time
Number of griz cal stars 8,702,925 Require ≥2 cal observations in each band
Number of Y cal stars 6,225,680 A griz cal star with ≥2 Y cal observations
Number of ${\mathrm{ZPT}}^{\mathrm{FGCM}}$ 3,182,584 All CCD images (Table 5)

Download table as:  ASCIITypeset image

4.5.1. Superstar Flats

Five epochs of camera operations were identified and captured in the superstar flats ${S}_{b}^{\mathrm{superstar}}$. These are not parameters of the fit, but are computed and updated after each calibration cycle from the ${\mathrm{CCD}}^{\mathrm{gray}}$ values (Equation (31)) averaged over the DES wide-field calibration exposures taken in each band. A typical g-band superstar flat, shown in Figure 7, is dominated by differences in the shorter wavelength sensitivity of the CCDs and their AR coatings, while the i-band superstar flat in Figure 8 exhibits smooth gradients of a percent or so across the focal plane. These gradients are consistent with known ambiguities in the fitting technique used to create the initial DESDM star flats.

Figure 7.

Figure 7. Superstar flat in the g band derived from the third epoch of observing. The axes are R.A. and decl. offset from the center of the field of view. The FGCM calibration process does not require these corrections to average to zero over the focal plane.

Standard image High-resolution image
Figure 8.

Figure 8. Superstar flat in the i band derived from the third epoch of observing.

Standard image High-resolution image

4.5.2. Opacity Fit Parameters

The primary mirror was washed on seven dates during the three-year Y3A1 campaign, so the linear model used for the accumulation of dust ${S}^{\mathrm{optics}}$ requires 14 free parameters. The resulting history, shown in Figure 9, is consistent with laboratory engineering measurements taken on the wash dates. It exhibits overall worsening of optimal transmission over time as expected for the aluminum mirror surface exposed to air and possible buildup of dust on the downward-facing DECam external window that was not cleaned during this period of time.

Figure 9.

Figure 9. Throughput of the Blanco/DECam optical system. The plot shows the piecewise linear fit to the transmittance of the optics with discontinuities at the known dates when the primary mirror was washed (marked with vertical dashed lines and also once prior to the start of the survey that is not marked).

Standard image High-resolution image

4.5.3. Atmospheric Fit Parameters

A summary of the atmospheric parameters obtained by the FGCM fit is given in Figure 10. The auxiliary aTmCAM instrument was unavailable for the first year of the Y3A1 campaign, and analysis of the data obtained in the latter two years was not available for inclusion in the Y3A1 calibration. So these data are not used in the Y3A1 calibration. The SUOMINET GPS network provided measurements of atmospheric water vapor on 90% of the nights of the DES Y3A1 campaign, and these data were used to compute (Equation (21)) most of the PWV values shown in the figure. The less precise linear form of Equation (22) was used for the remainder of the campaign observations. The aerosol depth values were fit in all cases with the linear form (Equation (25)), and as discussed in Section 3.2.3, the aerosol optical index α is assumed to be constant during each night. Note that for clarity the figure shows only nightly averages of the computed PWV and ${\tau }_{7750}$ values.

Figure 10.

Figure 10. Atmospheric parameters from the Y3A1 FGCM fit. The top plot shows the nightly average aerosol optical depth at $7750\,{\rm{\mathring{\rm A} }}$ for fitted exposures in the campaign. The middle plot shows the aerosol α. The bottom plot shows the nightly average precipitable water vapor. Only nights where the given atmospheric parameter has an impact on the calibration, and therefore can be well fit, are shown. For ${\tau }_{7750}$, only nights with at least 10 exposures in each g and r are shown; for α, only nights with at least 10 exposures in g are shown; and for PWV, only nights with at least 10 exposures in z are shown.

Standard image High-resolution image

A detailed analysis of the patterns and correlations in the meteorological parameters has not been done, but the aerosol and water vapor distributions are consistent with historical data from the CTIO site. There is evidence for seasonal variation in the fitted aerosol optical index consistent with the smaller sized particulates (larger optical indices) being prevalent during the early spring start of the DES observing periods and particulates of larger cross-sections dominating in the later summer periods. Even with these trends removed, the index remains noisy. This may be due to the presence of multiple peaks in the likelihood function as would be the case if there were more than one component of aerosol particulate in the atmosphere (not an unreasonable expectation). Future incorporation of data from the auxiliary aTmCAM instrument may allow the inclusion of two components of aerosol particulates in the atmospheric model. The residual error in these parameters remains reflected in the overall performance of the Y3A1 calibration, discussed next.

5. Performance of the FGCM Calibration of Y3A1

The metrics that we use to characterize the success of the FGCM fitting procedure include the reproducibility of the calibrated ${m}_{b}^{\mathrm{std}}$ magnitudes of the calibration stars and comparison with recently published Gaia G-band data taken at the TOA (Lindegren et al. 2016). The first of these characterizes the "precision" or random error in the nightly calibration vectors, and the comparison with Gaia is sensitive to systematic errors in the fit that translate into uniformity variations. We also evaluate the sufficiency of the linear approximation to the chromatic correction for SEDs across the stellar locus. We note that we also might use the uniformity of the observed stellar locus across the survey footprint as a measure of the performance of the calibration (e.g., Ivezić et al. 2004; High et al. 2009; Kelly et al. 2014). Unfortunately, the observed color distributions depend on the resolution and accuracy of Galactic reddening corrections. For the present work, these are not sufficiently controlled at small spatial scales to address the subpercent goals of the DES calibration.

5.1. FGCM Fit Precision

To evaluate the reproducibility (precision) of the FGCM calibration, we consider the distributions of the residuals ${E}^{\mathrm{gray}}(i,j)$ (Equation (30)) in the b = griz bands on exposures used in the final Cycle 3 of the Y3A1 FGCM fit. Those measurements made with ${\sigma }^{\mathrm{phot}}\lt 0.010\,\mathrm{mag}$ are shown in Figure 11. By design, the fit simultaneously minimizes the photon-statistics weighted variance of these in all bands. For diagnostic purposes, we analyze these band by band:

Equation (35)

We interpret these data in terms of the combined random errors in the FGCM fit without attribution to particular sources of these errors.

Figure 11.

Figure 11. Dispersions of repeated measurements on calibration exposures of the ${m}_{b}^{\mathrm{std}}$ magnitudes of calibration stars with ${\sigma }^{\mathrm{phot}}\lt 0.010$. The horizontal axis is ${E}^{\mathrm{gray}}(i,j)$ (Equation (30)), the difference between individual observations i and the mean magnitude of all observations of the same star j. The blue solid line is the histogram of the data, and the black dashed line is a Gaussian fit. The calibration dispersion, $\delta \mathrm{FGCM}$, is computed by subtracting the estimated photometric errors in quadrature. Over- or underflow counts are accumulated in bins at the extreme ends of the horizontal range. The four plots correspond to the four bands griz used in the FGCM fit. Each star is observed in nearly all cases only once on a given night, so the calibration errors of $5\mbox{--}6\,\mathrm{mmag}$ (Table 4) are indicative of the precision of the calibration of data taken on a single night.

Standard image High-resolution image

The DES survey is carried out in multiple "tilings" of the footprint and produces repeated observations of each calibration star that are generally well-separated in time; a star is seldom observed in the same band more than once on a given night. Exceptions are the supernova fields that are often observed with successive exposures when they are targeted. With this exception, the errors in the FGCM fit parameters evaluated on different tilings are approximately independent of each other. So, we approximate the variances of the residuals as

Equation (36)

where Nb(j) is the number of observations i of the calibration star j in band b, and Nb is the total observations of all calibration stars in band b. In this approximation, ${\delta }^{2}\mathrm{FGCM}(b)$ is the variance of the parent distribution of the measurements of the magnitude of a star introduced by random errors in the FGCM fit parameters. We assume it is constant over the three-year survey and over the survey footprint. The magnitudes of each calibration star are computed as the average of the measured values, so the observed dispersion of ${E}^{\mathrm{gray}}(j)$ underestimates the true dispersion. We estimate a correction from the average number of observations of a calibration star in each band (typically ∼4 in the Y3A1 release).

After subtraction of the photon statistical uncertainties, values of 6–7 mmag are obtained for the precision $\delta \mathrm{FGCM}(b)$ of the Y3A1 fit in the griz bands. Table 4 summarizes the means and variances of Gaussian fits to the distributions and includes the fractions of observations found outside the $2\sigma $ of the mean. The Gaussian fits are reasonably good, but the outlier populations are seen to be approximately twice that expected for purely random error. These results are robust to variations in the cut on photon statistics over the range $0.005\lt {\sigma }^{\mathrm{phot}}\,\lt 0.020$. We note that these results are consistent with the precision implied by the residual exposure-averaged gray term shown in Figure 6, where the photon statistical errors are negligible. Analysis of the observations made of the DES supernova fields discussed in Section 5.2 below support the hypothesis that the values determined from the entire data sample can be used to represent the error in any single measurement.

Table 4.  Summary of FGCM Calibration Fit Results

Band Mean Offset (mag) Gaussian σ (mag) δFGCM (mag) Fraction $\lt -2\sigma $ Fraction $\gt 2\sigma $
g −0.00000 0.0087 0.0073 0.036 0.034
r −0.00000 0.0080 0.0061 0.049 0.051
i −0.00012 0.0080 0.0059 0.045 0.049
z 0.00000 0.0087 0.0073 0.034 0.033
Y −0.00023 0.0097 0.0078 0.020 0.042

Download table as:  ASCIITypeset image

5.1.1. The Y-band Calibration

As described in Section 4.1, the Y-band magnitudes are "dead reckoned" from the atmospheric parameters derived from the griz exposures. Therefore, the Y-band data offer a useful internal check on the calibration precision of the FGCM fit. The subset of griz calibration stars that are also observed on at least two Y-band exposures are taken as candidate Y-band standard stars. Final Y-band calibration stars and exposures are selected with a cyclical process to remove non-photometric exposures. This process is identical to that used for the griz bands except that no additional fits are made to the calibration parameter vectors. The ${m}_{Y}^{\mathrm{std}}$ magnitudes are then computed from the ${{\boldsymbol{P}}}^{\mathrm{atm}}$ parameters obtained from the griz fit, and the distribution of the residuals ${E}^{\mathrm{gray}}(i,j)$ is computed in the same manner as the griz samples. The result is shown in Figure 12 and included in Table 4. We find that the Y-band calibration precision $\delta \mathrm{FGCM}(Y)=7.8\,\mathrm{mmag}$ is comparable to that of the griz bands. This provides assurance that the FGCM models and fitted parameters are sufficiently accurate to account for subpercent variations in the photometry in the reddest bands.

Figure 12.

Figure 12. Dispersions of repeated measurements of the ${m}_{Y}^{\mathrm{std}}$ magnitudes of Y-band calibration stars with ${\sigma }^{\mathrm{phot}}\lt 0.010$. The axes and data on the plots are the same as those of Figure 11. Subtraction of photon-counting statistics in quadrature yields the value $\delta \mathrm{FGCM}(Y)=7.8$ mmag, in agreement with the precision of the griz data sets (Table 4).

Standard image High-resolution image

5.1.2. Precision of Calibration Star Magnitudes

We examine in this section the internal precision with which the magnitudes of calibration stars are determined; we note that, as in all cases, these magnitudes are only approximately normalized to an external scale. With the assumption that the repeated measurements of the magnitudes of the calibration stars are independent of each other, we estimate the random error in their mean magnitudes,

Equation (37)

where, as before, Nb(j) is the number of observations i of calibration star j in band b. The random error from the fit reduces to $\lt 4\,\mathrm{mmag}$ in all cases, the statistical photometric error becomes $\lt 0.050\,\mathrm{mag}$ for nearly all calibration stars (initially chosen with ${\rm{S}}/{\rm{N}}\gt 10$ per exposure), and for the brighter objects, the overall errors approach the somewhat arbitrary control value ${\sigma }_{0}^{\mathrm{std}}=3\,\mathrm{mmag}$. The precision with which the calibration star magnitudes are known plays an important role in the final assignment of calibration data products (Section 6.3) and in particular the ability to provide accurate calibrations of non-photometric exposures.

5.2. FGCM Fit Stability

The DES survey targets the supernova fields repeatedly every few days, so these are used as a quality check on the stability of the FGCM calibration. Shown in Figure 13 are the ${\mathrm{EXP}}^{\mathrm{gray}}$ values (Equation (33)) for all SN calibration exposures taken during the Y3A1 campaign. Exposures in all bands are plotted in the figure. The deviation of the mean of the residuals over the three-year survey is well below $5\,\mathrm{mmag}$.

Figure 13.

Figure 13. Average residuals of griz magnitudes found on calibration exposures of the DES supernova fields over the full three-year Y3A1 campaign. These fields are observed at regular intervals during the campaign and demonstrate the stability of the FGCM calibration fit. Data from all four bands are included in the figure.

Standard image High-resolution image

5.3. FGCM Fit Uniformity

The FGCM calibration will introduce correlations in the errors of measurements made closely spaced in time, and these can be imprinted on the uniformity of the calibration error across the celestial sky by the survey tiling strategy. The DECam focal plane is approximately 2° in diameter, so it is expected that structure on this scale will appear particularly in regions of the footprint that were not observed a large number of times in Y3A1.

To look for possible spatial structure in the calibration, we compare with the Gaia DR1 results (Lindegren et al. 2016) that were taken above the atmosphere. The Gaia G band is a broad passband that is centered approximately on the DES r band and spans most of the DES g, r, and i filters. We fit a color transformation that combines weighted combinations of the DES g, r, and i instrumental passbands with the Gaia G published response. Stars with DES color $0.5\lt (g-i)\lt 1.5$ are spatially matched to stars in the Gaia catalog, and the Gaia G-band magnitudes are compared with the transformed DES gri magnitudes. The mean differences of these magnitudes are binned in HEALPIX pixels (NSIDE = 256) and shown in Figure 14. The differences are statistically well-described by a Gaussian with $\sigma =6.6\,\mathrm{mmag}$. Spatial structure at small and large scales, which is caused by calibration and depth issues from both surveys, can be seen at this level. We note that comparisons to the broad G band are likely to be contaminated by Milky Way dust, so that this may be interpreted as an upper limit on the uniformity.

Figure 14.

Figure 14. Offset map (left) and histogram (right) of the difference between the predicted Gaia G band (from the DES r band) and the observed Gaia G band for stars with $0.5\lt (g-i)\lt 1.5$, in pixels of HEALPIX NSIDE = 256. Structure caused by calibration and depth issues from both surveys at small and large scales can be seen. A Gaussian fit with $\sigma =6.6\,\mathrm{mmag}$ (black hashed curve) is shown on the histogram plot; overflow bins are not plotted.

Standard image High-resolution image

5.4. Linearized Chromatic Corrections

The FGCM uses linearized chromatic correction (Equation (16)) to compute the standard magnitudes of calibration stars during the fitting stage. Every evaluation of the ${\chi }^{2}$ requires these to be recomputed, and the fully integrated correction is computationally too slow to use for this purpose. We discuss in this section both the size of the fully integrated correction and the accuracy of the linear approximation for the stellar SEDs used in the fit. Note that this does not address the accuracy of the calibration fit parameter vectors, only the robustness of the linear computations.

To examine the accuracy of the linear approximation, we use the stellar spectral library of Kelly et al. (2014), which combines SDSS spectra (Aihara et al. 2011) and the Pickles spectral library (Pickles 1998). For each template star, we synthesize colors by integrating the SED with the standard FGCM passbands. We then randomly sample 50,000 exposures/CCD pairs from Y3A1 observing, and compute the chromatic correction for each in two ways. These are shown in Figures 1517 for a sample blue star, middle-color star, and red star, respectively.

Figure 15.

Figure 15. Chromatic corrections (red) and residuals for linearized corrections (dashed blue) for blue stars with $g-i\sim 0.5$.

Standard image High-resolution image
Figure 16.

Figure 16. Chromatic corrections (red) and residuals for linearized corrections (dashed blue) for stars with $g-i\sim 1.5$.

Standard image High-resolution image
Figure 17.

Figure 17. Chromatic corrections (red) and residuals for linearized corrections (dashed blue) for red stars with $g-i\sim 3.0$.

Standard image High-resolution image

We first integrate the stellar spectrum with the passband for each exposure and CCD combination. These are plotted with red solid histograms in the figures and can be taken as estimates of the systematic chromatic offset that needs to be included in the computation of the magnitude. These offsets vary from as little as $1\mbox{--}2\,\mathrm{mmag}$ (e.g., i- or z-band observations of blue stars) to as much as $40\mbox{--}50\,\mathrm{mmag}$ (e.g., g-band observations of red stars). As discussed further in Appendix C, the chromatic corrections are dominated by instrumental effects in the r and i bands, by water vapor variation in the z band, and by a mix of instrumental and atmosphere effects in the g band.

We next use the synthetic colors to estimate the linearized correction as done during the FGCM calibration (Equation (16)). The residual of the linearized correction is shown with the blue dashed histograms in the figures. The median offset and rms estimated via median absolute deviation is also shown. The linearized corrections reduce the residual error by factors of 2 to 10. In most cases, the linearized correction reduces the systematic chromatic error to an rms of $\sim 2\,\mathrm{mmag}$, though in some cases (particularly in the g band for the reddest stars with $g-i\sim 3.0$) the residuals have an rms of $\sim 5\,\mathrm{mmag}$. These systematic uncertainties are reasonably well matched to the overall precision of the FGCM calibration.

While the previous analysis applies to single observations (as is the case with transients such as supernovae), the impact of the linearized residuals on co-add (average) magnitudes should be smaller if the corrections are uncorrelated. To test this, we start by computing the mean color of each calibration star with no corrections. After the g − i color is computed, we match this to the closest match in the Kelly et al. (2014) spectral library. Chromatic corrections are then computed using the matched spectrum. We then compute the offset between the co-add average magnitudes using the linearized corrections and the integrated corrections for blue, middle, and red stars as above. Figure 18 shows a map of these offsets over the footprint (left panel) and a histogram of residuals (right panel) for red stars in the g band. The linearized residuals for these stars are fit well by a Gaussian with $\sigma =2\,\mathrm{mmag}$. As can be seen in Figure 17, this case has the largest co-add residuals. The residuals from the linearized corrections are $\lt 0.7\,\mathrm{mmag}$ for every other band/color combination; this validates our assumption that use of the linearized correction in the fit does not produce significant loss of precision.

Figure 18.

Figure 18. Offset map (left) and histogram (right) of the difference between the spectral-integration corrected co-add stellar magnitudes and the linearized approximation of the correction for red stars in the g band. While the Gaussian σ of the residuals from the linearized corrections is $\sim 2\,\mathrm{mmag}$ for this band/color combination, all other combinations have residuals of $\lt 0.7\,\mathrm{mmag}$. The honeycomb pattern apparent in the plot is due to the bandpass dependence on focal-plane position.

Standard image High-resolution image

6. FGCM Data Products

The FGCM fit yields a catalog of parameters ${{\boldsymbol{P}}}^{\mathrm{inst}}$ (Equation (19)) and ${{\boldsymbol{P}}}^{\mathrm{atm}}$ (Equation (26)) from which it is possible to compute detailed passbands for observations taken on calibratable nights. It also yields a catalog of reference stars with well-determined grizY magnitudes in the FGCM standard system. Both of these catalogs are important products of the FGCM procedure that can be used in a wide range of science analyses.

The FGCM also produces zeropoints to CCD images from Y3A1 exposures in the initial query. These zeropoints are defined to specifically calibrate object magnitudes as measured in the DESDM FINALCUT processing. These zeropoints can be used to correct single-epoch images for studies of transient phenomena or the construction of multi-epoch co-add images and catalogs.

6.1. FGCM Process Flags

The assignment of values to FGCM data products follows one of several paths identified by the parameter ${\mathrm{FLAG}}^{\mathrm{FGCM}}$ summarized in Table 5 and detailed in this section. Data acquired from griz calibration exposures are given ${\mathrm{FLAG}}^{\mathrm{FGCM}}=1$, while data from Y-band calibration exposures are given ${\mathrm{FLAG}}^{\mathrm{FGCM}}=2$. Data from exposures that are not deemed to have been taken in photometric conditions, but that were taken on calibratable nights, are in the ${\mathrm{FLAG}}^{\mathrm{FGCM}}=4$ category. These first three categories comprise the exposures taken on calibratable nights that are themselves calibratable; 90.5% of the exposures on the Y3A1 demand list are in one of these categories. Objects observed on these exposures will have valid ${m}^{\mathrm{std}}$ values with accurate chromatic correction.

Table 5.  FGCM Calibration Quality Flags

${\mathrm{FLAG}}^{\mathrm{FGCM}}$ Y3A1 Description
  Exposures (%)  
1 77.7 CCD image on a griz calibration exposure (% of griz exposures)
2 76.0 CCD image on a Y calibration exposure (% of Y exposures)
4 13.2 CCD image taken on a calibratable night, but not calibration exposure
8 0.4 CCD image recovered on a night with no calibration fit
16 2.9 Unable to assign data products
33–36 6.1 CCD image on a calibratable night; unable to estimate gray correction
Any 100.0 All CCD images on all exposures

Download table as:  ASCIITypeset image

There are a few individual CCD images that have a large number of calibration stars, but these were taken on nights with no calibration fit. These are ${\mathrm{FLAG}}^{\mathrm{FGCM}}=8$ entries and might be useful for some science cases, although the chromatic corrections are purely instrumental. A few percent of Y3A1 exposures that are in the initial demand list are found to be of too poor photometric quality to complete a calibration; these are the ${\mathrm{FLAG}}^{\mathrm{FGCM}}=16$ entries. Finally, there are also a number of CCD images that were acquired on a calibratable night, but contain too few calibration stars to determine reliable "gray" corrections. These individual CCDs are retained as ${\mathrm{FLAG}}^{\mathrm{FGCM}}={\mathrm{FLAG}}^{\mathrm{FGCM}}+32$ for completeness, but are not deemed science quality.

6.2. FGCM Zeropoints and Linear Chromatic Correction

With sufficient knowledge of the SED of the target source, it is possible to compute the full chromatic correction for observations taken on calibrated nights (${\mathrm{FLAG}}^{\mathrm{FGCM}}=1,2\,\mathrm{or}\,4$) using the fit parameter vectors. However, the linear approximation to the chromatic correction can be easily implemented and is sufficient for many applications. The FGCM provides calibration data products for both the fully integrated and linearized corrections that are discussed in this section.

A calibrated measurement (on exposure number $\mathrm{EXP}$ and sensor $\mathrm{CCD}$) of the ${m}_{b}^{\mathrm{std}}$ magnitude of a celestial object can be computed as (cf., Equation (16))

Equation (38)

where ${m}_{b}^{\mathrm{inst}}$ is the instrumental magnitude computed by DESDM from source and background ADU counts, nightly flats, and star-flat corrections. The zeropoint ${\mathrm{ZPT}}^{\mathrm{FGCM}}$ is computed from the integral of the observing passband ${{\mathbb{I}}}_{0}^{\mathrm{obs}}$ as in Equation (4), and for reasons of flexibility includes the exposure time normalization

Equation (39)

The passband integral ${{\mathbb{I}}}_{0}^{\mathrm{obs}}(\mathrm{EXP},\mathrm{CCD})$ is computed as in Equations (17) and (18):

Equation (40)

and the "gray" correction ${\mathrm{ZPT}}^{\mathrm{gray}}$ is described in the following section.

The normalized chromatic integral ${{\mathbb{I}}}_{10}^{\mathrm{FGCM}}(\mathrm{EXP},\mathrm{CCD})$ is similarly defined:

Equation (41)

with the cancellation of the superstar and optics terms that do not depend on wavelength. This integral is approximated via the LUTs described in Section 3.4.

6.3. FGCM Gray Corrections

The FGCM takes advantage of the extensive network of calibration stars with well-determined magnitudes to correct for residual errors due to effects not included in the fit model. With no guidance on the possible wavelength dependence of such failures, the algorithm uses the "gray" parameters computed after the last cycle of the fitting process (Section 4.2). The FGCM gray zeropoint correction, ${\mathrm{ZPT}}^{\mathrm{gray}}$, is determined from the stars on the CCD whenever possible, an estimate from other CCDs on the same exposure will be used as a second choice, and as a last resort ${\mathrm{FLAG}}^{\mathrm{FGCM}}$ will be set to ${\mathrm{FLAG}}^{\mathrm{FGCM}}+32$.

For each CCD image, we compute ${\mathrm{CCD}}^{\mathrm{gray}}$ and ${\sigma }^{\mathrm{phot}}(\mathrm{CCD})$ as described in Equations (31) and (32). On CCD images with at least five calibration stars and ${\sigma }^{\mathrm{phot}}(\mathrm{CCD})\lt 5\,\mathrm{mmag}$, we assign the CCD estimate to the zeropoint gray value:

Equation (42)

It is possible for a CCD image to contain few, if any, calibration stars even though the entire exposure may contain CCD images with many stars (e.g., CCD images on exposures taken at the edges of the DES footprint). In this case, we compute ${\mathrm{EXP}}^{\mathrm{gray}}(\mathrm{EXP})$ and ${\mathrm{VAR}}^{\mathrm{gray}}(\mathrm{EXP})$ as in Equations (33) and (34). If there are at least five CCDs with valid ${\mathrm{CCD}}^{\mathrm{gray}}$ values and variance ${\mathrm{VAR}}^{\mathrm{gray}}\,\lt {0.005}^{2}$, then we assign the exposure estimate to the zeropoint gray value:

Equation (43)

No explicit limit is placed on the size or sign of the ${\mathrm{ZPT}}^{\mathrm{gray}}$ correction. If both attempts fail, then the CCD image will be uncorrected for gray extinction, and the value of ${\mathrm{FLAG}}^{\mathrm{FGCM}}$ will be increased by 32.

We note that application of the ${\mathrm{ZPT}}^{\mathrm{gray}}$ correction reduces to the traditional use of a catalog of "standard stars" to estimate residual errors in the calibration fit; in this case, the standard catalog is created by the FGCM fitting step itself. It relies on the presence of a sufficient number of "photometric" observations of these stars in the fitted data sample to provide the needed reference magnitudes. No chromatic correction can be attached to a gray correction, but the retrieved chromatic integrals discussed in Appendix B might usefully flag cases that have significant residual chromatic effects; we have not yet studied this possibility in detail.

6.4. FGCM Calibration Errors

The FGCM assigns an error to the zeropoint ${\mathrm{ZPT}}^{\mathrm{FGCM}}$ (Equation (39)) that includes contributions from the error in ${{\mathbb{I}}}_{0}$ from the global calibration fit and from the error in the gray correction ${\mathrm{VAR}}^{\mathrm{ZPT}}$ computed for each CCD image. If ${\mathrm{ZPT}}^{\mathrm{gray}}$ is derived directly from ${\mathrm{CCD}}^{\mathrm{gray}}$, then the error in the gray correction is computed solely from photon statistics ${\mathrm{VAR}}^{\mathrm{ZPT}}={\sigma }^{\mathrm{phot}}{(\mathrm{EXP},\mathrm{CCD})}^{2}$ (Equation (32)). If it is derived from the average of other CCD images on the exposure, then ${\mathrm{VAR}}^{\mathrm{ZPT}}={\mathrm{VAR}}^{\mathrm{gray}}(\mathrm{EXP})$ (Equation (34)). Note that spatial structure in the residual errors on scales below the size of a CCD will not be included in this estimate.

With the assumption previously discussed that the random errors in the FGCM fit parameters from each tiling of the footprint are independent, the random error in ${\mathrm{ZPT}}^{\mathrm{FGCM}}$ can be estimated,

Equation (44)

where the global fit error is $\delta \mathrm{FGCM}(b)$ (Equation (36)) and ${N}_{\mathrm{tile}}(\mathrm{EXP},\mathrm{CCD})$ is the average number of observations in band b per calibration star found on the CCD image (Equation (37)). The ${\sigma }_{0}^{\mathrm{ZPT}}$ systematic control term is again set to $3\,\mathrm{mmag}$. As discussed in Section 4.2, exposures used in the calibration fit (i.e., ${\mathrm{FLAG}}^{\mathrm{FGCM}}\lt =2$) were selected to have little, if any, gray extinction, so the ${\sigma }^{\mathrm{ZPT}}$ values for these exposures are typically $5\,\mathrm{mmag}$ or less. While the ${\mathrm{ZPT}}^{\mathrm{gray}}$ corrections averaged over the focal plane can be equally accurate, errors in magnitudes measured on non-photometric exposures (i.e., ${\mathrm{FLAG}}^{\mathrm{FGCM}}\gt =4$) can be significantly larger.

Shown in Figures 19 through 21 are the calibration errors ${\sigma }^{\mathrm{ZPT}}$ averaged over exposures with ${\mathrm{FLAG}}^{\mathrm{FGCM}}\lt =\,4$ in HEALPIX pixels across the full DES footprint that would be typical of the Y3A1 co-add catalog. We show only the g, i, and Y bands as examples, as the r and z bands look very similar. The structure seen in these plots is primarily due to correlations in the varying number of tilings of regions on the sky. For example, the supernova fields can be readily identified as individual DECam focal-plane footprints with estimated errors near $3\,\mathrm{mmag}$ (the error floor set by ${\sigma }_{0}^{\mathrm{ZPT}}$) in the griz bands.

Figure 19.

Figure 19. Average calibration error ${\sigma }^{\mathrm{ZPT}}$ in the g band for catalog average stellar magnitudes found on exposures with ${\mathrm{FLAG}}^{\mathrm{FGCM}}=1$ or ${\mathrm{FLAG}}^{\mathrm{FGCM}}=4$, similar to the selection for the Y3A1 co-add catalog. The averages are binned at HEALPIX NSIDE = 256. The white region in the south was originally part of the DES footprint definition but was eliminated to improve observing efficiency.

Standard image High-resolution image
Figure 20.

Figure 20. Same as Figure 19, for the i band.

Standard image High-resolution image
Figure 21.

Figure 21. Same as Figure 19, for the Y band for exposures with ${\mathrm{FLAG}}^{\mathrm{FGCM}}=2$ or ${\mathrm{FLAG}}^{\mathrm{FGCM}}=4$.

Standard image High-resolution image

7. Summary: Y3A1 and Beyond

We have presented a "Forward Global Calibration Method (FGCM)" for the photometric calibration of wide-field surveys, and we have presented results of its application to the first three years of the DES survey. The FGCM combines data taken with auxiliary instrumentation at the observatory with data from the broadband survey imaging itself and models of the instrument and atmosphere to estimate the spatial and time dependence of the passbands of individual DES survey exposures. "Standard" passbands that are typical of the individual passbands encountered during the survey campaign have been chosen. The passband of any individual flux observation is combined with an estimate of the source spectral shape to yield magnitudes ${m}_{b}^{\mathrm{std}}$ in the standard system. This "chromatic correction" to a standard system is necessary to achieve many DES scientific goals.

The FGCM achieves reproducible and stable photometric calibration of standard magnitudes ${m}_{b}^{\mathrm{std}}$ of stellar sources over the multiyear DES Y3A1 data sample with residual random calibration errors $\sigma \approx 6\mbox{--}7\,\mathrm{mmag}$ per exposure (Table 4). The accuracy of the calibration is uniform across the 5000 square degree DES footprint to within $\sigma =7\,\mathrm{mmag}$ (Figure 14). The systematic uncertainty of magnitudes in the standard system due to the spectrum of the source is less than $5\,\mathrm{mmag}$ for main-sequence stellar spectra with $0.5\lt g-i\lt 3.0\,\mathrm{mag}$ (Section 5.4). A catalog of standard stars with well-known magnitudes in the DES standard system, as well as atmosphere models for each exposure that allow the computation of corrections of measured magnitudes to the standard system, is created with the FGCM procedure.

Continued analysis of the calibration of the DES Y3A1 data set has pointed to several improvements that we anticipate installing in the FGCM in the future:

  • 1.  
    We anticipate that incorporation of the aTmCAM data into the FGCM fit will yield better reconstruction of the atmospheric conditions encountered during the survey.
  • 2.  
    The selection of calibration objects at present does not attempt to remove variable sources (stars or quasars). Errors introduced into the calibration by such objects are presently included in our performance metrics. While most DES images contain enough stars to realize some reduction in the average impact of these objects, they may contribute especially to populations in the non-Gaussian tails of the residual distributions. Known variable stars can be easily eliminated from the sample, and relatively simple cuts based on light curves observed by DES can be implemented to remove more of these objects.
  • 3.  
    The FGCM does not include any direct accounting of residual errors in the assignment of ADU counts to sources, due to errors in the determination of the image point-spread function (PSF) and variability of optical "seeing." A first analysis of the correlations between observed PSF values and residual photometric errors indicates these effects are typically less than the $3\,\mathrm{mmag}$ control values used in the FGCM evaluations, but in poor observing conditions can be worse. Moreover, the DES strategy selects targets and filter bands based on observing conditions, and so may introduce systematic bias in the calibration. At present, these errors are corrected only as part of the ${\mathrm{ZPT}}^{\mathrm{gray}}$ component in the ${\mathrm{ZPT}}^{\mathrm{FGCM}}$ values. A correction based on the PSF measured on each exposure and applied within the fitting cycle (e.g., as the superstar flats presently are) can eliminate most of this effect and improve the convergence of the fit.
  • 4.  
    The transmission of out-of-band flux through the DECam optical filters is observed in the ${S}_{b}^{\mathrm{DECal}}(\lambda )$ scans at the level of $\lesssim 0.1 \% $. This flux contributes to the observed broadband ADU counts. The FGCM ${{\mathbb{I}}}_{0}$ and ${{\mathbb{I}}}_{1}$ integrals are all computed over the wavelength interval from $3800\,{\rm{\mathring{\rm A} }}$ to $11000\,{\rm{\mathring{\rm A} }}$, so they include this transmission to the extent that it is captured in the ${S}_{b}^{\mathrm{DECal}}(\lambda )$ data. Full detailed DECal scans are time consuming, however, and known errors in the existing scans introduce noise in the FGCM relative calibration. Although this noise is properly included in the FGCM Y3A1 performance metrics given in this report, these errors will particularly affect chromatic corrections for non-stellar spectra and will complicate the interpretation of absolute calibrations of the passbands. We will acquire more accurate DECal scans over the out-of-band regions for the analyses of these effects.
  • 5.  
    The FGCM uses the MODTRAN atmospheric transmission code to compute both the fit model and corrections to observed broadband magnitudes. For the work here, computations were done with outputs smoothed with a resolution of 1 nm (Gaussian FWHM). Comparisons with other resolutions and codes will be done to determine the sensitivity of the calibration to the underlying computational methods for targets with SEDs of various types.
  • 6.  
    Although not offering an improved performance of the calibration, there is a simplification that can be made in the parameterization of the DES passbands. If we define ${\lambda }_{b}$ (Equation (12)) with the standard passband (including the atmosphere) rather than with the instrumental passband, then ${{\mathbb{I}}}_{10}^{\mathrm{std}}\equiv 0$ and would thus simplify Equation (16). The magnitudes of the chromatic corrections are identical, provided ${{\mathbb{I}}}_{10}^{\mathrm{obs}}$ and ${{\mathbb{I}}}_{10}^{\mathrm{std}}$ are defined consistently, so the final results of the calibration are unchanged, but the formalism becomes more elegant.

Finally, we note that the concepts and techniques presented here will be even more powerful when applied to future data that will be obtained with the LSST. The wide field of view and rapid cadence of the LSST survey will provide extremely fine and detailed sampling of observing conditions, and the auxiliary instrumentation planned for the LSST observing site is designed to provide accurate determinations of changing passbands. The LSST data set may be particularly well suited to the implementation of some form of the exposure-by-exposure retrieval process discussed in Appendix B of this paper.

The authors thank the staff of the Cerro Tololo Inter-American Observatory for their expert and continuous support of the DES observing campaign. This work is supported in part by the U.S. Department of Energy contract to SLAC No. DE-AC02-76SF00515.

Funding for the DES Projects has been provided by the U.S. Department of Energy, the U.S. National Science Foundation, the Ministry of Science and Education of Spain, the Science and Technology Facilities Council of the United Kingdom, the Higher Education Funding Council for England, the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign, the Kavli Institute of Cosmological Physics at the University of Chicago, the Center for Cosmology and Astro-Particle Physics at the Ohio State University, the Mitchell Institute for Fundamental Physics and Astronomy at Texas A&M University, Financiadora de Estudos e Projetos, Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro, Conselho Nacional de Desenvolvimento Científico e Tecnológico and the Ministério da Ciência, Tecnologia e Inovação, the Deutsche Forschungsgemeinschaft, and the Collaborating Institutions in the Dark Energy Survey.

The Collaborating Institutions are Argonne National Laboratory, the University of California at Santa Cruz, the University of Cambridge, Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas-Madrid, the University of Chicago, University College London, the DES-Brazil Consortium, the University of Edinburgh, the Eidgenössische Technische Hochschule (ETH) Zürich, Fermi National Accelerator Laboratory, the University of Illinois at Urbana-Champaign, the Institut de Ciències de l'Espai (IEEC/CSIC), the Institut de Física d'Altes Energies, Lawrence Berkeley National Laboratory, the Ludwig-Maximilians Universität München and the associated Excellence Cluster Universe, the University of Michigan, the National Optical Astronomy Observatory, the University of Nottingham, The Ohio State University, the University of Pennsylvania, the University of Portsmouth, SLAC National Accelerator Laboratory, Stanford University, the University of Sussex, Texas A&M University, and the OzDES Membership Consortium.

The DES data management system is supported by the National Science Foundation under grant number AST-1138766. The DES participants from Spanish institutions are partially supported by MINECO under grants AYA2012-39559, ESP2013-48274, FPA2013-47986, and Centro de Excelencia Severo Ochoa SEV-2012-0234. Research leading to these results has received funding from the European Research Council under the European Unions Seventh Framework Programme (FP7/2007-2013) including ERC grant agreements 240672, 291329, and 306478.

Facility: BLANCO 4.0 m/DECam - .

Appendix A: Estimation of the SED Slope

To complete the construction of a standard magnitude, we need a prescription for the computation of the derivative of the SED of the source. We note that, if the passbands are flat or narrow in wavelength, then we can approximate (though not rigorously)

Equation (45)

We compute the slopes of the SED at the boundaries between bands as

Equation (46)

These lead to approximations for the slopes of the SED across the passbands:

Equation (47)

The "fudge factors" (−1.00, 0.50, and 1.00) are used for the bands at the end of the spectrum to accommodate extrapolation across passbands that are neither flat nor narrow. The empirical determination of these factors and the accuracy of Equations (47) are discussed in Appendix B.

Appendix B: FGCM Chromatic Corrections and Retrieval

We discuss in this appendix a method to retrieve the chromatic integrals ${{\mathbb{I}}}_{0}$ and ${{\mathbb{I}}}_{1}$ for individual exposures given a sufficiently large set of well-calibrated stars. This method might be used retroactively to improve the temporal frequency of a calibration done initially on a nightly basis such as has been done for Y3A1. It is possible to extract the value of the two passband integrals for each individual exposure from the behavior of the observed flux produced by stars of different colors. This is highlighted in Figure 22, which shows the dependence of the chromatic corrections made in the Y3A1 calibration for stars of differing colors on two z-band exposures, with high and low PWV values.

Figure 22.

Figure 22. Dependence of the chromatic corrections for stars of differing colors. In this example, two z-band exposures were chosen, one with high $\mathrm{PWV}$ (red circles), and one with low $\mathrm{PWV}$ (blue squares). The signature of the water vapor absorption on the red end of the z band is apparent in the large shift in observed magnitudes that depends on the star color.

Standard image High-resolution image

We start with the best estimates of the magnitudes of the calibration stars available from the FGCM fit. Then, we define the raw uncalibrated instrumental magnitude for star j observed on exposure i,

Equation (48)

and the retrieval parameter

Equation (49)

Equation (16) can be used to find

Equation (50)

Consider the integrals of the observing passbands as unknown in this linear equation, and minimize the sum over calibration stars j on exposure i:

Equation (51)

where $\mathrm{RHS}$ is the right-hand side of Equation (50), and ${\sigma }_{f}$ is an estimated error for the value of the retrieval parameter ${f}^{\mathrm{obs}}$. A prescription for the evaluation of the appropriate derivatives of the SED is given in Appendix A.

The range of colors of the calibration stars on each exposure is generally large enough to project out reasonable determinations of the chromatic integral ${{\mathbb{I}}}_{1}^{\mathrm{obs}}$, which we denote by ${{ \mathcal R }}_{1}$. The chromatically retrieved ${{ \mathcal R }}_{1}$ values are compared in Figure 23 with those computed directly from the FGCM nightly fit parameters. The variation in ${{\mathbb{I}}}_{1}$ in the g band is determined by a mix of instrumental and atmosphere properties, the variation in the z band is determined by varying water vapor, and the r- and i-band variations are almost purely instrumental. The "fudge factors" given in Appendix A were determined to minimize the differences between the ${{\mathbb{I}}}_{1}$ and ${{ \mathcal R }}_{1}$ values in these plots. Although the two values being compared in the figure are not independent of each other, the good agreement confirms that the chromatic corrections are indeed made consistently. When projected to histograms, the differences between the two values are found to be typically ∼0.5 or less, which corresponds to differences below 5 mmag in the chromatic correction. Although the FGCM fit does not make direct use of the retrieved values, we note that it includes this information intrinsically as the ${\chi }^{2}$ function (Equation (27)) is sensitive to the colors of the calibration stars.

Figure 23.

Figure 23. Comparison of ${{\mathbb{I}}}_{1}$ from direct fits and those obtained by chromatic retrieval (${{ \mathcal R }}_{1}$), with each photometric exposure/CCD contributing to the plot. The size of the effect of the chromatic terms depends on the SED. The right axis shows the implied change in magnitude between a red star with $g-i\sim 3.0$ and a blue star with $g-i\sim 0.6$ for the assoiated chromatic term.

Standard image High-resolution image

Appendix C: Atmospheric Color Terms

While the total atmospheric extinction (${{\mathbb{I}}}_{0}$) is strongly dependent on airmass, as discussed in Li et al. (2016, see their Section 3.1), we expect there to be a color–airmass atmospheric extinction coefficient, especially at the bluer bands (Henden & Kaitchuck 1990). In this appendix, we investigate the size of this term in the FGCM solution for DES Y3.

In Figure 24, we show the model and retrieved chromatic passband integrals (${{\mathbb{I}}}_{1}$ and ${{ \mathcal R }}_{1}$) as a function of airmass for the griz bands. As mentioned previously, the vertical spread in the plot is primarily due to instrumental effects for gri and varying water vapor in z. However, there is a correlation with airmass that is small but noticeable at the few mmag level in the g and z bands. Although much noisier, the same trend is apparent to the eye in the right panel for the retrieved integrals. Figure 25 shows the residual between the retrieved and model chromatic integrals. As with Figure 23, it is clear that the FGCM model successfully predicts the color response of the stars on individual CCDs, in addition to the response as a function of airmass.

Figure 24.

Figure 24. Left: FGCM model chromatic passband integral (${{\mathbb{I}}}_{1}$) as a function of airmass for the griz bands. As in Figure 23, the right axis shows the implied change in magnitude between a red star with $g-i\sim 3.0$ and a blue star with $g-i\sim 0.6$ for the assoiated chromatic term. The vertical spread at fixed airmass is due to instrumental effects for gri and varying water vapor in z. The airmass term is small but noticeable in the g and z bands. Right: FGCM-retrieved chromatic passband integral (${{ \mathcal R }}_{1}$) as a function of airmass for griz bands. Although noisy, a slight trend with airmass in the g and z bands is apparent.

Standard image High-resolution image
Figure 25.

Figure 25. Residual between model and retrieved chromatic passband integral (${{\mathbb{I}}}_{1}-{{ \mathcal R }}_{1}$) as a function of airmass for the griz bands. The FGCM model successfully predicts both the instrumental and airmass terms.

Standard image High-resolution image

Appendix D: Initial Preparations

D.1. FINALCUT Queries

The DESDM software package accepts raw DECam exposures and produces "FINALCUT" catalogs of observed quantities for each object detected on science exposures. A set of quality cuts is applied to eliminate exposures on which one or more of a number of recognizable hardware failures occurred or that were taken through easily detectable cloud cover. The exposures selected for Y3A1 include wide-field survey and supernova fields, but no standard-star observations. A control log that drives the calibration process is then created.

A query (SQL) of the DESDM FINALCUT catalogs is done to make an initial selection of observations that are candidates to be used in the FGCM calibration. This query requires (Source Extractor data products are indicated in capital letters):

  • 1.  
    SExtractor flag = 0 (objects that were not deblended, saturated, or had other processing problems).
  • 2.  
    The object image is not within 100 pixels of any CCD sensor edge.
  • 3.  
    A successful MAG_PSF fit with 0.001 < MAGERR_PSF < 0.100 mag (no explicit cut is made on the instrumental magnitude).
  • 4.  
    Selection of stellar sources with CLASS_STAR > 0.75 and −0.003 < SPREAD_MODEL < 0.003.

D.2. Initial Selection of Calibration Stars

The following process is used to identify candidate calibration stars:

  • 1.  
    Remove observations that were "blacklisted" by DESDM due to known instrumental or imaging problems.
  • 2.  
    Select i-band observations and identify star candidates from detections that are within 1 arcsec of each other.
  • 3.  
    Remove candidates that have another candidate within 2 arcsec separation.
  • 4.  
    Randomly remove candidates to limit the density of stars to approximately one per square arcmin as found at the south Galactic Cap; HEALPIX (NSIDE = 128) is used in this step.
  • 5.  
    Seek observations in the remaining grzY bands that match an i-band candidate.
  • 6.  
    Identify candidate griz calibration stars as those with at least two observations in each of the four bands.
  • 7.  
    Identify the subset of griz calibration stars that also have two observations in the Y band.

A catalog of grizY FINALCUT observations of candidate calibration stars is created for use during the FGCM calibration process that follows.

Appendix E: Selections of Calibration Stars, Calibration Exposures, and "Calibratable" Nights

On the initial FGCM fit cycle, estimates of the magnitude of each object j in each of the griz bands are made by computing the observed TOA magnitudes ${m}_{b}^{\mathrm{obs}}(i,j)$ (Equation (4)) with the parameters for the standard atmosphere in Table 1. The average value $\overline{{m}_{b}^{\mathrm{obs}}(j)}$ of all observations of that object that are within 0.10 mag of the brightest is then computed. If there is not at least a second observation in each band within this tolerance of the brightest, then the object is removed from the calibration star catalog. On subsequent cycles, calibration stars are required to have been observed on at least two calibration exposures in each of the griz bands in the previous fit cycle.

Loose color cuts are applied to eliminate objects far off the stellar locus or simply mismeasured:

  • 1.  
    −0.25 < g − r < 2.25
  • 2.  
    −0.50 < r − i < 2.25
  • 3.  
    −0.50 < i − z < 1.00

An estimate is made of the "gray" extinction of each observation of each calibration star using Equation (30). These values are used to choose calibration exposures and calibratable nights. On the initial FGCM fit cycle, calibration exposures are chosen by requiring that:

  • 1.  
    There are at least 600 calibration stars visible in the exposure.
  • 2.  
    The estimated mean gray extinction of the calibration stars observed on the exposure is less than 0.250 mag.
  • 3.  
    The variance of the gray extinction of the calibration stars observed on the exposure is less than 0.025 mag2.

On subsequent cycles, the more sophisticated analysis of the individual CCD images detailed in Section 4.2 is used to define the mean and variance of the gray extinction.

An observing night is classified "calibratable" if:

  • 1.  
    There were at least 10 calibration exposures on that night.
  • 2.  
    The variance of the gray extinction of all calibration exposures on that night is less than 0.100 mag2.

There is no requirement that any particular fraction of a night be deemed "photometric," and non-photometric exposures can be taken on a "calibratable" night.

Calibration stars for the Y band are identified as the subset of griz calibration stars that also are found on least two Y-band calibration exposures. Calibration Y-band exposures are chosen with the same criteria used to select griz calibration exposures, but the Y-band exposures are not used in the FGCM fit. A separate sequence of analysis cycles is carried out using the griz fit parameters to identify the final set of Y-band calibration exposures used to determine magnitudes for Y-band calibration stars.

Footnotes

Please wait… references are loading.
10.3847/1538-3881/aa9f22