The Sloan Digital Sky Survey Quasar Catalog: Sixteenth Data Release
Brad W. Lyke, Alexandra N. Higley, J. N. McLane, Danielle P. Schurhammer, Adam D. Myers, Ashley J. Ross, Kyle Dawson, Solène Chabanier, Paul Martini, Nicolás G. Busca, Hélion du Mas des Bourboux, Mara Salvato, Alina Streblyanska, Pauline Zarrouk, Etienne Burtin, Scott F. Anderson, Julian Bautista, Dmitry Bizyaev, W. N. Brandt, Jonathan Brinkmann, Joel R. Brownstein, Johan Comparat, Paul Green, Axel de la Macorra, Andrea Muñoz Gutiérrez, Jiamin Hou, Jeffrey A. Newman, Nathalie Palanque-Delabrouille, Isabelle Pâris, Will J. Percival, Patrick Petitjean, James Rich, Graziano Rossi, Donald P. Schneider, Alexander Smith, M. Vivek, Benjamin Alan Weaver
I Introduction
The Sloan Digital Sky Survey (SDSS) has a long history of creating and releasing catalogs of quasars for use in cosmology and studies of quasar physics. SDSS spectroscopically observed 105,783 quasars released between the first (Schneider et al. 2002) and final (Schneider et al. 2010) quasar catalogs of the SDSS legacy programs (SDSS-I/II). When the third iteration of SDSS observations (Eisenstein et al. 2011, SDSS-III;) began, the combination of a new spectroscopic instrument, a new focus on quasar programs, extra fibers for spectroscopy, and the discontinuation of imaging observations, significantly increased the number of quasars that were observed. Over the course of the SDSS Baryon Oscillation Spectroscopic Survey (Dawson et al. 2013, BOSS;) program, three quasar catalogs were released: DR9Q, DR10Q, and DR12Q (Pâris et al. 2012; Pâris et al. 2014; Pâris et al. 2017), with the final BOSS quasar catalog, DR12Q, containing 297,301 quasars. DR12Q also contained data from external catalogs in other wavelength ranges, multiple redshift estimates, and broad emission line parameters. DR14Q (Pâris et al. 2018) was the first quasar catalog released as part of SDSS-IV quasar program, containing 526,356 quasars. In this paper, we release the final quasar catalog of the SDSS-IV quasar program, the extended Baryon Oscillation Spectroscopic Survey (Dawson et al. 2016, eBOSS;). This catalog, which we will refer to as DR16Q, contains 920,110 observations of 750,414 quasars. Comparisons of DR16Q to previous quasar catalogs are limited to DR12Q and DR7Q, as these represent the final quasar catalogs accompanying each iteration of SDSS.
One of the primary objectives of eBOSS was to constrain the angular scale of baryon acoustic oscillations (BAO) in tracers of the distribution of matter (Eisenstein et al. 2005; Cole et al. 2005, for detection see). To achieve the planned precision of 2.8% on the angular diameter distance, , and 4.2% on the Hubble Parameter, , at , eBOSS was designed to obtain spectra for a set of 500,000 quasars in the redshift range (Dawson et al. 2016). This represented more than a fivefold increase in the number of quasars for that redshift range, as compared to the final BOSS quasar catalog, DR12Q. With the final eBOSS observations complete, DR16Q comprises 480,459 quasars within the redshift range . To constrain BAO measurements at higher redshift, eBOSS also planned to observe 120,000 quasars at , increasing the precision on and from Ly forest measurements by a factor of 1.44. DR16Q includes 239,081 Ly quasars, a 25% increase over DR12Q.
While the primary objectives of eBOSS and other SDSS-IV programs informed the target selection for quasars in DR16Q (see §II.2), eBOSS quasar catalogs have been used in a number of other recent research studies beyond the eBOSS core programs. These include, but are certainly not limited to: The study of changing-look quasars, which can be used to investigate accretion mechanisms and other quasar physics (Sheng et al. 2020); X-ray studies of the clustering of quasars, which can also give insight into the growth and evolution of supermassive black holes (Powell et al. 2020); studies of the correlation between X-ray and emission line luminosities (Timlin et al. 2020); studies of quasar outflows in the far infrared and radio bands via follow-up of optically confirmed quasars (Hall et al. 2019); studies of the correlation of outflow velocities with bolometric luminosity in Broad Absorption Line (BAL) quasars (Bruni et al. 2019); and studies of the variability in BAL troughs over time (Grier et al. 2016; McGraw et al. 2017). To help facilitate these sorts of quasar studies, DR16Q includes multiple redshift estimates, BAL and damped Ly (DLA) quasar identifications, and compiled multi-wavelength data.
Previous iterations of SDSS quasar catalogs have included redshifts from automated classification pipelines, visual inspections, and principal component analysis (PCA) based on prominent quasar emission lines. In this tradition, DR16Q includes a range of redshift estimates that are characterized by different accuracies, precisions, and levels of homogeneity (see §IV for more details). Most importantly, we have visually inspected 329,130 quasars in the catalog, with 326,535 of these having confident visual classifications and redshifts. Our set of visual inspections also includes the results from a random subsample of 10,000 eBOSS quasar targets. We visually inspected this random subsample and included inspections of different observations of the same quasar to characterize the accuracy and precision of automated redshift algorithms that are also presented in this catalog (again see §IV for more information).
This study is part of a coordinated release of the final eBOSS measurements of BAO and redshift space distortions (RSD) in the clustering of luminous red galaxies (LRG) (Collaboration et al. 2020a; Gil-Marin et al. 2020, ;), emission line galaxies (ELG) (Raichoor et al. 2020; Tamone et al. 2020; de Mattia et al. 2020, ;), and quasars (Hou et al. 2020; Neveux et al. 2020, ;). An essential component of these studies is the construction of data catalogs (Ross et al. 2020, this catalog;), mock catalogs (Lin et al. 2020; Zhao et al. 2020), and n-body simulations for assessing systematic errors (Rossi et al. 2020; Smith et al. 2020). At the highest redshifts, , the coordinated release of final eBOSS measurements includes measurements of BAO in the Ly forest (du Mas des Bourboux et al. 2020). The cosmological interpretation of these results in combination with the final BOSS results and other probes is found in Collaboration et al. 2020b.
This paper is organized as follows: In §II we summarize the data used to target DR16Q quasars. In §III we outline how we constructed the two different catalog files released as part of DR16Q. In §IV we describe the different redshift estimates in DR16Q, their uncertainties, and potential issues for each estimator. In §V we describe the automated algorithms used for identifying and analyzing Damped Lyman Alpha (DLA) systems and Broad Absorption Line (BAL) quasars. In §VI, we outline the physical properties of the DR16Q quasar sample. In §VII we briefly discuss the multi-wavelength data included in DR16Q. In §VIII we describe the quantities included in the DR16Q quasar-only catalog, before concluding in §IX. We also provide an Appendix that discusses the precision and accuracy of different redshift estimates for DR16Q quasars, presents some spectra of DR16Q quasars, notes mistakes that we have corrected from previous SDSS quasar catalogs, and details the data model of the DR16Q quasar-only catalog.
II Survey outline
In this section we summarize the imaging surveys, target selection procedures, and spectroscopic observations that produced the SDSS-IV/eBOSS quasar sample.
Three sets of imaging data were used to generate quasar targets for SDSS-IV/eBOSS (Myers et al. 2015). The primary imaging was an updated calibration of SDSS-I/II/III. Additional imaging was incorporated from the Wide-field Infrared Survey Explorer (Wright et al. 2010, WISE;) using the custom “unWISE” coadds (Lang et al. 2014). Finally, information on source variability from the Palomar Transient Factory (Law et al. 2009; Rau et al. 2009, PTF;) was used to supplement quasar targeting (Palanque-Delabrouille et al. 2016).
SDSS imaging data, in the , , , , and photometric bands (Fukugita et al. 1996), was taken at the 2.5 m Sloan telescope (Gunn et al. 2006) using the 30 2k2k CCDs outlined in Gunn et al. 1998. By Data Release 8 (Aihara et al. 2011, DR8;) over 14,000 of sky was covered by SDSS imaging. SDSS-IV/eBOSS used the same DR8 imaging as SDSS-III/BOSS, but leveraged new photometric calibrations using the “uber-calibration” method of Padmanabhan et al. 2008, updated by Schlafly et al. 2012 to be pinned to PanSTARRS imaging (Kaiser et al. 2010). A full description of this process can be found in Finkbeiner et al. 2016.
The WISE mission (Wright et al. 2010) collected data in four infrared bands: W1 (3.4 ), W2 (4.6 ), W3 (12 ), and W4 (22 ). Lang 2014 used WISE data to create a custom set of coadded “unWISE” images, which were force-photometered at the locations of known SDSS sources by Lang et al. 2014. Due to significant differences in depth between W1/W2 and W3/W4 data, only W1 and W2 were used for eBOSS targeting.
PTF imaging was obtained in the Mould-R filter and supplemented with SDSS , as discussed in Ofek et al. 2012. For eBOSS targeting, a custom pipeline was used to coadd individual PTF frames on a timescale of 1 to 4 epochs per year. These coadded images were also used to construct a full stack, which was 50% complete to known quasars at a magnitude limit of . A catalog of sources was extracted from this full stack and light curves were generated to supplement eBOSS targeting, as detailed in Myers et al. 2015.
II.2 Target Selection
One of the main goals of SDSS-IV/eBOSS was to study dark energy using the BAO method (Ata et al. 2017, e.g.). Specifically, the eBOSS quasar sample was designed to achieve a precision on the angular diameter distance, , of 2.8% for the redshift range , and a 4.2% precision in the value of within that same redshift range for the quasar-quasar auto-correlation. These constraints required a uniformly observed quasar sample density of for the redshift range . A quasar sample was also targeted to increase constraints on and in the Ly forest by compared to SDSS-III/BOSS (Dawson et al. 2016). eBOSS achieved the targeted precision for the lower redshift range (Hou et al. 2020; Neveux et al. 2020; Smith et al. 2020) and the Ly forest sample (du Mas des Bourboux et al. 2020). The targeting program to select the eBOSS quasar sample, which is detailed in Myers et al. 2015, is summarized below.
The majority of eBOSS quasars were targeted by a CORE algorithm, which was applied to SDSS SURVEY_PRIMARY point sources with (extinction-corrected) or . These point sources were passed to the XDQSOz algorithm (Bovy et al. 2012), which imposed a probability of being a quasar at redshifts of of more than 20%. An additional WISE-optical color cut was then applied to further reduce stellar contamination. These two selection criteria led to a quasar sample density of . Note that no explicit upper limit on redshift was applied, allowing the CORE sample to also target Ly-forest quasars.
To constrain cosmological parameters, eBOSS targeted quasars purely as back-lights of the Ly forest, meaning that such quasars could have a heterogeneous angular selection function. The CORE sample was therefore supplemented by three diverse methods designed to increase the yield of Ly-forest quasars. Objects with and that displayed quasar-like variability in the PTF light curves discussed in §II.1 were included as QSO_PTF targets, increasing the sample density to . The of SDSS point sources that lie within 1″ of a FIRST radio source were included as QSO_EBOSS_FIRST targets. Finally, Ly quasars that yielded a low S/N spectrum in BOSS were added as QSO_REOBS targets, which increased the on-sky density by between and .
Quasars that were targeted by the SDSS-IV sub-programs, TDSS (Morganson et al. 2015; MacLeod et al. 2018, detailed in) and SPIDERS (Dwelly et al. 2017; Comparat et al. 2019, detailed in) are also included in DR16Q. The on-sky distribution of DR16Q quasars, which reflects all of the various targeting programs outlined in this sub-section, can be seen in Fig. 1.
II.3 Spectroscopy
Spectroscopy for SDSS-IV/eBOSS was conducted using the BOSS spectrographs (Smee et al. 2013) on the 2.5 m Sloan Telescope. Two spectrographs each recorded data from 500 fibers on a 2k CCD with square 24 pixels and a wavelength range of 3600 Å to 10,400 Å at a spectral resolution of .
Each calibrated group of 1000 spectra were processed by the BOSS spec1d pipeline (Bolton et al. 2012, see also §IV.1). Spectra were fit using a variable number of rest-frame-derived PCA templates, which were applied using least-squares minimization to find the five best quasar redshifts, five best galaxy redshifts, 123 stellar redshifts, and one cataclysmic variable star redshift. The fits were then ranked according to the smallest reduced () value. The redshift, object classification, and line identifications were taken from the spectral fit with the lowest . In the case that two spectral fits had a difference less than 0.01 a ZWARNING flag was assigned.
DR16Q includes spectra obtained using both the BOSS spectrographs and the SDSS-I/II spectrographs. The cumulative number of observed quasar spectra by campaign is shown in Fig. 2. Wavelength limits for the spectra differ between the two set-ups, with SDSS-I/II spectra covering 3800 Å to 9100 Å (Smee et al. 2013, see).
III Construction of the catalog
As DR16Q represents the final SDSS-IV quasar catalog, it contains all quasars observed as part of eBOSS, TDSS, and SPIDERS. Additionally, like the catalog of Pâris et al. 2018, quasars observed in SDSS-I/II, and SDSS-III/BOSS have been included. Quasars presented in Schneider et al. 2010 and Pâris et al. 2017 that did not have an eBOSS observation were added via coordinate-matching, as detailed in §III.1. Due to quasar identification errors, quasars in DR14Q without a match in DR16Q were not included in DR16Q (see §C for details). The python code for generating DR16Q is available publicly. https://github.com/bradlyke/dr16q
The DR16Q superset was constructed from spAll-v5_13_0.fits (henceforth “the spAll file”), the file of all SDSS-III/IV observations generated by version v5_13_0 of the SDSS spectroscopic pipeline https://data.sdss.org/datamodel/files/BOSS_SPECTRO_REDUX/RUN2D/spAll.html. Any observation in the spAll file that has a bit flagged that is recorded in the columns listed in Table 1 was included in the DR16Q superset.
As the spAll file does not include observations from SDSS-I/II, quasars from DR7Q without an eBOSS reobservation were added to the DR16Q superset. Additionally, some quasars appearing in DR12Q were serendipitous identifications and did not have the bits set from Table 1. DR7Q and DR12Q were coordinate-matched with a radius to the superset, and missing objects were added. If a quasar already appeared in the superset, only the redshift and spectroscopic identifiers (plate, MJD, and fiber ID) were added to the SDSS-III/IV record. Known astrometric errors in DR12Q were corrected before coordinates were matched. The DR7Q and DR12Q quasars were added to the superset after the winnowing algorithm outlined in §III.2 was applied, as any objects appearing in DR7Q and DR12Q had previously been visually confirmed to be confident quasars. For quasars included in both DR7Q and DR12Q, only the DR7Q observation was propagated to this catalog superset.
The superset contains 1,440,615 observations of quasars, stars, and galaxies that were all targeted as quasars (or appeared in previous quasar catalogs).
III.2 Automated classification
Spectra flagged as in Table 1 were selected from the spAll file and passed through a modified version of a classification scheme that first appeared in Dawson et al. 2016. The “top 5” classifications (those with the 5 lowest ; see §II.3) are used in the following decision tree (in order) to set the value of the AUTOCLASS_DR14Q field:
If the best model fit for the spectrum is STAR, the spectrum is classified as a STAR.
If the best model fit for the spectrum is GALAXY and , then the spectrum is classified as a GALAXY.
If the best model fit for the spectrum is GALAXY, , and at least one other fit is GALAXY, then the spectrum is classified as a GALAXY.
If the best model fit for the spectrum is QSO and 2 or more other model fits are STAR, then the spectrum is classified as a STAR.
If the best model fit for the spectrum is QSO, fewer than 2 other model fits are STAR, and , the spectrum is classified as a QSO.
If a spectrum meets none of these criteria, it is selected for visual inspection (AUTOCLASS_DR14Q = VI).
Each individual spectrum was classified using this schema, and, afterwards, any object that had an initial classification of QSO and was reclassified for visual inspection (AUTOCLASS_DR14Q = VI). This algorithm flagged of the superset ( spectra) for visual inspection. To reduce duplication of effort, we only visually inspected spectra taken after MJD 57905, the last date of inspections for DR14Q. This reduced our flagged percentage to , or 20,508 spectra.
To further reduce the number of visual inspections, the QuasarNET algorithm (Busca & Balland 2018) was applied. QuasarNET produces a binary quasar flag and a redshift, which we designated IS_QSO_QN and Z_QN respectively. We used the results stored in AUTOCLASS_DR14Q to reclassify objects based on confident QuasarNET classifications, recording the output in AUTOCLASS_PQN. AUTOCLASS_PQN retained the same classification as AUTOCLASS_DR14Q for all cases but one: if AUTOCLASS_DR14Q was VI, IS_QSO_QN , and Z_QN , then AUTOCLASS_PQN was changed to QSO. Applying QuasarNET led to a reduction in the number of spectra to inspect to (8,581 spectra). Finally, objects were removed from the superset where the ZWARNING www.sdss.org/dr16/algorithms/bitmasks/#ZWARNING field had one or more of the following flags set: UNPLUGGED, SKY, LITTLE_COVERAGE, BAD_TARGET, or NODATA.
To characterize the accuracy of our classification scheme, the SDSS-III/SEQUELS data set (Myers et al. 2015, see §5.1 of) was used as “truth” to calculate the sample completeness via,
where is the number of quasars correctly classified as QSO by our schema, is the number of quasars identified during visual inspections, and is the total number of quasars in the catalog. We also calculated the sample contamination via,
where is the number of spectra incorrectly classified as quasar spectra and is as in Eqn. 1. We calculated a completeness of and a contamination of . Due to increased observation time and subsequent higher signal-to-noise ratios for these spectra, the BOSS SEQUELS set is not necessarily a good indicator of the spectral quality throughout eBOSS.
III.3 Random eBOSS Visual Inspections
To better characterize the eBOSS spectral pipeline, a random subsample of 10,000 eBOSS spectra from the DR16Q superset was selected. This subsample consisted of objects from the eBOSS CORE set and non-CORE objects with a pipeline redshift greater than 1.8. This subsample was visually inspected to check whether the pipeline correctly classified the spectrum and, in the case of quasar spectra, assigned an accurate redshift (“accurate” being defined as ; see also §IV.6). Whether the pipeline’s classification (and redshift) was correct is recorded in DR16Q in the column PIPE_CORR_10K. If the pipeline was correct, Z_10K was set to the pipeline redshift, and the pipeline’s determination of a quasar classification was retained.
If the pipeline did not correctly classify the spectrum, or a quasar redshift was significantly wrong ( ), the classification was corrected and quasar redshifts were recalculated as detailed in §III.4. These data are recorded in DR16Q in the columns IS_QSO_10K for classification, Z_10K for the redshift, and Z_CONF_10K for the redshift confidence in the case of quasars. Eqn. 1 was applied to this set, producing a completeness of . Some of the random subsample of 10,000 eBOSS spectra with a low signal-to-noise ratio were classified as quasars by the DR14Q visual inspection team but were reclassified as non-quasars by the DR16Q team. Applying Eqn. 2 and using DR14Q classifications for such cases produced an estimated contamination of . Using DR16Q classifications for such cases produced an estimated contamination of .
III.4 Visual inspection in eBOSS
In past SDSS visually inspected catalogs, such as DR7Q (Schneider et al. 2010) and DR12Q (Pâris et al. 2017), the number of quasar candidates was small enough for each spectrum to be visually inspected. In eBOSS the number of observations rose precipitously, so, for DR16Q, we only visually inspected objects as outlined in §III.2. As in DR14Q, objects selected for visual inspection were reclassified and quasar redshifts were corrected where needed. Spectra that were not quasars upon visual inspection, or that had a very low signal-to-noise ratio, were classified as “non-quasars” and did not have their redshifts corrected. These appear in the superset with CLASS_PERSON (GALAXY), and have . The numeric system used to classify spectra in DR16Q is shown in Table 2. This system is similar to that used in DR12Q, but the (unused) value of 2 was removed for DR16Q and a new value of 50 was added to indicate potential blazars.
Any spectra flagged for visual inspection in DR16Q were classified as a “non-quasar” if the noise spectrum was greater than the continuum everywhere and no more than one emission line peak rose above the noise level. If two emission line peaks could be positively identified, the object was classified as a quasar and given a corrected, “visual inspection” redshift. In a few cases, a single evident emission line peak could be questionably identified. Where this was true, the redshift was corrected using that emission line, the object was classified as a quasar, but the confidence rating for the redshift (Z_CONF; described below) was set to 1. During visual inspection, we identified four spectra with high flux, continua matching an archetypal quasar continuum shape, and no identifiable absorption or emission features. These spectra were marked as possible blazars; they were assigned a CLASS_PERSON value of 50, and a redshift of -999.
Where emission line peaks (or other features) could be identified, a new redshift was calculated by using the peak (or feature) wavelength for the following emission lines in priority order: Mg II , C IV , C III] , [O III] , [O II] , and Lyman break . A confidence rating for these redshifts was recorded in the column Z_CONF, with 0 being the lowest and 3 being the highest confidence (a value of -1 indicates the object was not visually inspected). Spectra with one questionable emission line were given a confidence rating of 1. Spectra with two or more lines identified based on pipeline locations were given a confidence rating of 2. In all cases, visual inspection redshifts were calculated to three decimal places. If the visual inspection redshift agreed with the pipeline, the visual inspection redshift was set to the pipeline redshift.
Unlike for DR12Q, spectra of general interest such as those of damped Lyman- systems (DLAs) and broad absorption line quasars (BALs) were not flagged as part of the visual inspection process. Instead, DLAs and BALs were identified via algorithm, as described in §V.
As the SDSS classification pipeline changed substantially between DR14Q and DR16Q, DR16Q only includes visual inspection information from DR14Q for objects that were in the DR16Q superset. Additionally, objects in DR16Q with and should be considered suspect, as they sometimes have misleading spectroscopic reductions or classifications. Users should carefully reinspect such objects prior to using them for scientific analyses.
III.5 Duplicate Observation Removal
Some SDSS-IV/eBOSS quasar targets were part of multi-epoch campaigns (e.g., Reverberation Mapping; Shen et al. 2015; TDSS; Morganson et al. 2015; MacLeod et al. 2018). Additionally, many targets observed in previous SDSS campaigns were reobserved in eBOSS. To reduce the superset of observations to objects we employed the following algorithm:
The superset catalog was coordinate-matched to itself with a maximum matching radius of and self-matches were removed.
For objects that had at least one visual inspection, we selected the observation with the highest VI confidence rating.
If all of the confidence ratings were the same, or none of the observations had a visual inspection, we selected the observation with the highest SN_MEDIAN_ALL value.
The SN_MEDIAN_ALL value represents the median signal-to-noise ratio across all good pixels in a spectrum. Primary observations were marked with a 1 in the PRIM_REC column of the DR16Q superset. For non-primary observations the spectroscopic plate, modified Julian date, fiber ID number, and spectroscopic instrument (SDSS or BOSS) were recorded in the fields of the primary observation marked PLATE_DUPLICATE, MJD_DUPLICATE, FIBERID_DUPLICATE, and SPECTRO_DUPLICATE respectively. The number of duplicate observations for each spectroscopic set-up were also tallied and recorded in NSPEC_SDSS and NSPEC_BOSS. The column NSPEC records the total number of duplicate observations. All duplicate observations are included as individual records in the DR16Q superset but only quasars with PRIM_REC set to 1 were used to create the DR16Q quasar-only catalog.
III.6 Classification results
DR16Q primarily contains data from eBOSS, but quasars appearing in DR7Q and DR12Q were also added (to both the DR16Q superset and the quasar-only catalog) if they did not already appear in the DR16Q superset. Due to the varied sources for the superset records, a more robust final classification for quasars was needed. A new column titled IS_QSO_FINAL was created that can take integer values from -2 to 2. In brief, quasar spectra have a value of 1, and questionable quasar spectra a value of 2. All values of 0 or less denote non-quasars. We developed a new algorithm to merge all of the independent, confident quasar classification sources into a final value. This final classification was generated by the following algorithm after the removal of duplicate observations:
If AUTOCLASS_PQN was QSO, the object is a quasar and IS_QSO_FINAL .
However, if CLASS_PERSON = 1 or 4 and Z_CONF , the object was not a quasar and IS_QSO_FINAL .
If Z_VI or Z_10K , these are possible blazars and IS_QSO_FINAL .
If AUTOCLASS_PQN = UNK, CLASS_PERSON = 3 or 30, and Z_CONF , the object is a quasar and IS_QSO_FINAL .
If the above is true, but Z_CONF , then the classification as a quasar is questionable, but included. We set IS_QSO_FINAL . There were 69 objects in this subset.
If SOURCE_Z is DR12QV, DR7QV_SCH, or DR6Q_HW, the object was visually confirmed to be a quasar in a previous catalog and we set IS_QSO_FINAL .
If RANDOM_SELECT and IS_QSO_10K , the object is visually confirmed to be a quasar and we set IS_QSO_FINAL .
If IS_QSO_DR12Q or IS_QSO_DR7Q , we set IS_QSO_FINAL . This subset occurred when an object had an eBOSS primary observation and a duplicate DR12Q or DR7Q observation.
If AUTOCLASS_PQN = VI, CLASS_PERSON = 3, 30, or 50, and Z_CONF , then we set IS_QSO_FINAL .
However, if this last condition is true except Z_CONF , the object is questionably a quasar and we set IS_QSO_FINAL . There were 670 objects in this subset.
AUTOCLASS_PQN, CLASS_PERSON, Z_VI, Z_10K, SOURCE_Z, RANDOM_SELECT, and the various IS_QSO_YYY columns are described in detail in §VIII. Once the IS_QSO_FINAL column was populated in the DR16Q superset, only objects with were selected for the quasar-only catalog.
Two special cases existed after assigning classifications: First, an object classified as a quasar by the algorithm in §III.2 that had a low-confidence visual inspection classifying it as a non-quasar. Such objects were left in the quasar-only catalog but are possible contaminants. Second, an object classified as a quasar by a low-confidence visual inspection that was classified as a non-quasar by the automated algorithm. Such objects were removed and represent possible lost quasars. In other words, confident visual inspection classifications would override automated classifications, but low-confidence visual classifications would not.
Table 3 lists the number of observations and objects appearing in both the DR16Q superset and the DR16Q quasar-only catalog.
IV Redshift estimates
A homogeneously defined set of quasar redshifts is integral to the eBOSS mission of characterizing large-scale structure. Alternate redshift estimates, however, may be more useful for other science needs. We have therefore chosen to include a number of different redshift estimates in DR16Q, which we detail in this section.
DR16Q includes automated classifications and redshifts determined by version v5_13_0 of the SDSS spectroscopic pipeline. Observed spectra are fit by a set of models and templates that are detailed in Bolton et al. 2012. Quasar models are first fit by searching over redshifts binned in redshift space where bins are separated by four SDSS pixels in constant log-lambda spacing. The five models with the lowest are then fit to every pixel. These “top five” quasar fits are then compared, using reduced values, to the best five model fits for galaxies, 123 fits to stellar templates, and a fit to a cataclysmic variable template. Dubious pixels in spectra can be masked before fitting, but good spectra typically retain pixels to fit. Quasar models include four eigenspectra components derived from BOSS reobservations of 568 SDSS DR5 quasars and a quadratic polynomial. In the version of the pipeline used to construct DR16Q, quasar models were optimized for BOSS, which targeted Ly forest quasars at about . In particular, the pipeline has trouble confidently distinguishing redshifts in the range for which the strong [O III] and Ly emission lines are not present in the eBOSS spectrum.
To check the quality of the pipeline classifications and redshifts, we compared the visual inspection redshifts derived from our random set of 10,000 superset spectra (Z_10K; see §III.3) to their pipeline values (Z_PIPE) for eBOSS CORE targets. Using a value of to define an inaccurate pipeline redshift (see also §IV.6), we found that 2.1% of the pipeline redshifts were inaccurate. This represented 154 catastrophic failures out of 7254 quasars. Further, the vast majority (130) of these catastrophes were highly inaccurate, where .
IV.2 QuasarNET redshifts
As discussed in §III.2, we used redshifts from the QuasarNET https://github.com/ngbusca/QuasarNET algorithm to help determine which quasars to visually inspect. We record this redshift in DR16Q as Z_QN. For more information on QuasarNET, we refer the reader to Busca & Balland 2018.
IV.3 Visual inspection redshifts
DR16Q includes the visually inspected redshifts for quasars that appeared in DR7Q or DR12Q in the Z_DR7Q_SCH and Z_DR12Q columns. We also include the redshifts from Hewett & Wild 2010, where available, in the field Z_DR6Q_HW, as they are formally in the Hewett and Wild paper and have been used in some of our companion papers. We are conscious that a large body of work uses the updated DR7Q Hewett and Wild redshifts included in the ancillary columns of the value-added catalog detailed in Shen et al. 2011. We include these redshifts in their own column, Z_DR7Q_HW, for completeness. To conform with other reported redshifts, we do not include the Shen et al. 2011 redshift errors in DR16Q. See columns 143 and 144 at http://das.sdss.org/va/qso_properties_dr7/dr7.htm For objects inspected after DR12Q, the visual inspections are included in the field Z_VI. Redshifts for quasars found during the random visual inspection (see §III.3), are recorded in the column Z_10K. While some of these values may overlap we include each separately, as data reduction techniques may have changed between observations. In all cases, the field SOURCE_Z records the origin of the primary redshift estimate, and the estimate itself is recorded in Z (as detailed in §IV.5).
IV.4 PCA redshift and emission line redshifts
In the tradition of previous BOSS and eBOSS quasar catalogs, DR16Q includes a redshift generated by principal component analysis (PCA), using the redvsblue algorithm https://github.com/londumas/redvsblue. These redshifts are recorded in the Z_PCA field of DR16Q.
In fitting the spectra, the redvsblue algorithm uses the same four PCA eigenvectors as the SDSS spectroscopic pipeline and includes a second degree polynomial as a broadband term. Unlike the SDSS pipeline, redvsblue uses all pixels within the observed wavelength range 3600 Å to 10,000 Å, regardless of whether they would be masked by the pipeline. The redvsblue algorithm is also not limited to the pipeline redshift range of .
For quasars in the DR16Q quasar-only sample, we stacked all spectra that did not have the ZWARNING www.sdss.org/dr16/algorithms/bitmasks/#ZWARNING flags SKY, LITTLE_COVERAGE, UNPLUGGED, BAD_TARGET or NODATA set, before assigning a PCA redshift. Spectra are ’stacked’ by matching them in log-lambda space and taking an error-weighted average of the flux density at each point. For data appearing in the DR16Q superset, only the best observation was used. For both the DR16Q quasar-only catalog and the superset, the redvsblue algorithm corrected all observed spectra for Galactic extinction using the dust map of Schlegel et al. 1998. The algorithm also corrected the model PCA eigenvectors for Ly transmission evolution using parameters from Calura et al. 2012. We used the primary DR16Q redshift (Z), with a flat prior of , to seed an initial redshift estimate. In addition to the full-spectrum PCA redshift (Z_PCA), we independently computed six emission line redshifts (H, H, Mg II, C III], C IV, and Ly) using the same prior on the primary redshift (Z) as used to calculate Z_PCA but not using Z_PCA itself We use “PCA redshift” to denote a redshift not tied to a single emission line. Redshifts derived from a single emission line are referred to as “emission line redshifts.”. We include these redshifts in DR16Q when the emission line of interest is in the observed frame of the spectrum. A distinct PCA redshift was used in the Ly forest clustering catalogs. This redshift, recorded in the column Z_LYAWG masks the Ly emission line and potential forest before generating a redshift. More details about this redshift can be found in du Mas des Bourboux et al. 2020.
Some of the 750,414 sources in the DR16Q quasar-only sample did not yield good PCA redshifts. These included: 12,412 quasars where Z_PIPE disagreed with Z_QN by more than 10,000 ; 1085 quasars that did not have an SDSS identifier ( https://www.sdss.org/dr16/algorithms/resolve/), so could not be stacked for the quasar-only catalog; 4 quasars with (possible blazars); and 444 that had outlier spectra that redvsblue could not fit reliably. In addition, there are 11 quasars that have . In total, 665,612 quasars in the quasar-only catalog yielded reliable PCA redshifts. The DR16Q superset contains 920,109 quasars with . These PCA redshifts represent a sample with homogeneous statistical and systematic errors.
IV.5 Selection of the “Primary” Redshift
DR16Q includes many different quasar redshift estimates. We select a “primary” redshift (similar to the “best” redshift in DR14Q) for each object from, most preferably, the available visual inspection redshifts, or, alternatively, the SDSS automated pipeline redshift. The columns Z and SOURCE_Z record this primary redshift and from which column it was selected. See §IV.3 for more information on the available visual inspection redshifts.
For objects that have a redshift in the columns Z_VI or Z_10K and a confidence (Z_CONF or Z_CONF_10K) of , Z records the corresponding redshift and SOURCE_Z is set to VI. Otherwise, if an object has a redshift in the columns Z_DR6Q_HW or Z_DR7Q_SCH these values are used (with Z_DR6Q_HW overriding Z_DR7Q_SCH) and SOURCE_Z is set to DR6Q_HW or DR7QV_SCH. As the Z_DR7Q_HW redshifts did not formally appear in the Shen et al. 2011 paper, these values are not used to populate the Z column. If no other visual inspection redshift is populated then Z_DR12Q is used (and SOURCE_Z is set to DR12QV). For objects with DR12Q redshifts, only the visual inspection redshifts are recorded; DR12Q pipeline redshifts are not included. In the absence of any of these visual inspection redshifts, Z is populated with the automated pipeline redshift (and SOURCE_Z is set to PIPE).
The PCA and QuasarNET redshifts are included in their own columns in DR16Q but were not used to inform the Z column. Given the heterogeneous source information that is propagated into the Z column, we expect Z to represent the least biased redshift estimator, but with a high variance. For analyses that require a homogeneous redshift over a large ensemble we recommend Z_PCA. We ourselves use Z_PCA in this paper as a redshift prior for calculating absolute i-band magnitudes, and for finding DLAs and BALs (§V).
IV.6 Comparison of redshift values
The number and complexity of physical processes that can affect the spectrum of a quasar make it difficult to precisely and accurately disentangle a “systemic” redshift (i.e., as a meaningful indicator of distance) from measured redshifts. Indeed, quasar spectra contain broad emission lines due to the rotating gas located around the central black hole that are subject to matter outflows around the accretion disk. These astrophysical processes frequently give rise to systematic offsets when measuring redshifts. To investigate the systematic shifts associated with the automated and emission line redshifts (, , and ), we used the Reverberation Mapping program (Shen et al. 2015) to compare the eBOSS redshifts to these “systemic” redshifts obtained from coadded-spectra of 849 confirmed quasars where . Shen et al. 2016 measured the velocity shifts of quasar emission line peaks compared to stellar absorption lines from the host galaxy of individual quasars. These stellar features correspond to absorption in the host galaxy which is not affected by contaminating physical processes providing reliable “systemic” velocity measurements. Thus the “systemic” redshifts are henceforth referred to as “host” redshifts. We discarded the first year of observations, to match the eBOSS observation time, and kept only quasars in the redshift range .
We define the velocity difference for redshifts as:
where is the redshift under comparison, is the speed of light, and is the redshift baseline used for comparison. In Fig. 3, is used for , which is compared to various redshifts available in the catalog as a function of this host redshift. Only (the “primary” redshift detailed in §IV.5), , and show systematic shifts that are less than the uncertainty on the host redshift itself. Our study also confirmed that is the least biased broad emission line redshift estimate as previously reported in, e.g., Shen et al. 2016.
In addition to systematic uncertainty, each measured redshift contains a statistical precision that we can estimate using duplicate observations. These duplicate observations are made possible in overlapping plates when unused fibers are assigned to quasars with previous observations. Fig. 4 shows the offset in velocity between two redshift measurements of the same quasar. The statistical precision of and show a similar behaviour with no significant redshift dependence for the eBOSS redshift range, and show a statistical uncertainty of . A more detailed discussion of statistical uncertainties in and can be found in Appendix A.
For the catalog as a whole, we define quasars in DR16Q as being a “catastrophic failure” if they have a velocity difference from a reference redshift of . As the Shen et al. 2015 quasar sample is much smaller than DR16Q, we do not have ‘host’ redshifts to calculate catastrophic failures for the entire catalog. We define a different redshift, , as for comparing the catastrophic failure rate of redshifts from various sources in the Z column. For a detailed discussion of the use of in the clustering catalog, see Ross et al. 2020. The comparisons of the various sources to can be found in Table 4, which also includes a comparison to for a “full sample” of quasars in DR16Q. The full sample consists only of quasars where and , and each source subsample was drawn from this greater set.
The full distribution of for the samples in Table 4 can be seen in the left-hand panel of Fig. 5. The right-hand panel shows as a function of for catastrophic failures in the full sample. The lines appearing near 9,900 and 10,500 are artifacts of edge effects due to how the PCA-fitting algorithm bins redshift ranges.
Over the entire sample (marked “TOTAL” in Table 4) the catastrophic failure rate for the Z column is 0.93%. It should be noted that the PCA redshift, itself, is likely not an ideal estimate of a quasar’s host redshift. In addition, the PCA-fitting algorithm shares many properties with the SDSS pipeline (SOURCE_Z=‘PIPE’), so Z_PIPE and Z_PCA might be expected to be similar.
V Damped Lyman Alpha and Broad Absorption Line systems
As was the case for previous SDSS quasar catalogs, DR16Q includes information about DLA systems (henceforth DLAs) and BAL quasars (henceforth BALs). For DR16Q, we used automated processes rather than visual inspections to identify DLAs and BALs, but BALs identified in previous visual inspection campaigns still retain that classification independent of the processes described in this section.
We identified DLAs in DR16Q quasar spectra using the algorithm described in Parks et al. 2018, which is based on a convolutional neural network (CNN; see Parks et al. 2018, for full details).
We only classified DLAs in spectra with , the redshift range over which spectra contained enough pixels to reliably identify DLAs. We thus reduced the input set to 270,315 sightlines. If multiple observations were available for one object in the spAll-v5_13_0 file, we used the stacked spectrum of all good observations as input to the DLA finder. We identified bad spectra using the ZWARNING parameter (see, e.g., §III.2). If ZWARNING was SKY, LITTLE_COVERAGE, UNPLUGGED, BAD_TARGET, or NODATA, we did not use the associated observation in the stack. Following Parks et al. 2018, we provide a very pure sample that has a confidence parameter of more than 0.9, and logarithms of the column densities of more than 20.3. Our final sample contains 39,514 DLAs in 35,686 sightlines with an average logarithmic column density of 20.606. For each quasar spectrum, we provide the list of identified DLAs with the absorption redshifts (Z_DLA), the logarithms of the column density (NHI_DLA), and the confidence parameters (CONF_DLA). The size of each list is the same and corresponds to the maximum number of identified DLAs in any spectrum. If all parameters are set to -1 then no DLA was detected. More information about the efficiency and purity of the aforementioned algorithm is forthcoming in Chabanier et al. (in prep).
V.2 Broad Absorption Line systems
We identified BALs in all quasars at using an algorithm that looks for absorption troughs that would represent either blueshifted C IV or Si IV features. We performed a fit of an unabsorbed quasar model to each spectrum, looked for differences between the model and spectrum that would represent absorption, masked out these regions, and iterated these steps until no new absorption features are identified. This procedure is very similar to the method described by Guo & Martini 2019 to prepare DR14 quasar spectra for input to their CNN, and used the same five principal components. We performed this fit over the rest-frame wavelength range 1260 Å to 2400 Å when possible, and a shorter range for the lowest and highest redshift quasars. If the value of this fit was worse than the value of the best pipeline fit, we used that pipeline fit instead. We then normalized the spectrum by the best model.
The algorithm measured the commonly used “BALnicity index” (BI) proposed by Weymann et al. 1991 and the intrinsic absorption index (AI) proposed by Hall et al. 2002. BI was computed using,
where , unless is continuously positive over a velocity interval , in which case, . is the normalized flux density as a function of velocity blueshift from the C IV or Si IV emission-line center. AI was computed by,
where and have the same definition as Eqn. 4. DR16Q contains any BI and AI measurements for both C IV and Si IV for all quasars with . These are BI_CIV, AI_CIV, BI_SIIV, and AI_SIIV. We also provide error estimates for each quantity: ERR_BI_CIV, ERR_AI_CIV, ERR_BI_SIIV, ERR_AI_SIIV. All BI, AI, and error estimates are in units of .
We assigned a BAL probability BAL_PROB to each quasar based on the statistical significance of the troughs associated with the C IV line, and the quality of the fit to the quasar continuum. The BAL_PROB values are one of four, discrete values, and are based on visual inspection of large numbers of quasars whose BI values and continuum fits have different levels of statistical significance. For quasars with good continuum fits, we assigned BAL_PROB = 1 to cases where BI_CIV is more than ten times the uncertainty in this quantity. Based on our visual inspections, these are all unambiguous cases. Quasars with a less significant BI measurement, but whose AI_CIV is more than ten times the uncertainty, were assigned BAL_PROB = 0.95. These are nearly all unambiguous BALs as well. If BI_CIV is zero, but AI is similarly significant, we assigned BAL_PROB = 0.9. These are nearly all BALs, but their BI value is zero where the trough is under 2000 wide and/or the trough extends closer to the line center than 3000 . Other quasars with a less significant BI measurement were assigned BAL_PROB = 0.75, and quasars with a BI_CIV value of zero and a less significant AI value were assigned BAL_PROB = 0.5. We used similar criteria to assign BAL_PROB to quasars with poorer continuum fits, although with generally lower probability values. For a small number of quasars, the continuum fit failed, and these quasars were not assigned a value for BAL_PROB. The remaining quasars were assigned BAL_PROB = 0.
VI Summary of quasar characteristics
DR16Q comprises two catalog files: a superset of objects targeted as quasars by SDSS-I/II/III/IV and a quasar-only set selected from that superset. The superset contains 1,440,615 observations and includes quasars from BOSS and eBOSS, legacy quasars added from DR7Q, and serendipitous discoveries added from DR12Q. The quasar-only catalog contains 750,414 quasars, where 225,082 are new quasars observed since DR14Q. Quasars appearing in DR16Q can be identified using the unique combination of plate, MJD, and fiber ID. The plate, MJD, and fiber ID of “duplicate observations” have also been back-populated into the superset for user convenience, though each observation still appears in its own record. We have also marked which quasars are considered primary in the PRIM_REC field, which only appears in the superset. Due to catalog construction constraints in DR7Q, there are possible additional duplicate observations from SDSS-I/II that are not included in DR16Q. DR16Q represents the largest catalog of quasars to date taken from SDSS data and covers 9,376 of the sky, with an average on-sky surface density of . DR16Q also presents the largest variety of redshift estimates, to date, for each quasar in an SDSS quasar catalog and is the first such catalog to include the Gaia DR2 data for known quasars.
The left-hand panel of Fig. 6 presents the redshift distribution of the number of observed quasars for each SDSS campaign as they appear in the DR16Q quasar-only catalog. The number of observed quasars increased dramatically during the SDSS-III/BOSS campaign, which targeted fainter quasars at higher redshift. The right-hand panel of Fig. 6 shows the redshift distribution of only the SDSS-IV/eBOSS quasars broken down by eBOSS subprogram. Quasars in each panel use the PCA-derived redshift for consistency, and are limited to quasars where . It is clear that the most SDSS quasars are contributed by SDSS-IV and that by far the most SDSS-IV quasars are contributed by the eBOSS CORE sample. The luminosity space of the quasars in DR16Q is shown in Fig. 7, as a function of the same PCA redshifts.
VII Multi-wavelength Data
DR16Q includes force-photometered or cross-matched data from: the Galaxy Evolution Explorer (GALEX, Martin et al. 2005), the UKIRT Infrared Deep Sky Survey (UKIDSS, Lawrence et al. 2007), the Wide-Field Infrared Survey Explorer (WISE, Wright et al. 2010), the FIRST radio survey (Becker et al. 1995), the Two Micron All Sky Survey (2MASS, Skrutskie et al. 2006), the Second ROSAT All-Sky Survey (2RXS, Boller et al. 2016), the Third XMM-Newton Serendipitous Source Catalog (Rosen et al. 2016), and Gaia data release 2 (Gaia Collaboration et al. 2018). In this section, we describe how we incorporated these multi-wavelength data into DR16Q. For GALEX, UKIDSS, and WISE we cross-matched to the data releases that were actually used to target quasars in BOSS and eBOSS. These multi-wavelength data, then, are particularly useful for trying to recreate BOSS/eBOSS targeting. As FIRST, 2MASS, ROSAT, XMM-Newton, and Gaia were not used in BOSS/eBOSS targeting, we chose to cross-match to the most recent data set available during catalog construction. The data set used for each external survey is explicitly defined in that survey’s subsection.
A summary of these external surveys can be found in Table 5, with more detailed information in the appropriate subsections below. In Fig. 8 we demonstrate the utility of these data by providing the spectral energy distribution (SED) of a quasar that has extensive multi-wavelength coverage in DR16Q.
As in past SDSS quasar catalogs, DR16Q includes data from GALEX Data Release 5, force-photometered at the location of SDSS DR8 imaging sources (Aihara et al. 2011). We present data from both GALEX bands: NUV (1350--1750 Å) and FUV (1750--2750 Å). A total of 646,041 objects have a non-zero flux in either the NUV or FUV band, 552,025 (431,431) have a positive NUV (FUV) flux, and 386,642 objects have a positive flux in both bands. All fluxes are reported in nanomaggies See https://www.sdss.org/dr16/algorithms/magnitudes/#Fluxunits:maggiesandnanomaggies, where 1 nanomaggy Jy.
VII.2 UKIDSS
Similarly to GALEX, DR16Q includes SDSS-DR8-based imaging force-photometered in the four UKIDSS bands (with central wavelengths): Y ( ), J ( ), H ( ), and K ( ) bands. UKIDSS data was taken before March 2011 and was released as UKIDSS DR1–DR9 (Pâris et al. 2014, see §4.5.5 of). We provide the fluxes and errors for each of these bands in units of .
DR16Q contains 151,362 measurements from the UKIDSS area (which is smaller than the SDSS footprint). [150,147, 149,629, 149,502 and 150,288] sources have a positive flux in [Y, J, H, and K] respectively. 146,500 sources have a positive flux in all four bands.
VII.3 WISE
eBOSS targeting was, in part, based on data taken from the WISE W1 ( ) and W2 ( ) bands (Myers et al. 2015). Many of the eBOSS quasar targets had fluxes below the WISE detection limit used for the AllWISE Data Release, so forced photometry was applied to custom “unWISE” stacks (Lang 2014), as described in Lang et al. 2014. For more information see: https://www.sdss.org/dr15/data_access/value-added-catalogs/?vac_id=wise-forced-photometry
DR16Q contains 747,962 objects with a positive flux in either the W1 or W2 bands. There are 744,835 (741,227) objects with a positive flux in the W1 (W2) band, and 739,093 objects with a positive flux in both bands. Quasars in DR16Q that were not identified using SDSS imaging do not have “unWISE” forced photometry. There are 1001 such objects in DR16Q and each has a flux set to -1 in both bands.
VII.4 FIRST
Sources in DR16Q are matched to the December 2014, version of the FIRST http://sundog.stsci.edu/first/catalogs.html catalog (Helfand et al. 2015, e.g.), using a radius. Our reported FIRST_FLUX corresponds to the peak flux density, in mJy, at cm wavelength. These values include the added mJy “CLEAN” bias described in Thyagarajan et al. 2011. We also report the FIRST signal-to-noise ratio of the peak flux using,
The catalog contains 21,843 matches to FIRST radio sources.
VII.5 2MASS
DR16Q includes data from the 2MASS All-Sky Point Source Catalog, released March 2003, in three bands (with central wavelengths): J ( ), H ( ), and ( ). Catalog objects were matched to 2MASS sources within , and we include the Vega magnitude, magnitude uncertainty, signal-to-noise ratio, and photometric read flag for each object. There are a total of 18,115 2MASS matches in DR16Q. The magnitude limits of the 2MASS survey (, , and ) explain the lower detection rate compared to WISE and UKIDSS.
VII.6 ROSAT/2RXS
Unlike the other surveys mentioned in this section, a single coordinate-match with the ROSAT/2RXS (Boller et al. 2016) and XMMSL2 For SL2 specifics see https://www.cosmos.esa.int/web/xmm-newton/xmmsl2-ug (Saxton et al. 2008) would not provide a reliable association. This is because both surveys have a large positional uncertainty, as can be seen in Fig. 1 of Salvato et al. 2018. In particular, 95% of the 2RXS sources have a 1- positional uncertainty smaller than 29″. As detailed in Dwelly et al. 2017, Salvato et al. 2018 and Comparat et al. 2019, a better approach is to construct a match between X-ray sources and AllWISE sources via a Bayesian approach (using a code called Nway). Here, we simply matched the coordinates of DR16Q within 1″ to the AllWISE counterparts of the X-ray sources presented in Salvato et al. 2018.
In DR16Q there are a total of 11,545 matched objects, and we include the 2RXS right ascension and declination, and the source flux and flux error in the 0.5–2.0 keV band.
VII.7 XMM-Newton
DR16Q includes cross-matches to the two most complete X-ray catalogs to date: XMMPZCAT See http://xraygroup.astro.noa.gr/Webpage-prodex/xmmfitcat_access.html (Ruiz et al. 2018) and 3XMM-DR8 See http://xmmssc.irap.omp.eu/Catalogue/3XMM-DR8/3XMM_DR8.html, which are both based on the third version of the XMM-Newton Serendipitous Source Catalog (Rosen et al. 2016).
XMMPZCAT (Ruiz et al. 2018) is a catalog of photometric redshifts for X-ray sources, which was created using a machine learning algorithm (Carrasco Kind & Brunner 2013, MLZ-TPZ; detailed in). XMMPZCAT provides X-ray positions and redshifts for about 100,000 sources. We cross-matched DR16Q and XMMPZCAT, with a matching radius of 10″. Despite the large matching radius, 59% of the sources were within 1″. DR16Q includes more than 15,800 sources with X-ray counterparts in XMMPZCAT, of which are estimated to be contaminants due to chance superpositions.
XMMPZCAT is based on 3XMM-DR6 (the sixth release of the 3XMM catalog). So, in addition, we matched DR16Q to the more recent 3XMM-DR8 catalog using a radius. We restricted this match to areas not covered by 3XMM-DR6 or to sources without XMMPZCAT counterparts. DR16Q contains an additional X-ray counterparts from 3XMM-DR8.
For each of the 18,138 DR16Q quasars with XMM-Newton counterparts, we report the soft (0.2–2.0 keV), hard (4.5–12.0 keV), and total (0.2–12.0 keV) fluxes with associated errors. These were computed as the weighted average of all detections in the three XMM-Newton cameras (MOS1, MOS2, PN). The X-ray luminosities for the total fluxes were also computed and are provided. These are not absorption-corrected. All fluxes and errors are expressed in and the total luminosity was computed using Z.
VII.8 Gaia
DR16Q includes data from the second data release of Gaia https://www.cosmos.esa.int/web/gaia/dr2. We matched objects using a radius, and present the Vega magnitudes and mean signal-to-noise ratio for the three Gaia bands: G, BP, and RP, as well as the Gaia RA, DEC, parallax, and proper motion (for both RA and DEC). We also include the unique Gaia designation, which is guaranteed to remain unique in future Gaia data releases.
A total of 469,786 objects in DR16Q have a match to the Gaia catalog, to limiting magnitudes of , , and .
VIII Description of the DR16Q catalog
The DR16Q quasar-only catalog contains 183 columns of information for each quasar in a binary FITS (Wells et al. 1981) table file. The DR16Q superset includes the columns listed below up to column 98 inclusive, omitting Z_LYAWG and M_I (columns 53 and 97 respectively), but adding PRIM_REC (column 16 in the superset) which has a value of 1 if the record is considered the primary observation for a quasar. The columns in the quasar-only catalog are summarized in Table 6. Complete DR16Q quasar-only column descriptions follow: 1. The SDSS name generated from the RA and DEC for the primary record in the format hhmmss.ssddmmss.s in the J2000 equinox. The ’SDSS J’ is omitted. Coordinate values are truncated, not rounded. 2–3. The right ascension and declination in decimal degrees for the J2000 equinox. 4–6. The unique spectroscopic plate number, modified Julian date of spectroscopic observation, and fiber ID. The combination of these three values gives a unique identifier for every spectroscopic observation in SDSS-I/II/III/IV. Where an object was observed multiple times we chose the observation with the most confident visual inspection. If data from visual inspection was not available the observation with the highest SN_MEDIAN_ALL was chosen as the primary. 7. The automated classification as outlined in §III.2. This column can take the values GALAXY, QSO, STAR, UNK, and VI. A classification of UNK corresponds to objects that were added to the superset catalog after the initial automated classification was completed. All of these records were taken from a catalog of visually inspected objects that did not have a targeting bit that appears in Table 1. 8. The automated classification as detailed in the first part of §III.2. This column can take the same set of values as AUTOCLASS_PQN, and UNK is defined as above. Classifications of STAR, GALAXY, QSO were retained in AUTOCLASS_PQN. Only objects with a classification of VI in this column could be reclassified in AUTOCLASS_PQN. 9. A numeric flag indicating if an object was identified as a quasar by QuasarNET. A value of -1 indicates the object was not processed by QuasarNET, 1 (0) indicates the object was identified as a quasar (non-quasar). 10. The redshift of the quasar as computed by QuasarNET. As outlined in §III.2, this was used as a binary discriminant with a threshold set to . Observations with AUTOCLASS_DR14Q set to VI that had were reclassified in AUTOCLASS_PQN as QSO. 11. A binary flag indicating if the object was selected randomly for visual inspection as detailed in §III.4. A value of 0 indicates the object was not selected. The randomized subsample was selected from the superset and contained some duplicate observations of quasars. All subsampled 10,000 observations were unique. Objects were selected from a larger set where EBOSS_TARGET1 contained the QSO1_EBOSS_CORE targeting bit set, or had an observation date (MJD ) and pipeline redshift 12. The redshift from the visual inspection of the randomly selected subsample. Note that this field is included as a possible “visual inspection” source for Z. 13. The confidence rating for a visually identified redshift. A value of -1 indicates the object was not selected for the subsample. A value of 1 is the lowest confidence and 3 is the highest confidence. A value of 1 typically indicates a spectrum with only one broad emission peak above the noise spectrum. 14. A numeric flag indicating whether the automated pipeline correctly identified the classification and redshift with . A value of -1 indicates the record was not included in the random subsample, a value of 0 indicates the pipeline incorrectly identified the classification or redshift, and a value of 1 indicates that both classification and redshift were correct. 15. A numeric flag that classifies the record as a quasar for the randomly selected subsample. As in 13-14, a -1 value indicates the record wasn’t selected. 16. A 64-bit integer that identifies BOSS and eBOSS objects in the SDSS photometric and spectroscopic catalogs. Some SDSS-I/II objects have a THING_ID value, but not all. A value of -1 indicates the record wasn’t assigned a THING_ID. 17. The visually identified redshift of the record. A value of -999 indicates a possible blazar and no meaningful redshift from an emission feature can be identified. A value of -1 indicates the record was not visually inspected. See §IV.3. 18. The confidence rating for the visually identified redshift. Objects with -1 were not visually inspected. Objects with 0 were visually inspected but a confident redshift and classification could not be identified. For other objects a value of 3 is the highest confidence. 19. The visually identified classification for the object. Definitions for the numeric values appear in Table 2. Objects appearing in DR16Q that have values of 1 (Star) or 4 (Galaxy) have low Z_CONF values. In these cases the automated pipeline classification was used to determine whether the object was a quasar. 20–24. The redshift and flag indicating an object is a quasar for objects appearing in DR12Q (Pâris et al. 2017), DR7Q (Schneider et al. 2010), and Hewett & Wild 2010. These values are kept separate from Z_VI as an object observed more than once may have different redshifts for different pipeline reductions. For DR12Q objects, only the visual inspection redshift was recorded. 25. The Hewett and Wild (2010) redshifts applied to DR7Q and taken from the ancillary column of Shen et al. 2011. See column 143 at http://das.sdss.org/va/qso_properties_dr7/dr7.htm for more information. 26. The overall flag indicating if an object is a quasar. See §III.6. 27. The best available redshift taken from Z_VI, Z_10K, Z_DR12Q, Z_DR7Q_SCH, Z_DR6Q_HW, or Z_PIPE. Visually identified redshifts with were preferred. Z_DR6Q_HW was preferred over Z_DR7Q_SCH. In the absence of a confident visual inspection redshift or previous catalog redshift, this value is taken from Z_PIPE. 28. The source for the redshift recorded in column 27. DR12Q redshifts were taken from the visual inspection redshifts in that catalog. 29. The automated redshift taken from version v5_13_0 of the SDSS reduction pipeline. Objects added from DR7Q that had no BOSS or eBOSS reobservation do not have a pipeline redshift. 30. A bit flag for the quality of the pipeline redshift www.sdss.org/dr16/algorithms/bitmasks/#ZWARNING. 31. A string for the SDSS photometric identification generated from the sky version, run, rerun, camera column, field number, and ID. A blank value indicates the object does not have SDSS photometry and was selected as a target from another source catalog. 32–34. The redshift, warning flag, and for the PCA redshift generated by redvsblue (see §IV.4). 35–52. Similar to columns 32–34, the redvsblue pipeline fits for six emission lines: H, H, Mg II, C III], C IV, and Ly. 53. A PCA-derived redshift using redvsblue with spectrum-masking of the Ly emission line and forest. 54–56. The absorber redshift, absorber column density, and confidence rating for DLA absorbers. No object had more than 5 absorbers. Objects with a value of -1 in the first element were either outside the redshift range for DLA systems, or had no identifiable absorbers. 57. The probability an object is a BAL quasar. A -1 indicates the object’s redshift was too low to have a detection within the spectroscopic wavelength range. 58–65. The BALnicity index (BI), BI uncertainty, absorption index (AI), and AI uncertainty for the C IV region and for the Si IV region. All columns are in units of . 66–71. Targeting bit flags for BOSS, eBOSS, and ancillary BOSS programs (see Table 1). 72–73. The number of additional spectra for an object from SDSS-I/II (column 72) or BOSS/eBOSS (column 73). Objects with only one observation will have both values set to 0. SDSS-I/II (SDSS-III/IV) objects have an MJD before (after) 54663. 74. The total number of additional spectroscopic observations for an object. This is the sum of columns 72 and 73. Objects with only one observation will have this value set to 0. 75–78. The spectroscopic plate, modified Julian date, fiber ID, and spectroscopic instrument for each duplicate observation of an object. As with columns 4–6, the combination of plate, MJD, and fiber ID provide a unique reference to each observation. For column 78, observations from SDSS-I/II have a value of 1, while observations from BOSS/eBOSS have a value of 2. Objects with multiple duplicate observations are in no particular order. 79–84. SDSS photometric information. Combining these columns gives the OBJID in column 31. 85. The wavelength for which the fiber placement was optimized to account for atmospheric differential refraction (Dawson et al. 2013), in Å. 86. The focal plane offset, in , to account for wavelength dependence of the focal plane due to distance from the center of the plate (Dawson et al. 2013). 87–88. The and positions in the focal plane for the spectroscopic fiber hole, in mm. 89–90. The name of the tiling chunk and the tile number for the spectroscopic plate placement on the sky. 91. The overall for the spectroscopic plate, taken from the minimum of the two red and two blue cameras for the plate. 92–93. The PSF flux and inverse variance for each of the five SDSS bands: u, g, r, i, and z, in nanomaggies. The fluxes are not corrected for Galactic extinction. 94–95. As for columns 92–93, but for inverse hyperbolic sine (asinh) AB magnitudes (Lupton et al. 1999). Magnitudes are not corrected for Galactic extinction. 96. The Galactic extinction values from Schlafly & Finkbeiner 2011a for the five SDSS bands. 97. Absolute i-band magnitude corrected for extinction. Calculated from the magnitude and Galactic extinction in columns 94 and 96, using the PCA redshift in column 32. K-corrections were normalized to a redshift of 2, using Table 4 of Richards et al. 2006. The following cosmological parameters were used: , , and . 98. The median S/N for all good pixels in the five SDSS bands. 99. A matching flag for objects in the forced-photometry SDSS-DR8/GALEX catalog. A value of 1 (0) indicates the object was (was not) found in the GALEX catalog. 100–103. GALEX FUV and NUV fluxes and inverse variances, expressed in nanomaggies. 104. A matching flag for objects in the forced-photometry SDSS-DR8/UKIDSS catalog. A value of 1 (0) indicates the object was (was not) found in the UKIDSS catalog. 105–112. The flux density and error in the four UKIDSS bands (Y, J, H, and K) in units of . 113–114. The W1-band ( ) WISE flux and inverse flux variance in nanomaggies and nanomaggies-2 respectively. A source with a measured magnitude of 22.5 in the Vega system would have a flux of 1 nanomaggy. See Lang et al. 2014. 115–116. The W1-band magnitude and magnitude uncertainty in the Vega magnitude system. Calculated using columns 113–114. 117. The W1-band profile-weighted goodness of fit weighted by the point-spread function in the WISE images (for point sources). 118. The W1-band flux signal-to-noise ratio. Calculated using columns 113–114. 119. The W1-band profile-weighted number of WISE exposures used in the “unWISE” coadd images for this source. This is analogous to a depth measurement. 120–121. The W1-band profile-weighted flux from other sources within the PSF of this source, and the profile-weighted fraction of flux from external sources for this source. 122. The W1-band number of pixels included in the PSF fit for this source. 123–132. The W2-band ( ) data conforming to the descriptions in columns 113–122. 133. A matching flag for objects in the FIRST catalog. The maximum matching radius was . A value of 1 (0) indicates the object did (did not) have a match in the FIRST catalog. 134–135. The peak flux density and flux density signal-to-noise ratio at cm in units of mJy. See §VII.4. 136. The matching separation in arcsec between the SDSS and FIRST objects. 137–138. The J-band magnitude and magnitude error from the 2MASS point source catalogs (Cutri et al. 2003). Objects used a maximum matching radius of . Magnitudes are in the Vega system. 139–140. The J-band signal-to-noise ratio and photometric read flag that records the default magnitude origins. See https://old.ipac.caltech.edu/2mass/releases/allsky/doc/sec2_2.html 141–144. H-band data conforming to the descriptions in columns 137–140. 145–148. -band data conforming to the descriptions in columns 137–140. 149. The matching separation in arcsec between SDSS and 2MASS objects. 150. The 2RXS ID number designating unique objects. 151–152. The right ascension and declination of the 2RXS source in decimal degrees (J2000). 153–154. The source flux and source flux error in the 0.5–2.0 keV band in , as described in Boller et al. 2016. and dereddened. 155. The matching separation in arcsec between SDSS and 2RXS objects. 156. The XMM-Newton Source designation ID. 157–158. The right ascension and declination of the XMM-Newton source in decimal degrees (J2000). 159–160. The X-ray flux and flux error for the 0.2–2.0 keV energy band in . 161–162. The X-ray flux and flux error for the 2.0–12.0 keV energy band in . 163-164. The total X-ray flux and flux error for the full energy range (0.2–12.0 keV) in . 165. The total X-ray luminosity for the full energy range (0.2–12.0 keV) in . 166. The matching separation in arcsec between SDSS and XMM-Newton objects. 167. A matching flag for objects that appeared in the Gaia DR2 catalog. Objects were matched using a maximum radius of . A value of 1 (0) indicates the object did (did not) have a match in the Gaia catalog. 168. The unique Gaia designation. 169–170. The Gaia DR2 barycentric right ascension and declination in decimal degrees (J2015.5). 171–172. The Gaia absolute stellar parallax and parallax error (J2015.5). 173–174. The proper motion and standard error of proper motion for right ascension in (J2015.5). 175–176. The proper motion and standard error for declination in the same form as columns 173–174. 177–178. The mean magnitude and mean flux over standard deviation for the Gaia G-band in the Vega magnitude system. 179–180. BP-band data conforming to the descriptions in columns 177–178. 181–182. RP-band data conforming to the descriptions in columns 177–178. 183. The matching separation in arcsec between SDSS and Gaia DR2.
IX Conclusion
In this paper, we detail DR16Q, the final SDSS-IV/eBOSS quasar catalog. The catalog consists of two subcatalogs: the DR16Q superset containing 1,440,615 observations targeted as quasars, and the quasar-only set containing 750,414 quasars. The quasar-only catalog includes 225,082 new quasars observed after the release of DR14Q, a 42% increase in the catalog size. We estimate the quasar-only catalog to be 99.8% complete with 0.3–1.3% contamination. We include automated pipeline redshifts for all quasars observed as part of SDSS-III/IV and confident visual inspection redshifts for 320,161 quasars. DLAs and BALs were identified and measured by automated algorithms and the quasar-only catalog includes 35,686 DLAs and 99,856 spectra with . DR16Q includes homogeneous redshifts derived using principal component analysis, including six separate emission line PCA redshifts. Finally, DR16Q includes multi-wavelength matching to GALEX, UKIDSS, WISE, FIRST, 2MASS, ROSAT/2RXS, XMM-Newton and Gaia.
SDSS-IV/eBOSS observations are now complete and SDSS-V (Kollmeier et al. 2017) will target far fewer quasars than SDSS-IV. DR16Q is therefore likely to remain the most significant compilation of SDSS quasars for quite some time to come.
Acknowledgements
BWL, JNM, and ADM were supported by the U.S. Department of Energy, Office of Science, Office of High Energy Physics, under Award Number DE-SC0019022. ANH is supported by The University of Wyoming Science Initiative Wyoming Research Scholars Program and was funded by Wyoming NASA Space Grant Consortium, NASA Grant #NNX15AI08H.
Funding for the Sloan Digital Sky Survey IV has been provided by the Alfred P. Sloan Foundation, the U.S. Department of Energy Office of Science, and the Participating Institutions. SDSS-IV acknowledges support and resources from the Center for High-Performance Computing at the University of Utah. The SDSS web site is www.sdss.org. In addition, this research relied on resources provided to the eBOSS Collaboration by the National Energy Research Scientific Computing Center (NERSC). NERSC is a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231.
SDSS-IV is managed by the Astrophysical Research Consortium for the Participating Institutions of the SDSS Collaboration including the Brazilian Participation Group, the Carnegie Institution for Science, Carnegie Mellon University, the Chilean Participation Group, the French Participation Group, Harvard-Smithsonian Center for Astrophysics, Instituto de Astrofísica de Canarias, The Johns Hopkins University, Kavli Institute for the Physics and Mathematics of the Universe (IPMU), University of Tokyo, the Korean Participation Group, Lawrence Berkeley National Laboratory, Leibniz Institut für Astrophysik Potsdam (AIP), Max-Planck-Institut für Astronomie (MPIA Heidelberg), Max-Planck-Institut für Astrophysik (MPA Garching), Max-Planck-Institut für Extraterrestrische Physik (MPE), National Astronomical Observatories of China, New Mexico State University, New York University, University of Notre Dame, Observatário Nacional, MCTI, The Ohio State University, Pennsylvania State University, Shanghai Astronomical Observatory, United Kingdom Participation Group, Universidad Nacional Autónoma de México, University of Arizona, University of Colorado Boulder, University of Oxford, University of Portsmouth, University of Utah, University of Virginia, University of Washington, University of Wisconsin, Vanderbilt University, and Yale University.
References
Appendix A Statistical uncertainties in pipeline and PCA redshifts
Fig. 9 shows the distribution of the statistical uncertainty for and together with a redshift-dependent Gaussian distribution following the eBOSS requirements listed in Dawson et al. 2016 for “low” () and “high” redshift () quasars Specifically: §3.2, requirement 1, of Dawson et al. 2016.. As noted in §IV.6, the actual distribution of redshift uncertainty contains tails extending to , which are not captured by a single Gaussian model. Therefore, we considered a more realistic model based on a double-Gaussian profile (see the black curve in Fig. 4) defined by:
where both Gaussian functions are centered on zero. The resulting fit to the data gives , , and . We kept the shape of this distribution fixed with redshift. A detailed study of the impact of this modeled, double-Gaussian redshift uncertainty on the cosmological parameters, using N-body mock catalogs, is presented in Smith et al. 2020. In addition, the clustering analyses presented in Hou et al. 2020 incorporated this redshift uncertainty when deriving cosmological parameters. Based on the Hou et al. and Smith et al. analyses, the total errors (statistical and systematic) of and meet the eBOSS requirements detailed in Dawson et al. 2016, provided that we model the shape of the redshift accuracy and precision using Eqn. A1.
As detailed in §IV.6, we found that the catastrophic failure rate for DR16Q quasar redshifts is of order 1%, meeting the requirements quoted in Dawson et al. 2016. In Smith et al. 2020, the effect of the catastrophic failures was implemented in N-body mock catalogs, and the impact of these is studied on cosmological constraints. They found that even a catastrophic failure rate of over 1% is sufficiently small that constraints on the cosmological parameters from eBOSS quasars are unaffected.
Appendix B Interesting spectra
DR16Q includes a wide range of illustrative quasar spectra. We have chosen to include four such interesting, unusual, or informative spectra in this appendix. For all of the spectra plotted here, the line rest wavelengths were taken from Table 2 of Vanden Berk et al. 2001.
In Fig. 10, we present the spectrum of an Iron Low-Ionization Broad Absorption Line (FeLoBAL) quasar discovered during the random visual inspections. For more information on these unusual objects see §5.2 and Fig. 6 of Hall et al. 2002.
DR16Q includes many BAL quasars. In Fig. 11 we present a quasar that shows BAL features. These BAL features were identified by the algorithm described in §V.2. The spectrum also displays two emission lines that are often weak in quasars, O I (labeled) and C II (unlabeled).
The BAL algorithm described in §V.2 focuses on C IV and Si IV features. In Fig. 12 we present a different type: an Mg II BAL. This spectrum was not identified by the BAL algorithm as the quasar is not at a high enough redshift for C IV or Si IV to be in the SDSS observable wavelength range.
SDSS-III/BOSS and SDSS-IV/eBOSS focused, in part, on studies of the Ly forest using quasars. In Fig. 13 we include a spectrum of one such target that has a clearly visible Ly forest. This spectrum highlights some rarer emission features and a weak Lyman limit.
Appendix C Issues from Previous Quasar Catalogs
As large scale usage of the SDSS quasar catalogs has increased over time, bugs have been discovered within previous iterations of these catalogs. Documented bugs and other issues that appeared in the twelfth and fourteenth catalogs have been corrected for this iteration of the quasar-only and superset catalogs. We list the known issues below. All issues listed have been corrected in the most recent version of the catalogs released: DR16Q_v4 and DR16Q_Superset_v3 with two exceptions explained below.
(DR12Q) Incorrect astrometry for DR12Q objects.
DR12Q-added objects now use the current astrometric coordinates for BOSS objects.
(DR12Q) Absolute i-band magnitudes were incorrectly calculated. K-corrections were only done to the continuum and did not include emission line corrections. Additionally it appears the set cosmology parameters used was not either of the two sets published in the paper.
K-correction values were correctly applied and cosmology parameters match those listed in DR16Q.
(DR12Q, DR14Q) Spectra with ZWARNING flags for UNPLUGGED or BAD_TARGET were included.
All records with these ZWARNING flags have been removed.
(DR14Q) Opening DR14Q reports a “VOTable opening error.”
VOTable errors have been corrected and the first table HDU in the FITS files have been named “CATALOG.”
(DR14Q) DUPLICATE fields are populated with errant -1 values at every other position.
DUPLICATE fields have been populated with the correct PLATE, MJD, FIBERID, and SPECTRO values.
(DR14Q) SDSS names incorrectly reported due to erroneous rounding errors.
SDSS names are now correctly truncated, rather than rounded.
The column has been renamed to OBJID to match other SDSS catalogs, and has been populated for BOSS and eBOSS objects. OBJID values for SDSS-I/II quasars have been included where they were available.
(DR14Q) GALEX_MATCHED and UKIDSS_MATCHED are recorded as floating numbers instead of integers.
These two fields are now recorded as integers, and use 0 or 1 values to denote no-match or a match respectively.
(DR14Q) FIRST_MATCHED uses incorrect values.
The FIRST_MATCHED column now uses 0 or 1 to denote a match.
(DR14Q) Records with no XMM or 2MASS match are blank.
Quasars with no match in XMM or 2MASS now have -1 values rather than blank entries.
(DR14Q) The following columns all had zero values or were empty: RUN_NUMBER, COL_NUMBER, RERUN_NUMBER, FIELD_NUMBER, SPECTRO_DUPLICATE.
These columns have been correctly populated.
(DR14Q) N_SPEC values did not match the number of additional spectra due to incorrect population of -1 values in the DUPLICATE fields (see #5 above).
The NSPEC fields have been populated correctly and renamed.
(DR14Q) Hyphens and periods appear in some column names. These may cause FITS reader programs to report errors.
All column names with hyphens or periods have been renamed to remove these punctuation marks. All columns now only use alphanumeric characters and underscores.
(DR14Q) Some TUNITS FITS header cards do not match the reported units.
All TUNITS header cards have been removed. Refer to this paper or the datamodel https://data.sdss.org/datamodel/files/BOSS_QSO/DR16Q/ for the correct units.
(DR14Q) The Z_ERR column did not contain errors for pipeline redshifts as reported.
(DR14Q) The ZWARNING column was not populated.
The ZWARNING column has been correctly populated for BOSS and eBOSS quasars.
(DR16Q) Six known quasars from DR7Q were not added to DR16Q and could not be included without affecting other SDSS projects in progress. These quasars can be found in the Science Archive Server (SAS) under the following PLATE-MJD-FIBERID combinations: 901-52641-307, 1194-52703-58, 1611-53147-507, 1768-53442-57, 1948-53388-42, 2784-54529-73.