Announcements
Mission Overview
Cluster Difference Imaging Photometric Survey (CDIPS)
Primary Investigator: Luke Bouma
HLSP Authors: Luke Bouma
Released: 2019-10-04
Updated: 2023-11-22
Primary Reference(s): Bouma et al. (2019)
Citations: See ADS Statistics
Overview
The TESS mission has been releasing full-frame images recorded at 30 minute cadence. Using the TESS images, the CDIPS team has begun a Cluster Difference Imaging Photometric Survey (CDIPS), in which they are making light curves for stars that are candidate members of open clusters and moving groups. They have also included stars that show photometric indications of youth. Each light curve represents between 20 and 25 days of observations of a star brighter than Gaia RP magnitude of 16. The precision of the detrended light curves is generally in line with theoretical expectations.
The pipeline is called "cdips-pipeline", and it is available for inspection as a GitHub repository, and should be cited as an independent software reference (Bhatti et al., 2019, http://doi.org/10.5281/zenodo.3370324).
Before using the light curves, the team strongly recommends that you become familiar with the TESS data release notes, and also consult the TESS Instrument Handbook, available at MAST (http://archive.stsci.edu/tess/).
The team has also created a catalog of target metadata, such as cluster name, cluster membership provenance, Gaia magnitudes, and parallax values. The catalog is available as a .csv file in the Data Access section.
DR6 CONTENTS
The sixth CDIPS data release (2023-11-22) comprises the third and fourth cycles of TESS observations (Sectors 27-39 and Sectors 40-55). Cycle 3 began in July 2020 and ended in June 2021. Cycle 4 began in June 2021 and ended in September 2022. The Cycle 3 CDIPS data include 538,375 light curves, for 475,253 unique stars. Cycle 4 includes 680,065 light curves, for 249,204 unique stars. As in previous data releases, the target stars include age-dated and age-dateable stars within one kiloparsec of the Sun. The target star catalog is a metacatalog of stars known to be in open clusters, moving groups, and stellar associations. Some stars that are known to be photometrically or spectroscopically young are also included. The target star catalog is published as Table 3 of Bouma et al. (2022), and the literature sources used to create this list are given in Table 4 of the same manuscript. The evolution of the target star catalog over previous data releases is described in the "Read Me" at the top of this page. The reduction methods are described by Bouma et al. (2019), as well as in the aforementioned "Read Me" file.
DR5 CONTENTS
The fifth CDIPS data release (2022-04-25) comprises the second year of TESS observations. It contains 559,641 light curves of target stars that fell on silicon during TESS Sectors 14 through 26. The target star list of young, age-dated, and age-dateable stars extends to GRP<16, and has significantly improved due to the latest parallaxes and kinematics from the Gaia satellite (see README for further details on the target selection). A cumulative metadata file of all light curves available from Sectors 1 through 26 is available under "Catalog File" below. This file also contains the latest information about cluster membership for any given source with a light curve.
DR4 CONTENTS
The fourth CDIPS data release (2020-08-25) contains 26,956 light curves of target stars that fell on silicon during TESS Sectors 1 through 5. Sectors 1 through 4 look away from the galactic plane, and so there are fewer young stars than in Sectors 5-13. Some of the Orion complex is visible in Sector 5.
DR3 CONTENTS
The third CDIPS data release (2020-05-07) contains 130,215 light curves of target stars that fell on silicon during TESS Sectors 12 and 13.
DR2 CONTENTS
The second CDIPS data release (2019-12-09) contains 355,380 light curves of target stars that fell on silicon during TESS Sectors 8, 9, 10 and 11. Combined with DR1, Galactic longitudes from ~190 to 320 degrees are covered, totalling about half a million stars brighter than Gaia RP of 16. The reduction methods used for the second release are identical to those from Bouma et al. (2019), except as noted in the CDIPS README file. Target stars have had claims of youth in the literature. Their light curves are amenable for studies in stellar and exoplanetary astrophysics.
DR1 CONTENTS
The first CDIPS data release (2019-10-02) contains 159,343 light curves of target stars that fell on silicon during TESS Sectors 6 and 7. They cover about one sixth of the Galactic plane. The target stars are described and listed in Bouma et al. (2019). They are stars for which a mix of Gaia and pre-Gaia kinematic, astrometric, and photometric information suggest either cluster membership or youth.
Data Products
Each target's lightcurve file is stored in a sub-directory based on the Sector it was observed in, as a four-digit, zero-padded string preceded by an "s". They are further divided into sub-directories based on the camera and CCD number they are on. For example, "s0014/cam1_ccd1/" for Sector 14 lightcurves that are on Camera 1 CCD 1.
The light curves are in a FITS format familiar to users of the Kepler, K2, and TESS-short cadence light curves made by the NASA Ames team. Their file names follow this convention:
hlsp_cdips_tess_ffi_gaiatwo<gaiaid>-<sector>-<cam>-<ccd>_tess_v01_llc.fits
where:
- <gaiaid> = The full Gaia DR2 target id, e.g., "0002080749378172930816".
- <sector> = The Sector represented as a 4-digit, zero-padded string, preceded by an "s", e.g., "s0014" for Sector 14.
- <cam> = The camera number (1-4), e.g., "cam1" for Camera 1.
- <ccd> = The CCD number (1-4) for that camera, e.g., "ccd1" for CCD 1.
The catalog of target metadata is stored at the top level, and follows this format:
hlsp_cdips_tess_ffi_<sector-start>-<sector-end>_tess_v01_catalog.csv
where:
- <sector-start> = The first TESS Sector that has target light curves, e.g., "s0001"
- <sector-end> = The last TESS Sector that has target light curves, e.g., "s0026"
Data file types:
_llc.fits | Extracted light curve file |
_catalog.csv | Catalog of source metadata such as cluster names, cluster membership provenance, Gaia magnitudes, and parallax values; NOTE: the catalog uses semi-colon (;) characters as a delimiter for columns |
Catalog Metadata Columns
Click the blue [+] to see the list of catalog metadata.
A catalog of target metadata, such as cluster name, cluster membership provenance, Gaia magnitudes, and parallax values, is also provided. NOTE: The catalog file is delimited by semi-colon (;) characters, while commas (,) are used for some columns that have multiple values. The catalog has the following columns:
Column Name | Description |
---|---|
path | String containing sector, camera, ccd, and source_id for star with CDIPS light curve. |
dr2_source_id | Star's Gaia DR2 source identifier. |
sector | TESS Sector for star with CDIPS light curve. |
cam | Camera number for star with CDIPS light curve. |
ccd | CCD number for star with CDIPS light curve. |
dr2_ra | Stellar decimal right ascension, unit degree, source Gaia DR2. |
dr2_dec | Stellar decimal declination, unit degree, source Gaia DR2. |
dr2_parallax |
Stellar parallax, units mas, source Gaia DR2. |
dr2_parallax_error |
Stellar parallax uncertainty, units mas, source Gaia DR2. |
dr2_pmra | Stellar proper motion in RA* direction, units mas/yr, source Gaia DR2. |
dr2_pmdec | Stellar proper motion in DEC direction, units mas/yr, source Gaia DR2. |
dr2_phot_g_mean | Stellar Gaia G magnitude, source Gaia DR2. |
dr2_phot_rp_mean |
Stellar Gaia Rp magnitude, source Gaia DR2. |
dr2_phot_bp_mean | Stellar Gaia Bp magnitude, source Gaia DR2. |
cluster | ','-separated string of cluster names for which this star has been reported to be a member |
age |
','-separated logarithm (base-10) of reported age in years |
mean_age |
Mean (ignoring NaNs) of the age column |
reference_id | ','-separated string of literature references that reported the star's cluster membership. |
reference_bibcode |
ADS bibcode corresponding to reference_id |
Light Curve FITS File Format
Click the blue [+] to see the format of the data files FITS header.
The primary header contains information about the target star, including the catalogs that claimed cluster membership or youth ("CDIPSREF"). Membership claims based on Gaia DR2 data are typically the highest quality claims. Cross-matches against TICv8 and Gaia-DR2 are also included.
The sole binary table extension contains the light curves. Three aperture sizes are used:
- APERTURE1 = 1 pixel in radius
- APERTURE2 = 1.5 pixels in radius
- APERTURE3 = 2.25 pixels in radius
Three different types of light curves are available. The first is the raw "instrumental" light curve measured from differenced images. The second is a detrended light curve that regresses against the number of principal components noted in the light curve's header. The third is a detrended light curve found by applying TFA with a fixed number of template stars. The recommended time stamp is "TMID_BJD", which is the exposure mid-time at the barycenter of the solar system (BJD), in the Temps Dynamique Barycentrique standard (TDB). For further details, please see Bouma et al. 2019, or contact the authors.
The full set of available time-series vectors is as follows:
- TTYPE1 = 'BGE ' / Background measurement error
- TTYPE2 = 'BGV ' / Background value (after bkgd surface subtrxn)
- TTYPE3 = 'FDV ' / Measured D value (see Pal 2009 eq 31)
- TTYPE4 = 'FKV ' / Measured K value (see Pal 2009 eq 31)
- TTYPE5 = 'FSV ' / Measured S value (see Pal 2009 eq 31)
- TTYPE6 = 'IFE1 ' / Flux error in aperture 1 (ADU)
- TTYPE7 = 'IFE2 ' / Flux error in aperture 2 (ADU)
- TTYPE8 = 'IFE3 ' / Flux error in aperture 3 (ADU)
- TTYPE9 = 'IFL1 ' / Flux in aperture 1 (ADU)
- TTYPE10 = 'IFL2 ' / Flux in aperture 2 (ADU)
- TTYPE11 = 'IFL3 ' / Flux in aperture 3 (ADU)
- TTYPE12 = 'IRE1 ' / Instrumental mag error for aperture 1
- TTYPE13 = 'IRE2 ' / Instrumental mag error for aperture 2
- TTYPE14 = 'IRE3 ' / Instrumental mag error for aperture 3
- TTYPE15 = 'IRM1 ' / Instrumental mag in aperture 1
- TTYPE16 = 'IRM2 ' / Instrumental mag in aperture 2
- TTYPE17 = 'IRM3 ' / Instrumental mag in aperture 3
- TTYPE18 = 'IRQ1 ' / Instrumental quality flag ap 1, 0/G OK, X bad
- TTYPE19 = 'IRQ2 ' / Instrumental quality flag ap 2, 0/G OK, X bad
- TTYPE20 = 'IRQ3 ' / Instrumental quality flag ap 3, 0/G OK, X bad
- TTYPE21 = 'RSTFC ' / Unique frame key
- TTYPE22 = 'TMID_UTC' / Exp mid-time in JD_UTC (from DATE-OBS,DATE-END)
- TTYPE23 = 'XIC ' / Shifted X coordinate on CCD on subtracted frame
- TTYPE24 = 'YIC ' / Shifted Y coordinate on CCD on subtracted frame
- TTYPE25 = 'CCDTEMP ' / Mean CCD temperature S_CAM_ALCU_sensor_CCD
- TTYPE26 = 'NTEMPS ' / Number of temperatures avgd to get ccdtemp
- TTYPE27 = 'TMID_BJD' / Exp mid-time in BJD_TDB (BJDCORR applied)
- TTYPE28 = 'BJDCORR ' / BJD_TDB = JD_UTC + TDBCOR + BJDCORR
- TTYPE29 = 'TFA1 ' / TFA Trend-filtered magnitude in aperture 1
- TTYPE30 = 'TFA2 ' / TFA Trend-filtered magnitude in aperture 2
- TTYPE31 = 'TFA3 ' / TFA Trend-filtered magnitude in aperture 3
- TTYPE32 = 'PCA1 ' / PCA Trend-filtered magnitude in aperture 1
- TTYPE33 = 'PCA2 ' / PCA Trend-filtered magnitude in aperture 2
- TTYPE34 = 'PCA3 ' / PCA Trend-filtered magnitude in aperture 3
NOTE: a very small number of targets fall on more than one camera-chip combination in a given Sector. In these cases, there are multiple files produced. One example is Gaia DR2 2075378156488866560 in Sector 14, which falls on both Camera 1 CCD 1 and Camera 2 CCD 4, and thus has two files: /s0014/cam1_ccd1/hlsp_cdips_tess_ffi_gaiatwo0002075378156488866560-s0014-cam1-ccd1_tess_v01_llc.fits, /s0014/cam2_ccd4/hlsp_cdips_tess_ffi_gaiatwo0002075378156488866560-s0014-cam2-ccd4_tess_v01_llc.fits
Data Access
Catalog File
The cumulative DR6 catalog file can be downloaded directly here: hlsp_cdips_tess_ffi_s0001-s0055_tess_v01_catalog.csv
Each catalog supersedes previous catalogs, however, for historical purposes previous catalogs can be found below.
The catalog file can be used to select light curves for a specific cluster, as reported by specific authors in the literature. For example, to select all the CDIPS light curves for members of NGC 2516 reported by Cantat-Gaudin et al. (2018), one could do the following in Python (click Expand to see sample script):
import pandas as pd
# Read in the catalog.
df = pd.read_csv('hlsp_cdips_tess_ffi_s0001-s0026_tess_v01_catalog.csv', sep=';', low_memory=False)
# Create the mask to select only Observations for members of NGC 2516, reported by Cantat-Gaudin et al. (2018).
sel = ( df.reference_id.str.contains('CantatGaudin2018a') & df.cluster.str.contains('NGC_2516') )
# Apply mask to pandas data frame.
df_ngc2516 = df[sel]
This yields 4992 light curves for 876 unique stars observed over the first year of TESS, with an average of ~5 sectors per star. Given the list of source_ids, MAST can then be queried for the light curves (for example, using astroquery).
Astroquery Example
CDIPS data products are available in the MAST Portal and via astroquery.mast. For those who want to download light curves for a single target, or all light curves for a given Sector, see the following Python code example below. NOTE: There are (up to) tens of thousands of light curves for a given Sector, thus downloading all of the products can take the better part of a day, even with a good internet connection. By default, the light curve files will be downloaded under a folder called "mastDownload" in the same working directory that you run the Python script from. Expand the box below for a sample script.
from astroquery.mast import Observations
# Search for CDIPS light curves within 0.001 degrees of V684 Mon.
obs_table = Observations.query_criteria(objectname="V684 Mon", radius=".001 deg", provenance_name="CDIPS")
print("Found " + str(len(obs_table)) + " CDIPS light curves.")
# Get list of available products for this Observation.
cdips_products = Observations.get_product_list(obs_table)
# Download the products for this Observation.
manifest = Observations.download_products(cdips_products)
# Search for CDIPS light curves directly based on TIC ID.
ticid = '210400528'
obs_table = Observations.query_criteria(target_name=ticid, provenance_name="CDIPS")
print("Found " + str(len(obs_table)) + " CDIPS light curves.")
# Get list of available products for this Observation.
cdips_products = Observations.get_product_list(obs_table)
# Download the products for this Observation.
manifest = Observations.download_products(cdips_products)
# Get all CDIPS light curves for a given Sector.
# May not work depending on bandwidth and traffic; we suggest you use bulk download scripts instead.
sector_num = '21'
print('Querying for CDIPS Sector ' + sector_num + " Observations...")
obsTable = Observations.query_criteria(provenance_name = "CDIPS", sequence_number = sector_num)
print("Found a total of " + str(len(obsTable)) + " CDIPS targets.")
print('Downloading data products for these observations...')
for obs in obsTable:
data_products = Observations.get_product_list(obs)
Observations.download_products(data_products)
NOTE: The final query example provided above can timeout for some users (due to internet bandwidth or traffic on the database at MAST). If this occurs, an alternative is to use the bulk download scripts, which will download products via cURL commands given the complete list of CDIPS targets for a given Sector.
-
A web-based interface for cross-mission searches of data at MAST or the Virtual Observatory. Download CDIPS light curves for a few targets.
-
Search for, and retrieve, CDIPS data products programmatically based on a list of coordinates or target names. You can also search by Sector.
-
Each Sector of CDIPS files is available to download through a set of cURL commands that will download each light curve sequentially.