NASA Data Center Annual Program Plan

Program Year: FY 2004 
Data Center/Service: Multi-mission Archive at Space Telescope (MAST)
(Optical/UV Science Archive Research Center) 
Supporting Organization: Space Telescope Science Institute
3700 San Martin Drive
Baltimore, MD 21218

Overall Mission:  MAST supports active and legacy mission data sets and related catalogs and surveys, focusing primarily on data in the ultraviolet, optical, and near-IR parts of the spectrum. Support includes curation of the data, providing expert support to users of the data, providing access to data-specific calibration and analysis software, providing user support for this software, and maintaining public access interfaces to the data. MAST works with new mission teams in the supported wavelength regions to assist in the development of data management plans, especially in the areas of data formats, descriptive metadata and standardization of keywords, in the development of data access and delivery plans, and assuring data quality control.

MAST Data Holdings

Name Size Number of Observations Active Mission Duration
ACTIVE MISSIONS
FUSE 313.492 GB 2799 1999-
HST 13.956 TB 426,688 1990-
LEGACY MISSIONS
ORFEUS: BEFS 4.1 GB 332 Sept. 1993; Nov. 1996
ORFEUS: IMAPS 0.3 GB 643 Sept. 1993; Nov. 1996
ORFEUS: TUES 0.2 GB 229 Nov. 1996
EUVE 96 GB 1377 1992-Jan. 2001
ASTRO: UIT 56 GB 1,442 Dec. 1990; March 1995
ASTRO: HUT 0.6 GB 516 Dec. 1990; March 1995
ASTRO: WUPPE 0.1 GB 238 Dec. 1990; March 1995
IUE Final Archive 475 GB 103,552 1978-1996
IUE SIPS 125 GB 104,296 1978-1996
Copernicus 0.8 GB 551 1972-1981
CATALOGS & SURVEYS
SDSS: Early Data Release 1 TB n/a 1998-
VLA-FIRST 109 GB 14,940 1993-
Digitized Sky Surveys 5 TB n/a 1950-58, 1975-99
GSC I, II 2 TB n/a 1950-58, 1975-99

Services Provided: MAST provides support for users seeking to understand the properties and instrumental signatures of all archived data sets and assistance with the interfaces to browse and retrieve these data. Access to non-HST mission and instrument specific calibration and analysis software and assistance in its use continues is on a time-available basis. Full support for HST related software is provided by the MAST Help Desk and staff.

Non-HST Data Analysis Software Provided: IUE "RDAF" package (IDL-based), IUE Final Archive processing software (IRAF port), EUVE analysis software package (IRAF-based), Copernicus data analysis software (IDL-based), UIT data reduction/analysis software (FORTRAN, C, and IDL routines), WUPPE data analysis software (FORTRAN routines requiring the FITSIO library), and HUT data reduction software (IRAF-based) are available through MAST.

Mission Interfaces:

Interoperability Activities: MAST is working with the Astrophysics Data Center (ADEC) on a project to build a simple interoperability framework among the NASA astronomical data centers referring service in a web-based search in a Web-based search, pointing MAST users to relevant data at other data centers and alerting users at these other centers of MAST data that may be of interest. This project has the immediate goal of improving the interaction between data centers and of laying the framework for the National Virtual Observatory.



ACTIVITIES AND MAJOR ACCOMPLISHMENTS OF THE LAST YEAR

Data Ingests and Retrievals: The combined active mission (HST, FUSE) annual data ingest rate increased markedly to 5.8 TB, raising the total to 14.0 TB. This upturn was due mainly to the addition of data from the ACS and NICMOS instruments, which started operations late in the previous year. For all major missions (active and archival) the number of requested datasets has increased over the past year. Over the last year a new data storage array was delivered to the Institute. Staff have completed the the migration of DADS data (HST, FUSE), as well as data previously stored in other media.

MAST Data Ingest & Retrieval Activity

Date Ingest Volume (GB) - Active Missions Retrieval Volume (GB) - Active Missions Retrieval Volume (GB) - Legacy Missions Datasets Retrieved - Active Missions Datasets Retrieved - Legacy Missions
Jun 2002 382.78 679.93 1.99 32699 7493
Jul 2002 401.14 970.65 4.43 45948 4087
Aug 2002 397.98 1122.59 62.75 46824 8995
Sep 2002 477.64 1148.02 3.11 40626 1855
Oct 2002 383.54 1176.66 2.28 47416 2267
Nov 2002 472.18 936.35 2.91 32675 1949
Dec 2002 480.44 1134.36 5.07 33559 2090
Jan 2003 459.73 1260.76 5.16 51208 5136
Mar 2003 484.29 1550.37 6.65 39247 2174
Apr 2003 436.17 1152.21 8.53 31791 10855
May 2003 487.73 1096.89 4.29 37218 4420
Jun 2003 446.17 1909.7 0.98 39898 1415
Feb 2003 524.00 1500.41 6.32 37260 6174
TOTALS5833.79 15638.90 114.44 516369 58910

*As MAST does not maintain retrieval statistics for DSS and SDSS, the number of searches are displayed to show the interest level in these datasets.

"FastAccess Service": The large size of ACS files poses logistical problems for transfer of these files to users. Staff members created a FastAccess" area on the MAST website from which users can retrieve popular and non-proprietary ACS files via ftp, including ACS Early Release Observations (ERO) and the Great Observatories Origins Deep Survey (GOODS) observations. This service also reduces the number of requests made to the sometimes overloaded DADS retrieval system. All the GOODS observations were completed May 27, 2003. The FastAccess service was a great success with over 900 unique computer domains (users) retrieving over 1.2 TB of data (25,000+ files) over the past year. Near the end of the year, the ACS/ERO and some of the GOODS data were temporarily removed from the FastAccess area due to lack of space on the new RAIDTEC staging array. The data are now available from the new EMC storage area.

New Storage Media: A 32 Terrabyte RAID array purchased from the EMC Corporation will serve as the new primary storage/backup medium for all DADS, MAST, and GALEX datasets (as well as a staging area for OTF and OPUS operations). A RAIDTEC array purchased the previous year is now being used for FastAccess data (see below) and as a staging area for DADS retrievals.

Improved MAST Services:

Data Discovery/Search Tools: Scrapbook and Pointings Table: STIS and NICMOS images were added to the Spectral/Imaging Scrapbook. New datasets are added to the Scrapbook table each month from HST and FUSE observations. Data for active instrument missions, such as for STIS, WFPC2, and NICMOS, are added weekly the Pointings Table.

This chart shows the number of times each tool was used for a search or display over the past year.

High Level Science Products (HLSP):

User Interface Enhancements:

The Astrophysical Data Centers Executive Council: MAST has played an active role within the ADEC to coordinate and provide common standards for the data services of NASA's astronomical data archive centers. Acting on request from NASA/OSS's Science Archive Working Group, the ADEC wrote and submitted a white paper on "NASA Science-Archive Interoperabililty" Acting on Headquarters request, the ADEC wrote and submitted a white paper on "NASA Science-Archive Interoperabililty" to NASA Headquarters (no formal response, as of this writing).

Literature Links: The publications database and the links between scientific papers and the MAST datasets they link to were regularly updated as new citations became available through the ADS. About 1/8 of all papers utilizing MAST datasets referred to more than one mission.

Press Releases from MAST Data (HST-archival only):



PLANS FOR COMING YEAR

New datasets:

New services for archival research:


Thumbnail of GALEX data "return page" from querying on an observed object (data are simulated). Click on thumbnail for larger version or go to the site.

Coordination activities:

Continued Services to Archival Researchers:

Drafting of next senior review proposal to NASA.
This document will detail MAST activities over the last four years and describe plans for the future.