This page describes how to use the HST Science Search form and describes the individual fields in that form.
Use the HST Science Search form to search the HST Archive Catalog
by object name, position, observation date, proposal ID, wavelength,
and data type. You can also mark data for retrieval using this interface.
This interface can retrieve data either to the archive staging area
or directly to the destination you specify, so you can retrieve proprietary data
(if you're priveleged to do so). To allow you to safely enter a destination
username and password, we use the same security mechanism as many
commercial sites.
The name of a local file containing a table or list of
parameters such as coordinates, targets names, or data IDs
to be uploaded to the server
and used to query the database. The file must be an ASCII text
file with either one entry per line (e.g., a target name, a Data ID,
or a set of coordinates), or a table separated with one
of the allowed delimiters, with targets, Data IDs, or RA and Dec values in the
designated columns. Note in either case, only one entry per line is
extracted. If, for example, a comma-separated list of target names
is downloaded in one line, only the value in the designated column
will be used.
The search script will perform a database search for each
extracted Data ID, target, or set of coordinates, contained in
the uploaded list. Target names will be resolved to coordinates.
If a resolver error occurs with target names,
the search will abort and the compiled results displayed.
Coordinates may be given in several formats including
sexigesimal and decimal degrees.
If the output is requested in CSV or Excel spreadsheet
format, a blank line will be used to distinguish the results of
one target search from another. VOTable format incorporates
separate RESOURCE tags for each database query.
Use the other form entries to specify field delimiters,
RA, DEC, or Target column numbers (when the file contains a table
of values), and file contents (target names or coordinates).
The browse button allows users to seach local directories to
locate files.
Warning: Since uploading long lists can take a while to run,
uploaded files are limited to 10,000 entries.
Specifies contents of the local file to be uploaded (e.g.,
coordinates, target names or Data ID's). By default,
most MAST search forms assume coordinates.
Note that each target, or set of coordinates
specified in the uploaded file, is treated as a
separate query. The results are displayed as each query is run. If
however Data ID's are entered (up to 10,000 are allowed),
it is processed as a single query
(e.g., select * where data_id in (did1,did2,...).
To avoid displaying column names after each target name or coordinate
query, consider using the comma-separated values output format.
Also keep in mind that not all target names are resolvable. For example,
SIMBAD currently does not reolve most 2MASS IDs.
The column number containing either the Data ID, Right Ascension (decimal degrees or
sexagesimal), or target name (depending on how file_contents is set).
The default is to assume the first column is to be used.
For forms allowing coordinates as input, the
column number containing the Declnation (decimal degrees or sexagesimal).
The default is to assume the second column contains the DEC value.
If the file contents is set to Target Name or any Data ID, this
parameter is ignored.
The character used to delimit table entries in the uploaded
file. Allowed values include tabs( ), commas(,), vertical bar (|),
or semi-colons(;).
The default is to assume tabs are the delimiters.
If the file contains only a single column, use tabs as the delimiter.
The name of the astronomical object you want to search for. Examples
of valid names include gam Gem, NGC 1068, JUPITER, and hd 45677.
For Kepler, a sky-region limited mission, examples might be
14 Cyg, HR 7483, HD 181649, or NGC 6819.
Multiple target names can be entered if separated by commas, although
table sorting is turned off in these cases.
The Target Name is used in combination with the Resolver Field.
If the SIMBAD, CFA (SIMBAD at CfA), NED (default) or HLA name resolver options are
chosen, then coordinates returned from these services are used
to perform a cone search with the specified search radius.
For most mission searches, you do NOT have to use the resolver.
Choose the "Don't resolve"
option to perform string searches on the object name in the database.
Note Kepler catalogs do not include a generic object name field,
so this option is not available for Kepler users.
When you search on the object name in the database (i.e. without
using the name resolver), case will be ignored. The object name
will not be wildcarded at the front and back automatically
(that's so if you innocently enter IO,
you don't match things like ORION). You can however
wildcard the object name using *
(for example, *IO*). You can also enter
a comma-separated list; for example,
*JUP*,*SAT* would match object names containing
either JUP or SAT.
Note that most missions store some target names
in a format that is not compatible with the NED or SIMBAD
name resolvers. For example, most 2MASS IDs are currently not resolveable
by SIMBAD.
This field describes how target names are to be handled.
If you want to resolve a target name into its coordinates (the default),
this field can be used to describe which name resolver to use.
You can also elect to search the database by the target name itself
by choossing the "Don't resolve" option.
The two main name resolver services are SIMBAD and NED.
NED
is the NASA Extragalactic Database at Caltech in Pasadena, California, and
SIMBAD
is the Set of Identifications, Measurements, and Bibliography for
Astronomical Data at the Centre de Données astronomiques
in Strasbourg, France (SIMBAD at CDS).
A mirror site at the Center for Astrophysics
in Boston is also now available and is denoted as "SIMBAD at CFA".
NED is an extragalactic database, and generally won't
resolve object names within the Milky Way galaxy.
Because we occasionally have problems with network connections and web
servers, we now store previously resolved target names and coordinates
in our own local database and search this database before
trying to access the other name resolvers using various web services.
By default, If no entry is found in the local cache,
the entered object names will first be sent to the NED service,
and, if still not found, then CFA, CDS, and HLA in that order.
You may also go directly to CFA, CDS, or HLA by changing the
selected name resolver, although the local cache is always checked first.
If any error occurs, the search form will
be redrawn with an error message at the top. Otherwise, the returned
coordinates will then be used to search
the database, along with whatever other query qualifications you have given.
We recommend that you use object name resolution to find observations of specific
stationary targets. This is the most reliable way to look up observations,
because the observer could have given any object name
at all (for example, NGC1976 instead of M42, or PARALLEL-FIELD).
The SIMBAD and NED name resolvers can resolve only fixed objects;
they cannot compute the positions of moving objects (planets, comets, etc.).
To find moving objects, try selecting the appropriate category option available on most
MAST search forms, or as mentioned above, enter an object name that could match what you're
looking for, and select "Don't resolve" for the name resolver.
Note wild cards are allowed, so for Jupiter you might enter "*JUP*".
The Right Ascension and Declination values. If single values are
entered, a cone search is performed using the specified search radius
(default = 3 arcminutes for most missions, 0.02 arcmin. for Kepler).
Values may be entered in decimal degrees or using sexagesimal notation.
Although decimal hours is NOT an allowed input format, Right Ascension
search results may optionally be displayed as decimal hours
(see the "Output Coords" form element).
Note the examples listed below (and elsewhere) are only intended to
show the format of the form entries. There is no guarantee that entering
these specific values will return any search results.
You may also enter ranges of right ascension or declination,
using the ".." operator. For example, you can enter
21h 51m .. 21h 52m for the right ascension, and
28 51 .. 29 51 for the declination.
Comparators can also be used, i.e. ">", ">=", "<", "<=".
For example, "> 85" as a declination value will return
all observations with declination larger than 85 degrees.
(Note when ranges of coordinates are specified the search
radius will be ignored. Also, searches on ranges can be
quite time consuming.)
Coordinate values may be specified using a number of
formats. Examples of valid formats include:
Decimal Degrees
185.63325 29.8959861111111
Hours, minutes and Seconds
12 22 31.98 29 53 45.55
12h22m31.98s 29d53m45.55s
12:22:31.98 +29:53:45.55
12h22'31.98" 29d53'45.55"
12h 22m 31.98s 29d 53m 45.55s
12h 22' 31.98" 29d 53' 45.55"
12h 22' 31.98" -29d 53' 45.55"
12h22'31".98 -29d53'45".55
12h22m31s.98 -29o53m45s.55
12h 22' 31".98 -29d 53' 45".55
Hours/Degrees and Minutes (no seconds)
12 22 29 53
12h22m +29d53m
12h22m 29d53m
12:22m 29:53m
12h22' 29d53'
12h 22m 29d 53m
12h 22' 29d 53'
12h 22' -29d 53'
The RA may be given in decimal degrees by indicating
a D or d after the degrees:
12d 22m 29d 53m
Spacing is not important, as long as the value is unambiguous. You can
delimit the hours/degrees, minutes, and (optional) seconds with letters,
colons, spaces, or any character that's not a digit or a decimal point.
Like target names, multiple coordinates can be entered if separated by commas.
The radius of the search box around the RA and Dec, in floating-point arcminutes
(e.g., 5.0). You should be careful about giving too restrictive a search radius
since (for some missions) the coordinates of the object were given
by the Guest Observer, and may not reflect the precise pointing of the instrument
at the time of the observation.
The search routine computes the angular
separation between each result dataset and the search center so this really is
a circular radius. (Results are generally sorted on the angular separation by default.)
The equinox of the RA and Dec you have entered, either B1900,
B1950 or J2000.
If B1900 or B1950 are selected,
the input coordinates are precessed to year 2000,
but NOT converted to FK5 or ICRS. This will add an error which (from year 1900)
can range from a few arcseconds up to roughly 25" at the poles.
Note the precession is only applied to the input coordinates.
The coordinates displayed in the search
results will depend on the mission database and the selected output columns. (Note:
all MAST missions include J2000 coordinates as default output columns.)
If you enter a target name and use either the SIMBAD or NED name resolver,
the equinox will be set to J2000.
The date of the observation. More specifically, the date and time, in GMT, on which
the exposure was started. When specifying this date, you need to include a date and an optional time.
The date can have any of the following formats (the month name can be spelled out or abbreviated to three letters;
case is not significant):
If the day is omitted, the first day of the month is assumed. This means that a specification
like "July 1994" will look for observations done on July 1 1994 00:00:00,
not for observations done during July 1994. Note also that when entering a date with the month in
numerical format, the American ordeing is used; i.e., the first number is the month.
If a time is omitted, then midnight (00:00:00) is assumed.
Otherwise, you can specify a time in any of these formats:
14:30
14:30:20
14:30:20:999
14:30:20.9
4am
4 PM
04:30:20 AM
To search for observations before a given date, use <, and for observations
after a given date, use >. For example,
> Jul 15 1994
< Jul 15 1994
You can use the .. operator to search on a range of dates:
Jul 1 1994 .. Aug 1 1995
This operator is inclusive on the first date and exclusive on the second.
Finally, you can search on a list of dates or date ranges. For example,
Jul 1 1994 .. Jul 3 1994,
Dec 1 1995 .. Dec 6 1995
will search for observations done within either one of these date ranges.
The HST proposal number under which the observation was executed.
This can be a numeric ID or a comma-separated list of numeric IDs.
Any characters other than digits, commas, and spaces will cause an error message
to be displayed. For example, instead of searching for GO-5916,
simply specify 5916. Or to search for observations from either proposal
5410 or proposal 5916, specify 5410, 5916.
A short description of the target, supplied by the observer.
like target names, these may not always be reliable- one observer's
CLUSTER OF GALAXIES may be another's ELLIPTICAL-
but they are generally better than nothing (especially where solar system
objects are concerned; planet, asteroid, and comet names are more likely
to be spelled out in the target description than in the target name).
Every morning, we generate a list of all the target descriptions
currently in use. This list is linked back to the HST Science Search page, so you can read through this
list (or search it with your browser's find capability) and find datasets matching the description.
The dataset name is the unique identifier for an HST observation.
(For NICMOS and STIS, it can also represent an association of exposures.)
This value can be wildcarded using a *. When you specify a dataset
name, any instrument or wavelength specification will be ignored.
The observation set within the program. This is usually the same as the visit number,
though in a small number of cases it will be different. The obset ID is used as the
fourth and fifth letters of a dataset name. You can enter a comma separated list here.
If necessary, obset IDs will be padded with leading zeroes to two characters.
Here you select which instruments you want data from.
We've divided the instruments into Imagers, Spectrographs, and Other,
but instruments that are (or were) capable of producing either images or spectra
will appear in both places. These buttons will help you select only images
or spectra from a particular instrument.
Users with Javascript enabled in their browsers
will see two little buttons here labelled ALL and NONE.
These buttons will select or deselect all of the checkboxes in the section,
so you don't have to go through hitting lots of checkboxes if you
only want one instrument.
In this section, select the kind of spectra you want to search for
by selecting the instrument.
Notice that some instruments are capable of producing both images and spectra.
In this case, the query will be properly built to search for the selected observation type
for that instrument.
Here you can select data from instruments that produce neither images
nor spectra: the Fine Guidance Sensors (which produce astrometric, usually interferometric, data)
and the High Speed Photometer (which produced photometric data).
These are not checked by default.
Select the release date for the data, in GMT. See the observation date for the entry format.
HST data has a nominal proprietary period of one year (though in special cases, this may be shortened or extended).
The Release Date field gives the end of the dataset's proprietary period.
This is the date on which a dataset was archived.
If a dataset was archived more than once (for example, if it was reprocessed
by the pipeline), then this will show the latest archive date.
About 75% of all science datasets are archived within 24 hours after
the end of the observation (delays longer than this are usually
due to problems in pipeline calibration, or if the data stream gets backed up. Delays
like this are rare, however, and are more likely to apply to the newer instruments early in their careers.)
Choose Science (default) to get only science observations in the search results.
Choose Calibration to get only calibration observations in the search results.
At this time, you may not choose both options at the same time.
You may use these form elements to search on any column(s)
in the mission table. First, select the field
you wish to search from the pulldown menu under the "User-specified field n" heading.
Then, type in the qualification in the corresponding "Field Descriptions" box.
Clicking on the "Field Descriptions" link, will display information on the allowed fields
including the allowed range of values.
As an example, a Kepler user might select "E(B-V)" from the pulldown menu and
enter "< 0.5" in the "Field Descriptions" box.
NOTE only fields which are not already
included on the search form should be selected. Specifying search criteria
for a field that is listed in BOTH the form and in the User Specified field, may
cause either the query to fail or return unexpected results.
This form element allows you to choose the columns to be displayed
and their order, for the search results.
A set of columns that are commonly requested has been chosen as a default.
You remove output columns by highlighting the column to be removed and
then clicking on the remove button to the right of the output columns list.
You may determine the order of columns by highlighting a column and
then clicking the up or down buttons to the right of the list of
chosen output columns.
You may also add more columns to the list, either singly or all
at once. To add individual columns, select the desired
column from the pull down menu beneath the list of chosen output columns,
then click the add button. The column will be added to the bottom
of the output column list. To add all the available columns, click the
"add all" button.
Note the output column form element has its own reset button to restore
the list of output columns to the values initially displayed when the page
was drawn. The reset button at the top of the form is
used to reset the other form elements.
Clicking the "clear form" button will restore the original defaults to
all isections of the form.
One warning, the amount of memory required for a search is proportional
to the number of columns requested. For large requests, users may want to
reduce the number of output columns to the minimum required.
Verb is an integer parameter used by the VO community for specifying the
amount of output returned for a given search request. It is only
available when retrieving data as a web service but works with every
MAST service. Setting verb=3 in a search request is equivalent to
specifying "add all" from a search form;
it will return all the available columns in the output not just the standard
default fields. Currently setting verb to any other value has no effect.
Choose how you want the output rows sorted. You can select
up to three fields to sort on. The rows will be sorted in the order of
the first sort field; if two rows have the same sort field, they will be
sorted in order of the second sort field, and so on. Default sort fields
may be listed, but any field from the pulldown list can be used.
Specifying multiple sort fields may increase executon time.
If you prefer no sorting, you can specify "null" for all 3 fields.
This may speed up the query, but results will be displayed in
the order in which they were originally stored in the database table.
For each field, you can select that the rows be sorted in reverse
order on that field by selecting the reverse checkbox. For example,
you can sort the rows with the most recent observations first by selecting
Observation Date for the first sort field and selecting
the reverse checkbox next to it.
One word of caution: the selected sort field can change the search results
when the query finds more rows than are displayed ( i.e, when the number of
found rows exceeds the value of "maximum records"). For example, for a search
on a particular coordinate that finds 5,000 entries, if the search
is sorted on exposure time
and 1,001 rows are to be displayed (the default), then the 1,001
shortest exposures
from the 5,000 found entries will be displayed
which may not include the entries closest to the
desired position. (It is a good idea to always sort on "ang_sep" for target or
coordinate searches).
Specifies the format for displaying the primary
equatorial (i.e., RA and Dec) coordinates. The options include:
Sexagesimal - The default format with Right Ascension specified
as hh mm ss.sss and Declination as +/-dd mm ss.ss
( e.g., RA = 12 46 11.091, Dec = -00 30 12.08).
Note an extra digit was added as of June, 2012.
Degrees - Decimal degrees for both RA and Dec with 7
significant figures to the right of the decimal point
(e.g., RA=191.5461912, Dec=-0.5033333).
Note 2 extra digits were added as of June, 2012.
or
Hours - Decimal hours for RA and decimal degrees for Dec
in same format as for decimal degrees (e.g., RA=12.7697512, Dec=-0.5033333).
Note decimal hours = decimal degrees/15.0.
(Note 2 extra digits were added as of June, 2012.)
Any other coordinate fields contained in the searched mission catalog will be
displayed in their original format.
This value specifies the maximum number of rows returned in a
single query. For the standard mission search forms, the current
default is 1,001, but values from 1 to 25,001 are allowed.
For the file upload forms in which multiple targets, data ID's, or
coordinates can be specified, the default is set to 20 rows per file entry,
with allowed values ranging from 1 to 5,000.
Note when displayed as HTML, the latest search scripts will display
100 records per page. Links to the additional pages are shown
on the results page.
This paging feature however does require javascript to be turned on.
Users should be cautioned about retrieving a large number of records
(i.e., > 10,000 - 15,000) in HTML format. This can cause memory
problems for the browser (particulrly Safari) and prevent javascript
commands from functioning. It may also cause the browser to freeze
and require restarting.
Using the output format options which download results in a file can reduce the
problem.
Another option for large requests is to use "Casjobs".
Casjobs requires requesting a user name and password, and submitting
queries in SQL, but it allows users to submit large search results and
save them online. For Kepler, the link ito Casjobs is
http://mastweb.stsci.edu/kplrcasjobs/.
For other missions, check the Search_Retrieve page in the left gutter.
When queries are submitted as a web service, the default number of rows
returned is 2,000, but any value is allowed when max_rows is specified
as a query parameter. (See the
MAST Web services page for more information.)
This parameter controls the number of records displayed per web page.
By default, 100 rows or records are displayed per HTML page. Therefore if
400 records are returned, links to 4 pages will be displayed at the
top and bottom of the results table.
The paging feature however uses
javascript, so if javascript is turned off, paging won't work
and only the rows shown on the first page can be displayed. This is
one reason why increasing the default value may be helpful.
The current limit is 1000 rows per page which is recommended for large requests.
Note this value is ignored when output formats other than HTML are selected.
Selecting this checkbox will restrict the display to only rows in which
every output column value for a given row is unique. This option is primarily useful
when only a small number of columns are displayed (i.e., using the "remove"
button to remove default output columns) and when the selected columns
have duplicate values. Including columns which already have unique values (e.g.
Kepler ID or Data ID)
will make the "Distinct" option ineffective.
As an example, a IUE or FUSE user might want to create a list of unique target
names for a specific object class/category. He or she would specify the desired object
class, select only "object Class" and "target name" for the output columns,
click the "Make Rows Distinct" button, then click "Search".
Note that for some missions, columns such as RA, Dec and Magnitude were frequently defined
by the observer and often have different values for the same target.
If columns such as these are chosen as output columns, there will often
be more than one row listed per object name.
You may choose any of the
following formats for displaying/storing search results.
If you are using a browser (e.g., Firefox, etc) to submit a query
from a MAST web form, the formats labelled "File: ..." offer a
way to download results directly to your local computer. Choose any of
the other format options if you want to display the results in the browser,
or if you are submitting the request from a program
(see MAST web services).
HTML_Table (default) - results returned as a
standard HTML table including various links for retrieving data,
displaying previews, literature references, plotting spectra, etc.
File: Excel_Spreadsheet - results are stored as an Excel
spreadsheet file.
(Note: assumes users computer/browser provides support for Excel-format files).
The default file name when downloaded is "mission"_search.xls where "mission"
is the mission name (e.g., fuse_search.xls).
VOTable - an XML format adopted by the Virtual Observatory (VO)
project and displayed in the user's browser. Note coordinates in VOTable
format are always in decimal degrees rather than sexagesimal format.
For searches returning results from more than one mission and/or target,
multiple "resource" tags are created. Searches with a radius of 0
will return a VOTable file listing the output fields for that particular
mission/catalog. (For more information on the XML file format,
see VOTable documentation.)
Comma-separated values - a simple ASCII array containing
column headings followed by rows of comma-separated values. In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Space-separated values - a simple ASCII array containing
column headings followed by rows of space-separated values.
In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Note users may want to select
coordinates in decimal rather than sexagesimal format to maintain the
correspondence between column headings and entries although some column
headings may contain blanks as well.
(Semi-colons, pipes, or commas are probably safer delimiters.)
IRAF Space-separated values with INDEFs - Like the space-separated format
above except empty fields are replaced with the string "INDEF". This format is useful
for IRAF-compatibility.
Semi-colon separated values - a simple ASCII array containing
column headings followed by rows of semi-colon separated values. In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Tab-separated values - a simple ASCII array containing
tabs for delimiters. May be useful for ingesting into Excel spreadsheets.
Pipe-separated values - a simple ASCII array containing
column headings followed by rows of pipe or vertical bar separated values.
(Note: not offered in file upload mode.)
Json format - Javascript Object Notation (json) is a simple machine and
human-readable, name/value ASCII format supported by many programming languages.
(Note: not offered in file upload mode.)
File: comma-separated values -
a simple ASCII text file containing
column headings followed by rows of comma-separated values. In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Rather than being displayed in the browser, the results are directly downloaded
to the users computer using the file name "mission"_search.txt where "mission" is
the mission name (e.g., hst_search.txt). Depending on the
browser settings, the user may be prompted for a file location before the
file is downloaded.
File: Space-separated values -
a simple ASCII text file containing
column headings followed by rows of space-separated values. In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Rather than being displayed in the browser, the results are directly downloaded
to the users computer using the file name "mission"_search.txt where "mission" is
the mission name (e.g., hst_search.txt). Depending on the
browser settings, the user may be prompted for a file location before the
file is downloaded.
File: IRAF Space-separated values with INDEFs -
Like the space-separated format
above except empty fields are replaced with the string "INDEF". This file format is useful
for IRAF-compatibility.
File: Semicolon-separated values -
a simple ASCII text file containing
column headings followed by rows of semicolon-separated values. In file upload mode,
a blank line is inserted between the search results to separate multiple target queries.
Rather than being displayed in the browser, the results are directly downloaded
to the users computer using the file name "mission"_search.txt where "mission" is
the mission name (e.g., hst_search.txt). Depending on the
browser settings, the user may be prompted for a file location before the
file is downloaded.
File: Tab-separated values - a simple ASCII file containing
tabs for delimiters. May be useful for ingesting into Excel spreadsheets.
File: Pipe-separated values -
a simple ASCII text file containing
column headings followed by rows of pipe-separated values.
(Note: not offered in file upload mode.)
Rather than being displayed in the browser, the results are directly downloaded
to the users computer using the file name "mission"_search.txt where "mission" is
the mission name (e.g., hst_search.txt). Depending on the
browser settings, the user may be prompted for a file location before the
file is downloaded.
File: Json format - Javascript Object Notation (json) is a
simple machine and
human-readable, name/value ASCII format supported by many programming languages.
Rather than being displayed in the browser, the results are directly downloaded
to the users computer using the file name "mission"_search.txt where "mission" is
the mission name (e.g., hst_search.txt). Depending on the
browser settings, the user may be prompted for a file location before the
file is downloaded.
File: WGET Commands - This option is only available for
certain missions. If selected, a shell script file is output which the user
can execute from his own computer to download all the selected light
curves or extracted spectral files with one command. The shell script
file uses the "WGET" program which is available for most operating systems.
Note for Kepler, two WGET options are available: "File: WGET LC commands" will create
a script for downloading available light curves, "File: WGET TPF commands" will create
a script for downloading target pixel files.
Note: If no entries are found for an entry a
"no entries found" message is written in the selected format and
the program continues.
In all cases, error conditions will cause the database search to abort.