Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DraftMASTDOCS and version 23.10
Excerpt

This page provides an overview on how to use the MAST Mission Search to find MAST data collections. The description of each form component on this page is based on the HST search.

Info

Future Searches for other MAST mission data and collections will adopt the same or similar components. Any components that are only available for specific data collections will be documented.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid

On this page...

Table of Contents
indent24px

Major Components Of The Mission Search

This section describes chapter summarizes the field guide to the major components of the Mission Search. There are three main areas: the search form, the search results table, and the download overlay.  Each Each numbered box in these figures is described in a corresponding numbered section subsection below.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid
 

Search Form

Image Removed

Anchor

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid

Search Results Table

Image Removed

search_form
search_form

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid

Download Overlay

Image Removed

Summary Of The Major Components: Search Form

Anchorsearch_formsearch_form

Image Removed


Image Added

Figure 1 – The Search form window for Hubble, where numbered highlights correspond to areas where various search parameters and constraints are specified, and where searches are initiated. 

The search form is where users specify the search parameters and constraints to create their search. The available

searches

search options include:

  • Spatial cone search based on coordinates and/or object names,

  • Direct search by dataset IDs,
  • Advanced search with more specific constraints to narrow the search, and
  • Search without specifying any filters. For example,
    • Users can search for all observations taken with a particular instrument after a certain date without specifying a specific target.
    • Or press 'SEARCH' without entering anything into the form to return every observation taken.

Each field in this search form provides a tooltip as a quick guidance. Users can hover over each field with their mouse to see the tips.

 Specific

Specific functionality of each component is summarized below.

  PanelborderColor


#00617EbgColor#E3EEF1borderWidth2

Image Modified

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

1. Cone Search and Upload List Search

Perform a cone search by typing either an object name or the coordinates directly. Multiple object names, coordinates, or combinations of both are allowed by pressing 'return' or 'tab' keys after each object.  Use the 'UPLOAD LIST OF TARGETS' button button to upload a comma-separated file containing the object names, coordinates, or specific dataset IDs. Users can set the size of their cone search in arcminutes or arcseconds. This section is not required to conduct a search: users can leave it blank and search based only on other parameters.  To start querying, click the Search bar at the bottom of the page. More infoborderWidth
Note
borderColor#00617E
bgColor#E3EEF1

Object names in this component are used only to resolve into coordinates using a name resolver.

Panel

2

Image Modified

PanelborderColor#00617EbgColor

#E3EEF1borderWidth2

2.

Core

Search

Parameters

Parameter Overview

Use these fields to build advanced searches. Add search constraints based on the most commonly used observation parameters like instrument, proposal information, filter/grating, or start/end times. Each parameter accepts regular expressions, for example, greater than or less than for numerical fields or wildcard characters for string fields. If the default filters on the component do not include the specific parameter needed, see the 'Add Condition'

 section

section below for further search options

. More info

.

panel

borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Modified

PanelborderColor#00617EbgColor#E3EEF1borderWidth2

3. Add Condition

Use 'Add Condition' to further constrain the search.

 Search

 Search for a column based on names and descriptions, or scroll through the complete list in the 'Column Name' text box. The search condition can include numerical constraints or wildcard characters for string fields.  Use the 'ADD ANOTHER CONDITION' button to add multiple constraints and columns.

More info. PanelborderColor#00617EbgColor#E3EEF1borderWidth

2

Image Modified

PanelborderColor#00617E

bgColor#E3EEF1borderWidth2

4. Choose Output Columns

Use 'Output Columns' to select which columns to include in the search results. The form is set by default to return a subset recommended by MAST. Use the shortcuts in the upper right to select 'Recommended' (Image Modified), 'All' (Image Modified), or 'None'(Image Modified) of the columns. Click in the 'Output Column' box and start typing to search for columns or click the check box in the pop-out menu to select based on its name or description. Remove individual columns from the selected ones by clicking the 'x' next to its name.

 More info. PanelborderColor#00617E

bgColor#E3EEF1borderWidth2

Image Modified

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

5. The Search Bar

The search bar is always located at the bottom of your screen. Clicking the 'SEARCH' button starts the search. Clicking the 'SHOW API QUERY' button generates a script using the Application Programming Interface (API) for MAST Mission Search, based on the search parameters entered into the form. This can be a great way to learn how to construct queries programmatically. Reset the form using the 'CLEAR FORM' button on the left

. More info

.



Summary Of The Major Components:

Search Results Table

Anchor
search_results_table
search_results_table

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid


Image Modified

Figure 2 – The results table after a search for Hubble data.

 The search results table contains observations that match the search parameters. If a list of targets (object names, coordinates, or dataset names along with other information) is uploaded, all uploaded parameters will be included as additional columns in the results table. See the section Cone Search And Upload List Search for valid file formats. 


PanelborderColor#00617EbgColor

#E3EEF1borderWidth2

Image Modified

PanelborderColor#00617EbgColor#E3EEF1borderWidth

2

1. Sorting Columns

The search results table can be sorted in ascending or descending order by clicking on the column name. The arrows indicate the sort direction. The table supports multi-column sorting, where the number next to each sorted column indicates the order. In the example on the left, the search results table is sorted first by Instrument name in ascending order, second by Exposure Time in descending order.

More info.
panel

borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Modified

PanelborderColor#00617EbgColor

#E3EEF1borderWidth2

2. Pagination

When there are

more search

more search results than the page size (default page size is 500 results per page), the table relies on pagination to display the records one page at a time. Iterate through previous or next pages, or jump to the first or last page, using the arrow buttons.

 More info.
panel

borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Modified

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

3. Table Rows Per Page

Updating the 'Rows Per Page' drop down changes the number of rows displayed on the table. For queries that return more than a few hundred results,

displaying fewer

displaying fewer rows per page will enable quicker loading. For queries that have less than a few hundred results, showing more rows per page can be convenient to see more on a single page

. More info

.

panel

borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Modified

PanelborderColor#00617EbgColor

#E3EEF1borderWidth2

4. Row Selection

Select one or more rows to download products associated with those datasets by clicking the checkboxes next to individual observations. The top checkbox in the header row selects all rows on the current page. Deselect individual rows using the checkboxes in those rows. Note that selecting or deselecting rows is limited to one page at a time. However, row selections on each page will be remembered between pages of the whole results table. To select rows across many table pages, try refining your search to be more selective, apply sorting of columns to group them together, or use the API (programmatic access to allow searches or downloads with scripts). 

More info.

Image Added

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

5. The Download Button

To download products associated with the observations in the search results table, select at least one row of observations. Then use the 'DOWNLOAD DATA' button to access the Download Overlay by selecting 'Choose Files' or generate an API script with one of the 'Quick API Script' options.  When selecting more than 2000 observations, the 'Choose Files' button is disabled; instead, either reduce the number of selected rows or use the 'Quick API Script'option to programmatically retrieve the products from the selected observations. See 'Show API Button' in the Download Overlay for more information about API queries.

More info.
PanelborderColor#00617EbgColor#E3EEF1borderWidth

2

Image Modified

PanelborderColor#00617EbgColor#E3EEF1borderWidth2

6. The Export Button (Exporting Search Results Table)

Export the metadata of the search results table in a comma-separated (CSV), JSON, or VO Table format. To do this, select a subset of the table rows or the entire table of search results. Unlike downloading datasets, there is no limit to the number of rows that can be exported.

More info.
PanelborderColor#00617EbgColor

#E3EEF1borderWidth2

Image Modified

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

7. The Edit Search Button

Use the 'EDIT SEARCH' button to update the search parameters or start a new search. The search form will be overlaid and remember the previous query parameters, which can be modified. Press the 'CLEAR FORM' button at the bottom left of the screen to start a new search.

More info.



Summary Of The Major Components:

Download Overlay

Anchor
download_overlay
download_overlay

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2
borderStylesolid


Image Added

Figure 3 – The download overlay panel, with selectors or action buttons highlighted in numbered boxes. The overlay selectors vary slightly among missions; this graphic applies to JWST.

Each dataset contains one or more products (i.e., files), including calibration files,

uncalibrated observations

ancillary data, and calibrated

observations

files at various levels of processing. It is possible to download specific file types across the datasets or all the files that are available. The

Download Overlay

download overlay allows filtering by product types

and suffixes

, and selection of specific files to download from each dataset. Files that are selected using the checkboxes remain selected to be downloaded even if additional filters are applied in the overlay to make them no longer visible in the overlay.

Only deselecting a file will exclude it from the download.

The selectors and action elements are described in detail in the Download Overlay article.


Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

1. Filter By Product Types

Use this component to show and hide files associated with the selected product types in the file-selection table. Then use checkboxes to select which product rows to mark for download. By default, the table shows all products for all product types, with nothing selected initially. More info.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

2. Filter By Product Suffixes

Use this component to show and hide files by product suffixes. By default, all product suffixes are selected to appear in the file-selection table. More info.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

3. Filter By String Match

Filter files by typing any string in the search box, which will match against file name, suffix, extension, instrument, or the filter/grating. This search box will only show files that are already visible in the table, so make sure to select all file types and extensions to find specific files. More info.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

4. Download A Zip File On Your Computer

Download selected files directly using the 'START DOWNLOAD' button at the bottom of the download overlay window. The files will download as a zip file. The majority of data collections are publicly available, but a small amount is temporarily available for certain people. Downloading non-public datasets requires permission to retrieve those files (granted by the Principal Investigator of each observing program) and logging into your MyST account. For login information, see MAST User Accounts.  More info.

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

Image Removed

Panel
borderColor#00617E
bgColor#E3EEF1
borderWidth2

5. Show API Query to Download Via A Script

The 'DOWNLOAD WITH API QUERY' button provides an alternative to downloading the zip file. It allows downloading a script containing terminal commands such as cURL to download the selected files sequentially. This button can also be used to learn how to write a programmatic script to download files. More info.

For Further Reading...