Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DraftMASTDOCS and version 1.3
Excerpt
hiddentrue

Choose an option for retrieving files from MAST


Panel
borderColor#00617E
borderWidth2px
borderStylesolid

On this page...

Table of Contents
maxLevel3
indent24px

Direct from Search Results

Retrieving data from MAST in the Portal context requires first executing a successful search (see the chapter on Searching). Each of the rows in the search results includes a File icon which enables a direct download of a single file or observation (see One-Click Download for details).

Using the Download Manager

In the Portal Download Manager you must check one of more directories or file boxes in the File panel before download methods become available to you (see Download Basket).

Note
titlePortal Log-on

You must be logged in to the Portal to download data that is marked as Exclusive Access. Such observations appear with a yellow background in the Search Results table.

Warning
titleBrowser Pop-ups

The Portal requires that pop-up blockers be disabled for the domain: https://mast.stsci.edu/ in order to download data. Check the documentation for your browser to determine how this is done, and be alert for notifications from the browser that popups are being blocked.  In many cases it simply requires giving approval for pop-ups when you are asked.

Options

Click one of the buttons described below to choose the details of your download.

Browser Download

Follow the steps below to initiate a download of the selected files. The files will be bundled into a .zip or a .tar (optionally compressed) file.


InstructionNotes
1Click the Download button.

Download products button

2Select your prefered form for the download bundle and click Download.

Download bundle format dialog

3Save the file bundle to your local storage. The appearance of the file-save dialog depends upon your browser settings.

Download to local disk dialog (browser specific)

Curl Script

You may elect to download a custom Bash script, which when run on your host system will retrieve your selected data files using cURL commands.


InstructionNotes
1Click the Download button.

Download products button

2Select Curl from the file Format pull-down menu.

Download bundle format dialog

3Save the cURL shell script in a directory where you wish the data files to be stored.

Download to local disk dialog (browser specific)

4

Bring up a shell and execute the script.

Note: If you are retrieving Exclusive Access Protected data, you will need to either provide your MyST login credentials, or have established a MAST Auth token, in order for the shell to complete the retrieval successfully.

Note: The cURL script is targeted to a bash shell. Specifying bash on the command line allows it to be invoked from any unix shell.

Code Block
languagebash
bash MAST_2018-10-31T2028.sh
Note
titleChoosing Shippable Media

Requesting data via shippable media will involve considerable delay. Note that you will need to certify that you are unable to use another means of data retrieval.

Note
titleMAST Auth Tokens

Authentication for access to Exclusive Access data via a cURL or other scripts is managed in MAST via tokens. See MAST API Tokens to learn how to create or update a MAST.auth token.

Batch Retrieval

The Batch option allows the selected files to be written to external media for subsequent retrieval. Follow the steps below to stage data on the archive.stsci.edu ftp server. Note that requesting data via shippable media will incur a substantial delay, and requires that you certify that you cannot retrieve data via staging.

Note

Staging files for ftp retrieval is currently supported for a few MAST missions (including JWST and HST), but not all. It is highly recommended to instead retrieve large numbers of files via cURL.


InstructionNotes
1Click the Batch Retrieval button.

Batch retrieval button

2

Select staging from the file Delivery Method pull-down menu and (if you are not logged in) provide the email address where you wish the notification to be sent.

Note: If you are logged in to MAST, the e-mail address on record will be pre-filled.

Batch retrieval options dialog

3Acknowledge the pop-up notification, and check your email at the delivery address you specified.

Pop-up status notification

4The email notification will give the location of the files that have been staged.

5

Bring up a shell** and initiate an ftp session on archive.stsci.edu. The appropriate login credentials will be one of the following:

  • If you were logged into MAST when you requested that your data be staged, use your MyST login credentials.
  • If you requested a retrieval anonymously (for non-exclusive access data), use:
    • User: anonymous
    • Password: <any syntactically valid email address>
Code Block
languagebash
% ftp archive.stsci.edu
Connected to archopsvm1.stsci.edu.
# [Welcome message...]
Name: anonymous
331 Guest login ok, type your email address as 
the password
Password: 
6Navigate to the directory specified in the email notification and initiate the transfer of data files.
Code Block
languagebash
ftp> cd /stage/anonymous/anonymous_20190107Z_2339f1c0
# turn off interactive prompt:
ftp> prompt
ftp> mget *
Note
titleMAC OS X 10.14+ Users

**Apple has removed the native ftp application for Mac OS 10.14 (Mojave) and higher. A solution is to install a third-party file-transfer application, such as Cyberduck or wget. If using CyberDuck, be sure to open your connection as FTP-SSL, since MAST now uses secure ftp (ftps). See this article for help.

Other Download Methods

It is possible to search for and retrieve data using MAST web services, or the python astroquery.mast library. These methods are described in Beyond the Portal.

For Further Reading...