Page History
Excerpt | ||
---|---|---|
| ||
Choose an option for retrieving files from MAST |
Panel | ||||||
---|---|---|---|---|---|---|
| ||||||
On this page...
|
Direct from Search Results
Retrieving data from MAST in the Portal context requires first executing a successful search (see the chapter on Searching). Each of the rows in the search results includes a File icon which enables a direct download of a single file or observation (see One-Click Download for details).
Using the Download Manager
In the Portal Download Manager you must check one of more directories or file boxes in the File panel before download methods become available to you (see Download Basket).
Note | ||
---|---|---|
| ||
You must be logged in to the Portal to download data that is marked as Exclusive Access. Such observations appear with a yellow background in the Search Results table. |
Warning | ||
---|---|---|
| ||
The Portal requires that pop-up blockers be disabled for the domain: https://mast.stsci.edu/ in order to download data. Check the documentation for your browser to determine how this is done, and be alert for notifications from the browser that popups are being blocked. In many cases it simply requires giving approval for pop-ups when you are asked. |
Options
Click one of the buttons described below to choose the details of your download.
Browser Download
Follow the steps below to initiate a download of the selected files. The files will be bundled into a .zip or a .tar (optionally compressed) file.
Instruction | Notes | |
---|---|---|
1 | Click the Download button. | |
2 | Select your prefered form for the download bundle and click Download. | |
3 | Save the file bundle to your local storage. The appearance of the file-save dialog depends upon your browser settings. |
Curl Script
You may elect to download a custom Bash script, which when run on your host system will retrieve your selected data files using cURL commands.
Instruction | Notes | ||||||
---|---|---|---|---|---|---|---|
1 | Click the Download button. | ||||||
2 | Select Curl from the file Format pull-down menu. | ||||||
3 | Save the cURL shell script in a directory where you wish the data files to be stored. | ||||||
4 | Bring up a shell and execute the script. Note: If you are retrieving Exclusive Access Protected data, you will need to either provide your MyST login credentials, or have established a MAST Auth token, in order for the shell to complete the retrieval successfully. Note: The cURL script is targeted to a bash shell. Specifying bash on the command line allows it to be invoked from any unix shell. |
|
Note | ||
---|---|---|
| ||
Requesting data via shippable media will involve considerable delay. Note that you will need to certify that you are unable to use another means of data retrieval. |
Note | ||
---|---|---|
| ||
Authentication for access to Exclusive Access data via a cURL or other scripts is managed in MAST via tokens. See MAST API Tokens to learn how to create or update a MAST.auth token. |
Batch Retrieval
The Batch Retrieval option allows the selected files to be written to external media for subsequent retrieval. Follow the steps below to stage data on the archive.stsci.edu ftp server. Note that requesting data via shippable media will incur a substantial delay, and requires that you certify that you cannot retrieve data via staging.
Note |
---|
Staging files for ftp retrieval is currently supported for a few MAST missions (including JWST and HST), but not all. It is highly recommended to instead retrieve large numbers of files via cURL. |
Instruction | Notes | |||
---|---|---|---|---|
1 | Click the Batch Retrieval button. | |||
2 | Select Staging from the Delivery Method pull-down menu and (if you are not logged in) provide the email address where you wish the notification to be sent. Note: If you are logged in to MAST, the e-mail address on record will be pre-filled. | |||
3 | Acknowledge the pop-up notification, and check your messages at the delivery email address you specified. | |||
4 | The email notification will give the location of the files that have been staged. | |||
5 | Access the staging disk using an encrypted FTPS connection. See below for suggestions for modern, third-party clients.
|
Options for retrieving staged data via third-party clients:
Please see the Archive Support Knowledge Base for more details on each of these clients, and to explore other options.
Expand | ||
---|---|---|
| ||
To download the app or for more help, please see the Cyberduck site. Launch the app and select Open Connection.
You will see two folders: "pub" and "stage":
Under "stage", navigate to the directory specified in the email notification and you should see the folder(s) containing your download.
|
Expand | ||
---|---|---|
| ||
To download the app or for more help, please see the FileZilla site. Launch the app. In the Host field enter ftps://archive.stsci.edu, then your MyST email address and password in the Username and Password fields, respectively. Select Quickconnect.
Under Remote site, you will see two folders: "pub" and "stage"
Under "stage", navigate to the directory specified in the email notification and you should see the folder(s) containing your download. Once you locate the folder(s) or file(s) you want to download, right click and select Download. |
Expand | ||||
---|---|---|---|---|
| ||||
To install wget or for more help, please see the wget site. Bring up a shell. If you requested a retrieval anonymously, run:
If you were logged into MAST when you requested that your data be staged, run:
Note, for internal users, there may still be a certificate problem; if you encounter an error add ' |
Expand | ||||
---|---|---|---|---|
| ||||
To install curl or for more help, please see the curl site. Curl is likely already installed on many machines, and if not, is freely available as open source software. Bring up a shell. If you requested a retrieval anonymously, run:
If you were logged into MAST when you requested that your data be staged, run:
Note that you must include the filename in these commands. If you do not know the name of the file you'd like to retrieve, or want to download an entire directory, we recommend wget or one of the other methods detailed here. |
Expand | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||
Bring up a shell (see note below) and initiate an ftp session on
The appropriate login credentials will be one of the following:
Navigate to the directory specified in the email notification and initiate the transfer of data files.
|
Other Download Methods
It is possible to search for and retrieve data using MAST web services, or the Python astroquery.mast library. These methods are described in Beyond the Portal.