FAQ List
The following are Frequently Asked Questions of MAST, with each question and answer embedded in an excerpt macro.
Data Access
Direct your browser to the MyST site, and follow the instructions in the MAST Accounts page. Data from most programs have been reprocessed fairly often. When this happens, updated files eventually replace the prior version. However, there is a latency between the time when updated files are created and when the files are migrated to the area where they are discoverable in MAST. Sometimes the delay can be more than a day. Unfortunately, there is no easy workaround. Patience is the key. The names of the HST and JWST science instruments as viewed in MAST have been augmented to include configuration information. This affects the way that instrument names should be specified in the Advanced Search in the Portal, and in Observations.query_criteria() searches with the astroquery.mast API. Other kinds of queries are not affected. See, e.g., the article JWST Instrument Names for details. Some Observations (i.e., rows in the Portal Search Results table) are associated with a very large number of files. Loading too many Observation into the Basket at once can result in a pop-up error message like this one: This problem of loading too many files in the basket is particularly likely for JWST Observations with many extracted spectra (e.g., NIRCam Wide-Field Slitless Spectra), or Observations containing lots of spatial dithers or other spacecraft maneuvers (as for an extended mosaic or moving targets). To get around this problem you can do the following: Use the astroquery.mast API. See the Astroquery Search and Retrieval section of the Using MAST APIs article. Follow the link to the Jupyter Notebook for API Large Downloads.I am a Principal Investigator of an HST or JWST observing program. How do I authorize my Co-Is to access the data.
Why do I sometimes get a "404 File Not Found" error when I try to retrieve files.
My API queries for data taken with particular instruments do not return the expected results.
The Portal won't load Observations into my Basket.
JWST
There are multiple ways to discover JWST Observations. For instance: From hours to days. This is a difficult question to answer with precision because it depends on several factors. Many hours can elapse between the end of an exposure and transmission of that data to the ground. This is largely because JWST does not have continuous contact with the ground in the high-bandwidth channel that is required to transmit high-volume science data. Once the data processing system receives the data from Flight Operations, much of the data is processed within a few hours. There are edge cases where complex programs may take more than a day, or even several days, to process. That said, it is likely that most data will appear in MAST within a day or two of the end of the last exposure in an observation. It is best to "subscribe" to data from a program so that you are notified after reprocessed data are available in MAST. See the article Program Subscriptions and Notifications for details. Select the Reprocessed check-box under subscription type; it is best to select a Daily notification frequency to avoid being bombarded with notifications (see next FAQ). Absent a subscription, it is more challenging to determine whether extant data in MAST have been reprocessed recently. First, read the JDox article JWST Operations Pipeline Build Information for context. In particular, it calls out two FITS header keywords to look at: It is possible that files in MAST are awaiting a new reprocessing because of very recent updates to reference files. There is no easy way to tell that, except by subscribing to the relevant data. You probably requested a "Fast" notification frequency, and (for JWST data) possibly for product levels of "2" and higher. Notifications are generated less than an hour after new data products are ingested into the Archive (whether new or reprocessed). For many programs it takes hours, or sometimes days, for all data to be processed. During this time, many notifications are generated as the products are archived; potentially dozens or even hundreds of notifications. Unfortunately, the notifications are not specific enough to link to only the data that have been reprocessed. Instead, the link will take you to a Portal results page with all data from the program. Editing two settings in the subscriptions menu should help: If you have already established a subscription, you can click the "Subscriptions" link in the Portal and edit the frequency and product level parameters for each subscription. Read Program Subscriptions and Notifications to see how to do this.How do I learn when JWST observations have been obtained.
JWST
" in the Mission filter and enter a range of observation start dates, e.g., "2022-07-02
" and "2022-07-09
" in the Start Time filter boxes, then click the Search button. This will search for all JWST observations that were started between 2 July 2022 through 9 July 2022.obs_collection="JWST"
and some other parameters such as instrument_name="MIRI*"
. See the astroquery.mast documentation for details.What is the usual delay between the end of a JWST observation and when it first appears in MAST.
How do I know whether data from my JWST program have been reprocessed.
CAL_VER
and CRDS_CTX
. If files you have on your machine show an earlier version than what is shown in MAST, you may want to re-retrieve the data. To see which versions are in the archive,Filename
Date
(this is the date the file was created, which reflects when processing was last performed)cal_ver
to show the version of the processing softwarecrds_ctx
to show the context of the CRDS reference filesWhy do I get so many identical reprocessing notifications per day.
General
Navigate your browser to the special DOI Portal. Follow the instructions in the Special Searches article in the Portal Guide, specifically the section on Create a DOI. The DOI Homepage has additional FAQs and information about pre-made DOIs for bulk datasets (e.g. Kepler, TESS, Pan-STARRS). DOI for Uncalibrated Products If you have reduced or extracted products yourself, rather than using the high-level products in MAST, you can still create a DOI for your data. Load the level-2b (calibrated) or Level-3 (calibrated & combined) products into the DOI basket, even if you did not use them directly; users who follow the DOI link will be able to access the lower-level products. When creating your DOI, we recommend that you include a note in the "About this data" field specifying the products used in your analysis. How do I create a DOI to reference the data I analyzed in my publication.