Learn key information to help you get started with JWST data products |
This article summarizes key information to help you quickly discover and understand JWST data from MAST. On this page... |
The most effective approach to discovering JWST science data in MAST depends upon your objective and your involvement in JWST observing programs.
If you are a Principal Investigator (PI) or Co-Investigator (Co-I) on one or more active JWST observing programs (i.e., approved programs that expect to obtain data in the current cycle), or are an Archive Researcher awaiting data from certain programs to become available, do one or more of the following:
JWST
box in the Mission filter, and enter the program number in the Proposal ID filter to search for data in your program.If you have a scientific interest in JWST data but are not part of an investigator team, you might prefer these options:
JWST
box in the Mission filter, or follow the Using the MAST Portal tutorial in this Manual for JWST-specific searches.Anonymous users will be able to search for all data, but will only be able to retrieve public data. See the next section. |
Most science data obtained from JWST will be released to the astronomical community following an exclusive access period (EAP), during which the Principal Investigating Team enjoys exclusive scientific use. The duration of the exclusive access period depends upon the type of program. Some programs, whether by policy or choice, have a zero-length EAP.
Principal Investigators are automatically given authorization to access data products within the EAP for their observing programs. PIs must authorize other members of their team if they need to access these data prior to the expiration of the EAP. See the article on MAST User Accounts to learn how to grant access. |
A large quantity of JWST data will be available for public use as soon as the observations are obtained and processed. These include the following categories of observing programs:
Use the MAST Portal to register for notifications about data from specific observing programs. This is a particularly good way for general MAST users to learn when the EAP expires on data of interest. See the Portal Guide chapter Program Subscriptions and Notifications for details.
The Field Guide to JWST Data chapter in this manual, along with certain other JWST reference materials, will help you understand enough about JWST data products to get started on data analysis. Here are some key elements:
The calibration pipeline for JWST processes data in stages from raw to the most refined, calibrated, and combined products; most products produced by intermediate pipeline stages are also archived. See the chapter on Science Data Products to learn about the categories of JWST products and how they are represented in MAST, and see the article onĀ Processing Levels and Product Stages for details about each type of data file. Generally, the highest-levels of products are appropriate for science analysis.
The file name convention for JWST data products was designed to facilitate automated pipeline processing, and relates the files to details of the observing program that generated them. The names are not scientist-friendly. See the Field Guide chapter for a summary, or the File Naming Schemes reference document for details. The most important distinction is between products that relate to an exposure vs. those that relate to a source or target.
A data product type refers to the semantic content of the file. It is encoded in the product filename as a suffix, appearing just before the file extension (e.g., *_cat.ecsv
indicates the file content is a source catalog). Which products you see for a given observation in MAST depends upon the instrument configuration (e.g., imaging, some form of spectroscopy, coronography), data taking mode (e.g., timeseries, dithers), and the level of processing. See the sortable table of MAST Data Product Types for a brief explanation of type extensions, and the calibration pipeline Data Product Types for details.
Most (but not all) science data products are in FITS format. These files have primary and extension headers that contain valuable metadata. The keyword names and definitions may be found in the searchable JWST Keyword Dictionary for all instruments and configurations. See the article on Keyword Metadata for details.
The calibration pipeline that produces JWST data products will be re-executed (and data products regenerated) after initial ingestion in response to events such as pipeline software updates or updates to calibration reference files. There are other reasons for a user to re-run the pipeline on their own system, e.g. to modify choices for backgrounds or spectrum extraction parameters. See the JWST Data Reduction Pipeline overview, and the JWST Calibration Pipeline reference document for details.
The full set of data products related to a single JWST observation may consist of hundreds of files. Standard MAST searches return Observations, which are collections of related files; this bundling de-clutters the interface and makes the selection of file types more manageable for users. See the chapter on Data Product Linkages to see how files are rolled up under an Observation. One can use filters in the Portal Download Basket to select the small number that are needed for actual science analysis. Using the "Minimum Recommended Products" filter is often helpful.
There are multiple options for retrieving data products from MAST. They include:
See the Portal Guide chapter on Retrieving Data for details.
JWST Reference documents: