Create Content

Introduction

This page contains information on how to use the SID MAST Portal to find, select and retrieve JWST Ground test data. 


Currently, the only way to download data from the SID archive is to download the data to an Archive staging area and then use Cyberduck (ftp client) to download the data to your machine from the staging area.


The portal contains a series of search boxes, or filters, in the main section of the page, with additional search options listed on the left of the page. To add one of the filters (options with green plus signs can be added), simply click on the search option you want. If it contains a red minus sign, you can remove the filter. This is customizable to allow the user to search only the options they wish. The download limit is 25000 files, so the selection should be narrowed down lower than this before trying to view/retrieve the files. Search Fields that are valid for packages have a '(p)' appended to their name.

The default set of search boxes are listed in the 'Primary' columns, while other options that can be added are listed under 'Secondary' columns.

Text box searching: Most search options have a blank text box that allows the user to start typing all or part of the item they're searching for.  To search for an option, just type part of it, like in Google, and the archive will retrieve anything with that text as part of the option. There are two wildcard options, for more detailed searches, the % for multiple characters and an underscore '_' for single characters.

Menu scroll searching: Many search boxes also contain menus of options that can be selected by scrolling through the list and selecting various options (multiple options allowed) by clicking on the boxes next to the desired selection. The options in the menus are not alphabetical, but organized by the number of files in that category, with the largest number of files at the top.

Once a user has selected the set of files they wish to view, the user should click on the download button at the upper left corner. This will display a window with all of the selected files. The filter panes on the left of this window can be used to further narrow the list of files displayed. From here, individual files can be selected for download.

Primary Columns

 

Retrieval Type

Package type; either "file" or "package". File refers to individual FITS files while package refers to a tar file of various data sets, which can include telemetry, log files or other information. The database table is comprised primarily of values extracted from either FITS keywords (files) or a readme file (both files and packages). Search Fields that are valid for packages have a '(p)' appended to their name.

Instrument

This is the instrument name for the data you wish to find. Valid instruments to search on are: FGS, MIRI, NIRCAM, NIRISS, NIRSPEC, and TFI. The options are displayed in a searchable menu.

File Name (p)

This box is a blank text box that allows the user to type in all or part of a specific file name to search for. This can be used for both files and packages. A few examples of searches follows. Searching for 'Housekeeping' would bring up a list of packages that contain all of the MIRI Housekeeping files (telemetry) from various test runs. Searching for NRCA1A-SCAalive-Full will find any NIRCAM data with that text string in the filename.

Test Campaign

This identifier specifies a particular stage and location of instrument testing. Currently recognized campaigns are shown in the table below.

Test Campaign
Description
Location
Dates
MIRVM1MIRI Verification Model Cryo Testing 1RAL2007-11-01 to 2008-1-30
MIRVM2MIRI Verification Model Cryo Testing 2RAL2008-06-01 to 2008-10-01
NRSDSNIRSPec Detector SubsystemGSFC2009-06-30 to 2011-06-01
NRCETUNIRCam Engineering Test UnitLMATC2010-04
MIRJPLCOTMIRI Flight-like detectors in cryoJPL2010-01 and 2010-07
MIRJPLCPT1MIRI Flight-like detectors in cryoJPL2010-10
ICV0Pre-cv testing (ambient)GSFC2010-03-31 to 2012-06-29
MIRFM1MIRI Flight Model Cryo testingRAL

2011-05 to 2011-06

MIRJPL1MIRI Flight-like detectors in cryoJPL2012-03 to 2012-04
NRCFM1NIRCam Flight Model Cryo 1LMATC2012-06 to 2012-09
MIRJPL2MIRI Flight-like detectors in cryoJPL2012-07 to 2012-09
NRCFM2NIRCam Flight Model Cryo 2LMATC2012-11 to 2013-01
NRCFM3NIRCAM Flight Model Cryo 3LMATC2013-03
MIRJPL3MIRI Flight-like detectors in cryoJPL2013-03 to 2013-06
ICV1ISIM CV1RR testingGSFC2013-09-1 to 2013-10-25
MIRJPL4MIRI Flight-like detectors in cryoJPL2014-04 to 2014-05
ICV2ISIM CV2 TestingGSFC

2014-04-24 to 2014-10-8

MIRJPLCPT2MIRI Flight-like detectors in cryoJPL2014-12
MIRJPL5MIRI Flight-like detectors in cryoJPL2015-05
ICV3ISIM CV3 TestingGSFC2015-08-6 to 2016-02-12
FGSTFI

Risk Mitigation

PFM Detector Alignment

PFM CVAC

DFL

DFL

DFL

2011-01

2010-12

2010-11 to 2012-01

NRCSCANIRCam flight and flight-spare SCA testsUA2011-03-03 to 2015-08-19
NRCEMINIRCam flight module EMI/EMC testsLMATC2013-05-27 to 2013-07-16
DCLAFirst round from the Detector Characterization Lab of detector testsGSFC DCL2014-04-14 to 2014-10-01
DCLBSecond round from the Detector Characterization Lab of detector tests.  Went from "A" to "B" in case there were duplicate job numbers.GSFC DCL2015-05-23 to 2015-06-21
NRCVIBEAmbient aliveness tests before and after NIRCam flight module vibration testsGSFC2013-08-05, 2013-09-07
NRCSWAPAmbient aliveness tests for new NIRCam FPAs and FPEs installed before ISIM CV2GSFC2013-12-17, 2014-01-04
NRSNIRSpec instrument testsAstrium2011-01-30 to 2011-02-26
MIRJPL6MIRI Flight-like detectors in cryoJPL

2016-08-24 to 2016-09-09

MIRJPL7MIRI Flight-like detectors in cryoJPL

2017-03-06 to

2017-03-24

OTISENVPre-OTIS environmental testingGSFC2016-10
OTISCVOTIS testingJSC

2017-07 to

2017-10

NGASWarm functional testing at Northrup Grumman post-deliveryNGAS2018-05-28 to 2018-06-05

 

Table of Contents

 

Test Number (p)

This is a string combining the test campaign and a Job Number from a file. This can be used to search for both files and packages. An example would be icv1_04270 (or  #4270, 04270, _04270, or 4270), which indicates a file taken as part of CV1 testing at Goddard with the JOBID 4270.

Date (p)

Date and time in which the data were acquired. This option also has a histogram with slider bars and date entry boxes that can be used to narrow down a date range. Type the beginning date and the end dates into the boxes and press 'Enter'. Single dates may be specified using the format YYYY-MM-DD hh:mm:ss.

Test Title (p)

Title of test as specified in the test plan or specified by instrument teams. This title comes from the title of the test as defined in the scripts, for example: M03392-DARKS-3270161936_1, G1TRACK-CENTER_1 and NWF03756-CV2-1-4119145426_1. This title is usually (but not always) part of the File Name. To find MIRI telemetry (housekeeping) files, choose 'Package' for Retrieval Type and *Housekeeping* for Test Title.

Test Goal

One or more predefined objectives for the test, taken from the following lists. The menu contains all of the available options and the tables below contain a short description of how each option was defined.

Facility Tests 
backgroundbackground from test environment
externaltest of setup exposures
setuptest of external equipment
Hardware Tests 
alivenessstandard aliveness test
currentadjust current
functionalstandard functional test
heaterheater test
lamplamp test
mechanismmechanism test
softwaresoftware test
telemetrytelemetry / sensor test
temperaturetemperature control test
timingevent timing test
tuninghardware tuning test (ASIC)
voltageadjust voltages
Environmental Tests 
emcgeneric electromagnetic compatibility (EMC) test
emc-conductionEMC conductive coupling
emc-emissionEMC emissivity test
emc-radiativeEMC radiative coupling
emc-susceptibilityEMC radiative coupling
Detector Characterization 
darkdark rate measurement
flatdetector flat field measurement
gaindetector gain measurememt
linearitydetector linearity measurement
noisedetector noise measurement
persistencepersistence measurement
qequantum efficiency measurement
readoutexploring different readout modes
saturationsaturation measurement
Instrument Characterization 
alignmentalignment measurement
anomaliesoptical anomalies (ghosts, etc.)
coarsephasingcoarse phase-plate measurement
distortionoptical distortion measurement
finephasingfine phase-plate measurement
flatinstrument flat field measurement
focusfocus measurement
intermediatephasingintermediate phase-plate measurement
leaklight leak measurements (instrument in dark configuration, MSA contrast
orientationorientation measurement
phaseretrievalphase retrieval
platescaleplate scale measurement
polarizationdetermining polarization characteristics
psfpoint spread function measurement (also LSF)
spectrophotometryspectrophotometry tests
stabilitystability measurement
throughputinstrument throughput measurement
wavelengthwavelength scale measurement
wfswavefront sensing
Optical tests (used for OTIS test data only)
fsmFine steering mirror
guidingguiding test or demo
oteOptical Telescope Element
pmsa

Primary Mirror Segment Array

pupilOTE, FSM, or SI pupil alignment/measurement
smaSeconday Mirror Assembly
vignettingFOV or pupil osbcuration measurement
thermaltest of thermal response
ssr-flushfile designed to flush the ssr and force data processing

Optical Element

The options for this search parameter combine Filter and Pupil. The menu below the text box contains all of the available options. The user can type either filter or pupil options into the search box or search the scrollable menu.

For MIRI, there is no pupil, so the filter options are the following: F560W, F770W, F1000W, F1130W, F1280W, F1500W, F1800W, F2100W, F2550W, F2550WR, FND, F1065C, F1140C, F1550C, F2300C, and OPAQUE. If the filter is labeled with a W, it is a wide pass filter, if it ends in C, it is a coronagraphic filter. MIRI also has a neutral density filter (FND) to be used for corongraph target acquisition, and an OPAQUE filter to be used for darks.

For NIRCam, the Filter options are: clear, F070W, F090W, F115W, F140M, F150W, F150W2, F182M, F187N, F200W, F210M, F212N, F250M, F277W, F300M, F322W2, F335M, F356W, F360M, F410M, F430M, F444W, F460M, F480M, INDEF, UNKNOWN, WL3, and WLP4. The Pupil options to be paired with the filters are: CLEAR, DGHS60, DHS2, F162M, F164N, F33N, F323N, F405N, F466N, F470N, FLAT, GDHS0, GRISMV2, GRISMV3, Imaging, MASKBAR, MASKIPR, MASKRND, PINHOLES,  WL1, WL2, WLM8, WLP8,   INDEF, and UNKNOWN. Not all pupils can be paired with all filters. Start by typing in the filter or pupil you are searching for and then narrow down the options from there.

For NIRISS, the Filter options are: F090W, F115W, F158M, F140M, F150W, F200W, NRM, GR700XD, and CLEARP. The Pupil options are: CLEAR, F277W, F356W, F380M, F430M, F444W, F480M, GR150C, and GR150R.

For TFI, the Filter options are: CLEAR, F158M, F175, F200M, F229M, F349M, F425M, F470M and INITIAL. The Pupil options are: CLEAR, FLAT, FND, LINE, MASK21, MASK71, MASKNR, OPAQUE and INITIAL.

FGS has no Filters or Pupils.

Grating

Disperser Element. The searchable menu allows you to scroll through and view all possible options.

For MIRI, there are three disperser elements as part of the IFU: SHORT, MEDIUM, and LONG. These three elements can be crossed for Grating wheel A and Grating wheel B to form combinations like SHORT,LONG.

NIRSpec has the Gratings G140H, G235H, G395H, G140M, G235M, G395M, MIRROR, and PRISM.

Secondary Columns

File ID

Number given to the fits files by the archive. Each fits file will have a unique File ID. This number is not recorded in any logs, and will not be usable as a search box.

Package ID

Number given to the package files by the archive. Multiple files associated with a single package will have the same Package ID. This number is not recorded in any logs, and will not be usable as a search box.

ASIC Part Number

Part number of ASIC(s) used in a test.

MIRI has no ASICs and won't have any options here.

NIRCam: 228, 234, 223, 225, 263, 242, 232, 241, 251, 255,  256

TFI: 239,

FGS: 246, 253

NIRSPec:

128nrsds2009-06-30 to 2009-08-07, 2009-12-10 - 2010-01-31
131nrsds2009-06-30 to 2009-08-07, 2009-12-10 - 2010-01-31
202nrsds2009-08-21 to 2009-11-30, 2010-02-15 to 2010-05-26
215nrsds2009-08-21 to 2009-11-30, 2010-02-15 to 2010-05-26
244nrsds2010-07-16 to 2011-04-16
252nrsds2010-07-16 to 2011-04-16

ASIC Temperature

Temperature of ASIC (K). Besides the text entry boxes for a temperature range, there is a histogram with slider bars.

Bench Temperature

Temperature of optical bench (K). Besides text entry boxes for temperature ranges, there is a histogram with slider bars.

Central Wavelength

Central wavelength (µm). Range: -1 to 5.5. Besides text entry boxes for the central wavelength, there is a histogram with slider bars.

Data Set Name (p)

Root name of the observation set (note several files may have same root name). Examples include: FGS_I_T-CVAC_G2TFG_FGDEMA-FGSTFI_03106, ISIM_I_T-IM-SUB128-S-S-3269084020_1-ICV1_04748

Description (p)

Short description of purpose and content of test. Note: if a data package needs to be subdivided, the parameters will all be the same except for the description. For ISIM data, this is the name of the original zip file directory. For example: 

DIR=IM-SUB128-S-S-3269084020_1_4748_JW1_JLAB88_20130926T084107.101_20130926T084612.969

Detector

Name of the detector. This search box contains a selectable list of options.

For FGS, the options are FGS1 and FGS2.

For MIRI, the options are MIRIMAGE, MIRIFUSHORT, and MIRIFULONG.

For NIRISS, the only option is NIRISS.

For NIRCam, the options are: NRCA1, NRCA2, NRCA3, NRCA4, NRCALONG, NRCB1, NRCB2, NRCB3, NRCB4, and NRCBLONG.

For NIRSpec, the options are NRS1 and NRS2.

For TFI, the only option is TFI.

External Field Points

This option allows searching a menu of selectable external field points.

This option allows the user to search through more than 4000 external field points. Examples for this field include OTESKY_AM: (0.00; 0.00) and NCA_DHS.

Note: If you receive an 'unresponsive script' message when you try to view all options, clicking on 'Continue' should allow you to see them all.

External Filter

The External filters for the test setup. These would be any filters used as part of the test setup before light hits the instrument. An example for MIRI testing; at RAL the external filters would be HOLE or BLANK.

This option allows searching a menu of over 100 selectable external filters.

External Focus

This option allows searching a menu of over 200 selectable external focus points. MIRI does not use this keyword. Examples include: +4 WAVE, -2.0 mm, and -4.6.

External Lamp

Designation of the external lamps used in testing. Examples of this option are: for MIRI testing at RAL, options are: POINT,PINHOLE_100; POINT,PINHOLE_25, EXTENDED and PSS_LED. For fgstfi tests, the OGSE was used for the external lamp for both FGS and TFI. This option allows searching a menu of over 700 selectable external lamp names.

External Pupil

Designation of any external pupils used as part of the test setup. This option allows searching a menu of over 400 selectable external pupil names. A few examples of options are: DIFFUSER and SPIDERS-A, CPP-1 from NIRCam and TRICONTAGON from ISIM tests.

File Size

Size of the data file in bytes.

FPA Part Number

Part number of FPA used in test. 

For NIRSpec, the part numbers are: 104, used from 2009-08-21 to 2009-11-30 and 2010-02-15 to 2010-05-26, 105 used from 2010-07-16 to 2011-04-16, 106 from dcla testing, 107 from dclb testing, 103 from nrsds testing,  and PF which was used from 2009-06-30 to 2009-08-07 and 2009-12-10 to 2010-01-30.

FGS used 005 and 006 from fgstfi testing, 011 and 014 from CV3 testing.

NIRISS used 012 for CV3 testing.

TFI had 003 from fgstfi testing.

For MIRI, The Verification Model test run used the number FPM-003 for the MIRIMAGE detector, FPM-005 for MIRIFULONG, and FPM-004 for MIRIFUSHORT. The JPL test campaigns used FPM-101SCA-106 and SCAB. For the Flight detectors, with test runs including Cryo-Vac testing at Goddard, the FPM numbers are FPM-106 for MIRIMAGE, FPM-104 for MIRIFULONG, and FPM-105 for MIRIFUSHORT.

FPA Temperature

Temperature of focal plane assembly (K). In addition to the text entry boxes, there is a histogram with slider bars.

Group Gap

Number of frames skipped as part of the readout pattern. This search box has a selectable menu to scroll through.

Ingest Date

        Date the data was ingested into SID. In addition to text entry boxes, there is a histogram with slider bars. Data may not have been ingested in chronological order by when it was taken.

Instrument Mode

This lists the MIRI Subarray modes. Not used for other instruments. The available options are: BRIGHTSKY, FULL, MASK1065, MASK1140, MASK1550, MASKLYOT, SLITLESSPRISM, SUB64, SUB128, SUB256, and for FM1 tests only, AXIS64, AXIS128, AXIS256. For JPL tests, there are also the following: CHR5CUSTOM, BRIGHT128, SUB512X128, and SUB320X320.

Integration Time

Total amount of time for each integration in the data. In addition to text entry boxes, there is a histogram with slider bars.

Internal Lamp

Internal illumination source

MIRI: the only internal lamp is a Tungsten filament lamp with a diffusing surface within an integrating sphere. The only options for MIRI are: ON or OFF.

FGS: These values were derived from the observation logsheets of the various cryovacuum test campaigns.
The log entries were made by numerous people over many years and were not necessarily consistent. 
The options are: G1 or G2; PRIME or PRIMARY (search on PRI); REDUN or REDUNDANT (search on RED); CAL or LINE; and LEVEL 1 - LEVEL 6.
We recommend searching using the parameters above, then either culling the search results or refining your search based on your results.

NIRCam, the options are: FLATPLA, FLATPLB, FLATPSA, FLATPSB, FLATRLA, FLATRLB, FLATRSA, FLATRSB, LONGAP, LONGAR, LONGBP, LONGBR, NONE, SHORTAP, SHORTAR, SHORTBP, and SHORTBR.

NIRISS: These values were derived from the observation logsheets of the various cryovacuum test campaigns.
The log entries were made by numerous people over many years and were not necessarily consistent. 
The options are: '' or NONE

NIRSpec: CAA/FLAT1, CAA/TEST, CAA/REF, CAA/LINE3, CAA/FLAT3, CAA/FLAT2, CAA/FLAT5, CAA/LINE2, CAA/FLAT4, CAA/LINE1, CAA/LINE4,

TFI: These values were derived from the observation logsheets of the various cryovacuum test campaigns.
The log entries were made by numerous people over many years and were not necessarily consistent. 
The options are: PRIMARY or PRIME (search on PRI) or REDUNDANT; FLAT or LINE; LEVEL 1 - LEVEL 7; 
We recommend searching using the parameters above, then either culling the search results or refining your search based on your results.

Job Number

IGSS job number. This must be entered via the text box.

N Frame

Number of frames per group. (For modes that involve combining data.) This has a searchable menu.

N Group

Number of groups per integration. This has a searchable menu.

N Integration

Number of integrations per exposure. This has a searchable menu.

N Sample

Samples per pixel.

NAXIS1

X-axis dimension. Range: 0 to 2048. This has a searchable menu.

NAXIS2

Y-axis dimension. Range: 0 to 2048. This has a searchable menu.

PIL State

PIL State.

This only applies to NIRCam, the options are DEPLOYED, RETRACTED, DEPLOYING, OUTOFRANGE, RETRACTING, BETWEEN and UNKNOWN.

Readout

Readout mode. This has a searchable menu.

For FGS, the options are ACQ1, ACQ2, FINEGUIDE, ID and TRACK, FGSRAPID, and FGS.

For MIRI, the options are FAST, SLOW, FASTGRPAVG and FASTINTAVG and DEEP8 (roadshow only).

For NIRCam, the options are: RAPID, SLOW, BRIGHT1, BRIGHT2, SHALLOW2, MEDIUM2, MEDIUM8, SHALLOW4, DEEP2, and DEEP8.

For NIRSpec, the options are NRSRAPID, TNRSN16R4, SLOW, NRS, TNRSBRT2, and TNRSMID8.

For NIRISS, the options are NISRAPID and NIS.

For TFI, the options are ACQ1, ACQ2 and ID.

Release Date

Date the data will become non-proprietary. Since all Ground test data is proprietary indefinitely, a date of 2038-01-01 was chosen. This is not a useable box to search with.

SCA Part Number

Part number of the SCA used in the test.

NIRSpec has the following options: 40, 42, 54, 55, 58 and 60 for the nrsds tests. 17163, 17280, 17167, 17169,

NIRCam: C104, C073, C067, C072, C044, C090, C045, C043, C084, C101, 16990, 17025, 17047, 17026, 17027, 17024, 17005, 16991, 17158, 17011, 17023, 17161, 16989, 17048, 17006, 17012, 17004, 17162,

TFI/NIRISS: F027

NIRISS: 17315

FGS: F021, F022, 17328, 17329,

MIRI does not have SCA numbers.

Starting Column

Array column start pixel number

Starting Row

Array row start pixel number

Test ID

Test identification

Test Name

Name of test.

The MIRI team used this keyword to specify the names of tests as used in the Test Specification documents, usually taking the form IMG_RAD_01 or IMG_OPT_02.

  • No labels