One of the main tasks of the TSO WG on FY2020 is to perform testing of the steps made by the JWST Calibration Pipeline for TSO-like data. This tracking sheet contains all the information regarding pipeline testing by the members of the TSO WG. Nestor Espinoza and Sarah Kendrew will be populating this page heavily in the weeks of July 20 and 27, 2020, for NIRISS and MIRI TSO testing, respectively. Nikolay Nikolov and Tony Keyes will be populating at their own pace for NIRCam and NIRSpec, respectively.
In general, if bugs are found, the best would be to discuss them first in one of our meetings before going ahead and submitting them (unless this is high-priority, in which case we could schedule a special meeting for this). This is left at the discretion of each TSO WG member.
Before jumping to read the below table, some important comments to keep in mind while reading them:
Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
---|---|---|---|---|---|---|---|---|
group_scale | The step is supossed to do nothing for NIRISS/SOSS (here, a group = 1 frame). Indeed, nothing changes when running this step, except for the length of the ASDF element in the HDU list object, which is normal. | N/A | ||||||
dq_init | This step correctly initializes the data-quality flags, as it is supposed to do. However, still not clear what the PIXELDQ mask is reporting. GROUPDQ masks make sense with respect to the reference file bad pixel mask. | |||||||
saturation | This step does what is expected to do: it captures saturated pixels and flags them in the GROUPDQ masks. The simulations used for this validation had saturated pixels and they were correctly identified (flagged) by the pipeline. | |||||||
superbias | N/A | |||||||
reset | N/A | N/A | This was tested on a TSO imaging file separately since this step does not currently run by default. The test passed with no issues. | N/A | ||||
linearity | ||||||||
rscd | N/A | N/A | N/A | |||||
dark_current | ||||||||
refpix | ||||||||
jump | Step produced no errors. Manually introduced jumps were detected. | |||||||
ramp_fitting | *rateints files show spikes not seen with my own ramp fits, and do not report timestamps. This has been identified as an awesimsoss header bug. | produced rateints with 7.5 and independent linear fits; substantial difference in a subset of data. | ||||||
gain_scale | ||||||||
Extended comments by instrument branch:
Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
---|---|---|---|---|---|---|---|---|
assign_wcs | ||||||||
extract_2d | ||||||||
flat_field | ||||||||
srctype | ||||||||
photom | ||||||||
extract_1d | This step currently extracts the whole subarray as a spectrum, which produced order overlap, which makes this step produce an unusable product for science. An algorithm is in development for this step. For details, see . |
Extended comments by instrument branch:
Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
---|---|---|---|---|---|---|---|---|
assign_wcs | N/A | N/A | ||||||
flat_field | N/A | N/A | ||||||
photom | N/A | N/A |
Extended comments by instrument branch:
Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
---|---|---|---|---|---|---|---|---|
outlier_detection | ||||||||
tso_photometry | ||||||||
extract_1d | ||||||||
white_light |
Extended comments by instrument branch: