One of the main tasks of the TSO WG on FY2020 is to perform testing of the steps made by the JWST Calibration Pipeline for TSO-like data. This tracking sheet contains all the information regarding pipeline testing by the members of the TSO WG. Nestor Espinoza and Sarah Kendrew will be populating this page heavily in the weeks of July 20 and 27, 2020, for NIRISS and MIRI TSO testing, respectively. Nikolay Nikolov and Tony Keyes will be populating at their own pace for NIRCam and NIRSpec, respectively.
General guidelines for Pipeline Testing
- Please, test every step identified below. If for some reason you don't have time to test a step, let Nestor Espinoza and Sarah Kendrew know.
- Use the comments in the tables to post brief comments about the status of that testing step (think of it as a quick overview for others to know what is going on). For extended commentary, or details on how you performed the testing, use the text below the tables.
- If a bug is found, please report it in Jira as a "Bug" Jira ticket. Please copy the links to those tickets in the table below under the comments.
- For algorithm improvements/enhancements, please file an "Improvement" Jira ticket. Please copy the links to those tickets in the table below under the comments.
General comments
Before jumping to read the below table, some important comments to keep in mind while reading them:
- NIRISS testing is being done using awesimsoss NIRISS/SOSS simulations of HAT-P-1. Care must be taken as this is the first end-to-end simulation of awesimsoss (which is under active development).
- MIRI testing is being done using MIRISim simulations of MIRI/LRS.
- NIRCam testing is being done using Mirage simulations.
- NIRSpec testing is being done on CV3 data.
Below, we show the detailed ongoing pipeline testing. If a bug is found, please report it in Jira as a "Bug" Jira ticket. For algorithm improvements/enhancements, please file an "Improvement" Jira ticket. Please copy the links to those tickets below under the comments.
Stage 1: Detector Processing TSO testing
| Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
|---|---|---|---|---|---|---|---|---|
| group_scale | TODO | TODO | N/A | TODO | ||||
| dq_init | TODO | TODO | TODO | TODO | ||||
| saturation | TODO | TODO | TODO | TODO | ||||
| superbias | TODO | TODO | N/A | TODO | ||||
| linearity | TODO | TODO | TODO | TODO | ||||
| rscd | N/A | N/A | TODO | N/A | ||||
| dark_current | TODO | TODO | TODO | TODO | ||||
| refpix | TODO | TODO | N/A | TODO | ||||
| jump | DONE | Step produced no errors. Manually introduced jumps were detected. | TODO | TODO | TODO | |||
| ramp_fitting | ONGOING | *rateints files show spikes not seen with my own ramp fits, and do not report timestamps. This has been identified as an awesimsoss header bug. | ONGOING | produced rateints with 7.5 and independent linear fits; substantial difference in a subset of data. | TODO | TODO | ||
| gain_scale | TODO | TODO | TODO | TODO | ||||
Extended comments by instrument branch:
- NIRISS:
- Regarding error on ramp_fitting step, Nestor Espinoza is looking into what headers have to be added to awesimsoss in order for the step to properly work. The problem has to do with the fact that the pipeline is not reading the time-stamps — and hence not calculating the rates correctly. After that's done, will run the step again and compare against his ramp fit (which was done using a simple OLS). - NIRCam
- MIRI:
- NIRSpec:
Stage 2: Spectroscopic processing TSO testing
| Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
|---|---|---|---|---|---|---|---|---|
| assign_wcs | TODO | TODO | TODO | TODO | ||||
| extract_2d | TODO | TODO | TODO | TODO | ||||
| flat_field | TODO | TODO | TODO | TODO | ||||
| srctype | TODO | TODO | TODO | TODO | ||||
| photom | TODO | TODO | TODO | TODO | ||||
| extract_1d | DONE | This step currently extracts the whole subarray as a spectrum, which produced order overlap, which makes this step produce an unusable product for science. An algorithm is in development for this step. For details, see JP-201 - Getting issue details... STATUS . | TODO | TODO | TODO |
Extended comments by instrument branch:
- NIRISS:
- NIRCam
- MIRI:
- NIRSpec:
Stage 2: Image Processing TSO testing
| Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
|---|---|---|---|---|---|---|---|---|
| assign_wcs | TODO | TODO | TODO | TODO | ||||
| flat_field | TODO | TODO | TODO | TODO | ||||
| photom | TODO | TODO | TODO | TODO |
Extended comments by instrument branch:
- NIRISS:
- NIRCam
- MIRI:
- NIRSpec:
Stager 3: Time-Series Observation(TSO) Processing testing
| Pipeline step | NIRISS status | NIRISS comments | NIRCam status | NIRCam comments | MIRI status | MIRI comments | NIRSpec status | NIRSpec comments |
|---|---|---|---|---|---|---|---|---|
| outlier_detection | TODO | TODO | TODO | TODO | ||||
| tso_photometry | TODO | TODO | TODO | TODO | ||||
| extract_1d | TODO | TODO | TODO | TODO | ||||
| white_light | TODO | TODO | TODO | TODO |
Extended comments by instrument branch:
- NIRISS:
- NIRCam
- MIRI:
- NIRSpec:
