Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Stage 1: Detector Processing TSO testing

Pipeline stepNIRISS statusNIRISS commentsNIRCam statusNIRCam commentsMIRI statusMIRI commentsNIRSpec statusNIRSpec comments
group_scale

Status
colourGreen
titleDone

The step is supossed to do nothing for NIRISS/SOSS (here, a group = 1 frame). Indeed, nothing changes when running this step, except for the length of the ASDF element in the HDU list object, which is normal.

Status
titletodo


N/A

Status
titletodo


dq_init

Status
colourGreen
titleDone

This step correctly initializes the data-quality flags, as it is supposed to do, according to the reference mask in CRDS.

Status
titletodo


Status
colourGreen
title

todo

DONE

(high-level test)

Status
titletodo


saturation

Status
colourGreen
titleDone

This step does what is expected to do: it captures saturated pixels and flags them in the GROUPDQ masks. The simulations used for this validation had saturated pixels and they were correctly identified (flagged) by the pipeline.

Status
titletodo


Status
colourGreen
title

todo

done

(high-level)

Status
titletodo


superbias

Status
colourGreen
titleDone

Tested my own bias substraction using reference files and got exact same results.

Status
titletodo


N/A

Status
titletodo


resetN/A
N/A

Status
colourGreen
titleDONE

This was tested on a TSO imaging file separately since this step does not currently run by default. The test passed with no issues.N/A
linearity

Status
colourGreen
titleDone

Tested linearity correction using reference files and got exact same results.

Status
titletodo


Status
titletodo


Status
titletodo


rscdN/A
N/A

Status
titletodo


N/A
dark_current

Status
colourGreen
titleDone

Dark frames perform expected corrections on the data.

Status
titletodo


Status
titletodo


Status
titletodo


refpix

Status
colour

Yellow

Green
title

ongoing

Done

Currently, does not do anything to NIRISS/SOSS simulations, as reference pixels there are set to zero. When injecting a fake strain of reference pixels got results I still don't understand (see below).

Status
titletodo


Status

titleTODO

colourGreen
titleDONE

skipped for MIRI subarray data so only needs testing for FULL array imaging TSOs. this step is sufficiently tested in unit tests.

Status
titletodo



jump

Status
colourGreen
titleDone

Step produced no errors. Manually introduced jumps were detected.

Status
titletodo


Status
titletodo


Status
titletodo


ramp_fitting

Status
colourYellow
titleongoing

*rateints files show small spikes that do not
seen with
show on my own
ramp fits, and do not report timestamps. This has been identified as an awesimsoss header bug.
ramps, even when being careful with GROUPSDQ.

Status
colourYellow
titleONGOING

produced rateints with 7.5 and independent linear fits; substantial difference in a subset of data.

Status
titletodo


Status
titletodo


gain_scale

Status
titletodo


Status
titletodo


Status
titletodo


Status
titletodo











Extended comments by instrument branch:

...

Pipeline stepNIRISS statusNIRISS commentsNIRCam statusNIRCam commentsMIRI statusMIRI commentsNIRSpec statusNIRSpec comments
assign_wcs

Status
titletodo


Status
titletodo


Status
colourYellow
titletodoONGOING


Status
titletodo


extract_2d

Status
titletodo


Status
titletodo


Status
titletodo


Status
titletodo


flat_field

Status
titletodo


Status
titletodo


Status
colourYellow
titletodoONGOING


Status
titletodo

Build 7.5: Failed current validation test  

passes for NRS2, but fails for NRS1:  

JP-1071 -NIRSpec: flat_field calspec2 step failing validation for FS ALLSLITS, BOTS, and MOS data OPEN

srctype

Status
titletodo


Status
titletodo


Status
titletodo


Status
titletodo

Build 7.5:  Logic is not correct, always defaults to POINT, even when provided EXTENDED

JP-1576 - source_type logic in spec2 is not correct for NIRSpec FS and MOS modes OPEN

photom

Status
titletodo


Status
titletodo


Status
titletodo


Status
titletodo


extract_1d

Status
colourRed
titleDone

This step currently extracts the whole subarray as a spectrum, which produced order overlap, which makes this step produce an unusable product for science. An algorithm is in development for this step. For details, see 

Jira
serverSTScI JIRA
serverIdaac911eb-9c55-3f14-8368-77b436fb6dc2
keyJP-201
.

Status
titletodo


Status
titletodo


Status
titletodo

Build 7.5:                methodology needs to be vetted by TSOWG

additional comments pending

...