You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 19 Next »

Text revised and expanded from this page:  HST Astrometry Project Overview

Improved WFC3 and ACS Data Products

Beginning 3 December 2019, improved astrometry for WFC3 and ACS imaging data is available from MAST and includes two new corrections to the header world coordinate system (WCS). The first includes an updated Hubble Guide Star Catalog (GSC version 2.4.0) which updates the coordinates of the guide stars with the positions from Gaia DR1. This reduces the typical uncertainties in the positions of the guide stars to <~100 mas over the entire sky. Combining this new information with the knowledge of the instrument distortions, an a priori correction has been made for all WFC3 and ACS observations in order to lock all HST observations onto a common absolute reference frame. When possible, an additional correction has been applied by aligning sources in each HST image directly to the Gaia catalog; this fit is referred to as an a posteriori correction. While some observing modes cannot be aligned to Gaia (e.g. grism and moving target observations) or the alignment may fail due to a lack of sources in either the HST image or the Gaia catalog, approximately 70% of the WFC3 and ACS frames have been aligned successfully. For these data products, the typical pointing uncertainty is reduced to ~10 mas, although the uncertainties increase for observations further in time from the Gaia reference epoch (2015.0 for DR1, 2015.5 for DR2)

Guide Star Catalogs

Historically, the accuracy of HST absolute astrometry has been limited primarily by uncertainties in the celestial coordinates of the guide stars as specified in the Guide Star Catalog. GSC 1.1 had nominal rms errors of ~0.5 arcsec per coordinate, with errors as large as ~1‐3 arcsec reported near the plate edges. This accuracy improved substantially in October 2005 (during Cycle 15) with the introduction of GSC 2.3.2, where rms errors per coordinate were reduced to ~0.3 arcsec over the whole sky.  An updated version of the catalog (GSC 2.4.0) was released in October 2017, improving the celestial coordinates with the positions from Gaia DR1 and reducing errors to < 30mas over the entire sky. Thus, after including uncertainties in the positions of the science Instruments (SIs) in the alignment of the focal plane to the Fine Guidance Sensors (FGS), the total error in HST absolute astrometry is ~1 arcsec for observations made with GSC 1.1, ~0.3 arcsec for those made with GSC 2.3.2, and ~0.1 arcsec when using the new GSC 2.4.0.  A summary of the GSC catalogs and associated errors over the HST lifetime is provided in Table 1. 


Table 1: Key Guide Star Catalog releases and associated errors 

Catalog

Release Date

Mean Epoch of catalog positions

Typical errors

Worst errors

Total Error (including SI to FGS alignment)

Comment

GSC 1.0

Jun 1989



1-2”


 GSC1 summary

GSC 1.1

Aug 1992

1981.8

0.5”

~1”

~1”

First version published for the user community

Used by HST operations prior to Cycle 15

WFPC2 installed Dec 1993

GSC 2.0

Jan 2000





Science target fields only; GSC2 summary

GSC 2.2.0

Jun 2001





Public Release

ACS installed Mar 2002

GSC 2.3.2

Oct 2005

1992.5

0.3”

0.75”

0.3”

Public Release

GSC 1.1 and GSC 2.3.2 Comparison

GSC 2.3.3Oct 2009



WFC3 installed May 2009

GSC 2.4.0

Oct 2017

2015.0

0.03”


0.1”

GSC2.3.4 aligned to Gaia DR1    

Complete GSC Summary

HST Astrometry Project

The coordinates populated in the FITS headers of HST observations retrieved from DADS (the HST Data Archiving and Distribution Service) were derived based on the guide star coordinates in use at the time of the observation. As the accuracy in these catalogs were refined over time, the pointing accuracy of HST has also improved. Table 1 lists the catalog in use at the time of installation of the three main imaging cameras (WFPC2, ACS, and WFC3) and the typical errors at each epoch.

The goal of the HST Astrometry Project is to correct these inconsistencies in the archival data products as much as possible.  As observations are processed or reprocessed in the HST pipeline, their World Coordinate System (WCS) will be updated to use the most accurate solution available. There are two types of corrections that can be performed:

  • a priori         : correct the coordinates of the guide stars in use at the time of observation to the coordinates of those guide stars as determined by Gaia by applying a global offset to the WCS
  • a posteriori  : identify sources in the HST image and cross-match with positions from an external reference catalog (such as Gaia) to derive an improved WCS based on fitting x/y to RA/Dec

Note that a priori corrections are only relevant for observations which executed prior October 2017 (eg. prior to the release of GSC 2.4.0), and these will still include small errors in the alignment of the science instruments to the HST focal plane. The a posteriori corrections are limited to imaging instruments for which there are an adequate number sources to define a reference catalog for matching. These solutions remove uncertainties in the focal plane and are expected to have the smallest absolute astrometric error.

Implementation

The key to implementing improvements to the astrometry is the use of headerlets, self-contained FITS extensions containing a WCS transformation which can be attached to a FITS file and applied to the primary WCS. An observation can have multiple headerlets, each of which may have astrometry derived by differing methods. As HST data is processed/reprocessed, all available headerlets will be present as FITS extensions in the archived image with the best solution applied to the primary WCS.  More details on how the WCS information is stored in headerlets may be found on the page Astrometry in Drizzled Products.

WCS Naming Conventions

Successfully aligning an observation to Gaia using the a posteriori processing will result in an update of the 'active' WCS of the image with the new solution and the new headerlet extension. This headerlet not only includes the WCS keywords which define the transformation from pixels to Gaia-aligned positions on the sky, but it also contains information about how this solution was derived along with the errors to be expected based on the fit. 

The various WCS solutions are identified by the WCSNAME keyword found in each FITS headerlet and use the following naming convention: 

wcsName = OriginalSolution - CorrectionType

 where OriginalSolution may be either

  •    OPUS : initial ground system wcs, no distortion correction
  •    IDC_xxxxxxxxx : initial distortion corrected wcs  (where xxxxxxxxx = geometric distortion model used, eg. the rootname of the IDCTAB reference file)

 and CorrectionType may have several forms

  •    GSC240 : a priori WCS where guide star coordinates are corrected from the original reference frame (e.g. GSC1.1 or GSC2.3) to the Gaia DR1-based GSC2.4.0
  •    HSC30 :   a priori WCS corrected from the original reference frame to the Hubble Source Catalog (HSC v3.0) frame which is based on Gaia DR1
  •    FIT-IMG-ReferenceCatalog : a posteriori WCS derived from matching to a reference catalog, where 'IMG' implies individual fits for each image to the reference catalog
  •    FIT-REL-ReferenceCatalog : a posteriori WCS derived from matching to a reference catalog, where 'REL' implies images were aligned to one other before a global catalog alignment

More details on interpreting the WCS names may be found on the Astrometry in Drizzled Products page. A list of possible 'active' WCSNAME values populated in the image headers is provided in Table 2.


Table 2: Sample active WCSNAME keyword values and the corresponding WCSTYPE description 

WCSNAME

WCSTYPE

Comment

OPUS

‘distorted not aligned’

No distortion correction has been applied; analysis of these FLT/FLC files may only be performed if corrected by the instrument-specific pixel area map

IDC_0461802ej

‘undistorted not aligned'                                                                   

Distortion corrected using the IDCTAB reference file '0461802ej_idc.fits', but not aligned to an external catalog

IDC_0461802ej-GSC240

‘undistorted a priori solution based on GSC240'

Alignment based on Guide Star Catalog v2.4.0 (GSC240).  Absolute errors ~0.1"

IDC_0461802ej-HSC30

‘undistorted a priori solution based on HSC30’

Alignment based on Hubble Source Catalog v3.0.  HSC30 errors are typically smaller than GSC240. If both corrections are available, HSC takes precedence.

IDC_0461802ej-FIT_REL_GAIADR1

‘undistorted a posteriori solution relatively aligned to GAIADR1’

Exposures relatively aligned to one another, and subsequently aligned as a set to Gaia DR1

IDC_0461802ej-FIT_REL_GAIADR2

‘undistorted a posteriori solution relatively aligned to GAIADR2’

Exposures relatively aligned to one another, and subsequently aligned as a set to Gaia DR2 (including proper motion corrections to HST observation epoch)

IDC_0461802ej-FIT_REL_NONE

‘undistorted a posteriori solution relatively aligned to NONE’

Exposures relatively aligned to one another, but the quality of the fit to an absolute reference catalog is unverified and should be checked by the user

IDC_0461802ej-FIT_IMG_GAIADR1

‘undistorted a posteriori solution aligned image-by-image to GAIADR1’

Exposures individually aligned to Gaia DR1 (not as a set)

IDC_0461802ej-FIT_IMG_GAIADR2

‘undistorted a posteriori solution aligned image-by-image to GAIADR2’

Exposures individually aligned to Gaia DR2 (including proper motion corrections to the HST observation epoch)

IDC_0461802ej-FIT_IMG_NONE

‘undistorted a posteriori solution aligned image-by-image to NONE’

Exposures individually aligned to an astrometric reference catalog, but the quality of the fit is unverified and should be checked by the user

Usage 

Images downloaded from the archive after reprocessing with the new Enhanced Pipeline Products code will have headerlets added as extra extensions to the FITS file. A python notebook <insert LINK> has been developed to familiarize users with the structure of the new FITS images and to demonstrate how the primary WCS may be changed to any other preferred solution. These instructions will also show how to back out the new WCS updates entirely if desired (see the section below on Future Improvements).

Alternatively, any of the new WCS solutions may be downloaded from MAST/STScI as separate headerlet files and applied to existing data. For users who wish to manually reprocess existing data, the 'updatewcs' task in the STWCS package as used by the Enhanced Pipeline Products code will be able to automatically connect to the astrometry database to retrieve and apply the headerlets. Python functions for creating, updating, and applying headerlets to FITS images are described via the Headerlet User Interface.

Improvements in Future Releases

While the majority of calibrated HST data products are now aligned to a common absolute reference frame, there are still improvements which will be available in the next data release.  For example, exposures obtained in the same visit would have been aligned (relatively) to one another in prior archival products but may no longer aligned in the new HAP.

  • Grism images will now be offset from their direct image counterparts, where only the later of which may be aligned to an external reference catalog.
  • Exposures in different filters (eg. narrowband vs broadband) which were obtained in the same visit may no longer be aligned to one another, for example, if each filter had a different number of matches to Gaia.
  • Short and long exposures obtained in the same visit may no longer be aligned due to potentially different number of Gaia matches.

Further refinements to the alignment will be available in the next release of Hubble Advanced Products, referred to as 'Single Visit Mosaics'.



____Suggested basic examples for the Jupyter notebook___:

1.) Show the extra extensions

from astropy.io import fits
fits.info('/internal/hladata/ENVS_OUTPUT/ALIGNDEV_12Oct19/popen-gw1/test_alignpipe_randomlist_J8C020/j8c041sdq_flc.fits')

No. Name Ver Type Cards Dimensions Format
0 PRIMARY 1 PrimaryHDU 279 ()
1 SCI 1 ImageHDU 253 (4096, 2048) float32
2 ERR 1 ImageHDU 57 (4096, 2048) float32
3 DQ 1 ImageHDU 49 (4096, 2048) int16
4 SCI 2 ImageHDU 249 (4096, 2048) float32
5 ERR 2 ImageHDU 57 (4096, 2048) float32
6 DQ 2 ImageHDU 49 (4096, 2048) int16
7 WCSCORR 1 BinTableHDU 59 14R x 24C [40A, I, A, 24A, 24A, 24A, 24A, D, D, D, D, D, D, D, D, 24A, 24A, D, D, D, D, J, 40A, 128A]
8 HDRLET 1 NonstandardExtHDU 22 (60480,)
9 HDRLET 2 NonstandardExtHDU 26 (112320,)
10 HDRLET 3 NonstandardExtHDU 26 (112320,)
11 HDRLET 4 NonstandardExtHDU 26 (112320,)
12 HDRLET 5 NonstandardExtHDU 26 (112320,)
13 HDRLET 6 NonstandardExtHDU 26 (112320,)
14 WCSDVARR 1 ImageHDU 15 (64, 32) float32
15 WCSDVARR 2 ImageHDU 15 (64, 32) float32
16 D2IMARR 1 ImageHDU 15 (64, 32) float32
17 D2IMARR 2 ImageHDU 15 (64, 32) float32
18 WCSDVARR 3 ImageHDU 15 (64, 32) float32
19 WCSDVARR 4 ImageHDU 15 (64, 32) float32
20 D2IMARR 3 ImageHDU 15 (64, 32) float32
21 D2IMARR 4 ImageHDU 15 (64, 32) float32
22 HDRLET 7 NonstandardExtHDU 26 (112320,)
23 HDRLET 8 NonstandardExtHDU 26 (112320,)

2.) Show the different headerlets and the corresponding WCSNAMEs.  Explain how to know which WCS is primary.

from stwcs.wcsutil.headerlet import headerlet_summary

headerlet_summary('/internal/hladata/ENVS_OUTPUT/ALIGNDEV_12Oct19/popen-gw1/test_alignpipe_randomlist_J8C020/j8c041sdq_flc.fits',columns=['HDRNAME','WCSNAME'])

EXTN              HDRNAME                                                   WCSNAME                           
8         j8c041sdq_flt_OPUS-hlet.fits                                 OPUS
9        OPUS2019-06-04                                                    IDC_0461802ej                    
10       j8c041sdq_flt_OPUS-GSC240-hlet.fits                 OPUS-GSC240                   
11        j8c041sdq_flt_IDC_0461802ej-GSC240-hlet.fits IDC_0461802ej-GSC240    
12       j8c041sdq_flt_OPUS-HSC30-hlet.fits                    OPUS-HSC30                     
13       j8c041sdq_flt_IDC_0461802ej-HSC30-hlet.fits    IDC_0461802ej-HSC30      
22      IDC_0461802ej                                                          IDC_0461802ej
23      IDC_0461802ej-FIT_REL_GAIADR2                          IDC_0461802ej-FIT_REL_GAIADR2

3.) Show how to determine which WCS is primary

fits.getval('/internal/hladata/ENVS_OUTPUT/ALIGNDEV_12Oct19/popen-gw1/test_alignpipe_randomlist_J8C020/j8c041sdq_flc.fits','WCSNAME',1)

'IDC_0461802ej-FIT_REL_GAIADR2'

4.) Example showing how to back out the primary WCS in order to restore alignment between grism observations and their direct image counterparts.





  • No labels