Dual-Anonymous Peer Review for NASA Astrophysics Proposals
June 2 2020 - AAS Special Session 201
Introductory remarks Paul Hertz, Director, NASA Astrophysics Division
The ABCs of Breaking Bias in Science Stefanie K. Johnson, Leeds Business School, University of Colorado
Abstract: In this talk, Johnson covers the business case for diversity as it pertains to maximizing global competitiveness in science. She explains some of the biases that impede diversity initiatives and provides ways of overcoming those biases to effectively promote greater diversity in science.
HST Telescope Allocation Committee: Process and Statistics Iain Neill Reid, Space Telescope Science Institute
Abstract: Statistical analysis shows that proposals with male Principal Investigators had a higher success rate than those led by female PIs in Cycles 11 through 25. This talk will describe steps taken by STScI to mitigate the potential impact of unconscious biases, culminating in moving the TAC review to a fully dual-anonymous process. Some results from the most recent TACs will be presented.
Observations and Analysis of Dual-Anonymization at HST Jessica F. Kirk, University of Memphis
Abstract: Using archival data, we examine the effects of the Hubble Space Telescope Time Allocation Committee (HST TAC)’s decision to adopt a dual- rather than single-anonymous review process. The change involved removing, to varying degrees, information about the Principal Investigator (PI) with the goal of reducing bias against women. Proposals led by female PIs were significantly more likely to be accepted in the five cycles following the changes compared to the 11 cycles using a single-anonymous review system. Taking a closer look at why these changes emerged, we examined data at the reviewer-level in the cycle immediately preceding the change compared to three of the cycles after the change. We found that male reviewers rated female PIs significantly worse than they rated male PIs before, but not after, dual-anonymization was adopted.
Implementation of Dual-Anonymous Peer Review at NASA Dan Evans, NASA Astrophysics Division
Abstract: Over the next year, all Astrophysics General Observer / General Investigator (GO/GI) programs will convert to a dual-anonymous peer review process. Not only will proposers be unaware of the identity of reviewers, but the reviewers will also not have explicit knowledge of the proposing teams’ and institutions’ identities. In addition, four NASA Science Mission Directorate ROSES-2020 programs (including ADAP and Habitable Worlds) will also switch to dual-anonymous peer review. NASA understands that the dual-anonymous peer review represents a major shift in proposal evaluation. Since NASA is committed to ensuring a smooth transition for the proposing community, NASA will provide detailed guidance in this talk. Topics that will be covered include: how to write anonymized proposals, how proposals will be evaluated, and which additional resources are available to assist the community with the transition.
Who gets time on Hubble: the dual-anonymous TAC process
June 2 2020 - webinar
The Cycle 28 HST TAC Review Louis Strolger, Space Telescope Science Institute
