Based on the available literature, feedback from the community, and the discussions of the Working Group, it is our recommendation that the Institute move toward a dual-anonymous proposal process beginning with Cycle 26 HST in late 2018. We understand that a fully anonymous process requires active participation from community, and that there is notable apprehension as to what the effect of anonymizing will do to the scientific productivity of the observatory. We therefore recommend a phased approach, in which most of review is done anonymously with a sensibility check done at the very end of the review.
- On the statistics on HST proposal success rates, HST Proposal Statistics.ppt (N. Reid)
- On Gender Bias in Hubble Proposal Ratings, Hubble Presentation.pptx (S. Johnson)
HST Proposal Process
The HST Call formally describes the proposal process and review policies each cycle. In particular, Chapter 6.1 covers how the reviews are done, and Chapter 6.2 discusses the selection criteria that we expect panel reviewers and the TAC to use for evaluations. The HST Peer Review Information site has much more detailed information from the Science Policies Group on HST peer review, including some history on the evaluation of the review, more specific guidelines to reviewers, presentations provided at orientation on the observatory status and science activities, lists of previous panelists and chairs, and the proposal processing procedures.
The STScI Chief Librarian, Jenny Novacescu, has complied a few articles on doubledual-blind anonymous peer reviews that should be have been useful in our discussions. They are available on Box (http://bit.ly/2ENhoV4), and include crib notes by the Librarian on each article in the See the document Anonymous-Double Blind Review Annotated Bibliography [Bibliography.docx.]. Before , but before diving into these articles, a place to start might be this article in Science Magazine.