Peer Review
Peer review is a critical tool EPA uses to ensure that only high-quality, validated science is released or used by the Agency. High quality scientific and technical information enables EPA and stakeholders alike to effectively participate in assessing and managing human health and environmental risks. The Peer Review Program oversees Agency efforts to develop and implement peer review procedures and approaches for EPA staff and managers.
About Peer Review
The Purpose of Peer Review
Peer review is intended to uncover any technical problems or unresolved issues in a preliminary (or draft) work product through the use of independent experts. This information is then used to revise that draft product so that the final work product will reflect sound technical information and analyses. Peer review is a process for enhancing a scientific or technical work product so that the product is improved, and any decision or position taken by the Agency, based in part on that product, has a sound, credible basis.
How Peer Review Differs from Public Comment
Public comment does not necessarily draw the kind of independent, expert information and in-depth analyses expected from the peer review process. Public comment is open to all issues, whereas the peer review process is limited to consideration of specified technical issues. While it may be an important component of EPA's decision-making process, public comment does not substitute for peer review.
Peer Review of Extramural Research
In addition to peer review requirements for all EPA-produced research, all EPA-funded extramural research (e.g., research grants) must also undergo peer review.
All eligible grant applications are reviewed by an appropriate peer review panel comprised of non-EPA scientists, engineers, social scientists and/or economists who are accomplished in their respective disciplines and proficient in the technical subjects they are reviewing. These peer review panels provide critical, independent, and objective evaluations of each grant proposal. Peer reviewers read grant applications and independently evaluate the scientific merits of each project proposal based on specific criteria.
Resources and Products
Peer Review Handbook
Peer review is the evaluation of a product by independent experts in that field who were not involved in that product's development. It is a critical tool used by EPA to ensure that only high-quality, verified science is released or used by the Agency. The EPA Peer Review Handbook (2015) is a how-to manual that is used by staff across EPA and is often referred to by external stakeholders as a model of good peer review practices.
Policy and Memo
Supporting the Handbook, the Peer Review Policy (and memo signed by the Administrator in 2006) established the EPA's policy for peer review of scientifically and technically based work products that are intended to inform Agency decisions.
Bulletin and Agenda
The Office of Management and Budget Bulletin contains provisions for the conduct of peer review at all federal agencies in order to enhance transparency and accountability and applies to "influential scientific information," including "highly influential scientific assessments." The Bulletin requires federal agencies to conduct peer reviews of influential scientific information before it is disseminated to the public and to post Peer Review Agendas on their websites. The Peer Review Agenda lists Influential Scientific Information (ISI) and Highly Influential Scientific Assessment (HISA) products that were peer reviewed during a fiscal year and posts their peer review documents (e.g. plan, charge, draft product, peer review report, and agency response).
Contractor-Managed Peer Review Process
In March 2013, EPA strengthened its contractor-managed peer review process to address any actual or potential conflicts of interest with regard to peer review panels for Influential Scientific Information (ISI) or Highly Influential Scientific Assessments (HISA) products. For these products, peer review panel membership is now subject to public comment in order to increase transparency.