An official website of the United States government.

We've made some changes to EPA.gov. If the information you are looking for is not here, you may be able to find it on the EPA Web Archive or the January 19, 2017 Web Snapshot.

Benchmark Dose Tools

Model Averaging Webinar Workshop Announcement

EPA’s National Center for Environmental Assessment (NCEA) hosted a public workshop on model averaging methods for dose-response analysis. The workshop was held by webinar in two half-day increments (12:00 PM–4:00 PM EST) on December 10-11, 2015. 

04/15/2016: EPA has reviewed and approved for release the Model Averaging Workshop Report. The report includes the pre-meeting written responses from discussants, discussants' comments during the workshop to the EPA discussion questions, and their responses to questions asked by workshop audience participants.


Workshop Overview

The purpose of this workshop is to obtain expert peer consultation on model averaging methods for dose-response analysis. To facilitate the workshop, EPA will provide invited workshop consultants with background and support materials for consideration, including a document describing methods that are consistent with published recommendations and software that illustrates how those existing methods could be implemented.

Workshop consultants will examine EPA’s background and support material and provide written comments prior to the workshop. Discussions and conclusions reached during the workshop will form the basis of a workshop report that EPA will consider for the identification of the model averaging method(s) that offer(s) the greatest potential for the development of chemical health assessments.

While the workshop support material and software describe candidate methods for use in evaluating continuous response measures, participants will also be asked to comment on the potential for extension of any preferred method(s) identified to dichotomous response measures.

Top of Page

Conference Link and Participation Guide

You can connect to the webinar by selecting this Adobe Connect address: http://epawebconferencing.acms.com/modelaveragingworkshop/ (opens in a new browser window).

You can download a 2-page Virtual Participation Guide from the Workshop Support Materials page. It contains basic information on how to use Adobe Connect for this conference.

Top of Page

Location/Date

This workshop will be held only by webinar. The workshop will be open to attendance by interested public attendees and/or speakers on a first-come, first-served basis up to the limits of available webinar room.

This workshop will be held December 10-11, 2015 from 12:00 pm - 4:00 pm EST.

Top of Page

Public Participation

Instructions for workshop registration are described on the Workshop Registration tab. Interested parties with expertise in this field of study are invited to provide their perspective by registering for the workshop and preparing a brief presentation (≤ 5 minutes) for the workshop consultants. Instructions for requesting to make a presentation at the workshop are provided on the Workshop Registration tab.

Top of Page

Background

The benchmark dose (BMD) method is a key component of chemical risk assessments performed by EPA, other U.S Federal and State Agencies, and multiple international organizations. The BMD method is used to establish toxicity values such as EPA reference doses and cancer slope factors for chemicals expected to have human health effects. Existing BMD methods involve the selection of a single dose-response model from among a suite of models with little biological basis, based largely on a comparison of model fits to the data. As such, they have been criticized for not adequately accounting for model uncertainty and biological considerations. Model averaging is a well-recognized and published scientific approach that can assist in the characterization of model uncertainty, and has the potential for incorporating biological considerations. Bayesian methods can be applied to allow prior information, including biological considerations, to influence model averaging results. Given these potential benefits, model averaging and several model averaging approaches are being investigated and tested by EPA.

Top of Page

Discussants

Name Affiliation
David Dunson Duke University
Ruth Hummel US EPA
Michael Messner US EPA
Walter Piegorsch University of Arizona
Woody Setzer US EPA
Matthew Wheeler National Institute for Occupational Safety and Health (NIOSH)

A PDF version of the discussants' response to the discussion questions is available for download from the Model Averaging Workshop Support Materials page.

Top of Page

Agenda

Thursday, December 10, 2015

Time Activity

12:00 – 12:20

Welcome and Opening Remarks

12:20 – 1:00

Public Presentations

1:00 – 1:20

Discussion Question 1: Overall approach to model-averaging

Are there other model averaging methods that EPA should consider?

1:20 – 2:00

Discussion Question 2, 5: Completeness of suite of models

Are there other parametric models that should be included in model-averaging? If so, do you recommend testing performance of the new suite?

2:00 – 2:15

BREAK

2:15 – 3:00

Discussion Question 3: Implementation of methods

Do you agree with the approaches used to implement the methods reviewed in the workshop support material?

3:00 – 3:30

Discussion Question 4: Testing approach

Should additional testing be performed to identify a model averaging approach for dose-response analyses that offers the greatest advantage for the development of chemical health assessments?

3:30 – 4:00

Day 1 Audience Questions and Day 1 Wrap-Up

4:00

ADJOURN

Friday, December 11, 2015

Time Activity

12:00 – 12:20

Welcome and Day 1 Recap

12:20 – 1:45

Discussion Question 6: Motives for using model averaging in health assessments

a. How useful is model averaging for characterizing model uncertainty?
b. How useful is model averaging for incorporating prior information?
 

Discussion Question 7: Should alternatives or complements to model averaging be investigated? Examples: Isotonic regression; Non-parametric and semi-parametric (Bayesian and frequentist) modeling; Full Bayesian model averaging; Flexible parametric models

1:45 – 2:00

BREAK

2:00 – 2:40

Discussion Question 8: Dichotomous Data

Describe any major concerns for the application of methods described in this report to dichotomous data. How do the results of the present background paper on models for continuous data compare to published work on model averaging for dichotomous models?

2:40 – 3:10

Discussion Question 9: Is Model Averaging Ready for Use in Chemical Health Assessment?

Is model averaging as implemented in the workshop support material suitable for use in chemical health assessments, possibly with some reservations or precautions? Can you identify circumstances when model averaging may be helpful and informative or misleading?

3:10 – 3:30

Discussion Question 10: Conclusions

Do you agree with the conclusions made in Section 4.1 of the workshop support material?

3:30 – 4:00

Audience Questions and Final Wrap-Up

4:00

ADJOURN

Top of Page

To register for the workshop, please send your name, title, affiliation, contact information, and if you are interested in making a brief (≤ 5 minutes) presentation to EPA_MA_Workshop@icfi.com. Registration will remain open, as permitted by webinar capacity, through the duration of the workshop.

If you are requesting to make a brief presentation, you will be sent instructions for the preparation and submission of presentation materials. To promote transparency, if you request to make a presentation, please also disclose: (1) The nature of any financial relationships (e.g., consulting agreements, expert witness support, or research funding) you may have with any organization(s) or entities having an interest in issues under discussion; and (2) The extent to which your comments were reviewed by an interested party prior to submission.

Please direct questions regarding workshop registration or logistics to Susan Blaine at EPA_MA_Workshop@icfi.com or by phone at 703-225-2471. To obtain clarification or provide comments on the workshop support materials, contact Jeff Gift, Ph.D., at gift.jeff@epa.gov or by phone at 919-541-4828.

Supporting Materials for the Workshop