Multi-criteria Integrated Resource Assessment (MIRA)
You will need the free Adobe Reader to view some of the files on this page. See EPA's PDF page to learn more.
On this page
- What is MIRA?
- Tools in the MIRA Toolbox
- 10 Steps of the MIRA Process
- Learn More
MIRA is a new approach to help decision makers make more informed environmental decisions that include stakeholder concerns.
The process is used to:
- Create an Environmental Index (using many indicators)
- Rank environmental elements such as counties, watersheds or alternative decision options (using many indicators)
Environmental Problems: Addressing Wicked Environmental Problems
Tame Problems are those that can be clearly defined and agreed to by all stakeholders and have a clear right answer. A math problem is an example of a tame problem. Tame problems can be very complex. Going to Mars is an example of a tame but complex problem.
Wicked problems (PDF) (15pp., 1.3MB) are those that:
- Have multi-dimensional context: The problem cannot be easily defined so that all stakeholders agree
- Have multiple stakeholder perspectives: The problem can be defined in many ways, including spatial and temporal scales. Complex judgment about the level of abstraction at which to define the problem is required.
- Have no clear stopping rules and require trade-offs among conflicting goals: There is no optimal solution or “right” or “wrong” answer; only better or worse alternatives (as judged by stakeholders).
- Are subjective and values-driven: There are no objective measures (or indicators) of success.
- Are learning-driven: Every trial counts and learning through analytical iteration is critical. There are no given alternatives; stakeholders must drive the learning to discover solutions.
- Have multi-dimensional legitimacy: These problems often have strong moral, professional and political dimensions.
Examples of Wicked Environmental Problems: Global climate change, Sustainability, Environmental risk management
Environmental Solutions: MIRA facilitates "clumsy" solutions
Elegant solutions address tame problems. Examples of elegant solutions are the answer to an algebra problem, the experimental results from a toxicological study, or the engineering design of the Mars landing vehicle.
Clumsy solutions are those that exhibit the following features:
Learn more about how clumsy solutions work from Vermeij et al. 2006. Clumsy Solutions for a Complex World: The Case of Climate Change. Public Administration 84 (4): 817-843 and about how MIRA facilitates clumsy solutions in Applications.
How the MIRA modules connect with each other and with outside information:
Data Collection Manager
- allows users to store, sort, and retrieve data such as source emissions, demographics, and environmental quality values
Geostatistical Indicators Module
- allows users to take spatial fields (i.e., maps) and collapse them into a single number in order to compare one map to another in making a decision
Programmatic and Budget Decision Analysis Module
- provides a way to organize all decision criteria (i.e., indicators), include expert opinions and include what's important to stakeholders in making a decision
- outputs from Cause and Effect Models (from EPA and non-EPA sources) become inputs into MIRA; connects science with decision making (via the MIRA Decision Analysis Module)
- Mechanistic Models:
- Explicitly include the mechanisms or processes between the state variables; unlike empirical models. The parameters in mechanistic models should be supported by data and have real-world interpretations (EPA, 2009b). Examples are Fate and Transport models like Air Quality Models (AERMOD, CMAQ) and Water Quality Models (HSPF, SWAT)
- Empirical Models:
- Rely upon the observed relationships among experimental data typically because information about the underlying mechanism is not understood or available. These can be thought of as ‘best-fit’ models whose parameters may or may not have real-world interpretation. Examples are probabilistic models like regression models and exposure models.
- Integrated Modeling:
- A systems analysis-based approach to environmental assessment. It includes a set of interdependent science based components (models, data, and assessment methods) that together form the basis for constructing an appropriate modeling system. The constructed modeling system is capable of simulating the environmental stressor-response relationships relevant to a well specified problem statement. (Integrated Modeling for Integrate Environmental Decision Making, EPA100/R-08/010) An example is integrated environmental modeling Technologies (iemTechnologies)developed by EPA’s National Exposure Research Laboratory (NERL). It is a suite of tools for integrated environmental modeling, including Data for Environmental Modeling (D4EM), Framework for Risk Analysis for Multimedia Environmental Systems (FRAMES), and Supercomputer for Model Uncertainty and Sensitivity Evaluation (SuperMUSE).
- Data for Environmental Modeling (D4EM):
- D4EM interfaces National, Regional, State, Local and user defined databases with modeling systems, such as FRAMES.
- Framework for Risk Analysis for Multimedia Environmental Systems (FRAMES):
- FRAMES allows models to communicate with each other, facilitating the passage of data, resulting in the simulation of complex environmental processes.
- Supercomputer for Model Uncertainty and Sensitivity Evaluation (SuperMUSE):
- SuperMUSE combines a software and hardware to allows analysts to select one or more components of the MIRA-FRAMES architecture depending on their analytical needs and also give them the capability to perform model uncertainty and/or sensitivity analysis.
- define the decision question; decide on decision criteria based on that question
- select the 'problem set' which is the set of elements (the decision options or pollutant sources) that are to be ranked using MIRA
- gather the data needed for each criterion
- index set of elements (expert input)
- weigh the criteria (decision maker/stakeholder values)
- create an initial 'decision set' (a problem set whose elements are ranked based on the data and criteria weighting)
- create different decision sets for the initial problem set and modifying that problem set if appropriate as learning occurs and additional options are discovered;
- discuss these with stakeholders
- make the final decision
The data from the Data Collection Manager and from the Geostatistical Indicators Module, as well as other databases or models, are incorporated into the MIRA Process in step 3, as guided by the decision criteria and the problem set identified in steps 1 and 2. Users are key to the MIRA approach as it is these stakeholders that determine what criteria are used, which data adequately represent those criteria, how the criteria are weighted and the kinds of alternatives that will be examined.
Select the number to the right of each application or keyword to jump to its corresponding reference.
|Creating an Environmental Index||7, 8|
|Ranking Environmental Elements
||1, 5, 10
2, 4, 5, 9, 10
2, 3, 11
Find Applications by Keywords
|Air Toxics||4, 5, 10|
|Budget prioritization||5, 10|
|Decision Analysis/Decision Making||15, 16, 17, 18, 19, 20|
|Economics||1, 2, 3|
|Ecosystem||5, 10, 20|
|Energy||1, 5, 10|
|Environmental Condition||2, 5, 10, 12, 21|
|Indicators||1, 2, 5, 6, 10, 12, 14, 20, 21|
|Multi-pollutant||4, 5, 10|
|Ozone||2, 4, 5, 6, 10, 12, 14|
|PM2.5||4, 5, 10|
|Public Health||4, 5, 6, 10, 12, 14|
|Risk Management||4, 5, 10, 12, 20|
|Stakeholders||1, 3, 4, 5, 6, 10, 12, 14, 15, 16, 17, 18, 19, 20|
|Sustainability||5, 10, 20|
|Uncertainty||2, 3, 11, 21|
|Watershed Condition||5, 10|
- Using Environmental, Energy, Climate, Economic and Social Indicators to Evaluate Selected Crop Fertilizer Practices in the Chesapeake Bay Watershed (PDF) (1 pg, 533K)
- Air Quality Data - A Methodology to Assess Optimal Ozone Monitoring Network Design (PDF) (21 pp, 766K)
- Environmental Policy Analysis:How Much Uncertainty is Too Much and How Do We Know? (PDF) (29 pp, 1.3MB)
- Philadelphia Air Toxics Study: Evaluation of Risk Management Options Using MIRA (PDF) (1 pg, 83K)
- Trans-Disciplinary Learning: A Case Study Linking Science to Budgets (PDF) (18 pp, 1.3K)
- Evaluating Ozone Nonattainment: Technical Support Document for the 8-hour Ozone Designations 11-Factor Analysis
- Technical Support Document Cover Memo (PDF) (27 pp, 137K)
- Errata Sheet to Technical Support Document (PDF) (1 pg, 8.4K)
- Attachment A - Letter Discussing the MIRA Approach (PDF) (7 pp, 80K)
- Attachment B - 8-hour Ozone Nonattainment Designations - Comparison with EPA 120d Recommendations vs. State Responses (PDF) (6 pp, 52K)
- Attachment C - Memorandum of Agreement to Allow EPA to Grant the Separation of the Fredericksburg 8-Hour Ozone Nonattainment Area From the Washington, DC 8-Hour Ozone Nonattainment Area (PDF) (3 pp, 34K)
- Attachment D
- Charles City County, VA 2001 (PDF) (9 pp, 340K)
- Charles City County, VA 2002 (PDF) (9 pp, 375K)
- Charles City County, VA 2003 (PDF) (9 pp, 394K)
- Hampton Roads, VA 2001(PDF) (9 pp, 368K)
- Hampton County, VA 2002 (PDF) (9 pp, 347K)
- Hampton Roads, VA 2003 (PDF) (9 pp, 356K)
- Henrico County, VA 2001 (PDF) (9 pp, 336K)
- Henrico County, VA 2002 (PDF) (9 pp, 410K)
- Henrico County, VA 2003 (PDF) (9 pp, 369K)
- Attachment E
- Attachment F
- PM2.5 Public Health Community of Practice - Baltimore, MD (PDF) (19pp, 287K)
- Indicators and Implicit Weighting Scheme of the Hazard Ranking System (HRS) (PDF) (17pp, 78K)
Please contact your local library or EPA's Philadelphia library to obtain the unlinked documents listed below.
- Stahl, C.H. and A.J. Cimorelli. 2013. A Demonstration of the Necessity and Feasibility of Using a Clumsy Decision Analytic Approach on Wicked Environmental Problems. Integrated Environmental Assessment and Management 9(1): 17-30.
- Stahl, C.H., A.J. Cimorelli, C. Mazzarella and B. Jenkins. 2011. Toward Sustainability: A Case Study Demonstrating Transdiciplinary Learning Through the Selection and Use of Indicators in a Decision Making Process. Integrated Environmental Assessment and Management 7(3): 483-498.
- Sanderson, H., C. H. Stahl, R. Irwin and M. D. Rogers. 2005. Reflections on uncertainty in risk assessment and risk management by the Society for Environmental Toxicology and Chemistry's (SETAC) precautionary principle workgroup. Water Science and Technology 52: 73-79.
- Cimorelli, Alan J. and Cynthia H. Stahl. 2005. Tackling the Dilemma of the Science-Policy Interface in Environmental Policy Analysis . Bulletin of Science, Technology, and Society 25: 46-52.
- Stahl, Cynthia H. and Alan J. Cimorelli. 2005. How Much Uncertainty is Too Much and How Do We Know? A Case Example of the Assessment of Ozone Monitoring Network Options. Risk Analysis 25: 1109-1120.
- Stahl, Cynthia H., Cristina Fernandez and Alan J. Cimorelli. April 15, 2004. Technical Support Document for the Region III 8-hour Ozone Designations 11-Factor Analysis. Philadelphia, PA: U.S. Environmental Protection Agency, Region III.
- Stahl, Cynthia H. 2003. Multi-criteria Integrated Resource Assessment (MIRA): A New Decision Analytic Approach to Inform Environmental Policy Analysis. University of Delaware. For the degree of Doctor of Philosophy.
- Stahl, Cynthia H., Alan J. Cimorelli and Alice H. Chow. 2002. "A New Approach to Environmental Decision Analysis: Multi-criteria Integrated Resource Assessment (MIRA)" (PDF) (17 pp, 146K) , Bulletin of Science, Technology, and Society 22: 443-459.
- EPA Office of the Inspector General (August 15, 2002), "Consistency and Transparency in Determination of EPA's Anticipated Ozone Designations" (PDF) (36 pp, 115K), Report No. 2002-S-00016
- Cimorelli, Alan J., Cynthia H. Stahl, Alice H. Chow and Cristina Fernandez. June 1999. Decision Consequence Model (DCM): Integrating Environmental Data and Analysis Into Real-Time Decision Making paper presented to the Air and Waste Management Association Conference in St. Louis, Missouri.
- Stahl, Cynthia H., Hong-Jin Kim, Alan J. Cimorelli and Alice H. Chow. 1999. Decision Consequence Model (DCM): Integrating Environmental, Social, Political and Economic Impact Assessment into Real-Time Decision Making. Proceedings of the 19th Annual Meeting of the International Association for Impact Assessment, Glasgow, Scotland
- Stahl, Cynthia H. and Todd S. Bridges. 2013. "Fully baked" sustainability using decision analytic principles and ecosystem services . Integrated Environmental Assessment and Management 9(4): 551-553.
- Cimorelli, Alan J. and Cynthia H. Stahl. 2014. Avoiding "Proofiness": Addressing uncertainty in environmental characterization . Integrated Environmental Assessment and Management 10(1): 141-142.
Cynthia Stahl (firstname.lastname@example.org)
Decision Analysis Module
Office of Environmental Information & Analysis (3EA10)
Environmental Assessment & Innovation Division
US EPA Region 3
1650 Arch St.
Philadelphia, PA 19103-2029
Janet Kremer (email@example.com)
Model Outputs / Integrated Modeling
Office of Environmental Information and Analysis (3EA10)
Environmental Assessment & Innovation Division
US EPA Region 3
1650 Arch St.
Philadelphia, PA 19103-2029