Jump to main content.


Comparison of UAM Results with Ambient

Note: EPA no longer updates this information, but it may be useful as a reference or resource.


AIR QUALITY DATA

Definitions
Introduction
Urban Airshed Model
Evaluating UAM Performance using Surface Air Quality Data
Example Graphical Displays
Statistical Parameters for Model Performance Evaluation
Comparison of UAM Results with Aloft Air Quality Data
Characterization of Ozone Concentrations Aloft During SCAQS
Comparing UAM Predictions and Aloft Air Quality
Result of Comparison of Aloft Ozone and NOx Measurements with Model Predictions in SCAQS
Air Quality Regional Boundaries
Summary
References
Lumped Carbon-Bond Species
Relationship Between Individual Chemical Species and Lumped Carbon-Bond Species

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


DEFINITIONS

CALMET = Diagnostic meteorological model
CALRAMS = Prognostic meteorological model
CBIV = Carbon bond IV chemical reaction mechanism scheme
NOx = NO + NO2 + poorly defined fraction of other NOx species (given conventional analyzers)
NOy = NOx+ HNO3 + organic nitrates + inorganic nitrates = NOx + NOz
NOz = Oxidation products of NOx = NOy * (1 - NOx/NOy)
RHC = Reactive hydrocarbons
ROM = Regional oxidant model
UAM = Urban Airshed Model
IV = EPA Regulations version using CBIV; V = with variable grid
VOC = Volatile organic compounds

 [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


INTRODUCTION

 

  •  Important to compare Urban Airshed Model (UAM) output with ambient air quality data to assess model performance.
  •  Three broad types of ozone and precursor data useful for comparisons to UAM output:
    •  Surface air quality
    • Aloft air quality
    • Boundary conditions

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


URBAN AIRSHED MODEL (UAM)

  • The UAM is a 3-D grid model designed to calculate the concentrations of both inert and chemically reactive pollutants by simulating physical and chemical processes that take place in the atmosphere.
  • The UAM uses a mass balance in which relevant emissions, transport, chemical reaction, and removal processes are expressed in mathematical terms.
  • Simulations are usually 24- to 72-hour periods during which episodic meteorological conditions persist.
  • Typical UAM application:
    •  Select episode (usually widespread exceedance of ozone NAAQS, typical meteorological conditions).
    • Select modeling domain to encompass ozone monitors that reported exceedances and all major source regions.
    • Prepare model inputs using observed meteorological, emission, and air quality data for an episode.
    • Evaluate model performance.
  • The UAM is used for analysis of spatially and/or temporally differentiated future emission control strategies and their effect on air quality in various parts of the modeling region.

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    EVALUATING UAM PERFORMANCE USING SURFACE AIR QUALITY DATA

     Analytical Tools

    •  Graphical displays
    • Statistics

    Species

    • Ozone
    • NO, NO2, NOx, NOy
    • VOC in CBIV groups
    • VOC/NOy or VOC/NOx ratios

    Supplemental Data

    •  Meteorological data
    • Emissions estimates
    • Geophysical data
    • Data quality and completeness information

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


EXAMPLE GRAPHICAL DISPLAYS
  •  Time series plots
    • Compare observed and simulated pollutant concentrations for ozone, NO, NO2 (or NOy) and selected VOC for all monitoring sites within model domain.
    • Compare observed ozone concentrations with the minimum and maximum simulated concentrations within nine surrounding grid cells of a monitoring site.
  • Contour plots
    • Show simulated pollutant concentrations and observed concentrations for ozone, NO, NO2 (or NOy), and selected VOC for each hour.
  • Frequency distributions
    • Of residuals (differences between hourly observed and predicted concentrations) for ozone.
  • Scatter plots
    • Observed versus predicted hourly concentrations.

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 1.

Simulated Ozone Concentrations on August 17-20 1993

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 2.

Simulated and Observed NO2 Concentrations on June 28 1991

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 3.

Comparison between predicted and measured Reactive Hydrocarbon(RHC)

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 4.

Maximum Simulated (hourly averaged) Ozone Concentrations (ppb)

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 5.

Distribution of Predicted and Residual Ozone Concentrations

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


Figure 6

Ozone Prediction bias, error, and Residual stratified by concentration.

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


STATISTICAL PARAMETERS FOR MODEL PERFORMANCE EVALUATION

 

 EPA-Required Statistical Parameters

Normalized accuracy of domainwide maximum 1-hr concentration unpaired in space and time
Mean normalized bias of all predicted and observed concentration pairs where the observed exceeds minimum concentrations
Mean normalized error of all predicted and observed concentration pairs where the observed exceeds minimum concentrations
Observed domainwide maximum 1-hr concentration

 These definitions assume all observed peak concentrations exceed the maximum concentrations.

  

 Additional Statistical Parameters

Absolute accuracy of domainwide maximum 1-hr concentrations paired in space and time
Normalized accuracy of domainwide maximum 1-hr concentrations paired in space and time
Absolute accuracy of domainwide maximum 1-hr concentrations paired in space and unpaired in time
Normalized accuracy of domainwide maximum 1-hr concentrations paired in space and unpaired in time
Absolute accuracy of domainwide maximum 1-hr concentrations paired in time and unpaired in space
Normalized accuracy of domainwide maximum 1-hr concentrations paired in time and unpaired in space
Absolute accuracy of domainwide maximum 1-hr concentrations unpaired in space and time
Mean normalized bias of predicted and observed maximum 1-hr concentrations at all monitoring stations
Mean normalized error of predicted and observed maximum 1-hr concentrations at all monitoring stations
Mean absolute bias of predicted and observed maximum 1-hr concentrations at all monitoring stations
Mean absolute error of predicted and observed maximum 1-hr concentrations at all monitoring stations
Mean absolute bias of predicted and observed pairs where the observed exceeds minimum concentrations
Mean absolute error of predicted and observed pairs where the observed exceeds minimum concentrations

 These definitions assume all observed peak concentrations exceed the maximum concentrations.

  

[Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


COMPARISON OF UAM RESULTS WITH ALOFT AIR QUALITY DATA

 

 Introduction 

  • Knowledge of pollutant concentrations aloft is important for understanding the evolution and sources of ozone concentrations measured at surface-based monitoring sites.  
  • The characteristics of aloft pollutant concentrations and the results of comparisons between simulated and measured concentrations can provide insights into ways to improve model representations of what is occurring in the atmosphere and ways to improve model performance evaluations.
  • Analysis Approach 

  • Characterize pollutant concentrations aloft (3-D analyses using aircraft or other aloft air quality data).
  • Compare surface and aloft pollutant concentrations.
  • Compare aloft pollutant concentrations with model predictions.
  •    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    CHARACTERIZATION OF OZONE CONCENTRATIONS ALOFT DURING SCAQS

      

  • High concentrations of ozone often exist in aloft layers.
  • Aloft ozone layers often mix down to the surface.
  • Aloft layers were generally horizontal in structure.
  • Mixed-layer average ozone concentrations were higher than surface concentrations.
  •   [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 7

    Location of 2-Dimensional Data Plane (dashed line) and nearby Aircraft Spiral locations.

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 8

    Ozone Concentrations (ppb)

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 9

    Comparison of midday and afternoon mixed-layer-average and surface ozone concentrations.

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


     COMPARING UAM PREDICTIONS AND ALOFT AIR QUALITY

    • Obtain UAM air quality output (all layers) for grid cells surrounding air quality measurement location.
    • Obtain gridded mixing heights for these cells.
    • Bin aloft data to match UAM output layers.
    • Plot comparisons.
    • Investigate spatial and temporal variability of the UAM output.
    • Review results with respect to meteorological conditions leading to the ozone episode.

      [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 10

    Comparison of aloft ozone measurements with model predictions...

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 11

    Vertical Profile of ozone concentration measured by Aircraft Spiral compared to the UAM averages...

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 12

    Vertical Profiles of ozone concentrations measured by Aircraft Spiral compared to the UAM average for El Monte, CA, June 24, 1987

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 13

    Vertical Profiles of ozone concentrations measured by Aircraft Spiral compared to the UAM average for El Monte, CA, June 25, 1987

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 14

    Vertical profiles of NOx concentrations measured by aircraft spiral compared to the UAM average for El Monte, June 25, 1987. The 15-m vertical average aircraft NOx concentrations, 5-layer model predictions, and model layer-averaged aircraft data are shown.

    Vertical profiles of NOx concentrations measured by aircraft spiral compared to the UAM average for El Monte, June 25, 1987. The 15-m vertical average aircraft NOx concentrations, 5-layer model predictions, and model layer-averaged aircraft data are shown. The model predictions were significantly lower aloft (particularly at about 500 to 100 m msl) and significantly higher in the surface layer all day. (Roberts et al., 1993b)

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    RESULTS OF COMPARISON OF ALOFT OZONE AND NOx MEASUREMENTS WITH MODEL PREDICTIONS IN SCAQS

    • Model predictions of ozone below 200 m agl in the morning were ³ measured concentrations.
    • Model predictions of ozone above about 200 m agl were typically about 50 to over 100 ppb lower than measured concentrations.
    • Model predictions of NOx below about 400 m agl in the morning were both higher and lower than measured concentrations.
    • Model predictions of NOx above 400 m agl in the midday and afternoon were typically lower than measured concentrations.
    • Modeling recommendations included the need to properly represent significant ozone concentrations aloft (esp. 500-1000 m), mixing of ozone layers to the surface, horizontal pollutant structure aloft, and mixed-layer ozone greater than surface ozone concentrations.

      [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    AIR QUALITY AT REGIONAL BOUNDARIES

     

    •  Surface air quality data not necessarily sufficient
    •  Regional models often underpredict ozone at upwind boundaries
    •  Important to look at precursors
    •  Definition of boundary

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Figure 15

    Assess Boundry Conditions - Surface and aloft ozone concentrations along the 1991 LMOS southern boundary in the morning, midday, and evening on July 18.

    [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    Average aloft (above 600 m msl) and surface NOx concentrations along the 1991 LMOS southern boundary in the morning, midday, and evening on July 18 (Roberts et al., 1994).

     

     Sites

     NOx Concentration (ppb)

     Morning

     Midday

    Evening

     Surface         
     Streator

     5

     3

     2

     Kankakee

     9

     5

     13

     Jasper

     8

     4

     4

     Aloft

     2

     4

     4

    Aloft and surface NMOC concentrations along the 1991 LMOS southern boundary in the morning, midday, and evening on July 18 (Roberts et al., 1994).

     

     Sites

     NMOC Concentration (ppbC)

    Morning

     Midday

     Evening

    Surface      
    Kankakee

    88

    136

    133

    Casper

    100

    58

    51

    Aloft      
    Streator (500 m)

    33

    103

    35

    Streator (1300 m)

    49

    134

    52

    Kankakee

    28

    182

    40

    Rochester

    36

    241

     

      [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


     SUMMARY

     

    • Comparisons should also be made with ozone and ozone precursors, including NO, NOy, and speciated VOC.
    • Comparisons at domain boundary are important.
     Analysis/Procedure  Example Tool(s)
     Process UAM output  Programming
     Compare surface ambient air quality with UAM output  Statistical packages, spreadsheets, other data display
     Examine aloft air quality  Statistical packages, spreadsheets, surfer
     Compare UAM output and aloft air quality  Spreadsheets, graphics
     Investigate domain boundary conditions  Statistical packages, spreadsheets, other data display

      [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    COMPARISON OF URBAN AIRSHED MODEL REFERENCES

    Adamski W. (1997) An analysis of measured and predicted concentrations aloft of ozone and total reactive oxides of nitrogen in the eastern U.S. during July 1995. Draft report prepared by Wisconsin Department of Natural Resources, Racine, WI, January.

    California Air Resources Board (1995) Sacramento area modeling analysis for the 1994 state implementation plan. Report prepared by Technical Support Division, California Air Resources Board, Sacramento, CA, April.

    Cassmassi J., Mitsutomi S., Bassett M., Lester J.C., and Zhang X. (1994) Ozone modeling - performance evaluation. Draft technical report V-B prepared by South Coast Air Quality Management District, Diamond Bar, CA, June.

    Eisinger, D.S., Deakin E.A., Mahoney L.A., Morris R.E., and Ireson R.G. (1990) Transportation control measures: state implementation plan guidance. Revised final report prepared by Systems Applications International, San Rafael, CA, SYSAPP-90/084, September.

    Hanna S.R., Moore G.E., and Fernau M.E. (1996) Evaluation of photochemical grid models (UAM-IV, UAM-V, and the ROM/UAM-IV couple) using data from the Lake Michigan Ozone Study (LMOS). Atmos. Environ. 30, 3265-3279.

    McNair L.A., Harley R.A., and Armistead G.R. (1996) Spatial inhomogeneity in pollutant concentrations, and their implications for air quality model evaluation. Atmos. Environ. 30, 4291-4301.

    Roberts P.T. and Main H.H. (1992a) Characterization of three-dimensional air quality during the SCAQS. In Southern California Air Quality Study Data Analysis. Proceedings from SCAQS Data Analysis Conference, University of California, Los Angeles, CA, July 21-23, Air & Waste Management Association, Pittsburgh, PA, (STI-1223), VIP-26.

    Roberts P.T., Main H.H., Lindsey C.G., and Korc M.E. (1993a) Ozone and particulate matter case study analysis for the Southern California Air Quality Study. Final report prepared for the California Air Resources Board, Sacramento, CA by Sonoma Technology, Inc., Santa Rosa, CA, STI-90020-1222-FR, May.

    Roberts P.T., Main H.H., and Korc M.E. (1993b) Comparison of 3-D air quality data with model sensitivity runs for the South Coast Air Basin. Paper No. 93-WP-69B.05 presented at the Air & Waste Management Association Regional Photochemical Measurement and Modeling Studies Conference, San Diego, CA, November 8-12, (STI-1244).

    Roberts P.T., Dye T.S., Korc M.E., and Main H.H. (1994) Air quality data analysis for the 1991 Lake Michigan Ozone Study. Final report prepared for Lake Michigan Air Directors Consortium, Des Plaines, IL by Sonoma Technology, Inc., Santa Rosa, CA, STI-92022-1410-FR.

    Stoeckenius T.E., Ligocki M.P., Shepard S.B., and Iwamiya R.K. (1994a) Analysis of PAMS data: application to summer 1993 Houston and Baton Rouge data. Draft report prepared by Systems Applications International, San Rafael, CA, SYSAPP94-94/115d, November.

    Systems Applications International, Sonoma Technology Inc., Earth Tech, Alpine Geophysics, and A.T. Kearney (1995) Gulf of Mexico Air Quality Study. Vol. I: summary of data analysis and modeling. Final report prepared for U.S. Department of the Interior, Minerals Management Service, Gulf of Mexico OCS Region, New Orleans, LA, OCS Study MMS-95-0038.

    Tesche T.W., Georgopoulos P., Seinfeld J.H., Cass G., Lurmann F.W., and Roth P.M. (1990) Improvement of procedures for evaluating photochemical models. Draft final report prepared for Research Division, California Air Resources Board, Sacramento, CA by Radian Corporation, Sacramento, CA, Contract No. A832-103, March.

    U.S. Environmental Protection Agency (1991) Guideline for regulatory application of the Urban Airshed Model (UAM). Report prepared by U.S. Environmental Protection Agency, Research Triangle Park, NC, EPA 450/4-91-013.

     [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


    LUMPED CARBON-BOND SPECIES

      Carbon Number

    MW

     Carbon-bond Species

    Comments

     1

     15

     PAR  Represents single-bonded carbon groups

    2

    28

    OLE Represents terminal double-bonded carbon groups

    2

    28

    ETH Represents ethylene

    7

    92

    TOL Represents toluene and other aromatics with a single side chain

    8

    106

    XYL Represents xylene and other aromatics with multiple side chains

    5

    68

    ISOP Represents isoprene

    2

    30

    FORM Represents primarily formaldehyde

    2

    44

    ALD2 Represents higher aldehydes and internal double-bonded carbon groups

      [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]


     

    RELATIONSHIP BETWEEN INDIVIDUAL CHEMICAL SPECIES REPORTED IN PAMS DATA SETS AND LUMPED CARBON-BOND SPECIES

     

     

     Carbon Number

    Carbon-bond Speciesa

    Individual Chemical Species Splits

    1

    PAR

    0.2´ethan + 0.5´acety + 0.5´propa + nbuta + isbta + ispna + npnta + cypna + nhexa + 23dmb + 0.83´22dmb + 2mpna + 3mpna + cyhxa + mcpna + nhept + 2mhxa + 3mhxa + 24dmp + mcyhx + noct + 2mhep + 3mhep + 0.875´224tmp + 234tmp + nnon + ndec + nundec + 0.33´prpyl +0.5´1bute + 0.6´(1pnte + 3m1be + 2m2be + cypne) + 0.2´(c2pne + t2pne) + 0.17´benz + 0.125´ebenz + 0.22´(ispbz + npbz) + 0.11´(124tmb + 135tmb) + 0.33´(c2hex + t2hex) + 0.83´2m1pe + 0.67´4m1pe

    2

    OLE

    0.67´prpyl + 0.5´1bute + 0.4´(1pnte + 3m1be) + 0.33´4m1pe + 0.125´styr

    2

    ETH

    ethyl

    7

    TOL

    tolu + 0.875´(styr + ebenz) + 0.78´(npbz + ispbz)

    8

    XYL

    pxyl + m/pxyl + pxyl + 0.89´(124tmb + 135tmb)

    5

    ISOP

    Ispre

     a The relationships between FORM and ALD2 and individual chemical species are not indicated because ambient data for important components of those lumped species are not available.

    Source: Stoeckenius et al., 1994a

     [Workbook Table of Contents] [Top of Urban Airshed Modeling] [Previous Section] [Next Section]

     


    Local Navigation


    Jump to main content.