Performance measurement and program evaluation can both help identify areas of programs that need improvement and determine whether the program is achieving its goals or objectives. They serve different but complimentary functions:
- Performance measurement is an ongoing process that monitors and reports on a program's progress and accomplishments by using pre-selected performance measures.
- Program evaluation, however, uses measurement and analysis to answer specific questions about how well a program is achieving its outcomes and why.
So, performance measurement data describes program achievement, and program evaluation explains why we see those results.
What is program evaluation?
Program evaluations are individual systematic studies conducted to assess how well a program is working and why. EPA uses program evaluation to create more effective and efficient programs. Through program evaluations, EPA can make better management decisions; support new and innovative approaches and emerging practices; continuously improve existing programs; and subsequently, improve human health and the environment.
What types of program evaluations are there?
Program evaluations can assess the performance of a program at all stages of a program's development. The type of program evaluation conducted aligns with the program's maturity (e.g., developmental, implementation, or completion) and is driven by the purpose for conducting the evaluation and the questions that it seeks to answer. The purpose of the program evaluation determines which type of evaluation is needed:
What is performance measurement?
Performance measurement is a way to continuously monitor and report a program's progress and accomplishments, using pre-selected performance measures. By establishing program measures, offices can gauge whether their program is meeting their goals and objectives. Performance measures help programs understand "what" level of performance is achieved.
How do we determine good measures?
Measurement is essential to making cost-effective decisions. We strive to meet three key criteria in our measurement work:
- Is it meaningful?: Measurement should be consistent and comparable to help sustain learning.
- Is it credible?: Effective measurement should withstand reasonable scrutiny.
- Is it practical?: Measurement should be scaled to an agency's needs and budgetary constraints.
How is performance measurement different from program evaluation?
A program sets performance measures as a series of goals to meet over time. Measurement data can be used to identify/flag areas of increasing or decreasing performance that may warrant further investigation or evaluation. Program evaluations assess whether the program is meeting those performance measures but also look at why they are or are not meeting them.
For example, imagine you bought a new car that is supposed to get 30 miles per gallon. But say, you notice that you are only getting 20 miles per gallon. That's a performance measurement. You looked at whether your car was performing where it should be. So what do you do next? You would take it to a mechanic. The mechanic's analysis and recommendations would be the program evaluation because the mechanic would diagnose why the car is not performing as well as it should.
You need performance measures to know whether your program (or car) is performing where it should be, and you do a program evaluation (or go to the mechanic) to find out the reason why it is not meeting those expectations.