Energy Conservation Standards for Residential Refrigerators

Proposed Rule

Score: 38 / 60

RULE SUMMARY

The Energy Policy and Conservation Act (EPCA) prescribes energy conservation standards for various consumer products and commercial and industrial equipment, including residential refrigerators, refrigerator-freezers, and freezers. The EPCA also requires the Department of Energy (DOE) to determine whether more stringent, amended standards for these products are technologically feasible and economically justified, and would save a significant amount of energy. In this NOPR, DOE proposes amended energy conservation standards for residential refrigerators, refrigerator-freezers, and freezers. The NOPR also announces a public meeting to receive comment on these proposed standards and associated analyses and results.


METHODOLOGY

There are twelve criteria within our evaluation within three broad categories: Openness, Analysis and Use. For each criterion, the evaluators assign a score ranging from 0 (no useful content) to 5 (comprehensive analysis with potential best practices). Thus, each analysis has the opportunity to earn between 0 and 60 points.

CriterionScore

Openness

1. How easily were the RIA , the proposed rule, and any supplementary materials found online?
The NOPR turns up in regulations.gov with a RIN search but not a keyword search. A link to the NOPR and the technical support document can be found five clicks from the DOE home page, if one knows to click on "energy efficiency" and "Office of Energy Efficiency and Renewable Energy." A chapter of the technical support document is called the RIA, but one must skim the entire document to get all of the analysis that is normally in an RIA. The NOPR repeatedly refers the reader to the "NOPR TSD" but only tells the reader that it is available at DOE's public reading room, even though it can be found online. A RIN search on the DOE web site does not produce the regulation.
3/5
2. How verifiable are the data used in the analysis?
Most data come from known sources that are cited and linked. Many data are reproduced in appendices or linked in spreadsheets. Some figures are sourced to discussions with manufacturers, a proprietary database, or other industry sources that would be difficult to verify.
4/5
3. How verifiable are the models and assumptions used in the analysis?
Models and assumptions are clearly laid out and described with peer-reviewed citations given when appropriate; references are often linked. Research appears to be from peer-reviewed articles where possible, otherwise government or industry studies. Spreadsheets used in the analysis are available on DOE's web site, with instructions for use included as appendices. While DOE conducted numerous interviews with affected manufacturers, it is not always clear how information from those interviews affected the analysis or even how this information was stored or analzyed. DOE also admits that "some models in use by energy efficiency program evaluation experts were so client-specific that generic relationships between economic parameters and consumer response could not be established."
3/5
4. Was the analysis comprehensible to an informed layperson?
Analysis was spread throughout a 966-page document that was loaded with redundancy and frequent use of numerous acronyms that would be virtually incomprehensible to an informed layperson. The analysis of benefits and costs was somewhat disjointed and confusing, as it switched back and forth between payback periods, life-cycle costs, net present value, and benefit-cost ratios--thus making the overall analysis somewhat bewildering for an intelligent and interested layperson. The NOPR is largely a summary of the analysis, which makes it easier for a trained economist or other professional to follow the analysis, but it is not a "plain English" summary. Many unfamiliar and probably unnecessary acronyms are used, such as "GFP" for "gas-filled panel" and "LCC" for "life-cycle cost." There may be more technological detail than most readers need, but it is certainly thorough.
3/5

Analysis

5. How well does the analysis identify the desired outcomes and demonstrate that the regulation will achieve them?
4/5
Does the analysis clearly identify ultimate outcomes that affect citizens’ quality of life?
Analysis identifies net monetary savings to consumers as a result of lower energy costs as well as environmental benefits associated with lower electricity use. These both affect citizens' quality of life.
5/5
Does the analysis identify how these outcomes are to be measured?
Benefits and costs of proposed standards are expressed in annualized values over the 30-year analysis period (2014–2043). Monetary values are the sum of (1) the annualized national economic value, expressed in 2009$, of benefits from operating products that meet the proposed standards (consisting primarily of operating cost savings from using less energy, minus increases in equipment purchase costs), and (2) the monetary value of the benefits of emission reductions, including CO2 emission reductions. A range of social costs of carbon and social costs of NOX emissions are used to monetize the environmental benefits.
5/5
Does the analysis provide a coherent and testable theory showing how the regulation will produce the desired outcomes?
Standards increase efficiency of refrigerators, and so consumers must purchase refrigerators with greater efficiency. Anlaysis recognizes that higher prices will reduce shipments, so the change in outcomes is the net change after accounting for this. The engineering analysis screens technologies for their effects on outcomes in a coherent manner. There is no clear theory explaining why government regulation can produce savings for consumers that consumers do not bother to capture themselves; there is one brief claim about economic literature on this but no theory or citations.
2/5
Does the analysis present credible empirical support for the theory?
Exhaustive engineering calculations assess energy efficiency associated with the different standards. Many assumptions, however, were based on interviews with the affected industry or outside experts without clearly showing or describing information gathered. Data presented in the analysis show that efficiency of refrigerators has increased over time, though whether this is a result of previous standards or other market forces is not clear. Given the extensive data and literature gathered to evaluate effects of alternative policies that were not adopted, it seems odd that DOE has not analyzed the effects of past standards to gauge new standards' effectiveness.
3/5
Does the analysis adequately assess uncertainty about the outcomes?
Analysis presents low, high, and primary estimates of benefits at various discount rates. Projected energy savings are adjusted to account for the fact that actual energy savings in the field differ from what DOE tests or calculations may suggest. (Although calculation of "rebuttable payback periods" uses the test data rather than actual data.) Life-cycle cost and payback period analysis uses Monte Carlo simulations (this counts under benefits rather than costs because life-cycle cost savings are calculated as a benefit). Estimating health benefits, DOE notes that, for NOX emissions, available estimates suggest a very wide range of monetary values, ranging from $370 per ton to $3,800 per ton of NOX from stationary sources, measured in 2001$ (equivalent to a range of $447 to $4,591 per ton in 2009$). This is a very wide range from which to present estimated heath benefits. Appendices show results with alternative assumptions about economic growth. Full compliance is assumed.
4/5
6. How well does the analysis identify and demonstrate the existence of a market failure or other systemic problem the regulation is supposed to solve?
1/5
Does the analysis identify a market failure or other systemic problem?
NOPR claims economics literature identifies a number of reasons consumers appear to undervalue future energy savings. These include lack of information, short-term bias, computational or other difficulties in evaluating the tradeoffs, divergent incentives (renters vs. owners), imperfect foresight, and uncertainty. They are simply listed with no elaboration. No mention of market failure is found throughout the 966-page document. Other than one vague reference to a global externality problem associated with greenhouse gases, there is no discussion of social costs associated with energy production in private markets.
2/5
Does the analysis outline a coherent and testable theory that explains why the problem (associated with the outcome above) is systemic rather than anecdotal?
NOPR asserts that extensive economics literature attempts to explain why consumers appear to undervalue energy efficiency improvements. It provides no citations to any literature. There is no discussion of why suppliers lack profit incentives to make these cost savings more apparent to customers. Some admissions in the analysis undermine DOE's implicit theory of consumer irrationality. Several manufacturers expressed concern that more stringent energy standards could adversely impact utility of their products and thus displease their customers. Several manufacturers indicated that other product features currently available (e.g., ice and water dispensers, glass doors, soda can dispensers, crisper compartments, anti-sweat features, and food preservation capabilities) may have to be removed in order to both meet new standard levels and maintain product prices that would be acceptable to consumers.
1/5
Does the analysis present credible empirical support for the theory?
The NOPR provides no evidence that any of the asserted reasons are actually true. A literature review in the appendix includes three studies that imply consumer discount rates for appliance energy savings average of 37%, but this is not carried through into any analysis of a systemic problem. (A high implicit discount rate with regard to operating costs means that, based on market behavior, consumers appear to put relatively low economic value on the operating cost savings realized from more efficient appliances.)
1/5
Does the analysis adequately assess uncertainty about the existence or size of the problem?
The "undervaluation" problem is assumed to exist based on assertions backed up by no citations to literature. DOE seeks comment on this issue, which can at least be taken as an acknowledgment of some uncertainty.
1/5
7. How well does the analysis assess the effectiveness of alternative approaches?
4/5
Does the analysis enumerate other alternatives to address the problem?
DOE considered five alternative "trial standard levels." A chapter titled "Regulatory Impact Analysis" assessed seven non-regulatory alternatives for achieving the chosen trial standard levels.
5/5
Is the range of alternatives considered narrow (e.g., some exemptions to a regulation) or broad (e.g., performance-based regulation vs. command and control, market mechanisms, nonbinding guidance, information disclosure, addressing any government failures that caused the original problem)?
DOE identified six non-regulatory policy alternatives that feasibly could provide incentives for the same energy efficiency levels as the proposed standards for the products. These are: consumer rebates, consumer tax credits, manufacturer tax credits, voluntary energy efficiency targets, early replacement, and bulk government purchases. The five trial standard levels are variations on the same regulatory approach, but with some pretty big differences in size. This is a wider range of alternatives than federal agencies usually consider, but they are all government focused and all are alternative ways to achieve energy savings by affecting consumer purchase decisions. There is no discussion of a public information campaign, which would appear a logical alternative if indeed consumers generally lack sufficient information about cost savings that DOE claims would follow more efficient appliances. There is also no mention of raising electricity rates (e.g., by raising tax rates), which would be consistent with promoting more efficient energy consumption if indeed there is a significant social cost associated with adverse environmental effects. Higher electricity rates would create greater incentives for both consumers to demand more efficient appliances and for suppliers to invest in improved technology that results in more efficient appliances.
5/5
Does the analysis evaluate how alternative approaches would affect the amount of the outcome achieved?
DOE evaluated each alternative in terms of its ability to achieve significant energy savings at a reasonable cost, and compared the effectiveness of each to the effectiveness of the proposed standard. Net consumer savings or costs, national energy savings, and emission reductions are calculated for all 5 trial standard levels. For the alternative policies, market penetration of efficient appliances and national energy savings are calculated, but other benefits are not calculated. Calculations for rebates, tax credits, and early replacement simply assume the amount of money the government spends is equal to what was done in past programs.
4/5
Does the analysis adequately address the baseline? That is, what the state of the world is likely to be in the absence of federal intervention not just now but in the future?
The baseline used to calculate energy savings is the Energy Information Administration's forecasts of energy prices and energy use, which do not assume the regulation will be adopted. Calculations adjust for projected increases in voluntary efficiency under the Energy Star program. The estimate base case is clearly identified as the "no new regulatory action" alternative. All of the above are strengths, but the analysis does not consider whether other marketplace developments might increase energy efficiency under the baseline.
2/5
8. How well does the analysis assess costs and benefits?
4/5
Does the analysis identify and quantify incremental costs of all alternatives considered?
Primary costs considered are increases in prices to consumers and decreased profits to manufacturers. These are calculated for all trial standard levels. Cost is not calculated for the policy alternatives, such as rebates or tax credits. Calculations for rebates, tax credits, and early replacement simply assume the amount of money the government spends is equal to what was done in past programs, but this is not calculated. Manufacturers stated that the financial burden of developing products to meet amended energy conservation standards has an opportunity cost due to limited capital and R&D dollars. Investments incurred to meet amended standards reflect foregone investments in innovation and the development of new features that consumers value and on which manufacturers earn a premium. DOE does not address existence or range of possible values of such costs or their effects on future standards of living for U.S. citizens.
4/5
Does the analysis identify all expenditures likely to arise as a result of the regulation?
Analysis predicts higher production costs, possible higher installation costs, consumers paying higher prices for appliances, and reduced revenues for electric utility firms. Analysis explicitly assumes, without substantiation, that maintenance and repair costs would not increase. It also discusses the cumulative regulatory burden affecting the manufacturers as a result of other pending rulemakings or legislation, but it does not appear to take these costs into account in the calculations.
4/5
Does the analysis identify how the regulation would likely affect the prices of goods and services?
Analysis calculates change in purchase price of refrigerators and change in operating cost due to increased energy efficiency for each trial standard level. It does assume a 37% discount rate to predict consumer purchase behavior, which is what economic research seems to show.
4/5
Does the analysis examine costs that stem from changes in human behavior as consumers and producers respond to the regulation?
Net changes in relative prices of refrigerators are used, along with estimated elasticity of demand, to predict future purchases in the presence of the standards. In the economics literature, DOE found only a few relevant studies of appliance markets. No studies use time-series data of product price and shipments data after 1980. The analysis claims that the literature suggests that the demand for appliances is price-inelastic, thus suggesting that higher product prices will not significantly deter consumers from purchasing more efficient appliances. It is not clear how accurate these predictions are, because manufacturers indicated some product features will change, which changes the nature of the product. DOE also stated that a number of manufacturers expressed concern that higher retail prices could alter consumers’ decisions to repair or replace their standard-size refrigerator-freezers. Another chapter estimates employment effects. DOE stated that some manufacturers believed the higher standards could force them to move their remaining domestic production to Mexico to take advantage of cheaper labor. Indirect employment impacts that occur because of the imposition of standards may result from consumers shifting expenditures between goods (the substitution effect) and from changes in income and overall expenditure levels (the income effect).
3/5
If costs are uncertain, does the analysis present a range of estimates and/or perform a sensitivity analysis?
Analysis presents low, high, and primary estimates of costs at various discount rates. In addition to using probability distributions to characterize several of the inputs to the calculation, DOE developed samples of individual households. DOE performed the life-cycle and payback period calculations for each household in the sample to account for the variability in energy consumption and/or energy price associated with a range of households. Based on the Monte Carlo simulations for each efficiency level, DOE calculated the percentage of consumers who would experience a net life-cycle benefit, a net life-cycle cost, or no impact.
4/5
Does the analysis identify the alternative that maximizes net benefits?
A table shows benefits, costs, and net benefits of the chosen standard level. This is only done for the proposed standards, not for all trial standards, but it could easily have been done. The benefit figure is a bit unusual because it nets out cost increases to consumers when calculating consumer benefits instead of categorizing these as a cost. Net benefits are not calculated for policy alternatives.
3/5
Does the analysis identify the cost-effectiveness of each alternative considered?
Cost-effectiveness is not explicitly calculated. With some work, it could be calculated for each trial standard level. It could not be calculated for the policy alternatives because costs are not calculated for the policy alternatives. The analysis shows the payback period for consumers, which is one type of cost-effectiveness measure but not a measure of social cost-effectiveness.
4/5
Does the analysis identify all parties who would bear costs and assess the incidence of costs?
Especially informative are calculations showing the percentage of households that will bear net costs or receive net benefits when increased appliance costs are weighed against decreased energy usage. A chapter of the analysis calculates costs for low-income and senior households and shows percentages that will bear net costs or receive net benefits, but concludes these differ little from the averages. DOE interviewed manufacturers, found only one that qualifies as a small business, and did not analyze the effects on this company separately. Consumer and industry analyses implicitly show how the burden is split between consumers and producers, but this is not really drawn out. DOE admits there may be negative effects on the actors involved in electricity supply (power plant providers, fuel suppliers, electricity generators, and electricity distributors). However, because the distribution of electricity is regulated everywhere and its institutional structure varies, DOE chose not to assess impacts on actors involved in electricity supply from reduction in electricity demand.
4/5
Does the analysis identify all parties who would receive benefits and assess the incidence of benefits?
Some consumers gain, if we presume the 3 or 7% discount rates are the "correct" ones. It is refreshing to see a hard analysis showing the percent of consumers that will actually receive benefits. A general equilibrium model estimates that employment will increase in other sectors because other sectors of the economy are more labor-intensive than electricity production. Analysis notes that the social cost of carbon figures are global benefits, not just U.S. benefits.
4/5

Use

9. Does the proposed rule or the RIA present evidence that the agency used the analysis?
The relevant statute requires that DOE select the maximum standard that is technically feasible and economically justified. The latter includes a number of economic factors, including costs to manufacturers, costs to consumers, value of energy savings to consumers, effects on utility or performance of the product, and competition. DOE must also consider the need for national energy savings (which includes environmental benefits) and any other factors the secretary believes are relevant. These statutory factors provide the framework for the analysis, and DOE explains how it used this analysis to choose standards. It is a little suspicious, though, that in three of four cases, DOE happened to choose the same standards that were recommended in a set of joint comments submitted by manufacturers, environmental advocates, and consumer groups. The NOPR dismisses the broader "regualtory alternatives" analyzed in the RIA by saying that DOE selected the option producing the maximimum improvement in energy efficiency that is technologically feasible and economically justified. The analysis of these alternatives seems to have played no role in decisions.
4/5
10. Did the agency maximize net benefits or explain why it chose another alternative?
Because of the statutory requirement (above), DOE will choose the alternative standard that maximizes net benefits only by accident. Net benefits were calculated only for the set of standards chosen, not for all trial standards, but they could have been calculated from the information in the analysis. Detailed tables and discussion in the NOPR list the calculated benefits and burdens, explaining why DOE believes its trial standard level selected achieves the greatest energy savings that are economically justified. The discussion weighing benefits and burdens suggests that DOE was aware of the net benefits of the alternative standards even though they are not explicitly calculated. It's much less likely DOE was aware of the net benefits of the policy alternatives. DOE clearly articulated its reasons for choosing among the alternative trial standard levels.
5/5
11. Does the proposed rule establish measures and goals that can be used to track the regulation's results in the future?
DOE did not establish goals or measures, but the benefits and costs calculated in the RIA could be used to do so. It would appear to be easy to track the progress of sales of more efficient appliances and then study if the new regulation lessened electricity demand. DOE estimates energy savings from electricity will be 4.5 quads over 30 years and benefit to the nation will be between $2.56 and $18.80 billion.
1/5
12. Did the agency indicate what data it will use to assess the regulation's performance in the future and establish provisions for doing so?
There is no commitment to measuring results of the regulation in the future. However, DOE clearly has access to the relevant data, and the regulatory analysis provides a template for using the data for measurement. Data on actual sales of products, energy use, etc. could be used to calculate ex post results, following the methods used in the RIA.
2/5
 
Total38 / 60

Additional details

Agency
Department of Energy
Regulatory Identification Number
1904-AB79
Agency Name
Department of Energy
Rule Publication Date
09/27/2010
Comment Closing Date
11/26/2010