Investment Advice - Participants and Beneficiaries

Proposed Rule

Score: 40 / 60

RULE SUMMARY

This document contains proposed regulations implementing the provisions of the statutory exemption set forth in sections 408(b)(14) and 408(g) of the Employee Retirement Income Security Act, as amended (ERISA or the Act), and parallel provisions in the Internal Revenue Code of 1986, as amended (Code), relating to the provision of investment advice described in the Act by a fiduciary adviser to participants and beneficiaries in participant-directed individual account plans, such as 401(k) plans, and beneficiaries of individual retirement accounts (and certain similar plans). Section 408(b)(14) provides an exemption from certain prohibited transaction provisions in ERISA with respect to the provision of investment advice, the investment transaction entered into pursuant to the advice, and the direct or indirect receipt of fees or other compensation by the fiduciary adviser or an affiliate in connection with the provision of advice or the transaction pursuant to the advice. Section 408(g) describes the conditions under which the investment advice related transactions are exempt.


METHODOLOGY

There are twelve criteria within our evaluation within three broad categories: Openness, Analysis and Use. For each criterion, the evaluators assign a score ranging from 0 (no useful content) to 5 (comprehensive analysis with potential best practices). Thus, each analysis has the opportunity to earn between 0 and 60 points.

CriterionScore

Openness

1. How easily were the RIA , the proposed rule, and any supplementary materials found online?
The RIA is in the proposed rule. A link to the proposed rule is four intuitive clicks from the home page via the "laws and regulations" heading on EBSA's page. A search using the regulation's name and "proposed regulation" immediately produces links to the proposed regulation. The proposed rule is also available on regulations.gov.
5/5
2. How verifiable are the data used in the analysis?
Sources extensively documented, though not always linked.
3/5
3. How verifiable are the models and assumptions used in the analysis?
The analysis includes extensive documentation with references to academic, industry, and government research. It takes pretty careful reading to discern whether the assumptions are just "assumptions" or actually grounded in evidence. For some assumptions, the RIA requests comment since it is a proposed rule.
4/5
4. Was the analysis comprehensible to an informed layperson?
Results are clear. There's some jargon, usually related to the law or regulation itself. The analysis is a moderately difficult read.
3/5

Analysis

5. How well does the analysis identify the desired outcomes and demonstrate that the regulation will achieve them?
4/5
Does the analysis clearly identify ultimate outcomes that affect citizens’ quality of life?
Increased investment returns due to better investment advice.
5/5
Does the analysis identify how these outcomes are to be measured?
Reduction in costs attributable to bad investment decisions. The RIA monetizes the prospective improvement investment returns: "The Department anticipates that this proposed regulation and proposed class exemption, by extending quality, expert investment advice to more retirement plan participants, together will improve their investment results by approximately $14 billion or more annually, at a cost of $4 billion, thereby producing a net financial benefit of $10 billion or more. The improved investment results will reflect reductions in investment errors such as payment of higher than necessary fees and expenses, poor trading strategies, and inadequate diversification. The provisions of this proposed regulation and the conditions attached to this proposed class exemption reflect the Department’s efforts to ensure that the advice provided pursuant to them will be affordable and of high quality."
5/5
Does the analysis provide a coherent and testable theory showing how the regulation will produce the desired outcomes?
It presents a plausible argument that more information will reduce errors.
4/5
Does the analysis present credible empirical support for the theory?
Research and/or survey results are presented supporting the claims that more advice leads to better investment outcomes, advice is used, and some advice is not given due to current laws and regulations.
3/5
Does the analysis adequately assess uncertainty about the outcomes?
The analysis considers uncertainty in rate of error reduction and the percent of investors the advice reaches.
5/5
6. How well does the analysis identify and demonstrate the existence of a market failure or other systemic problem the regulation is supposed to solve?
4/5
Does the analysis identify a market failure or other systemic problem?
Systemic problem may be biased investment decisions. The analysis argues that regulatory barriers to information dissemination exacerbate this."Such informational and behavioral problems translate into at least five distinct types of investment mistakes, which together generate financial losses (including foregone earnings) of $109 billion or more annually 15 for DC plan and IRA participants, the Department estimates." The identification of and explanation of several problems is a good practice.
4/5
Does the analysis outline a coherent and testable theory that explains why the problem (associated with the outcome above) is systemic rather than anecdotal?
See above.
4/5
Does the analysis present credible empirical support for the theory?
Research suggests that advice reduces error. The survey suggests that some advice is not given due to regulation.
4/5
Does the analysis adequately assess uncertainty about the existence or size of the problem?
The regulation assumes that the existence of the problem is not uncertain and that it won't clear itself up, but it doesn't explicitly say that. Therefore, there is no relevant or explicit content on the likelihood that the problem will occur. Ranges of estimates often presented. This is reinforced by uncertainty analysis applied to benefits. There is some acknowledgement of uncertainty about the size of the problem.
2/5
7. How well does the analysis assess the effectiveness of alternative approaches?
4/5
Does the analysis enumerate other alternatives to address the problem?
A full RIA is done on 3 options, but not on small tweaks.
5/5
Is the range of alternatives considered narrow (e.g., some exemptions to a regulation) or broad (e.g., performance-based regulation vs. command and control, market mechanisms, nonbinding guidance, information disclosure, addressing any government failures that caused the original problem)?
The analysis considers no action, issuance of the statutory exemption, issuance of an additional class exemption, and a few additional tweaks. The option selected does leave a great deal of flexibility in compliance: "This proposed regulation consequently provides for transparency and procedural rigor but generally does not attempt to specify precise and fixed substantive standards. For example, pursuant to the proposed regulation the experts’ qualifications will be reviewed by a fiduciary, and each certification will be documented in detail. The proposed regulation also provides that models may be certified once for similar applications across multiple DC plans or IRAs, rather than separately for each individual application, thereby promoting affordability of arrangements using models." Therefore, the range of options would appear to be broad versus narrow, recognizing the variety of models that could be certified in the future.
4/5
Does the analysis evaluate how alternative approaches would affect the amount of the outcome achieved?
The RIA assesses benefits of statutory exemption with and without the additional class exemption. It also shows incremental vs. cumulative effects.
4/5
Does the analysis adequately address the baseline? That is, what the state of the world is likely to be in the absence of federal intervention not just now but in the future?
It assumes that the baseline is current practice, with no consideration of how the market might evolve under the no action scenario. The analysis is careful not to count some errors that will be eliminated by other changes in the law as a benefit of this regulation.
1/5
8. How well does the analysis assess costs and benefits?
3/5
Does the analysis identify and quantify incremental costs of all alternatives considered?
The analysis considers costs of the major proposed alternative.
3/5
Does the analysis identify all expenditures likely to arise as a result of the regulation?
The analysis identifies expenditures, though the justification for the number is vague.
3/5
Does the analysis identify how the regulation would likely affect the prices of goods and services?
The analysis Identifies cost of information, but not costs associated with investment advice that exploits conflicts of interest. It identifies very clearly how the prices of the services offered would be affected in table form, but mostly in annual billions and not on an individual basis.
3/5
Does the analysis examine costs that stem from changes in human behavior as consumers and producers respond to the regulation?
Behavioral changes due to improved information are well analyzed, but investment advisor exploitation of conflicts of interest could be a significant consumer cost. The RIA acknowledges this but simply says it is part of the cost of bad advice, or good advice not acted upon, with no justification for the size of the assumed effect. The RIA has also asked for comments about behavioral effects: "The opening of large new markets to a variety of investment advice arrangements to which they were heretofore closed may affect the evolution of investment advice products and services and related technologies and their distribution channels and respective market shares. Other possible indirect effects that the Department lacks bases to estimate include financial market impacts of changes in investor behavior and related macroeconomic effects. The Department invites comments on how to improve this analysis, with particular attention to the assessment and explanation of attendant uncertainty, and how such analysis could be carried out. Comments that include specific suggestions or data to help support our analysis of impacts and the characterization of uncertainty would be especially useful." The content is therefore somewhat relevant as the RIA is seeking to improve its measurement of changes resulting from the regulation.
3/5
If costs are uncertain, does the analysis present a range of estimates and/or perform a sensitivity analysis?
The analysis does not address this topic.
0/5
Does the analysis identify the alternative that maximizes net benefits?
The RIA clearly identifies which major approach offers the greatest net benefits. Decisions on tweaks seem to be sensitive to cost and benefit considerations.
5/5
Does the analysis identify the cost-effectiveness of each alternative considered?
Table 5 shows the value of investment error reduced per dollar of advice. But this is provided only for the alternatives chosen, not for all the alternative tweaks.
3/5
Does the analysis identify all parties who would bear costs and assess the incidence of costs?
It appears that the participants in the investment are both the bearers of the cost and the recipients of the benefits, with benefits still exceeding the cost. But it isn't explicitly mentioned that they're the only bearers. Somewhat relevant content, but not followed through. The analysis recognizes that costs will be different for IRAs and defined benefit pension plans, and uses different cost figures for each. Figures chosen are not well documented.
2/5
Does the analysis identify all parties who would receive benefits and assess the incidence of benefits?
The analysis does not emphasize this. However, table 7 shows effects on participants in small defined-contribution plans.
2/5

Use

9. Does the proposed rule or the RIA present evidence that the agency used the analysis?
The statutory exemption was a forgone conclusion. It appears to maximize net benefits, but since it was mandated by law, it is not clear that this analysis prompted the department to make this decision. (Class exemption in another rule, discussed in this RIA, was not.)
3/5
10. Did the agency maximize net benefits or explain why it chose another alternative?
The statutory exemption was determined by law. The additional class exemption appears to be DOL's own initiative, justified by a desire to produce greater net benefits to investors.
4/5
11. Does the proposed rule establish measures and goals that can be used to track the regulation's results in the future?
The agency does not make a commitment to do this, but the RIA provides a good framework for developing measures and goals.
1/5
12. Did the agency indicate what data it will use to assess the regulation's performance in the future and establish provisions for doing so?
The agency does not make a commitment to do this, but data like those used in the RIA could be tracked in the future to assess the regulation.
2/5
 
Total40 / 60

Additional details

Agency
Department of Labor
Regulatory Identification Number
1210-AB13
Agency Name
Department of Labor
Rule Publication Date
08/22/2008