Alternative dispute resolution Updated

Promoting accurate bargainer expectations regarding outcomes from binding dispute resolution is worth the effort

Appalachian State University, and ESI, USA, and IZA, Germany

one-pager full article

Elevator pitch

Alternative dispute resolution procedures such as arbitration and mediation are the most common methods for resolving wage, contract, and grievance disputes, but they lead to varying levels of success and acceptability of the outcome depending on their design. Some innovative procedures, not yet implemented in the real world, are predicted to improve on existing procedures in some ways. Controlled tests of several procedures show that the simple addition of a nonbinding stage prior to binding dispute resolution can produce the best results in terms of cost (monetary and “uncertainty” costs) and acceptability.

Resolving workplace disputes (wages,
                        contract, grievance)

Key findings

Pros

Binding dispute resolution guarantees a settlement.

A well-designed procedure can promote voluntary settlements.

A nonbinding stage to a dispute resolution procedure can help limit disputes caused by incomplete information.

Any procedure promoting voluntary settlement is likely to be beneficial in the long term.

Cons

Common dispute resolution procedures increase dispute rates relative to such alternatives as strikes and lockouts.

Poorly designed dispute resolution procedures may limit good faith bargaining.

Settlements from a third party may be extreme and less acceptable than voluntary settlements.

Dispute resolution procedures may be addictive, as reliance on them can increase over time.

Author's main message

Dispute resolution procedures can be useful for workplace wage negotiations, contract disputes, or other grievances. The most helpful type uses a nonbinding stage (such as mediation) before any binding procedure (such as arbitration) to reduce unrealistic expectations and encourage voluntary settlement. Controlled laboratory tests have shown that adding a nonbinding stage is effective and easier to implement than complicated theoretical procedures. Policymakers should consider high-quality laboratory evidence, just as scientists do, so that conclusions or policy decisions are not based on misinterpretations of confounding factors typically present in naturally occurring field data.

Motivation

Alternative dispute resolution (ADR) procedures are increasingly being used in many contexts, including contract disputes, civil and community disputes, and court-mandated ADR as part of tort reform in the US. Even high-profile salary disputes in US Major League Baseball are settled using final-offer arbitration. Mediation and arbitration also play a significant role in the workplace in such areas as labor–management disputes and grievance resolution. ADR uses neutral and unbiased individuals to help determine a reasonable settlement, but this poses risks to the bargainers. The uncertainty over arbitrator decisions should promote voluntary settlement [1]. But that same uncertainty opens the door for unrealistic bargainer expectations, which may reduce settlement rates.

Discussion of pros and cons

The hypothesized benefits of alternative dispute resolution

When a labor–management dispute ends in a strike or lockout of workers, the cost is high. If disputes can be resolved more efficiently (at lower cost), and the outcomes are acceptable to the disputants, this is a win–win solution.

Binding ADR involves arbitration procedures that guarantee a settlement of some sort, so the uncertainty over whether a settlement can be reached is avoided when using binding ADR. Procedural rules can, however, differ greatly from one binding procedure to another, so these rules are an important determinant of a procedure's effectiveness.

Arbitration procedures may fail to live up to expectations

Binding arbitration often allows broad discretion to impose whatever settlement the arbitrator deems reasonable. This type of arbitration is commonly referred to as conventional arbitration. Uncertainty about the likely outcome from arbitration is a type of “cost” that promotes voluntary settlement among risk-averse disputants, so changing the procedural rules of arbitration to increase outcome uncertainty should, in theory, improve voluntary settlement rates [1].

Final-offer arbitration can be seen as a way to increase voluntary settlements when arbitration looms. Under final-offer arbitration rules, at impasse, the disputants each submit final offers to the arbitrator, who is then constrained to choose one of the two final offers as the arbitrated outcome. The procedure has had a significant impact on US labor policy as several states have implemented final-offer arbitration to settle public sector labor disputes [2], and Major League Baseball remains the highest-profile use of the procedure to settle salary disputes. In Canada, the transportation industry has used final-offer arbitration to settle rate and service disputes, and the fishing industry allows its use for resolving disputes between fish harvesters and processors. Final-offer arbitration has been used elsewhere, and it has been suggested as a potentially useful procedure for World Trade Organization dispute settlement [3].

Unfortunately, policy preceded theory and empirical evidence on final-offer arbitration. Theorists have shown that predicted final offers diverge [4]. Evidence is mixed as to whether final-offer arbitration promotes more voluntary settlements than conventional arbitration. And because procedures labeled as conventional arbitration or final-offer arbitration in real-world data may not even follow the same exact rules [5], the comparisons are not clean. For this reason, laboratory experiments offer controlled “wind-tunnel” tests of arbitration procedures and provide useful apples-to-apples comparisons of the relative effectiveness of different ADR procedures.

The problem of bargainer overconfidence

One reason negotiations may fail is that disputants do not share a common and accurate belief about the likely outcomes from arbitration. Evidence shows that disputant beliefs are more important than their attitudes toward outcome risk when bargaining in the face of arbitration [6].

Arbitration procedures created to increase outcome uncertainty (and therefore reduce disputes) may create overconfidence, and this has been well documented in the context of bargaining [7]. Thus, while the uncertainty of arbitrated outcomes was originally thought to help promote voluntary settlements that same uncertainty may inadvertently reduce settlement rates due to an increase in bargainer optimism [8].

The narcotic effect of arbitration

Another concern with third-party ADR is that disputants might become dependent on the ADR procedure. This has been a particular concern with arbitration. Labeled the “narcotic” effect of arbitration, this concern is particularly important where disputants face the possibility of recurring disputes, as with wage or grievance negotiations.

A laboratory negotiations study that could inform whether arbitration is addictive shows that learning is slower with arbitration [9]. Specifically, bargainers learn from past disputes in the sense that a greater number of past disputes decreases the likelihood of a dispute in the current decision round. However, when arbitration is available, some of this effect (the reduced dispute likelihood from bargainers having disputed more in the past) is diminished, which the study refers to as a type of narcotic effect [9].

Other laboratory studies have found a related but slightly different sort of narcotic effect with conventional and final-offer arbitration, in the sense that past use of the arbitration procedure increases the current probability of using arbitration.

A benefit of using arbitration is that disputes get “settled” one way or the other, but bargainers are more likely to be satisfied with an outcome they have negotiated themselves, as opposed to an outcome determined by someone else [4]. In other words, a negotiated outcome, by definition, is mutually acceptable. Such may not be the case with an arbitrated outcome, particularly if the outcome is determined by final-offer rules that guarantee one bargainer's final offer will be rejected by the arbitrator. Acceptability of the settlement outcome may be particularly important for long-term workplace relationships as compared to short-term relationships in temporary or seasonal occupations.

The benefits of laboratory studies on dispute resolution

While it may be expected that more can be learned from “real world” data that occurs naturally in the field, such data are messy in the sense that many uncontrolled factors may differ from one dispute to another. For example, properly comparing the effectiveness of conventional arbitration with that of final-offer arbitration (or with mediation) is impossible if only the most difficult disputes, or the disputes with more at stake, are channelled to one procedure over another. The only way to fairly compare the effectiveness of different procedures is to create an otherwise identical bargaining environment that differs only in the ADR procedure invoked at impasse.

Statistical methods can help control for some factors that may influence bargaining outcomes in naturally occurring field data, but that is possible only when such influences are quantifiable in a consistent way. Even the coding of a procedure used in field data is an issue at times. For example, procedures differing in important aspects may all be labeled as “final-offer arbitration” for purposes of an empirical summary [5], but combining procedures that differ for convenience complicates how a researcher can determine the effectiveness of a certain type of ADR procedure.

In the end, the trade-off is that laboratory bargaining environments are more controlled but less real world than naturally occurring data. Even so, data from well-designed laboratory experiments contribute greatly to our knowledge in many arenas, and they can offer valuable and relatively inexpensive empirical evidence on a procedure's effectiveness prior to implementation [10].

Arbitration procedures compared

The interest in comparing the effectiveness of different arbitration procedures exists in both the field and the laboratory data literature. Canadian public-sector contract data have shown that disputes are more common with compulsory arbitration, but the relevant studies did not examine different forms of arbitration. Instead, the focus was on comparing compulsory arbitration with right-to-strike statutes.

Early experimental evidence indicated that final-offer arbitration promoted voluntary settlement. A common feature of the earliest arbitration experiments, however, was the use of mock negotiations. While a mock negotiation may seem desirable to create a more realistic environment, such experiments introduce confounding variables that are not easily quantifiable (such as nonverbal signals in bargaining).

The more recent literature based on controlled laboratory comparisons of arbitration procedures has consistently shown that final-offer arbitration has lower voluntary settlement rates than conventional arbitration. So, the laboratory evidence does not support the argument that final-offer arbitration, designed to increase the uncertainty costs to disputants, will promote fewer disputes. An additional drawback is that arbitrated outcomes are unsatisfactory to the losing party, which compromises the acceptability of final-offer arbitration outcomes.

Other rules of arbitration have been developed in an attempt to improve on both conventional arbitration and final-offer arbitration:

  • Tri-offer arbitration. Similar to final-offer arbitration, but allows the arbitrator the choice of selecting a factfinder recommendation (based on the evidence presented) in addition to either of the disputants’ final offers.

  • Combined offer arbitration. Mixes the rules of conventional and final-offer arbitration to remove the possibility of an intermediate settlement between the disputants’ final offers.

  • Double offer arbitration. Asks disputants to submit a primary and a secondary final offer, with the secondary final offer valued in the arbitrator decision rule for its proximity to what the arbitrator views as a fair settlement.

  • Amended final-offer arbitration. Similar to final-offer arbitration, but the losing disputant's final offer determines the settlement.

Some of these procedures produce a theoretical convergence of final offers, which would imply settlement without the need for arbitration. But the rules of these innovative procedures are not always straightforward, limiting their usefulness in the real world. Some innovative procedures have been tested in controlled laboratory experiments, but the evidence has not shown a significant improvement in dispute rates relative to the more commonly used conventional arbitration (some appear to improve settlement rates relative to final-offer arbitration).

Thus, innovative arbitration procedures with superior theoretical properties do not appear to provide clear benefits of significantly improved settlement outcomes, yet they often also impose the additional costs of being rather complicated to understand and implement.

Overconfidence and the narcotic effect

Regarding the discrepancy between theoretical predictions and empirical evidence of existing arbitration procedures, key factors are the bargainers’ expectations of what the arbitrator deems a fair settlement. Divergent expectations will affect both theoretical predictions and empirical outcomes.

The problem of overconfidence with arbitration has been examined to a limited extent using field and laboratory data. While both the field and laboratory evidence indicate that optimism will increase dispute rates, one study directly tests this proposition by eliciting actual beliefs about expected arbitrator decisions [8]. Deriving the theoretical predictions of final-offer arbitration under conditions of bargainer optimism, this type of overconfidence causes final offers to diverge. The study presents laboratory experiments showing both higher dispute rates and more divergent final offers in final-offer arbitrations [8]. Other research has shown similar effects of optimism on conventional arbitration outcomes. The conclusion from these laboratory experiments is that optimism is a more serious impediment than risk attitude in terms of harming the chances of voluntary settlement.

While dispute rates may be the most important and commonly examined outcome measure in evaluating arbitration procedures, there is also legitimate concern over whether arbitration is habit-forming. In other words, repeated use of arbitration may cause future dependency on the procedure, which implies the bargainers would not engage in good faith negotiations because they would rather hold out for arbitration.

Another concern of repeated use of arbitration is that it might harm the ability to learn from the pain of past disputes. While sparse, some limited empirical evidence documents this so-called “narcotic” effect of arbitration. Field data research has been dependent on the statistical methods used, so again the laboratory offers useful complementary evidence that is easier to interpret.

The earliest controlled laboratory study examining the narcotic effect finds that arbitration slows bargainer learning over time [9]. The more traditional interpretation of the narcotic effect of arbitration is that past use of a procedure increases the likelihood of use for the current dispute, all else being equal.

Controlled laboratory experiments have shown that both conventional and final-offer arbitration may be addictive in this sense. Furthermore, this addictive nature of arbitration may be amplified in the presence of other bargainer characteristics. For example, one laboratory study shows that a commonplace level of insufficient sleep (approximately six hours per night) increases this narcotic effect of arbitration relative to if the bargainer is well-rested [11]. This again highlights the importance of finding an ADR procedure that promotes voluntary settlement prior to the need to actually use the arbitration procedure. A nonbinding ADR stage prior to binding arbitration may help accomplish this goal.

The benefits of a nonbinding stage in alternative dispute resolution

As noted above, overconfidence or optimism is a critical variable in determining whether disputants will reach a voluntary settlement in binding arbitration. Thus, any nonbinding ADR procedure, such as mediation, that may provide information on the likely outcomes from arbitration could be a useful replacement or preliminary stage to binding ADR procedure. In general, nonbinding mediation (and fact-finding by the mediator) is meant to help in this way and may help to render the bargainers’ expectations unbiased.

To be fair, there is evidence that mediation is widely and successfully used in the real world. But it must be noted that mediation is often used for disputes that may not be considered as difficult to resolve as those sent to arbitration. So again, the laboratory provides a useful place where mediation and arbitration can be compared for otherwise identical disputes, with all other factors held constant.

Some laboratory research has examined nonbinding recommendations, as might be seen in fact-finding procedures. Fact-finding typically provides a recommendation to the interested parties in the dispute, which is meant to give bargainers a settlement option or focal point for negotiations. Interestingly, a nonbinding recommendation serves to lower the outcome uncertainty for disputants, which may inadvertently raise the likelihood of dispute. But what is perhaps more important is that the recommendation may help to make overconfident bargainers less biased and serve as a focal point to facilitate settlement. The empirical laboratory data have shown a dominant focal point effect, such that experimental treatments with a nonbinding recommendation have lower dispute rates relative to conventional arbitration with no recommendation.

A follow-up study to the initial laboratory research includes a treatment in which a nonbinding recommendation is completely ignored in the final stage of arbitration [12]. Even when the recommendation is known to have no impact on an eventual arbitrated settlement, it helps draw the final bargaining positions together and lower the dispute rates relative to an otherwise identical treatment of conventional arbitration. This is consistent with the hypothesis that the recommendation helps provide beneficial information on what an arbitrator may view as a fair settlement, which reduces optimism.

In experimental treatment conditions where the recommendation is not ignored but could influence a final arbitrated settlement, dispute rates remain lowest when recommendations are either mostly ignored or mostly adopted. Recommendations given an intermediate weight in the arbitrated settlement are perhaps viewed as a more indecisive message to bargainers, which could defeat the point of trying to remove uncertainty to facilitate settlement.

Limitations and gaps

For all the benefits that incentivized laboratory studies of ADR may offer, they have the disadvantage of not being as reflective of the “real world” as some would like. However, care has been taken in most laboratory experiment research to faithfully recreate the essential decision environment of interest; strip away any nonessential details that may confound results; and offer financial compensation in the experiment that varies with choices made. In the end, laboratory subjects are real people making real choices for real money. If an ADR procedure shows serious weaknesses in the lab, it can be assumed that it will not be a success in the real world.

The lab can help generate relatively low-cost data to test procedures prior to (premature) implementation. In this way, the laboratory research can be viewed as a useful first step in studying the effectiveness of arbitration and other dispute resolution mechanisms, but it should not be the only step to take.

Another gap in the literature, unfortunately, is the absence of field experiment research on ADR policy that would serve to build on laboratory insights. That is, the use of laboratory methods in the more realistic setting of the real world (or with a more natural subject pool) would help bridge the gap between naturally occurring but “messy” real world data, and clean but more artificial-feeling laboratory data. With the recent rise in field experiment research, this gap may be filled to some extent in the near future.

Summary and policy advice

Binding ADR procedures lower the cost of a bargaining impasse by guaranteeing a settlement, so it seems that all ADR mechanisms will likely increase dispute rates relative to high-cost alternatives, such as strikes or lockouts. The trade-off is that ADR implementation saves all stakeholders from the significant loss associated with these high-cost alternatives. So, the real issue is to find the ADR procedure that promotes the most voluntary settlement prior to the need to actually invoke the procedure.

Policymakers should seriously consider high-quality laboratory evidence to inform decisions much in the way a scientist studies a phenomenon first in the lab so that conclusions are not based on misinterpretations of confounding factors typically present in uncontrolled data generation.

While final-offer arbitration was suggested as a way to improve settlement rates over conventional arbitration by increasing the cost of dispute (the uncertainty costs), the empirical data from well-controlled and incentivized laboratory studies show the opposite. Dispute rates are typically higher in final-offer arbitration than in conventional arbitration. The reason seems to be that bargainers are typically overconfident about the likely outcome from arbitration, and final-offer arbitration leads to more overconfidence.

While the rules of arbitration have been creatively modified by several researchers in an attempt to improve on conventional or final-offer arbitration, the empirical evidence indicates that the simplest modification is to add a stage prior to arbitration that generates a nonbinding recommendation, which provides useful information on what an arbitrated settlement might look like. While this lowers uncertainty costs (possibly increasing dispute rates), it also reduces the opportunity for overconfidence. It would seem that removing unrealistic expectations in negotiations would improve the chance of settlement, whether or not there is the benefit of a dispute resolution mechanism.

A procedure that includes a recommendation is just a way to formalize this attempt at recalibrating expectations to reality. A recommendation stage in dispute resolution is not costless to implement, but there may be a significant payoff in increasing the rate of voluntary settlements and the acceptability of negotiated outcomes.

These laboratory findings may help explain the popularity of mediation as a nonbinding ADR procedure. However, the empirical research highlights the importance of an actual suggested or recommended outcome prior to binding dispute resolution. Thus, in terms of policy advice, mediation prior to arbitration seems a reasonable choice of ADR procedure, but workplaces should also be encouraged to empower mediators to offer an explicit suggested settlement that bargainers know will be shared with the binding arbitrator.

Acknowledgments

The author thanks an anonymous referee and the IZA World of Labor editors for many helpful suggestions on earlier drafts. The author also thanks Lynn Hunnicutt, David McEvoy, and David Bruner for collaboration on some of this research, and numerous seminar and conference attendees for helpful comments at different stages. Financial/other support for the author's research cited in this article is gratefully acknowledged and includes: Utah State University, National Science Foundation awards SES-0133231, SES-0316414, and SES-1734137. Version 2 of the article refers to recent evidence on how sleep, or lack thereof, effects bargaining in the presence of arbitration, and also includes information on the use of final-offer arbitration in different industries in Canada, and within the World Trade Organization.

Competing interests

The IZA World of Labor project is committed to the IZA Code of Conduct. The author declares to have observed the principles outlined in the code.

© David L. Dickinson

evidence map

Alternative dispute resolution

Full citation

Full citation

Data source(s)

Data type(s)

Method(s)

Countries