Supplementary Appendix for Moral Hazard, Incentive Contracts and Risk: Evidence from Procurement Gregory Lewis Harvard University and NBER Patrick Bajari University of Washington and NBER December 18, 2013 1 Overview In this supplementary appendix, we provide additional information on the following: Data Sources Missing Data and Sample Selection Estimation of Traffic Delay Costs Variable Definition Additional evidence of moral hazard Connections across multiple projects Evidence on enforcement Robustness of the policy conclusions to alternative estimates of traffic delays Derivation of the likelihood function All tables are at the end of the document. 1
2 Data Sources We compiled data from three sources: 1. FieldOps Data: Mn/DOT used a program called FieldOps to manage project data. The project engineer records project information and daily updates in this program, for the duration of work on the project. Each project has a number of database files. The project information database contains information on the location and description of the project, the identity of the contractor and project engineer; the size and duration of the project; and the number and type of days allocated. The diary database contains daily updates on how many hours the contractor worked each day, how many hours of work were initially planned, how many hours of avoidable or unavoidable delays were recorded, what the weather conditions were like, and what the current project controlling operation was. We obtained the database files directly from Mn/DOT and wrote code in unix to convert the raw data files into a file format readable by Stata. 2. Enforcement Data: We obtained a spreadsheet with all the liquidated damages (time penalties) paid on each contract in the data directly from Mn/DOT. We used this data to construct the enforcement variable (see below). 3. Weather Data: We obtained data on rainfall and snowfall during the period 1990-2010 at a number of weather monitoring stations in Minnesota from the National Climatic Data Center (http://www.ncdc.noaa.gov/). We geocoded each contract location, and merged each contract to its three closest stations. For each contract-day, we constructed the rainfall and snowfall at the closest weather station, using data from the second or third closest stations where necessary due to missing data problems. 3 Missing Data and Sample Selection The estimation sample is a selected subset of the contracts let by Mn/Dot during the sample period (1996 2005). There are database files for 2009 projects (some of which are let outside of the sample period), but 716 of these are corrupt and/or blank. Of the remaining files, only 943 are working day contracts. For a small fraction of the working day contracts (52/943), the project information database is available but the diary data is missing. This gives us a sample of 891 working day contracts. 2
We next drop very short (less than 10 working days), long (over 200 working days), big contracts (over $10M) and those let outside of the sample period, a total of 99 contracts. We then classify projects according to their primary activity (see variable description for more details), and drop projects that are not likely to require lane closure or shoulder work, and therefore may cause little negative externality. We keep contracts whose primary activity is bridge repair, construction or resurfacing. This leaves us with 537 contracts. Further cleaning (checks on the consistency of the diary data, projects where data is missing) leaves us with a sample of 466 contracts, used in the main paper. 4 Estimation of Traffic Delay Costs We next construct measures of traffic delay costs for the roads under construction for a sub-sample of 87 of these contracts. As you ll see, determining these costs is slow work, and so we economized on the sample size. We develop an estimate of the delay cost as follows: Traffic Delay Cost t = Delay t Time Value t Traffic t The daily user cost is estimated as the per user delay (in hours), times the time value for the average commuter (in $/hour), times the average daily traffic on that road. In this we follow closely the actual Mn/DOT methodology for computing user costs. Their methodology accounts also for additional wear and tear in the case where commuters are re-routed, and for the possibility of cars with multiple occupancy. By neglecting these factors, we hope to get conservative user cost estimates. The first element that we need to calculate is the average delay due to the construction project. In practice, this depends on whether the project engineer decides to close down lanes but still leave the road open, or to close the road and detour commuters. Whenever the road is left open, commuters must slow down, and Mn/DOT generally assumes that their commuting speed over that section is cut in half. On the other hand, if rerouted, the detour is generally longer than the original route, and that also causes delays. The decision of whether to reroute or close lanes is spelled out in the project plans, and so Mn/DOT uses this information when calculating user costs. Since we do not have access to the information, we take a conservative stance, computing the minimum of these two alternatives. To do this, for each contract where the location data allows us to pinpoint it on a map, 3
Figure 1: Delay Calculations: The left panel shows the locations of the highway construction projects used in the counterfactual. The right panel shows an example of a detour calculation around a section of route 6. we use Google maps to outline the construction zone, and its length (see the left panel of Figure 1). We then use Google to calculate a travel time for that route. If the route is left open, we assume that the travel time will double, which means the delay will be equal to the original travel time. We also do our best to construct a likely detour around that section of the road, as in the right panel of Figure 1. We then use Google to estimate the time required to drive the detour, getting a delay estimate as the difference between the travel times. In practice, Mn/DOT does a less-virtual version of this exercise, actually sending personnel to drive the detour and original route at different times of day and record the data. Overall then, delays are calculated as: Delay t = Min{T ravel time t, Detour T ime t T ravel time; 1 3 } The last term implies that we never allow for a delay of more than 20 minutes this is to avoid the concern that a few outliers drive our counterfactual results. To get an estimate of the daily traffic, we use traffic volume measures from Mn/DOT at each location in the dataset. 1 For a measure of the time value, we use the rate of $12/hour, which is the rate used in the Mn/DOT calculations. 1 See http://www.dot.state.mn.us/traffic/data/html/volumes.html 4
5 Variables Used We summarize in Table 1 the data sources and construction of the variables that are fundamental (i.e. excluding variables that are constructed from the fundamental variables, such as work rate, backlog etc). 6 Additional Evidence on Moral Hazard We present in this section a brief discussion of some additional evidence on moral hazard, applying the seemingly unrelated regressions (SUR) framework discussed in the main paper. Table 2 reports three pairs of regressions, each specification adding additional fixed effects as controls. In all cases, the dependent variable in the first member of the pair is the normalized hours, and the second is the work rate. Since the set of controls in each pair is the same, running the two as a system gives the same results as equation-by-equation OLS. The main statistic of interest is the p-value on the test for the independence of the residuals across the pair of equations. In all cases the p-value is zero, so we can reject the hypothesis that the residuals are independent; moreover, the correlations are all positive. This yields the same conclusion as we reached in the main paper: contracts that require more work than expected ex-ante have higher work rates than one would have expected ex-ante, which is evidence of ex-post moral hazard and/or unobserved heterogeneity. Table 3 reports the same sets of regressions, but changing the second dependent variable in each pair to the ratio of days worked to days charged. This is essentially a test for adaptation on the extensive margin: when a contract requires extra work, do contractors work more days? Again we find a significant and positive correlation between the residuals in all cases. 7 Connections across multiple projects An interesting question not explored in the main paper is whether there is evidence that shocks on one contract controlled by a contractor lead to adaptation on other projects (i.e. can firms with multiple projects risk share across contracts)? We find little evidence of this. Our testing approach is to construct a measure of the shock on each project as in the main paper (i.e. as a residual from a first stage regression), and then, for each contract, 5
Density 0.05.1.15.2 20 10 0 10 20 Days Late Density 0.05.1.15.2.25 20 10 0 10 20 Days Late Figure 2: Distribution of days late by contractors working on a single project (left) and multiple projects (right) construct the residual on overlapping projects as the weighted average residual from projects the rm is contemporaneously working on (where the weights are the number of overlapping days). As shown in Table 4, we find no evidence of statistically significant linkages on either the intensive or extensive margins: when other contracts experience negative shocks (positive overlapping residuals), there is a modest positive effect on the work rate and ratio of days worked to charged. Similarly, one might have thought that the atom in days taken was purely an artifact of contractors with multiple projects shifting work between them, rather than a change in work rate (although the evidence in the main paper suggests this cannot be the case). In Figure 2 we show that there is an atom of on-time completions both for contractors working on a single project and those working on multiple projects, which is further evidence against this hypothesis. 8 Evidence on Enforcement In the main paper, we argued that there was little evidence that the project engineer colluded with the contractors, awarding them unavoidable delays so that they could finish on time. We provide some evidence of this in columns 1 and 2 of Table 5. When we regress the normalized unavoidable delay days on covariates, we find that there are very few statistically significant observable predictors and if anything, project engineers seem less likely 6
to grant delays when the planned pace of the project is fast, or contractors are working on multiple projects at once (though this is interpreting a partial correlation as causal). Once we add in firm and project engineer fixed effects, we find that the firm fixed effects are not jointly significant, although the project engineer fixed effects are. So it appears there is some heterogeneity in how the rules are enforced across project engineers, but no evidence that some contractors are good at convincing project engineers to give them unearned delays. We also claimed that the enforcement probability appears to be unrelated to any of the contract characteristics, and therefore can be modeled as a (latent) constant parameter p (whose realization, the enforcement decision, is known to the contractor). Evidence in favor of this is presented in columns 3 and 4 of the same table. The only characteristic that is significantly correlated with the enforcement outcome is the overlap with other projects (in the column 4 specification), and given the number of regressors, it is not that surprising that one of them turns up as significant. It therefore appears that enforcement is reasonably modeled as being random, at least ex-ante. 9 Robustness of the policy conclusions to alternative estimates of traffic delays As described above, we estimate traffic delay costs by calculating the delay from taking an alternative route and/or traveling more slowly on the original route, and multiplying by the volume of traffic and an estimate of the value of commuter s time. All of these elements could be mismeasured, and so for robustness we re-simulate the counterfactuals twice: once under the assumption that traffic delay costs are halved, and a second time under the assumption that they are doubled. The results are displayed in Tables 6 and 7. 10 Derivation of the likelihood function Recall that the marginal benefit of delay function takes the form (dropping t subscripts): c (d) = αd + d T ( xγ + δθ + ε) 7
where ε is latent and distributed N(0, σ 2 ); and θ is estimated in a first stage. Recall also the additional penalties from waiting another day and the penalties saved by completing a day earlier: + (d) = 1(enforced)1(d + 1 > d T )(d + 1 max{d, d T })c D (d) = 1(enforced)1(d > d T )(d max{d 1, d T })c D We use the following necessary conditions: c(d) < c(d + 1) + + (d) and c(d) < c(d 1) (d) Now we have that d c(d) c(d 1) = c(d + 1) c(d) = d 1 d+1 This implies the following bounds on ε: d αs + d T ( xγ + δθ + ε) ds = αd + α 2 dt ( xγ + δθ + ε) αs + d T ( xγ + δθ + ε) ds = αd α 2 dt ( xγ + δθ + ε) 1 ( (d) + α ) d T 2 αd xγ δθ < ε < 1 ( + (d) α ) d T 2 αd xγ δθ And then dividing through by σ, we get the likelihood contribution of each datapoint: ( 1 l = Φ ( + (d) α ) d T σ 2 αd 1 ) ( 1 σ (xγ δθ) Φ ( (d) + α ) d T σ 2 αd 1 ) σ (xγ δθ) where Φ denotes the standard normal cdf. We now comment briefly on the implementation of the EM algorithm. Given the parameter estimates, we must derive a posterior distribution over the enforcement realizations. This will be different for contracts that finished late, early and on-time. If late defined here as d > d T whether they were enforced is observable, and so the posterior is an indicator for the contract being enforced. If early defined here as d d T 1 there is no new information from observing the completion time, and the posterior probability of enforcement is equal to the prior probability p (a parameter estimated during the maximization step). If d (d T 1, d T ], then define l 1 as the likelihood contribution when the terms are evaluated under enforcement and l 2 as that when they are zero. Then the posterior on the contract 8
being enforced is given by pl 1 /(pl 1 + (1 p)l 2 ). In the maximization step, we maximize the expected log likelihood given the current posterior. Because we assume p independent of all other parameters, the likelihood maximizing guess is the mean posterior. All other parameters are maximized jointly using the above likelihood function. 9
Table 1: Sources and Definitions of Variables used in the Analysis Variable Unit Sample Source Definition Contract Value $ All Project Information Winning bid on this project. Amount due to contractor on successful completion. Engineer Days Days All Diary Data Design engineer s estimate of the project length, in working days (i.e. excluding weekends and holidays). Specifies the number of days the prime contractor is allowed to take to complete the project. Days charged Days All Diary Data Working days charged by the project engineer during the course of the project. Days worked Days All Diary Data Number of days on which the hours worked was positive. Engineer s hours Hours All Diary Data Sum of all the working hours estimate in the plan submitted by the prime contractor to the project engineer. Imputed where missing. Hours worked Hours All Diary Data Sum of all the hours worked recorded by the project engineer throughout the course of the contract. Avoidable delays Hours All Diary Data Sum of all the hours of avoidable delay recorded by the project engineer throughout the course of the contract. Unavoidable delayavoidable Hours All Diary Data Sum of all the hours of un- delay recorded by the project engineer throughout the course of the contract. 10
Unavoidable delay days Days All Diary Data Sum of all the working days on which the contractor was not charged a day and the hours of unavoidable delays was positive. Contract late? Binary All Diary Data Binary variable indicating if the number of working days taken exceeded the project target, as measured by the project engineer. Enforced Binary Late contracts only Mn/DOT Spreadsheet Binary variable indicating if the liquidated damages paid was positive Types of Work Categorical All Project Informatioing Types of work required dur- the project, based on the project description in the bid summary. Constructed via keyword matching in the project description. Daily traffic Vehicles Delay Subsample Traffic Volumes Average annual daily traffic (AADT) near the contract lo- cation. Daily rainfall Inches All Weather Data Rainfall at the closest weather station to the contract (by distance). Daily snowfall Inches All Weather Data Snowfall at the closest weather station to the contract (by distance). 11
Table 2: Ex-post moral hazard: correlation tests (1) (2) (3) Time penalty -0.017 0.002-0.005 0.002-0.022-0.000 (0.014) (0.006) (0.014) (0.007) (0.014) (0.007) Engineer work rate -0.173 0.255*** -0.190* 0.226*** -0.301** 0.209*** (0.107) (0.047) (0.114) (0.054) (0.117) (0.058) Contract value ($ K/day) 0.086*** 0.010** 0.089*** 0.010** 0.097*** 0.007 (0.009) (0.004) (0.010) (0.005) (0.009) (0.005) Historical daily rainfall 0.002 0.005 0.011 0.003 0.057** -0.009 (0.023) (0.010) (0.024) (0.011) (0.025) (0.012) Historical chance of snow 0.036-0.008 0.031-0.001-0.002 0.007 (0.042) (0.018) (0.040) (0.019) (0.036) (0.018) Firm capacity > $3M 0.017 0.250 (0.379) (0.167) In-state contractor -0.526 0.291 (0.589) (0.260) Firm backlog / firm capacity 0.126-0.033-0.292 0.133-0.622 0.408 (0.561) (0.248) (0.662) (0.314) (0.629) (0.312) Overlap with other projects -0.297 0.307* 0.290 0.375* 0.278 0.075 (0.415) (0.183) (0.475) (0.226) (0.467) (0.232) District/Work/Year FE yes yes yes yes yes yes Firm FE no no yes yes yes yes Project Engineer FE no no no no yes yes Test: independent residuals 0.00 0.00 0.00 R 2 0.40 0.29 0.53 0.34 0.68 0.54 N 466 400 358 Each pair of columns gives results from seemingly unrelated regressions, where the dependent variable in the first of the pair is the total hours taken, normalized by the engineer s days; and the second is the work rate (total hours worked divided by total days worked). In (2) the estimation sample consists only of contracts where each contractor participated in at least 3 contracts in the sample; additionally in column (3) each project engineer has managed at least two contracts. Significance levels are denoted by asterisks (* p < 0.1, ** p < 0.05, *** p < 0.01). Capacity is measured as the firm s maximum backlog over the sample period. Overlap is the fraction of planned days that overlap with planned construction on other projects the firm is contracted for. Test: independent residuals reports p-values from a Breusch-Pagan test of the independence of the residuals in the pairs of equations. 12
Table 3: Ex-post moral hazard: extensive margin (1) (2) (3) Time penalty -0.017 0.002* -0.005 0.002* -0.022 0.001 (0.014) (0.001) (0.014) (0.001) (0.014) (0.001) Engineer work rate -0.173-0.024*** -0.190* -0.020** -0.301** -0.016 (0.107) (0.009) (0.114) (0.010) (0.117) (0.010) Contract value ($ K/day) 0.086*** 0.004*** 0.089*** 0.004*** 0.097*** 0.004*** (0.009) (0.001) (0.010) (0.001) (0.009) (0.001) Historical daily rainfall 0.002 0.001 0.011 0.003 0.057** 0.004* (0.023) (0.002) (0.024) (0.002) (0.025) (0.002) Historical chance of snow 0.036-0.002 0.031-0.002-0.002-0.003 (0.042) (0.003) (0.040) (0.003) (0.036) (0.003) Firm capacity > $3M 0.017-0.033 (0.379) (0.032) In-state contractor -0.526-0.049 (0.589) (0.049) Firm backlog / firm capacity 0.126 0.097** -0.292 0.051-0.622 0.039 (0.561) (0.047) (0.662) (0.055) (0.629) (0.054) Overlap with other projects -0.297-0.063* 0.290-0.037 0.278-0.044 (0.415) (0.035) (0.475) (0.040) (0.467) (0.040) District/Work/Year FE yes yes yes yes yes yes Firm FE no no yes yes yes yes Project Engineer FE no no no no yes yes Test: independent residuals 0.00 0.00 0.00 R 2 0.40 0.23 0.53 0.36 0.68 0.55 N 466 400 358 Each pair of columns gives results from seemingly unrelated regressions, where the dependent variable in the first of the pair is the total hours taken, normalized by the engineer s days; and the second is the ratio of days worked to days charged. In (2) the estimation sample consists only of contracts where each contractor participated in at least 3 contracts in the sample; additionally in column (3) each project engineer has managed at least two contracts. Significance levels are denoted by asterisks (* p < 0.1, ** p < 0.05, *** p < 0.01). Capacity is measured as the firm s maximum backlog over the sample period. Overlap is the fraction of planned days that overlap with planned construction on other projects the firm is contracted for. Test: independent residuals reports p-values from a Breusch- Pagan test of the independence of the residuals in the pairs of equations. 13
Table 4: Ex-post moral hazard: multiple projects Work rate Days worked / days charged Residual 0.095*** 0.255*** 0.293*** 0.032*** 0.029*** 0.028*** (0.027) (0.048) (0.072) (0.005) (0.006) (0.008) Residual on overlapping projects 0.009 0.014 0.032 0.001-0.002 0.004 (0.034) (0.070) (0.128) (0.006) (0.008) (0.014) Time penalty -0.005 0.013-0.011 0.002 0.002-0.001 (0.008) (0.013) (0.017) (0.001) (0.002) (0.002) Engineer work rate 0.267*** 0.201** 0.245* -0.020* -0.016-0.007 (0.060) (0.102) (0.145) (0.011) (0.012) (0.016) Contract value ($ K/day) 0.015*** 0.030*** 0.030** 0.003*** 0.003*** 0.004*** (0.005) (0.009) (0.012) (0.001) (0.001) (0.001) Historical daily rainfall -0.001 0.017 0.014 0.003 0.004 0.003 (0.013) (0.023) (0.036) (0.002) (0.003) (0.004) Historical chance of snow -0.030-0.054-0.121* -0.001-0.001-0.007 (0.021) (0.037) (0.064) (0.004) (0.004) (0.007) Firm capacity > $3M 0.297 0.012 (0.249) (0.045) In-state contractor 0.317-0.050 (0.443) (0.080) Firm backlog / firm capacity -0.173 0.801 1.232 0.094 0.079 0.065 (0.322) (0.561) (0.758) (0.058) (0.066) (0.085) Overlap with other projects 0.600** 0.219-0.150-0.117*** -0.070-0.070 (0.240) (0.436) (0.596) (0.044) (0.051) (0.067) District/Work/Year FE yes yes yes Firm FE no yes yes Project Engineer FE no no yes R 2 0.38 0.50 0.65 0.43 0.49 0.68 N 274 274 248 274 274 248 The dependent variable in the first three columns is work rate; in the next three it is the ratio of days worked to days charged. The estimation sample includes only overlapping contracts. All results are from OLS regressions, and standard errors are robust. Significance levels are denoted by asterisks (* p < 0.1, ** p < 0.05, *** p < 0.01). Capacity is measured as the firm s maximum backlog over the sample period. Overlap is the fraction of planned days that overlap with planned construction on other projects the firm is contracted for. Residual refers to the residual from a regression of hours worked divided by engineer s days on the same set of covariates (i.e. those corresponding to that column); the residual on overlapping projects is the weighted average residual from projects the firm is contemporaneously working on, weighted by the overlapping days. 14
Table 5: Contract monitoring and enforcement Unavoidable delay fraction Penalty applied Time penalty 0.000-0.000 0.006-0.003 (0.001) (0.001) (0.004) (0.005) Engineer work rate -0.038*** -0.045*** -0.007-0.017 (0.008) (0.013) (0.027) (0.030) Contract value ($K/day) 0.001 0.001-0.003-0.002 (0.001) (0.001) (0.003) (0.003) Historical daily rainfall 0.002 0.007** 0.002 0.001 (0.002) (0.003) (0.005) (0.005) Historical chance of snow 0.002-0.002-0.004 0.000 (0.001) (0.003) (0.004) (0.007) Firm capacity > $3M 0.014-0.020 0.042 (0.034) (0.102) (0.114) In-state contractor 0.044 0.021 0.164 (0.033) (0.164) (0.199) Firm backlog / firm capacity 0.043 0.016 0.065 0.066 (0.037) (0.063) (0.141) (0.153) Overlap with other projects -0.081** -0.058 0.101 0.219** (0.034) (0.054) (0.099) (0.101) District/Work/Year FE yes yes no yes Firm/Engineer FE no yes no no Wald Test: Firm FE (p-value) - 0.22 - - Wald Test: Engineer FE (p-value) - 0.00 - - R 2 0.15 0.47 0.03 0.33 N 466 358 153 153 In the first two columns, the dependent variable is the number of days on which the project engineer awarded an unavoidable delay divided by the engineer s days. In the last two columns, an observation is a late contract, and the dependent varible is whether the late penalty was enforced. All regressions are by OLS with robust standard errors. Significance levels are denoted by asterisks (* p < 0.1, ** p < 0.05, *** p < 0.01). Capacity is measured as the firm s maximum backlog over the sample period. Overlap is the fraction of planned days that overlap with planned construction on other projects the firm is contracted for. 15
Table 6: Robustness Check: Traffic delay costs are halved Current Fully 10% Tighter New Penalties Lane Rental Policy Enforced Deadline (10% Delay Cost) (10% Delay Cost) Subsample with delay data Days taken 40.13 37.82 37.00 39.66 36.78 (38.44,41.05) (36.29,38.65) (35.22,37.99) (37.95,40.54) (34.34,38.02) Commuter gain ($K) 17.63 39.07 46.29 43.94 110.77 (10.98,23.53) (26.63,51.14) (33.45,60.01) (30.03,53.17) (80.54,146.38) Acc. cost ($K) 1.31 2.92 3.51 1.77 5.35 (0.82,1.72) (2.03,3.65) (2.53,4.46) (1.24,2.06) (3.99,6.82) Penalties paid ($K) 3.00 6.67 9.09 3.39 25.38 (1.98,3.52) (4.30,7.75) (6.27,10.25) (2.26,3.90) (21.60,27.70) Net gain ($K) 16.31 36.15 42.78 42.17 105.42 (10.17,21.81) (24.65,47.51) (30.87,55.74) (28.85,51.15) (76.55,139.58) Std. deviation costs ($K) 3.53 7.84 8.88 4.33 7.75 (2.64,4.12) (6.30,8.95) (7.34,10.01) (3.39,4.93) (6.72,8.83) Reweighted to match full sample Days taken 37.76 35.80 35.05 37.33 34.61 (36.35,38.73) (34.62,36.62) (33.57,35.97) (35.93,38.22) (32.65,35.74) Commuter gain ($K) 13.87 30.66 36.63 34.56 90.45 (8.71,18.55) (21.06,40.45) (26.66,47.72) (23.85,42.71) (65.94,119.36) Acc. cost ($K) 1.02 2.27 2.75 1.39 4.36 (0.65,1.35) (1.59,2.89) (2.02,3.52) (0.98,1.63) (3.26,5.54) Penalties paid ($K) 2.40 5.32 7.32 2.65 21.16 (1.62,2.90) (3.55,6.35) (5.19,8.42) (1.82,3.12) (18.29,23.03) Net gain ($K) 12.85 28.39 33.88 33.17 86.09 (8.07,17.21) (19.50,37.60) (24.64,44.34) (22.91,41.09) (62.68,113.82) Std. deviation costs ($K) 2.95 6.55 7.47 3.56 6.59 (2.24,3.49) (5.31,7.56) (6.22,8.52) (2.80,4.09) (5.72,7.51) As a robustness check, we show the counterfactual welfare results under different policies if traffic delay costs were halved. The top panel of results is estimated using the data subsample for which we have social cost measures; the second panel imputes counterfactual results for the full sample by reweighting the counterfactual moments for each contract by the inverse of the probability of appearing in the subsample. This probability is estimated by a probit, conditioning on the observables used elsewhere in the paper. The first column is simulated outcomes under the current policy, with random enforcement. The remaining simulations all assume perfect enforcement. The second column maintains the current deadlines and penalties. In the third column, the contract deadline is accelerated by 10%. In the fourth, the daily penalties for late completion are set equal to 10% of the social cost, while the final policy is a lane rental at 10% of the social cost. All statistics are calculated relative to a scenario where no time incentives are used. For example, Commuter Gain for any contract is the average number of days saved by using time incentives times the social cost. Acceleration Cost is the estimated additional cost to the winning contractor of accelerating construction relative to a no time incentives scenario. Penalties paid are damages the contractor pays for being late. Net Gain is the difference between commuter gain and contractor acceleration costs. Std. deviation costs is the standard deviation of the contrator costs plus penalties, where the standard deviation is across draws from the empirical distribution of estimated productivity shocks. 16
Table 7: Robustness Check: Traffic delay costs are doubled Current Fully 10% Tighter New Penalties Lane Rental Policy Enforced Deadline (10% Delay Cost) (10% Delay Cost) Subsample with delay data Days taken 40.13 37.82 37.00 37.09 26.15 (38.45,41.03) (36.29,38.61) (35.23,37.95) (35.84,37.73) (22.79,28.56) Commuter gain ($K) 70.52 156.29 185.17 269.65 1049.61 (43.29,94.10) (108.28,202.87) (133.78,239.66) (200.56,306.50) (912.17,1162.46) Acc. cost ($K) 1.31 2.92 3.51 6.42 37.61 (0.81,1.72) (2.04,3.65) (2.55,4.43) (4.85,7.18) (34.67,38.25) Penalties paid ($K) 3.00 6.67 9.09 4.15 40.85 (1.98,3.52) (4.33,7.72) (6.31,10.23) (2.50,5.16) (29.82,51.42) Net gain ($K) 69.20 153.37 181.66 263.23 1012.00 (42.48,92.37) (106.26,199.23) (131.24,235.29) (195.46,299.84) (875.59,1126.33) Std. deviation costs ($K) 3.53 7.84 8.88 10.09 24.40 (2.65,4.12) (6.31,8.94) (7.36,10.01) (7.54,11.82) (20.00,27.41) Reweighted to match full sample Days taken 37.76 35.80 35.05 35.17 24.82 (36.40,38.73) (34.62,36.60) (33.59,35.94) (34.20,35.83) (21.88,27.20) Commuter gain ($K) 55.50 122.64 146.52 214.01 873.00 (34.43,74.20) (85.70,160.39) (106.79,190.40) (159.38,246.56) (753.01,974.62) Acc. cost ($K) 1.02 2.27 2.75 5.13 31.98 (0.64,1.34) (1.60,2.87) (2.03,3.50) (3.86,5.85) (29.72,32.32) Penalties paid ($K) 2.40 5.32 7.32 3.04 33.53 (1.62,2.89) (3.59,6.34) (5.22,8.42) (1.84,3.91) (24.25,43.26) Net gain ($K) 54.47 120.37 143.77 208.88 841.02 (33.79,72.86) (84.11,157.55) (104.76,186.98) (154.85,241.04) (722.01,942.71) Std. deviation costs ($K) 2.95 6.55 7.47 8.27 21.03 (2.24,3.49) (5.32,7.55) (6.22,8.51) (6.22,9.89) (17.25,23.57) As a robustness check, we show the counterfactual welfare results under different policies if traffic delay costs were doubled. The top panel of results is estimated using the data subsample for which we have social cost measures; the second panel imputes counterfactual results for the full sample by reweighting the counterfactual moments for each contract by the inverse of the probability of appearing in the subsample. This probability is estimated by a probit, conditioning on the observables used elsewhere in the paper. The first column is simulated outcomes under the current policy, with random enforcement. The remaining simulations all assume perfect enforcement. The second column maintains the current deadlines and penalties. In the third column, the contract deadline is accelerated by 10%. In the fourth, the daily penalties for late completion are set equal to 10% of the social cost, while the final policy is a lane rental at 10% of the social cost. All statistics are calculated relative to a scenario where no time incentives are used. For example, Commuter Gain for any contract is the average number of days saved by using time incentives times the social cost. Acceleration Cost is the estimated additional cost to the winning contractor of accelerating construction relative to a no time incentives scenario. Penalties paid are damages the contractor pays for being late. Net Gain is the difference between commuter gain and contractor acceleration costs. Std. deviation costs is the standard deviation of the contrator costs plus penalties, where the standard deviation is across draws from the empirical distribution of estimated productivity shocks. 17