Internet Explorer 11 is not supported

For optimal browsing, we recommend Chrome, Firefox or Safari browsers.

Are Governments 'Paying for Failure' With Social Impact Bonds?

A social policy experiment is spreading across the country as a new way to finance, deliver, and improve public services and problems. But its merits are so far unproven.

Three years ago, New York City launched an ambitious and unprecedented social policy experiment at its jail on Rikers Island. Thousands of teenage inmates began receiving group therapy aimed at improving their moral reasoning by addressing their beliefs and thought processes in a step-by-step treatment. The goal was to reduce the number of repeat offenses once the inmates were released. Academic studies using the method, known as moral reconation therapy, had reported success in reducing recidivism. Still, no one had ever scaled up these studies to accommodate anything like the 9,240 inmates the four-year Rikers Island program aimed to serve. This month, the program is coming to an abrupt end.

The reason for the progam’s demise has to do with another feature of the experiment: It was financed entirely with a $9.6 million loan from Goldman Sachs. New York City was to pay the investment firm back if the repeat offense rate went down by at least 10 percent over four years. In June, a preliminary report showed the program not only was missing its recidivism target, it had no impact on the rate altogether. Goldman Sachs moved swiftly and took a contract option to cancel the program one year early. The first social impact bond program in the United States has officially failed. 

“Everyone went into this understanding what they were getting into,” says David Butler, a senior adviser at MDRC, a nonprofit social policy research organization that managed the treatment program at Rikers. “These things are risks. Just because something works in one environment doesn’t mean it will work somewhere else.” 

Unpredictable as they are, programs like the one at Rikers are not going away. In fact, these attempts to link altruistic policy goals with the pursuit of private profit have been gaining steam as the latest promising innovation in public finance. The mere announcement of the Rikers project back in 2012 was a catalyst for action in dozens of other jurisdictions. Cash-strapped governments quickly became sold on the concept that they can use private money from investors for preventive social programs -- money the government will have to pay back only if the programs produce the desired measurable outcomes. In 2013 alone, 28 state and local governments applied to the Rockefeller Foundation and Harvard’s Social Impact Bond Technical Assistance Lab to receive help in developing such programs. 

Media outlets have often touted the innovative financing tool with few notes about the complicated nature of the projects. Last year on Capitol Hill, where bipartisan support is famously elusive these days, a $300 million proposal pushed by President Obama to allocate federal funds for social impact bond projects in the states managed to attract proponents on both sides of the aisle.  

But as the enthusiasm for social impact bonds has grown, so has skepticism about the concept of partnering with the private sector to accomplish social goals. Last spring, a congressional hearing on the subject ended on a negative note as critics questioned the complicated structure of program contracts between governments, investors and the various private operators involved. “I don’t get this at all,” said Maine independent Sen. Angus King, squinting with disbelief. “I think this is an admission that government isn’t doing what it’s supposed to do. This strikes me as a fancy way of contracting out.” 

That hearing was followed by a report last summer that the world’s first social impact program, located in the United Kingdom, had not reached its target goal required to trigger early payments to investors. That development and the news from the Rikers project underscore the fact that the merits of social impact bond programs are entirely unproven. The programs are so new, in fact, that people are still arguing about what to call them. Some say that referring to them as bond investments is misleading because they are not like actual government bonds that are bought and sold on a public market. That’s why many proponents prefer to call them “pay for success” programs. But what does “pay for success” imply, asks Indiana University Public Affairs professor Craig L. Johnson. “That right now we’re paying for failure?”  

The bond programs may or may not save governments money in the long run. Even though the Rikers project didn’t work, Goldman Sachs said last month that its three other social impact bond investments had shown “encouraging progress.”  Still, it’s much too early to tell if any of these endeavors will actually bring about the kind of change that social scientists and governments are hoping for. 

Social impact bonds got their start five years ago in the U.K., at a prison in Peterborough, a city of about 190,000 people situated 100 miles north of London. Investors and social services professionals formed a group called Social Finance and made Peterborough their first investment. For a cost of about $8 million over six years, the provider, One Service, is giving comprehensive assistance to offenders who have served short sentences, in an effort to help them become self-supporting when they are released. Caseworkers help get ex-cons ID cards, set them up with doctors, encourage them to take classes and help them find counseling.

The argument for doing something at Peterborough was compelling. In Britain, 60 percent of those who serve short-term sentences land back in jail within a year. The Peterborough program, which will conclude next year, aims to reduce recidivism by 7.5 percent. The buzz about it and its new financing method via private investors led to the flurry of experiments at the state and local level in the United States. In December 2013, New York became the first state to try social impact bonds, launching a program aimed at reducing recidivism and increasing employment among 2,000 ex-offenders. All told, more than two dozen states and localities have now taken up or considered a social impact bond project.

These bond deals are being used to address all sorts of social problems, including early childhood education, homelessness, health and criminal justice. No two projects are the same. Each must draw up its own contract with service providers and with the project evaluators who track the outcomes. None of the new projects can be modeled after an existing one; each is its own social experiment and must be built from the ground up. For example, the Massachusetts juvenile justice bond program is financed with $18 million from six organizations, including nonprofits. The state is setting aside money every year for a separate fund to pay back investors if the seven-year project meets its goals. The Rikers Island project, on the other hand, was financed entirely by Goldman Sachs, with Bloomberg Philanthropies insuring three-quarters of the money. 

The stated goals vary considerably. While the goal at Rikers was to reduce recidivism by at least 10 percent, Massachusetts is targeting a 40 percent reduction in jail days over seven years for the nearly 1,000 offenders in the study. The state estimates this reduction would result in a $22 million savings, and that is the amount it will pay back investors if the goal is reached. If the program exceeds that goal, Massachusetts estimates it could save as much as $45 million; however, it would only have to pay out a maximum of $27 million. Other programs have similarly structured payouts. Goldman Sachs stood to receive as much as $11.7 million if the Rikers program significantly exceeded its goal, while New York City estimates it would have recouped a net savings of up to $20.5 million.

These are complicated agreements -- the Massachusetts bond contract is more than 200 pages long -- and their very complexity is often cited by their critics as a weakness. Maryland investigated the possibility of using social impact bonds, but the state’s Department of Legislative Services concluded in 2013 that the startup cost of designing a program and negotiating a contract would likely exceed the projected savings of a pilot serving several hundred people. That report essentially killed the issue of social impact bonds in Maryland, at least for now.

Indeed, the Rikers experience seems to illustrate that concern. A report on lessons learned prepared last year by MDRC lamented the jail program’s “high transaction costs” that weren’t covered in the Goldman Sachs loan. And for all the effort, the city’s greatest potential for cost savings would have amounted to less than half of a percent of the $1 billion it costs annually to run the jail. 

But whatever the critics may say, it seems likely that governments will be increasingly attracted to these experiments. At a minimum, practitioners argue, they will get the benefits of knowing more about what doesn’t work, and can cut their losses. In that sense, says MDRC’s Butler, the Rikers program was a success. “This is not the recipe for reducing recidivism for these kids at Rikers,” he says. “Learning that was really important.”

Still, the task of attracting investors is tricky. Even the philanthropically minded investors drawn to social impact bond projects aren’t going to put up money for a program that looks like it was constructed on a wing and a prayer. 

Goldman Sachs was reticent to enter the Rikers deal in 2012 until it saw results from previous academic studies that showed moral reconation therapy could reduce recidivism by up to 25 percent in those participating. And even then, it took insurance from Bloomberg Philanthropies to seal the deal. (As a result, the firm lost $1.2 million instead of its full investment.) “We’re trying to find that sweet spot of allowing every stakeholder to win,” says Tracy Palandjian, CEO of Social Finance US, which is a sister company to the U.K. group and is managing the New York state, as well as developing ones in Connecticut, Massachusetts, Michigan and South Carolina. “So even when the state pays back the investors with returns, that still should be smaller than what you gain overall as a state.”

But that’s where the argument ends, at least for now. Until the social impact projects currently running hit their end dates, no one will know how the numbers play out. And on the social services side, some question whether designing projects focused on short-term behavioral change is the best way to intervene. “It is hard to recreate the kind of concrete turnaround you get in pay for success across a whole lifespan,” says Anne Stone, who runs a child development program in Washington state. “I’m not in any way suggesting it’s not worthy to move those dials, but is there a way we can be thinking about this in a two-generation approach?”

The fact is, social impact bonds may have started out life as an innovative financing tool. But many who are now taking part in them are finding that the real experiment is in developing a new model for delivering government services. In that sense, supporters hope the projects’ immediate impact will be in encouraging more social policy geared toward preventive measures, even if the intangible savings are impossible to quantify. They are hopeful that when a project ends and appears to be working, the government will be willing to pay the full cost of its extension, without any private backers. 

Sometimes even the hint of private investment can spur a commitment from government. The Utah Legislature recently agreed to assume some of the costs of a Salt Lake County social impact bond program after Goldman Sachs committed to financing for one. Harvard’s Jeffrey Liebman had a similar experience working with a state budget director to find a social impact project for that state. Among the ideas Liebman proposed was a health-care program that would place caseworkers in senior centers to save on Medicaid costs. Instead of going for the financing project, the budget director just opted to include the cost for the caseworkers in the state’s budget. “If social impact bonds cause that to happen, that’s just as good,” Liebman said at last year’s Senate hearing.

Still, for Indiana University’s Johnson, any kind of mass social impact brought about by these kinds of projects is decades away. “We need a lot more cases to see what works and what doesn’t,” he says. “The problem I see now is, if you just have a few experiments going, that’s not going to tell us how to change. Until people have put up [collectively] hundreds of millions of dollars, we’re not going to know if this works.” 

Liz Farmer, a former Governing staff writer covering fiscal policy, helps lead the Pew Charitable Trusts’ state fiscal health project’s Fiscal 50 online resource.