O'Reilly logo

Open Government by Laurel Ruma, Daniel Lathrop

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 9. “You Can Be the Eyes and Ears”: Barack Obama and the Wisdom of Crowds

Micah L. Sifry

On his first full day in office, President Barack Obama issued an executive memorandum that may someday be seen as signaling the most important shift in how government works in the United States since the rise of the New Deal. His subject? Not jobs or health care or the environment, but “transparency and open government.” In five succinct paragraphs, he promised to create an “unprecedented level of openness in Government” (see the Appendix A). “We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration,” he wrote, arguing that it would “strengthen our democracy and promote efficiency and effectiveness in Government.”

Most significantly, he declared that in addition to making government more transparent, it should become more participatory and collaborative:

Public engagement enhances the Government’s effectiveness and improves the quality of its decisions. Knowledge is widely dispersed in society, and public officials benefit from having access to that dispersed knowledge. Executive departments and agencies should offer Americans increased opportunities to participate in policymaking and to provide their Government with the benefits of their collective expertise and information…. Executive departments and agencies should use innovative tools, methods, and systems to cooperate among themselves, across all levels of Government, and with nonprofit organizations, businesses, and individuals in the private sector.

Obama’s language was dry, but the message is clear: in essence, he is pointing toward a third way between the stale left-right dichotomy of “big government” versus “smaller government.” Effective government, Obama is suggesting, may be found by opening the bureaucracy to direct public monitoring, engagement, and, where viable, collaboration. Is Obama calling for the federal government to embrace the wisdom of crowds? The signs certainly abound.

Change.gov Shows How to Change the Gov

The most robust moves came early, undertaken by Obama’s transition team during the weeks after the election but before his inauguration, when his team’s use of the Web wasn’t yet fully constrained by government traditions and legal hurdles. A number of valuable experiments came in quick succession.

First, on Change.gov, the official transition website, visitors were invited to “Join the Discussion” on topics such as health care reform, the economy, and community service, and rate the comments made by others. Several thousand people participated.

Then the transition team launched “Open for Discussion,” a gigantic online forum where people were invited to post questions and to vote the best ones up.[134] Over the course of two rounds, more than 120,000 people voted nearly 6 million times on more than 85,000 questions. In both cases, top administration officials offered answers to a handful of the top-voted issues.

Finally, there was the “Citizens’ Briefing Book,” an attempt at making sure that at least some iconoclastic ideas from the public made their way, unfiltered, directly into the president’s hands. More than 125,000 people voted on more than 44,000 submissions, and several months later, the White House Office of Public Engagement released a 32-page PDF along with a video showing Obama holding the report.[135]

“You Can Be the Eyes and Ears”

But the transition website was just the beginning. Early in his administration, Obama made several declarations about how his approach to government, and in particular the giant “Economic Recovery” spending plan that was the major legislative priority of his first months in office, would be informed by direct public participation in the process. In one online video, he told his supporters that this program would be conducted “with unprecedented transparency and accountability.” Clearly aware that his critics were already predicting “big government” would waste hundreds of billions in taxpayer dollars, he added:

I’ll appoint an aggressive Inspector General and a cabinet level oversight board to make sure your money is spent wisely. More importantly, I’ll enlist all of you. As soon as this plan is signed into law, Recovery.gov goes live and you’ll be able to see precisely where your tax dollars are going. Because this is your democracy, and as I said throughout the campaign, change never begins from the top down. It begins from the bottom up.

A day later, on February 9, 2009, while selling his recovery plan at a town hall meeting in economically devastated Elkhart, Indiana, Obama went further in explaining his vision for using the social Web to crowdsource the watchdogging of government spending:

We’re actually going to set up something called Recovery.gov—this is going to be a special website we set up, that gives you a report on where the money is going in your community, how it’s being spent, how many jobs are being created so that all of you can be the eyes and ears. And if you see that a project is not working the way it’s supposed to, you’ll be able to get on that website and say, “You know, I thought this was supposed to be going to school construction but I haven’t noticed any changes being made.” And that will help us track how this money is being spent…. The key is that we’re going to have strong oversight and strong transparency to make sure this money isn’t being wasted.

“I’ll enlist all of you.” “You can be the eyes and ears.” These are the words of someone who clearly understands the power and wisdom of a crowd, and the axiom that all of us are smarter than any one of us.

Recovery.gov Site Still Under Construction

But it’s one thing for the president to promise to involve the public in a fundamentally new way in their government, and another to get government agencies and leaders to actually change how they do business. As of the fall of 2009, the implementation of Obama’s vision remained sketchy at best.

For starters, Recovery.gov, which in Obama’s own words was meant to play a central role in collecting, displaying, and tracking how billions in new monies are spent, was for most of the year just a placeholder of a website showing only top-line data and graphics on what was supposed to be happening, not an actual data trove for citizen engagement.

The inspector general in charge of that program, Earl Devaney, admitted that it would take at least until the fall before the site contained much detailed information, but after a $9.5 million crash contract to redesign the site, it still wasn’t inspiring much confidence among transparency advocates. The revised site did contain tools enabling fairly granular data lookups and nifty maps showing where funding and jobs were supposedly occurring, but the lack of recipient reports made those tools relatively hollow. Similarly, users were encouraged to post reports of possible fraud, waste, or abuse, but the site didn’t make those reports available in any fashion. In addition, Devaney promised to reach out to “citizen inspectors general” on social networking sites such as Facebook and Twitter, to help him surface problems, but compared to Obama’s early promises of civic engagement, Devaney’s words seemed mostly like gestures without strong follow-up.

Online Town Hall or “Participation Theater”?

In terms of involving the public in a meaningful discussion of policy priorities, the Obama administration clearly chose to crawl before it walked, let alone ran. Or to use a less clichéd metaphor, Obama’s early moves were marked by an odd dichotomy: one leg of his administration seemed ready to race ahead, trying out new interactive experiments, while the other leg seemed to want to stand in place and control the discourse.

For example, twice in the first six months of 2009, Obama held an interactive “online town hall” where the public was invited to submit questions in advance and the president responded during a live webcast done in tandem with an in-the-flesh town hall meeting.

First, in late March, his new media team held an online town hall about the economy where for two days anyone could post a question on the White House website or vote one to the top of the pile. Then Obama held a live webcast from the White House where he pointedly responded to most of the top-voted questions. Nearly 93,000 people submitted more than 100,000 questions, and more than 3.6 million votes were cast on them. Tens of thousands watched the event live online. The forum was generally deemed a success, but it hit one discordant note when Obama made fun of the fact that questions about legalizing marijuana did surprisingly well in the online voting. “I don’t know what this says about the online audience,” he chuckled, ignoring the fact that somewhere between 40% and 50% of U.S. voters favor the reform.[136]

Then, in early July, the president held another online town hall meeting on health care reform, but despite using sites such as YouTube, Facebook, and Twitter to invite the submission of questions from the public, this event was far less interactive than his first. Obama said he’d answer some of the “more popular” questions, but there was no mechanism established to determine which ones were indeed popular. Instead, his staff chose which questions he would be asked to respond to, producing an event that was less spontaneous and less town-hall-like than if all the questions had come from citizens live at the event using no technology at all. Reporters at the daily White House briefing peppered Press Secretary Robert Gibbs with critical questions about the event, attacking it as a sham. My colleague at Sunlight Foundation, Ellen Miller, called it “transparency theater,” though the more precise term would be “participation theater.”

The seeming reluctance of the Obama operation to allow the public to inject its own preferences into a White House media event is rooted in a traditional understanding of how important it is to always control your message. But back in 2008, candidate Obama seemed unfazed by the prospect of involving the public in such events in a more free-form fashion. When the Open Debate Coalition, a cross-partisan group of reform advocates, was pushing for the use of “bubble-up” style public question filtering for the national debates, in particular for the one “town hall”-style debate, Obama declared his support for the concept (as did his opponent, Senator John McCain). Obama wrote:

Town hall debates such as the October 7 debate provide an excellent opportunity to utilize technology to give voters more of a role in determining which questions are selected and asked. For example, during the MTV forum in which I participated last year, the Internet community voted to ask a question regarding my position on network neutrality, which I support. I support the use of such technology in debates as the Coalition proposes in its letter.

It remains to be seen whether President Obama will listen to candidate Obama on this issue.

Open Data and Open Government

Fortunately, the progress of Obama’s call for a more open, participatory, and collaborative government isn’t dependent on change solely in how the White House manages its most precious political asset, the president and his ability to communicate directly with the American people. Obama’s call for change, coupled with the hiring of several leaders in the fields of open data and open government, has set off ripples across the federal government. CIOs and web managers in hundreds of departments and agencies are embracing this change in tone, and policy, to engage in all kinds of new approaches. A long list of agencies are now using YouTube, Facebook, MySpace, and dozens of less well-known but equally potent Web 2.0 platforms, thanks to efforts by the White House new media team and the U.S. Government Accountability Office (GAO) to negotiate acceptable terms of service with these third-party services. At least 68 agencies have official Twitter accounts (those were the ones the White House was following from its official Twitter account). And several agencies, such as the U.S. Environmental Protection Agency (EPA), have begun to roll out their own initiatives to make their piece of government more transparent.

The biggest developments of note were the launch of Data.gov and IT.usaspending.gov by White House CIO Vivek Kundra, and the “open government initiative” launched by the Office of Management and Budget (OMB) and the Office of Science and Technology Policy (OSTP) and led by deputy CTO Beth Noveck. Each of these efforts represents the finest distillation of Obama’s principles into practice, and their emergence in the first six months of his administration is a sign of real promise.

Kundra’s work in opening up raw government data in structured, machine-readable form is positively revolutionary. Literally hundreds of thousands of data streams are coming online at Data.gov, and in the process a whole new kind of public engagement with public information is being enabled. His willingness to launch the site before all these data sets were identified, and to also enable users to openly rate the quality of the data on the site, are subtle but significant shifts in how government conducts information technology (IT) projects, moving away from control and perfection and toward iteration and interaction. This is also the case with IT.usaspending.gov, which showcases user-friendly “dashboards” to help the public (as well as government leaders) track tens of billions in IT spending. “We want to tap into the ingenuity of the American people to show us a better, innovative path,” Kundra told a rapt audience at the Personal Democracy Forum in June 2009, as he described his approach to iterative website development.

A similar willingness to give up partial control and invite freewheeling public participation has characterized Noveck’s leadership of the Open Government Directive. For several weeks between late May and early July 2009, the public was invited to participate in a series of open online conversations about Obama’s day-one transparency memorandum. The goal, in Noveck’s words, was to create a “structured dialog” aimed at the “co-creation of government” with “many people participating in the process.”

The process started with an online brainstorm using IdeaScale, a third-party platform that enables Digg-style voting to bubble up popular suggestions. In a short period of time, about 4,000 people had posted more than 1,100 ideas and thousands of comments, and cast more than 30,000 votes to help rank them. Then the public was invited to comment on a series of detailed blog posts. And finally, participants were given the opportunity to actually help draft each of 16 distinct sections of the draft directive, using the collaborative writing tool Mixed Ink. A total of 375 participants wrote 305 different drafts across those 16 topics, and voted 2,256 times on those drafts to help produce some promising policy language.

This open process wasn’t without its bumps. Especially in the early stages, the OSTP site was bombarded with comments from members of the public with their own narrow concerns, including people who believe Obama’s birth certificate is invalid. These “birthers” were, in many cases, driven to Noveck’s site by right-wing websites and bloggers, and for a time their voices appeared to drown out those of people genuinely interested in proposing improvements in government transparency practices. To a casual visitor of the site, it might have appeared that it had been hijacked. But Lena Trudeau, vice president of the National Academy of Public Administration, which hosted that phase of the process, said it was an overall success.

She did tell Federal Computer Week, however, that after an initial burst of participation by members of the public who wanted to contribute constructive suggestions, the IdeaScale phase of the initiative hit some turbulence. She noted, “Part of the theory behind the site was that the community would help moderate it. Well, the challenge that you have is, when a large part of the constructive community goes away, you’re left with people who may not have the full context of what you are trying to accomplish or they may have their own agendas. And that’s just something we need to know and understand if we are going to be using more of these tools and approaches in the policy evolvement process.”

Co-creation, Co-optation, or Collision?

It remains to be seen just how far the administration will go toward implementing Obama’s vision of change fostered by making government more open, participatory, and collaborative. In part, this is because he is juggling many difficult priorities at once. In part, this is because he and the innovators he has appointed to pioneer these changes are traveling uncharted territory. And finally, by offering to involve and empower the public in “co-creating” government, Obama is unleashing an inherently disruptive force.

As his administration’s early experiments with crowdsourcing have shown, hundreds of thousands of Americans are eager to take up his call to participate in new ways—and that’s without his having pushed hard to publicize the opportunity. What happens when those numbers climb into the millions, and people who have been invited to have a voice now expect to be listened to?

It isn’t just that online collaborative platforms for public input and participation can be gamed, and thus special interest groups or semiorganized pranksters can seemingly hijack such sites to make mischief. Ideally, the more often government enables such interaction to happen, the less meaningful those disruptions will become. It’s when the chance to participate is kept rare that the value of gaming these sites is at its highest.

The more difficult issue for advocates of opening up a process of “co-creating” government is what may happen when newly empowered citizens inevitably collide with entrenched interests. Obama’s vision of enlisting the public in a new, socially conscious and transparent process of improving how government works—“You can be the eyes and ears”—may be exhilarating, but it also may lead to all kinds of unexpected consequences. The subcontractor who is skimming recovery funds that are supposed to be spent on building that new school may be a cousin of the local mayor, who may be tied to the Democratic Party, or his workers may belong to a construction union that endorsed the president’s election. In other words, local e-democracy, Obama-style, could easily crash head-on into local power politics.

We don’t know yet how this story will play out. But the evolving history of the social Web offers one encouraging hint. From Wikipedia to Craigslist to Amazon to Google, the Web keeps rewarding those actors who empower ordinary users, eliminate wasteful middlemen, share information openly, and shift power from the center to the edges. Applying those same principles to government will undoubtedly be messy, but Obama has one thing going for him: it is where technology is already taking us.

About the Author

About the Author

Micah L. Sifry is cofounder and editor of the Personal Democracy Forum, a website and annual conference that covers the ways technology is changing politics, and TechPresident.com, an award-winning group blog about how the American presidential candidates are using the Web, and how the Web is using them.

[136] See http://www.pollingreport.com/drugs.htm. For example, 46% favor the legalization of small amounts of pot for personal use (Washington Post poll from April 2009), and 44% are in favor of making the use of pot legal (Gallup poll from October 2009).

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required