We use cookies on this site to enhance your experience. Visit our Privacy Policy for more info.

Wholesale Government: Open Data and APIs

Nick Sinai | July 20, 2015| 1 min. read

We understand the temptation for the federal government to focus primarily on the “retail” side of government — i.e. delivering public goods and services directly to citizens. After all, in a democracy a government’s customers are also its boss. Getting retail right is important. But getting “wholesale” right — i.e. partnering with distributors, channels, and other intermediaries to provide services — is just as essential. It’s through wholesale platforms that citizens, businesses, and nonprofits can make more of federal resources than the government alone could. Take, for example, how the federal government distributes funds. There are a number of high profile “retail” mechanisms to distribute benefits — such as the Social Security Administration sending checks directly to the disabled and elderly, or the IRS providing a refund check to taxpayers. The federal government also distributes “wholesale” block grants to intermediaries such as states, municipalities, and non-profit organizations, which in turn serve the public.

The retail vs. wholesale framework can be applied to the delivery of federal government services. The FBI serves as a retail police force directly investigating federal crimes, but also offers wholesale lab services to local police agencies that don’t have specialized capabilities. The same framework also applies to digital services. Government websites, Twitter accounts, and emails are examples of retail digital services, where the government is directly reaching citizens through information and transactions. The federal government is making progress toward improving its retail websites — for example, see the Department of the Interior’s website, which explains government revenues from oil, gas and other resources extracted from federal lands.

To improve retail government websites, the White House launched the U.S. Digital Services Playbook, and the General Services Administration launched 18F, a consultancy that builds effective, user-centric digital services. This is a commendable and important effort, but we’d also argue that wholesale digital services — opening up data and systems to business and non-profit intermediaries — is the massive opportunity that every government executive and public sector entrepreneur should be seizing to make government smarter and more effective. Wholesale digital services are what Tim O’Reilly calls “government as a platform.” President Obama’s open data initiatives — including a 2009 memorandum, a 2013 executive order, a national open data plan, Data.gov, Project Open Data, and a host of agency activities — are essentially a wholesale digital strategy. The data is being re-used by business, nonprofits, and other intermediaries that are analyzing, crunching, and incorporating the data into useful products and services. Just as some businesses like Apple have mastered both selling direct and through channels, some federal agencies have a long history with both retail and wholesale digital services. For example, at the National Weather Service, weather.gov is one of the most popular government websites, but the underlying weather data also powers your local news weathercast, weather apps, and a multitude of financial products.

Beyond open data, opening up systems, forms, and transactions to intermediaries is the natural evolution of a wholesale digital strategy for government. For example, since the IRS has already opened up its systems to vetted tax preparers, companies like TurboTax and H&R Block can compete to provide a great user experience and submit tax returns to the IRS on a user’s behalf. How can wholesale digital services be scaled across government? Application programming interfaces (APIs) are how modern Internet software and apps talk to each other, allowing data to be shared across boundaries. Building and maintaining useful APIs is the key to a smarter and more efficient government, using low cost, existing infrastructure that already exists. Here are a few examples of APIs in federal government according to the 18F /Developer Program: The Federal Aviation Administration provides travel websites and mobile apps with live airport status and delay information through its Airport Service API. The Pillbox API from the National Library of Medicine powers third party mashups that serve consumers who need to quickly identify an unknown pill. The Sunlight Foundation’s “Scout” project consumes the Federal Register API to provide alerts and notifications for formal government action. While we are huge fans of all types of government APIs as part of a wholesale digital strategy, we’d argue the largest yet untapped opportunity is public, read-write APIs — transactional APIs that submit data back to the government from external apps and services. Here is an example of the wholesale opportunity at the Department of Education: Free grants and low-cost loans are an important strategy to help all Americans afford college, and simply filling out the Department of Education’s Free Application for Financial Student Aid (FAFSA) may help orient students toward four-year college degrees. In fact, Indiana researchers summarized the academic literature by saying “the bulk of financial aid studies indicate that financial aid in general is likely to increase college access, choice and subsequent persistence.” And according to Mark Kantrowitz, publisher of FinAid.org, over two million students qualify for Pell Grants but don’t apply, and those students tend to disproportionately attend two-year post-secondary institutions rather than four-year programs.

The federal government’s strategy to increase FAFSA applications has been primarily retail — redesigning the website, streamlining the form, improving the user experience, and using First Lady Michelle Obama in a national call-to-action campaign that includes a FAFSA Completion Challenge, online videos, and visiting classrooms to encourage students to fill out the FAFSA. But what if the Department of Education employed a wholesale digital strategy as well? Suppose the department builds a public, read-write API for the FAFSA. Vetted organizations could build applications that collect student and parent information and securely submit it to the Department of Education. Imagine LA Unified School District, KIPP Schools, and after-school nonprofits all helping immigrant communities reach students that that are currently not applying for financial aid. The addition of a wholesale layer to the FAFSA lifecycle would allow institutions and companies who are already assisting students to step up and better serve the long tail of underserved student populations, similar to what TurboTax and H&R block does for the IRS. These existing organizations can extend the reach of the Department of Education, allowing it to better fulfill its mission.

In fact, the Department of Education has committed to explore this exact strategy at a 2014 White House Education Datapalooza, and asked for public comment to better understand the issue. A developer built an open source demonstration version of the API. We’re excited about the opportunity to turn this idea into a reality in 2015. The Departments of the Interior and Agriculture are also seizing this opportunity, asking for input about how to open up data and booking systems for federal parks and hosting a myAmerica developer summit on April 11 and 12. Entrepreneurs are responding — witness Hipcamp CEO Alyssa Ravasio’s call for the government to take a “wholesale” digital approach so innovators can build new apps and services to help Americans explore the great outdoors. From expanding higher education access to delivering benefits to veterans, providing the services that Americans need is no easy feat. But by adopting a wholesale digital strategy through open data and APIs, the federal government can more effectively partner with local government, nonprofits, and businesses to better serve the American people — extending its reach and helping solve our nation’s challenges. Aneesh Chopra and Nick Sinai Walter Shorenstein Media and Democracy Fellows Shorenstein Center for Media, Politics and Public Policy Harvard Kennedy School We understand the temptation for the federal government to focus primarily on the “retail” side of government — i.e. delivering public goods and services directly to citizens.

After all, in a democracy a government’s customers are also its boss. Getting retail right is important. But getting “wholesale” right — i.e. partnering with distributors, channels, and other intermediaries to provide services — is just as essential. It’s through wholesale platforms that citizens, businesses, and nonprofits can make more of federal resources than the government alone could. Take, for example, how the federal government distributes funds. There are a number of high profile “retail” mechanisms to distribute benefits — such as the Social Security Administration sending checks directly to the disabled and elderly, or the IRS providing a refund check to taxpayers. The federal government also distributes “wholesale” block grants to intermediaries such as states, municipalities, and non-profit organizations, which in turn serve the public. The retail vs. wholesale framework can be applied to the delivery of federal government services. The FBI serves as a retail police force directly investigating federal crimes, but also offers wholesale lab services to local police agencies that don’t have specialized capabilities.

The same framework also applies to digital services. Government websites, Twitter accounts, and emails are examples of retail digital services, where the government is directly reaching citizens through information and transactions. The federal government is making progress toward improving its retail websites — for example, see the Department of the Interior’s website, which explains government revenues from oil, gas and other resources extracted from federal lands. To improve retail government websites, the White House launched the U.S. Digital Services Playbook, and the General Services Administration launched 18F, a consultancy that builds effective, user-centric digital services. This is a commendable and important effort, but we’d also argue that wholesale digital services — opening up data and systems to business and non-profit intermediaries — is the massive opportunity that every government executive and public sector entrepreneur should be seizing to make government smarter and more effective. Wholesale digital services are what Tim O’Reilly calls “government as a platform.” President Obama’s open data initiatives — including a 2009 memorandum, a 2013 executive order, a national open data plan, Data.gov, Project Open Data, and a host of agency activities — are essentially a wholesale digital strategy. The data is being re-used by business, nonprofits, and other intermediaries that are analyzing, crunching, and incorporating the data into useful products and services. Just as some businesses like Apple have mastered both selling direct and through channels, some federal agencies have a long history with both retail and wholesale digital services. For example, at the National Weather Service, weather.gov is one of the most popular government websites, but the underlying weather data also powers your local news weathercast, weather apps, and a multitude of financial products.

Beyond open data, opening up systems, forms, and transactions to intermediaries is the natural evolution of a wholesale digital strategy for government. For example, since the IRS has already opened up its systems to vetted tax preparers, companies like TurboTax and H&R Block can compete to provide a great user experience and submit tax returns to the IRS on a user’s behalf. How can wholesale digital services be scaled across government? Application programming interfaces (APIs) are how modern Internet software and apps talk to each other, allowing data to be shared across boundaries. Building and maintaining useful APIs is the key to a smarter and more efficient government, using low cost, existing infrastructure that already exists. Here are a few examples of APIs in federal government according to the 18F /Developer Program: The Federal Aviation Administration provides travel websites and mobile apps with live airport status and delay information through its Airport Service API. The Pillbox API from the National Library of Medicine powers third party mashups that serve consumers who need to quickly identify an unknown pill. The Sunlight Foundation’s “Scout” project consumes the Federal Register API to provide alerts and notifications for formal government action. While we are huge fans of all types of government APIs as part of a wholesale digital strategy, we’d argue the largest yet untapped opportunity is public, read-write APIs — transactional APIs that submit data back to the government from external apps and services. Here is an example of the wholesale opportunity at the Department of Education: Free grants and low-cost loans are an important strategy to help all Americans afford college, and simply filling out the Department of Education’s Free Application for Financial Student Aid (FAFSA) may help orient students toward four-year college degrees. In fact, Indiana researchers summarized the academic literature by saying “the bulk of financial aid studies indicate that financial aid in general is likely to increase college access, choice and subsequent persistence.” And according to Mark Kantrowitz, publisher of FinAid.org, over two million students qualify for Pell Grants but don’t apply, and those students tend to disproportionately attend two-year post-secondary institutions rather than four-year programs.

The federal government’s strategy to increase FAFSA applications has been primarily retail — redesigning the website, streamlining the form, improving the user experience, and using First Lady Michelle Obama in a national call-to-action campaign that includes a FAFSA Completion Challenge, online videos, and visiting classrooms to encourage students to fill out the FAFSA. But what if the Department of Education employed a wholesale digital strategy as well? Suppose the department builds a public, read-write API for the FAFSA. Vetted organizations could build applications that collect student and parent information and securely submit it to the Department of Education. Imagine LA Unified School District, KIPP Schools, and after-school nonprofits all helping immigrant communities reach students that that are currently not applying for financial aid.

The addition of a wholesale layer to the FAFSA lifecycle would allow institutions and companies who are already assisting students to step up and better serve the long tail of underserved student populations, similar to what TurboTax and H&R block does for the IRS. These existing organizations can extend the reach of the Department of Education, allowing it to better fulfill its mission. In fact, the Department of Education has committed to explore this exact strategy at a 2014 White House Education Datapalooza, and asked for public comment to better understand the issue. A developer built an open source demonstration version of the API.

We’re excited about the opportunity to turn this idea into a reality in 2015. The Departments of the Interior and Agriculture are also seizing this opportunity, asking for input about how to open up data and booking systems for federal parks and hosting a myAmerica developer summit on April 11 and 12. Entrepreneurs are responding — witness Hipcamp CEO Alyssa Ravasio’s call for the government to take a “wholesale” digital approach so innovators can build new apps and services to help Americans explore the great outdoors. From expanding higher education access to delivering benefits to veterans, providing the services that Americans need is no easy feat. But by adopting a wholesale digital strategy through open data and APIs, the federal government can more effectively partner with local government, nonprofits, and businesses to better serve the American people — extending its reach and helping solve our nation’s challenges. Aneesh Chopra and Nick Sinai Walter Shorenstein Media and Democracy Fellows Shorenstein Center for Media, Politics and Public Policy Harvard Kennedy School