Survey Skepticism Hampering Data Collection
Privacy Concerns and Online Scams Lower Response Rates
Erik Paul, Chief Operating Officer of a software development business in Orlando, Florida, recently responded online to the 2022 Economic Census. However, when the U.S. Census Bureau asked about the company's finances, Paul hesitated. He expressed discomfort in sharing financial information, reflecting the growing survey skepticism among individuals and organizations.
This skepticism poses a challenge for the Census Bureau and other federal agencies. As privacy concerns rise and online scams proliferate, survey response rates have declined in the past decade. The COVID-19 pandemic further exacerbated the problem by disrupting in-person follow-up visits.
Low response rates introduce bias because wealthier and more educated households are more likely to answer surveys. This impacts the accuracy of data relied upon by demographers, planners, businesses, and government leaders to allocate resources effectively.
Survey skepticism has become so prevalent that the Federal Trade Commission (FTC) issued a consumer alert this month, reassuring the public that the American Community Survey (ACS), one of the Census Bureau's vital tools, is legitimate.
The Importance of the American Community Survey
The ACS is the Census Bureau's largest survey, covering over 40 topics, including income, internet access, rent, disabilities, and language spoken at home. Along with the census, it helps determine the distribution of $1.5 trillion in federal spending each year, the location of schools, and the development of new housing, among other crucial decisions.
Despite its significance, the ACS response rate fell from 97.6% in 2011 to 85.3% in 2021. Other federal questionnaires have experienced even more drastic declines.
Addressing Skepticism and Improving Response Rates
The FTC acknowledges the wariness surrounding surveys but emphasizes that the information collected serves a vital public purpose. The FTC's consumer alert states, "The ACS is a legitimate survey to collect information used to make decisions about how federal funding is spent in your community."
However, skepticism can be challenging to dispel, even among those tasked with protecting the public against identity theft and online security. Cherie Aschenbrenner, an elderly services officer with the Elgin, Illinois police department, expressed her strong opposition to the ACS in a comment on the FTC's website, stating, "There is NO WAY in anyone's right mind should they answer these invasive questions. 20 pages of them! NO WAY!!!!"
Declining response rates can also be attributed to survey fatigue, privacy concerns, and the time required to complete surveys. Technological advancements, such as spam filters, caller ID, and doorbell cameras, have also made it more challenging to reach individuals through traditional survey methods.
Efforts to Increase Survey Participation
Federal statistical agencies have implemented various strategies to increase survey participation. These include sending advanced and follow-up notices, making follow-up calls, and visiting households that do not respond. They have also expanded response options to include the internet, mail, and phone. Some agencies have even offered monetary incentives to encourage participation.
Additionally, agencies are exploring alternative data sources, such as administrative records collected by government agencies like the Social Security Administration and the Internal Revenue Service. They are also looking to capture and aggregate real-time financial transactions, such as soda purchases at grocery stores. These efforts prioritize privacy protections to prevent linking specific purchases to individual consumers.
The Census Bureau is taking steps to use more administrative records in its surveys. This month, the bureau proposed using existing records on property acreage instead of asking about it on the ACS. It is also examining how to leverage other sources for information about housing.
Relying more on administrative records can free up resources, allowing the Census Bureau to focus on reaching hard-to-count populations, such as immigrants, rural area residents, and people of color. These populations can be difficult to count due to language barriers, lack of internet access, distrust in government, or simply being hard to locate. However, if they are not counted or interviewed, they may miss out on vital resources.
The 2020 census marked the first time administrative records were used to fill in gaps about households with missing information. A post-count evaluation comparing survey results with census figures showed that information from the Social Security Administration and the IRS was more accurate than traditional methods, such as interviewing neighbors or landlords.
Census Bureau Director Robert Santos emphasizes the cost-effectiveness and accuracy of using administrative records, stating, "Wh