Summary results for the survey are available. Click here to explore
In collaboration with Facebook, along with a consortium of universities and public health officials, the Delphi group at Carnegie Mellon University conducts the COVID-19 Trends and Impact Survey to monitor the spread and impact of the COVID-19 pandemic in the United States. This survey is advertised through Facebook. It has run continuously since early April 2020, and about 50,000 people in the United States participate every day. Survey results are publicly available on our CTIS Results Dashboard and COVIDcast Map; aggregate data can be downloaded through our COVIDcast Exporter, from our COVIDcast API, and as contingency tables with demographic breakdowns.
Such detailed data has never before been available during a public health emergency, and it has already helped public health officials understand how to save lives and how to safely reopen public life. The data also helps researchers understand the social, economic, and health effects of the COVID-19 pandemic.
An international version of the survey is conducted by the University of Maryland in collaboration with Facebook. Its data is available separately.
Detailed technical documentation about the survey is available on our site for data users.
The survey asks respondents whether they are experiencing any symptoms, then asks a series of questions designed to help researchers understand the spread of COVID-19 and its effect on people in the United States. These include questions about COVID-19 testing, prior medical conditions, social distancing measures, mental health, demographics, and the economic effects of the pandemic.
Delphi uses information from the survey as part of its public COVIDcast Map, to inform its forecasts of the pandemic’s spread, and to assist public health agency partners. By providing daily data from all parts of the United States, the survey allows comparisons between regions and allows careful tracking of changes over time. Other researchers use the survey to study factors related to the pandemic’s spread, its effects on mental health, how different demographic groups are affected by the pandemic, and numerous other important questions.
Because the survey can reach thousands of respondents every day, its questions focus on what the respondents are experiencing right now. This allows us to track how conditions change across the country every day.
The surveys are a collaboration between Delphi at Carnegie Mellon University, numerous universities, and Facebook. Researchers at many institutions are analyzing the survey data and assisting in the survey’s development.
The survey protocol has been reviewed by the Carnegie Mellon University Institutional Review Board. Delphi only publicly releases aggregate data; de-identified individual data is made available to research partners. Our partners are bound by data use agreements to maintain the confidentiality of individual survey responses. Facebook refers its users to the survey, but it does not receive any individual survey data.
Participants are recruited for the surveys through an advertisement placed in their Facebook news feed. Facebook automatically selects a random sample of its users to see the advertisement; users who click on the ad are taken to a survey administered by Carnegie Mellon University, and Facebook does not see their survey responses. The survey is available in English, Spanish, Brazilian Portuguese, Vietnamese, French, and simplified Chinese.
The survey participants are sampled from Facebook users, rather than being a random sample from the entire United States population. But unlike a traditional telephone or mail survey, distribution through Facebook allows us to reach tens of thousands of respondents every day, permitting researchers to make comparisons between many geographic areas and to detect changes as soon as they happen.
To account for the differences between Facebook users and the United States population, Facebook includes a unique identifier when it links users to the survey. Carnegie Mellon collects these identifiers and provides Facebook with a list of identifiers that completed the survey; Facebook then calculates statistical weights indicating how representative each person is of the United States population, based on demographic data known to Facebook. Crucially, Carnegie Mellon cannot use these identifiers to identify specific Facebook users, and Facebook never receives individual survey responses and cannot link them to specific users.
Our CTIS Results Dashboard shows aggregate survey results, ranging from rates of COVID-like symptoms over mask usage to mental health. In addition, our COVIDcast dashboard shows basic aggregate survey results, revealing the rates of mask usage and COVID-like symptoms across the United States. The data used by both tools is also freely available for download through the COVIDcast API and our COVIDcast Exporter. Facebook also publishes a map based on the United States and international aggregate data.
The Symptom Data Challenge challenged participants to enable earlier detection and improved situational awareness of the COVID-19 outbreak by using data from these symptom surveys. Check out the the challenge website for more details about the Challenge and the finalists.
Our primary description of the survey and its results over the first year of operation was published as part of the special feature “Beyond Cases and Deaths: The Benefits of Auxiliary Data Streams in Tracking the COVID-19 Pandemic” in PNAS:
Other research publications using the survey data include:
If you have used the survey data, or the aggregate data available in the COVIDcast API, to publish research results, please contact us so we can include your work here.
Yes! Aggregate data is available for download through the COVIDcast API, updated daily. R and Python clients are available for the API. Aggregate data does not include any individual survey responses, only averages over counties and other geographic areas, and does not include all survey questions. See the API documentation for details on how to access the data, what survey questions are available, and how our aggregate values are calculated. Contingency tables giving demographic breakdowns of key survey signals are also publicly available for download.
Access to de-identified individual survey responses is available to qualified research groups who sign Data Use Agreements protecting the confidentiality of survey responses. If you are interested in using the data for your research, you can find instructions on our documentation site. The available data and survey waves are documented here.
Questions from survey respondents about consent, research ethics, or how their data is used: delphi-admin-survey-fb@lists.andrew.cmu.edu
Getting access to survey data for research: complete this form
Stacy Kish
Associate Director, Research Communications
Dietrich College
Carnegie Mellon University
Alex Reinhart
Assistant Teaching Professor
Department of Statistics & Data Science
Carnegie Mellon University