With the emergence of COVID-19 in the U.S., the Centers for Medicare & Medicaid Services (CMS) was uniquely positioned to quickly collect vital information on how the pandemic is impacting the Medicare population by using the Medicare Current Beneficiary Survey (MCBS) as a vehicle to collect data. The MCBS COVID-19 Rapid Response Community Supplements are nationally representative, cross-sectional telephone surveys that collect data on topics such as the availability of telemedicine visits, deferred medical care, social distancing and other preventive health behaviors, COVID-19 testing and vaccination, and the consequences of the COVID-19 pandemic for social, emotional, and financial well-being.
The first MCBS COVID-19 Summer 2020 Community Supplement was a standalone telephone survey of 11,114 Medicare beneficiaries administered from June 10, 2020 through July 15, 2020. This data collection was conducted by NORC at the University of Chicago (NORC) as a supplement to MCBS annual data collection. The second MCBS COVID-19 Fall 2020 Community Supplement was a standalone telephone survey of 9,686 Medicare beneficiaries administered from October 5, 2020 through November 15, 2020 during regular MCBS annual data collection. The third MCBS COVID-19 Winter 2021 Community Supplement was a standalone telephone survey of 11,107 Medicare beneficiaries administered from March 1, 2021 through April 25, 2021 during regular MCBS annual data collection. After Winter 2021, a subset of the COVID-19 Community Supplement items were integrated into the main MCBS questionnaire instrument.
To enable researchers to analyze the data collected through the COVID-19 Community Supplements, data are combined with demographic and health status data collected during prior interviews and made publically available through the MCBS COVID-19 Supplement Public Use Files (PUFs), which include analytic weights to ensure data are statistically accurate. The COVID-19 Summer 2020 Supplement PUF was released in October 2020, the COVID-19 Fall 2020 Supplement PUF was released in January 2021, and the COVID-19 Winter 2021 Supplement PUF was released in July 2021. The PUFs are evaluated for disclosure risk and do not require a Data Use Agreement (DUA). The estimates in this web tool use the MCBS COVID-19 Supplement PUFs with the appropriate weights. See below for more information about the methodology.
In addition to standalone PUFs, data collected in the COVID-19 Summer 2020 and Fall 2020 Community Supplements were made available as part of the 2019 Survey File Limited Data Set (LDS). Similarly, data collected in the Winter 2021 Supplement will be made available as part of the 2020 Survey File LDS. LDS data are available with a DUA and are linkable to other data segments for analysis.
To learn more about the COVID-19 Community Supplements and how to appropriately analyze the data, see the following resources:
Download the MCBS COVID-19 Supplement Questionnaires.
Download the MCBS COVID-19 Supplement PUFs, including the analytic weights, data user documentation, and codebook.
To view other estimates from MCBS COVID-19 Community Supplement data, check out the Summer 2020 Data Snapshot Infographic, Fall 2020 Data Snapshot Infographic, and Winter 2021 Data Snapshot Infographic.
The MCBS COVID-19 Data Tool presents findings from the MCBS COVID-19 Summer 2020 Supplement PUF, MCBS COVID-19 Fall 2020 Supplement PUF, and MCBS COVID-19 Winter 2021 Supplement PUF. Estimates represent the population of beneficiaries who were continuously enrolled in Medicare from the beginning of 2020 and were alive, living in the community, and eligible and enrolled in Medicare at the time of the COVID-19 Summer 2020, Fall 2020, or Winter 2021 Supplement interviews.
The COVID-19 Data Tool is comprised of a series of dashboards related to how COVID-19 has affected the lives of Medicare beneficiaries. In addition, estimates for different demographic subgroups and health factor status subgroups are also presented. The tool presents a visual approximation of the analysis; all conclusions should be verified through appropriate analysis of the publically available datasets.
The MCBS COVID-19 Data Tool incorporates questions and responses from the COVID-19 Summer 2020, Fall 2020, and Winter 2021 Supplement PUFs that meet certain inclusion criteria.
Questions are included in the MCBS COVID-19 Data Tool if the question received enough valid responses to produce a reliable estimate. Read more about MCBS analytical guidance in the user tutorials.
Responses are included in estimated percentages for a particular question if a valid response was recorded for that survey respondent. For more information on valid responses, see the glossary and tables of preliminary estimates in the Summer 2020 Infographic Methodology, Fall 2020 Infographic Methodology, and Winter 2021 Infographic Methodology.
Several measures included in the dashboards are created using derived variables. These derived variables combine information from one or more variables available in the MCBS COVID-19 Supplement PUFs:
Washed hands/used hand sanitizer: Respondents were asked whether they have practiced different behaviors in response to the COVID-19 pandemic. Responses to “Washed hands for 20 seconds with soap and water” and “Used hand sanitizer” were collapsed into a single measure. A “yes” response to either behavior is considered a “yes” response in the derived variable.
Purchased extra food/supplies/medicines: Respondents were asked whether they have practiced different behaviors in response to the COVID-19 pandemic. “Purchased extra food,” “Purchased extra cleaning supplies,” and “Purchased or picked up extra prescription medicines beyond usual purchases” were collapsed into a single measure. A “yes” response to any of the three behaviors is considered a “yes” response in the derived variable.
Number of Chronic Conditions: Respondents were asked whether they have ever had any of the following conditions: Alzheimer’s/dementia, any heart condition, cancer (non-skin), hypertension/high blood pressure, diabetes/high blood sugar, any arthritis, stroke/brain hemorrhage, emphysema/asthma/chronic obstructive pulmonary disease (COPD), depression, high cholesterol, osteoporosis/soft bones. Responses were combined to calculate the total number of listed conditions.
Dual Eligible Status: Beneficiaries who are either eligible for partial Medicaid as non-Qualified Medicare Beneficiary (non-QMB) or eligible for partial Medicaid as a Qualified Medicare Beneficiary (QMB) were collapsed into a single category, “Partial-Benefit Dual Eligible.”
Forgone Care: Types of forgone care that did not meet suppression criteria were collapsed into a single “Other types of care” category in the Forgone Care dashboards. For Fall 2020, “Other types of care” includes “urgent care for an accident or illness” and “hearing care”. For Winter 2021, “Other types of care” includes “urgent care for an accident or illness”, “hearing care”, and “mental health care”.
Likelihood of COVID-19 Vaccine Uptake: Respondents were asked if they would get a COVID-19 vaccine if one were available. Responses of “Definitely” and “Probably” were collapsed into a single category, “Definitely or Probably”. Responses of “Definitely Not” and “Probably Not” were also collapsed into a single category, “Definitely Not or Probably Not”.
Reasons for Not Getting COVID-19 Vaccines:
Perceptions of Severity of COVID-19: Respondents were asked whether they agreed with the following statements: “Coronavirus is more contagious than the flu”; “Coronavirus is more deadly than the flu”; “It is important for everyone to take precautions to prevent the spread of the Coronavirus, even if they are not in a high-risk group”. Examples of high-risk groups include elderly or chronically ill individuals. For the three severity measures, responses of “Strongly Agree” were collapsed under “Agree”.
Questions on vaccine uptake and beneficiaries’ perceptions of COVID-19 were added starting with the COVID-19 Fall 2020 Community Supplement. As such, the COVID-19 Vaccines and Perceptions of COVID-19 Severity dashboards are not available for Summer 2020. In addition, the questions on COVID-19 vaccine uptake were updated between the Fall 2020 and Winter 2021 Community Supplements:
In addition, the reference period for select items changed between supplements, including items asking about: COVID-19 preventive health behaviors, the impact of COVID-19 on daily life, experiences with forgone care, availability and utilization of telemedicine, participation in video/voice calls, and the impact of COVID-19 on well-being. The COVID-19 Summer 2020 Community Supplement used a reference period of “since the coronavirus pandemic began”, the COVID-19 Fall 2020 Community Supplement used a reference period of “since July 1, 2020”, and the COVID-19 Winter 2021 Community Supplement used a reference period of “since November 1, 2020” for most items.
Percentage estimates are calculated using the survey weights supplied in the PUF. Variance estimates (which are needed to derive standard errors and confidence intervals) are calculated using replicate weights supplied in the file. See documentation for MCBS weights.
Within the dashboard, the confidence intervals within each dot plot are adjusted using the Goldstein-Healy method as described in:
Wright, Tommy, Martin Klein, and Jerzy Wieczorek. “A Primer on Visualizations for Comparing Populations, Including the Issue of Overlapping Confidence Intervals.” The American Statistician 73, no. 2 (2019): 165-178. DOI: 10.1080/00031305.2017.1392359
To link to this article: https://doi.org/10.1080/00031305.2017.1392359
This adjustment is done so that the confidence intervals can be readily used to determine if two estimates within a chart are, statistically speaking, different (see the use of confidence intervals to compare groups).
The MCBS COVID-19 Data Tool was created using R Shiny and D3.js.
Each dashboard consists of a bar chart presenting outcome variables related to a theme. For example, the dashboard on Preventive Behaviors shows the percent of beneficiaries who have changed their behavior in response to COVID-19. The dashboard also shows a series of dot plots which dynamically update to show the demographic breakdown of responses for a particular behavior.
Select the text “Click here to learn more” to open a drop-down box with instructions and a link to the methodology.
Click on a single bar within the bar chart to see how that topic differs within each group displayed in the dot plots. The dot plots include confidence intervals which can be used to identify potential meaningful differences.
Clicking on a bar in the bar chart on the left adjusts the universe of respondents in the dot plots on the right. For example, clicking on the bar corresponding to “Wore a facemask” in the Preventive Behaviors dashboard updates the universe of respondents in the dot plots to all respondents who had a valid response to the question: “Have you worn a facemask when out in public in response to the outbreak of COVID-19?”
Click on the time period (e.g., Winter 2021) in the dashboard description to change the data source. The Summer 2020 option shows data collected between June-July 2020, the Fall 2020 option shows data collected between October-November 2020, and the Winter 2021 option shows data collected between March-April 2021.
Toggle between the Demographics and Health tabs on the right to see how topics differ by beneficiary characteristics. The Demographics tab includes breakdowns by different demographic variables such as Sex, Age, and Total Household Income. The Health tab includes breakdowns by different health factors such as Current Smoker and Chronic Conditions.
Scales on the dot plots are dynamic. Estimates should only be compared within groups in the dot plots, not across. For example, the “Male” group should not be compared to the “75+ years” group.
Hovering over a particular bar or dot in the tool allows users to view additional details about that particular question and the survey responses. For example, hovering over the bar corresponding to “Worn a facemask” in the Preventive Behaviors dashboard will provide the following information: “% of Medicare beneficiaries responded ‘yes’ to the question: Have you worn a facemask when out in public in response to the outbreak of COVID-19?”
Users can perform statistical hypothesis tests (p = 0.05) to determine if there is a meaningful difference between two percentages within a chart. The width of the intervals indicates the measure of uncertainty in the estimates.
Given the method used to construct the confidence intervals (see note in the Methodology section), if two confidence intervals within a chart overlap, then there is no meaningful difference between the percentages for those two groups. However, if two confidence intervals within a chart do not overlap, then there is a meaningful difference between the percentages for those two groups.
Confidence intervals are adjusted for direct comparison across groups; the confidence interval associated with each demographic group does NOT represent a univariate confidence interval for that group’s proportion. Confidence intervals should not be interpreted for a single demographic group, only used for hypothesis tests of differences between groups. However, the width of the confidence interval does provide a visual sense of the uncertainty of the estimate. All conclusions should be verified through appropriate analysis of the data.
For more information, contact us.