Scoring and Star Ratings
MA & PDP CAHPS Survey results are adjusted for certain respondent characteristics not under the control of the health or drug plan but related to the sampled member's survey responses. Case-mix adjustment is performed by CMS contractors. The case-mix coefficients are re-estimated each year based on new data and are used for Star Ratings. For example, the case-mix coefficients for 2020 Star Ratings were estimated from CAHPS data collected in 2019. Case-mix coefficients are publicly available in the Medicare Part C & D Star Ratings Technical Notes.
The variables used as case-mix adjustors for the MA & PDP CAHPS Survey since 1998 can be found here.
Slides describing the scoring of composite measures for the MA & PDP CAHPS Survey can be found here.
Between-contract variances for reported measures are available since 2019.
Additional detail on weighting of MA & PDP CAHPS measures within contracts can be found here.
Information on construction of individual-level weights in MA & PDP CAHPS can be found here.
Unit response rates followed patterns typical for health surveys (Klein et al., 2011), including higher response rates for non-Hispanic whites than for other racial/ethnic subgroups, better response rates through age 79, and lower response rates for low-income beneficiaries. All analyses used individual-level poststratification weights that account for sample design and nonresponse (Deming and Stephan, 1940; Purcell and Kish, 1980) by matching weighted sample and enrollment populations in each Medicare contract-by-county combination on demographic characteristics, Medicaid eligibility/low-income subsidy enrollment status, enrollment in a Special Needs Plan, and zip-code level distributions of income, education, and race/ethnicity.
Klein DJ, Elliott MN, Haviland AM, et al. Understanding nonresponse to the 2007 Medicare CAHPS survey. Gerontologist. 2011; 51: 843–855.
Deming WE, Stephan FF. On a least squares adjustment of a sampled frequency table when the expected marginal tools are known. Ann Math Stat. 1940; 11: 427–444.
Purcell NJ, Kish L. Postcensal estimates for local areas (or domains). Int Stat Rev. 1980; 48: 3–18.
Official scoring of Medicare CAHPS is linear mean scoring. A summary that compares linear mean scoring with top-box scoring for Medicare CAHPS measures can be found here. The summary includes median reliabilities for Medicare Advantage contracts calculated from 2017 CAHPS data.
Please use the following citation when referencing material on this web site. [www.MA-PDPCAHPS.org] Centers for Medicare & Medicaid Services, Baltimore, MD. Month, Date, Year the page was accessed. www.MA-PDPCAHPS.org.
This page was last modified on 3/13/2020