A summary description of the analyses that contribute to the reported measures for MA & PDP CAHPS can be found here. MA & PDP CAHPS data are analyzed using the CAHPS Macro, Version 5.0. Visit Analyzing CAHPS Survey Data to download the 5.0 version of AHRQ’s CAHPS macro with test modules as well as updated instructions for the program.
Slides describing the scoring of composite measures for the MA & PDP CAHPS Survey can be found here.
MA & PDP CAHPS Survey results are adjusted for certain respondent characteristics not under the control of the health or drug plan but related to the sampled member's survey responses. Case-mix adjustment is performed by CMS contractors. The case-mix coefficients are used for Star Ratings and re-estimated each year based on new data. For example, the case-mix coefficients for 2024 Star Ratings were estimated from CAHPS data collected in 2023. Case-mix coefficients are publicly available in the Medicare Part C & D Star Ratings Technical Notes. Instructions on the use of case-mix coefficients and national means for MA & PDP CAHPS can be found here. In addition, the zipped folder “2023 Information on Case-Mix, Case-mix Coefficients and National Means” contains the spreadsheet “2023_example.xlsx”, which may be used as a template for case-mix adjustment. This spreadsheet includes an example of the calculation of the adjustment for a specific measure (Rating of Care) for a fictitious contract. Case-mix coefficients and national means are taken from other files included in the zipped folder. Specifically, case-mix coefficients are taken from the table in the file named “ma_coef_2023_final.xlsx”, and national means are taken from the table in the file named “ma_means_2023_final.xlsx”. An analogous set of files is included in the zipped folder for 2021.
The variables used as case-mix adjustors for the MA & PDP CAHPS Survey since 1998 can be found here.
Additional detail on weighting of MA & PDP CAHPS measures within contracts can be found here.
Reliability is a measure of how well the score for a contract is measured and how well that contract score distinguishes a contract’s performance from that of other contracts. Reliability plays a role in calculating CAHPS Star Ratings and in describing non-star measures in reports to MA and PDP contracts. Reliability is calculated as 1−V/(V+t2), where t2 is the between-contract variance of the means for that measure and V is the sampling variance of the contract’s mean score. The links below contain information that a contract can use to calculate its reliability for each measure. The links to Between-Contract Variances for Reported Measures contain the between-contract variances (t2) for reported measures. Contracts can use the CAHPS Macro (here) to calculate V from their own data. See Training Slides (here) for more information about reliability and how it is used in calculating Star Ratings.
Please use the following citation when referencing material on this website. [www.MA-PDPCAHPS.org] Centers for Medicare & Medicaid Services, Baltimore, MD. Month, Date, Year the page was accessed. www.MA-PDPCAHPS.org.
This page was last modified on 8/4/2023