To assess the feasibility of implementing web-based survey administration, CMS implemented a mode experiment to test three web-based modes for the OAS CAHPS Survey (see 82 FR 59216). This mode experiment tested five administration modes with patients who receive outpatient surgical care: mail only, telephone only, web only, web with mail follow-up and web with a telephone follow-up. Data collection was completed in the fall of 2019. Preliminary response rates by mode are: 35% mail-only; 19% phone-only; 29% web-only; 39% web with mail follow-up; and 35% web with telephone follow-up.
As with the earlier mode experiment in 2015, the results of the 2019 mode experiment showed no significant differences based on survey mode. There were, however, slight differences in responses attributable to patient-mix characteristics. The following six patient characteristics were found to be significant predictors: surgery type, overall health, overall mental health, age, education, and relative lag time. 'How well the respondent speaks English' was replaced by 'relative lag time, the other five significant predictors are the same as in the 2015 Mode Experiment. Therefore, these six patient-mix adjustments will be made on OAS CAHPS Survey results that are publicly reported beginning in 2022. No adjustments are needed for mode differences. The patient-mix adjustment coefficients will be updated quarterly as national implementation data are available.