Development of Willingness-to-Pay Questionnaire on Health Insurance Cost-Sharing for Catastrophic Prescription Drugs: A Content Validity and Reliability Assessment
Abstract
Prescription drug cost-sharing in Indonesia remains challenging because no valid willingness-to-pay (WTP) questionnaire for this cost-sharing is available. The aim of this study was to conduct item selection and evaluate the content validity of the questionnaire on the WTP for prescription drug cost-sharing under the national health insurance scheme in patients with catastrophic illnesses. The method was a cross-sectional study and used a three-step design, namely literature review, consultation with some health economics experts, and evaluation of content validity. This study involved 9 experts, consisting of academicians and health professionals who worked in a hospital, to perform content validation of a questionnaire on the WTP for prescription drug cost-sharing. This study used CVI (content validity index) and CVR (content validity ratio) for both individual item measurement and the overall scale. This study's results reveal a questionnaire comprising 47 items grouped into five domains: healthcare utilization information, participation in health insurance information, drug information, and cost-sharing scenarios. The questionnaire items were extracted from many sources. The items that could be used for the study should have an I-CVI of 0.79-1.00. There were three items removed because of criticisms from the experts and Item-CVI<0.79 and CVR<0.62. Those with Item-CVI>0.79 were revised. The overall scale of the questionnaire was excellent with an S-CVI/Ave of 0.94. We conclude that the questionnaire on the willingness-to-pay for prescription drug cost-sharing was developed and validated through expert consultation, item selection, and CVI. The questionnaire reviewed in this study had good content validity. As a follow-up, a new 42-item questionnaire was developed.
References
Adebayo, E. F., Uthman, O. A., Wiysonge, C. S., Stern, E. A., Lamont, K. T., & Ataguba, J. E. (2015). A systematic review of factors that affect uptake of community-based health insurance in low-income and middle-income countries. BMC Health Services Research, 15(1). https://doi.org/10.1186/s12913-015-1179-3
Agustina, R., Dartanto, T., Sitompul, R., Susiloretni, K. A., Suparmi, Achadi, E. L., Taher, A., Wirawan, F., Sungkar, S., Sudarmono, P., Shankar, A. H., Thabrany, H., Agustina, R., Dartanto, T., Sitompul, R., Susiloretni, K. A., Suparmi, Achadi, E. L., Taher, A., … Khusun, H. (2019). Universal health coverage in Indonesia: Concept, progress, and challenges. The Lancet, 393(10166), 75–102. https://doi.org/10.1016/S0140-6736(18)31647-7
Akwaowo, C. D., Umoh, I., Motilewa, O., Akpan, B., Umoh, E., Frank, E., Nna, E., Okeke, U., & Onwujekwe, O. E. (2021). Willingness to Pay for a Contributory Social Health Insurance Scheme: A Survey of Rural Residents in Akwa Ibom State, Nigeria. Frontiers in Public Health, 9, 654362. https://doi.org/10.3389/fpubh.2021.654362
Ayre, C., & Scally, A. J. (2014). Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86. https://doi.org/10.1177/0748175613513808
Baker, C. L., Bruno, M., Grant, L., Johnson, C., Bennett, B., Brohan, E., & Emir, B. (2017). Content Validity of a Willingness to Quit Tool for Use with Current Smokers in Clinical Practice. Advances in Therapy, 34(10), 2295–2306. https://doi.org/10.1007/s12325-017-0611-y
Breidert, C. (2005). EPub WU Institutional Repository Estimation of Willingness-to-Pay Theory , Measurement , and. Library, April.
Chanie, M. G., & Ewunetie, G. E. (2020). Determinants of enrollment in community based health insurance among Households in Tach-Armachiho Woreda, North Gondar, Ethiopia, 2019. PLoS ONE, 15(8 August). Scopus. https://doi.org/10.1371/journal.pone.0236027
Chiwaridzo, M., Chikasha, T. N., Naidoo, N., Dambi, J. M., Tadyanemhandu, C., Munambah, N., & Chizanga, P. T. (2017). Content validity and test-retest reliability of a low back pain questionnaire in Zimbabwean adolescents. Archives of Physiotherapy, 7(1), 3. https://doi.org/10.1186/s40945-017-0031-y
Darmawan, K. H., Satibi, S., & Kristina, S. A. (2019). Willingness To Pay for Social Health Insurance and Related Factors Among Population in Yogyakarta Province, Indonesia. International Medical JournaL, 22(April), S787. https://doi.org/10.1016/j.jval.2019.09.2053
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4
Deksisa, A., Abdo, M., Mohamed, E., Tolesa, D., Garoma, S., Zewdie, A., Lami, M., Irena, D., Abdena, D., & Lemi, H. (2020). Willingness of community based health insurance uptake and associated factors among urban residents of Oromia regional state, Oromia, Ethiopia, a cross-sectional study. BMC Health Services Research, 20(1), 864. https://doi.org/10.1186/s12913-020-05583-x
Donfouet, H. P. P., Makaudze, E., Mahieu, P. A., & Malin, E. (2011). The determinants of the willingness-to-pay for community-based prepayment scheme in rural Cameroon. International Journal of Health Care Finance and Economics, 11(3), 209–220. https://doi.org/10.1007/s10754-011-9097-3
Fallahzadeh, H., Etesam, F., & Asgarian, F. S. (2015). Validity and reliability related to the Persian version of the Children’s Sleep Habits Questionnaire: Validity of the Persian CHSQ. Sleep and Biological Rhythms, 13(3), 271–278. https://doi.org/10.1111/sbr.12114
Farzanegan, R., Farzanegan, B., Alehashem, M., Zangi, M., Niakan Kalhori, S. R., Sheikhy, K., Emami, H., & Behgam Shadmehr, M. (2017). Item Selection and Content Validity of the Risk Factors of Post-Intubation Tracheal Stenosis Observation Questionnaire for ICU-Admitted Patients. Tanaffos, 16(1), 22–33.
Feng, J., Song, H., & Wang, Z. (2020). The elderly’s response to a patient cost-sharing policy in health insurance: Evidence from China. Journal of Economic Behavior & Organization, 169, 189–207. https://doi.org/10.1016/j.jebo.2019.11.009
Ghosh, S., & Mondal, S. (2011). Morbidity, health expenditure and willingness to pay for health insurance amongst the urban poor: A case study. Journal of Health Management, 13(4), 419–437. https://doi.org/10.1177/097206341101300404
Gidey, M. T., Gebretekle, G. B., Hogan, M.-E., & Fenta, T. G. (2019). Willingness to pay for social health insurance and its determinants among public servants in Mekelle City, Northern Ethiopia: A mixed methods study. Cost Effectiveness and Resource Allocation, 17(1), 2. https://doi.org/10.1186/s12962-019-0171-x
Haile, M., Ololo, S., & Megersa, B. (2014). Willingness to join community-based health insurance among rural households of Debub Bench District, Bench Maji Zone, Southwest Ethiopia. BMC Public Health, 14(1), 591. https://doi.org/10.1186/1471-2458-14-591
Hossein, Z., & Gerard, A. (2013). Trends in cost sharing among selected high income countries—2000–2010. Health Policy, 112(1–2), 35–44. https://doi.org/10.1016/j.healthpol.2013.05.020
James, C. D., Hanson, K., McPake, B., Balabanova, D., Gwatkin, D., Hopwood, I., Kirunga, C., Knippenberg, R., Meessen, B., Morris, S. S., Preker, A., Souteyrand, Y., Tibouti, A., Villeneuve, P., & Xu, K. (2006). To Retain or Remove User Fees?: Reflections on the Current Debate in Low- and Middle-Income Countries. Applied Health Economics and Health Policy, 5(3), 137–153. https://doi.org/10.2165/00148365-200605030-00001
Juengst, S. B., Terhorst, L., Dicianno, B. E., Niemeier, J. P., & Wagner, A. K. (2019). Development and content validity of the behavioral assessment screening tool (BAST β ). Disability and Rehabilitation, 41(10), 1200–1206. https://doi.org/10.1080/09638288.2017.1423403
Kado, A., Merga, B. T., Adem, H. A., Dessie, Y., & Geda, B. (2020). Willingness to Pay for Community-Based Health Insurance Scheme and Associated Factors Among Rural Communities in Gemmachis District, Eastern Ethiopia. ClinicoEconomics and Outcomes Research: CEOR, 12, 609–618. https://doi.org/10.2147/CEOR.S266497
Koohi Rostamkalaee, Z., Jafari, M., & Gorji, H. A. (2022). A systematic review of strategies used for controlling consumer moral hazard in health systems. BMC Health Services Research, 22(1), 1260. https://doi.org/10.1186/s12913-022-08613-y
Lavoie Smith, E., Haupt, R., Kelly, J., Lee, D., Kanzawa-Lee, G., Knoerl, R., Bridges, C., Alberti, P., Prasertsri, N., & Donohoe, C. (2017). The Content Validity of a Chemotherapy-Induced Peripheral Neuropathy Patient-Reported Outcome Measure. Oncology Nursing Forum, 44(5), 580–588. https://doi.org/10.1188/17.ONF.580-588
Lawshe, C. H. (1975). A QUANTITATIVE APPROACH TO CONTENT VALIDITY. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Lynn, M. R. (1986). Determination and Quantification Of Content Validity: Nursing Research, 35(6), 382???386. https://doi.org/10.1097/00006199-198611000-00017
Mekonne, A., Seifu, B., Hailu, C., & Atomsa, A. (2020). Willingness to Pay for Social Health Insurance and Associated Factors among Health Care Providers in Addis Ababa, Ethiopia. BioMed Research International, 2020, 1–7. https://doi.org/10.1155/2020/8412957
Minyihun, A., Gebregziabher, M. G., & Gelaw, Y. A. (2019). Willingness to pay for community-based health insurance and associated factors among rural households of Bugna District, Northeast Ethiopia. BMC Research Notes, 12(1), 1–7. https://doi.org/10.1186/s13104-019-4091-9
Moghaddam, N. M., Jame, S. Z. B., Rafiei, S., Sarem, A. A., Ghamchili, A., & Shafii, M. (2019). Managerial competencies of head nurses: A model and assessment tool. British Journal of Nursing, 28(1), 30–37. https://doi.org/10.12968/bjon.2019.28.1.30
Mohamad Marzuki, M. F., Yaacob, N. A., & Yaacob, N. M. (2018). Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Human Factors, 5(2), e10308. https://doi.org/10.2196/10308
Moshki, M., Khajavi, A., Sadeghi-Bazargani, H., Vahedi, S., & Pour-Doulati, S. (2020). Developing Pedestrians’ Red-light Violation Behavior Questionnaire (PRVBQ); Assessment of Content Validity and Reliability. Bulletin of Emergency and Trauma, 8(2), 98–106. https://doi.org/10.30476/BEAT.2020.46449
Musgrove, P., Zeramdini, R., & Carrin, G. (2002). Basic patterns in national health expenditure. Bulletin of the World Health Organization, 13.
Najafi, F., & Kheiri, B. (2012). Investigating the Impact of Country of Origin on Customer Behavior: Investigation of the Moderating Roles of Product Involvement and Product Familiarity on Product Evaluation and Customer Behavioral Intentions. Jounal of Marketing Management, 7(17), 37–60.
Nguyen, H. T., & Connelly, L. B. (n.d.). Cost-sharing in health insurance and its impact in a developing country– Evidence from a quasi-natural experiment. 46.
Nosratnejad, S., Rashidian, A., Mehrara, M., Akbari Sari, A., Mahdavi, G., & Moeini, M. (2014). Willingness to pay for the social health insurance in Iran. Global Journal of Health Science, 6(5), 154–163. https://doi.org/10.5539/gjhs.v6n5p154
O’Donnell, C. A., Burns, N., Mair, F. S., Dowrick, C., Clissmann, C., van den Muijsenbergh, M., van Weel-Baumgarten, E., Lionis, C., Papadakaki, M., Saridaki, A., de Brun, T., & MacFarlane, A. (2016). Reducing the health care burden for marginalised migrants: The potential role for primary care in Europe. Health Policy, 120(5), Article 5. https://doi.org/10.1016/j.healthpol.2016.03.012
Park, E., & Choi, S. (2020). Who Benefits from the Fixed Copayment of Medical and Pharmaceutical Expenditure among the Korean Elderly? International Journal of Environmental Research and Public Health, 17(21), 8118. https://doi.org/10.3390/ijerph17218118
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Rascati, K. L. (2009). Essentials of pharmacoeconomics. Lippincott Williams & Wilkins.
Remler, D. K., & Greene, J. (2009). Cost-Sharing: A Blunt Instrument. Annual Review of Public Health, 30(1), 293–311. https://doi.org/10.1146/annurev.publhealth.29.020907.090804
Saber, A., Tabatabaei, S. M., Akasheh, G., Sehat, M., Zanjani, Z., & Larijani, B. (2017). Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients. International Journal of Preventive Medicine, 8, 75. https://doi.org/10.4103/ijpvm.IJPVM_367_16
Salampessy, B. H., Alblas, M. M., Portrait, F. R. M., Koolman, X., & Van Der Hijden, E. J. E. (2018). The effect of cost-sharing design characteristics on use of health care recommended by the treating physician; A discrete choice experiment 11 Medical and Health Sciences 1117 Public Health and Health Services 14 Economics 1402 Applied Economics. BMC Health Services Research, 18(1), 1–14. https://doi.org/10.1186/s12913-018-3598-4
Sangoseni, O., Hellman, M., & Hill, C. (2013). Development and Validation of a Questionnaire to Assess the Effect of Online Learning on Behaviors, Attitudes, and Clinical Practices of Physical Therapists in the United States Regarding Evidenced-based Clinical Practice. Internet Journal of Allied Health Sciences and Practice. https://doi.org/10.46743/1540-580X/2013.1439
Seaman, K. L., Sanfilippo, F. M., Roughead, E. E., Bulsara, M. K., Kemp-Casey, A., Bulsara, C., Watts, G. F., & Preen, D. (2017). Impact of consumer copayments for subsidised medicines on health services use and outcomes: A protocol using linked administrative data from Western Australia. BMJ Open, 7(6), e013691. https://doi.org/10.1136/bmjopen-2016-013691
Thi Thuy Nga, N., FitzGerald, G., & Dunne, M. P. (2018). Family-Based Social Health Insurance for Informal Workers in Vietnam: Willingness to Pay and Its Determinants. Asia-Pacific Journal of Public Health, 30(6), 512–520. https://doi.org/10.1177/1010539518799785
Venkatachalam, L. (2004). The contingent valuation method: A review. Environmental Impact Assessment Review, 24(1), 89–124. https://doi.org/10.1016/S0195-9255(03)00138-0
Webber, M. P., & Huxley, P. J. (2007). Measuring access to social capital: The validity and reliability of the Resource Generator-UK and its association with common mental disorder. Social Science & Medicine, 65(3), 481–492. https://doi.org/10.1016/j.socscimed.2007.03.030
World Health Organization. (2010). The world health report: Health systems financing: The path to universal coverage: Executive summary.
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6