Development of Questionnaire on Willingness-to-Pay for Health Insurance Cost-Sharing for Catastrophic Prescription Drugs

  • Diesty Anita Nugraheni 1. Doctoral Graduate Program, Faculty of Pharmacy, Universitas Gadjah Mada, Yogyakarta, Indonesia, 55281 2. Department of Pharmacy, Faculty of Mathematics and Natural Sciences, Universitas Islam Indonesia, Yogyakarta, Indonesia, 55584
  • Satibi Satibi Department of Pharmaceutics, Faculty of Pharmacy, Universitas Gadjah Mada, Sekip Utara 55291 Ygyakarta
  • Susi Ari Kristina
  • Diah Ayu Puspandari Department of Health Policy and Management, Faculty of Medicine, Public Health, and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia, 55281
Keywords: Willingness-to-Pay, Content validity, Prescription Drug Cost-Sharing, Health Insurance, Questionnaire


Prescription drug cost-sharing in Indonesia remains challenging because no valid willingness-to-pay (WTP) questionnaire for this cost-sharing is available. The aim of this study was to conduct item selection and evaluate the content validity of the questionnaire on the WTP for prescription drug cost-sharing under the national health insurance scheme in patients with catastrophic illnesses. The method was a cross-sectional study and used a three-step design, namely literature review, consultation with some health economics experts, and evaluation of content validity. This study involved 9 experts, consisting of academicians and health professionals who worked in a hospital, to perform content validation of a questionnaire on the WTP for prescription drug cost-sharing. This study used CVI (content validity index) and CVR (content validity ratio) for both individual item measurement and the overall scale. This study's results reveal a questionnaire comprising 47 items grouped into five domains: healthcare utilization information, participation in health insurance information, drug information, and cost-sharing scenarios. The questionnaire items were extracted from many sources. The items that could be used for the study should have an I-CVI of 0.79-1.00. There were three items removed because of criticisms from the experts and Item-CVI<0.79 and CVR<0.62. Those with Item-CVI>0.79 were revised. The overall scale of the questionnaire was excellent with an S-CVI/Ave of 0.94. We conclude that the questionnaire on the willingness-to-pay for prescription drug cost-sharing was developed and validated through expert consultation, item selection, and CVI. The questionnaire reviewed in this study had good content validity. As a follow-up, a new 42-item questionnaire was developed.


Adams, R., Chou, Y.-J., & Pu, C. (2015). Willingness to participate and Pay for a proposed national health insurance in St. Vincent and the grenadines: A cross-sectional contingent valuation approach. BMC Health Services Research, 15, 148.
Adebayo, E. F., Uthman, O. A., Wiysonge, C. S., Stern, E. A., Lamont, K. T., & Ataguba, J. E. (2015). A systematic review of factors that affect uptake of community-based health insurance in low-income and middle-income countries. BMC Health Services Research, 15(1).
Agustina, R., Dartanto, T., Sitompul, R., Susiloretni, K. A., Suparmi, Achadi, E. L., Taher, A., Wirawan, F., Sungkar, S., Sudarmono, P., Shankar, A. H., Thabrany, H., Agustina, R., Dartanto, T., Sitompul, R., Susiloretni, K. A., Suparmi, Achadi, E. L., Taher, A., … Khusun, H. (2019). Universal health coverage in Indonesia: Concept, progress, and challenges. The Lancet, 393(10166), 75–102.
Akwaowo, C. D., Umoh, I., Motilewa, O., Akpan, B., Umoh, E., Frank, E., Nna, E., Okeke, U., & Onwujekwe, O. E. (2021). Willingness to Pay for a Contributory Social Health Insurance Scheme: A Survey of Rural Residents in Akwa Ibom State, Nigeria. Frontiers in Public Health, 9, 654362.
Ayre, C., & Scally, A. J. (2014). Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86.
Baker, C. L., Bruno, M., Grant, L., Johnson, C., Bennett, B., Brohan, E., & Emir, B. (2017). Content Validity of a Willingness to Quit Tool for Use with Current Smokers in Clinical Practice. Advances in Therapy, 34(10), 2295–2306.
Breidert, C. (2005). EPub WU Institutional Repository Estimation of Willingness-to-Pay Theory , Measurement , and. Library, April.
Chanie, M. G., & Ewunetie, G. E. (2020). Determinants of enrollment in community based health insurance among Households in Tach-Armachiho Woreda, North Gondar, Ethiopia, 2019. PLoS ONE, 15(8 August). Scopus.
Chiwaridzo, M., Chikasha, T. N., Naidoo, N., Dambi, J. M., Tadyanemhandu, C., Munambah, N., & Chizanga, P. T. (2017). Content validity and test-retest reliability of a low back pain questionnaire in Zimbabwean adolescents. Archives of Physiotherapy, 7(1), 3.
Darmawan, K. H., Satibi, S., & Kristina, S. A. (2019). Willingness To Pay for Social Health Insurance and Related Factors Among Population in Yogyakarta Province, Indonesia. International Medical JournaL, 22(April), S787.
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197.
Deksisa, A., Abdo, M., Mohamed, E., Tolesa, D., Garoma, S., Zewdie, A., Lami, M., Irena, D., Abdena, D., & Lemi, H. (2020). Willingness of community based health insurance uptake and associated factors among urban residents of Oromia regional state, Oromia, Ethiopia, a cross-sectional study. BMC Health Services Research, 20(1), 864.
Donfouet, H. P. P., Makaudze, E., Mahieu, P. A., & Malin, E. (2011). The determinants of the willingness-to-pay for community-based prepayment scheme in rural Cameroon. International Journal of Health Care Finance and Economics, 11(3), 209–220.
Fallahzadeh, H., Etesam, F., & Asgarian, F. S. (2015). Validity and reliability related to the Persian version of the Children’s Sleep Habits Questionnaire: Validity of the Persian CHSQ. Sleep and Biological Rhythms, 13(3), 271–278.
Farzanegan, R., Farzanegan, B., Alehashem, M., Zangi, M., Niakan Kalhori, S. R., Sheikhy, K., Emami, H., & Behgam Shadmehr, M. (2017). Item Selection and Content Validity of the Risk Factors of Post-Intubation Tracheal Stenosis Observation Questionnaire for ICU-Admitted Patients. Tanaffos, 16(1), 22–33.
Feng, J., Song, H., & Wang, Z. (2020). The elderly’s response to a patient cost-sharing policy in health insurance: Evidence from China. Journal of Economic Behavior & Organization, 169, 189–207.
Ghosh, S., & Mondal, S. (2011). Morbidity, health expenditure and willingness to pay for health insurance amongst the urban poor: A case study. Journal of Health Management, 13(4), 419–437.
Gidey, M. T., Gebretekle, G. B., Hogan, M.-E., & Fenta, T. G. (2019). Willingness to pay for social health insurance and its determinants among public servants in Mekelle City, Northern Ethiopia: A mixed methods study. Cost Effectiveness and Resource Allocation, 17(1), 2.
Haile, M., Ololo, S., & Megersa, B. (2014). Willingness to join community-based health insurance among rural households of Debub Bench District, Bench Maji Zone, Southwest Ethiopia. BMC Public Health, 14(1), 591.
Hossein, Z., & Gerard, A. (2013). Trends in cost sharing among selected high income countries—2000–2010. Health Policy, 112(1–2), 35–44.
James, C. D., Hanson, K., McPake, B., Balabanova, D., Gwatkin, D., Hopwood, I., Kirunga, C., Knippenberg, R., Meessen, B., Morris, S. S., Preker, A., Souteyrand, Y., Tibouti, A., Villeneuve, P., & Xu, K. (2006). To Retain or Remove User Fees?: Reflections on the Current Debate in Low- and Middle-Income Countries. Applied Health Economics and Health Policy, 5(3), 137–153.
Juengst, S. B., Terhorst, L., Dicianno, B. E., Niemeier, J. P., & Wagner, A. K. (2019). Development and content validity of the behavioral assessment screening tool (BAST β ). Disability and Rehabilitation, 41(10), 1200–1206.
Kado, A., Merga, B. T., Adem, H. A., Dessie, Y., & Geda, B. (2020). Willingness to Pay for Community-Based Health Insurance Scheme and Associated Factors Among Rural Communities in Gemmachis District, Eastern Ethiopia. ClinicoEconomics and Outcomes Research: CEOR, 12, 609–618.
Koohi Rostamkalaee, Z., Jafari, M., & Gorji, H. A. (2022). A systematic review of strategies used for controlling consumer moral hazard in health systems. BMC Health Services Research, 22(1), 1260.
Lavoie Smith, E., Haupt, R., Kelly, J., Lee, D., Kanzawa-Lee, G., Knoerl, R., Bridges, C., Alberti, P., Prasertsri, N., & Donohoe, C. (2017). The Content Validity of a Chemotherapy-Induced Peripheral Neuropathy Patient-Reported Outcome Measure. Oncology Nursing Forum, 44(5), 580–588.
Lawshe, C. H. (1975). A QUANTITATIVE APPROACH TO CONTENT VALIDITY. Personnel Psychology, 28(4), 563–575.
Lynn, M. R. (1986). Determination and Quantification Of Content Validity: Nursing Research, 35(6), 382???386.
Mekonne, A., Seifu, B., Hailu, C., & Atomsa, A. (2020). Willingness to Pay for Social Health Insurance and Associated Factors among Health Care Providers in Addis Ababa, Ethiopia. BioMed Research International, 2020, 1–7.
Minyihun, A., Gebregziabher, M. G., & Gelaw, Y. A. (2019). Willingness to pay for community-based health insurance and associated factors among rural households of Bugna District, Northeast Ethiopia. BMC Research Notes, 12(1), 1–7.
Moghaddam, N. M., Jame, S. Z. B., Rafiei, S., Sarem, A. A., Ghamchili, A., & Shafii, M. (2019). Managerial competencies of head nurses: A model and assessment tool. British Journal of Nursing, 28(1), 30–37.
Mohamad Marzuki, M. F., Yaacob, N. A., & Yaacob, N. M. (2018). Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Human Factors, 5(2), e10308.
Moshki, M., Khajavi, A., Sadeghi-Bazargani, H., Vahedi, S., & Pour-Doulati, S. (2020). Developing Pedestrians’ Red-light Violation Behavior Questionnaire (PRVBQ); Assessment of Content Validity and Reliability. Bulletin of Emergency and Trauma, 8(2), 98–106.
Musgrove, P., Zeramdini, R., & Carrin, G. (2002). Basic patterns in national health expenditure. Bulletin of the World Health Organization, 13.
Najafi, F., & Kheiri, B. (2012). Investigating the Impact of Country of Origin on Customer Behavior: Investigation of the Moderating Roles of Product Involvement and Product Familiarity on Product Evaluation and Customer Behavioral Intentions. Jounal of Marketing Management, 7(17), 37–60.
Nguyen, H. T., & Connelly, L. B. (n.d.). Cost-sharing in health insurance and its impact in a developing country– Evidence from a quasi-natural experiment. 46.
Nosratnejad, S., Rashidian, A., Mehrara, M., Akbari Sari, A., Mahdavi, G., & Moeini, M. (2014). Willingness to pay for the social health insurance in Iran. Global Journal of Health Science, 6(5), 154–163.
O’Donnell, C. A., Burns, N., Mair, F. S., Dowrick, C., Clissmann, C., van den Muijsenbergh, M., van Weel-Baumgarten, E., Lionis, C., Papadakaki, M., Saridaki, A., de Brun, T., & MacFarlane, A. (2016). Reducing the health care burden for marginalised migrants: The potential role for primary care in Europe. Health Policy, 120(5), Article 5.
Park, E., & Choi, S. (2020). Who Benefits from the Fixed Copayment of Medical and Pharmaceutical Expenditure among the Korean Elderly? International Journal of Environmental Research and Public Health, 17(21), 8118.
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497.
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467.
Rascati, K. L. (2009). Essentials of pharmacoeconomics. Lippincott Williams & Wilkins.
Remler, D. K., & Greene, J. (2009). Cost-Sharing: A Blunt Instrument. Annual Review of Public Health, 30(1), 293–311.
Saber, A., Tabatabaei, S. M., Akasheh, G., Sehat, M., Zanjani, Z., & Larijani, B. (2017). Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients. International Journal of Preventive Medicine, 8, 75.
Salampessy, B. H., Alblas, M. M., Portrait, F. R. M., Koolman, X., & Van Der Hijden, E. J. E. (2018). The effect of cost-sharing design characteristics on use of health care recommended by the treating physician; A discrete choice experiment 11 Medical and Health Sciences 1117 Public Health and Health Services 14 Economics 1402 Applied Economics. BMC Health Services Research, 18(1), 1–14.
Sangoseni, O., Hellman, M., & Hill, C. (2013). Development and Validation of a Questionnaire to Assess the Effect of Online Learning on Behaviors, Attitudes, and Clinical Practices of Physical Therapists in the United States Regarding Evidenced-based Clinical Practice. Internet Journal of Allied Health Sciences and Practice.
Seaman, K. L., Sanfilippo, F. M., Roughead, E. E., Bulsara, M. K., Kemp-Casey, A., Bulsara, C., Watts, G. F., & Preen, D. (2017). Impact of consumer copayments for subsidised medicines on health services use and outcomes: A protocol using linked administrative data from Western Australia. BMJ Open, 7(6), e013691.
Thi Thuy Nga, N., FitzGerald, G., & Dunne, M. P. (2018). Family-Based Social Health Insurance for Informal Workers in Vietnam: Willingness to Pay and Its Determinants. Asia-Pacific Journal of Public Health, 30(6), 512–520.
Venkatachalam, L. (2004). The contingent valuation method: A review. Environmental Impact Assessment Review, 24(1), 89–124.
Webber, M. P., & Huxley, P. J. (2007). Measuring access to social capital: The validity and reliability of the Resource Generator-UK and its association with common mental disorder. Social Science & Medicine, 65(3), 481–492.
World Health Organization. (2010). The world health report: Health systems financing: The path to universal coverage: Executive summary.
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54.
How to Cite
Nugraheni, D. A., Satibi, S., Kristina, S. A., & Puspandari, D. A. (2023). Development of Questionnaire on Willingness-to-Pay for Health Insurance Cost-Sharing for Catastrophic Prescription Drugs . Indonesian Journal of Pharmacy.
Research Article