1. Home
  2. Vol 9, No 2 (2023)
  3. Marvianto

Psychometric properties of Mental Health Scale: An Item Response Theory Approach

Ramadhan Dwi Marvianto
(Submitted 1 April 2022)
(Published 31 October 2023)

Abstract


Indonesia Family Life Survey (IFLS) the fifth wave used the Centre for Epidemiological Studies Scale (CES-D10) to measure mental health state, which was depressive symptoms construct. It was primarily used in some studies regarding depressive symptoms. However, there was no specific validation research in the Indonesian context. Thus, this study aimed to (1) investigate the item quality of depressive symptom measurement from IFLS fifth wave, (2) measurement precision of this scale, and (3) the measurement invariance based on gender using the IRT approach. This study used data from ILFS-5 in the KP ("Keadaan Psikologis" or Mental Health) section, which was CES-D10 consisting of 10 items and conduct IRT analysis using a 2-PL model. The number of participants from the data was 31,447. CFA analysis resulted a unidimensional model fit for this scale. Moreover, finding showed that this scale had good psychometric properties, including item discrimination, item location, and item fit, except item 5 and item 8. Despite the poor quality for those items, the reliability coefficient, including the items, met a reliable measurement criterion. Also, this scale had much information for assessing medium and severe depressive symptoms. Moreover, the Differential Item Functioning (DIF) analysis indicated that there was no item exhibiting DIF.

Keywords


Depression Scale; IFLS; Psychometrics

Full Text: PDF

DOI: 10.22146/gamajop.73878

References


Andresen, E. M., Malmgren, J. A., Carter, W. B., & Patrick, D. L. (1994). Screening for Depression in Well Older Adults: Evaluation of a Short Form of the CES-D. American Journal of Preventive Medicine, 10(2), 77–84. https://doi.org/https://doi.org/10.1016/S0749-3797(18)30622-6 Astutik, E., Hidajah, A. C., Tama, T. D., Efendi, F., & Li, C. Y. (2021). Prevalence and determinants of depressive symptoms among adults in Indonesia: A cross-sectional population-based national survey. Nursing Forum, 56(1), 37–44. https://doi.org/10.1111/nuf.12508 Ayala, R. J. de. (2009). The theory and practice of item response theory. New York: The Guilford Press. Ayis, S. A., Ayerbe, L., Ashworth, M., & DA Wolfe, C. (2018). Evaluation of the Hospital Anxiety and Depression Scale (HADS) in screening stroke patients for symptoms: Item Response Theory (IRT) analysis. Journal of Affective Disorders, 228(November 2017), 33–40. https://doi.org/10.1016/j.jad.2017.11.037 Baker, F. (2001). The basics of item response theory. College Park, MD: ERIC Clearinghouse on Assessment and Evaluation. Retrieved from http://eric.ed.gov/ERICWebPortal/recordDetail?accno=ED458219%5Cnpapers2://public ation/uuid/53C840DD-C92B-4719-8EC3-AF2076EDCAB3 Baron, E. C., Davies, T., & Lund, C. (2017). Validation of the 10-item Centre for Epidemiological Studies Depression Scale (CES-D-10) in Zulu, Xhosa and Afrikaans populations in South Africa. BMC Psychiatry, 17(1), 1–14. https://doi.org/10.1186/s12888-016-1178-x Berk, R. A. (2006). Thirteen Strategies to Measure College Teaching. Virginia: Stylus Publishing. Björgvinsson, T., Kertz, S. J., Bigda-Peyton, J. S., McCoy, K. L., & Aderka, I. M. (2013). Psychometric Properties of the CES-D-10 in a Psychiatric Sample. Assessment, 20(4), 429–436. https://doi.org/10.1177/1073191113481998 Boey, K. W. (1999). Cross-validation of a short form of the CES-D in Chinese elderly. International Journal of Geriatric Psychiatry, 14(8), 608–617. https://doi.org/10.1002/(SICI)1099-1166(199908)14:83.0.CO;2-Z Bradley, K. L., Bagnell, A. L., & Brannen, C. L. (2010). Factorial validity of the center for epidemiological studies depression 10 in adolescents. Issues in Mental Health Nursing, 31(6), 408–412. https://doi.org/10.3109/01612840903484105 Brown, A., & Croudace, T. J. (2015). Scoring and estimating score precision using multidimensional IRT1. In Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment (a volume in the Multivariate Applications Series) (pp. 307–333). New York: Routledge. Cao, J., & Rammohan, A. (2016). Social capital and healthy ageing in Indonesia. BMC Public Health, 16(1), 1–14. https://doi.org/10.1186/s12889-016-3257-9 Chalmers, R. P. (2012). {mirt}: A Multidimensional Item Response Theory Package for the {R} Environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06 Cheng, S. T., Chan, A. C. M., & Fung, H. H. (2006). Factorial structure of a short version of the Center for Epidemiologic Studies Depression Scale. International Journal of Geriatric Psychiatry, 21(4), 333–336. https://doi.org/10.1002/gps.1467 Chiesi, F., Primi, C., Pigliautile, M., Ercolani, S., della Staffa, M. C., Longo, A., ... Mecocci, P. (2017). The local reliability of the 15-item version of the Geriatric Depression Scale: An item response theory (IRT) study. Journal of Psychosomatic Research, 96(December 2016), 84–88. https://doi.org/10.1016/j.jpsychores.2017.03.013 Diener, E., & Emmons, R. A. (1984). The independence of positive and negative affect. Journal of Personality and Social Psychology, 47(5), 1105–1117. https://doi.org/10.1037/0022-3514.47.5.1105 Embretson, S. E. (1985). Test design: Developments in psychology and psychometrics. New York: Academic Press, Inc. Feuerstahler, L. M., Waller, N., & MacDonald, A. (2020). Improving Measurement Precision in Experimental Psychopathology Using Item Response Theory. Educational and Psychological Measurement (Vol. 80). https://doi.org/10.1177/0013164419892049 Furr, M. R., & Bacharach, V. R. (2013). Psychometric: An Introduction (2nd ed.). Amazon: SAGE Publisher. Girgus, J. S., Yang, K., & Ferri, C. V. (2017). The gender difference in depression: Are elderly women at greater risk for depression than elderly men? Geriatrics (Switzerland), 2(4). https://doi.org/10.3390/geriatrics2040035 Giusti, E. M., Jonkman, A., Manzoni, G. M., Castelnuovo, G., Terwee, C. B., Roorda, L. D., & Chiarotto, A. (2020). Proposal for Improvement of the Hospital Anxiety and Depression Scale for the Assessment of Emotional Distress in Patients With Chronic Musculoskeletal Pain: A Bifactor and Item Response Theory Analysis. Journal of Pain, 21(3–4), 375–389. https://doi.org/10.1016/j.jpain.2019.08.003 Gustryanti, K., Thongpat, S., & Maneerat, S. (2017). Factors Relating To Depression Among Older People Living in Cimahi, West Java Province, Indonesia. Belitung Nursing Journal, 3(1), 14–22. https://doi.org/10.33546/bnj.50 Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory Library. Hariyani, N., Bramantoro, T., Nair, R., Singh, A., & Sengupta, K. (2020). Depression symptoms and recurrent aphthous stomatitis—Evidence from a population-based study in Indonesia. Oral Diseases, 26(5), 948–954. https://doi.org/10.1111/odi.13303 Haynes, W. (2013). Bonferroni Correction. In W. Dubitzky, O. Wolkenhauer, K.-H. Cho, & H. Yokota (Eds.), Encyclopedia of Systems Biology (p. 154). New York, NY: Springer New York. https://doi.org/10.1007/978-1-4419-9863-7_1213 Hu, L.-T., & Bentler, P. M. (1998). Fit Indice in Covariance Structure Modeling: Sensitivity to Underparameterized Model Misspecification. Psychological Methdos, 3(4), 424–453. Hussain, M. A., Huxley, R. R., & Al Mamun, A. (2015). Multimorbidity prevalence and pattern in Indonesian adults: An exploratory study using national survey data. BMJ Open, 5(12). https://doi.org/10.1136/bmjopen-2015-009810 Isaura, E. R., Chen, Y. C., Su, H. Y., & Yang, S. H. (2020). The relationship between food security status and sleep disturbance among adults: A cross-sectional study in an indonesian population. Nutrients, 12(11), 1–13. https://doi.org/10.3390/nu12113411 Iwata, N., Umesue, M., Egashira, K., Hiro, H., Mizoue, T., Mishima, N., & Nagata, S. (1998). Can positive affect items be used to assess depressive disorders in the Japanese population? Psychological Medicine, 28(1), 153–158. https://doi.org/10.1017/S0033291797005898 Kang, T., & Chen, T. T. (2007). An Investigation of the Performance of Generalized S-X2 Item- Fit Index for Polytomous IRT Models. ACT Research Report Series (Vol. 1). Kashiwagi, S., Tamiya, N., & Sandoval, F. (2016). Factors Associated with Depression amongst Family Caregivers Involved in Care for Community-dwelling Persons of Middle Age and Older: Based on Data from Indonesia Family Life Survey. Public Policy and Administration Research, 6(5), 24–32. Retrieved from www.iiste.org Kim, S., & Feldt, L. S. (2010). The estimation of the IRT reliability coefficient and its lower and upper bounds, with comparisons to CTT reliability statistics. Asia Pacific Education Review, 11(2), 179–188. https://doi.org/10.1007/s12564-009-9062-8 Lee, A. E. Y., & Chokkanathan, S. (2008). Factor structure of the 10-item CES-D scale among community dwelling older adults in Singapore. International Journal of Geriatric Psychiatry, 23(6), 592–597. https://doi.org/10.1002/gps.1944 Leung, J., Gouda, H., Chung, J. Y. C., & Irmansyah, I. (2021). Comorbidity between depressive symptoms and chronic conditions – findings from the Indonesia Family Life Survey. Journal of Affective Disorders, 280, 236–240. https://doi.org/10.1016/j.jad.2020.11.007 Liew, H. P., & Gardner, S. (2016). The interrelationship between smoking and depression in Indonesia. Health Policy and Technology, 5(1), 26–31. https://doi.org/10.1016/j.hlpt.2015.10.003 Liu, Q., He, H., Yang, J., Feng, X., Zhao, F., & Lyu, J. (2020). Changes in the global burden of depression from 1990 to 2017: Findings from the Global Burden of Disease study. Journal of Psychiatric Research, 126(June 2019), 134–140. https://doi.org/10.1016/j.jpsychires.2019.08.002 MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037/1082-989X.1.2.130 Mahwati, Y. (2017). The Relationship between Spirituality and Depression Among the Elderly in Indonesia. Makara Journal of Health Research, 21(1), 13–19. https://doi.org/10.7454/msk.v21i1.6206 Nazroo, J. Y., Edwards, A. C., & Brown, G. W. (1998). Gender differences in the prevalence of depression: Artefact, alternative disorders, biology or roles? Sociology of Health and Illness, 20(3), 312–330. https://doi.org/10.1111/1467-9566.00104 Nunnally, J. C., & Bernstein, I. H. (1994). Psychometrics Theory (third edit). McGraw-Hill. https://doi.org/10.1007/978-1-4020-9173-5_8 Olino, T. M., Yu, L., Klein, D. N., Rohde, P., Seeley, J. R., Pilkoinis, P. A., & Lewinsohn, P. M. (2008). Measuring depression using item response theory: an examination of three measures of depressive symptomatology. International Journal of Methods in Psychiatric Research, 21(1), 76–85. https://doi.org/10.1002/mpr.1348 Peltzer, K., & Pengpid, S. (2018). High prevalence of depressive symptoms in a national sample of adults in Indonesia: Childhood adversity, sociodemographic factors and health risk behaviour. Asian Journal of Psychiatry, 33(December 2017), 52–59. https://doi.org/10.1016/j.ajp.2018.03.017 Pengpid, S., Peltzer, K., & Susilowati, I. H. (2019). Cognitive Functioning and Associated Factors in Older Adults: Results from the Indonesian Family Life Survey-5 (IFLS-5) in 2014-2015. Current Gerontology and Geriatrics Research, 2019, 23–25. https://doi.org/10.1155/2019/4527647 Purborini, N., Lee, M. B., Devi, H. M., & Chang, H. J. (2021). Associated factors of depression among young adults in Indonesia: A population-based longitudinal study. Journal of the Formosan Medical Association, (xxxx). https://doi.org/10.1016/j.jfma.2021.01.016 R Core Team. (2020). R: A Language and Environment for Statistical Computing. Vienna, Austria. Retrieved from https://www.r-project.org/ RAND. (2021a). Indonesian Family Life Survey (IFLS) Data and Documentation | RAND. Retrieved March 19, 2021, from https://www.rand.org/well-being/social-and-behavioral- policy/data/FLS/IFLS/download.html RAND. (2021b). RAND Indonesian Family Life Survey (IFLS) | RAND. Retrieved March 19, 2021, from https://www.rand.org/well-being/social-and-behavioral- policy/data/FLS/IFLS.html Rigdon, E. E. (1996). CFI versus RMSEA: A comparison of two fit indexes for structural equation modeling. Structural Equation Modeling, 3(4), 369–379. https://doi.org/10.1080/10705519609540052 Rizopoulos, D. (2006). ltm : An R Package for Latent Variable Modeling. Journal Of Statistical Software, 17(5). Roadolff, L. S. (1977). The CES-D scale: a self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401. Rosseel, Y. (2012). {lavaan}: An {R} Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. Retrieved from http://www.jstatsoft.org/v48/i02/ Schroevers, M. J., Sanderman, R., Van Sonderen, E., & Ranchor, A. V. (2000). The evaluation of the Center for Epidemiologic Studies Depression (CES-D) scale: Depressed and Positive Affect in cancer patients and healthy reference subjects. Quality of Life Research, 9(9), 1015–1029. https://doi.org/10.1023/A:1016673003237 Stommel, M., Given, B. A., Given, C. W., Kalaian, H. A., Schulz, R., & McCorkle, R. (1993). Gender bias in the measurement properties of the center for epidemiologic studies depression scale (CES-D). Psychiatry Research, 49(3), 239–250. https://doi.org/10.1016/0165-1781(93)90064-N Strauss, J., Beegle, K., Sikoki, B., Dwiyanto, A., Herwati, Y., Witoelar, F., & Corporation, R. (2016). The 5th Wave of the Indonesia Family Life Survey (IFLS): Overview and Field Report. Retrieved from http://www.rand.org/content/dam/rand/pubs/working_papers/WR1100/WR1143z2/RAN D_WR1143z2.pdf Univeristy of Washington. (2021). GBD Results Tool | GHDx. Retrieved March 29, 2021, from http://ghdx.healthdata.org/gbd-results-tool Widhowati, S. S., Chen, C. M., Chang, L. H., Lee, C. K., & Fetzer, S. (2020). Living alone, loneliness, and depressive symptoms among Indonesian older women. Health Care for Women International, 41(9), 984–996. https://doi.org/10.1080/07399332.2020.1797039 World Health Organization. (2017). Depression and other common mental disorders: Global health estimates. Geneva: World Health Organization. Retrieved from https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2- eng.pdf Wu, H., Fai Cheung, S., & On Leung, S. (2019). Simple use of BIC to Assess Model Selection Uncertainty: An Illustration using Mediation and Moderation Models. Multivariate Behavioral Research, 55(1), 1–16. https://doi.org/10.1080/00273171.2019.1574546 Yuniati, F., & Kamso, S. (2020). Assessing the Quality of Life Among Productive Age in the General Population: A Cross-Sectional Study of Family Life Survey in Indonesia. Asia- Pacific Journal of Public Health. https://doi.org/10.1177/1010539520956411 Zhang, W., O’Brien, N., Forrest, J. I., Salters, K. A., Patterson, T. L., Montaner, J. S. G., ... Lima, V. D. (2012). Validating a shortened depression scale (10 item CES-D) among HIV-Positive people in British Columbia, Canada. PLoS ONE, 7(7), 1–5. https://doi.org/10.1371/journal.pone.0040793


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Gadjah Mada Journal of Psychology (GamaJoP)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.