Psychiatry investigation

  • 제15권11호
  • /
  • Pages.1030-1036
  • /
  • 2018
  • /
  • 1738-3684(pISSN)
  • /
  • 1976-3026(eISSN)
대한신경정신의학회 (Korean Neuropsychiatric Association)
권호 표지
DOI QR코드

DOI QR Code

Use of a Machine Learning Algorithm to Predict Individuals with Suicide Ideation in the General Population

  • Ryu, Seunghyong (Department of Mental Health Research, National Center for Mental Health) ;
  • Lee, Hyeongrae (Department of Mental Health Research, National Center for Mental Health) ;
  • Lee, Dong-Kyun (Department of Mental Health Research, National Center for Mental Health) ;
  • Park, Kyeongwoo (Department of Mental Health Research, National Center for Mental Health)
  • 투고 : 2018.06.24
  • 심사 : 2018.08.27
  • 발행 : 2018.11.30
⟨ 이전 논문 다음 논문 ⟩

초록

Objective In this study, we aimed to develop a model predicting individuals with suicide ideation within a general population using a machine learning algorithm. Methods Among 35,116 individuals aged over 19 years from the Korea National Health & Nutrition Examination Survey, we selected 11,628 individuals via random down-sampling. This included 5,814 suicide ideators and the same number of non-suicide ideators. We randomly assigned the subjects to a training set (n=10,466) and a test set (n=1,162). In the training set, a random forest model was trained with 15 features selected with recursive feature elimination via 10-fold cross validation. Subsequently, the fitted model was used to predict suicide ideators in the test set and among the total of 35,116 subjects. All analyses were conducted in R. Results The prediction model achieved a good performance [area under receiver operating characteristic curve (AUC)=0.85] in the test set and predicted suicide ideators among the total samples with an accuracy of 0.821, sensitivity of 0.836, and specificity of 0.807. Conclusion This study shows the possibility that a machine learning approach can enable screening for suicide risk in the general population. Further work is warranted to increase the accuracy of prediction.

키워드

과제정보

연구 과제 주관 기관 : Korea Health Industry Development Institute (KHIDI)

참고문헌

  1. Statistics Korea. Annual Report on the Cause of Death Statistics 2016. Daejeon: Statistics Korea; 2017.
  2. OECD. OECD Health Statistics 2017. Available at: https://stats.oecd.org/Index.aspx?DataSetCode=HEALTH_STAT. Accessed June 17, 2018.
  3. Kim WJ, Song YJ, Ryu HS, Ryu V, Kim JM, Ha RY, et al. Internalized stigma and its psychosocial correlates in Korean patients with serious mental illness. Psychiatry Res 2015;225:433-439. https://doi.org/10.1016/j.psychres.2014.11.071
  4. Arsenault-Lapierre G, Kim C, Turecki G. Psychiatric diagnoses in 3275 suicides: a meta-analysis. BMC Psychiatry 2004;4:37. https://doi.org/10.1186/1471-244X-4-37
  5. Conwell Y, Duberstein PR, Cox C, Herrmann JH, Forbes NT, Caine ED. Relationships of age and axis I diagnoses in victims of completed suicide: a psychological autopsy study. Am J Psychiatry 1996;153:1001-1008. https://doi.org/10.1176/ajp.153.8.1001
  6. Korea Psychological Autopsy Center. Psychological Autopsy Report. Available at: http://www.mohw.go.kr/react/al/sal0301vw.jsp?PAR_MENU_ID=04&MENU_ID=0403&page=1&CONT_SEQ=344726. Acessed Jun 17, 2018.
  7. Zalsman G, Hawton K, Wasserman D, van Heeringen K, Arensman E, Sarchiapone M, et al. Suicide prevention strategies revisited: 10-year systematic review. Lancet Psychiatry 2016;3:646-659. https://doi.org/10.1016/S2215-0366(16)30030-X
  8. Ministry of Health and Welfare. The Survey of Mental Disorders in Korea 2016. Sejong: Ministry of Health and Welfare; 2017.
  9. Nock MK, Borges G, Bromet EJ, Alonso J, Angermeyer M, Beautrais A, et al. Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry 2008;192:98-105. https://doi.org/10.1192/bjp.bp.107.040113
  10. May AM, Klonsky ED, Klein DN. Predicting future suicide attempts among depressed suicide ideators: a 10-year longitudinal study. J Psychiatr Res 2012;46:946-952. https://doi.org/10.1016/j.jpsychires.2012.04.009
  11. Miranda R, Ortin A, Scott M, Shaffer D. Characteristics of suicidal ideation that predict the transition to future suicide attempts in adolescents. J Child Psychol Psychiatry 2014;55:1288-1296. https://doi.org/10.1111/jcpp.12245
  12. Chellappa SL, Araujo JF. Sleep disorders and suicidal ideation in patients with depressive disorder. Psychiatry Res 2007;153:131-136. https://doi.org/10.1016/j.psychres.2006.05.007
  13. Valtonen H, Suominen K, Mantere O, Leppamaki S, Arvilommi P, Isometsa ET. Suicidal ideation and attempts in bipolar I and II disorders. J Clin Psychiatry 2005;66:1456-1462. https://doi.org/10.4088/JCP.v66n1116
  14. Jeon HJ, Lee JY, Lee YM, Hong JP, Won SH, Cho SJ, et al. Lifetime prevalence and correlates of suicidal ideation, plan, and single and multiple attempts in a Korean nationwide study. J Nerv Ment Dis 2010;198:643-646. https://doi.org/10.1097/NMD.0b013e3181ef3ecf
  15. Ribeiro JD, Franklin JC, Fox KR, Bentley KH, Kleiman EM, Chang BP, et al. Letter to the Editor: suicide as a complex classification problem: machine learning and related techniques can advance suicide prediction - a reply to Roaldset (2016). Psychol Med 2016;46:2009-2010. https://doi.org/10.1017/S0033291716000611
  16. Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 2016;375:1216-1219. https://doi.org/10.1056/NEJMp1606181
  17. Kweon S, Kim Y, Jang MJ, Kim Y, Kim K, Choi S, et al. Data resource profile: the Korea National Health and Nutrition Examination Survey (KNHANES). Int J Epidemiol 2014;43:69-77. https://doi.org/10.1093/ije/dyt228
  18. Li DC, Liu CW, Hu SC. A learning method for the class imbalance problem with medical data sets. Comput Biol Med 2010;40:509-518. https://doi.org/10.1016/j.compbiomed.2010.03.005
  19. Bolton JM, Gunnell D, Turecki G. Suicide risk assessment and intervention in people with mental illness. BMJ 2015;351:h4978. https://doi.org/10.1136/bmj.h4978
  20. Ghasemi P, Shaghaghi A, Allahverdipour H. Measurement scales of suicidal ideation and attitudes: a systematic review article. Health Promot Perspect 2015;5:156-168. https://doi.org/10.15171/hpp.2015.019
  21. Passos IC, Mwangi B, Cao B, Hamilton JE, Wu MJ, Zhang XY, et al. Identifying a clinical signature of suicidality among patients with mood disorders: A pilot study using a machine learning approach. J Affect Disord 2016;193:109-116. https://doi.org/10.1016/j.jad.2015.12.066
  22. Oh J, Yun K, Hwang JH, Chae JH. Classification of suicide attempts through a machine learning algorithm based on multiple systemic psychiatric scales. Front Psychiatry 2017;8:192. https://doi.org/10.3389/fpsyt.2017.00192
  23. Choi SB, Lee W, Yoon JH, Won JU, Kim DW. Ten-year prediction of suicide death using Cox regression and machine learning in a nationwide retrospective cohort study in South Korea. J Affect Disord 2018;231:8-14. https://doi.org/10.1016/j.jad.2018.01.019
  24. Altman N, Krzywinski M. The curse(s) of dimensionality. Nat Methods 2018;15:399-400. https://doi.org/10.1038/s41592-018-0019-x
  25. Grover KE, Green KL, Pettit JW, Monteith LL, Garza MJ, Venta A. Problem solving moderates the effects of life event stress and chronic stress on suicidal behaviors in adolescence. J Clin Psychol 2009;65:1281-1290. https://doi.org/10.1002/jclp.20632
  26. Tsutsumi A, Kayaba K, Ojima T, Ishikawa S, Kawakami N; Jichi Medical School Cohort Study Group. Low control at work and the risk of suicide in Japanese men: a prospective cohort study. Psychother Psychosom 2007;76:177-185. https://doi.org/10.1159/000099845
  27. Druss B, Pincus H. Suicidal ideation and suicide attempts in general medical illnesses. Arch Intern Med 2000;160:1522-1526. https://doi.org/10.1001/archinte.160.10.1522
  28. Jeon HJ, Woo JM, Kim HJ, Fava M, Mischoulon D, Cho SJ, et al. Gender differences in somatic symptoms and current suicidal risk in outpatients with major depressive disorder. Psychiatry Investig 2016;13:609-615. https://doi.org/10.4306/pi.2016.13.6.609
  29. Ahmedani BK, Peterson EL, Hu Y, Rossom RC, Lynch F, Lu CY, et al. Major Physical Health Conditions and Risk of Suicide. Am J Prev Med 2017;53:308-315. https://doi.org/10.1016/j.amepre.2017.04.001
  30. Lee H, Seol KH, Kim JW. Age and sex-related differences in risk factors for elderly suicide: differentiating between suicide ideation and attempts. Int J Geriatr Psychiatry 2018;33:e300-e306. https://doi.org/10.1002/gps.4794
  31. Sugawara N, Yasui-Furukori N, Sasaki G, Tanaka O, Umeda T, Takahashi I, et al. Gender differences in factors associated with suicidal ideation and depressive symptoms among middle-aged workers in Japan. Ind Health 2013;51:202-213. https://doi.org/10.2486/indhealth.MS1354
  32. Kimura T, Iso H, Honjo K, Ikehara S, Sawada N, Iwasaki M, et al. Educational Levels and Risk of Suicide in Japan: The Japan Public Health Center Study (JPHC) Cohort I. J Epidemiol 2016;26:315-321. https://doi.org/10.2188/jea.JE20140253
  33. Kim SY, Shin DW, Oh KS, Kim EJ, Park YR, Shin YC, et al. Gender differences of occupational stress associated with suicidal ideation among South Korean employees: the Kangbuk Samsung Health Study. Psychiatry Investig 2018;15:156-163. https://doi.org/10.30773/pi.2017.05.31.1
  34. Yoon CG, Bae KJ, Kang MY, Yoon JH. Is suicidal ideation linked to working hours and shift work in Korea? J Occup Health 2015;57:222-229. https://doi.org/10.1539/joh.14-0237-OA

피인용 문헌

  1. Detection of Suicide Attempters among Suicide Ideators Using Machine Learning vol.16, pp.8, 2018, https://doi.org/10.30773/pi.2019.06.19
  2. The utility of artificial intelligence in suicide risk prediction and the management of suicidal behaviors vol.53, pp.10, 2019, https://doi.org/10.1177/0004867419864428
  3. Early-life stressful events and suicide attempt in schizophrenia: Machine learning models vol.218, pp.None, 2020, https://doi.org/10.1016/j.schres.2019.11.061
  4. Discovering the Unclassified Suicide Cases Among Undetermined Drug Overdose Deaths Using Machine Learning Techniques vol.50, pp.2, 2020, https://doi.org/10.1111/sltb.12591
  5. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations vol.17, pp.16, 2018, https://doi.org/10.3390/ijerph17165929
  6. Applications of Artificial Intelligence Methodologies to Behavioral and Social Sciences vol.29, pp.10, 2020, https://doi.org/10.1007/s10826-019-01689-x
  7. Development of an early-warning system for high-risk patients for suicide attempt using deep learning and electronic health records vol.10, pp.1, 2018, https://doi.org/10.1038/s41398-020-0684-2
  8. A comparative study of machine learning techniques for suicide attempts predictive model vol.27, pp.1, 2018, https://doi.org/10.1177/1460458221989395
  9. Screening for Depression in Mobile Devices Using Patient Health Questionnaire-9 (PHQ-9) Data: A Diagnostic Meta-Analysis via Machine Learning Methods vol.17, pp.None, 2018, https://doi.org/10.2147/ndt.s339412
  10. A Comprehensive Review of Computer-Aided Diagnosis of Major Mental and Neurological Disorders and Suicide: A Biostatistical Perspective on Data Mining vol.11, pp.3, 2021, https://doi.org/10.3390/diagnostics11030393
  11. Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches vol.18, pp.7, 2021, https://doi.org/10.3390/ijerph18073339
  12. Comparing machine learning to a rule-based approach for predicting suicidal behavior among adolescents: Results from a longitudinal population-based survey vol.295, pp.None, 2018, https://doi.org/10.1016/j.jad.2021.09.018
  13. Detecting suicidal risk using MMPI-2 based on machine learning algorithm vol.11, pp.1, 2021, https://doi.org/10.1038/s41598-021-94839-5
  14. Psychological Autopsy and Forensic Considerations in Completed Suicide of the SARS-CoV-2 Infected Patients. A Case Series and Literature Review vol.11, pp.23, 2018, https://doi.org/10.3390/app112311547
  15. Machine learning for suicidal ideation identification: A systematic literature review vol.128, pp.None, 2018, https://doi.org/10.1016/j.chb.2021.107095