Browse > Article
http://dx.doi.org/10.30773/pi.2018.08.27

Use of a Machine Learning Algorithm to Predict Individuals with Suicide Ideation in the General Population  

Ryu, Seunghyong (Department of Mental Health Research, National Center for Mental Health)
Lee, Hyeongrae (Department of Mental Health Research, National Center for Mental Health)
Lee, Dong-Kyun (Department of Mental Health Research, National Center for Mental Health)
Park, Kyeongwoo (Department of Mental Health Research, National Center for Mental Health)
Publication Information
Psychiatry investigation / v.15, no.11, 2018 , pp. 1030-1036 More about this Journal
Abstract
Objective In this study, we aimed to develop a model predicting individuals with suicide ideation within a general population using a machine learning algorithm. Methods Among 35,116 individuals aged over 19 years from the Korea National Health & Nutrition Examination Survey, we selected 11,628 individuals via random down-sampling. This included 5,814 suicide ideators and the same number of non-suicide ideators. We randomly assigned the subjects to a training set (n=10,466) and a test set (n=1,162). In the training set, a random forest model was trained with 15 features selected with recursive feature elimination via 10-fold cross validation. Subsequently, the fitted model was used to predict suicide ideators in the test set and among the total of 35,116 subjects. All analyses were conducted in R. Results The prediction model achieved a good performance [area under receiver operating characteristic curve (AUC)=0.85] in the test set and predicted suicide ideators among the total samples with an accuracy of 0.821, sensitivity of 0.836, and specificity of 0.807. Conclusion This study shows the possibility that a machine learning approach can enable screening for suicide risk in the general population. Further work is warranted to increase the accuracy of prediction.
Keywords
Suicide ideation; Prediction; Machine learning algorithm; Public health data;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Jeon HJ, Woo JM, Kim HJ, Fava M, Mischoulon D, Cho SJ, et al. Gender differences in somatic symptoms and current suicidal risk in outpatients with major depressive disorder. Psychiatry Investig 2016;13:609-615.   DOI
2 Ahmedani BK, Peterson EL, Hu Y, Rossom RC, Lynch F, Lu CY, et al. Major Physical Health Conditions and Risk of Suicide. Am J Prev Med 2017;53:308-315.   DOI
3 Lee H, Seol KH, Kim JW. Age and sex-related differences in risk factors for elderly suicide: differentiating between suicide ideation and attempts. Int J Geriatr Psychiatry 2018;33:e300-e306.   DOI
4 Sugawara N, Yasui-Furukori N, Sasaki G, Tanaka O, Umeda T, Takahashi I, et al. Gender differences in factors associated with suicidal ideation and depressive symptoms among middle-aged workers in Japan. Ind Health 2013;51:202-213.   DOI
5 Kimura T, Iso H, Honjo K, Ikehara S, Sawada N, Iwasaki M, et al. Educational Levels and Risk of Suicide in Japan: The Japan Public Health Center Study (JPHC) Cohort I. J Epidemiol 2016;26:315-321.   DOI
6 Kim SY, Shin DW, Oh KS, Kim EJ, Park YR, Shin YC, et al. Gender differences of occupational stress associated with suicidal ideation among South Korean employees: the Kangbuk Samsung Health Study. Psychiatry Investig 2018;15:156-163.   DOI
7 Yoon CG, Bae KJ, Kang MY, Yoon JH. Is suicidal ideation linked to working hours and shift work in Korea? J Occup Health 2015;57:222-229.   DOI
8 Statistics Korea. Annual Report on the Cause of Death Statistics 2016. Daejeon: Statistics Korea; 2017.
9 OECD. OECD Health Statistics 2017. Available at: https://stats.oecd.org/Index.aspx?DataSetCode=HEALTH_STAT. Accessed June 17, 2018.
10 Kim WJ, Song YJ, Ryu HS, Ryu V, Kim JM, Ha RY, et al. Internalized stigma and its psychosocial correlates in Korean patients with serious mental illness. Psychiatry Res 2015;225:433-439.   DOI
11 Zalsman G, Hawton K, Wasserman D, van Heeringen K, Arensman E, Sarchiapone M, et al. Suicide prevention strategies revisited: 10-year systematic review. Lancet Psychiatry 2016;3:646-659.   DOI
12 Arsenault-Lapierre G, Kim C, Turecki G. Psychiatric diagnoses in 3275 suicides: a meta-analysis. BMC Psychiatry 2004;4:37.   DOI
13 Conwell Y, Duberstein PR, Cox C, Herrmann JH, Forbes NT, Caine ED. Relationships of age and axis I diagnoses in victims of completed suicide: a psychological autopsy study. Am J Psychiatry 1996;153:1001-1008.   DOI
14 Korea Psychological Autopsy Center. Psychological Autopsy Report. Available at: http://www.mohw.go.kr/react/al/sal0301vw.jsp?PAR_MENU_ID=04&MENU_ID=0403&page=1&CONT_SEQ=344726. Acessed Jun 17, 2018.
15 Valtonen H, Suominen K, Mantere O, Leppamaki S, Arvilommi P, Isometsa ET. Suicidal ideation and attempts in bipolar I and II disorders. J Clin Psychiatry 2005;66:1456-1462.   DOI
16 Ministry of Health and Welfare. The Survey of Mental Disorders in Korea 2016. Sejong: Ministry of Health and Welfare; 2017.
17 Nock MK, Borges G, Bromet EJ, Alonso J, Angermeyer M, Beautrais A, et al. Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry 2008;192:98-105.   DOI
18 May AM, Klonsky ED, Klein DN. Predicting future suicide attempts among depressed suicide ideators: a 10-year longitudinal study. J Psychiatr Res 2012;46:946-952.   DOI
19 Miranda R, Ortin A, Scott M, Shaffer D. Characteristics of suicidal ideation that predict the transition to future suicide attempts in adolescents. J Child Psychol Psychiatry 2014;55:1288-1296.   DOI
20 Chellappa SL, Araujo JF. Sleep disorders and suicidal ideation in patients with depressive disorder. Psychiatry Res 2007;153:131-136.   DOI
21 Jeon HJ, Lee JY, Lee YM, Hong JP, Won SH, Cho SJ, et al. Lifetime prevalence and correlates of suicidal ideation, plan, and single and multiple attempts in a Korean nationwide study. J Nerv Ment Dis 2010;198:643-646.   DOI
22 Ribeiro JD, Franklin JC, Fox KR, Bentley KH, Kleiman EM, Chang BP, et al. Letter to the Editor: suicide as a complex classification problem: machine learning and related techniques can advance suicide prediction - a reply to Roaldset (2016). Psychol Med 2016;46:2009-2010.   DOI
23 Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 2016;375:1216-1219.   DOI
24 Choi SB, Lee W, Yoon JH, Won JU, Kim DW. Ten-year prediction of suicide death using Cox regression and machine learning in a nationwide retrospective cohort study in South Korea. J Affect Disord 2018;231:8-14.   DOI
25 Li DC, Liu CW, Hu SC. A learning method for the class imbalance problem with medical data sets. Comput Biol Med 2010;40:509-518.   DOI
26 Bolton JM, Gunnell D, Turecki G. Suicide risk assessment and intervention in people with mental illness. BMJ 2015;351:h4978.   DOI
27 Ghasemi P, Shaghaghi A, Allahverdipour H. Measurement scales of suicidal ideation and attitudes: a systematic review article. Health Promot Perspect 2015;5:156-168.   DOI
28 Passos IC, Mwangi B, Cao B, Hamilton JE, Wu MJ, Zhang XY, et al. Identifying a clinical signature of suicidality among patients with mood disorders: A pilot study using a machine learning approach. J Affect Disord 2016;193:109-116.   DOI
29 Oh J, Yun K, Hwang JH, Chae JH. Classification of suicide attempts through a machine learning algorithm based on multiple systemic psychiatric scales. Front Psychiatry 2017;8:192.   DOI
30 Altman N, Krzywinski M. The curse(s) of dimensionality. Nat Methods 2018;15:399-400.   DOI
31 Grover KE, Green KL, Pettit JW, Monteith LL, Garza MJ, Venta A. Problem solving moderates the effects of life event stress and chronic stress on suicidal behaviors in adolescence. J Clin Psychol 2009;65:1281-1290.   DOI
32 Kweon S, Kim Y, Jang MJ, Kim Y, Kim K, Choi S, et al. Data resource profile: the Korea National Health and Nutrition Examination Survey (KNHANES). Int J Epidemiol 2014;43:69-77.   DOI
33 Druss B, Pincus H. Suicidal ideation and suicide attempts in general medical illnesses. Arch Intern Med 2000;160:1522-1526.   DOI
34 Tsutsumi A, Kayaba K, Ojima T, Ishikawa S, Kawakami N; Jichi Medical School Cohort Study Group. Low control at work and the risk of suicide in Japanese men: a prospective cohort study. Psychother Psychosom 2007;76:177-185.   DOI