An EEG-fNIRS Hybridization Technique in the Multi-class Classification of Alzheimer's Disease Facilitated by Machine Learning

기계학습 기반 알츠하이머성 치매의 다중 분류에서 EEG-fNIRS 혼성화 기법

  • Ho, Thi Kieu Khanh (Department of Software, Korea National University of Transportation) ;
  • Kim, Inki (Department of Software, Korea National University of Transportation) ;
  • Jeon, Younghoon (School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology) ;
  • Song, Jong-In (School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology) ;
  • Gwak, Jeonghwan (Department of Software, Korea National University of Transportation)
  • 호티키우칸 (한국교통대학교 소프트웨어학과) ;
  • 김인기 (한국교통대학교 소프트웨어학과) ;
  • 전영훈 (광주과학기술원 전기전자컴퓨터공학과) ;
  • 송종인 (광주과학기술원 전기전자컴퓨터공학과) ;
  • 곽정환 (한국교통대학교 소프트웨어학과)
  • Published : 2021.07.14

Abstract

Alzheimer's Disease (AD) is a cognitive disorder characterized by memory impairment that can be assessed at early stages based on administering clinical tests. However, the AD pathophysiological mechanism is still poorly understood due to the difficulty of distinguishing different levels of AD severity, even using a variety of brain modalities. Therefore, in this study, we present a hybrid EEG-fNIRS modalities to compensate for each other's weaknesses with the help of Machine Learning (ML) techniques for classifying four subject groups, including healthy controls (HC) and three distinguishable groups of AD levels. A concurrent EEF-fNIRS setup was used to record the data from 41 subjects during Oddball and 1-back tasks. We employed both a traditional neural network (NN) and a CNN-LSTM hybrid model for fNIRS and EEG, respectively. The final prediction was then obtained by using majority voting of those models. Classification results indicated that the hybrid EEG-fNIRS feature set achieved a higher accuracy (71.4%) by combining their complementary properties, compared to using EEG (67.9%) or fNIRS alone (68.9%). These findings demonstrate the potential of an EEG-fNIRS hybridization technique coupled with ML-based approaches for further AD studies.

Keywords

Acknowledgement

This work was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (Grant No. NRF-2020R1I1A3074141), the Brain Research Program through the NRF funded by the Ministry of Science, ICT and Future Planning (Grant No. NRF-2019M3C7A1020406), and "Regional Innovation Strategy (RIS)" through the NRF funded by the Ministry of Education.