• Title/Summary/Keyword: spiking neural network

Search Result 24, Processing Time 0.024 seconds

The Parameter Learning Method for Similar Image Rating Using Pulse Coupled Neural Network

  • Matsushima, Hiroki;Kurokawa, Hiroaki
    • Journal of Multimedia Information System
    • /
    • v.3 no.4
    • /
    • pp.155-160
    • /
    • 2016
  • The Pulse Coupled Neural Network (PCNN) is a kind of neural network models that consists of spiking neurons and local connections. The PCNN was originally proposed as a model that can reproduce the synchronous phenomena of the neurons in the cat visual cortex. Recently, the PCNN has been applied to the various image processing applications, e.g., image segmentation, edge detection, pattern recognition, and so on. The method for the image matching using the PCNN had been proposed as one of the valuable applications of the PCNN. In this method, the Genetic Algorithm is applied to the PCNN parameter learning for the image matching. In this study, we propose the method of the similar image rating using the PCNN. In our method, the Genetic Algorithm based method is applied to the parameter learning of the PCNN. We show the performance of our method by simulations. From the simulation results, we evaluate the efficiency and the general versatility of our parameter learning method.

QoS-Aware Optimal SNN Model Parameter Generation Method in Neuromorphic Environment (뉴로모픽 환경에서 QoS를 고려한 최적의 SNN 모델 파라미터 생성 기법)

  • Seoyeon Kim;Bongjae Kim;Jinman Jung
    • Smart Media Journal
    • /
    • v.12 no.4
    • /
    • pp.19-26
    • /
    • 2023
  • IoT edge services utilizing neuromorphic hardware architectures are suitable for autonomous IoT applications as they perform intelligent processing on the device itself. However, spiking neural networks applied to neuromorphic hardware are difficult for IoT developers to comprehend due to their complex structures and various hyper-parameters. In this paper, we propose a method for generating spiking neural network (SNN) models that satisfy user performance requirements while considering the constraints of neuromorphic hardware. Our proposed method utilizes previously trained models from pre-processed data to find optimal SNN model parameters from profiling data. Comparing our method to a naive search method, both methods satisfy user requirements, but our proposed method shows better performance in terms of runtime. Additionally, even if the constraints of new hardware are not clearly known, the proposed method can provide high scalability by utilizing the profiled data of the hardware.

Trends in Ultra Low Power Intelligent Edge Semiconductor Technology (초저전력 엣지 지능형반도체 기술 동향)

  • Oh, K.I.;Kim, S.E.;Bae, Y.H.;Park, S.M.;Lee, J.J.;Kang, S.W.
    • Electronics and Telecommunications Trends
    • /
    • v.33 no.6
    • /
    • pp.24-33
    • /
    • 2018
  • In the age of IoT, in which everything is connected to a network, there have been increases in the amount of data traffic, latency, and the risk of personal privacy breaches that conventional cloud computing technology cannot cope with. The idea of edge computing has emerged as a solution to these issues, and furthermore, the concept of ultra-low power edge intelligent semiconductors in which the IoT device itself performs intelligent decisions and processes data has been established. The key elements of this function are an intelligent semiconductor based on artificial intelligence, connectivity for the efficient connection of neurons and synapses, and a large-scale spiking neural network simulation framework for the performance prediction of a neural network. This paper covers the current trends in ultra-low power edge intelligent semiconductors including issues regarding their technology and application.

Electrophysiological and Morphological Classification of Inhibitory Interneurons in Layer II/III of the Rat Visual Cortex

  • Rhie, Duck-Joo;Kang, Ho-Young;Ryu, Gyeong-Ryul;Kim, Myung-Jun;Yoon, Shin-Hee;Hahn, Sang-June;Min, Do-Sik;Jo, Yang-Hyeok;Kim, Myung-Suk
    • The Korean Journal of Physiology and Pharmacology
    • /
    • v.7 no.6
    • /
    • pp.317-323
    • /
    • 2003
  • Interneuron diversity is one of the key factors to hinder understanding the mechanism of cortical neural network functions even with their important roles. We characterized inhibitory interneurons in layer II/III of the rat primary visual cortex, using patch-clamp recording and confocal reconstruction, and classified inhibitory interneurons into fast spiking (FS), late spiking (LS), burst spiking (BS), and regular spiking non-pyramidal (RSNP) neurons according to their electrophysiological characteristics. Global parameters to identify inhibitory interneurons were resting membrane potential (>-70 mV) and action potential (AP) width (<0.9 msec at half amplitude). FS could be differentiated from LS, based on smaller amplitude of the AP (<∼50 mV) and shorter peak-to-trough time (P-T time) of the afterhyperpolarization (<4 msec). In addition to the shorter AP width, RSNP had the higher input resistance (>200 $M{Omega}$) and the shorter P-T time (<20 msec) than those of regular spiking pyramidal neurons. Confocal reconstruction of recorded cells revealed characteristic morphology of each subtype of inhibitory interneurons. Thus, our results provide at least four subtypes of inhibitory interneurons in layer II/III of the rat primary visual cortex and a classification scheme of inhibitory interneurons.

Discrimination of neutrons and gamma-rays in plastic scintillator based on spiking cortical model

  • Bing-Qi Liu;Hao-Ran Liu;Lan Chang;Yu-Xin Cheng;Zhuo Zuo;Peng Li
    • Nuclear Engineering and Technology
    • /
    • v.55 no.9
    • /
    • pp.3359-3366
    • /
    • 2023
  • In this study, a spiking cortical model (SCM) based n-g discrimination method is proposed. The SCM-based algorithm is compared with three other methods, namely: (i) the pulse-coupled neural network (PCNN), (ii) the charge comparison, and (iii) the zero-crossing. The objective evaluation criteria used for the comparison are the FoM-value and the time consumption of discrimination. Experimental results demonstrated that our proposed method outperforms the other methods significantly with the highest FoM-value. Specifically, the proposed method exhibits a 34.81% improvement compared with the PCNN, a 50.29% improvement compared with the charge comparison, and a 110.02% improvement compared with the zero-crossing. Additionally, the proposed method features the second-fastest discrimination time, where it is 75.67% faster than the PCNN, 70.65% faster than the charge comparison and 38.4% slower than the zero-crossing. Our study also discusses the role and change pattern of each parameter of the SCM to guide the selection process. It concludes that the SCM's outstanding ability to recognize the dynamic information in the pulse signal, improved accuracy when compared to the PCNN, and better computational complexity enables the SCM to exhibit excellent n-γ discrimination performance while consuming less time.

Implementation of Autonomous IoT Integrated Development Environment based on AI Component Abstract Model (AI 컴포넌트 추상화 모델 기반 자율형 IoT 통합개발환경 구현)

  • Kim, Seoyeon;Yun, Young-Sun;Eun, Seong-Bae;Cha, Sin;Jung, Jinman
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.5
    • /
    • pp.71-77
    • /
    • 2021
  • Recently, there is a demand for efficient program development of an IoT application support frameworks considering heterogeneous hardware characteristics. In addition, the scope of hardware support is expanding with the development of neuromorphic architecture that mimics the human brain to learn on their own and enables autonomous computing. However, most existing IoT IDE(Integrated Development Environment), it is difficult to support AI(Artificial Intelligence) or to support services combined with various hardware such as neuromorphic architectures. In this paper, we design an AI component abstract model that supports the second-generation ANN(Artificial Neural Network) and the third-generation SNN(Spiking Neural Network), and implemented an autonomous IoT IDE based on the proposed model. IoT developers can automatically create AI components through the proposed technique without knowledge of AI and SNN. The proposed technique is flexible in code conversion according to runtime, so development productivity is high. Through experimentation of the proposed method, it was confirmed that the conversion delay time due to the VCL(Virtual Component Layer) may occur, but the difference is not significant.

Comparison of Artificial Neural Networks for Low-Power ECG-Classification System

  • Rana, Amrita;Kim, Kyung Ki
    • Journal of Sensor Science and Technology
    • /
    • v.29 no.1
    • /
    • pp.19-26
    • /
    • 2020
  • Electrocardiogram (ECG) classification has become an essential task of modern day wearable devices, and can be used to detect cardiovascular diseases. State-of-the-art Artificial Intelligence (AI)-based ECG classifiers have been designed using various artificial neural networks (ANNs). Despite their high accuracy, ANNs require significant computational resources and power. Herein, three different ANNs have been compared: multilayer perceptron (MLP), convolutional neural network (CNN), and spiking neural network (SNN) only for the ECG classification. The ANN model has been developed in Python and Theano, trained on a central processing unit (CPU) platform, and deployed on a PYNQ-Z2 FPGA board to validate the model using a Jupyter notebook. Meanwhile, the hardware accelerator is designed with Overlay, which is a hardware library on PYNQ. For classification, the MIT-BIH dataset obtained from the Physionet library is used. The resulting ANN system can accurately classify four ECG types: normal, atrial premature contraction, left bundle branch block, and premature ventricular contraction. The performance of the ECG classifier models is evaluated based on accuracy and power. Among the three AI algorithms, the SNN requires the lowest power consumption of 0.226 W on-chip, followed by MLP (1.677 W), and CNN (2.266 W). However, the highest accuracy is achieved by the CNN (95%), followed by MLP (76%) and SNN (90%).

Trend of AI Neuromorphic Semiconductor Technology (인공지능 뉴로모픽 반도체 기술 동향)

  • Oh, K.I.;Kim, S.E.;Bae, Y.H.;Park, K.H.;Kwon, Y.S.
    • Electronics and Telecommunications Trends
    • /
    • v.35 no.3
    • /
    • pp.76-84
    • /
    • 2020
  • Neuromorphic hardware refers to brain-inspired computers or components that model an artificial neural network comprising densely connected parallel neurons and synapses. The major element in the widespread deployment of neural networks in embedded devices are efficient architecture for neuromorphic hardware with regard to performance, power consumption, and chip area. Spiking neural networks (SiNNs) are brain-inspired in which the communication among neurons is modeled in the form of spikes. Owing to brainlike operating modes, SNNs can be power efficient. However, issues still exist with research and actual application of SNNs. In this issue, we focus on the technology development cases and market trends of two typical tracks, which are listed above, from the point of view of artificial intelligence neuromorphic circuits and subsequently describe their future development prospects.

Reduction of Inference time in Neuromorphic Based Platform for IoT Computing Environments (IoT 컴퓨팅 환경을 위한 뉴로모픽 기반 플랫폼의 추론시간 단축)

  • Kim, Jaeseop;Lee, Seungyeon;Hong, Jiman
    • Smart Media Journal
    • /
    • v.11 no.2
    • /
    • pp.77-83
    • /
    • 2022
  • The neuromorphic architecture uses a spiking neural network (SNN) model to derive more accurate results as more spike values are accumulated through inference experiments. When the inference result converges to a specific value, even if the inference experiment is further performed, the change in the result is smaller and power consumption may increase. In particular, in an AI-based IoT environment, power consumption can be a big problem. Therefore, in this paper, we propose a technique to reduce the power consumption of AI-based IoT by reducing the inference time by adjusting the inference image exposure time in the neuromorphic architecture environment. The proposed technique calculates the next inferred image exposure time by reflecting the change in inference accuracy. In addition, the rate of reflection of the change in inference accuracy can be adjusted with a coefficient value, and an optimal coefficient value is found through a comparison experiment of various coefficient values. In the proposed technique, the inference image exposure time corresponding to the target accuracy is greater than that of the linear technique, but the overall power consumption is less than that of the linear technique. As a result of measuring and evaluating the performance of the proposed method, it is confirmed that the inference experiment applying the proposed method can reduce the final exposure time by about 90% compared to the inference experiment applying the linear method.

Brain-Inspired Artificial Intelligence (브레인 모사 인공지능 기술)

  • Kim, C.H.;Lee, J.H.;Lee, S.Y.;Woo, Y.C.;Baek, O.K.;Won, H.S.
    • Electronics and Telecommunications Trends
    • /
    • v.36 no.3
    • /
    • pp.106-118
    • /
    • 2021
  • The field of brain science (or neuroscience in a broader sense) has inspired researchers in artificial intelligence (AI) for a long time. The outcomes of neuroscience such as Hebb's rule had profound effects on the early AI models, and the models have developed to become the current state-of-the-art artificial neural networks. However, the recent progress in AI led by deep learning architectures is mainly due to elaborate mathematical methods and the rapid growth of computing power rather than neuroscientific inspiration. Meanwhile, major limitations such as opacity, lack of common sense, narrowness, and brittleness have not been thoroughly resolved. To address those problems, many AI researchers turn their attention to neuroscience to get insights and inspirations again. Biologically plausible neural networks, spiking neural networks, and connectome-based networks exemplify such neuroscience-inspired approaches. In addition, the more recent field of brain network analysis is unveiling complex brain mechanisms by handling the brain as dynamic graph models. We argue that the progress toward the human-level AI, which is the goal of AI, can be accelerated by leveraging the novel findings of the human brain network.