• Title/Summary/Keyword: Residual learning

Search Result 203, Processing Time 0.026 seconds

Performance Evaluation of DSE-MMA Blind Equalization Algorithm in QAM System (QAM 시스템에서 DSE-MMA 블라인드 등화 알고리즘의 성능 평가)

  • Kang, Dae-Soo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.6
    • /
    • pp.115-121
    • /
    • 2013
  • This paper related with the DSE-MMA (Dithered Sign-Error MMA) that is the simplification of computational arithmetic number in blind equalization algorithm in order to compensates the intersymbol interference which occurs the passing the nonlinear communication channel in the presence of the band limit and phase distortion. The SE-MMA algorithm has a merit of H/W implementation for the possible to reduction of computational arithmetic number using the 1 bit quantizer in stead of multiplication in the updating the equalizer tap weight. But it degradates the overall blind equalization algorithm performance by the information loss at the quantization process compare to the MMA. The DSE-MMA which implements the dithered signed-error concepts by using the dither signal before qualtization are added to MMA, then the improved SNR performance which represents the roburstness of equalization algorithm are obtained. It has a concurrently compensation capability of the amplitude and phase distortion due to intersymbol interference like as the SE-MMA and MMA algorithm. The paper uses the equalizer output signal, residual isi, MD, MSE learning curve and SER curve for the performance index of blind equalization algorithm, and the computer simulation were performed in order to compare the SE-MMA and DSE-MMA applying the same performance index. As a result of simulation, the DSE-MMA can improving the roburstness and the value of every performance index after steady state than the SE-MMA, and confirmed that the DSE-MMA has slow convergence speed which meaning the reaching the seady state from initial state of adaptive equalization filter.

A study on end-to-end speaker diarization system using single-label classification (단일 레이블 분류를 이용한 종단 간 화자 분할 시스템 성능 향상에 관한 연구)

  • Jaehee Jung;Wooil Kim
    • The Journal of the Acoustical Society of Korea
    • /
    • v.42 no.6
    • /
    • pp.536-543
    • /
    • 2023
  • Speaker diarization, which labels for "who spoken when?" in speech with multiple speakers, has been studied on a deep neural network-based end-to-end method for labeling on speech overlap and optimization of speaker diarization models. Most deep neural network-based end-to-end speaker diarization systems perform multi-label classification problem that predicts the labels of all speakers spoken in each frame of speech. However, the performance of the multi-label-based model varies greatly depending on what the threshold is set to. In this paper, it is studied a speaker diarization system using single-label classification so that speaker diarization can be performed without thresholds. The proposed model estimate labels from the output of the model by converting speaker labels into a single label. To consider speaker label permutations in the training, the proposed model is used a combination of Permutation Invariant Training (PIT) loss and cross-entropy loss. In addition, how to add the residual connection structures to model is studied for effective learning of speaker diarization models with deep structures. The experiment used the Librispech database to generate and use simulated noise data for two speakers. When compared with the proposed method and baseline model using the Diarization Error Rate (DER) performance the proposed method can be labeling without threshold, and it has improved performance by about 20.7 %.

A Study of CNN-based Super-Resolution Method for Remote Sensing Image (원격 탐사 영상을 활용한 CNN 기반의 초해상화 기법 연구)

  • Choi, Yeonju;Kim, Minsik;Kim, Yongwoo;Han, Sanghyuck
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.3
    • /
    • pp.449-460
    • /
    • 2020
  • Super-resolution is a technique used to reconstruct an image with low-resolution into that of high-resolution. Recently, deep-learning based super resolution has become the mainstream, and applications of these methods are widely used in the remote sensing field. In this paper, we propose a super-resolution method based on the deep back-projection network model to improve the satellite image resolution by the factor of four. In the process, we customized the loss function with the edge loss to result in a more detailed feature of the boundary of each object and to improve the stability of the model training using generative adversarial network based on Wasserstein distance loss. Also, we have applied the detail preserving image down-scaling method to enhance the naturalness of the training output. Finally, by including the modified-residual learning with a panchromatic feature in the final step of the training process. Our proposed method is able to reconstruct fine features and high frequency information. Comparing the results of our method with that of the others, we propose that the super-resolution method improves the sharpness and the clarity of WorldView-3 and KOMPSAT-2 images.

Introduction to Geophysical Exploration Data Denoising using Deep Learning (심층 학습을 이용한 물리탐사 자료 잡음 제거 기술 소개)

  • Caesary, Desy;Cho, AHyun;Yu, Huieun;Joung, Inseok;Song, Seo Young;Cho, Sung Oh;Kim, Bitnarae;Nam, Myung Jin
    • Geophysics and Geophysical Exploration
    • /
    • v.23 no.3
    • /
    • pp.117-130
    • /
    • 2020
  • Noises can distort acquired geophysical data, leading to their misinterpretation. Potential noises sources include anthropogenic activity, natural phenomena, and instrument noises. Conventional denoising methods such as wavelet transform and filtering techniques, are based on subjective human investigation, which is computationally inefficient and time-consuming. Recently, many researchers attempted to implement neural networks to efficiently remove noise from geophysical data. This study aims to review and analyze different types of neural networks, such as artificial neural networks, convolutional neural networks, autoencoders, residual networks, and wavelet neural networks, which are implemented to remove different types of noises including seismic, transient electromagnetic, ground-penetrating radar, and magnetotelluric surveys. The review analyzes and summarizes the key challenges in the removal of noise from geophysical data using neural network, while proposes and explains solutions to the challenges. The analysis support that the advancement in neural networks can be powerful denoising tools for geophysical data.

The Effect of regularization and identity mapping on the performance of activation functions (정규화 및 항등사상이 활성함수 성능에 미치는 영향)

  • Ryu, Seo-Hyeon;Yoon, Jae-Bok
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.18 no.10
    • /
    • pp.75-80
    • /
    • 2017
  • In this paper, we describe the effect of the regularization method and the network with identity mapping on the performance of the activation functions in deep convolutional neural networks. The activation functions act as nonlinear transformation. In early convolutional neural networks, a sigmoid function was used. To overcome the problem of the existing activation functions such as gradient vanishing, various activation functions were developed such as ReLU, Leaky ReLU, parametric ReLU, and ELU. To solve the overfitting problem, regularization methods such as dropout and batch normalization were developed on the sidelines of the activation functions. Additionally, data augmentation is usually applied to deep learning to avoid overfitting. The activation functions mentioned above have different characteristics, but the new regularization method and the network with identity mapping were validated only using ReLU. Therefore, we have experimentally shown the effect of the regularization method and the network with identity mapping on the performance of the activation functions. Through this analysis, we have presented the tendency of the performance of activation functions according to regularization and identity mapping. These results will reduce the number of training trials to find the best activation function.

A Structural Model of Management Goal Orientations and Preferred Goal Achievement Index in one Hospital Employees (한 종합병원 구성원의 경영목표 지향성의 구조적 모형과 선호 경영성과지표)

  • Park, Jae-Sung
    • Health Policy and Management
    • /
    • v.17 no.1
    • /
    • pp.50-74
    • /
    • 2007
  • The purpose of this study was to identify a determent of mastery approach goal and performance approach goal using a basic concept of goal orientations and goal setting theory, and to evaluate a preference of goal achievement index as a balance score card (BSC). The study model proposed had a adoptable level of goodness of fit index(.94) and root mean square residual(.08). The meditating variable, goal contribution, totally mediated the impact of goal commitment, Y-theory human behavior, and self-efficacy but organizational resource contribution for pursuing goal orientation. Moreover, goal contribution significantly determined mastery approach goal(p<.01) and performance approach goal(.05). In standardized effects, the most powerful antecedent of mastery approach goal and performance approach goal were in order of organizational resource contribution(.27/.28), goal contribution(.21/.17), self-efficacy(.07/.06), and Y -theory human behavior and goal commitment(.05/.05), respectively. Moreover, goal contribution had a more powerful impact on mastery approach goal(.21) rather than performance approach goal(.17). In the preference of BSC, all job types preferred learning and growth index in first. In the second preference, medical doctors and pharmacists chose financial results, nurses customer service, and office managers internal processes. Each job type reflected its' own preferred BSC index to that of the other job types. In comparing a preference of four BSC index of each own job type, it was statistically different at p<.001. In conclusion, one who emphasize organizational goal contribution in pursuing goal orientation has a more strong orientation toward mastery approach goal rather than performance approach goal. A hospital should overcome and harmonize the different preferences of four BSC index since the differences might cause organizational conflicts among job types with having each unique professional norm.

Combining multi-task autoencoder with Wasserstein generative adversarial networks for improving speech recognition performance (음성인식 성능 개선을 위한 다중작업 오토인코더와 와설스타인식 생성적 적대 신경망의 결합)

  • Kao, Chao Yuan;Ko, Hanseok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.6
    • /
    • pp.670-677
    • /
    • 2019
  • As the presence of background noise in acoustic signal degrades the performance of speech or acoustic event recognition, it is still challenging to extract noise-robust acoustic features from noisy signal. In this paper, we propose a combined structure of Wasserstein Generative Adversarial Network (WGAN) and MultiTask AutoEncoder (MTAE) as deep learning architecture that integrates the strength of MTAE and WGAN respectively such that it estimates not only noise but also speech features from noisy acoustic source. The proposed MTAE-WGAN structure is used to estimate speech signal and the residual noise by employing a gradient penalty and a weight initialization method for Leaky Rectified Linear Unit (LReLU) and Parametric ReLU (PReLU). The proposed MTAE-WGAN structure with the adopted gradient penalty loss function enhances the speech features and subsequently achieve substantial Phoneme Error Rate (PER) improvements over the stand-alone Deep Denoising Autoencoder (DDAE), MTAE, Redundant Convolutional Encoder-Decoder (R-CED) and Recurrent MTAE (RMTAE) models for robust speech recognition.

A study on the development of a program to check the severity of dysphagia patients using the K-means algorithm (K-means 알고리즘을 통한 연하 곤란 환자의 심각도를 확인하는 프로그램 개발 연구)

  • Choi, Dong-gyu;Jang, Jong-Wook
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2019.05a
    • /
    • pp.104-107
    • /
    • 2019
  • Modern people have abundant food and various forms of life compared to the past, but they have come to form an unhealthy diet, such as skipping breakfast and not eating in time in a busy life. When these eating habits are maintained for a long time, it leads to digestive trouble. The most easily occurring symptoms are called reflux esophagitis and dysphagia. Among them, dysphagia requires quick and accurate diagnosis as they develop into various forms of complications or are also identified as presymptoms of gastric and laryngeal cancers. The result of the diagnosis is still passively judged by the doctor and each of results are different depending on the doctor. The result of the diagnosis here means the severity. When they identify treatment or complications following the results of the diagnosis, the wrong diagnosis may lead to excessive or insufficient treatment. In this paper, to figure out the severity of dysphagia in the diagnosis of dysphagia, we studied the development of a program using the K-means algorithm in the processing of X-ray images for identifying residual food in epiglottic vallecula and pyriform sinus in the section leading to esophagus.

  • PDF

KOCED performance evaluation in the wide field of wireless sensor network (무선센서망 내 KOCED 라우팅 프로토콜 광역분야 성능평가)

  • Kim, TaeHyeon;Park, Sea Young;Yun, Dai Yeol;Lee, Jong-Yong;Jung, Kye-Dong
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.2
    • /
    • pp.379-384
    • /
    • 2022
  • In a wireless sensor network, a large number of sensor nodes are deployed in an environment where direct access is difficult. It is difficult to supply power, such as replacing the battery or recharging it. It is very important to use the energy with the sensor node. Therefore, an important consideration to increase the lifetime of the network is to minimize the energy consumption of each sensor node. If the energy of the wireless sensor node is exhausted and discharged, it cannot function as a sensor node. Therefore, it is a method proposed in various protocols to minimize the energy consumption of nodes and maintain the network for a long time. We consider the center point and residual energy of the cluster, and the plot point and K-means (WSN suggests optimal clustering). We want to evaluate the performance of the KOCED protocol. We compare protocols to which the K-means algorithm, one of the latest machine learning methods, is applied, and present performance evaluation factors.

High-velocity ballistics of twisted bilayer graphene under stochastic disorder

  • Gupta, K.K.;Mukhopadhyay, T.;Roy, L.;Dey, S.
    • Advances in nano research
    • /
    • v.12 no.5
    • /
    • pp.529-547
    • /
    • 2022
  • Graphene is one of the strongest, stiffest, and lightest nanoscale materials known to date, making it a potentially viable and attractive candidate for developing lightweight structural composites to prevent high-velocity ballistic impact, as commonly encountered in defense and space sectors. In-plane twist in bilayer graphene has recently revealed unprecedented electronic properties like superconductivity, which has now started attracting the attention for other multi-physical properties of such twisted structures. For example, the latest studies show that twisting can enhance the strength and stiffness of graphene by many folds, which in turn creates a strong rationale for their prospective exploitation in high-velocity impact. The present article investigates the ballistic performance of twisted bilayer graphene (tBLG) nanostructures. We have employed molecular dynamics (MD) simulations, augmented further by coupling gaussian process-based machine learning, for the nanoscale characterization of various tBLG structures with varying relative rotation angle (RRA). Spherical diamond impactors (with a diameter of 25Å) are enforced with high initial velocity (Vi) in the range of 1 km/s to 6.5 km/s to observe the ballistic performance of tBLG nanostructures. The specific penetration energy (Ep*) of the impacted nanostructures and residual velocity (Vr) of the impactor are considered as the quantities of interest, wherein the effect of stochastic system parameters is computationally captured based on an efficient Gaussian process regression (GPR) based Monte Carlo simulation approach. A data-driven sensitivity analysis is carried out to quantify the relative importance of different critical system parameters. As an integral part of this study, we have deterministically investigated the resonant behaviour of graphene nanostructures, wherein the high-velocity impact is used as the initial actuation mechanism. The comprehensive dynamic investigation of bilayer graphene under the ballistic impact, as presented in this paper including the effect of twisting and random disorder for their prospective exploitation, would lead to the development of improved impact-resistant lightweight materials.