• Title/Summary/Keyword: Cross-Entropy Method

Search Result 60, Processing Time 0.029 seconds

Minimum Entropy Deconvolution을 이용한 지하수 상대 재충진양의 시계열 추정법

  • 김태희;이강근
    • Proceedings of the Korean Society of Soil and Groundwater Environment Conference
    • /
    • 2003.09a
    • /
    • pp.574-578
    • /
    • 2003
  • There are so many methods to estimate the groundwater recharge. These methods can be categorized into four groups. First groupis related to the water balance analysis, second group is concerned with baseflow/springflow recession, and third group is interested in some types of tracers; environmental tracers and/or temperature profile. The limitation of these types of methods is that the estimated results of recharge are presented in the form of an average over some time period. Forth group has a little different approach. They use the time series data of hydraulic head and specific yield evaluated from field test, and the results of estimation are described in the sequential form. But their approach has a serious problem. The estimated results in forth typeof methods are generally underestimated because they cannot consider the discharge phase of water table fluctuation coupled with the recharge phase. Ketchum el. at. (2000) proposed calibrated method, considering recharge- and discharge-coupled water table fluctuation. But the dischargeis considered just as the areal average with discharge rate. On the other hand, there are many methods to estimate the source wavelet with observed data set in geophysics/signal processing and geophysical methods are rarely applied to the estimation of groundwater recharge. The purpose this study is the evaluation of the applicability of one of the geophysical method in the estimation of sequential recharge rate. The applied geophysical method is called minimum entropy deconvolution (MED). For this purpose, numerical modeling with linearized Boussinesq equation was applied. Using the synthesized hydraulic head through the numerical modeling, the relative sequenceof recharge is calculated inversely. Estimated results are very concordant with the applied recharge sequence. Cross-correlations between applied recharge sequence and the estimated results are above 0.985 in all study cases. Through the numerical test, the availability of MED in the estimation of the recharge sequence to groundwater was investigated

  • PDF

Learning of multi-layer perceptrons with 8-bit data precision (8비트 데이타 정밀도를 가지는 다층퍼셉트론의 역전파 학습 알고리즘)

  • 오상훈;송윤선
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.4
    • /
    • pp.209-216
    • /
    • 1996
  • In this paper, we propose a learning method of multi-layer perceptrons (MLPs) with 8-bit data precision. The suggested method uses the cross-entropy cost function to remove the slope term of error signal in output layer. To decrease the possibility of overflows, we use 16-bit weighted sum results into the 8-bit data with appropriate range. In the forwared propagation, the range for bit-conversion is determined using the saturation property of sigmoid function. In the backwared propagation, the range for bit-conversion is derived using the probability density function of back-propagated signal. In a simulation study to classify hadwritten digits in the CEDAR database, our method shows similar generalization performance to the error back-propagation learning with 16-bit precision.

  • PDF

Development of Correlation Based Feature Selection Method by Predicting the Markov Blanket for Gene Selection Analysis

  • Adi, Made;Yun, Zhen;Keong, Kwoh-Chee
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2005.09a
    • /
    • pp.183-187
    • /
    • 2005
  • In this paper, we propose a heuristic method to select features using a Two-Phase Markov Blanket-based (TPMB) algorithm. The first phase, filtering phase, of TPMB algorithm works by filtering the obviously redundant features. A non-linear correlation method based on Information theory is used as a metric to measure the redundancy of a feature [1]. In second phase, approximating phase, the Markov Blanket (MB) of a system is estimated by employing the concept of cross entropy to identify the MB. We perform experiments on microarray data and report two popular dataset, AML-ALL [3] and colon tumor [4], in this paper. The experimental results show that the TPMB algorithm can significantly reduce the number of features while maintaining the accuracy of the classifiers.

  • PDF

Calculating the Threshold Energy of the Pulsed Laser Sintering of Silver and Copper Nanoparticles

  • Lee, Changmin;Hahn, Jae W.
    • Journal of the Optical Society of Korea
    • /
    • v.20 no.5
    • /
    • pp.601-606
    • /
    • 2016
  • In this study, in order to analyze the low-temperature sintering process of silver and copper nanoparticles, we calculate their melting temperatures and surface melting temperatures with respect to particle size. For this calculation, we introduce the concept of mean-squared displacement of the atom proposed by Shi (1994). Using a parameter defined by the vibrational component of melting entropy, we readily obtained the surface and bulk melting temperatures of copper and silver nanoparticles. We also calculated the absorption cross-section of nanoparticles for variation in the wavelength of light. By using the calculated absorption cross-section of the nanoparticles at the melting temperature, we obtained the laser threshold energy for the sintering process with respect to particle size and wavelength of laser. We found that the absorption cross-section of silver nanoparticles has a resonant peak at a wavelength of close to 350 nm, yielding the lowest threshold energy. We calculated the intensity distribution around the nanoparticles using the finite-difference time-domain method and confirmed the resonant excitation of silver nanoparticles near the wavelength of the resonant peak.

Methodology to Verify the Unpredictability of True Random Number Generators (실난수 발생기 통계적 예측 불가능성 확인 방법)

  • Moon-Seok Kim;Seung-Bae Jeon
    • Convergence Security Journal
    • /
    • v.24 no.2
    • /
    • pp.123-132
    • /
    • 2024
  • In the era of the Internet of Things, 7 billion diverse devices have been interconnected worldwide. Ensuring information security across these varied devices is crucial in this hyper-connected age. To achieve essential security functions such as confidentiality, integrity, and authentication, it is imperative to implement true random number generators (TRNGs). Therefore, this study proposes a method to rapidly characterize the randomness of TRNGs. While there are international standards for formally characterizing the randomness of TRNGs, adhering to these standards often requires significant time and resources. This study aims to help TRNG developers enhance efficiency in both time and cost by characterizing rough randomness and unpredictability. Firstly, we propose applying auto-correlation and cross-correlation metrics for analog signals. Secondly, we suggest adopting joint entropy and mutual information metrics for digital signals.

Finite Element Analysis and Experimental Verification for the Cold-drawing of a FCC-based High Entropy Alloy (FCC계 고엔트로피 합금의 냉간 인발 유한요소해석 및 실험적 검증)

  • Cho, H.S.;Bae, S.J.;Na, Y.S.;Kim, J.H.;Lee, D.G.;Lee, K.S.
    • Transactions of Materials Processing
    • /
    • v.29 no.3
    • /
    • pp.163-171
    • /
    • 2020
  • We present a multi-step cold drawing for a non-equiatomic Co10Cr15Fe25Mn10Ni30V10 high entropy alloy (HEA) with a simple face-centered cubic (FCC) crystal structure. The distribution of strain in the cold-drawn Co10Cr15Fe25Mn10Ni30V10 HEA wires was analyzed by the finite element method (FEM). The effective strain was expected to be higher as it was closer to the surface of the wire. However, the reverse shear strain acted to cause a transition in the shear strain behavior. The critical effective strain at which the shear strain transition behavior is completely shifted was predicted to be 4.75. Severely cold-drawn Co10Cr15Fe25Mn10Ni30V10 HEA wires up to 96% of the maximum cross-sectional reduction ratio were successfully manufactured without breakage. With the assistance of electron back-scattering diffraction and transmission electron microscope analyses, the abundant deformation twins were found in the region of high effective strain, which is a major strengthening mechanism for the cold-drawn Co10Cr15Fe25Mn10Ni30V10 HEA wire.

A Statistical Perspective of Neural Networks for Imbalanced Data Problems

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.7 no.3
    • /
    • pp.1-5
    • /
    • 2011
  • It has been an interesting challenge to find a good classifier for imbalanced data, since it is pervasive but a difficult problem to solve. However, classifiers developed with the assumption of well-balanced class distributions show poor classification performance for the imbalanced data. Among many approaches to the imbalanced data problems, the algorithmic level approach is attractive because it can be applied to the other approaches such as data level or ensemble approaches. Especially, the error back-propagation algorithm using the target node method, which can change the amount of weight-updating with regards to the target node of each class, attains good performances in the imbalanced data problems. In this paper, we analyze the relationship between two optimal outputs of neural network classifier trained with the target node method. Also, the optimal relationship is compared with those of the other error function methods such as mean-squared error and the n-th order extension of cross-entropy error. The analyses are verified through simulations on a thyroid data set.

An Adaptive Learning Rate with Limited Error Signals for Training of Multilayer Perceptrons

  • Oh, Sang-Hoon;Lee, Soo-Young
    • ETRI Journal
    • /
    • v.22 no.3
    • /
    • pp.10-18
    • /
    • 2000
  • Although an n-th order cross-entropy (nCE) error function resolves the incorrect saturation problem of conventional error backpropagation (EBP) algorithm, performance of multilayer perceptrons (MLPs) trained using the nCE function depends heavily on the order of nCE. In this paper, we propose an adaptive learning rate to markedly reduce the sensitivity of MLP performance to the order of nCE. Additionally, we propose to limit error signal values at out-put nodes for stable learning with the adaptive learning rate. Through simulations of handwritten digit recognition and isolated-word recognition tasks, it was verified that the proposed method successfully reduced the performance dependency of MLPs on the nCE order while maintaining advantages of the nCE function.

  • PDF

An Efficient Motion Compensation Algorithm for Video Sequences with Brightness Variations (밝기 변화가 심한 비디오 시퀀스에 대한 효율적인 움직임 보상 알고리즘)

  • 김상현;박래홍
    • Journal of Broadcast Engineering
    • /
    • v.7 no.4
    • /
    • pp.291-299
    • /
    • 2002
  • This paper proposes an efficient motion compensation algorithm for video sequences with brightness variations. In the proposed algorithm, the brightness variation parameters are estimated and local motions are compensated. To detect the frame with large brightness variations. we employ the frame classification based on the cross entropy between histograms of two successive frames, which can reduce the computational redundancy. Simulation results show that the proposed method yields a higher peak signal to noise ratio (PSNR) than the conventional methods, with a low computational load, when the video scene contains large brightness changes.

Precise segmentation of fetal head in ultrasound images using improved U-Net model

  • Vimala Nagabotu;Anupama Namburu
    • ETRI Journal
    • /
    • v.46 no.3
    • /
    • pp.526-537
    • /
    • 2024
  • Monitoring fetal growth in utero is crucial to anomaly diagnosis. However, current computer-vision models struggle to accurately assess the key metrics (i.e., head circumference and occipitofrontal and biparietal diameters) from ultrasound images, largely owing to a lack of training data. Mitigation usually entails image augmentation (e.g., flipping, rotating, scaling, and translating). Nevertheless, the accuracy of our task remains insufficient. Hence, we offer a U-Net fetal head measurement tool that leverages a hybrid Dice and binary cross-entropy loss to compute the similarity between actual and predicted segmented regions. Ellipse-fitted two-dimensional ultrasound images acquired from the HC18 dataset are input, and their lower feature layers are reused for efficiency. During regression, a novel region of interest pooling layer extracts elliptical feature maps, and during segmentation, feature pyramids fuse field-layer data with a new scale attention method to reduce noise. Performance is measured by Dice similarity, mean pixel accuracy, and mean intersection-over-union, giving 97.90%, 99.18%, and 97.81% scores, respectively, which match or outperform the best U-Net models.