• Title/Summary/Keyword: 크로스 엔트로피

Search Result 11, Processing Time 0.024 seconds

Characteristics of Extended Cross-Entropy Error Function (확장된 크로스 엔트로피 오차함수의 특성)

  • Oh, Sang-Hoon
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2014.11a
    • /
    • pp.39-40
    • /
    • 2014
  • 신경회로망의 학습을 위하여 크로스 엔트로피 오차함수가 사용되며, 이의 성능향상을 위하여 확장된 크로스 엔트로피 함수도 제시되었다. 크로스 엔트로피 오차함수는 정보이론에서 제시된 상대 엔트로피(relative entropy)에서 유도된 함수이다. 상대 엔트로 피는 두 확률밀도함수의 발산(divergence) 함수이다. 이 논문에서는 상대 엔트로피와 크로스 엔트로피 관계를 파악한 후, 이를 기반으로 확장된 크로스 엔트로피에 상응하는 새로운 엔트로피 발산 함수를 n=2와 4인 경우에 대하여 유도한다.

  • PDF

Shadow Detection Based Intensity and Cross Entropy for Effective Analysis of Satellite Image (위성 영상의 효과적인 분석을 위한 밝기와 크로스 엔트로피 기반의 그림자 검출)

  • Park, Ki-hong
    • Journal of Advanced Navigation Technology
    • /
    • v.20 no.4
    • /
    • pp.380-385
    • /
    • 2016
  • Shadows are common phenomena observed in natural scenes and often bring a major problem that is affected negatively in colour image analysis. It is important to detect the shadow areas and should be considered in the pre-processing of computer vision. In this paper, the method of shadow detection is proposed using cross entropy and intensity image, and is performed in single image based on the satellite images. After converting the color image to a gray level image, the shadow candidate region has been estimated the optimal threshold value by cross entropy, and then the final shadow region has been detected using intensity image. For the validity of the proposed method, the satellite images is used to experiment. Some experiments are conducted so as to verify the proposed method, and as a result, shadow detection is well performed.

Adaptive Learning Rate and Limited Error Signal to Reduce the Sensitivity of Error Back-Propagation Algorithm on the n-th Order Cross-Entropy Error (오류 역전파 알고리즘의 n차 크로스-엔트로피 오차신호에 대한 민감성 제거를 위한 가변 학습률 및 제한된 오차신호)

  • 오상훈;이수영
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.6
    • /
    • pp.67-75
    • /
    • 1998
  • Although the nCE(n-th order cross-entropy) error function resolves the incorrect saturation problem of conventional EBP(error back-propagation) algorithm, the performance of MLP's (multilayer perceptrons) trained using the nCE function depends heavily on the order of the nCE function. In this paper, we propose an adaptive learning rate to make the performance of MLP's insensitive to the order of the nCE error. Additionally, we propose a limited error signal of output node to prevent unstable learning due to the adaptive learning rate. The effectiveness of the proposed method is demonstrated in simulations of handwritten digit recognition and thyroid diagnosis tasks.

  • PDF

Prior distributions using the entropy principles (엔트로피 이론을 이용한 사전 확률 분포함수의 추정)

  • Lee, Jung-Jin;Shin, Wan-Seon
    • The Korean Journal of Applied Statistics
    • /
    • v.3 no.2
    • /
    • pp.91-105
    • /
    • 1990
  • Several practical prior distributions are derived using the maximum entropy principle. Also, an interactive method for estimating a prior distribution which uses the minimum cross-entropy principle is proposed when there are many prior informations. The consistency of the prior distributions obtained by the entropy principles is discussed.

  • PDF

Histogram Bin Number Selection Method Robust to the Variations of Channel Occupancy for Cross Entropy (크로스 엔트로피 기반 스펙트럼 센싱에서 채널 점유 시간 변화에 따른 히스토그램 Bin 개수 선택 기법)

  • Yong, Seulbaro;Jang, Sung-Jeen;Kim, Jae-Moung
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.12 no.1
    • /
    • pp.88-97
    • /
    • 2013
  • Most of the traditional spectrum sensing methods consider only the current detected data sets of Primary User (PU). However previous state of PU is a kind of conditional probability that strengthens the reliability of the detector. Therefore, in the cross entropy spectrum sensing method, relationship of the previous and current spectrum sensing is considered to detect PU signal more effectively. But these cross entropy spectrum sensing methods only consider the ideal system. In other words, PU always occupy the channel during the same period. However, PU can occupy the channel either for a longer or a shorter period than the ideal case in the real system. For this reason, the spectrum sensing performance can be varied. In this paper, we propose the method that can maintain the performance of spectrum sensing in the real system and we confirm the results with the help of simulation.

An Efficient Motion Compensation Algorithm for Video Sequences with Brightness Variations (밝기 변화가 심한 비디오 시퀀스에 대한 효율적인 움직임 보상 알고리즘)

  • 김상현;박래홍
    • Journal of Broadcast Engineering
    • /
    • v.7 no.4
    • /
    • pp.291-299
    • /
    • 2002
  • This paper proposes an efficient motion compensation algorithm for video sequences with brightness variations. In the proposed algorithm, the brightness variation parameters are estimated and local motions are compensated. To detect the frame with large brightness variations. we employ the frame classification based on the cross entropy between histograms of two successive frames, which can reduce the computational redundancy. Simulation results show that the proposed method yields a higher peak signal to noise ratio (PSNR) than the conventional methods, with a low computational load, when the video scene contains large brightness changes.

An Efficient Video Coding Algorithm Applying Brightness Variation Compensation (밝기변화 보상을 적용한 효율적인 비디오 코딩 알고리즘)

  • Kim Sang-Hyun
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.5 no.4
    • /
    • pp.287-293
    • /
    • 2004
  • This paper proposes an efficient motion compensation algorithm for video sequences with brightness variations. In the proposed algorithm, the brightness variation parameters are estimated and local motions are compensated. To detect the frame with large brightness variations, we employ the frame classification based on the cross entropy between histograms of two successive frames, which can reduce the computational redundancy. Simulation results show that the proposed method yields a higher peak signal to noise ratio (PSNR) than that of the conventional methods, with a low computational load, when the video scene contains large brightness changes.

  • PDF

Deep Learning-Based Chest X-ray Corona Diagnostic Algorithm (딥러닝 기반 흉부엑스레이 코로나 진단 알고리즘)

  • Kim, June-Gyeom;Seo, Jin-Beom;Cho, Young-Bok
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.73-74
    • /
    • 2021
  • 코로나로 인해 X-ray, CT, MRI와 같은 의료영상 분야에서 딥러닝을 많이 접목시키고 있다. 간단히 접할 수 있는 X-ray 영상으로 코로나 진단을 위해 CNN, R-CNN 등과 같은 영상 딥러닝 분야에서 많은 연구가 진행되고 있다. 의료영상 기반 딥러닝 학습은 바이오마커를 정확히 찾아내고, 최소한의 손실률과 높은 정확도를 필요로한다, 따라서 본 논문에서는 높은 정확도를 위한 학습 모델을 선정하고 실험을 진행하였다.

  • PDF

Moving Picture Compression using Frame Classification by Luminance Characteristics (명암특성에 따른 프레임 분류를 이용한 동영상 압축기법)

  • Kim, Sang-Hyun
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.4
    • /
    • pp.51-56
    • /
    • 2011
  • This paper proposes an efficient moving picture compression for video sequences with luminance variations. In the proposed algorithm, the luminance variation parameters are estimated and local motions are compensated. To detect the frame required luminance compensation, we employ the frame classification based on the cross entropy between histograms of two successive frames, which can reduce the computational redundancy. Simulation results show that the proposed method yields a higher peak signal to noise ratio (PSNR) than that of the conventional methods, with a low computational load, when the video scene contains large luminance variations.

Image Restoration Algorithms by using Fisher Information (피셔 인포메이션을 이용한 영상 복원 알고리즘)

  • 오춘석;이현민;신승중;유영기
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.41 no.6
    • /
    • pp.89-97
    • /
    • 2004
  • An object to reflect or emit light is captured by imaging system as distorted image due to various distortion. It is called image restoration that estimates original object by removing distortion. There are two categories in image restoration method. One is a deterministic method and the other is a stochastic method. In this paper, image restoration using Minimum Fisher Information(MFI), derived from B. Roy Frieden is proposed. In MFI restoration, experimental results to be made according to noise control parameter were investigated. And cross entropy(Kullback-Leibler entropy) was used as a standard measure of restoration accuracy, It is confirmed that restoration results using MFI have various roughness according to noise control parameter.