• 대한수학회지
• /
• 제50권4호
• /
• pp.879-897
• /
• 2013

Shannon entropy is one of the widely used randomness measures especially for cryptographic applications. However, the conventional entropy tests are less sensitive to the inter-bit dependency in random samples. In this paper, we propose new online randomness test schemes for true random number generators (TRNGs) based on the mutual information between consecutive ${\kappa}$-bit output blocks for testing of inter-bit dependency in random samples. By estimating the block entropies of distinct lengths at the same time, it is possible to measure the mutual information, which is closely related to the amount of the statistical dependency between two consecutive data blocks. In addition, we propose a new estimation method for entropies, which accumulates intermediate values of the number of frequencies. The proposed method can estimate entropy with less samples than Maurer-Coron type entropy test can. By numerical simulations, it is shown that the new proposed scheme can be used as a reliable online entropy estimator for TRNGs used by cryptographic modules.

• Nuclear Engineering and Technology
• /
• 제54권4호
• /
• pp.1261-1270
• /
• 2022

This study was conducted to investigate the possibility of using gaze entropy to evaluate an operator's situation awareness in an emergency accident situation of a nuclear power plant. Gaze entropy can be an effective measure for evaluating an operator's situation awareness at a nuclear power plant because it can express gaze movement as a single comprehensive number. In order to determine the relationship between situation awareness and gaze entropy for an emergency accident situation of a nuclear power plant, an experiment was conducted to measure situation awareness and gaze entropy using simulators created for emergency accident situations LOCA, SGTR, SLB, and LOV. The experiment was to judge the accident situation of nuclear power plants presented in the simulator. The results showed that situation awareness and Shannon, dwell time, and Markov entropy had a significant negative correlation, while visual attention entropy (VAE) did not show any significant correlation with situation awareness. The results determined that Shannon entropy, dwell time entropy, and Markov entropy could be used as measures to evaluate situation awareness.

• 한국환경과학회지
• /
• 제22권11호
• /
• pp.1473-1479
• /
• 2013

Entropy is a measure of disorder or uncertainty. This terminology is qualitatively used in the understanding of its correlation to pollution in the environmental area. In this research, three different entropies were defined and characterized in order to quantify the qualitative entropy previously used in the environmental science. We are dealing with newly defined distinct entropies $E_1$, $E_2$, and $E_3$ originated from Shannon entropy in the information theory, reflecting concentration of three major green house gases $CO_2$, $N_2O$ and $CH_4$ represented as the probability variables. First, $E_1$ is to evaluate the total amount of entropy from concentration difference of each green house gas with respect to three periods, due to industrial revolution, post-industrial revolution, and information revolution, respectively. Next, $E_2$ is to evaluate the entropy reflecting the increasing of the logarithm base along with the accumulated time unit. Lastly, $E_3$ is to evaluate the entropy with a fixed logarithm base by 2 depending on the time. Analytical results are as follows. $E_1$ shows the degree of prediction reliability with respect to variation of green house gases. As $E_1$ increased, the concentration variation becomes stabilized, so that it follows from linear correlation. $E_2$ is a valid indicator for the mutual comparison of those green house gases. Although $E_3$ locally varies within specific periods, it eventually follows a logarithmic curve like a similar pattern observed in thermodynamic entropy.

• Environmental Engineering Research
• /
• 제17권3호
• /
• pp.167-174
• /
• 2012

In situ particle size spectra are obtained from two sequent cruises in order to evaluate the physical consequences of suspended particulate matters caused by episodic storm runoff from the Santa Ana River watershed, an urbanized coastal watershed. Suspended particles from various sources including surface runoff, near-bed resuspension, and phytoplankton are identified in empirical orthogonal function (EOF) analysis and an entropy-based parameterization (Shannon entropy). The first EOF mode is associated with high turbidity and fine particles as indicated by the elevated beam attenuation near the Santa Ana River and Newport Bay outlets, and the second EOF mode explains the suspended sediment dispersal and particle coarsening at the near-surface plume. Chlorophyll particles are also distinguished by negative magnitudes of the first EOF mode, which is supported by the relationship between fluorescence and beam attenuation. The integrated observation between the first EOF mode and the Shannon entropy index accentuates the characteristics of two different structures and/or sources of sediment particles; the near-surface plumes are originated from runoff water outflow, while the near-bottom particles are resuspended due to increased wave heights or mobilizing bottom turbidity currents. In a coastal pollution context, these methods may offer useful means of characterizing particle-associated pollutants for purposes of source tracking and environmental interpretation.

• 한국문헌정보학회지
• /
• 제6권
• /
• pp.87-103
• /
• 1979

Information storage and retrieval is a part of general communication process. In the Shannon's information theory, information contained in a message is a measure of -uncertainty about information source and the amount of information is measured by entropy. Indexing is a process of reducing entropy of information source since document collection is divided into many smaller groups according to the subjects documents deal with. Significant concepts contained in every document are mapped into the set of all sets of index terms. Thus index itself is formed by paired sets of index terms and documents. Without indexing the entropy of document collection consisting of N documents is $log_2\;N$, whereas the average entropy of smaller groups $(W_1,\;W_2,...W_m)$ is as small $(as\;(\sum\limits^m_{i=1}\;H(W_i))/m$. Retrieval efficiency is a measure of information system's performance, which is largely affected by goodness of index. If all and only documents evaluated relevant to user's query can be retrieved, the information system is said $100\%$ efficient. Document file W may be potentially classified into two sets of relevant documents and non-relevant documents to a specific query. After retrieval, the document file W' is reclassified into four sets of relevant-retrieved, relevant-not retrieved, non-relevant-retrieved and non-relevant-not retrieved. It is shown in the paper that the difference in two entropies of document file Wand document file W' is a proper measure of retrieval efficiency.

• 문화기술의 융합
• /
• 제8권4호
• /
• pp.415-422
• /
• 2022

이기종인 온주감귤 유전자(A=20.57, C=32.71, G=30.01, U=16.71%)와 커피 유전자(A=20.66, C=31.76, G=30.187, U=16.71%)는 95%이상이 유전자비가 동일하다. 이기종이면 일반적으로 유전자 결합이 안 되는 것으로 알려졌다. 그러나 유전자 기능적-유사성이 95%이상에서 Chargaff 룰과 Shannon Entropy 조건을 만족하면 접목이 가능하며, 새품종인 Coffrange가 된다. 우리는 DNA-RNA를 세계최초 BCJM 행렬로 풀어 미국특허 및 국제저널에 발표했다. 모든 동식물과 바이러스도 사람이 유전자와 비슷하다. 이점에 착안, 코로나-19와 인체의 유전자 특성을 풀어 영국 행렬교재에 6월 발표했다. 식물에서는 유전자 위치를 쉽게 바꾸는 기법인 BCJM-Transposon으로 처리한다. 시뮬레션에서는 행렬이 Cut & Paste와 Transpose로 성공할 수 있음을 예측했다.

• 대한전자공학회논문지SP
• /
• 제49권1호
• /
• pp.11-18
• /
• 2012

본 논문에서는 고 전송률에서도 구현이 가능한 엔트로피 제한(entropy constrained) 벡터양자기를 제안하였다. 양자화는 프로덕트 부호책에 기초한 프로덕트 표본 적응 양자기(sample-adaptive product quantizer)를 사용하여 엔트로피 제한 SAPQ(ECSAPQ) 설계 알고리듬을 제안하고 실험을 통하여 성능을 비교해 보았다. 제안한 ECSAPQ는 비슷한 복잡도의 엔트로피 제한 VQ보다 약 0.5dB 정도 성능이 좋음을 알 수 있었다. 또한 스칼라 양자기에 기초한 ECSAPQ는 Shannon의 최저 왜곡 곡선과 1.53dB의 차이를 가지는 ECSQ의 고 전송률에서의 이론 곡선보다 더 낮은 왜곡 곡선을 가짐을 확인할 수 있었다.

• 산업경영시스템학회지
• /
• 제40권3호
• /
• pp.7-17
• /
• 2017

Loan consultants assist clients with loan application processing and loan decisions. Their duties may include contacting people to ask if they want a loan, meeting with loan applicants and explaining different loan options. We studied the efficiency of service quality of loan consultants contracted to a bank in Korea. They do not work as a team, but do work independently. Since he/she is not an employee of the bank, the consultant is paid solely in proportion to how much he/she sell loans. In this study, a consultant is considered as a decision making unit (DMU) in the DEA (Data Envelopment Analysis) model. We use a principal component analysis-data envelopment analysis (PCA-DEA) model integrated with Shannon's Entropy to evaluate quality efficiency of the consultants. We adopt a three-stage process to calculate the efficiency of service quality of the consultants. In the first stage, we use PCA to obtain 6 synthetic indicators, including 4 input indicators and 2 output indicators, from survey results in which questionnaire items are constructed on the basis of SERVQUAL model. In the second stage, 3 DEA models allowing negative values are used to calculate the relative efficiency of each DMU. In the third stage, the weight of each result is calculated on the basis of Shannon's Entropy theory, and then we generate a comprehensive efficiency score using it. An example illustrates the proposed process of evaluating the relative quality efficiency of the loan consultants and how to use the efficiency to improve the service quality of the consultants.

• Communications for Statistical Applications and Methods
• /
• 제13권3호
• /
• pp.657-667
• /
• 2006

The concept of entropy, introduced in communication theory by Shannon (1948) as a measure of uncertainty, is of prime interest in information-theoretic statistics. This paper considers the minimum variance unbiased estimation for the maximum entropy of the transformed inverse Gaussian random variable by $Y=X^{-1/2}$. The properties of the derived UMVU estimator is investigated.

• 대한전자공학회논문지
• /
• 제12권2호
• /
• pp.1-10
• /
• 1975

본 논문은 사진데이타에 쉽게 적용할수있는 한 adaptive data compression 방법을 노표시하였다. 이웃 sample data 사이의 높은 correlation때문에 발생할 부호화 복잡성을 간편한 sample difference data로 대처하였으며, 자단의 statistical nonstationarity에 적응키 위해서 여덟가지 부호(code)로 구성된 code set중에서 최적부호를 선택토록 하였다. code erst는 두가지 등장부호와 여섯가지 보완형 Shannon-Fanro 부호로 되었다. difference data의 확률분포는 Laplacian model로, entropy의 확률분포는 Gaussian model대 하였다. 부호선별 Paranleter로서 entropy와 Pr[차이값=0]=Po를 비교하였다. 콤퓨타 실험결과 이 adaptive coding 방법으로 2대 1의 데이타 감축비를 얻었다. 이 방법은 fixed coding에 비해서 데이타 감축비와 부호화효율에서 약 10%와 15%의 이득을 주었다. 또한 도는 entropy보다 휠신 편리한 부호선별 parameter인 중시에 entropy 경우와 1% 내외의 좋은 결과를 얻을수 있음이 확인되었다. This paper presents an adaptive data compression algorithm for video data. The coling complexity due to the high correlation in the given data sequence is alleviated by coding the difference data, sequence rather than the data sequence itself. The adaptation to the nonstationary statistics of the data is confined within a code set, which consists of two constant length cades and six modified Shannon·Fano codes. lt is assumed that the probability distributions of tile difference data sequence and of the data entropy are Laplacian and Gaussion, respectively. The adaptive coding performance is compared for two code selection criteria: entropy and pr[difference value=0]=po. It is shown that data compression ratio 2 : 1 is achievable with the adaptive coding. The gain by the adaptive coding over the fixed coding is shown to be about 10% in compression ratio and 15% in code efficiency. In addition, po is found to he not only a convenient criterion for code selection, but also such efficient a parameter as to perform almost like entropy.