• Title/Summary/Keyword: Data Partition

Search Result 415, Processing Time 0.025 seconds

Declustering of High-dimensional Data by Cyclic Sliced Partitioning (주기적 편중 분할에 의한 다차원 데이터 디클러스터링)

  • Kim Hak-Cheol;Kim Tae-Wan;Li Ki-Joune
    • Journal of KIISE:Databases
    • /
    • v.31 no.6
    • /
    • pp.596-608
    • /
    • 2004
  • A lot of work has been done to reduce disk access time in I/O intensive systems, which store and handle massive amount of data, by distributing data across multiple disks and accessing them in parallel. Most of the previous work has focused on an efficient mapping from a grid cell to a disk number on the assumption that data space is regular grid-like partitioned. Although we can achieve good performance for low-dimensional data by grid-like partitioning, its performance becomes degenerate as grows the dimension of data even with a good disk allocation scheme. This comes from the fact that they partition entire data space equally regardless of distribution ratio of data objects. Most of the data in high-dimensional space exist around the surface of space. For that reason, we propose a new declustering algorithm based on the partitioning scheme which partition data space from the surface. With an unbalanced partitioning scheme, several experimental results show that we can remarkably reduce the number of data blocks touched by a query as grows the dimension of data and a query size. In this paper, we propose disk allocation schemes based on the layout of the resultant data blocks after partitioning. To show the performance of the proposed algorithm, we have performed several experiments with different dimensional data and for a wide range of number of disks. Our proposed disk allocation method gives a performance within 10 additive disk accesses compared with strictly optimal allocation scheme. We compared our algorithm with Kronecker sequence based declustering algorithm, which is reported to be the best among the grid partition and mapping function based declustering algorithms. We can improve declustering performance up to 14 times as grows dimension of data.

A Study on the Development of Analytical Methods and Behaviors of Environmental Pollutants ( I ) : Elution Behavior of Monosubstituted Phenols and Benzenes by Micellar Reversed-Phase Liquid Chromatography (환경 오염물질의 정량법 개발과 거동에 관한 연구 ( I ) : 미셀 역상 액체 크로마토그래피에서 페놀과 벤젠 일치환체들의 용리거동)

  • Lee, Dai Woon;Bang, Eun Jung;Cho, Byung Yun
    • Analytical Science and Technology
    • /
    • v.6 no.1
    • /
    • pp.1-8
    • /
    • 1993
  • The purpose of this study is to investigate the elution behavior of monosubstituted phenols and benzenes in micellar liquid chromatographic system, $C_{18}$ column-anionic surfactant, sodium dodecyl sulfate(SDS). The partition coefficients between the micellar pseudophase-water and modified stationary phase-water are calculated by the relationship between solute retention and micellar mobile phase(SDS) composition. The free energy of transfer of solute from water to micelle is also calculated from these values. There is a direct correlation between the hydrophobicity parameters in MLC and corresponding partition data for 1-octanol-water, which indicates that the hydrophobicity of molecules plays an important role in the partition for both systems and that quantitative structure activity relationships(QSAR) are available from studies on micellar partition. The other purpose of this study is to investigate methylene selectivity of alkyl homologous series through correlation between retention and the number of carbons. The correlation between hydrophobicity parameters in MLC and 1-octanol-water partition data was also observed when n-propanol was as a modifier in the mobile phase.

  • PDF

An Improvement of Partition-Based Spatial Merge Join using Dynamic Object Decomposition (동적 객체 분해를 이용한 분할 기반의 공간 합병 조인의 개선)

  • Choi, Yong-Jin;Lee, Yong-Ju;Park, Ho-Hyun;Lee, Sung-Jin;Chung, Chin-Wan
    • Journal of KIISE:Databases
    • /
    • v.27 no.2
    • /
    • pp.247-255
    • /
    • 2000
  • Traditional object decomposition techniques do not decompose spatial objects dynamically during spatial joins, because the object decomposition is very expensive. In this paper, we propose a modified object decomposition technique that can be applied in PBSM(Partition Based Spatial Merge-Join). In real-life data, there are much differences among the sizes of objects. We decompose only large objects with great effects on spatial joins. This technique decreases the decomposition cost of objects during spatial joins and enables efficient filter-refinement steps. Experiments show that the PBSM used with our proposed method performs significantly better than the traditional PBSM.

  • PDF

Development of a Linear Stability Analysis Model for Vertical Boiling Channels Connecting with Unheated Risers

  • Hwang, Dae-Hyun;Yoo, Yeon-Jong;Zee, Seong-Quun
    • Nuclear Engineering and Technology
    • /
    • v.31 no.6
    • /
    • pp.572-585
    • /
    • 1999
  • The characteristics of two-phase flow instability in a vertical boiling channel connecting with an unheated riser are investigated through the linear stability analysis model. Various two-phase flow models, including thermal non-equilibrium effects, are taken into account for establishing a physical model in the time domain. A classical approach to the frequency response method is adopted for the stability analysis by employing the D-partition method. The adequacy of the linear model is verified by evaluating experimental data at high quality conditions. It reveals that the flow-pattern-dependent drift velocity model enhances the prediction accuracy while the homogeneous equilibrium model shows the most conservative predictions. The characteristics of density wave oscillations under low-power and low-quality conditions are investigated by devising a simple model which accounts for the gravitational and frictional pressure losses along the channel. The necessary conditions for the occurrences of type-I instability and flow excursion are deduced from the one-dimensional D-partition analysis. The parametric effects of some design variables on low quality oscillations are also investigated.

  • PDF

A Hash based R-Tree for Fast Search of Mass Spatial Data (대용량 공간 데이터의 빠른 검색을 위한 해시 기반 R-Tree)

  • Kang, Hong-Koo;Kim, Joung-Joon;Shin, In-Su;Han, Ki-Joon
    • Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
    • /
    • 2008.10a
    • /
    • pp.82-89
    • /
    • 2008
  • 최근, GIS 분야에서 RFID와 GPS 센서 같은 위치 및 공간 데이타를 포함하는 다양한 GeoSensor의 활용으로 수집되는 공간 데이타가 크게 증가하면서, 대용량 공간 데이타의 빠른 처리를 위한 공간 인덱스의 중요성이 높아지고 있다. 특히, 대표적인 공간 인덱스인 R-Tree를 기반으로 검색 성능을 높이기 위한 연구가 활발히 진행되고 있다. 그러나, 기존 연구는 R-Tree에서 노드의 MBR 간의 겹침이나 트리 높이를 어느 정도 줄임으로써 다소 검색 성능을 향상시켰지만, 트리 검색에서 발생하는 불필요한 노드 접근 비용 문제를 효율적으로 해결하지 못하고 있다. 본 논문에서는 이러한 문제를 해결하고 R-Tree에서 대용량 공간 데이타의 빠른 검색을 제공하는 인덱스인 HR-Tree(Hash based R-Tree)를 제시한다. HR-Tree는 트리 검색 없이 R-Tree 리프 노드를 직접 접근할 수 있는 해시 테이블을 이용함으로써 R-Tree의 검색 성능을 높인다. 해시 테이블은 데이타 영역을 차원에 따라 반복적으로 분할한 Partition과 대응되는 R-Tree 리프 노드의 MBR과 포인터들로 구성된다. 각 Partition은 생성 과정에서 고유의 식별 코드를 갖기 때문에 Partition 코드가 주어지면 해시 테이블에서 해당 레코드를 쉽게 접근할 수 있다. 또한, HR-Tree는 R-Tree구조의 변경없이 다양한 R-Tree 변형 구조에 쉽게 적용할 수 있는 장점이 있다. 마지막으로 실험을 통하여 HR-Tree의 우수성을 입증하였다.

  • PDF

ESTIMATION OF RAIN SCAVENGING RATIO FOR PARTICLE BOUND POLYCYCLIC AROMATIC HYDROCARBONS AND POLYCHLORINATED BIPHENYLS

  • Kim, Hyeon-Kook;Shin, Yong-Seung;Lee, Dong-Soo;Song, Byung-Joo;Kim, Jong-Guk
    • Environmental Engineering Research
    • /
    • v.11 no.1
    • /
    • pp.33-44
    • /
    • 2006
  • The objective of this study was to develop and assess a method for estimating the rain scavenging ratios (RSRs) of particle-bound PAHs and PCBs using measured scavenging ratio of particulate matters (PM) and routinely available data of physico-chemical properties of PM. Paired atmospheric and rainwater sampling was conducted for a total of 4 rain events. Assuming equilibrium partitioning in rainwater-gas-PM system, an equation was derived for estimating the RSR of particle-bound chemicals as a function of RSR of PM and three equilibrium partition constants (i.e. dimensionless Henry's law constant, gas-particle partition coefficient, and water-particle partition coefficient). For all PAHs, the model significantly under-predicted the RSR while the model prediction for PCBs agreed with observation mostly within a factor of 5. The RSR model for the chemicals is of limited use as its accuracy critically depends on how close the observed partitioning of the chemicals in the gas-PM-rainwater system is to that estimated under the equilibrium assumption.

A Study on Heat Source Model to Creep Feed Grinding (크?피드 연삭에서 열원 모델에 관한 연구)

  • Jeong, Jong-Dal;Jeong, Hae-Do;Choe, Heon-Jong;Kim, Nam-Gyeong
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.18 no.2
    • /
    • pp.171-176
    • /
    • 2001
  • This study focuses on the energy partition and heat flux distribution in creep-feed grinding. From the measurements of transient grinding temperature in the workpiece which the thermocouple was embedded, the overall energy partition to the workpiece was estimated with moving heat source theory using the developed scalene triangle heat model. The energy partition was calculated as 3.75% in down grinding smaller than 5.3% in up grinding. Also, the scalene triangle heat model was confirmed as the most optional heat model in correspond to the experimental data. Then, the heat flux distribution was calculated from temperature responses. The heat flux is negative behind the grinding zone where fluid was applied. In this experimental result, the total heat flow to the workpiece per unit width obtained by integrating the positive heat flux was 0,7W/mm for down grinding.

  • PDF

Ethernet-Based Avionic Databus and Time-Space Partition Switch Design

  • Li, Jian;Yao, Jianguo;Huang, Dongshan
    • Journal of Communications and Networks
    • /
    • v.17 no.3
    • /
    • pp.286-295
    • /
    • 2015
  • Avionic databuses fulfill a critical function in the connection and communication of aircraft components and functions such as flight-control, navigation, and monitoring. Ethernet-based avionic databuses have become the mainstream for large aircraft owning to their advantages of full-duplex communication with high bandwidth, low latency, low packet-loss, and low cost. As a new generation aviation network communication standard, avionics full-duplex switched ethernet (AFDX) adopted concepts from the telecom standard, asynchronous transfer mode (ATM). In this technology, the switches are the key devices influencing the overall performance. This paper reviews the avionic databus with emphasis on the switch architecture classifications. Based on a comparison, analysis, and discussion of the different switch architectures, we propose a new avionic switch design based on a time-division switch fabric for high flexibility and scalability. This also merges the design concept of space-partition switch fabric to achieve reliability and predictability. The new switch architecture, called space partitioned shared memory switch (SPSMS), isolates the memory space for each output port. This can reduce the competition for resources and avoid conflicts, decrease the packet forwarding latency through the switch, and reduce the packet loss rate. A simulation of the architecture with optimized network engineering tools (OPNET) confirms the efficiency and significant performance improvement over a classic shared memory switch, in terms of overall packet latency, queuing delay, and queue size.

A Heuristic Polynomial Time Algorithm for Crew Scheduling Problem

  • Lee, Sang-Un
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.11
    • /
    • pp.69-75
    • /
    • 2015
  • This paper suggests heuristic polynomial time algorithm for crew scheduling problem that is a kind of optimization problems. This problem has been solved by linear programming, set cover problem, set partition problem, column generation, etc. But the optimal solution has not been obtained by these methods. This paper sorts transit costs $c_{ij}$ to ascending order, and the task i and j crew paths are merged in case of the sum of operation time ${\Sigma}o$ is less than day working time T. As a result, we can be obtain the minimum number of crews $_{min}K$ and minimum transit cost $z=_{min}c_{ij}$. For the transit cost of specific number of crews $K(K>_{min}K)$, we delete the maximum $c_{ij}$ as much as the number of $K-_{min}K$, and to partition a crew path. For the 5 benchmark data, this algorithm can be gets less transit cost than state-of-the-art algorithms, and gets the minimum number of crews.

Relationship between BrACs and BACs of Healthy Koreans for BAIIDs

  • SeungHwan Yi;BeomWoo Nam;Jeong-seok Seo
    • Journal of Sensor Science and Technology
    • /
    • v.33 no.1
    • /
    • pp.1-6
    • /
    • 2024
  • This study aims to suggest the partition ratio (Q-factor) of healthy Koreans and the comparison results of breath alcohol concentration (BAC) measurements using two methods (photoacoustic and electrochemical methods) for developing breath alcohol ignition interlock devices (BAIIDs). Given the relationship between BACs and BrACs and the Q-factor, the alcohol metabolism of healthy Koreans (96 males and 91 females) is revealed for understanding the digestion of alcohol and surveying the fundamental data of alcohol-related problems, CO2 concentrations vs. alcohol concentrations, and the performance of alcohol sensors in the marketplace. The average Q-factor of healthy Korean males and females are 1,913 (95% confidence interval from 1,889-1,937) and 1,991 (95% confidence interval from 1,945-2,036). Photoacoustic measurements could be applied to predict the BACs of drinkers, which is confirmed by the Bland-Altman plots presented in this study. The biases based on the partition ratios (Q=1,913 and Q=1,991) in the Bland-Altman plots were -0.0004% (95% CI from -0.0011 to +0.0003% for males) and -0.0017% (95% CI from -0.020 to +0.017% for females).