• Title/Summary/Keyword: PC Cluster

Search Result 266, Processing Time 0.024 seconds

Parallel Processing of k-Means Clustering Algorithm for Unsupervised Classification of Large Satellite Images: A Hybrid Method Using Multicores and a PC-Cluster (대용량 위성영상의 무감독 분류를 위한 k-Means Clustering 알고리즘의 병렬처리: 다중코어와 PC-Cluster를 이용한 Hybrid 방식)

  • Han, Soohee;Song, Jeong Heon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.37 no.6
    • /
    • pp.445-452
    • /
    • 2019
  • In this study, parallel processing codes of k-means clustering algorithm were developed and implemented in a PC-cluster for unsupervised classification of large satellite images. We implemented intra-node code using multicores of CPU (Central Processing Unit) based on OpenMP (Open Multi-Processing), inter-nodes code using a PC-cluster based on message passing interface, and hybrid code using both. The PC-cluster consists of one master node and eight slave nodes, and each node is equipped with eight multicores. Two operating systems, Microsoft Windows and Canonical Ubuntu, were installed in the PC-cluster in turn and tested to compare parallel processing performance. Two multispectral satellite images were tested, which are a medium-capacity LANDSAT 8 OLI (Operational Land Imager) image and a high-capacity Sentinel 2A image. To evaluate the performance of parallel processing, speedup and efficiency were measured. Overall, the speedup was over N / 2 and the efficiency was over 0.5. From the comparison of the two operating systems, the Ubuntu system showed two to three times faster performance. To confirm that the results of the sequential and parallel processing coincide with the other, the center value of each band and the number of classified pixels were compared, and result images were examined by pixel to pixel comparison. It was found that care should be taken to avoid false sharing of OpenMP in intra-node implementation. To process large satellite images in a PC-cluster, code and hardware should be designed to reduce performance degradation caused by file I / O. Also, it was found that performance can differ depending on the operating system installed in a PC-cluster.

Design of a Pipelined PC Cluster using Idle PCs on LAN (LAN상의 유휴 PC들을 사용한 파이프라인 방식의 PC Cluster의 설계)

  • Kim, Young-Gyun;Oh, Gil-Ho
    • Annual Conference of KIPS
    • /
    • 2003.11b
    • /
    • pp.1037-1040
    • /
    • 2003
  • 본 논문에서는 LAN 상에서 유휴 PC 들을 연산에 활용하는 PC Cluster 시스템에 대해 연구하였다. 특히, PC 실습실에 있는 PC 들의 유휴시간(Idle time)대를 이용하여 Cluster 연산에 사용함으로써 별도의 전용 클러스터 시스템을 설치하기 위한 하드웨어 및 설치 공간이 필요로 하지 않는다는 장점을 갖는다. PC 실습실의 PC 들은 주간에는 주로 교육 및 실습에 사용되며 오후 6시부터 오전 9시까지의 실습에 사용되지 않는 유휴시간을 CPU-Intensive 한 작업들을 병렬로 수행하는 PC Cluster로 구성하여 저가격의 고성능 시스템을 구축할 수 있다. 그리고 특정 연산을 전담하는 노드들을 지정하고 이 노드들의 연산 결과를 인접한 다른 노드들에게 전달함으로써 연속적인 다음 연산을 적용할 수 있도록 파이프라인(Pipeline) 형태로 구성한다. 파이프라인 형태의 PC Cluster 에서 연산을 겹침(Overlapped)으로서 처리량(Throughput)을 높일 수 있다. LAN으로 연결된 PC 실습실의 PC 들은 인터넷상의 연산 자원들보다 안정되고 신뢰성이 있기 때문에 복잡한 보안 기법을 사용하지 않아도 된다. 또한 연산시간이 유휴시간으로 고정되어 있기 때문에 네트워크의 부하 및 노드의 부하를 고려하는 복잡한 부하균등화 기법이나 스케줄링 기법이 필요로 하지 않는다.

  • PDF

Needs for PC-Cluster and its Applicable Fields (PC-Cluster 구축 및 활용)

  • Lee Sang-Moon;Yang Woo Jin;Shin Soon Chul
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2002.05a
    • /
    • pp.1-1
    • /
    • 2002
  • This abstract contains information of PC-Cluster systems that Samsung Advanced Institute of Technology (SAIT) have developed and researched since 1998. This paper introduce not only the reasons that why SAIT has been interested and focused in such system, but also where to SAIT has applied. There are many other applicable areas but this paper emphasis only in the fields of high performance computing and storage system. With the result of SAIT's PC-Cluster research, we hope we can create many new applicable areas with collaborations.

  • PDF

Design of an Efficient PC Cluster using a Very Large Idle PCs on Internet (인터넷상의 대규모 유휴 PC들을 사용한 효율적인 PC Cluster의 설계)

  • 김영균;최종욱;김용호;오길호
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2002.10e
    • /
    • pp.223-225
    • /
    • 2002
  • 본 논문에서는 인터넷 상에서 대규모의 유휴 PC들을 연산에 활용하는 PC Cluster시스템에 대해 연구하였다. 인터넷상의 노드는 i)이질적이고, ii)각 노드의 신뢰성이 확보되지 않는 특징을 갖는다. 또한 각각의 노드는 iii)지역 작업을 가질 수 있다. 작업 할당시 연산에 참여하는 노드의 이력 정보와 유휴상태를 함께 고려하여 작업을 할당함으로서 i), ii)를 고려한 PC클러스터링 방법을 제안하였다. 작업 할당시 노드의 이전 작업들의 처리에 대한신뢰성과, 작업 반환 시간을 고려하여 작업을 노드에 할당함으로써 신뢰성이 떨어지는 노드와 평균 반환 시간이 상대적으로 다른 노드들에 비해 큰 노드에 대해서 작업 할당을 가능한 줄임으로써 전체 작업의 신뢰성을 높일 수 있고 평균 작업 반환 시간을 단축시킬 수 있다. 제안한 방법에서는 iii)의 지역 작업을 가질 수 있는 인터넷상의 서로 다른 성능의 이질적인PC로 Cluster를 구축할 경우 보다 적합한 Self-Scheduling을 사용함으로서 효율적으로 작업할당이 가능하도록 하였다. 제안한 방법은 지역 작업을 갖고 있는 인터넷상의 대규모 PC들로 구성된 신뢰성 있는 PC클러스터 구축을 가능하도록 한다.

  • PDF

Construction of Highly Integrated PC Cluster based on Windows XP (높은 집적도를 가지는 Windows XP PC 클러스터 구축)

  • Lee S.-K.;Shin J.-R.;Choi J.-Y.
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2005.04a
    • /
    • pp.41-46
    • /
    • 2005
  • A new PC cluster was designed and constructed based on Windows XP Operating system. Primary target of the present design was the high node density per rack by using the general PC parts those are cost-effective and readily available in the market. Other major design points were system cooling and the convenient maintenance using standard PC parts. Presently 24 nodes per rack seems to be optimum considering the specification of the network switching device, system cooling and power supply, but 40 nodes can be accommodated within a single rack at maximum. Windows XP was selected as a high-performance computing environment considering the cost and the convenience in acquisition, maintenance and education. Both fast-Ethernet and Gigabit Ethernet network connection were tested and compared with previous data, especially for Linux doter using Myrinet. The result shows that there is no significant difference between the operating systems and the Fast-Ethernet and/or Gigabit Ethernet are good solution for the high-performance PC cluster considering the cost and performance.

  • PDF

Design and Performance of a CC-NUMA Prototype Card for SCI-Based PC Clustering (SCI 기반 PC 클러스터링을 위한 CC-NUMA 프로토타입 카드의 설계와 성능)

  • Oh, Soo-Cheol;Chung, Sang-Hwa
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.29 no.1
    • /
    • pp.35-41
    • /
    • 2002
  • It is extremely important to minimize network access time in constructing a high-performance PC cluster system For an SCI based PC cluster it is possilbe to reduce the network access time by maintaining network cache in each cluster node, This paper presents a CC-NUMA card that utilizes network cache for SCI based PC clustering The CC-NUMA card is directly plugged into the PCI solot of each node, and contains shared memory network cache, and interconnection modules. The network cache is maintained for the shared memory on the PCI bus of cluster nodes. The coherency mechanism between the network cache and the shared memory is based on the IEEE SCI standard. A CC-NUMA prototype card is developed to evaluate the performance of the system. According to the experiments. the cluster system with the CC-NUMA card showed considerable improvements compared with an SCI based clustser without network cache.

Design & Implementation of a Content-Based Image Retrieval System using a PC-Cluster (PC-Cluster를 사용한 내용기반의 화상 검색 시스템의 설계 및 구현)

  • Kim, Young-Gyun;Oh, Gil-Ho
    • Annual Conference of KIPS
    • /
    • 2004.05a
    • /
    • pp.1461-1464
    • /
    • 2004
  • 본 논문에서는 LAN 상에서 유휴 PC들을 사용하여 PC Cluster를 구성한 후 이를 사용한 내용기반의 화상 정보 검색(CBIR) 시스템에 관한 연구를 수행하였다. LAN 상의 유휴 PC 들은 인터넷상의 연산 자원들보다 안정되고 신뢰성이 있기 때문에 복잡한 보안 기법을 사용하지 않아도 되며 또한 연산시간이 유휴시간으로 고정되어 있기 때문에 네트워크의 부하 및 노드의 부하를 고려하는 복잡한 부하 균등화 기법이나 스케쥴링 기법이 필요로 하지 않는 특징을 갖는다. 내용기반의 화상 정보 검색은 화상 데이터의 대용량 특징으로 인해 화상 특징 추출 및 유사도 계산을 위해 많은 연산을 필요로 한다. 특히 다양한 내용기반의 정보 검색 서비스를 지원하기 위해 다중 특징(Multiple Features)을 동시에 추출하고자 할 때 연산시간은 급격히 증가한다. 따라서 이러한 내용 기반의 화상 정보 검색 시스템을 구현하기 위해 저비용의 고성능의 PC Cluster를 사용하여 전체 연산시간을 단축하고 실시간 정보검색이 가능하도록 하는 연구를 수행 하였다.

  • PDF

Implementation of Scheduling Strategies on PC Clusters (PC 클러스터에서 스케줄링 기법의 구현)

  • Kang Oh-Han;Song Hee-Heon;Chung Joong-Soo
    • The KIPS Transactions:PartA
    • /
    • v.11A no.7 s.91
    • /
    • pp.521-528
    • /
    • 2004
  • In this-paper, we propose a new task scheduling scheme for bus-based cluster architectures and analyze performance of the scheduling scheme which has been implemented in a PC cluster. The implemented scheme schedules the tasks of a task graph to the processors of a PC cluster, and it reduces parallel execution time by selectively duplicating critical tasks using heuristic. Experimental results show that the proposed scheduling scheme produces better parallel execution time than the other scheduling scheme.

The PC Clustering of the SIMD Structure for a Distributed Process of On-line Contingency (온라인 선로상정사고 분산처리를 위한 SIMD 구조의 PC 클러스터링)

  • Jang, Se-Hwan;Kim, Jin-Ho;Park, June-Ho
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.7
    • /
    • pp.1150-1156
    • /
    • 2008
  • This paper introduces the PC clustering of the SIMD structure for a distributed processing of on-line contingency to assess a static security of a power system. To execute on-line contingency analysis of a large-scale power system, we need to use high-speed execution device. Therefore, we constructed PC-cluster system using PC clustering method of the SIMD structure and applied to a power system, which relatively shows high quality on the high-speed execution and has a low price. SIMD(single instruction stream, multiple data stream) is a structure that processes are controlled by one signal. The PC cluster system is consisting of 8 PCs. Each PC employs the 2 GHz Pentium 4 CPU and is connected with the others through ethernet switch based fast ethernet. Also, we consider N-1 line contingency that have high potentiality of occurrence realistically. We propose the distributed process algorithm of the SIMD structure for reducing too much execution time on the on-line N-1 line contingency analysis in the large-scale power system. And we have verified a usefulness of the proposed algorithm and the constructed PC cluster system through IEEE 39 and 118 bus system.

A Study on a large-scale materials simulation using a PC networked cluster (PC Network Cluster를 사용한 대규모 재료 시뮬레이션에 관한 연구)

  • Choi, Deok-Kee;Ryu, Han-Kyu
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.30 no.5
    • /
    • pp.15-23
    • /
    • 2002
  • For molecular dynamics requires high-performance computers or supercomputers to handle huge amount of computation, it is not until recent days that the application of molecular dynamics to materials fracture simulations draw some attention from many researchers. With the recent advent of high-performance computers, computation intensive methods become more tractable than ever. However, carrying out materials simulation on high-performance computers costs too much in general. In this study, a PC cluster consisting of multiple commodity PCs is established and computer simulations of materials with cracks are carried out on it via molecular dynamics technique. The effect of the number of nodes, speedup factors, and communication time between nodes are measured to verify the performance of the PC cluster. Upon using the PC cluster, materials fracture simulations with more than 50,000 molecules are carried out successfully.