• Title/Summary/Keyword: Heterogeneous Server

Search Result 184, Processing Time 0.03 seconds

Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance

  • Choi, Do Young;Oh, Jung Hwan;Kim, Ji Kwang;Lee, Seung Eun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.12
    • /
    • pp.4648-4663
    • /
    • 2020
  • This paper proposes the Lempel-Ziv 4(LZ4) compression accelerator optimized for scale-out servers in data centers. In order to reduce CPU loads caused by compression, we propose an accelerator solution and implement the accelerator on an Field Programmable Gate Array(FPGA) as heterogeneous computing. The LZ4 compression hardware accelerator is a fully pipelined architecture and applies 16 dictionaries to enhance the parallelism for high throughput compressor. Our hardware accelerator is based on the 20-stage pipeline and dictionary architecture, highly customized to LZ4 compression algorithm and parallel hardware implementation. Proposing dictionary architecture allows achieving high throughput by comparing input sequences in multiple dictionaries simultaneously compared to a single dictionary. The experimental results provide the high throughput with intensively optimized in the FPGA. Additionally, we compare our implementation to CPU implementation results of LZ4 to provide insights on FPGA-based data centers. The proposed accelerator achieves the compression throughput of 639MB/s with fine parallelism to be deployed into scale-out servers. This approach enables the low power Intel Atom processor to realize the Hadoop storage along with the compression accelerator.

Online Monitoring of Ship Block Construction Equipment Based on the Internet of Things and Public Cloud: Take the Intelligent Tire Frame as an Example

  • Cai, Qiuyan;Jing, Xuwen;Chen, Yu;Liu, Jinfeng;Kang, Chao;Li, Bingqiang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.11
    • /
    • pp.3970-3990
    • /
    • 2021
  • In view of the problems of insufficient data collection and processing capability of multi-source heterogeneous equipment, and low visibility of equipment status at the ship block construction site. A data collection method for ship block construction equipment based on wireless sensor network (WSN) technology and a data processing method based on edge computing were proposed. Based on the Browser/Server (B/S) architecture and the OneNET platform, an online monitoring system for ship block construction equipment was designed and developed, which realized the visual online monitoring and management of the ship block construction equipment status. Not only that, the feasibility and reliability of the monitoring system were verified by using the intelligent tire frame system as the application object. The research of this project can lay the foundation for the ship block construction equipment management and the ship block intelligent construction, and ultimately improve the quality and efficiency of ship block construction.

Development of a 4S Multiple Media Switching Server and an Information Exchange System (4S 다중매체 스위칭 서버와 육해상 정보교환 시스템 개발)

  • Mun, Seong-Mi;Jang, Won-Seok;Son, Joo Yong;Yang, Gyu-Sik
    • Journal of Navigation and Port Research
    • /
    • v.37 no.3
    • /
    • pp.275-281
    • /
    • 2013
  • Ship Standard Network was submitted as a common subject of e-navigation by 81th IMO MSC 2005. This agenda was given an official status with strategy planning of e-navigation for Ship Standard Network after approval of WG program of 81th MSC 2006. Nowadays approximately 400 heterogeneous navigation and communication equipments are working on ships at sea. Standardization of ship network is to support exchanging various data efficiently. Among them, 4S network is defined as a wireless communication network between ship to ship and ship to shore which provides unceasing communication channel ship to shore. It has been expected to trigger various services and applications based on 4S network. However, no technologies and products has been appeared at fields yet. but now there's not specific technologies and developing products. In this paper, We developed a 4S multiple media switching server and a ship-land information exchange system to overcome the heterogeneity and provide efficient communication environments.. The performance of the implemented system was verified by TTA(Telecommunications Technology Association) V&V(Verification and Validation).

Optimal Server Allocation to Parallel Queueing Systems by Computer Simulation (컴퓨터 시뮬레이션을 이용한 병렬 대기행렬 시스템의 최적 서버 배치 방안)

  • Park, Jin-Won
    • Journal of the Korea Society for Simulation
    • /
    • v.24 no.3
    • /
    • pp.37-44
    • /
    • 2015
  • A queueing system with 2 parallel workstations is common in the field. Typically, the workstations have different features in terms of the inter arrival times of customers and the service times for the customers. Computer simulation study on the optimal server allocation for parallel heterogeneous queueing systems with fixed number of identical servers is presented in this paper. The queueing system is optimized with respect to minimizing the weighted system time of the customers served by 2 parallel workstations. The system time formula for the M/M/c systems in Kendall's notation is known. Thus, we first compute the optimal allocation for parallel M/M/c systems, comparing the results with those from the computer simulation experiments, and have the same results. The CETI rule is devised through optimizing M/M/c cases, which allocates the servers based on Close or Equal Traffic Intensities between workstations. Traffic intensity is defined as the arrival rate divided by the service rate times the number of servers. The CETI rule is shown to work for M/G/c, G/M/c queueing systems by numerous computer simulation experiments, even if the rule cannot be proven analytically. However, the CETI rule is shown not to work for some of G/G/c systems.

Design of MAHA Supercomputing System for Human Genome Analysis (대용량 유전체 분석을 위한 고성능 컴퓨팅 시스템 MAHA)

  • Kim, Young Woo;Kim, Hong-Yeon;Bae, Seungjo;Kim, Hag-Young;Woo, Young-Choon;Park, Soo-Jun;Choi, Wan
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.2 no.2
    • /
    • pp.81-90
    • /
    • 2013
  • During the past decade, many changes and attempts have been tried and are continued developing new technologies in the computing area. The brick wall in computing area, especially power wall, changes computing paradigm from computing hardwares including processor and system architecture to programming environment and application usage. The high performance computing (HPC) area, especially, has been experienced catastrophic changes, and it is now considered as a key to the national competitiveness. In the late 2000's, many leading countries rushed to develop Exascale supercomputing systems, and as a results tens of PetaFLOPS system are prevalent now. In Korea, ICT is well developed and Korea is considered as a one of leading countries in the world, but not for supercomputing area. In this paper, we describe architecture design of MAHA supercomputing system which is aimed to develop 300 TeraFLOPS system for bio-informatics applications like human genome analysis and protein-protein docking. MAHA supercomputing system is consists of four major parts - computing hardware, file system, system software and bio-applications. MAHA supercomputing system is designed to utilize heterogeneous computing accelerators (co-processors like GPGPUs and MICs) to get more performance/$, performance/area, and performance/power. To provide high speed data movement and large capacity, MAHA file system is designed to have asymmetric cluster architecture, and consists of metadata server, data server, and client file system on top of SSD and MAID storage servers. MAHA system softwares are designed to provide user-friendliness and easy-to-use based on integrated system management component - like Bio Workflow management, Integrated Cluster management and Heterogeneous Resource management. MAHA supercomputing system was first installed in Dec., 2011. The theoretical performance of MAHA system was 50 TeraFLOPS and measured performance of 30.3 TeraFLOPS with 32 computing nodes. MAHA system will be upgraded to have 100 TeraFLOPS performance at Jan., 2013.

S-FDS : a Smart Fire Detection System based on the Integration of Fuzzy Logic and Deep Learning (S-FDS : 퍼지로직과 딥러닝 통합 기반의 스마트 화재감지 시스템)

  • Jang, Jun-Yeong;Lee, Kang-Woon;Kim, Young-Jin;Kim, Won-Tae
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.54 no.4
    • /
    • pp.50-58
    • /
    • 2017
  • Recently, some methods of converging heterogeneous fire sensor data have been proposed for effective fire detection, but the rule-based methods have low adaptability and accuracy, and the fuzzy inference methods suffer from detection speed and accuracy by lack of consideration for images. In addition, a few image-based deep learning methods were researched, but it was too difficult to rapidly recognize the fire event in absence of cameras or out of scope of a camera in practical situations. In this paper, we propose a novel fire detection system combining a deep learning algorithm based on CNN and fuzzy inference engine based on heterogeneous fire sensor data including temperature, humidity, gas, and smoke density. we show it is possible for the proposed system to rapidly detect fire by utilizing images and to decide fire in a reliable way by utilizing multi-sensor data. Also, we apply distributed computing architecture to fire detection algorithm in order to avoid concentration of computing power on a server and to enhance scalability as a result. Finally, we prove the performance of the system through two experiments by means of NIST's fire dynamics simulator in both cases of an explosively spreading fire and a gradually growing fire.

Design and Implementation of a Spatio-Temporal Middleware for Ubiquitous Environments (유비쿼터스 환경을 위한 시공간 미들웨어의 설계 및 구현)

  • Kim, Jeong-Joon;Jeong, Yeon-Jong;Kim, Dong-Oh;Han, Ki-Joon
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.43-54
    • /
    • 2009
  • As R&D(Research and Development) is going on actively to develop technologies for the ubiquitous computing environment, which Is the human-oriented future computing environment, GIS dealing with spatio-temporal data is emerging as a promising technology. This also increases the necessity of the middleware for providing services to give interoperability in various heterogeneous environments. The core technologies of the middleware are real-time processing technology of data streams coming unceasingly from positioning systems and data stream processing technology developed for non-spatio-temporal data. However, it has problems in processing queries on spatio-temporal data efficiently. Accordingly, this paper designed and implemented the spatio-temporal middleware that provides interoperability between a mobile spatio-temporal DBMS(DataBase Management System) and a server spatio-temporal MMDBMS(Main Memory DataBase Management System). The spatio-temporal middleware maintains interoperability among heterogeneous devices and guarantees data integrity in query processing through real-time processing of unceasing spatio-temporal data streams and two way synchronization of spatio-temporal DBMSs. In addition, it manages session for the connection of each spatio-temporal DBMS and manages resources for its stable operation. Finally, this paper proved the usability of the spatio-temporal middleware by applying it to a real-time position tracking system.

  • PDF

Application of OGC WPS 2.0 to Geo-Spatial Web Services (공간정보 웹 서비스에서 OGC WPS 2.0 적용)

  • YOON, Goo-Seon;LEE, Ki-Won
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.19 no.3
    • /
    • pp.16-28
    • /
    • 2016
  • Advancing geo-spatial web technologies and their applications require compatible and interoperable heterogeneous browsers and platforms. Reduction of common or supporting components for web-based system development is also necessary. If properly understood and applied, OGC-based standards can be utilized as effective solutions for these problems. Thus, OGC standards are central to the design and development of web-based geo-spatial systems, and are particularly applicable to web services, which contain data processing modules. However, the application for OGC WPS 2.0 is at an early stage as compared with other OGC standards; thus, this study describes a test implementation of a web-based geo-spatial processing system with OGC WPS 2.0 focused on asynchronous processing functionality. While a binary thresholding algorithm was tested in this system, further experiments with other processing modules can be performed on requests for many types of processing from multiple users. The client system of the implemented product was based on open sources such as jQuery and OpenLayers, and server-side running on Spring framework also used various types of open sources such as ZOO project, and GeoServer. The results of geo-spatial image processing by this system implies further applicability and extensibility of OGC WPS 2.0 on user interfaces for practical applications.

Design and Implementation of Internet GIS based on ObjectWeb (ObjectWeb을 기반으로 한 Internet GIS의 설계 및 구현)

  • Kang, Myoung-Soo;Choy, Yoon-Chul;Koh, Kyun
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.6 no.4
    • /
    • pp.441-447
    • /
    • 2000
  • In this paper, we design and implement an Internet GIS based on ObjectWeb, which makes to use various distributed services and object paradigm. We use CORBA, which is the standard of distributed object middleware and supports interoperability and reusability regardless of the execution environment and the implementation language of a distributed code, so that it easily extends established systems in networking environment and accesses distributed heterogeneous spatial data. Our method distributes parts of user interactive tasks to clients to reduce and to improve the system performance while existing approaches concentrate all workloads on a server. We implement a travel information system on the developed IGIS. Users receive services from remote servers employing a Java client system running on a web browser.

  • PDF

Optimizing Performance and Energy Efficiency in Cloud Data Centers Through SLA-Aware Consolidation of Virtualized Resources (클라우드 데이터 센터에서 가상화된 자원의 SLA-Aware 조정을 통한 성능 및 에너지 효율의 최적화)

  • Elijorde, Frank I.;Lee, Jaewan
    • Journal of Internet Computing and Services
    • /
    • v.15 no.3
    • /
    • pp.1-10
    • /
    • 2014
  • The cloud computing paradigm introduced pay-per-use models in which IT services can be created and scaled on-demand. However, service providers are still concerned about the constraints imposed by their physical infrastructures. In order to keep the required QoS and achieve the goal of upholding the SLA, virtualized resources must be efficiently consolidated to maximize system throughput while keeping energy consumption at a minimum. Using ANN, we propose a predictive SLA-aware approach for consolidating virtualized resources in a cloud environment. To maintain the QoS and to establish an optimal trade-off between performance and energy efficiency, the server's utilization threshold dynamically adapts to the physical machine's resource consumption. Furthermore, resource-intensive VMs are prevented from getting underprovisioned by assigning them to hosts that are both capable and reputable. To verify the performance of our proposed approach, we compare it with non-optimized conventional approaches as well as with other previously proposed techniques in a heterogeneous cloud environment setup.