• 제목/요약/키워드: network storage

검색결과 1,073건 처리시간 0.024초

큐잉 네트워크 모델을 적용한 저장용량 분석 시뮬레이션 (Simulation of Storage Capacity Analysis with Queuing Network Models)

  • 김용수
    • 한국컴퓨터정보학회논문지
    • /
    • 제10권4호
    • /
    • pp.221-228
    • /
    • 2005
  • 데이터 저장장치는 서버의 내부나 근처에 있는 것으로 인식되어 왔으나 네트워크 기술의 발달로 저장장치 시스템은 주 전산기와 원거리에 떨어져 존재할 수 있게 되었다. 인터넷 시대에 데이터 량의 폭발적인 증가는 데이터를 저장하는 시스템과 이를 전송하는 시스템의 균형 있는 발전을 요구하고 있으며 SAN(Storage Area Network)이나 NAS(Network Attached Storage)은 이러한 요구를 반영하고 있다. 저장장치로부터 최적의 성능을 도출하기 위해서 복잡한 저장 네트워크의 용량과 한계를 파악하는 것이 중요하다. 파악된 데이터는 성능 조율의 기초가 되고 저장장치의 구매 시점을 결정하는데 사용될 수도 있다. 본 논문에서는 저장 네트워크 시스템의 큐잉 네트워크를 통한 분석적 모델을 제시한 다음, 이의 시뮬레이션하여 분석적 모델이 정당하다는 것을 입증한다.

  • PDF

군 USN 환경에서 효율적인 데이터 저장 및 질의 처리 방법 연구 (Efficient Data Storage & Query Processing Methods in Military Ubiquitous Sensor Networks)

  • 권영모;최현식;정연돈
    • 한국군사과학기술학회지
    • /
    • 제13권5호
    • /
    • pp.875-885
    • /
    • 2010
  • Recently, the role of Ubiquitous Sensor Network(USN) has been considered to be essential for supporting the near future Network Centric Warfare(NCW) and Tactical Information Communication Network(TICN). In this paper, we explore a set of data storage methods(external storage, local storage and data storage) and query processing methods in WSN. In particular, we focus on analyzing a novel data structure for supporting the local storage method, named the partial ordered tree(POT). The main idea behind POT is that sensor readings are usually correlated with the physical spatial domain. With the help of POT, only a small portion of sensor nodes participate in query processing tasks, and thus network lifetime is greatly increased. Through a series of simulation experiments, we demonstrate that the POT based local storage method clearly outperforms the existing data storage methods in terms of the energy-efficiency, which directly affects the network lifetime, for processing exact match queries, range queries and top-k queries.

네트워크 컴퓨팅 기술을 활용한 확장 가능형 빅데이터 스토리지 시스템 개발 (Development of scalable big data storage system using network computing technology)

  • 박정규;박은영
    • 한국정보통신학회논문지
    • /
    • 제23권11호
    • /
    • pp.1330-1336
    • /
    • 2019
  • 4차 혁명시대가 시작됨에 따라 다양한 장비들이 클라우드 기반으로 동작하고 있다. 이와 기기들은 다양한 형태의 데이터 또는 대용량의 멀티미디어 데이터를 계속 생성하고 있다. 이런 상황을 처리하기 위해서는 대용량의 저장장치가 필요하며 또한 저장된 데이터를 처리하고 정확한 정보를 얻기 위해서 빅데이터 기술이 필요하다. 일반적으로 네트워크 환경에서 대용량의 저장장치를 구축하기 위해서는 SAN 또는 NAS 기술이 사용된다. 본 논문에서는 DAS(Direct Attached Storage)의 확장기술인 Network-DAS를 사용하여 대용량 저장장치를 구성하는 방안을 제시한다. 논문에서 제시하는 스토리지 시스템의 확장성과 성능을 검증하기 위해 76개의 하드 디스크를 이용하여 벤치마크 실험을 수행하였다. 실험 결과 제안하는 고성능 대용량 스토리지 시스템의 확장성과 신뢰성을 검증하였다.

대용량 Abyss Storage의 KOREN 네트워크 기반 국내 및 해외 실증 테스트 (KOREN based Domestic and International Verification Test of Mass Abyss Storage)

  • 차병래;차윤석;최명수;박선;김종원
    • 스마트미디어저널
    • /
    • 제6권1호
    • /
    • pp.9-15
    • /
    • 2017
  • ICT 분야의 메가 트렌드는 IoT, Bigdata, 그리고 Cloud Computing 으로 집약된다. 이러한 메가 트렌드들은 독립적으로 운영되지 않으며, 이를 지원하기 위한 백그라운드에는 대용량 컴퓨팅 기술이 필요하듯 대용량 스토리지 기술이 필수적이다. 오픈소스 Ceph 기반의 대용량 스토리지의 성능 평가를 위하여 교육망인 KOREN 네트워크를 이용한 국내 및 해외 사이트와의 Abyss Storage의 실증 테스트를 수행한다. 또한, 스토리지 자체의 성능 평가를 위하여 스토리지 매체와 네트워크 본딩의 성능 테스트를 수행한다. 스토리지 매체별로 실질적인 속도 차이는 크지만 수행된 스토리지 매체 테스트에서는 크게 성능 차이를 보이지 않았다. 이를 해결하기 위한 방안으로 네트워크 가속화를 통한 성능 향상을 얻을 수 있었다. 또한 KOREN 망을 이용한 국내 및 해외 사이트를 연결하여 Abyss Storage의 내부 및 외부 네트워크의 실질적인 성능 테스트를 수행하였다.

Coding-based Storage Design for Continuous Data Collection in Wireless Sensor Networks

  • Zhan, Cheng;Xiao, Fuyuan
    • Journal of Communications and Networks
    • /
    • 제18권3호
    • /
    • pp.493-501
    • /
    • 2016
  • In-network storage is an effective technique for avoiding network congestion and reducing power consumption in continuous data collection in wireless sensor networks. In recent years, network coding based storage design has been proposed as a means to achieving ubiquitous access that permits any query to be satisfied by a few random (nearby) storage nodes. To maintain data consistency in continuous data collection applications, the readings of a sensor over time must be sent to the same set of storage nodes. In this paper, we present an efficient approach to updating data at storage nodes to maintain data consistency at the storage nodes without decoding out the old data and re-encoding with new data. We studied a transmission strategy that identifies a set of storage nodes for each source sensor that minimizes the transmission cost and achieves ubiquitous access by transmitting sparsely using the sparse matrix theory. We demonstrate that the problem of minimizing the cost of transmission with coding is NP-hard. We present an approximation algorithm based on regarding every storage node with memory size B as B tiny nodes that can store only one packet. We analyzed the approximation ratio of the proposed approximation solution, and compared the performance of the proposed coding approach with other coding schemes presented in the literature. The simulation results confirm that significant performance improvement can be achieved with the proposed transmission strategy.

Network Coding for Energy-Efficient Distributed Storage System in Wireless Sensor Networks

  • Wang, Lei;Yang, Yuwang;Zhao, Wei;Lu, Wei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제7권9호
    • /
    • pp.2134-2153
    • /
    • 2013
  • A network-coding-based scheme is proposed to improve the energy efficiency of distributed storage systems in WSNs (Wireless Sensor Networks). We mainly focus on two problems: firstly, consideration is given to effective distributed storage technology; secondly, we address how to effectively repair the data in failed storage nodes. For the first problem, we propose a method to obtain a sparse generator matrix to construct network codes, and this sparse generator matrix is proven to be the sparsest. Benefiting from this matrix, the energy consumption required to implement distributed storage is reduced. For the second problem, we designed a network-coding-based iterative repair method, which adequately utilizes the idea of re-encoding at intermediate nodes from network coding theory. Benefiting from the re-encoding, the energy consumption required by data repair is significantly reduced. Moreover, we provide an explicit lower bound of field size required by this scheme, which implies that it can work over a small field and the required computation overhead is very low. The simulation result verifies that the proposed scheme not only reduces the total energy consumption required to implement distributed storage system in WSNs, but also balances energy consumption of the networks.

토러스 연결망 기반의 대용량 멀티미디어용 분산 스토리지 시스템 (Torus Network Based Distributed Storage System for Massive Multimedia Contents)

  • 김재열;김동오;김홍연;김영균;서대화
    • 한국멀티미디어학회논문지
    • /
    • 제19권8호
    • /
    • pp.1487-1497
    • /
    • 2016
  • Explosively growing service of digital multimedia data increases the need for highly scalable low-cost storage. This paper proposes the new storage architecture based on torus network which does not need network switch and erasure coding for efficient storage usage for high scalability and efficient disk utilization. The proposed model has to compensate for the disadvantage of long network latency and network processing overhead of torus network. The proposed storage model was compared to two most popular distributed file system, GlusterFS and Ceph distributed file systems through a prototype implementation. The performance of prototype system shows outstanding results than erasure coding policy of two file systems and mostly even better results than replication policy of them.

분산형 저류시설의 실시간 네트워크 제어기술 적용시 고려 사항 (Methods for an application of real-time network control on distributed storage facilities)

  • 백현욱;류재나;오재일;김태형
    • 상하수도학회지
    • /
    • 제27권6호
    • /
    • pp.711-721
    • /
    • 2013
  • Optimal operation of a combined sewer network with distributed storage facilities aims to use the whole retention capacity of all reservoirs efficiently before overflows take place somewhere in the considered network system. An efficient real-time network control (RTNC) strategy has been emerging as an attractive approach for reducing substantially the overflows from a sewer network compared to the conventional fixed or manually adjusted gate setting method, but the related concrete framework for RTC development has not been throughly introduced so far. The main goal of this study is to give a detailed description of the RTNC systems via reviewing several guidelines published abroad, and finally to suggest methods for the proper application of RTNC on distributed storage facilities. Especially, this study is focused on emphasizing the importance of hierarchical structure of RTNC system that consists of three control layers (management, global control and local control). Further, with regard to the global control layer which is responsible for the central overall network control, the wide-ranging details of two components (adaption and optimization layers) are also presented. This study can provide the valuable basis for the RTNC implementation in the particular sewer network with distributed multiple storage facilities.

A Network Storage LSI Suitable for Home Network

  • Lim, Han-Kyu;Han, Ji-Ho;Jeong, Deog-Kyoon
    • JSTS:Journal of Semiconductor Technology and Science
    • /
    • 제4권4호
    • /
    • pp.258-262
    • /
    • 2004
  • Storage over Ethernet (SoE) is a network storage architecture that allows direct attachment of existing ATA/ATAPI devices to Ethernet without a separate server. Unlike SAN, no server computer intervenes between the storage and the client hosts. We propose a SoE disk controller (SoEDC) amenable to low-cost, single-chip implementation that processes a simplified L3/L4 protocol and converts commands between Ethernet and ATA/ATAPI, while the rest of the complex tasks are performed by the remote hosts. Thanks to simple architecture and protocol, the SoEDC implemented on a single $4mm{\times}4mm$ chip in 0.18um CMOS technology achieves maximum throughput of 55MB/s on Gigabit Ethernet, which is comparable to that of a high-performance disk storage locally attached to a host computer.

대용량 콘텐츠의 저장관리시스템에 관한 연구 (A Study on storage management system for the contents of great quantity)

  • 조윤희
    • 경영과정보연구
    • /
    • 제11권
    • /
    • pp.45-69
    • /
    • 2002
  • One of important technology that must improve compulsorily on information-oriented society stores, search and transmit cultural contents data of great quantity in heterogeneous environment. SAN appeared by solution to resolve the problem such as integration management of heterogeneous system data, effective practical use of storage, data transmission limit is happened from here. SAN is system that manage and shares data of large quantity efficiently attaching directly to high speed network such as Fiber Channel that storage system has been attached to server individually SAN became more complicated than existent storage environment although offer much advantage such as decrease of storage expense and flexibility of system configuration. This study argues management way could consider in such environment that understand complexity and component of networked storage system.

  • PDF