• 제목/요약/키워드: Data storage

검색결과 4,528건 처리시간 0.034초

BoxBroker: A Policy-Driven Framework for Optimizing Storage Service Federation

  • Heinsen, Rene;Lopez, Cindy;Huh, Eui-Nam
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권1호
    • /
    • pp.340-367
    • /
    • 2018
  • Storage services integration can be done for achieving high availability, improving data access performance and scalability while preventing vendor lock-in. However, multiple services environment management and interoperability have become a critical issue as a result of service architectures and communication interfaces heterogeneity. Storage federation model provides the integration of multiple heterogeneous and self-sufficient storage systems with a single control point and automated decision making about data distribution. In order to integrate diverse heterogeneous storage services into a single storage pool, we are proposing a storage service federation framework named BoxBroker. Moreover, an automated decision model based on a policy-driven data distribution algorithm and a service evaluation method is proposed enabling BoxBroker to make optimal decisions. Finally, a demonstration of our proposal capabilities is presented and discussed.

Optimization of Data Placement using Principal Component Analysis based Pareto-optimal method for Multi-Cloud Storage Environment

  • Latha, V.L. Padma;Reddy, N. Sudhakar;Babu, A. Suresh
    • International Journal of Computer Science & Network Security
    • /
    • 제21권12호
    • /
    • pp.248-256
    • /
    • 2021
  • Now that we're in the big data era, data has taken on a new significance as the storage capacity has exploded from trillion bytes to petabytes at breakneck pace. As the use of cloud computing expands and becomes more commonly accepted, several businesses and institutions are opting to store their requests and data there. Cloud storage's concept of a nearly infinite storage resource pool makes data storage and access scalable and readily available. The majority of them, on the other hand, favour a single cloud because of the simplicity and inexpensive storage costs it offers in the near run. Cloud-based data storage, on the other hand, has concerns such as vendor lock-in, privacy leakage and unavailability. With geographically dispersed cloud storage providers, multicloud storage can alleviate these dangers. One of the key challenges in this storage system is to arrange user data in a cost-effective and high-availability manner. A multicloud storage architecture is given in this study. Next, a multi-objective optimization problem is defined to minimise total costs and maximise data availability at the same time, which can be solved using a technique based on the non-dominated sorting genetic algorithm II (NSGA-II) and obtain a set of non-dominated solutions known as the Pareto-optimal set.. When consumers can't pick from the Pareto-optimal set directly, a method based on Principal Component Analysis (PCA) is presented to find the best answer. To sum it all up, thorough tests based on a variety of real-world cloud storage scenarios have proven that the proposed method performs as expected.

층 밀리 간섭계를 이용한 고체침지렌즈의 광학적 성능 평가 (Optical Performance Evaluation of SIL Assembly with Lateral Shearing Interferometer)

  • 이진의;김완진;최현;김태섭;윤용중;박노철;박영필
    • 정보저장시스템학회논문집
    • /
    • 제2권4호
    • /
    • pp.224-229
    • /
    • 2006
  • There has been studied flow to minimize the spot size to increase data capacity. Optical data storage devices are being developed near practical limits with wavelength and NA of 405nm and 0.85. There has been studied many types of next generation storage devices such as blu-ray multilayer system, probe based data storage and holographic data storage. Among these data storage devices, solid immersion lens(SIL) based near field recording (NFR) has been widely studied. In this system, SIL is the key component that focuses the laser beam with a very small size which enables ultra high data capacity. Therefore, optical performance evaluation system is required for SIL assembly. In this dissertation, a simple and accurate SIL assembly measurement method is proposed with wedge plate lateral shearing interferometer(LSI). Wedge plate LSI is cheaper than commercialized interferometer, robust to the vibration and the moving distance for phase shifting is large that is order of micrometer. We designed the thickness, wedge angle, material, surface quality and wavelength of wedge plate as 1mm, 0.02degree, fused silica, lamda/10(10-5) and 405nm, respectively. Also, we confirmed simulation and experimental results with quantitative analysis. This simple wedge plate LSI can be applied to different types of SIL such as solid immersion mirror(SIM), hemispherical, super-hemispherical and elliptical SIL.

  • PDF

군 USN 환경에서 효율적인 데이터 저장 및 질의 처리 방법 연구 (Efficient Data Storage & Query Processing Methods in Military Ubiquitous Sensor Networks)

  • 권영모;최현식;정연돈
    • 한국군사과학기술학회지
    • /
    • 제13권5호
    • /
    • pp.875-885
    • /
    • 2010
  • Recently, the role of Ubiquitous Sensor Network(USN) has been considered to be essential for supporting the near future Network Centric Warfare(NCW) and Tactical Information Communication Network(TICN). In this paper, we explore a set of data storage methods(external storage, local storage and data storage) and query processing methods in WSN. In particular, we focus on analyzing a novel data structure for supporting the local storage method, named the partial ordered tree(POT). The main idea behind POT is that sensor readings are usually correlated with the physical spatial domain. With the help of POT, only a small portion of sensor nodes participate in query processing tasks, and thus network lifetime is greatly increased. Through a series of simulation experiments, we demonstrate that the POT based local storage method clearly outperforms the existing data storage methods in terms of the energy-efficiency, which directly affects the network lifetime, for processing exact match queries, range queries and top-k queries.

클라우드 스토리지에서의 중요데이터 보호 (Securing Sensitive Data in Cloud Storage)

  • 이셜리;이훈재
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2011년도 춘계학술발표대회
    • /
    • pp.871-874
    • /
    • 2011
  • The fast emerging of network technology and the high demand of computing resources have prompted many organizations to outsource their storage and computing needs. Cloud based storage services such as Microsoft's Azure and Amazon's S3 allow customers to store and retrieve any amount of data, at anytime from anywhere via internet. The scalable and dynamic of the cloud storage services help their customer to reduce IT administration and maintenance costs. No doubt, cloud based storage services brought a lot of benefits to its customer by significantly reducing cost through optimization increased operating and economic efficiencies. However without appropriate security and privacy solution in place, it could become major issues to the organization. As data get produced, transferred and stored at off premise and multi tenant cloud based storage, it becomes vulnerable to unauthorized disclosure and unauthorized modification. An attacker able to change or modify data while data inflight or when data is stored on disk, so it is very important to secure data during its entire life-cycle. The traditional cryptography primitives for the purpose of data security protection cannot be directly adopted due to user's lose control of data under off premises cloud server. Secondly cloud based storage is not just a third party data warehouse, the data stored in cloud are frequently update by the users and lastly cloud computing is running in a simultaneous, cooperated and distributed manner. In our proposed mechanism we protect the integrity, authentication and confidentiality of cloud based data with the encrypt- then-upload concept. We modified and applied proxy re-encryption protocol in our proposed scheme. The whole process does not reveal the clear data to any third party including the cloud provider at any stage, this helps to make sure only the authorized user who own corresponding token able to access the data as well as preventing data from being shared without any permission from data owner. Besides, preventing the cloud storage providers from unauthorized access and making illegal authorization to access the data, our scheme also protect the data integrity by using hash function.

협업을 위한 클라우드 스토리지에서의 사용자 인증과 데이터 보호에 관한 연구 (A Study on the User Authentication and the Protection of Data in the Collaborative Cloud Storage)

  • 이재영
    • 디지털융복합연구
    • /
    • 제12권9호
    • /
    • pp.153-158
    • /
    • 2014
  • 협업을 위한 클라우드 스토리지란 협업에 참여하는 사용자들이 클라우드 스토리지를 공유하여 이용하는 것을 말한다. 협업에 이용되는 클라우드 스토리지는 여러 사람이 새로운 데이터를 저장하고 다른 사용자의 저장된 데이터를 읽을 수 있기 때문에 협업에 참여하는 사용자에 대한 인증과 데이터 보호의 문제가 일반의 그것보다 더 중요하다 할 것이다. 이에 본 논문에서는 협업을 위한 클라우드 스토리지를 공유하는 사용자에 대한 인증 방법과 저장된 데이터를 보호하는 방법을 제안하고자 한다.

RDP: A storage-tier-aware Robust Data Placement strategy for Hadoop in a Cloud-based Heterogeneous Environment

  • Muhammad Faseeh Qureshi, Nawab;Shin, Dong Ryeol
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제10권9호
    • /
    • pp.4063-4086
    • /
    • 2016
  • Cloud computing is a robust technology, which facilitate to resolve many parallel distributed computing issues in the modern Big Data environment. Hadoop is an ecosystem, which process large data-sets in distributed computing environment. The HDFS is a filesystem of Hadoop, which process data blocks to the cluster nodes. The data block placement has become a bottleneck to overall performance in a Hadoop cluster. The current placement policy assumes that, all Datanodes have equal computing capacity to process data blocks. This computing capacity includes availability of same storage media and same processing performances of a node. As a result, Hadoop cluster performance gets effected with unbalanced workloads, inefficient storage-tier, network traffic congestion and HDFS integrity issues. This paper proposes a storage-tier-aware Robust Data Placement (RDP) scheme, which systematically resolves unbalanced workloads, reduces network congestion to an optimal state, utilizes storage-tier in a useful manner and minimizes the HDFS integrity issues. The experimental results show that the proposed approach reduced unbalanced workload issue to 72%. Moreover, the presented approach resolve storage-tier compatibility problem to 81% by predicting storage for block jobs and improved overall data block placement by 78% through pre-calculated computing capacity allocations and execution of map files over respective Namenode and Datanodes.

외장형 저장장치를 이용한 웹 기반 데이터 스토리지 서비스 시스템 구현 (Implementation of Web-based Data Storage Service System Using External Storage Devices)

  • 김범준;이경희
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2017년도 추계학술대회
    • /
    • pp.111-114
    • /
    • 2017
  • 지속적인 디지털 콘텐츠의 이용 증가와 고품질화에 따라 인터넷 상의 대용량 데이터 스토리지 서비스 필요성도 증가하고 있다. 이를 위해 널리 사용되는 웹하드 서비스는 다수의 이용자들에게 웹을 통해 데이터를 저장, 관리, 공유 할 수 있는 편리한 기능을 제공하지만, 대용량의 저장 공간 사용에 대한 고비용 문제와 일부 이용자들이 중요한 데이터를 인터넷 상에 보관하기를 기피하는 현상을 해결할 필요가 있다. 반면, 외장 하드디스크와 같은 휴대형 스토리지 디바이스는 PC 등 연결된 호스트에서만 사용이 가능하므로 다른 이용자들과 데이터를 공유하기 위한 관리 및 보안 기능이 추가적으로 요구된다. 본 논문에서는 이러한 기존 방식들의 장점을 결합한 웹 기반의 데이터 스토리지 시스템을 제안한다. 제안되는 시스템은 외장 하드 디스크와 같은 디바이스를 필요에 따라 서버에 연결했을 때 웹을 통해 쉽게 원격에서 데이터를 관리, 공유할 수 있는 기능을 제공한다.

  • PDF

인공지능 기법을 이용한 홀로그래픽 데이터 스토리지 시스템의 에러 보정 (Error Correction of Holographic Data Storage System Using Artificial Intelligence)

  • 김장현;박진배;양현석;박영필
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 제37회 하계학술대회 논문집 D
    • /
    • pp.2142-2143
    • /
    • 2006
  • Today any data storage system cannot satisfy all of these conditions, however holographic data storage system can perform faster data transfer rate because it is a page oriented memory system using volume hologram in writing and retrieving data. System can be constructed without mechanically actuating part therefore fast data transfer rate and high storage capacity about 1Tb/cm3 can be realized. In this research, to reduce errors of binary data stored in holographic data storage system, a new method for bit error reduction is suggested. Firstly, find fuzzy rule to use test bed system for Element of Holographic Digital Data System. Secondly, make fuzzy rule table using DNA coding method. Finally, reduce prior error element and recording digital data. Recording ratio and reconstruction ratio show good performance.

  • PDF

신 개념 저장장치인 Storage Area Network (SAN)의 활용 및 도입시 고려사항

  • 홍순구;이상식;김종원
    • 한국경영과학회:학술대회논문집
    • /
    • 한국경영과학회 2001년도 추계학술대회 논문집
    • /
    • pp.128-131
    • /
    • 2001
  • With the advent of the Internet, data centric computing applications, and e-business applications, virtually all network-stored data has become mission critical in nature. This increasing reliance on the access to enterprise data is challenging the limitations of traditional server-storage solutions. As a result, the ongoing need to add more storage, serve more users and back up more data has given rise to the concept of a SAN(Storage Area Network), “a network whose primary purpose is the transfer of data between computer systems and storage elements and among storage elements.” The purpose of this article is to help the managers and researchers make the understanding of a SAN as the possibility of new data repository in e-business era. This paper provides a thorough literature review on this new concept including its structure, its benefits and disadvantages, and its underlying issues.

  • PDF