• Title/Summary/Keyword: data storage

Search Result 4,555, Processing Time 0.032 seconds

BoxBroker: A Policy-Driven Framework for Optimizing Storage Service Federation

  • Heinsen, Rene;Lopez, Cindy;Huh, Eui-Nam
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.1
    • /
    • pp.340-367
    • /
    • 2018
  • Storage services integration can be done for achieving high availability, improving data access performance and scalability while preventing vendor lock-in. However, multiple services environment management and interoperability have become a critical issue as a result of service architectures and communication interfaces heterogeneity. Storage federation model provides the integration of multiple heterogeneous and self-sufficient storage systems with a single control point and automated decision making about data distribution. In order to integrate diverse heterogeneous storage services into a single storage pool, we are proposing a storage service federation framework named BoxBroker. Moreover, an automated decision model based on a policy-driven data distribution algorithm and a service evaluation method is proposed enabling BoxBroker to make optimal decisions. Finally, a demonstration of our proposal capabilities is presented and discussed.

Optimization of Data Placement using Principal Component Analysis based Pareto-optimal method for Multi-Cloud Storage Environment

  • Latha, V.L. Padma;Reddy, N. Sudhakar;Babu, A. Suresh
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.12
    • /
    • pp.248-256
    • /
    • 2021
  • Now that we're in the big data era, data has taken on a new significance as the storage capacity has exploded from trillion bytes to petabytes at breakneck pace. As the use of cloud computing expands and becomes more commonly accepted, several businesses and institutions are opting to store their requests and data there. Cloud storage's concept of a nearly infinite storage resource pool makes data storage and access scalable and readily available. The majority of them, on the other hand, favour a single cloud because of the simplicity and inexpensive storage costs it offers in the near run. Cloud-based data storage, on the other hand, has concerns such as vendor lock-in, privacy leakage and unavailability. With geographically dispersed cloud storage providers, multicloud storage can alleviate these dangers. One of the key challenges in this storage system is to arrange user data in a cost-effective and high-availability manner. A multicloud storage architecture is given in this study. Next, a multi-objective optimization problem is defined to minimise total costs and maximise data availability at the same time, which can be solved using a technique based on the non-dominated sorting genetic algorithm II (NSGA-II) and obtain a set of non-dominated solutions known as the Pareto-optimal set.. When consumers can't pick from the Pareto-optimal set directly, a method based on Principal Component Analysis (PCA) is presented to find the best answer. To sum it all up, thorough tests based on a variety of real-world cloud storage scenarios have proven that the proposed method performs as expected.

Optical Performance Evaluation of SIL Assembly with Lateral Shearing Interferometer (층 밀리 간섭계를 이용한 고체침지렌즈의 광학적 성능 평가)

  • Lee, Jin-Eui;Kim, Wan-Chin;Choi, Hyun;Kim, Tae-Seob;Yoon, Yong-Joong;Park, No-Cheol;Park, Young-Pil
    • Transactions of the Society of Information Storage Systems
    • /
    • v.2 no.4
    • /
    • pp.224-229
    • /
    • 2006
  • There has been studied flow to minimize the spot size to increase data capacity. Optical data storage devices are being developed near practical limits with wavelength and NA of 405nm and 0.85. There has been studied many types of next generation storage devices such as blu-ray multilayer system, probe based data storage and holographic data storage. Among these data storage devices, solid immersion lens(SIL) based near field recording (NFR) has been widely studied. In this system, SIL is the key component that focuses the laser beam with a very small size which enables ultra high data capacity. Therefore, optical performance evaluation system is required for SIL assembly. In this dissertation, a simple and accurate SIL assembly measurement method is proposed with wedge plate lateral shearing interferometer(LSI). Wedge plate LSI is cheaper than commercialized interferometer, robust to the vibration and the moving distance for phase shifting is large that is order of micrometer. We designed the thickness, wedge angle, material, surface quality and wavelength of wedge plate as 1mm, 0.02degree, fused silica, lamda/10(10-5) and 405nm, respectively. Also, we confirmed simulation and experimental results with quantitative analysis. This simple wedge plate LSI can be applied to different types of SIL such as solid immersion mirror(SIM), hemispherical, super-hemispherical and elliptical SIL.

  • PDF

Efficient Data Storage & Query Processing Methods in Military Ubiquitous Sensor Networks (군 USN 환경에서 효율적인 데이터 저장 및 질의 처리 방법 연구)

  • Kwon, Young-Mo;Choi, Hyun-Sik;Chung, Yon-Dohn
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.13 no.5
    • /
    • pp.875-885
    • /
    • 2010
  • Recently, the role of Ubiquitous Sensor Network(USN) has been considered to be essential for supporting the near future Network Centric Warfare(NCW) and Tactical Information Communication Network(TICN). In this paper, we explore a set of data storage methods(external storage, local storage and data storage) and query processing methods in WSN. In particular, we focus on analyzing a novel data structure for supporting the local storage method, named the partial ordered tree(POT). The main idea behind POT is that sensor readings are usually correlated with the physical spatial domain. With the help of POT, only a small portion of sensor nodes participate in query processing tasks, and thus network lifetime is greatly increased. Through a series of simulation experiments, we demonstrate that the POT based local storage method clearly outperforms the existing data storage methods in terms of the energy-efficiency, which directly affects the network lifetime, for processing exact match queries, range queries and top-k queries.

Securing Sensitive Data in Cloud Storage (클라우드 스토리지에서의 중요데이터 보호)

  • Lee, Shir-Ly;Lee, Hoon-Jae
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2011.04a
    • /
    • pp.871-874
    • /
    • 2011
  • The fast emerging of network technology and the high demand of computing resources have prompted many organizations to outsource their storage and computing needs. Cloud based storage services such as Microsoft's Azure and Amazon's S3 allow customers to store and retrieve any amount of data, at anytime from anywhere via internet. The scalable and dynamic of the cloud storage services help their customer to reduce IT administration and maintenance costs. No doubt, cloud based storage services brought a lot of benefits to its customer by significantly reducing cost through optimization increased operating and economic efficiencies. However without appropriate security and privacy solution in place, it could become major issues to the organization. As data get produced, transferred and stored at off premise and multi tenant cloud based storage, it becomes vulnerable to unauthorized disclosure and unauthorized modification. An attacker able to change or modify data while data inflight or when data is stored on disk, so it is very important to secure data during its entire life-cycle. The traditional cryptography primitives for the purpose of data security protection cannot be directly adopted due to user's lose control of data under off premises cloud server. Secondly cloud based storage is not just a third party data warehouse, the data stored in cloud are frequently update by the users and lastly cloud computing is running in a simultaneous, cooperated and distributed manner. In our proposed mechanism we protect the integrity, authentication and confidentiality of cloud based data with the encrypt- then-upload concept. We modified and applied proxy re-encryption protocol in our proposed scheme. The whole process does not reveal the clear data to any third party including the cloud provider at any stage, this helps to make sure only the authorized user who own corresponding token able to access the data as well as preventing data from being shared without any permission from data owner. Besides, preventing the cloud storage providers from unauthorized access and making illegal authorization to access the data, our scheme also protect the data integrity by using hash function.

A Study on the User Authentication and the Protection of Data in the Collaborative Cloud Storage (협업을 위한 클라우드 스토리지에서의 사용자 인증과 데이터 보호에 관한 연구)

  • Jae-Young, Lee
    • Journal of Digital Convergence
    • /
    • v.12 no.9
    • /
    • pp.153-158
    • /
    • 2014
  • The Collaborative Cloud Storage is that several members of collaborating group together use data stored in a storage. Therefore, it is obvious that it is more complicated and important to protect data stored in the sharing storage than general cloud storage, not Collaborative Cloud Storage. this paper proposes a method for user authentication and data protection.

RDP: A storage-tier-aware Robust Data Placement strategy for Hadoop in a Cloud-based Heterogeneous Environment

  • Muhammad Faseeh Qureshi, Nawab;Shin, Dong Ryeol
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.9
    • /
    • pp.4063-4086
    • /
    • 2016
  • Cloud computing is a robust technology, which facilitate to resolve many parallel distributed computing issues in the modern Big Data environment. Hadoop is an ecosystem, which process large data-sets in distributed computing environment. The HDFS is a filesystem of Hadoop, which process data blocks to the cluster nodes. The data block placement has become a bottleneck to overall performance in a Hadoop cluster. The current placement policy assumes that, all Datanodes have equal computing capacity to process data blocks. This computing capacity includes availability of same storage media and same processing performances of a node. As a result, Hadoop cluster performance gets effected with unbalanced workloads, inefficient storage-tier, network traffic congestion and HDFS integrity issues. This paper proposes a storage-tier-aware Robust Data Placement (RDP) scheme, which systematically resolves unbalanced workloads, reduces network congestion to an optimal state, utilizes storage-tier in a useful manner and minimizes the HDFS integrity issues. The experimental results show that the proposed approach reduced unbalanced workload issue to 72%. Moreover, the presented approach resolve storage-tier compatibility problem to 81% by predicting storage for block jobs and improved overall data block placement by 78% through pre-calculated computing capacity allocations and execution of map files over respective Namenode and Datanodes.

Implementation of Web-based Data Storage Service System Using External Storage Devices (외장형 저장장치를 이용한 웹 기반 데이터 스토리지 서비스 시스템 구현)

  • Kim, Buemjun;Lee, Kyounghee
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.10a
    • /
    • pp.111-114
    • /
    • 2017
  • As digital contents are widely used and require increasingly high quality, the data storage services over Internet also become more and more important. One of popular services, web-hard, provides lots of users with web-based functions for data storage, management and sharing but such storage utilization requires quite high cost compared to using portable storage devices. Moreover, some users may avoid putting their important data into open Internet area. On the other hand, portable storage devices are cheaper but can be used only when they are physically connected to host devices such as PC. Also additional management and security functions should be equipped to support data sharing among users. In this paper, we propose a web-based data storage system combining those advantages of aforementioned two approaches. The proposed system immediately provides web-based services for data management and sharing when a portable device such as SDD is connected to the server.

  • PDF

Error Correction of Holographic Data Storage System Using Artificial Intelligence (인공지능 기법을 이용한 홀로그래픽 데이터 스토리지 시스템의 에러 보정)

  • Kim, Jang-Hyun;Park, Jin-Bae;Yang, Hyun-Seok;Park, Young-Pil
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.2142-2143
    • /
    • 2006
  • Today any data storage system cannot satisfy all of these conditions, however holographic data storage system can perform faster data transfer rate because it is a page oriented memory system using volume hologram in writing and retrieving data. System can be constructed without mechanically actuating part therefore fast data transfer rate and high storage capacity about 1Tb/cm3 can be realized. In this research, to reduce errors of binary data stored in holographic data storage system, a new method for bit error reduction is suggested. Firstly, find fuzzy rule to use test bed system for Element of Holographic Digital Data System. Secondly, make fuzzy rule table using DNA coding method. Finally, reduce prior error element and recording digital data. Recording ratio and reconstruction ratio show good performance.

  • PDF

신 개념 저장장치인 Storage Area Network (SAN)의 활용 및 도입시 고려사항

  • 홍순구;이상식;김종원
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2001.10a
    • /
    • pp.128-131
    • /
    • 2001
  • With the advent of the Internet, data centric computing applications, and e-business applications, virtually all network-stored data has become mission critical in nature. This increasing reliance on the access to enterprise data is challenging the limitations of traditional server-storage solutions. As a result, the ongoing need to add more storage, serve more users and back up more data has given rise to the concept of a SAN(Storage Area Network), “a network whose primary purpose is the transfer of data between computer systems and storage elements and among storage elements.” The purpose of this article is to help the managers and researchers make the understanding of a SAN as the possibility of new data repository in e-business era. This paper provides a thorough literature review on this new concept including its structure, its benefits and disadvantages, and its underlying issues.

  • PDF