• Title/Summary/Keyword: Data storage

Search Result 4,583, Processing Time 0.026 seconds

A Storage Technique for XML Documents based on Object-Relational Database (객체-관계형 데이타베이스 기반의 XML 문서 저장 기법)

  • Kim, Ji-Sim;Lee, Ki-Ho
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.8 no.4
    • /
    • pp.389-398
    • /
    • 2002
  • As XML has been proposed a standard format for organizing and exchanging data in the internet, many applications on managing XML data have been developed. Especially, there are many studies for storing XML documents. It is important to evaluate the performance for efficient storage techniques. In this work, we suggest an efficient technique for storing XML documents using an object-relational database model. We verify the efficiency of a new storage technique through the performance evaluation on XML storage techniques. The contributions of this paper is that we suggest an efficient storage technique using an existing data management model and evaluate the performance for storage techniques for XML documents including an new storage technique.

Privacy Preserving Source Based Deduplication In Cloud Storage (클라우드 스토리지 상에서의 프라이버시 보존형 소스기반 중복데이터 제거기술)

  • Park, Cheolhee;Hong, Dowon;Seo, Changho;Chang, Ku-Young
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.25 no.1
    • /
    • pp.123-132
    • /
    • 2015
  • In cloud storage, processing the duplicated data, namely deduplication, is necessary technology to save storage space. Users who store sensitive data in remote storage want data be encrypted. However Cloud storage server do not detect duplication of conventionally encrypted data. To solve this problem, Convergent Encryption has been proposed. But it inherently have weakness due to brute-force attack. On the other hand, to save storage space as well as save bandwidths, client-side deduplication have been applied. Recently, various client-side deduplication technology has been proposed. However, this propositions still cannot solve the security problem. In this paper, we suggest a secure source-based deduplication technology, which encrypt data to ensure the confidentiality of sensitive data and apply proofs of ownership protocol to control access to the data, from curious cloud server and malicious user.

Design and Verification of Connected Data Architecture Concept employing DataLake Framework over Abyss Storage Cluster (Abyss Storage Cluster 기반 DataLake Framework의 Connected Data Architecture 개념 설계 및 검증)

  • Cha, ByungRae;Cha, Yun-Seok;Park, Sun;Shin, Byeong-Chun;Kim, JongWon
    • Smart Media Journal
    • /
    • v.7 no.3
    • /
    • pp.57-63
    • /
    • 2018
  • With many types of data generated in the shift of business environment as a result of growth of an organization or enterprise, there is a need to improve the data-processing efficiency in smarter means with a single domain model such as Data Lake. In particular, creating a logical single domain model from physical partitioned multi-site data by the finite resources of nature and shared economy is very important in terms of efficient operation of computing resources. Based on the advantages of the existing Data Lake framework, we define the CDA-Concept (connected data architecture concept) and functions of Data Lake Framework over Abyss Storage for integrating multiple sites in various application domains and managing the data lifecycle. Also, it performs the interface design and validation verification for Interface #2 & #3 of the connected data architecture-concept.

Sharing On-line Storage with Various Flat Forms of Information Devices

  • Song, Seok-Il;Kwak, Yoon-Sik
    • International Journal of Contents
    • /
    • v.3 no.3
    • /
    • pp.38-42
    • /
    • 2007
  • In this paper, we propose a new storage system architecture called as U-Storage (ubiquitous storage system). U-Storage allows a user to access an on-line storage with any type of information devices that are able to connect to internet. The on-line storage is virtualized to the user's information devices as a local hard disk or a memory card by our U-Storage. With devices supporting U-Storage, users can read and write their data anytime and anywhere without downloading and uploading operation.

Development of a distributed high-speed data acquisition and monitoring system based on a special data packet format for HUST RF negative ion source

  • Li, Dong;Yin, Ling;Wang, Sai;Zuo, Chen;Chen, Dezhi
    • Nuclear Engineering and Technology
    • /
    • v.54 no.10
    • /
    • pp.3587-3594
    • /
    • 2022
  • A distributed high-speed data acquisition and monitoring system for the RF negative ion source at Huazhong University of Science and Technology (HUST) is developed, which consists of data acquisition, data forwarding and data processing. Firstly, the data acquisition modules sample physical signals at high speed and upload the sampling data with corresponding absolute-time labels over UDP, which builds the time correlation among different signals. And a special data packet format is proposed for the data upload, which is convenient for packing or parsing a fixed-length packet, especially when the span of the time labels in a packet crosses an absolute second. The data forwarding modules then receive the UDP messages and distribute their data packets to the real-time display module and the data storage modules by PUB/SUB-pattern message queue of ZeroMQ. As for the data storage, a scheme combining the file server and MySQL database is adopted to increase the storage rate and facilitate the data query. The test results show that the loss rate of the data packets is within the range of 0-5% and the storage rate is higher than 20 Mbps, both acceptable for the HUST RF negative ion source.

The Effect of Meteorological Factors on the Temporal Variation of Agricultural Reservoir Storage (기상인자가 농업용 저수지 저수량에 미치는 영향연구)

  • Ahn, So-Ra;Park, Min-Ji;Park, Geun-Ae;Kim, Seong-Joon
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.49 no.4
    • /
    • pp.3-12
    • /
    • 2007
  • The purpose of this paper is to analyze the relationship between meteorological factors and agricultural reservoir storage, and predict the reservoir storage by multiple regression equation selected by high correlated meteorological factors. Two agricultural reservoirs (Geumgwang and Gosam) located in the upsteam of Gongdo water level gauging station of Anseong-cheon watershed were selected. Monthly reservoir storage data and meteorological data in Suwon weather station of 21 years (1985-2005) were collected. Three cases of correlation (case 1: yearly mean, case 2: seasonal mean dividing a year into 3 periods, and case 3: lagging the reservoir storage from 1 month to 3 months under the condition of case 2) were examined using 8 meteorological factors (precipitation, mean/maximum/minimum temperature, relative humidity, sunshine hour, wind velocity and evaporation). From the correlation analysis, 4 high correlated meteorological factors were selected, and multiple regression was executed for each case. The determination coefficient ($R^{2}$) of predicted reservoir storage for case 1 showed 0.45 and 0.49 for Geumgwang and Gosam reservoir respectively. The predicted reservoir storage for case 2 showed the highest $R^{2}$ of 0.46 and 0.56 respectively in the period of April to June. The predicted reservoir storage for 1 month lag of case 3 showed the $R^{2}$ of 0.68 and 0.85 respectively for the period of April to June. The results showed that the status of agricultural reservoir storage could be expressed with couple of meteorological factors. The prediction enhanced when the storage data are divided into periods rather than yearly mean and especially from the beginning time of paddy irrigation (April) to high decrease of reservoir storage (June) before Jangma.

Estimation Carbon Storage of Urban Street trees Using UAV Imagery and SfM Technique (UAV 영상과 SfM 기술을 이용한 가로수의 탄소저장량 추정)

  • Kim, Da-Seul;Lee, Dong-Kun;Heo, Han-Kyul
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.22 no.6
    • /
    • pp.1-14
    • /
    • 2019
  • Carbon storage is one of the regulating ecosystem services provided by urban street trees. It is important that evaluating the economic value of ecosystem services accurately. The carbon storage of street trees was calculated by measuring the morphological parameter on the field. As the method is labor-intensive and time-consuming for the macro-scale research, remote sensing has been more widely used. The airborne Light Detection And Ranging (LiDAR) is used in obtaining the point clouds data of a densely planted area and extracting individual trees for the carbon storage estimation. However, the LiDAR has limitations such as high cost and complicated operations. In addition, trees change over time they need to be frequently. Therefore, Structure from Motion (SfM) photogrammetry with unmanned Aerial Vehicle (UAV) is a more suitable method for obtaining point clouds data. In this paper, a UAV loaded with a digital camera was employed to take oblique aerial images for generating point cloud of street trees. We extracted the diameter of breast height (DBH) from generated point cloud data to calculate the carbon storage. We compared DBH calculated from UAV data and measured data from the field in the selected area. The calculated DBH was used to estimate the carbon storage of street trees in the study area using a regression model. The results demonstrate the feasibility and effectiveness of applying UAV imagery and SfM technique to the carbon storage estimation of street trees. The technique can contribute to efficiently building inventories of the carbon storage of street trees in urban areas.

An Efficient Provable Secure Public Auditing Scheme for Cloud Storage

  • Xu, Chunxiang;Zhang, Yuan;Yu, Yong;Zhang, Xiaojun;Wen, Junwei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.11
    • /
    • pp.4226-4241
    • /
    • 2014
  • Cloud storage provides an easy, cost-effective and reliable way of data management for users without the burden of local data storage and maintenance. Whereas, this new paradigm poses many challenges on integrity and privacy of users' data, since users losing grip on their data after outsourcing the data to the cloud server. In order to address these problems, recently, Worku et al. have proposed an efficient privacy-preserving public auditing scheme for cloud storage. However, in this paper, we point out the security flaw existing in the scheme. An adversary, who is on-line and active, is capable of modifying the outsourced data arbitrarily and avoiding the detection by exploiting the security flaw. To fix this security flaw, we further propose a secure and efficient privacy-preserving public auditing scheme, which makes up the security flaw of Worku et al.'s scheme while retaining all the features. Finally, we give a formal security proof and the performance analysis, they show the proposed scheme has much more advantages over the Worku et al.'s scheme.

Randomized Block Size (RBS) Model for Secure Data Storage in Distributed Server

  • Sinha, Keshav;Paul, Partha;Amritanjali, Amritanjali
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.12
    • /
    • pp.4508-4530
    • /
    • 2021
  • Today distributed data storage service are being widely used. However lack of proper means of security makes the user data vulnerable. In this work, we propose a Randomized Block Size (RBS) model for secure data storage in distributed environments. The model work with multifold block sizes encrypted with the Chinese Remainder Theorem-based RSA (C-RSA) technique for end-to-end security of multimedia data. The proposed RBS model has a key generation phase (KGP) for constructing asymmetric keys, and a rand generation phase (RGP) for applying optimal asymmetric encryption padding (OAEP) to the original message. The experimental results obtained with text and image files show that the post encryption file size is not much affected, and data is efficiently encrypted while storing at the distributed storage server (DSS). The parameters such as ciphertext size, encryption time, and throughput have been considered for performance evaluation, whereas statistical analysis like similarity measurement, correlation coefficient, histogram, and entropy analysis uses to check image pixels deviation. The number of pixels change rate (NPCR) and unified averaged changed intensity (UACI) were used to check the strength of the proposed encryption technique. The proposed model is robust with high resilience against eavesdropping, insider attack, and chosen-plaintext attack.

Texture Image Generation Technique Considering Storage Optimization of 3D-Spatial Data (3차원 공간자료의 저장 공간 최적화를 고려한 텍스쳐 생성기법 연구)

  • Jin, Gi-Ho;Ha, Sung-Ryong
    • Journal of Digital Contents Society
    • /
    • v.15 no.4
    • /
    • pp.457-464
    • /
    • 2014
  • Recently, interests in space information data are increasing due to the initiation of spatial information open platform service by the Ministry of Land, Infrastructure and Transport. The purpose of this study is optimizing management and storing of the texture data, one kinds of 3D-spatial data. First, extract 3D-spatial data through the aerial triangulation and 3D-writing using raw image taken with the Multi-directional aerial camera and the vertical aerial camera. And develop the method to create single texture data and related technique by align and place corresponding 3D-spatial data to optimal storage space. Through experiment, the results show effect of 8 times of storage capacity reduction compared to existing single-file storage method, additionally, new method can improve file management efficiency in comparison with multiple file storage method. The results of this study can be cornerstone of three-dimensional space information management when dealing with bulk data, and utilizations will be enhanced through the further studies and algorithm improvement.