• Title/Summary/Keyword: data duplication

Search Result 205, Processing Time 0.027 seconds

A Design of DBaaS-Based Collaboration System for Big Data Processing

  • Jung, Yean-Woo;Lee, Jong-Yong;Jung, Kye-Dong
    • International journal of advanced smart convergence
    • /
    • v.5 no.2
    • /
    • pp.59-65
    • /
    • 2016
  • With the recent growth in cloud computing, big data processing and collaboration between businesses are emerging as new paradigms in the IT industry. In an environment where a large amount of data is generated in real time, such as SNS, big data processing techniques are useful in extracting the valid data. MapReduce is a good example of such a programming model used in big data extraction. With the growing collaboration between companies, problems of duplication and heterogeneity among data due to the integration of old and new information storage systems have arisen. These problems arise because of the differences in existing databases across the various companies. However, these problems can be negated by implementing the MapReduce technique. This paper proposes a collaboration system based on Database as a Service, or DBaaS, to solve problems in data integration for collaboration between companies. The proposed system can reduce the overhead in data integration, while being applied to structured and unstructured data.

A Study on the Improvement Directions of Data Classification Format for Efficient Information Management System (효율적인 정보화경영을 위한 데이터분류체계의 개선방안에 관한 연구)

  • Park, Jae-Yong
    • International Commerce and Information Review
    • /
    • v.6 no.3
    • /
    • pp.41-61
    • /
    • 2004
  • Today, most companies are needed to become interested on e-Biz and information management system. Especially, Data classification format system was very important for application to effective and efficiency management decision support. They should include main entry which consists of department, employee's name, title, publication date. Now, each company is using eleven different methods on data classification format system. In this paper finding result was as follows, in other words, general management document case using the nine date classification methods and special report management document ca se using the twodata classification methods. The aim of this study is to investigate problems that the present data classification format system has and some concerns that should be taken into account in case of the modification of the data classification system and change into a new one. This study is based on the survey in that the company managergave to 35 companies throughout the nation. As a result, the survey indicates that the crucial concerns of the participating managers are ineffective management information source and the duplication of data classification systems. This paper is the transcendental study the introduction of data classification format systems to business companies in Korea. This paper provided the fundamental data for the effective business process reengineering in business activity for management information.

  • PDF

Exhibition Monitoring System using USN/RFID based on ECA (USN/RFID를 이용한 ECA기반 전시물 정보 모니터링 시스템)

  • Kim, Gang-Seok;Song, Wang-Cheol
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.6
    • /
    • pp.95-100
    • /
    • 2009
  • Nowadays there are many studies and there's huge development about USN/RFID which have great developmental potential to many kinds of applications. More and more real time application apply USN/RFID technology to identify data collect and locate objects. Wide deployment of USN/RFID will generate an unprecedented volume of primitive data in a short time. Duplication and redundancy of primitive data will affect real time performance of application. Thus, security applications must filter primitive data and correlate them for complex pattern detection and transform them to events that provide meaningful, actionable information to end application. In this paper, we design a ECA Rule system for security monitoring of exhibition. This system will process USN/RFID primitive data and event and perform data transformation. It's had applied each now in exhibition hall through this study and efficient data transmission and management forecast that is possible.

  • PDF

Part-Machine Grouping Using Production Data-based Part-Machine Incidence Matrix: Neural Network Approach - Part 2 (생산자료기반 부품-기계 행렬을 이용한 부품-기계 그룹핑 : 인공신경망 접근법 - Part 2)

  • Won, Yu-Gyeong
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2006.11a
    • /
    • pp.656-658
    • /
    • 2006
  • This study deals with the part-machine grouping (PMG) that considers realistic manufacturing factors, such as the machine duplication, operation sequences with multiple visits to the same machine, and production volumes of parts. Basically, this study is an extension of Won(2006) that has adopted fuzzy ART neural network to group parts and machines. The proposed fuzzy ART neural network algorithm is implemented with an ancillary procedure to enhance the block diagonal solution by rearranging the order of input presentation. Computational experiments applied to large-size PMG data sets with a psuedo-replicated clustering procedure show effectiveness of the proposed approach.

  • PDF

Design of high-speed block transmission technology for real-time data duplication (실시간 데이터 이중화를 위한 고속 블록 전송기술 설계)

  • Han, JaeSeung;An, Jae-Hoon;Kim, Young-Hwan;Park, Chang-Won
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2018.07a
    • /
    • pp.445-448
    • /
    • 2018
  • 본 논문에서는 데이터 이중화 저장시스템의 장애발생으로 인한 백업서버 데이터 손실을 보호하기 위해 무 손실 실시간 데이터 이중화 시스템 설계방안을 제안한다. 이는 원본서버의 데이터와 백업서버의 데이터가 특정 시점 T에서 100% 일치하지 않는 비동기 방식을 동기방식으로 해결하기 위한 시스템 설계 제안으로, 원본서버의 데이터 생성과 동시에 실시간 데이터 백업을 목적으로 한다. 이를 위해 전송단계에서 필요한 가장 빠른 압축인 LZ4 압축 알고리즘을 기반으로 Intel AVX 명령어를 사용하여 보다 압축속도를 증진시켜 실시간 시스템을 구축한다. 또한 전송 중 보안위협으로부터 보호하기 위해 Key 전달 기법과 AES 암호화 알고리즘에 대해 기술한다.

  • PDF

Secure Data De-duplication Scheme for Protect of Data Ownership Using Bloom Filter (블룸필터 활용을 통한 데이터 소유권 보호 암호데이터 중복제거 기술)

  • Kim, Won-Bin;Lee, Im-Yeong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.04a
    • /
    • pp.270-273
    • /
    • 2016
  • 암호데이터 중복제거 기술이란 클라우드 서버에 전송된 데이터를 기존의 클라우드 서버에 저장된 데이터와 비교하여 데이터의 중복된 저장을 방지하는 기술이다. 이러한 데이터 중복제거 기술은 다양한 보안 위협이 발생하는데, 이 중 소유권 위조 공격은 원본 데이터를 소유하지 않은 공격자가 데이터의 소유권을 획득하여 클라우드 스토리지에 저장된 데이터를 취득할 수 있는 위협이다. 이러한 위협을 해결하기 위해 암호화 기술을 적용한 여러 기술들이 제안되어왔지만 과도하게 많은 통신 횟수와 연산량으로 인해 효율성이 떨어지는 문제가 존재한다. 따라서 본 논문에서는 클라우드 스토리지에 저장되는 데이터의 기밀성과 무결성을 보장하며, 연산량과 통신량 측면에서 효율적인 암호데이터 중복제거 기술을 제안한다.

High-throughput identification of chrysanthemum gene function and expression: An overview and an effective proposition

  • Nguyen, Toan Khac;Lim, Jin Hee
    • Journal of Plant Biotechnology
    • /
    • v.48 no.3
    • /
    • pp.139-147
    • /
    • 2021
  • Since whole-genome duplication (WGD) of diploid Chrysanthemum nankingense and de novo assembly whole-genome of C. seticuspe have been obtained, they have afforded to perceive the diversity evolution and gene discovery in the improved investigation of chrysanthemum breeding. The robust tools of high-throughput identification and analysis of gene function and expression produce their vast importance in chrysanthemum genomics. However, the gigantic genome size and heterozygosity are also mentioned as the major obstacles preventing the chrysanthemum breeding practices and functional genomics analysis. Nonetheless, some of technological contemporaries provide scientific efficient and promising solutions to diminish the drawbacks and investigate the high proficient methods for generous phenotyping data obtaining and system progress in future perspectives. This review provides valuable strategies for a broad overview about the high-throughput identification, and molecular analysis of gene function and expression in chrysanthemum. We also contribute the efficient proposition about specific protocols for considering chrysanthemum genes. In further perspective, the proper high-throughput identification will continue to advance rapidly and advertise the next generation in chrysanthemum breeding.

Technology Development for Improving Animation Performance Based on Train Route Patterns (열차 경로 패턴기반 애니메이션 성능 개선 기술 개발)

  • Lee, Duk-Hee;Yang, Won-Mo;Kim, Yong-Il;Yang, Yun-Hee;Shin, Yong-Tae
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.11 no.5
    • /
    • pp.136-146
    • /
    • 2012
  • As information technology used for simulation and virtual reality developed, there is a growing interest in animation technologies which will effectively deliver simulation results to users. Various efforts have been made to improve animation performance, like playback quality and speed, input-output speed and storage space reduction. However, earlier studies generally focused on image compression frame by frame. To significantly improve storage space and playback speed, animation data should be vectorized. Also, spatial and temporal duplication have to be removed. In this study, animation data structure was improved fundamentally through establishment of hierarchy and vectorization. Also Spatial and temporal duplication of animation data was removed through vectorization based on train route. As a result, storage space was reduced, input-output speed and playback speed were considerably improved. According to the test, additional Patternization which followed vectorization brought reduction of over 80% in storage space and input-output speed was quadrupled. Patternization technology can be used as a proper storage method of animation data, and can provide user-specific animation by small data transmission.

Research on Fault Tolerant Avionics Memory Design through Multi Level Cell Flash Memory Reliability Analysis (멀티 레벨 셀 플래시 메모리 신뢰성 분석을 통한 항공 전자장비용 내결함성 메모리 설계 연구)

  • Jeong, Sang-gyu;Jun, Byung-kyu;Kim, Young-mok;Chang, In-ki
    • Journal of Advanced Navigation Technology
    • /
    • v.20 no.4
    • /
    • pp.321-328
    • /
    • 2016
  • Typical MLC NAND flash devices are considered less reliable than SLC NAND flash devices. Although raw bit error rate (RBER) of MLC flash had been considered approximately 1000times or more higher than that of SLC flash, recent research conducted on Google's data center shows that it is much lower than such expectation. Based on the research, we devised In Drive Data Duplication (IDDD) scheme that efficiently exploit MLC flash's sufficient capacity to improve its data reliability without structural complexity increment using SSD intrinsic firmware layer, and showed the data reliability expectation of MLC flash could be significantly higher than that of SLC flash from measured and calculated error rates. Even though RBER of SLC flash was lower than that of MLC flash in 44 out of 48 cases we studied, applying IDDD scheme, RBER of MLC flash was became lower than that of SLC in all 48 cases and uncorrectable bit error rate (UBER) of MLC flash was became lower than that of SLC flash in 45 out of 48 cases.

Rapid Manufacturing of 3D Prototype from 3D scan data using VLM-ST (단속형 가변적층쾌속조형공정을 이용한 3차원 스캔데이터로부터 3차원 시작품의 쾌속 제작)

  • 이상호;안동규;김효찬;양동열;박두섭;채희창
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.536-539
    • /
    • 2002
  • The reverse engineering (RE) technology can quickly generate 3D point cloud data of an object by capturing the surface of a model using a 3D scanner. In the rapid prototyping (RP) technology, prototypes are rapidly produced from 3D CAD models in a layer-by-layer additive basis. In this paper, a physical human head shape is duplicated using a new RP process, the Transfer-type Variable Lamination Manufacturing process using expandable polystyrene foam sheet (VLM-ST), after the point cloud data of a human head shape measured from 3D SNX scanner are converted to STL file. From the duplicated human head shape, it has been shown that the VLM-ST process in connection with the 3D scanner is a fast and efficient process in that shapes with free surface, such as the human head shape, can be duplicated with ease. Considering the measurement time and the shape duplication time, the use of 3D SNX scanner and the VLM-ST process is expected to reduce the lead-time fur the development of new products in comparison with the other existing RE-RP connected manufacturing systems.

  • PDF