• 제목/요약/키워드: Distributed Data

검색결과 6,005건 처리시간 0.035초

하둡 환경에 적합한 데이터 저장 및 복원 기법에 관한 연구 (A Study on Data Storage and Recovery in Hadoop Environment)

  • 김수현;이임영
    • 정보처리학회논문지:컴퓨터 및 통신 시스템
    • /
    • 제2권12호
    • /
    • pp.569-576
    • /
    • 2013
  • 최근 많은 관심을 받고 있는 클라우드 컴퓨팅이 해결해야할 가장 큰 문제는 바로 보안이다. 일반적인 클라우드 컴퓨팅 환경에서는 사용자의 데이터 보호를 위해 수많은 분산서버를 이용하여 데이터를 저장한다. 하지만 분산서버에 저장된 데이터를 암호화 과정을 거치지 않고 그대로 저장하게 된다면, 마스터 서버에 저장된 분산파일 위치를 추적하여 그대로 유출이 되는 문제가 발생할 수 있다. 이러한 문제를 방지하기 위해 비밀키를 이용하여 분산된 데이터를 암호화해야할 필요성이 존재한다. 그러나 대용량 데이터의 경우 수십, 수백 개의 조각으로 나누어지게 되는데 분산서버마다 각각의 비밀키를 이용하게 된다면, 관리의 어려움이 존재할 뿐 아니라 분산 서버에 대한 정당한 인증, 암복호화 과정을 수없이 거치게 되어 막대한 오버헤드가 발생하게 된다. 따라서 본 논문에서는 이와 같은 문제점을 해결하기 위해 Hadoop 환경에 적합한 XOR 및 RAID기반의 효율적인 분산 저장 및 복구 기법을 제안하였다.

Middleware Architecture for Open Control Systems in the Distributed Computing Environment

  • Lee, Wongoo;Park, Jaehyun
    • Transactions on Control, Automation and Systems Engineering
    • /
    • 제3권3호
    • /
    • pp.190-195
    • /
    • 2001
  • The advance of computer, network, and Internet technology enables the control systems to process the massive data in the distributed computing environments. To implement and maintain the software in distributed environment, the component-based methodology is widely used. This paper proposes the middleware architecture for the distributed computer control system. With the proposed middleware services, it is relatively easy to maintain compatibility between products and to implement a portable control application. To achieve the compatibility between heterogeneous systems, the proposed architecture provides the communication protocols based on the XML with lightweight event-based service.

  • PDF

ITU-T에서 분산원장기술 표준화 동향 (Standard Status on ITU-T Distributed Ledger Technology)

  • 권동승;박종대
    • 전자통신동향분석
    • /
    • 제35권2호
    • /
    • pp.50-68
    • /
    • 2020
  • Distributed Ledger Technology (DLT) refers to a process and related technologies that enable a person to safely suggest, verify, and record state changes (usually updates) to synchronize ledgers distributed across network nodes. DLTs are becoming increasingly important as data management requirements evolve. Therefore, they need to understand the current state of standards (such as distributed storage and access technologies) to address future requirements. This paper provides ITU-T FG-DLT standard activities, such as standardization ization trends, use cases, reference architectures, platform evaluation criteria and future prospects.

Integration of CAD & PDM on web distributed environment using XML-based web service

  • Yahya, Bernardo Nugroho;Cho, Jeoung-Sung
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.1061-1066
    • /
    • 2004
  • It is certain that the future manufacturing environment will be network-centric and spatially distributed based on Internet. Today, wide variety of distributed computing and communication technologies are available for implementing a system for product data exchange and sharing. One of the technologies that have been received most attentions for product data exchange and sharing is Product Data Management (PDM). PDM tries to integrate and manage process of data and technical documents that are connected to physical product components. In accordance to previous researches about PDM, it can be regarded as an integration tool of many different areas, which ensures that the right information is available to the right person at the right time and in the right form throughout the enterprise. PDM with Web-enabled CAD system is proposed in this paper in order to acknowledge the usefulness of the system mentioned. The system will use Web service on Visual Studio C#.Net to invoke the web application system.

  • PDF

A Study on NEMO-partially DMM based E2E Seamless Data Integration Transmission Scheme in SOC Public Infrastructures

  • Ryu, Wonmo;Caytiles, Ronnie D.;Park, Byungjoo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제12권4호
    • /
    • pp.33-41
    • /
    • 2020
  • Nowadays, distributed mobility management (DMM) approaches have been widely adopted to address the limitations of centralized architectural methods to support seamless data transmission schemes in wireless sensor networks. This paper deals with the end-to-end (E2E) integration of Network Mobility (NEMO) basic support protocol in distributed wireless sensor network systems in structural health and environmental monitoring of social overhead capital (SOC) public infrastructures such as bridges, national highways, tunnels, and railroads. The proposed scheme takes advantage of the features of both the NEMO basic support protocol and partially distributed network-based DMM framework in providing seamless data transmission and robust mobility support. The E2E seamless data transmission scheme allows mobile users to roam from fixed-point network access locations and mobile platforms (i.e., vehicles such as cars, buses, and trains) without disconnecting its current sessions (i.e., seamless handover).

Data Flow 시스템에서 구조체 분산 처리 방식 (A Structure Distributed Processing Method in Data Flow Systems)

  • 맹성열;현운몽;하영호;임인철
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1987년도 전기.전자공학 학술대회 논문집(II)
    • /
    • pp.1125-1128
    • /
    • 1987
  • This paper proposes a method which distributes the structure data represented by a tree and handles it. To distribute and handle the structure data, this method partitions a structure data and distributes the partitioned structure in multiple processing element and allocates the partitioned structure. Each processing element includes the structure memory to store the partitioned structure and the structure controller to handle efficiently the distributed structure. As the structure is distributed and is stored in the structure memory and is handled by the structure controller, the processing time is reduced.

  • PDF

분산 자료에 대한 초완비 표현 방법 (A method of overcomplete representation for distributed data)

  • 이상철;박종우;곽칠성
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2007년도 하계종합학술대회 논문집
    • /
    • pp.457-458
    • /
    • 2007
  • This paper propose a method for representing distributed data of sensor networks. The proposed method is based on a general distributed regression framework that models sensor data by fitting a global function to each of the local measurements and explores the possible extensions of distribution regression by using complex signal representations. In order to reduce the amount of processed data and the required communication, the signal model has to be as compact as possible, with the ability to restore the arbitrary measurements. To achieve this requirement, data compression step is included, where the basis function set is changed to an overcomplete set. This have better advantages in case of nonstationary signal modeling than complete base representation.

  • PDF

A New Model to Enhance Efficiency in Distributed Data Mining Using Mobile Agent

  • Bardab, Saeed Ngmaldin;Ahmed, Tarig Mohamed
    • International Journal of Computer Science & Network Security
    • /
    • 제21권3호
    • /
    • pp.275-286
    • /
    • 2021
  • As a result of the vast amount of data that is geographically found in different locations. Distributed data mining (DDM) has taken a center stage in data mining. The use of mobile agents to enhance efficiency in DDM has gained the attention of industries, commerce and academia because it offers serious suggestions on how to solve inherent problems associated with DDM. In this paper, a novel DDM model has been proposed by using a mobile agent to enhance efficiency. The main idea behind the model is to use the Naive Bayes algorithm to give the mobile agent the ability to learn, compare, get and store the results on it from each server which has different datasets and we found that the accuracy increased roughly by 0.9% which is our main target.

CAN 통신을 이용한 분산제어 시스템의 시간지연보상을 위한 $\mu$-제어기에 관한 연구 (A study on the $\mu$-controller for the compensation of the network induced delays in the distributed)

  • 안세영;임동진
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2004년도 학술대회 논문집 정보 및 제어부문
    • /
    • pp.657-659
    • /
    • 2004
  • CAN is a serial communication bus for real-time controls and automations in distributed control systems. In distributed control systems, occasionally a sensor module and a controller are not in the same node and physically separated. In order for the signal from a sensor node to reach the controller node, the signal must travel through network. CAN has a certain capabilities to deal with real-time data. However, when many nodes on the networks try to send data on the same network, the arbitration mechanism to solve the data collision problem is necessary. This situation causes the time delay which has detrimental effects on the performance of the control systems. This paper proposes a method to solve the problem due to the time delay in distributed control system using CAN. Time delay is approximated to an element with a rational transfer function using Pade approximation and Mu~synthesis method is applied. Since time delay in the network is not constant, the time delay element is considered to be an uncertainty block with a bound. The proposed method is applied to the experimental system with CAN and proved to be effective.

  • PDF

A Novel Node Management in Hadoop Cluster by using DNA

  • Balaraju. J;PVRD. Prasada Rao
    • International Journal of Computer Science & Network Security
    • /
    • 제23권9호
    • /
    • pp.134-140
    • /
    • 2023
  • The distributed system is playing a vital role in storing and processing big data and data generation is speedily increasing from various sources every second. Hadoop has a scalable, and efficient distributed system supporting commodity hardware by combining different networks in the topographical locality. Node support in the Hadoop cluster is rapidly increasing in different versions which are facing difficulty to manage clusters. Hadoop does not provide Node management, adding and deletion node futures. Node identification in a cluster completely depends on DHCP servers which managing IP addresses, hostname based on the physical address (MAC) address of each Node. There is a scope to the hacker to theft the data using IP or Hostname and creating a disturbance in a distributed system by adding a malicious node, assigning duplicate IP. This paper proposing novel node management for the distributed system using DNA hiding and generating a unique key using a unique physical address (MAC) of each node and hostname. The proposed mechanism is providing better node management for the Hadoop cluster providing adding and deletion node mechanism by using limited computations and providing better node security from hackers. The main target of this paper is to propose an algorithm to implement Node information hiding in DNA sequences to increase and provide security to the node from hackers.