• 제목/요약/키워드: distributed environment

검색결과 3,725건 처리시간 0.03초

Fabricator based on B+Tree for Metadata Management in Distributed Environment

  • Chae-Yeon Yun;Seok-Jae Moon
    • International journal of advanced smart convergence
    • /
    • 제13권3호
    • /
    • pp.125-134
    • /
    • 2024
  • In a distributed environment, data fabric refers to the technology and architecture that provides data management, integration, and access in a consistent and unified manner. To build a data fabric, it is necessary to maintain data consistency, establish a data governance system, reduce structural differences between data sources, and provide a unified view. In this paper, we propose the Fabricator system, a technology that provides data management and access in a consistent and unified manner by building a metadata registry. Fabricator manages the addition and modification of metadata schemas and matching processes by designing a matching tool called MetaSB Manager that applies B+Tree. This allows real-time integration of various data sources in a distributed environment, maximizing the flexibility and usability of data.

분산 FTP 서버의 ACE 기반 로그 마이닝 시스템 (Distributed FTP Server for Log Mining System on ACE)

  • 민수홍;조동섭
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2002년도 합동 추계학술대회 논문집 정보 및 제어부문
    • /
    • pp.465-468
    • /
    • 2002
  • Today large corporations are constructing distributed server environment. Many corporations are respectively operating Web server, FTP server, Mail server and DB server on heterogeneous operation. However, there is the problem that a manager must manage each server individually. In this paper, we present distributed FTP server for log mining system on ACE. Proposed log mining system is based upon ACE (Adaptive Communication Environment) framework and data mining techniques. This system provides a united operation with distributed FTP server.

  • PDF

InterCom : 에이전트 기반 인터넷 컴퓨팅 환경 설계 및 구현 (InterCom : Design and Implementation of an Agent-based Internet Computing Environment)

  • 김명호;박권
    • 정보처리학회논문지A
    • /
    • 제8A권3호
    • /
    • pp.235-244
    • /
    • 2001
  • 네트워크와 컴퓨터 기술의 발달로 물리적으로 분산된 컴퓨터를 하나의 자원으로 사용하려는 연구가 많이 진행되고 있다. 일반적으로 이러한 연구들은 메시지 패싱을 기반으로 하는 환경을 개발하는 것이 주류를 이루고 있다. 이러한 환경은 보통 과학계산용 문제를 풀기 위해 많이 사용되고 주어진 문제의 내부병렬성을 이용하여 병렬처리 하게 된다. 따라서 보통 이러한 환경에서는 고도의 병렬성을 얻을 수 있다는 장점이 있는 반면에, 프로그래밍이 어렵고, 사용하기가 어려우며, 분산된 컴퓨터에 사용자의 계정이 있어야 한다는 단점이 있다. 그런데 만일 주어진 문제가 완전히 독립적인 작은 문제를 분할된다면 더욱 효율적인 환경을 만들 수 있다. 이러한 문제 유형은 생물정보학, 3차원 애니메이션, 그래픽스 등에 많이 준재하며, 이를 위한 새로운 환경 개발은 매우 중요한 연구라 할 수 있다. 따라서 본 논문에서는 이러한 문제를 효율적으로 처리하는 프록시 컴퓨팅 기반의 InterCom이라는 새로운 환경을 제안하고, 이들 구현한 것에 대해서 설명한다. 이 환경은 에이전트, 서버, 클라이언트로 구성되어 있다. 이 환경의 장점은 프로그래밍하기가 쉽고 분산된 모든 컴퓨터에 사용자 계정이 없어도 되며, 분산되는 코드를 자동 컴파일해 줌으로써 사용하기 쉽다는 것이다.

  • PDF

An Internet-based computing framework for the simulation of multi-scale response of structural systems

  • Chen, Hung-Ming;Lin, Yu-Chih
    • Structural Engineering and Mechanics
    • /
    • 제37권1호
    • /
    • pp.17-37
    • /
    • 2011
  • This paper presents a new Internet-based computational framework for the realistic simulation of multi-scale response of structural systems. Two levels of parallel processing are involved in this frame work: multiple local distributed computing environments connected by the Internet to form a cluster-to-cluster distributed computing environment. To utilize such a computing environment for a realistic simulation, the simulation task of a structural system has been separated into a simulation of a simplified global model in association with several detailed component models using various scales. These related multi-scale simulation tasks are distributed amongst clusters and connected to form a multi-level hierarchy. The Internet is used to coordinate geographically distributed simulation tasks. This paper also presents the development of a software framework that can support the multi-level hierarchical simulation approach, in a cluster-to-cluster distributed computing environment. The architectural design of the program also allows the integration of several multi-scale models to be clients and servers under a single platform. Such integration can combine geographically distributed computing resources to produce realistic simulations of structural systems.

Development of a Distributed Road Traffic Simulation System

  • Keawmanee, T.;Seubpradit, K.;Tandayya, P.
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2002년도 ITC-CSCC -2
    • /
    • pp.1324-1326
    • /
    • 2002
  • This paper concerns the development of distributed interactive simulation of a road traffic system. The simulation involved models of multiple and distributed road vehicles running on different locations. The simulation system represented a traffic system as if the distributed simulation models were in the same environment. The development of the distributed road traffic simulation was based on High Level Architecture (HLA), a state-of-the-art IEEE standard for the distributed and real-time simulation. Other work concerned modeling and simulating the road vehicles and building the map database for the virtual distributed shared environment. The information used in the simulation system was only in X-axis and Y-axis as the insignificant data in the Z-axis was omitted to simplify the simulation. However, the traffic system has visualized a 3-D coordinate system. The road vehicle models were able to avoid collision. The next direction of a vehicle can be chosen from the provided choices of further paths.

  • PDF

Design of a ParamHub for Machine Learning in a Distributed Cloud Environment

  • Su-Yeon Kim;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제16권2호
    • /
    • pp.161-168
    • /
    • 2024
  • As the size of big data models grows, distributed training is emerging as an essential element for large-scale machine learning tasks. In this paper, we propose ParamHub for distributed data training. During the training process, this agent utilizes the provided data to adjust various conditions of the model's parameters, such as the model structure, learning algorithm, hyperparameters, and bias, aiming to minimize the error between the model's predictions and the actual values. Furthermore, it operates autonomously, collecting and updating data in a distributed environment, thereby reducing the burden of load balancing that occurs in a centralized system. And Through communication between agents, resource management and learning processes can be coordinated, enabling efficient management of distributed data and resources. This approach enhances the scalability and stability of distributed machine learning systems while providing flexibility to be applied in various learning environments.

이기종 분산환경에서 PDM 통합환경 구현에 관한 연구 (A Study on the Implementation of PDM Integration Environment in Heterogeneous Distributed Environment)

  • 김형선
    • 산업경영시스템학회지
    • /
    • 제21권45호
    • /
    • pp.33-45
    • /
    • 1998
  • The typical characteristic of PDM(Product Data Management) System seperates the databases to store the meta data and applications. Therefore, meta data contains the information for the location of file, user profiles, relationships between the files, and process. PDM utilizes these information efficiently and does file management, configuration management, and process management. In this view, the integration strategy of PDM is to merge data and process. In the view of architecture, the interface between data and application and the actions of each application execute seamlessly. This architecture is viewed as integrated data and process among enterprises and implemented with client/server technology in distributed process environment that interfaced with open object-oriented technology which is developed with business object in the object-oriented infrastructure. In this paper, we studied the definition, function, and scope of PDM and researched the core technologies to implement the PDM integration environment. We also researched the PDM utilization in distributed enterprise environment and implementation of PDM integration environment with this technical background.

  • PDF

4족 보행로봇 및 MSRS를 이용한 분산 웹 개발환경 구축 (Construction of Distributed Web Development Environment using 4-Legged Robot and MSRS)

  • 양태규;서용호
    • 한국정보통신학회논문지
    • /
    • 제13권9호
    • /
    • pp.1964-1972
    • /
    • 2009
  • 본 논문은 4족 보행로봇 및 MSRS를 이용한 분산 웹 환경 로봇 서비스 개발환경을 제안하였다. 로봇 서비스 개발 환경은 고수준의 복잡한 로봇어플리케이션이 분산 웹 환경에서 동작 가능하게 하기 위하여, 마이크로소프트사의 MSRS를 이용해 로봇 기능들을 네트워크 노드에서 실행되는 서비스들로 구현하였다. 제안된 개발환경은 4족 보행 로봇인 제니보를 로봇플랫폼으로 선정하여 구현되어 졌다. 실험을 통해 개발된 로봇 서비스들은 분산 웹 환경 하에서 동적인 실행, 구성 및 원격 모니터링이 가능함을 보여주었다. 또한 개발된 로봇 서비스들을 복잡한 로봇어플리케이션을 쉽게 제작할 수 있도록 하는 비주얼프로그램 언어에서 사용하여 응용어플리케이션을 제작해 그 가능성을 검증하였다.

프로그래밍 투명성을 지원하는 분산 프로그래밍 도구의 설계 (A Design of Distributed Programing Tool in support of Programming Transparency)

  • 이상윤;김승호
    • 한국정보과학회논문지:정보통신
    • /
    • 제31권3호
    • /
    • pp.259-268
    • /
    • 2004
  • 분산 컴퓨팅 환경에 적용해야할 응용 소프트웨어의 비중이 증가함에 따라, 이를 지원하기 위한 다양한 형태의 분산 프로그래밍 도구들이 제안되어 있다. 그러나, 이러한 도구를 이용하여 분산처리 소프트웨어를 작성하기 위해서는 분산 프로그래밍 도구가 요구하는 부가적인 프로그래밍 지식을 숙지하여야 한다. 부가적인 지식 없이 분산처리를 수행하는 소프트웨어를 개발할 수 있다면, 분산처리에 대한 개발자의 부담을 줄여서, 개발하고자 하는 소프트웨어의 자체 기능에 더욱 집중할 수 있다. 본 논문에서는 새로운 분산 프로그래밍 도구를 제안하고, 이름을 TORB(Transparent Object Request Broker)라고 명명하였다. TORB를 이용하면, 프로그래밍 투명성의 지원을 통하여, 자바로 작성하는 분산처리 소프트웨어를 상대적으로 쉽게 개발할 수 있고, 후처리를 통하여 TORB가 제공하는 분산처리 환경에서 수행될 수 있다.

빅데이터를 위한 H-RTGL 기반 단일 분류기 분산 처리 프레임워크 설계 (Design of Distributed Processing Framework Based on H-RTGL One-class Classifier for Big Data)

  • 김도균;최진영
    • 품질경영학회지
    • /
    • 제48권4호
    • /
    • pp.553-566
    • /
    • 2020
  • Purpose: The purpose of this study was to design a framework for generating one-class classification algorithm based on Hyper-Rectangle(H-RTGL) in a distributed environment connected by network. Methods: At first, we devised one-class classifier based on H-RTGL which can be performed by distributed computing nodes considering model and data parallelism. Then, we also designed facilitating components for execution of distributed processing. In the end, we validate both effectiveness and efficiency of the classifier obtained from the proposed framework by a numerical experiment using data set obtained from UCI machine learning repository. Results: We designed distributed processing framework capable of one-class classification based on H-RTGL in distributed environment consisting of physically separated computing nodes. It includes components for implementation of model and data parallelism, which enables distributed generation of classifier. From a numerical experiment, we could observe that there was no significant change of classification performance assessed by statistical test and elapsed time was reduced due to application of distributed processing in dataset with considerable size. Conclusion: Based on such result, we can conclude that application of distributed processing for generating classifier can preserve classification performance and it can improve the efficiency of classification algorithms. In addition, we suggested an idea for future research directions of this paper as well as limitation of our work.