• Title/Summary/Keyword: managing and utilizing data

검색결과 109건 처리시간 0.028초

Design of Distributed Cloud System for Managing large-scale Genomic Data

  • Seine Jang;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제16권2호
    • /
    • pp.119-126
    • /
    • 2024
  • The volume of genomic data is constantly increasing in various modern industries and research fields. This growth presents new challenges and opportunities in terms of the quantity and diversity of genetic data. In this paper, we propose a distributed cloud system for integrating and managing large-scale gene databases. By introducing a distributed data storage and processing system based on the Hadoop Distributed File System (HDFS), various formats and sizes of genomic data can be efficiently integrated. Furthermore, by leveraging Spark on YARN, efficient management of distributed cloud computing tasks and optimal resource allocation are achieved. This establishes a foundation for the rapid processing and analysis of large-scale genomic data. Additionally, by utilizing BigQuery ML, machine learning models are developed to support genetic search and prediction, enabling researchers to more effectively utilize data. It is expected that this will contribute to driving innovative advancements in genetic research and applications.

Utilizing Artificial Neural Networks for Establishing Hearing-Loss Predicting Models Based on a Longitudinal Dataset and Their Implications for Managing the Hearing Conservation Program

  • Thanawat Khajonklin;Yih-Min Sun;Yue-Liang Leon Guo;Hsin-I Hsu;Chung Sik Yoon;Cheng-Yu Lin;Perng-Jy Tsai
    • Safety and Health at Work
    • /
    • 제15권2호
    • /
    • pp.220-227
    • /
    • 2024
  • Background: Though the artificial neural network (ANN) technique has been used to predict noise-induced hearing loss (NIHL), the established prediction models have primarily relied on cross-sectional datasets, and hence, they may not comprehensively capture the chronic nature of NIHL as a disease linked to long-term noise exposure among workers. Methods: A comprehensive dataset was utilized, encompassing eight-year longitudinal personal hearing threshold levels (HTLs) as well as information on seven personal variables and two environmental variables to establish NIHL predicting models through the ANN technique. Three subdatasets were extracted from the afirementioned comprehensive dataset to assess the advantages of the present study in NIHL predictions. Results: The dataset was gathered from 170 workers employed in a steel-making industry, with a median cumulative noise exposure and HTL of 88.40 dBA-year and 19.58 dB, respectively. Utilizing the longitudinal dataset demonstrated superior prediction capabilities compared to cross-sectional datasets. Incorporating the more comprehensive dataset led to improved NIHL predictions, particularly when considering variables such as noise pattern and use of personal protective equipment. Despite fluctuations observed in the measured HTLs, the ANN predicting models consistently revealed a discernible trend. Conclusions: A consistent correlation was observed between the measured HTLs and the results obtained from the predicting models. However, it is essential to exercise caution when utilizing the model-predicted NIHLs for individual workers due to inherent personal fluctuations in HTLs. Nonetheless, these ANN models can serve as a valuable reference for the industry in effectively managing its hearing conservation program.

사례기반 추론을 이용한 인력파견시스템의 설계와 구현에 관한 연구 (A Study on the Design and Implementation Human Resource Dispatch System of Using Case Based Reasoning)

  • 정이상;하창승
    • 한국컴퓨터정보학회논문지
    • /
    • 제12권3호
    • /
    • pp.95-103
    • /
    • 2007
  • 기존의 인력파견시스템은 작업 현장의 기초 자료를 관리하는데 많은 시간이 소요되고 정보의 입력방법이 복잡하여 급격히 늘어나는 작업 정보를 효율적으로 관리하는데 한계점이 있다. 또한 인력파견업체 중심의 시스템 관리와 인력 고용업체의 이해 부족은 인력 정보를 왜곡시키거나 누락시켜 적합성 높은 인력 배치를 어렵게 한다. 이러한 문제점을 해결하기 위해 본 연구에서는 휴대단말기를 이용하여 인력 고용업체와 근로 인력을 실시간으로 상호 연동하고 작업 이력을 데이터베이스에 축적하여 관리하는 모바일기반의 인력파견시스템을 개발한다. 또한 작업에 대한 근로 인력의 적합성을 향상하기 위해 사례기반 추론 기법을 사용하여 인력 배치 과정을 최적화 한다. 사례기반 추론을 이용한 지능적 처리는 인력 관리와 파견 작업에서 만족도 높은 인력 배치계획을 이룰 수 있는 기반을 제공한다.

  • PDF

벡터사진 정보와 BIM을 활용한 건축물의 시공·유지관리 이력관리기술 (History Management Technology of Building Construction and Maintenance Using Vector Photo Information and BIM)

  • 김균태;임명구;김구택
    • 한국건축시공학회지
    • /
    • 제14권6호
    • /
    • pp.605-613
    • /
    • 2014
  • 최근에 제안된 지능형 영상은 기존의 사진정보와 함께 6하원칙(5W1H)정보 등이 같이 생성 저장 관리되는 것이다. 그러므로 이 영상은 시공 유지관리 과정에서 촬영된 사진의 검색 관리에 매우 유용하게 쓰일 수 있다. 그리고 지능형 영상의 핵심이 되는 벡터사진이 BIM과 연계되면, 벡터사진에 포함된 정보를 활용하여 BIM객체를 찾아낼 수 있다. 그리고 찾아낸 BIM객체의 속성에 촬영된 벡터사진 정보를 저장하면, 벡터사진은 손쉽게 시공 유지관리 이력정보로 관리되어 건설정보관리의 효율화에 기여할 수 있다. 본 연구에서는 벡터사진 정보로부터 BIM의 객체를 추출하고, 추출된 객체의 속성을 관리하는 기술을 개발하였다. 그리고 프로토타입 모듈을 개발 테스트하여 기준점설정, 좌표계 변환, 위치계산 등의 과정을 평가하였다. 이를 통해 벡터사진으로부터 BIM 객체의 추출이 가능하며, 객체의 속성정보 관리도 가능함을 확인하였다.

메타데이터를 이용한 분산 STEP 데이터의 웹 인터페이스 (Web Interface for Distributed STEP Data using Metadata)

  • 진연권;유상봉
    • 한국CDE학회논문집
    • /
    • 제5권3호
    • /
    • pp.232-241
    • /
    • 2000
  • Even though we have greater chances to accomplish successful collaborative design by utilizing recent proliferation of networks, current practices do not fully take advantage of the information infrastructure. There are so much data over the networks, but not enough knowledge about the data is available to users. The main objectives of the product data interface system proposed in this paper are to capture more knowledge on managing product data and to provide users effective search capability. We define the metadata model for product data defined in STEP AP 203 and manage the metadata from product data in a repository system. Because we utilize the standard formats such as STEP for product data and RDF for metadata, the proposed approach can be applied to various fields of industries independently on commercial products.

  • PDF

그리드데이타의 활용을 위한 메타데이터 통합검색시스템의 개발 (Development of Integrated Metadata Accessing System for the Utilization of Griddata)

  • 이재명;김계현;곽태식;박태옥
    • 한국측량학회:학술대회논문집
    • /
    • 한국측량학회 2004년도 추계학술발표회 논문집
    • /
    • pp.197-202
    • /
    • 2004
  • Nowadays, the demand of the output analyzed from the gridded data has been sharply increased as the remote sensing technologies and GIS related industry have been developed. Therefore, a metadata access system which fits the requirements of the users should be developed for better managing and utilizing gridded data. In this background, this study defined a common application schema through the analysis of the metadata built by numerous institutes based on the draft metadata standards proposed from the study which maily concentrated on establishing the standards of distributing metadata for the gridded data supported by ETRI at 2003. Also, XML based integrated system was developed to access metadata maintained by SaTReC as well as SIMC to facilitate more convenient data access for the grid data users. The results of the pilot system developed from this study can be expected to contribute to build an more efficient and enlarged integrated access system of the metadata for the gridded data.

  • PDF

XML기반의 그리드데이터 메타데이터 교환체계 구축 방안 제시 (Proposing XML based Integrated Griddata Metadata Accessing Method)

  • 이재명;김계현
    • 한국공간정보시스템학회:학술대회논문집
    • /
    • 한국공간정보시스템학회 2004년도 국내 LBS 기술개발 및 표준화 동향세미나
    • /
    • pp.153-158
    • /
    • 2004
  • Nowadays, the demand of the output analyzed from the gridded data has been sharply increased as the remote sensing technologies and GIS related industry have been developed. Therefore, a metadata access system which fits the requirements of the users should be developed for better managing and utilizing gridded data. In this background, this study defined a common application schema through the analysis of the metadata built by numerous institutes based on the draft metadata standards proposed from the study which maily concentrated on establishing the standards of distributing metadata for the gridded data supported by ETRI at 2003. Also, XML based integrated system was developed to access metadata maintained by SaTReC as well as SIMC to facilitate more convenient data access for the grid data users. The results of the pilot system developed from this study can be expected to contribute to build an more efficient and enlarged integrated access system of the metadata for the gridded data.

  • PDF

국가교통시설 안정적 타당성 평가를 위한 국가교통데이터베이스 관리체제 진단 연구 (A Diagnosis Study on the Korea Transport Database for Stable Feasibility Analysis on Transportation Facilities)

  • 김진태
    • 한국도로학회논문집
    • /
    • 제16권4호
    • /
    • pp.97-110
    • /
    • 2014
  • PURPOSES: This study is to find the substantial shortcomings embedded in the government policies and practical administrative processes associated with the Korean Transportation Database (KTDB) and to propose preliminary approaches to overcome. METHODS: Administrative and socioeconomic issues on inefficiency in public and private investment and redemption was found from the literature review. Through the interview of sets of experts and practitioners, a set of faultiness embodied in the administrative procedure utilizing and managing KTDB was found and analyzed. RESULTS: This study found the erroneous administrative elements categorized into four groups: faulty socioeconomic data supporting local governors's optimistic will yielded overestimation of future traffic demand; faulty data incidentally introduced in KTDB burdened traffic demand analysis; unavoidable misuse of KTDB worsened the unstability of KTDB; and apathy to manage the KTDB data deviated systematic management. The proposed includes the alteration of the administrative and technical systems to overcome those shortcomings. CONCLUSIONS : Erroneous administrative elements associated with KTDB should be concerned prior to indicating subsequential faultiness in demand analysis.

Basic System Design in the PBNM Scheme for Multiple Domains as Cyber Physical System Using Data Science and AI

  • Kazuya Odagiri;Shogo Shimizu;Naohiro Ishii
    • International Journal of Computer Science & Network Security
    • /
    • 제23권11호
    • /
    • pp.1-7
    • /
    • 2023
  • In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, basic system design for PBNM scheme for multi-domain management utilizing data science and AI is proposed.

Experiment in the PBNM Scheme for Multiple Domains as Cyber Physical System Using Data Science and AI

  • Kazuya Odagiri;Shogo Shimizu;Naohiro Ishii
    • International Journal of Computer Science & Network Security
    • /
    • 제24권8호
    • /
    • pp.54-60
    • /
    • 2024
  • In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, basic system design for PBNM scheme for multi-domain management utilizing data science and AI is showed with experiment in feasibility.