• Title/Summary/Keyword: managing and utilizing data

Search Result 109, Processing Time 0.024 seconds

Design of Distributed Cloud System for Managing large-scale Genomic Data

  • Seine Jang;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.119-126
    • /
    • 2024
  • The volume of genomic data is constantly increasing in various modern industries and research fields. This growth presents new challenges and opportunities in terms of the quantity and diversity of genetic data. In this paper, we propose a distributed cloud system for integrating and managing large-scale gene databases. By introducing a distributed data storage and processing system based on the Hadoop Distributed File System (HDFS), various formats and sizes of genomic data can be efficiently integrated. Furthermore, by leveraging Spark on YARN, efficient management of distributed cloud computing tasks and optimal resource allocation are achieved. This establishes a foundation for the rapid processing and analysis of large-scale genomic data. Additionally, by utilizing BigQuery ML, machine learning models are developed to support genetic search and prediction, enabling researchers to more effectively utilize data. It is expected that this will contribute to driving innovative advancements in genetic research and applications.

Utilizing Artificial Neural Networks for Establishing Hearing-Loss Predicting Models Based on a Longitudinal Dataset and Their Implications for Managing the Hearing Conservation Program

  • Thanawat Khajonklin;Yih-Min Sun;Yue-Liang Leon Guo;Hsin-I Hsu;Chung Sik Yoon;Cheng-Yu Lin;Perng-Jy Tsai
    • Safety and Health at Work
    • /
    • v.15 no.2
    • /
    • pp.220-227
    • /
    • 2024
  • Background: Though the artificial neural network (ANN) technique has been used to predict noise-induced hearing loss (NIHL), the established prediction models have primarily relied on cross-sectional datasets, and hence, they may not comprehensively capture the chronic nature of NIHL as a disease linked to long-term noise exposure among workers. Methods: A comprehensive dataset was utilized, encompassing eight-year longitudinal personal hearing threshold levels (HTLs) as well as information on seven personal variables and two environmental variables to establish NIHL predicting models through the ANN technique. Three subdatasets were extracted from the afirementioned comprehensive dataset to assess the advantages of the present study in NIHL predictions. Results: The dataset was gathered from 170 workers employed in a steel-making industry, with a median cumulative noise exposure and HTL of 88.40 dBA-year and 19.58 dB, respectively. Utilizing the longitudinal dataset demonstrated superior prediction capabilities compared to cross-sectional datasets. Incorporating the more comprehensive dataset led to improved NIHL predictions, particularly when considering variables such as noise pattern and use of personal protective equipment. Despite fluctuations observed in the measured HTLs, the ANN predicting models consistently revealed a discernible trend. Conclusions: A consistent correlation was observed between the measured HTLs and the results obtained from the predicting models. However, it is essential to exercise caution when utilizing the model-predicted NIHLs for individual workers due to inherent personal fluctuations in HTLs. Nonetheless, these ANN models can serve as a valuable reference for the industry in effectively managing its hearing conservation program.

A Study on the Design and Implementation Human Resource Dispatch System of Using Case Based Reasoning (사례기반 추론을 이용한 인력파견시스템의 설계와 구현에 관한 연구)

  • Jung, Lee-Sang;Ha, Chang-Seung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.12 no.3
    • /
    • pp.95-103
    • /
    • 2007
  • Existing human resources dispatch systems face various limits for managing increasing information derived from the work-place as it required much time managing the basic data created at the work-place and the data input methods are complicated. This study focuses on how to solve the above mentioned problems by utilizing the cellular phone system, which provides vital connection between the organizations using the dispatched human resources and the resources. The study offers building of a necessary work history data base and its management through development of a mobile human resources dispatch system. In order to optimally place the given resources, the system utilizes deductive analytical process. Utilizing the intelligent, deductive analytical process in properly planning the placing of the right human resources to do the job will result satisfaction in human resources dispatch and management.

  • PDF

History Management Technology of Building Construction and Maintenance Using Vector Photo Information and BIM (벡터사진 정보와 BIM을 활용한 건축물의 시공·유지관리 이력관리기술)

  • Kim, Kyoon-Tai;Lim, Myung-Gu;Kim, Gu-Taek
    • Journal of the Korea Institute of Building Construction
    • /
    • v.14 no.6
    • /
    • pp.605-613
    • /
    • 2014
  • Recently proposed intelligent images are generating, storing and managing along with existing image information and 5W1H information. Therefore, these vector images can be useful in searching and managing photos taking during building construction and maintenance processes. In addition, when the vector photos, a key to the intelligent image, is linked with BIM, it is possible to find BIM objects by utilizing information included in vector photos. And if the taken vector photo is saved as attributes of the extracted object, the vector photo can be managed as the historical data. Furthermore, this new technology will contribute to make the management of construction information more efficiently. This study is about the development of the technology of extracting BIM objects from vector photo information and managing the attributes of the extracted objects. Also the prototype modules was developed and tested to evaluate the processes of setting reference points, converting coordinate system, calculating positions, and so on. Through these processes, it was confirmed that the possibility of extracting BIM objects from vector photos and of managing attribute data of objects.

Web Interface for Distributed STEP Data using Metadata (메타데이터를 이용한 분산 STEP 데이터의 웹 인터페이스)

  • 진연권;유상봉
    • Korean Journal of Computational Design and Engineering
    • /
    • v.5 no.3
    • /
    • pp.232-241
    • /
    • 2000
  • Even though we have greater chances to accomplish successful collaborative design by utilizing recent proliferation of networks, current practices do not fully take advantage of the information infrastructure. There are so much data over the networks, but not enough knowledge about the data is available to users. The main objectives of the product data interface system proposed in this paper are to capture more knowledge on managing product data and to provide users effective search capability. We define the metadata model for product data defined in STEP AP 203 and manage the metadata from product data in a repository system. Because we utilize the standard formats such as STEP for product data and RDF for metadata, the proposed approach can be applied to various fields of industries independently on commercial products.

  • PDF

Development of Integrated Metadata Accessing System for the Utilization of Griddata (그리드데이타의 활용을 위한 메타데이터 통합검색시스템의 개발)

  • 이재명;김계현;곽태식;박태옥
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2004.11a
    • /
    • pp.197-202
    • /
    • 2004
  • Nowadays, the demand of the output analyzed from the gridded data has been sharply increased as the remote sensing technologies and GIS related industry have been developed. Therefore, a metadata access system which fits the requirements of the users should be developed for better managing and utilizing gridded data. In this background, this study defined a common application schema through the analysis of the metadata built by numerous institutes based on the draft metadata standards proposed from the study which maily concentrated on establishing the standards of distributing metadata for the gridded data supported by ETRI at 2003. Also, XML based integrated system was developed to access metadata maintained by SaTReC as well as SIMC to facilitate more convenient data access for the grid data users. The results of the pilot system developed from this study can be expected to contribute to build an more efficient and enlarged integrated access system of the metadata for the gridded data.

  • PDF

Proposing XML based Integrated Griddata Metadata Accessing Method (XML기반의 그리드데이터 메타데이터 교환체계 구축 방안 제시)

  • Yi, Chae-Myoung;Kim, Kye-Hyun
    • 한국공간정보시스템학회:학술대회논문집
    • /
    • 2004.12a
    • /
    • pp.153-158
    • /
    • 2004
  • Nowadays, the demand of the output analyzed from the gridded data has been sharply increased as the remote sensing technologies and GIS related industry have been developed. Therefore, a metadata access system which fits the requirements of the users should be developed for better managing and utilizing gridded data. In this background, this study defined a common application schema through the analysis of the metadata built by numerous institutes based on the draft metadata standards proposed from the study which maily concentrated on establishing the standards of distributing metadata for the gridded data supported by ETRI at 2003. Also, XML based integrated system was developed to access metadata maintained by SaTReC as well as SIMC to facilitate more convenient data access for the grid data users. The results of the pilot system developed from this study can be expected to contribute to build an more efficient and enlarged integrated access system of the metadata for the gridded data.

  • PDF

A Diagnosis Study on the Korea Transport Database for Stable Feasibility Analysis on Transportation Facilities (국가교통시설 안정적 타당성 평가를 위한 국가교통데이터베이스 관리체제 진단 연구)

  • Kim, Jin-Tae
    • International Journal of Highway Engineering
    • /
    • v.16 no.4
    • /
    • pp.97-110
    • /
    • 2014
  • PURPOSES: This study is to find the substantial shortcomings embedded in the government policies and practical administrative processes associated with the Korean Transportation Database (KTDB) and to propose preliminary approaches to overcome. METHODS: Administrative and socioeconomic issues on inefficiency in public and private investment and redemption was found from the literature review. Through the interview of sets of experts and practitioners, a set of faultiness embodied in the administrative procedure utilizing and managing KTDB was found and analyzed. RESULTS: This study found the erroneous administrative elements categorized into four groups: faulty socioeconomic data supporting local governors's optimistic will yielded overestimation of future traffic demand; faulty data incidentally introduced in KTDB burdened traffic demand analysis; unavoidable misuse of KTDB worsened the unstability of KTDB; and apathy to manage the KTDB data deviated systematic management. The proposed includes the alteration of the administrative and technical systems to overcome those shortcomings. CONCLUSIONS : Erroneous administrative elements associated with KTDB should be concerned prior to indicating subsequential faultiness in demand analysis.

Basic System Design in the PBNM Scheme for Multiple Domains as Cyber Physical System Using Data Science and AI

  • Kazuya Odagiri;Shogo Shimizu;Naohiro Ishii
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.11
    • /
    • pp.1-7
    • /
    • 2023
  • In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, basic system design for PBNM scheme for multi-domain management utilizing data science and AI is proposed.

Experiment in the PBNM Scheme for Multiple Domains as Cyber Physical System Using Data Science and AI

  • Kazuya Odagiri;Shogo Shimizu;Naohiro Ishii
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.8
    • /
    • pp.54-60
    • /
    • 2024
  • In the current Internet system, there are many problems using anonymity of the network communication such as personal information leaks and crimes using the Internet system. This is why TCP/IP protocol used in Internet system does not have the user identification information on the communication data, and it is difficult to supervise the user performing the above acts immediately. As a study for solving the above problem, there is the study of Policy Based Network Management (PBNM). This is the scheme for managing a whole Local Area Network (LAN) through communication control for every user. In this PBNM, two types of schemes exist. As one scheme, we have studied theoretically about the Destination Addressing Control System (DACS) Scheme with affinity with existing internet. By applying this DACS Scheme to Internet system management, we will realize the policy-based Internet system management. In this paper, basic system design for PBNM scheme for multi-domain management utilizing data science and AI is showed with experiment in feasibility.