• Title/Summary/Keyword: multi database

Search Result 688, Processing Time 0.025 seconds

Data Cleaning and Integration of Multi-year Dietary Survey in the Korea National Health and Nutrition Examination Survey (KNHANES) using Database Normalization Theory (데이터베이스 정규화 이론을 이용한 국민건강영양조사 중 다년도 식이조사 자료 정제 및 통합)

  • Kwon, Namji;Suh, Jihye;Lee, Hunjoo
    • Journal of Environmental Health Sciences
    • /
    • v.43 no.4
    • /
    • pp.298-306
    • /
    • 2017
  • Objectives: Since 1998, the Korea National Health and Nutrition Examination Survey (KNHANES) has been conducted in order to investigate the health and nutritional status of Koreans. The food intake data of individuals in the KNHANES has also been utilized as source dataset for risk assessment of chemicals via food. To improve the reliability of intake estimation and prevent missing data for less-responded foods, the structure of integrated long-standing datasets is significant. However, it is difficult to merge multi-year survey datasets due to ineffective cleaning processes for handling extensive numbers of codes for each food item along with changes in dietary habits over time. Therefore, this study aims at 1) cleaning the process of abnormal data 2) generation of integrated long-standing raw data, and 3) contributing to the production of consistent dietary exposure factors. Methods: Codebooks, the guideline book, and raw intake data from KNHANES V and VI were used for analysis. The violation of the primary key constraint and the $1^{st}-3rd$ normal form in relational database theory were tested for the codebook and the structure of the raw data, respectively. Afterwards, the cleaning process was executed for the raw data by using these integrated codes. Results: Duplication of key records and abnormality in table structures were observed. However, after adjusting according to the suggested method above, the codes were corrected and integrated codes were newly created. Finally, we were able to clean the raw data provided by respondents to the KNHANES survey. Conclusion: The results of this study will contribute to the integration of the multi-year datasets and help improve the data production system by clarifying, testing, and verifying the primary key, integrity of the code, and primitive data structure according to the database normalization theory in the national health data.

Analysis and Evaluation of DBMS Bulk Data Loading Through Multi-tiered Architecture for Heterogeneous Systems (이기종 시스템에서 다층 구조를 통한 DBMS 대용량 데이터 로딩의 분석 및 평가)

  • Tan, Hee-Yuan;Lim, Hyo-Taek
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.1
    • /
    • pp.167-176
    • /
    • 2010
  • Managing the growing number of data generated through various processes requires the aid of Database Management System (DBMS) to efficiently handle the huge amount of data. These data can be inserted into database m real time or in batch, that come from multiple sources, including those that are coming from inside and outside of a network. The insertion of large amount of data is commonly done through specific bulk loading or insertion function supplied by each individual DBMS. In this paper, we analyze and evaluate on handling data bulk loading for heterogeneous systems that is organised as multi-tiered architecture and compare the result of DBMS bulk loader against program insertion from a software development perspective. We propose a hybrid solution using staging database that can be easily deployed for enhancing bulk loading performance compared to insertion by application.

Design of Network-based Game Using the GoF Design Patterns

  • Kim Jong-Soo;Kim Tai-Suk
    • Journal of Korea Multimedia Society
    • /
    • v.9 no.6
    • /
    • pp.742-749
    • /
    • 2006
  • In the network-based game where it uses the Internet infrastructure, the implementation is possible with the various methods. Such Applications are developed in the multi-tired architecture. There are many cases for the server to be separated from the hardware or the software. In this case, a lot of applications make the distributed process possible and are made as the multi-tiered architecture to develop the reusability of the existing software module. Especially, it is mostly general to separate for the case of a database server to a new tier. One of the important points of multi-tiered server side applications is security and because of this, it is difficult to share the related data about the design skill. Using design patterns, it gives help in reusing the existing written-code for the design of the game that needs a lot of money and time. Design Patterns are related to the software reuse. For the development of more efficient games, if well-defined design patterns are provided to the developers, then it would make more easy advanced game API and make possible the framework for the game development based on the API Through the analysis of the general network-based game currently servicing in the Internet, in this paper, we discuss how to implement a business logic tier using database system among the server side architectures. The main objective of this article is to show an efficient APIs(Application Programming Interfaces) design method which can be used to manage the data that must be saved to the database system among the packets that client/server have to be exchange.

  • PDF

A Design of Model For Interoperability in Multi-Database based XMDR on Distributed Environments (분산환경에서 XMDR 기반의 멀티데이터 베이스 상호운영 모델 설계)

  • Jung, Kye-Dong;Hwang, Chi-Gon;Choi, Young-Keun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.9
    • /
    • pp.1771-1780
    • /
    • 2007
  • The necessity of Information integration has emphasized by advancement of internet and change of enterprise environment. In enterprises, it usually integrates the multi-database constructing by M&A. For this integration of information it must guarantee interpretation and integration which is stabilized with solving heterogeneous characteristic problem. In this paper, we propose the method that change the global XML query to local XML query for interpretation. It is based on XMDR(eXtended Meta-Data Registry) which expresses the connection between the standard and the local for solve the interoperability problem in heterogeneous environment. Thus, we propose the legacy model that can search and modify by one Query with creating global XML Query by XMDR. and for his, we use the 2PC technique which is the distributed transaction control technique of existing.

The Study of DBaaS Hub System for Integration of Database In the Cloud Environment (클라우드 환경에서 데이터베이스 통합을 위한 DBaaS 허브 시스템에 관한 연구)

  • Jung, Kye-Dong;Hwang, Chi-Gon;Lee, Jong-Yong;Shin, Hyo-Young
    • Journal of Digital Convergence
    • /
    • v.12 no.9
    • /
    • pp.201-207
    • /
    • 2014
  • In the cloud environment, the company needs data integration and analysis to make decision and policy. If new system is added to this environment, a lot of time and cost is needed due to disparate properties among systems when data is integrated. Therefore, in this paper, we propose a DBaaS hub system for multi-database service. The DBaaS may require a different database and need data integration for relevant service. Using the ontology, we propose a metadata query to resolve the interoperability issues between data of DBaaS. The meta-query is not a query to access the real data, but the query for the upper level. This method provides data integration by accessing the data with the converted query through an ontology when we access the actual database.We also constructs a document-oriented database system using the metadata.

A Study on the Database Design in the MDO Environment (다분야 통합환경에서의 데이터베이스 설계 연구)

  • Hwang, Jin Yong;Jeong, Ju Yeong;Lee, Jae U;Byeon, Yeong Hwan
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.31 no.5
    • /
    • pp.25-36
    • /
    • 2003
  • Aircraft design pursues integrated design efforts by considering all design elements together. In the integrated design environment, it is crucial for the design data to be consistent, free of errorm, and most recent. Database design process consists of the analysis of the data which shall be stored and managed, the construction of the E-R Diagram, and the mapping of the database table. As a DBMS (DataBase Management System), Oracle 8i is employed to design and construct the database. The database design methodology is devised to apply for the several MDO(Multidisciplinary Design Optimization) techniques like MDF(MultiDisplinary Feasible), IDF(Individual Discipline Feasible), and CO(Collaborative Optimization). The defined process is demonstrated through a couple of design examples, including a simple numerical example and a UCAV(Unmanned Combat Aerial Vehicle) design optimization.

A Multi-Resolution Database Model for Management of Vector Geodata in Vehicle Dynamic Route Guidance System (동적 경로안내시스템에서 벡터 지오데이터의 관리를 위한 다중 해상도 모델)

  • Joo, Yong-Jin;Park, Soo-Hong
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.18 no.4
    • /
    • pp.101-107
    • /
    • 2010
  • The aim of this paper is to come up with a methodology of constructing an efficient model for multiple representations which can manage and reconcile real-time data about large-scale roads in Vector Domain. In other words, we suggested framework based on a bottom-up approach, which is allowed to integrate data from the network of the lowest level sequentially and perform automated matching in order to produce variable-scale map. Finally, we applied designed multi-LoD model to in-vehicle application.

The Efficient Query Evaluation Plan in the Spatial Database Engine

  • Liu, Zhao-Hong;Kim, Sung-Hee;Lee, Jae-Dong;Bae, Hae-Young
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2001.04b
    • /
    • pp.22-24
    • /
    • 2001
  • A new GIS software Spatial Database Engine(SDE) has been developed to integrated with spatial database that combines conventional and spatially related data. As we known well in the traditional relation database system, the query evaluation techniques are a well-researched subject, many useful and efficient algorithms have been proposed, but in the spatial database system, it is a litter difference with the traditionally ones. Based on the Query Graph Model(QGM), we implemented our own query evaulation plan in the SDE, which can deal with the full functionality query statement SELECT-FROM-WHERE_GROUPBY-HAVING, and treat the spatial data and non-spatial data seamlessly. We proposed a novel multi way join algorithm base on nest loop that may be attractive.

  • PDF

Database and knowledge-base for supporting distributed intelligent product design

  • Nguyen Congdu;Ha Sungdo
    • Proceedings of the IEEK Conference
    • /
    • summer
    • /
    • pp.87-91
    • /
    • 2004
  • This research presents distributed database and knowledge-base modeling approach for intelligent product design system. The product design information in this study is described by a collection of rules and design knowledge that are utilized according to the product development procedures. In this work, a network-based architecture has been developed to enable dispersed designers to simultaneously accomplish remote design tasks. A client/server communication diagram has also been proposed to facilitate consistent primary information modeling for multi-user access and reuse of designed results. An intelligent product design system has been studied with the concepts of distributed database and network-based architecture in order to support concurrent engineering design and automatic design part assembly. The system provides the capability of composing new designs from proper design elements stored in the database and knowledge-base. The distributed intelligent product design is applied to the design of an automobile part as an example.

  • PDF

A MULTI-DIMENSIONAL REDUCTION METHOD OF LARGE-SCALE SURVEY DATABASE

  • Lee, Y.;Kim, Y.S.;Kang, H.W.;Jung, J.H.;Lee, C.H.;Yim, I.S.;Kim, B.G.;Kim, H.G.;Kim, K.T.
    • Publications of The Korean Astronomical Society
    • /
    • v.28 no.1
    • /
    • pp.7-13
    • /
    • 2013
  • We present a multi-dimensional reduction method of the surveyed cube database obtained using a single- dish radio telescope in Taeduk Radio Astronomy Observatory (TRAO). The multibeam receiver system installed at the 14 m telescope in TRAO was not optimized at the initial stage, though it became more stabilized in the following season. We conducted a Galactic Plane survey using the multibeam receiver system. We show that the noise level of the first part of the survey was higher than expected, and a special reduction process seemed to be definitely required. Along with a brief review of classical methods, a multi-dimensional method of reduction is introduced; It is found that the 'background' task within IRAF (Image Reduction and Analysis Facility) can be applied to all three directions of the cube database. Various statistics of reduction results is tested using several IRAF tasks. The rms value of raw survey data is 0.241 K, and after primitive baseline subtraction and elimination of bad channel sections, the rms value turned out to be 0.210 K. After the one-dimensional reduction using 'background' task, the rms value is estimated to be 0.176 K. The average rms of the final reduced image is 0.137 K. Thus, the image quality is found to be improved about 43% using the new reduction method.