• Title/Summary/Keyword: Large-scale database

Search Result 297, Processing Time 0.028 seconds

EFFICIENT MANAGEMENT OF VERY LARGE MOVING OBJECTS DATABASE

  • Lee, Seong-Ho;Lee, Jae-Ho;An, Kyoung-Hwan;Park, Jong-Hyun
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.725-727
    • /
    • 2006
  • The development of GIS and Location-Based Services requires a high-level database that will be able to allow real-time access to moving objects for spatial and temporal operations. MODB.MM is able to meet these requirements quite adequately, providing operations with the abilities of acquiring, storing, and querying large-scale moving objects. It enables a dynamic and diverse query mechanism, including searches by region, trajectory, and temporal location of a large number of moving objects that may change their locations with time variation. Furthermore, MODB.MM is designed to allow for performance upon main memory and the system supports the migration on out-of-date data from main memory to disk. We define the particular query for truncation of moving objects data and design two migration methods so as to operate the main memory moving objects database system and file-based location storage system with.

  • PDF

Database System Parameter Toning in the TPC-W Benchmark (TPC-W 성능 평가에서의 데이타베이스 시스템 성능 인자 튜닝)

  • 류문수;정회진;이상호
    • Journal of KIISE:Databases
    • /
    • v.31 no.4
    • /
    • pp.373-383
    • /
    • 2004
  • There have been an emerging interests in the importance of database tuning techniques under modem database environments in which very large-scale data should be managed. In Particular. database performance parameters should be tuned to reflect system loads appropriately. This paper presents two parameter tuning strategies, namely throughput-based and response-time-based, which tune each performance parameter accordingly. The proposed techniques are applied to two commercial database systems in the TPC-W benchmark to see the effectiveness of those methods. The results show that they can help improve system performance considerably.

Analysis of Impact Between Data Analysis Performance and Database

  • Kyoungju Min;Jeongyun Cho;Manho Jung;Hyangbae Lee
    • Journal of information and communication convergence engineering
    • /
    • v.21 no.3
    • /
    • pp.244-251
    • /
    • 2023
  • Engineering or humanities data are stored in databases and are often used for search services. While the latest deep-learning technologies, such like BART and BERT, are utilized for data analysis, humanities data still rely on traditional databases. Representative analysis methods include n-gram and lexical statistical extraction. However, when using a database, performance limitation is often imposed on the result calculations. This study presents an experimental process using MariaDB on a PC, which is easily accessible in a laboratory, to analyze the impact of the database on data analysis performance. The findings highlight the fact that the database becomes a bottleneck when analyzing large-scale text data, particularly over hundreds of thousands of records. To address this issue, a method was proposed to provide real-time humanities data analysis web services by leveraging the open source database, with a focus on the Seungjeongwon-Ilgy, one of the largest datasets in the humanities fields.

차세대 고속전철 시스템 시험검증 체계 구축 및 적용

  • Choe Jong Min;Yu Il Sang;Kim Yeon Tae;Park Yeong Won
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2002.05a
    • /
    • pp.1079-1084
    • /
    • 2002
  • Systems engineering technology development program for Korea next-generation high-speed railway(KNHR) system in progress is a national large-scale system development program that is not only a large-size and complex but also multi-disciplinary in nature. Using the RDD-IOO, a systems engineering tool, the KNHR program can establish requirements traceability and development process management in the course of development. This paper presents the results from a computer-aided systems engineering application to KNHR system technology development project over the three years of activities. The traceability among the system design database in the vertical direction of SE process, as the results of the first year and the second year research was accomplished. The database in both the requirement management domain and the project management domain was developed and set up the traceability between them in the horizontal direction of the SE process in the V model as the results of the third year research. Therefore, KNHR design database was built to support the life-cycle management of the system as well as to reuse the knowledge in future programs. In the following development phase, this database will be utilized to accomplish the test and integration activities providing a baseline database. The outcome of the study contributes to the establishment of the model-based systems engineering approach as a best practice in the accumulation and advancement of systems engineering technology for railway system development.

  • PDF

Development of Out-of-Core Equation Solver with Virtual Memory Database for Large-Scale Structural Analysis (가상 메모리 데이타베이스를 이용한 대규모 구조해석용 코어 외 방정식 해석기법의 개발)

  • 이성우;송윤환;이동근
    • Computational Structural Engineering
    • /
    • v.4 no.2
    • /
    • pp.103-110
    • /
    • 1991
  • To solve the large problems with limited core memory of computer, a disk management scheme called virtual memory database has been developed. Utilizing this technique along with memory moving scheme, an efficient in-and out-of-core column solver for the sparse symmetric matrix commonly arising in the finite element analysis is developed. Compared with other methods the algorithm is simple, therefore the coding and computational efficiencies are greatly enhanced. Analysis example shows that the proposed method efficiently solve the large structural problem on the small-memory micro-computer.

  • PDF

RDFS Rule based Parallel Reasoning Scheme for Large-Scale Streaming Sensor Data (대용량 스트리밍 센서데이터 환경에서 RDFS 규칙기반 병렬추론 기법)

  • Kwon, SoonHyun;Park, Youngtack
    • Journal of KIISE
    • /
    • v.41 no.9
    • /
    • pp.686-698
    • /
    • 2014
  • Recently, large-scale streaming sensor data have emerged due to explosive supply of smart phones, diffusion of IoT and Cloud computing technology, and generalization of IoT devices. Also, researches on combination of semantic web technology are being actively pushed forward by increasing of requirements for creating new value of data through data sharing and mash-up in large-scale environments. However, we are faced with big issues due to large-scale and streaming data in the inference field for creating a new knowledge. For this reason, we propose the RDFS rule based parallel reasoning scheme to service by processing large-scale streaming sensor data with the semantic web technology. In the proposed scheme, we run in parallel each job of Rete network algorithm, the existing rule inference algorithm and sharing data using the HBase, a hadoop database, as a public storage. To achieve this, we implement our system and evaluate performance through the AWS data of the weather center as large-scale streaming sensor data.

A Study on the Data Reduction Techniques for Small Scale Map Production (소축적 지도제작을 위한 데이터 감축 기법에 관한 연구)

  • 곽강율;이호남;김명배
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.13 no.1
    • /
    • pp.77-83
    • /
    • 1995
  • This paper is concentrated on map generalization in digital environment for automated multi-scale map pro-duction using conventional hardcopy maps. Line generalization is urgently required process to prepare small scale digital map database when large scale map databases are available. This paper outlines a new approach to the line generalization when preparing small scale map on the basis of existing large scale distal map. Line generalizations are conducted based on zero-crossing algorithm using six sheets of 115,000 scale YEOSU area which produced by National Geographic Institute. The results are compared to Douglas-Peucker algorithm and manual method. The study gives full details of the data reduction rates and alternatives based on the proposed algorithm.

  • PDF

Adaptive Decision Tree Algorithm for Machine Diagnosis (기계 진단을 위한 적응형 의사결정 트리 알고리즘)

  • 백준걸;김강호;김창욱;김성식
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2000.04a
    • /
    • pp.235-238
    • /
    • 2000
  • This article presents an adaptive decision tree algorithm for dynamically reasoning machine failure cause out of real-time, large-scale machine status database. On the basis of experiment using semiconductor etching machine, it has been verified that our model outperforms previously proposed decision tree models.

  • PDF

Application of the Large-scale Climate Ensemble Simulations to Analysis on Changes of Precipitation Trend Caused by Global Climate Change (기후변화에 따른 강수 특성 변화 분석을 위한 대규모 기후 앙상블 모의자료 적용)

  • Kim, Youngkyu;Son, Minwoo
    • Atmosphere
    • /
    • v.32 no.1
    • /
    • pp.1-15
    • /
    • 2022
  • Recently, Japan's Meteorological Research Institute presented the d4PDF database (Database for Policy Decision-Making for Future Climate Change, d4PDF) through large-scale climate ensemble simulations to overcome uncertainty arising from variability when the general circulation model represents extreme-scale precipitation. In this study, the change of precipitation characteristics between the historical and future climate conditions in the Yongdam-dam basin was analyzed using the d4PDF data. The result shows that annual mean precipitation and seasonal mean precipitation increased by more than 10% in future climate conditions. This study also performed an analysis on the change of the return period rainfall. The annual maximum daily rainfall was extracted for each climatic condition, and the rainfall with each return period was estimated. In this process, we represent the extreme-scale rainfall corresponding to a very long return period without any statistical model and method as the d4PDF provides rainfall data during 3,000 years for historical climate conditions and during 5,400 years for future climate conditions. The rainfall with a 50-year return period under future climate conditions exceeded the rainfall with a 100-year return period under historical climate conditions. Consequently, in future climate conditions, the magnitude of rainfall increased at the same return period and, the return period decreased at the same magnitude of rainfall. In this study, by using the d4PDF data, it was possible to analyze the change in extreme magnitude of rainfall.

Computational analysis of large-scale genome expression data

  • Zhang, Michael
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2000.11a
    • /
    • pp.41-44
    • /
    • 2000
  • With the advent of DNA microarray and "chip" technologies, gene expression in an organism can be monitored on a genomic scale, allowing the transcription levels of many genes to be measured simultaneously. Functional interpretation of massive expression data and linking such data to DNA sequences have become the new challenges to bioinformatics. I will us yeast cell cycle expression data analysis as an example to demonstrate how special database and computational methods may be used for extracting functional information, I will also briefly describe a novel clustering algorithm which has been applied to the cell cycle data.

  • PDF