• Title/Summary/Keyword: Data modeling

Search Result 9,666, Processing Time 0.04 seconds

Modeling and Implementation of Public Open Data in NoSQL Database

  • Min, Meekyung
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.10 no.3
    • /
    • pp.51-58
    • /
    • 2018
  • In order to utilize various data provided by Korea public open data portal, data should be systematically managed using a database. Since the range of open data is enormous, and the amount of data continues to increase, it is preferable to use a database capable of processing big data in order to analyze and utilize the data. This paper proposes data modeling and implementation method suitable for public data. The target data is subway related data provided by the public open data portal. Schema of the public data related to Seoul metro stations are analyzed and problems of the schema are presented. To solve these problems, this paper proposes a method to normalize and structure the subway data and model it in NoSQL database. In addition, the implementation result is shown by using MongDB which is a document-based database capable of processing big data.

Numerical Study on the Impact of Meteorological Input Data on Air Quality Modeling on High Ozone Episode at Coastal Region (기상 입력 자료가 연안지역 고농도 오존 수치 모의에 미치는 영향)

  • Jeon, Won-Bae;Lee, Hwa-Woon;Lee, Soon-Hwan;Choi, Hyun-Jung;Kim, Dong-Hyuk;Park, Soon-Young
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.27 no.1
    • /
    • pp.30-40
    • /
    • 2011
  • Numerical simulations were carried out to investigate the impact of SST spatial distribution on the result of air quality modeling. Eulerian photochemical dispersion model CAMx (Comprehensive Air quality Model with eXtensions, version 4.50) was applied in this study and meteorological fields were prepared by RAMS (Regional Atmospheric Modeling System). Three different meteorological fields, due to different SST spatial distributions were used for air quality modeling to assess the sensitivity of CAMx modeling to the different meteorological input data. The horizontal distributions of surface ozone concentrations were analyzed and compared. In each case, the simulated ozone concentrations were different due to the discrepancies of horizontal SST distributions. The discrepancies of land-sea breeze velocity caused the difference of daytime and nighttime ozone concentrations. The result of statistic analysis also showed differences for each case. Case NG, which used meteorological fields with high resolution SST data was most successfully estimated correlation coefficient, root mean squared error and index of agreement value for ground level ozone concentration. The prediction accuracy was also improved clearly for case NG. In conclusion, the results suggest that SST spatial distribution plays an important role in the results of air quality modeling on high ozone episode at coastal region.

Assessment of modal parameters considering measurement and modeling errors

  • Huang, Qindan;Gardoni, Paolo;Hurlebaus, Stefan
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.717-733
    • /
    • 2015
  • Modal parameters of a structure are commonly used quantities for system identification and damage detection. With a limited number of studies on the statistics assessment of modal parameters, this paper presents procedures to properly account for the uncertainties present in the process of extracting modal parameters. Particularly, this paper focuses on how to deal with the measurement error in an ambient vibration test and the modeling error resulting from a modal parameter extraction process. A bootstrap approach is adopted, when an ensemble of a limited number of noised time-history response recordings is available. To estimate the modeling error associated with the extraction process, a model prediction expansion approach is adopted where the modeling error is considered as an "adjustment" to the prediction obtained from the extraction process. The proposed procedures can be further incorporated into the probabilistic analysis of applications where the modal parameters are used. This study considers the effects of the measurement and modeling errors and can provide guidance in allocating resources to improve the estimation accuracy of the modal data. As an illustration, the proposed procedures are applied to extract the modal data of a damaged beam, and the extracted modal data are used to detect potential damage locations using a damage detection method. It is shown that the variability in the modal parameters can be considered to be quite low due to the measurement and modeling errors; however, this low variability has a significant impact on the damage detection results for the studied beam.

Design of GIS based Korean Reach File Supporting Water Quality Modeling (수질모델링 지원을 위한 GIS 기반 한국형 Reach File 설계)

  • Kwon, Moon-Jin;Kim, Kye-Hyun;Lee, Chol-Young
    • Journal of Korea Water Resources Association
    • /
    • v.45 no.1
    • /
    • pp.1-13
    • /
    • 2012
  • Various input data required for water quality modeling have considerable impacts on modeling results and relevant analysis due to the absence of data standardization and lack of data accuracy. With this in mind, this study mainly focused on the designing Korean Reach File for more effective water quality modeling through the supply of database composed with accurate hydraulic and hydrologic data. The Korean Reach File is the hydraulic database with the locational information of individual reaches, and each reach represents the stream reach of homogeneous hydraulic characteristics. In detail, it has reach code designating each stream reach, and topological information including catalog unit, segment, marker and index. It was also designed considering linkage of existing codes such as stream name and stream code. The devised reach code was implemented to Kyungan River at the City of Gwangju of Kyunggi Province and the results showed that the reach code could effectively support the input database integrating basic numerous data required for water quality modeling based on a criterion as well as easier linkage and utilization with existing database. In addition, more systematic water quality management was enabled through the linkage of existing data such as treatment facilities, pollutant data, and management institutes using the reach codes defined for each stream section. In the future, more efforts need to be made to adopt the reach code as the national standard data thereby enabling utilization of numerous relevant database through the assigning of reach code to individual stream reaches nationwide.

A Study on the Calculation of Runoff Discharge in the Ohown river Basin Using the GIS Data and Hydrology Model (수문모형(HMS)과 GIS자료를 이용한 오원천 유역의 유출량 산정에 관한 연구)

  • 김운중;정남선;김경수
    • The Journal of Engineering Geology
    • /
    • v.10 no.3
    • /
    • pp.263-272
    • /
    • 2000
  • The main objective of this study is to simulate the rainfall-runoff relationship of the Ohwon rivet basin. For the this study, we used GIS technique and HMS(Hydrological Modeling System). In this study, watershed itself and geometric factors of watershed are extracted from DEM by using a GIS technique. The scanned data of topographical map with scale of 1:50,000 in the Ohwon river basin is used to this study and it is converted to DEM data. The parameters of Hydrological Modeling System as watershed area(A), river length, SCS Curve Number(CN) etc. are extracted by using the GIS technique in the Ohwon Basin. Extracted parameters are applied to the Hydrological Model System, then the paramenters optimized by the observed data and rainfall data. Then, the optimized parameters and Hydrological Modeling System are applied to the study area for the simulation of rainfall-runoff relationship. With the resultn of this study, GIS technique is useful to the extraction of watershed characteristics factors and Hydrological Modeling System is successful to the simulation of rainfall-runoff relationship.

  • PDF

Assessment of Global Air Quality Reanalysis and Its Impact as Chemical Boundary Conditions for a Local PM Modeling System (전지구 대기질 재분석 자료의 평가와 국지규모 미세먼지 예보모델에 미치는 영향)

  • Lee, Kangyeol;Lee, Soon-Hwan;Kim, EunJi
    • Journal of Environmental Science International
    • /
    • v.25 no.7
    • /
    • pp.1029-1042
    • /
    • 2016
  • The initial and boundary conditions are important factors in regional chemical transport modeling systems. The method of generating the chemical boundary conditions for regional air quality models tends to be different from the dynamically varying boundary conditions in global chemical transport models. In this study, the impact of real time Copernicus atmosphere monitoring service (CAMS) re-analysis data from the modeling atmospheric composition and climate project interim implementation (MACC) on the regional air quality in the Korean Peninsula was carried out using the community multi-scale air quality modeling system (CMAQ). A comparison between conventional global data and CAMS for numerical assessments was also conducted. Although the horizontal resolution of the CAMS re-analysis data is not higher than the conventionally provided data, the simulated particulate matter (PM) concentrations with boundary conditions for CAMS re-analysis is more reasonable than any other data, and the estimation accuracy over the entire Korean peninsula, including the Seoul and Daegu metropolitan areas, was improved. Although an inland area such as the Daegu metropolitan area often has large uncertainty in PM prediction, the level of improvement in the prediction for the Daegu metropolitan area is higher than in the coastal area of the western part of the Korean peninsula.

Enhancing Medium-Range Forecast Accuracy of Temperature and Relative Humidity over South Korea using Minimum Continuous Ranked Probability Score (CRPS) Statistical Correction Technique (연속 순위 확률 점수를 활용한 통합 앙상블 모델에 대한 기온 및 습도 후처리 모델 개발)

  • Hyejeong Bok;Junsu Kim;Yeon-Hee Kim;Eunju Cho;Seungbum Kim
    • Atmosphere
    • /
    • v.34 no.1
    • /
    • pp.23-34
    • /
    • 2024
  • The Korea Meteorological Administration has improved medium-range weather forecasts by implementing post-processing methods to minimize numerical model errors. In this study, we employ a statistical correction technique known as the minimum continuous ranked probability score (CRPS) to refine medium-range forecast guidance. This technique quantifies the similarity between the predicted values and the observed cumulative distribution function of the Unified Model Ensemble Prediction System for Global (UM EPSG). We evaluated the performance of the medium-range forecast guidance for surface air temperature and relative humidity, noting significant enhancements in seasonal bias and root mean squared error compared to observations. Notably, compared to the existing the medium-range forecast guidance, temperature forecasts exhibit 17.5% improvement in summer and 21.5% improvement in winter. Humidity forecasts also show 12% improvement in summer and 23% improvement in winter. The results indicate that utilizing the minimum CRPS for medium-range forecast guidance provide more reliable and improved performance than UM EPSG.

A Comparison of Modeling Methods for a Luxuriousness Model of Mobile Phones (감성모델링 기법 차이에 따른 휴대전화 고급감 모델의 비교 평가)

  • Kim, In-Gi;Yun, Myeong-Hwan;Lee, Cheol
    • Journal of the Ergonomics Society of Korea
    • /
    • v.25 no.2
    • /
    • pp.161-172
    • /
    • 2006
  • This study aims to compare and contrast the Kansei modeling methods for building a luxuriousness model that people feel about appearance of mobile phones. For the evaluation based on Kansei engineering approaches, 15 participants were employed to evaluate 18 mobile phones using a questionnaire. The results of evaluation were analyzed to build luxuriousness models through quantification I method, neural network, and decision tree method, respectively. The performance of Kansei modeling methods was compared and contrasted in terms of accuracy and predictability. The result of comparison of modeling methods indicated that model accuracy and predictability was closely related to the number of variables and data size. It was also revealed that quantification I method was the best in terms of model accuracy while decision tree method was the best modeling method with small variance in terms of predictability. However, it was empirically found that quantification I method showed extremely unstable predictability with small number of data. Consequently, it is expected that the research findings of this study might be utilized as a guideline for selecting proper Kansei modeling method.

Model development in freshwater ecology with a case study using evolutionary computation

  • Kim, Dong-Kyun;Jeong, Kwang-Seuk;McKay, Robert Ian (Bob);Chon, Tae-Soo;Kim, Hyun-Woo;Joo, Gea-Jae
    • Journal of Ecology and Environment
    • /
    • v.33 no.4
    • /
    • pp.275-288
    • /
    • 2010
  • Ecological modeling faces some unique problems in dealing with complex environment-organism relationships, making it one of the toughest domains that might be encountered by a modeler. Newer technologies and ecosystem modeling paradigms have recently been proposed, all as part of a broader effort to reduce the uncertainty in models arising from qualitative and quantitative imperfections in the ecological data. In this paper, evolutionary computation modeling approaches are introduced and proposed as useful modeling tools for ecosystems. The results of our case study support the applicability of an algal predictive model constructed via genetic programming. In conclusion, we propose that evolutionary computation may constitute a powerful tool for the modeling of highly complex objects, such as river ecosystems.

A Study on the BIM Application in Architecture Design Phase - Focus on BIM(Building Information Modeling) Process for Schematic Design- (건축설계에서 BIM(Building Information Modeling) 적용에 관한 연구 -계획설계 BIM(Building Information Modeling) 프로세스를 중심으로-)

  • Min, Young-Gi;Lee, Jae-Kook
    • Journal of The Korean Digital Architecture Interior Association
    • /
    • v.11 no.4
    • /
    • pp.29-38
    • /
    • 2011
  • In this study, neighborhood facility and office building to target two cases were performed BIM process. In the initial design phase of the planning process was conducted for the BIM process modeling, BIM in the design stage while performing the required range and level of the process were studied. Accordingly, from architectural firms to leverage BIM process, the proposed methods, efficient use of the modeling process proposed. Quality management information and input for the modeling and design process should be determined from the initial design and construction, including, for each field should be considered BIM, which require an appropriate range of information, according to these requirements, BIM creation and expansion of the level of information should be clearly defined. Perform the procedure for BIM in the process of communicating with stakeholders is critical. In addition, the input data and output data needed to perform management and to perform at the level obtained BIM design process and the model should be clear.