• Title/Summary/Keyword: bigdata analysis

Search Result 345, Processing Time 0.029 seconds

Performance Analysis Using a DNN-Based Sign Language Translation Model (DNN 기반 수어 번역 모델을 통한 성능 분석)

  • Min-Jae Jeong;Soong-Hwan Ro;Jun-Ki Hong
    • The Journal of Bigdata
    • /
    • v.9 no.1
    • /
    • pp.187-196
    • /
    • 2024
  • In this study, we propose a DNN (Deep Neural Network)-based sign language translation model that can significantly reduce training time by compressing sign language coordinates. We compared and analyzed the accuracy and training time of the model with and without sign language coordinate compression. The results of using the proposed model for sign language translation showed that while the accuracy decreased by approximately 5.9% after compressing the sign language video, the training time was reduced by 56.57%, indicating a substantial gain in training efficiency compared to the loss in translation accuracy.

Research of Performance Interference Control Technique for Heterogeneous Services in Bigdata Platform (빅데이터 플랫폼에서 이종 서비스간 성능 간섭 현상 제어에 관한 연구)

  • Jin, Kisung;Lee, Sangmin;Kim, Youngkyun
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.6
    • /
    • pp.284-289
    • /
    • 2016
  • In the Hadoop-based Big Data analysis model, the data movement between the legacy system and the analysis system is difficult to avoid. To overcome this problem, a unified Big Data file system is introduced so that a unified platform can support the legacy service as well as the analysis service. However, major challenges in avoiding the performance degradation problem due to the interference of two services remain. In order to solve this problem, we first performed a real-life simulation and observed resource utilization, workload characteristics and I/O balanced level. Based on this analysis, two solutions were proposed both for the system level and for the technical level. In the system level, we divide I/O path into the legacy I/O path and the analysis I/O path. In the technical level, we introduce an aggressive prefetch method for analysis service which requires the sequential read. Also, we introduce experimental results that shows the outstanding performance gain comparing the previous system.

An Exploratory Study on Improvement Method of the Subway Congestion Based Big Data Convergence (지하철 혼잡도 개선방안에 관한 빅데이터융합 기반의 탐색적 연구)

  • Kim, KeunWon;Kim, DongWoo;Noh, Kyoo-Sung;Lee, Joo-Yeoun
    • Journal of Digital Convergence
    • /
    • v.13 no.2
    • /
    • pp.35-42
    • /
    • 2015
  • As the value of Bigdata has been recognized importantly, public agencies including the government, private sector, etc. began to have an interest in Big Data. As there are sources of various data, and a variety of planning and analysis methods based on these sources has emerged, It is true that Bigdata will become a tool for creation of the new high qualitied information and decision making based on new insights. The purpose of this study is to find an alternative to the subway congestion problem that is not improved even though the various measures. In this study, we tried to explore approaches for ways to improve the congestion of the Seoul Subway using Seoul Metropolitan public data. Lastly, this study derived a policy alternative to establish new bus route that runs around the metro station that have a high level of congestion.

Design and Implementation of Bigdata Platform for Vessel Traffic Service (해상교통 관제 빅데이터 체계의 설계 및 구현)

  • Hye-Jin Kim;Jaeyong Oh
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.29 no.7
    • /
    • pp.887-892
    • /
    • 2023
  • Vessel traffic service(VTS) centers are equipped with RADAR, AIS(Automatic Identification System), weather sensors, and VHF(Very High Frequency). VTS operators use this equipment to observe the movement of ships operating in the VTS area and provide information. The VTS data generated by these various devices is highly valuable for analyzing maritime traffic situation. However, owing to a lack of compatibility between system manufacturers or policy issues, they are often not systematically managed. Therefore, we developed the VTS Bigdata Platform that could efficiently collect, store, and manage control data collected by the VTS, and this paper describes its design and implementation. A microservice architecture was applied to secure operational stability that was one of the important issues in the development of the platform. In addition, the performance of the platform could be improved by dualizing the storage for real-time navigation information. The implemented system was tested using real maritime data to check its performance, identify additional improvements, and consider its feasibility in a real VTS environment.

A Linked Analysis Method between Commercial district Information and Survey Information (상권정보와 설문정보의 연계 분석 방법)

  • Lee, Won-Cheol;Kang, Man-Su;Kim, Jinho
    • The Journal of Bigdata
    • /
    • v.5 no.2
    • /
    • pp.29-42
    • /
    • 2020
  • In Korea, micro-enterprises are in charge of an important part of the common people's economy, but face difficulties such as excessive competition, deteriorating profitability, and concentration of life-oriented industries. In order to solve this problem, the government is providing commercial district analysis services for micro-enterprises. However, the data provided by various organizations is not standardized, and there is a limit to the composition of the service with limited data. In this paper, we propose a method of solving the data consistency problem and linking and analyzing between questionnaire information and commercial district information to expand the data analysis service. The proposed linking methods are three methods: linking the commercial area information and questionnaire information in the same area based on the type of business and area, linking the survey information centered on individual micro-enterprise, and linking a small area of questionnaire information with a large area of commercial district information. The linked commercial district information and questionnaire information can be used in various ways or expanded analysis services. This proposed a method to overcome the limitations of existing commercial district analysis services with questionnaire information and lay the foundation for expanding the commercial district analysis services necessary for micro-enterprises.

Design and Implementation of a Survey System for Expanding Big Data-Based Commercial District Service (빅 데이터 기반의 상권 서비스 확장을 위한 설문조사시스템 설계 및 구현)

  • Lee, Won-Cheol;Kang, Man-Su;Kim, Jinho
    • The Journal of Bigdata
    • /
    • v.5 no.2
    • /
    • pp.171-186
    • /
    • 2020
  • The proportion of micro-enterprises and self-employed in Korea is excessively high compared to that of major developed countries, and frequent start-ups and business closures are repeated, causing enormous damage to the national economy. In order to solve this problem, various studies are underway for micro-enterprises, and the government provides commercial district information analysis services using big data for micro-enterprises. Among the commercial district information analysis services, the commercial district information analysis of our village store operated by the Seoul Metropolitan Government is continuously improving its service to provide the big data analysis service related to micro-enterprises. Since the service was built by integrating big data provided by various organizations, however, there are limitations in data reliability, data analysis, and service composition. In order to overcome these limitations, this paper proposes a location-based survey system that can be analyzed in conjunction with big data-based commercial district services. The proposed questionnaire survey system established the basis for expending the big data commercial district analysis service by linking the survey information and commercial district information.

Research of Water-related Disaster Monitoring Using Satellite Bigdata Based on Google Earth Engine Cloud Computing Platform (구글어스엔진 클라우드 컴퓨팅 플랫폼 기반 위성 빅데이터를 활용한 수재해 모니터링 연구)

  • Park, Jongsoo;Kang, Ki-mook
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_3
    • /
    • pp.1761-1775
    • /
    • 2022
  • Due to unpredictable climate change, the frequency of occurrence of water-related disasters and the scale of damage are also continuously increasing. In terms of disaster management, it is essential to identify the damaged area in a wide area and monitor for mid-term and long-term forecasting. In the field of water disasters, research on remote sensing technology using Synthetic Aperture Radar (SAR) satellite images for wide-area monitoring is being actively conducted. Time-series analysis for monitoring requires a complex preprocessing process that collects a large amount of images and considers the noisy radar characteristics, and for this, a considerable amount of time is required. With the recent development of cloud computing technology, many platforms capable of performing spatiotemporal analysis using satellite big data have been proposed. Google Earth Engine (GEE)is a representative platform that provides about 600 satellite data for free and enables semi real time space time analysis based on the analysis preparation data of satellite images. Therefore, in this study, immediate water disaster damage detection and mid to long term time series observation studies were conducted using GEE. Through the Otsu technique, which is mainly used for change detection, changes in river width and flood area due to river flooding were confirmed, centered on the torrential rains that occurred in 2020. In addition, in terms of disaster management, the change trend of the time series waterbody from 2018 to 2022 was confirmed. The short processing time through javascript based coding, and the strength of spatiotemporal analysis and result expression, are expected to enable use in the field of water disasters. In addition, it is expected that the field of application will be expanded through connection with various satellite bigdata in the future.

A Study on Unified Theory of Acceptance and Use of Technology(UTAUT) Improvement using Meta-Analysis: Focused on Analysis of Korea Citation Index(KCI)-Listed Researches (메타분석을 활용한 통합기술수용모형의 개선 연구: KCI 등재 논문 분석을 중심으로)

  • Hwang, Jeong-Seon;Lee, Hong Joo
    • The Journal of Bigdata
    • /
    • v.2 no.2
    • /
    • pp.47-56
    • /
    • 2017
  • The UTAUT was presented as a comprehensive of eight existing theories to improve the limit of Technology Acceptance Model (TAM), and it has been also utilizing in various fields related to acceptance and diffusion of new technology. In this study, we analyzed factors utilized in UTAUT through meta-analysis, and confirms the consistency of the model. We presented the principal factors and the additional factors. Moreover, we presented differences and suggestions through comparative analysis with previous researches. The meta-analysis showed that satisfaction, hedonic motivation, attitude, perceived enjoyment showed a important factors as additional factors. Based on this result, we presented an extended UTAUT model. In the case of Korea studies, it was found that increasing the degree of behavior intention is the most important factor leading to use behavior. The results of this research will be able to support researchers who research the acceptance and diffusion of new technologies, and companies trying to launch new products.

  • PDF

Design and Implementation of a Food Price Information Analysis System Based on Public Big Data (공공 빅데이터 기반의 식품 가격 정보 분석 시스템의 설계 및 구현)

  • Lim, Jongtae;Lee, Hyeonbyeong;Bok, Kyoungsoo;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.22 no.7
    • /
    • pp.10-17
    • /
    • 2022
  • Recently, with the issue of the 4th Industrial Revolution, many services using big data have been developed. Accordingly, studies have been conducting to utilize public data, which is considered as the most valuable data among big data. In this paper, we design and implement a food price information analysis system based on public big data. The proposed system analyzes the collected food price-related data in various forms from various sources and classifies them according to characteristics. In addition, the proposed system analyzes the factors affecting the price of food through big data analysis techniques and uses them as data to predict the price of food in the near future. Finally, the proposed system provides the user with the analyzed results through data visualization.