• Title/Summary/Keyword: 빅데이터플랫폼

Search Result 483, Processing Time 0.025 seconds

IoT Based Real-Time Indoor Air Quality Monitoring Platform for a Ventilation System (청정환기장치 최적제어를 위한 IoT 기반 실시간 공기질 모니터링 플랫폼 구현)

  • Uprety, Sudan Prasad;Kim, Yoosin
    • Journal of Internet Computing and Services
    • /
    • v.21 no.6
    • /
    • pp.95-104
    • /
    • 2020
  • In this paper, we propose the real time indoor air quality monitoring and controlling platform on cloud using IoT sensor data such as PM10, PM2.5, CO2, VOCs, temperature, and humidity which has direct or indirect impact to indoor air quality. The system is connected to air ventilator to manage and optimize the indoor air quality. The proposed system has three main parts; First, IoT data collection service to measure, and collect indoor air quality in real time from IoT sensor network, Second, Big data processing pipeline to process and store the collected data on cloud platform and Finally, Big data analysis and visualization service to give real time insight of indoor air quality on mobile and web application. For the implication of the proposed system, IoT sensor kits are installed on three different public day care center where the indoor pollution can cause serious impact to the health and education of growing kids. Analyzed results are visualized on mobile and web application. The impact of ventilation system to indoor air quality is tested statistically and the result shows the proper optimization of indoor air quality.

Korean Food Review Analysis Using Large Language Models: Sentiment Analysis and Multi-Labeling for Food Safety Hazard Detection (대형 언어 모델을 활용한 한국어 식품 리뷰 분석: 감성분석과 다중 라벨링을 통한 식품안전 위해 탐지 연구)

  • Eun-Seon Choi;Kyung-Hee Lee;Wan-Sup Cho
    • The Journal of Bigdata
    • /
    • v.9 no.1
    • /
    • pp.75-88
    • /
    • 2024
  • Recently, there have been cases reported in the news of individuals experiencing symptoms of food poisoning after consuming raw beef purchased from online platforms, or reviews claiming that cherry tomatoes tasted bitter. This suggests the potential for analyzing food reviews on online platforms to detect food hazards, enabling government agencies, food manufacturers, and distributors to manage consumer food safety risks. This study proposes a classification model that uses sentiment analysis and large language models to analyze food reviews and detect negative ones, multi-labeling key food safety hazards (food poisoning, spoilage, chemical odors, foreign objects). The sentiment analysis model effectively minimized the misclassification of negative reviews with a low False Positive rate using a 'funnel' model. The multi-labeling model for food safety hazards showed high performance with both recall and accuracy over 96% when using GPT-4 Turbo compared to GPT-3.5. Government agencies, food manufacturers, and distributors can use the proposed model to monitor consumer reviews in real-time, detect potential food safety issues early, and manage risks. Such a system can protect corporate brand reputation, enhance consumer protection, and ultimately improve consumer health and safety.

Design and Implementation of Multiple Filter Distributed Deduplication System Applying Cuckoo Filter Similarity (쿠쿠 필터 유사도를 적용한 다중 필터 분산 중복 제거 시스템 설계 및 구현)

  • Kim, Yeong-A;Kim, Gea-Hee;Kim, Hyun-Ju;Kim, Chang-Geun
    • Journal of Convergence for Information Technology
    • /
    • v.10 no.10
    • /
    • pp.1-8
    • /
    • 2020
  • The need for storage, management, and retrieval techniques for alternative data has emerged as technologies based on data generated from business activities conducted by enterprises have emerged as the key to business success in recent years. Existing big data platform systems must load a large amount of data generated in real time without delay to process unstructured data, which is an alternative data, and efficiently manage storage space by utilizing a deduplication system of different storages when redundant data occurs. In this paper, we propose a multi-layer distributed data deduplication process system using the similarity of the Cuckoo hashing filter technique considering the characteristics of big data. Similarity between virtual machines is applied as Cuckoo hash, individual storage nodes can improve performance with deduplication efficiency, and multi-layer Cuckoo filter is applied to reduce processing time. Experimental results show that the proposed method shortens the processing time by 8.9% and increases the deduplication rate by 10.3%.

A Design of N-Screen Convergence Presentation Tier by using Infographics Based on N-Tier Platform (N-Tier 플랫폼 환경에서 인포그래픽을 기반으로 N-스크린 융합 표현 계층의 설계)

  • Lee, Myeong-Ho
    • Journal of the Korea Convergence Society
    • /
    • v.5 no.4
    • /
    • pp.9-13
    • /
    • 2014
  • The environment of IT is, currently, on its developing process to the period of cloud computing, big data, and business intelligence which not only enable computer and internet to be utilized like the water or the air, but also be a new motivating force for its advance. In the respect of various interactions and Infographics, however, it is requiring more demands from its users, and additional functions which cannot be provided by the Web Browser. In this study, therefore, it will be suggested a design of N-screen convergence presentation tier by using infographics based on N-Tier platform.

A Study for Designing a Forest Disaster Response Platform (산림재난 대응 플랫폼 설계를 위한 기초연구)

  • Kye-Won Jun;Chang-Deok Jang;Bae-Dong Kang
    • Journal of Korean Society of Disaster and Security
    • /
    • v.17 no.1
    • /
    • pp.17-25
    • /
    • 2024
  • Recent climate change has led to an increase in the probability of forest disasters (forest fires, landslides). However, disaster systems providing information for forest disaster response lack unified information provision. Therefore, this study aims to provide essential disaster information from a unified system for swift disaster response. To achieve this goal, we conducted a fundamental study on the necessary components for designing a forest disaster platform, explored methods for visualizing platforms enabling swift response and information provision during forest disasters through case studies, and presented the findings. Our results indicate that both domestic and international forest disaster response platforms commonly utilize spatial information to provide location-specific information. Key components identified for designing a response platform for forest disasters include constructing forest disaster big data, including climate information for target areas, developing technology for integrated diagnosis of forest disasters at each stage, and designing tailored safety care services for disaster areas.

IoT(M2M) 기술 동향 및 발전 전망

  • Pyo, Cheol-Sik;Gang, Ho-Yong;Kim, Nae-Su;Bang, Hyo-Chan
    • Information and Communications Magazine
    • /
    • v.30 no.8
    • /
    • pp.3-10
    • /
    • 2013
  • 사물인터넷(IoT: Internet of Things)은 지능화된 사물들이 연결되는 네트워크를 통해 사람과 사물 (물리 또는 가상), 사물과 사물간에 상호 소통하고 상황인식 기반의 지식이 결합되어 지능적인 서비스를 제공하는 글로벌 인프라이며, 2017년 2,900억 달러 시장이 예측되는 스마트 폰 이후 유망기술이며 모바일, 클라우드, 빅데이터 기술 등과 융합하여 초연결사회의 핵심이 될 전망이다. IoT의 성공적인 실현을 위해서는 데이터 분석 및 추론, 개방형 시맨틱 플랫폼, 고신뢰 네트워크, 센서-스마트 단말 인터렉션 및 협업, 에너지 하베스팅, 스마트센서 등의 핵심기술 개발과 글로벌 표준화, 정보보호, 사생활 침해 우려 등의 장애 극복을 위해 IoT 생태계 참여자 모두의 협력이 필요하다.

A Leading Study of Data Lake Platform based on Big Data to support Business Intelligence (Business Intelligence를 지원하기 위한 Big Data 기반 Data Lake 플랫폼의 선행 연구)

  • Lee, Sang-Beom
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2018.01a
    • /
    • pp.31-34
    • /
    • 2018
  • We live in the digital era, and the characteristics of our customers in the digital era are constantly changing. That's why understanding business requirements and converting them to technical requirements is essential, and you have to understand the data model behind the business layout. Moreover, BI(Business Intelligence) is at the crux of revolutionizing enterprise to minimize losses and maximize profits. In this paper, we have described a leading study about the situation of desk-top BI(software product & programming language) in aspect of front-end side and the Data Lake platform based on Big Data by data modeling in aspect of back-end side to support the business intelligence.

  • PDF

PLS Path Modeling to Investigate the Relations between Competencies of Data Scientist and Big Data Analysis Performance : Focused on Kaggle Platform (데이터 사이언티스트의 역량과 빅데이터 분석성과의 PLS 경로모형분석 : Kaggle 플랫폼을 중심으로)

  • Han, Gyeong Jin;Cho, Keuntae
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.2
    • /
    • pp.112-121
    • /
    • 2016
  • This paper focuses on competencies of data scientists and behavioral intention that affect big data analysis performance. This experiment examined nine core factors required by data scientists. In order to investigate this, we conducted a survey to gather data from 103 data scientists who participated in big data competition at Kaggle platform and used factor analysis and PLS-SEM for the analysis methods. The results show that some key competency factors have influential effect on the big data analysis performance. This study is to provide a new theoretical basis needed for relevant research by analyzing the structural relationship between the individual competencies and performance, and practically to identify the priorities of the core competencies that data scientists must have.

Technical Trends in Intelligent Rehabilitation Services (지능형 재활 서비스 기술 동향)

  • B.S. Jeon;J.C. Kim
    • Electronics and Telecommunications Trends
    • /
    • v.38 no.3
    • /
    • pp.47-56
    • /
    • 2023
  • Physical rehabilitation consists of exercises that help individuals who have suffered injury, disease, or nervous system disorders to recover lost or impaired functions. The exercises need to be tailored to the degree and type of the patient's condition. To this end, a comprehensive rehabilitation data delivery system that connects medical institutions and local communities should be established, and an intelligent rehabilitation service technology should be developed. An intelligent rehabilitation service integrates and manages the patient's health information provided by medical institutions and the overall function evaluation information measured in the community. Based on the collected data, personalized rehabilitation services can be provided. We examine supportive policies and technological trends for rehabilitation exercise and sports. Additionally, we investigate development trends and key technologies of intelligent rehabilitation services being developed at ETRI.

Suggestion of development for domestic game market through big data analysis of global game trend (글로벌 게임 트렌드의 빅데이터 분석을 통한 국내 게임 시장의 발전 방향성 제시)

  • Song, Junhyup;Lim, Minwoo;Kim, Hansoo
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.07a
    • /
    • pp.161-164
    • /
    • 2022
  • 게임 산업은 기술의 발전과 비대면 서비스 수요 증가로 해마다 발전하고 있다. 본 연구는 사용자들의 수요를 조사하기 위하여 대중성이 가장 높은 온라인 게임 플랫폼에서 이용 시간이 많은 게임 정보를 확인하였다. HTML 파싱(parsing) 라이브러리를 통해 해당 게임들의 리뷰를 크롤링하여 엑셀 파일로 데이터베이스화하였고, 자연어 처리 라이브러리를 활용하여 데이터를 정제하였다. 총 5개 장르에 대하여 분석한 결과 각 장르에 해당하는 대표적인 키워드를 확인할 수 있었다. 취득한 키워드는 범용 시각화 패키지를 활용하여 워드 클라우드 형태로 한눈에 알아볼 수 있도록 시각화하였다.

  • PDF