• Title/Summary/Keyword: Bigdata platform

Search Result 59, Processing Time 0.029 seconds

Machine Learning-Based Programming Analysis Model Proposal : Based on User Behavioral Analysis

  • Jang, Seonghoon;Shin, Seung-Jung
    • International journal of advanced smart convergence
    • /
    • v.9 no.4
    • /
    • pp.179-183
    • /
    • 2020
  • The online education platform market is developing rapidly after the coronavirus infection-19 pandemic. As school classes at various levels are converted to non-face-to-face classes, interest in non-face-to-face online education is increasing more than ever. However, the majority of online platforms currently used are limited to the fragmentary functions of simply delivering images, voice and messages, and there are limitations to online hands-on training. Indeed, digital transformation is a traditional business method for increasing coding education and a corporate approach to service operation innovation strategy computing thinking power and platform model. There are many ways to evaluate a computer programmer's ability. Generally, piecemeal evaluation methods are used to evaluate results in time through coding tests. In this study, the purpose of this study is to propose a comprehensive evaluation of not only the results of writing, but also the execution process of the results, etc., and to evaluate the programmer's propensity habits based on the programmer's coding experience to evaluate the programmer's ability and productivity.

Methodology for Evaluating Big Data Platforms Performance in the Domestic Electronic Power Industry (국내 전력산업에서의 빅데이터 플랫폼 성과 평가 방법론)

  • Cho, Chisun;Lee, Nangyu;Hahm, Yukun
    • The Journal of Bigdata
    • /
    • v.5 no.1
    • /
    • pp.97-108
    • /
    • 2020
  • As the domestic electric power industry becomes a smart grid, big data platforms for demand management, facility management, and customer service have been deployed. However, due to the nature of the big data project, big data platforms take time to realize their value in the business processes. Therefore, it is not easy to evaluate the performance of the initial big data platforms using the known or theoretical evaluation methods. In this paper, we propose a methodology of big data platform performance evaluation based on specific information quality such as information completeness/sufficiency, information reliability, information relevancy, information comparability, information unbiasedness, timeliness of information, related to the volume, diversity, and velocity of big data.

Study of Trust Bigdata Platform (신뢰성 빅데이터 플렛폼의 연구)

  • Kim, Jeong-Joon;Kwak, Kwang-Jin;Lee, Don-Hee;Lee, Yong-Soo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.16 no.6
    • /
    • pp.225-230
    • /
    • 2016
  • Recently, Web has arisen large amount of data that to the development of the network and the Internet. In order to process it appeared that Big Data technology. Big Data technologies have been studied aiming a multifaceted and accurate analysis using existing regular data and a variety of data social data. But social data does not have the expertise and objectivity. And such manipulation and concealment and distortion of information have been raised troubling. Thus, this paper proposes for trust big data platform and will be described in detail. The big data platform proposed in this paper consists of data refiner, Data Analyzer, co-truster, visualizer, searcher, etc.

Research of Performance Interference Control Technique for Heterogeneous Services in Bigdata Platform (빅데이터 플랫폼에서 이종 서비스간 성능 간섭 현상 제어에 관한 연구)

  • Jin, Kisung;Lee, Sangmin;Kim, Youngkyun
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.6
    • /
    • pp.284-289
    • /
    • 2016
  • In the Hadoop-based Big Data analysis model, the data movement between the legacy system and the analysis system is difficult to avoid. To overcome this problem, a unified Big Data file system is introduced so that a unified platform can support the legacy service as well as the analysis service. However, major challenges in avoiding the performance degradation problem due to the interference of two services remain. In order to solve this problem, we first performed a real-life simulation and observed resource utilization, workload characteristics and I/O balanced level. Based on this analysis, two solutions were proposed both for the system level and for the technical level. In the system level, we divide I/O path into the legacy I/O path and the analysis I/O path. In the technical level, we introduce an aggressive prefetch method for analysis service which requires the sequential read. Also, we introduce experimental results that shows the outstanding performance gain comparing the previous system.

Research of Water-related Disaster Monitoring Using Satellite Bigdata Based on Google Earth Engine Cloud Computing Platform (구글어스엔진 클라우드 컴퓨팅 플랫폼 기반 위성 빅데이터를 활용한 수재해 모니터링 연구)

  • Park, Jongsoo;Kang, Ki-mook
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_3
    • /
    • pp.1761-1775
    • /
    • 2022
  • Due to unpredictable climate change, the frequency of occurrence of water-related disasters and the scale of damage are also continuously increasing. In terms of disaster management, it is essential to identify the damaged area in a wide area and monitor for mid-term and long-term forecasting. In the field of water disasters, research on remote sensing technology using Synthetic Aperture Radar (SAR) satellite images for wide-area monitoring is being actively conducted. Time-series analysis for monitoring requires a complex preprocessing process that collects a large amount of images and considers the noisy radar characteristics, and for this, a considerable amount of time is required. With the recent development of cloud computing technology, many platforms capable of performing spatiotemporal analysis using satellite big data have been proposed. Google Earth Engine (GEE)is a representative platform that provides about 600 satellite data for free and enables semi real time space time analysis based on the analysis preparation data of satellite images. Therefore, in this study, immediate water disaster damage detection and mid to long term time series observation studies were conducted using GEE. Through the Otsu technique, which is mainly used for change detection, changes in river width and flood area due to river flooding were confirmed, centered on the torrential rains that occurred in 2020. In addition, in terms of disaster management, the change trend of the time series waterbody from 2018 to 2022 was confirmed. The short processing time through javascript based coding, and the strength of spatiotemporal analysis and result expression, are expected to enable use in the field of water disasters. In addition, it is expected that the field of application will be expanded through connection with various satellite bigdata in the future.

A Study on the Feasibility of IoT and AI-based elderly care system application

  • KANG, Minsoo;KIM, Baek Seob;SEO, Jin Won;KIM, Kyu Ho
    • Korean Journal of Artificial Intelligence
    • /
    • v.9 no.2
    • /
    • pp.15-21
    • /
    • 2021
  • This paper conducted a feasibility study by applying an Internet of Things and Artificial intelligence-based management system for the elderly living alone in an aging society. The number of single-person families over the age of 50 is expected to increase, and problems such as health, safety, and loneliness may occur due to aging. Therefore, by establishing an IoT-based care system for the elderly living alone, a stable service was developed through securing a rapid response system for the elderly living alone and automatically reporting 119. The participants of the demonstration test were subjects under the jurisdiction of the "Seongnam Senior Complex," and the data collection rate between the IoT sensor and the emergency safety gateway was high. During the demonstration period, as a result of evaluating the satisfaction of the IoT-based care system for the elderly living alone, 90 points were achieved. We are currently in the COVID-19 situation. Therefore, the number of elderly living alone is continuously increasing, and the number of people who cannot benefit from care services will continue to occur. Also, even if the COVID-19 situation is over, the epidemic will happen again. So the care system is essential. The elderly care system developed in this way will provide safety management services based on artificial intelligence-based activity pattern analysis, improving the quality of in-house safety services.

Deep Learning-Based Smart Meter Wattage Prediction Analysis Platform

  • Jang, Seonghoon;Shin, Seung-Jung
    • International journal of advanced smart convergence
    • /
    • v.9 no.4
    • /
    • pp.173-178
    • /
    • 2020
  • As the fourth industrial revolution, in which people, objects, and information are connected as one, various fields such as smart energy, smart cities, artificial intelligence, the Internet of Things, unmanned cars, and robot industries are becoming the mainstream, drawing attention to big data. Among them, Smart Grid is a technology that maximizes energy efficiency by converging information and communication technologies into the power grid to establish a smart grid that can know electricity usage, supply volume, and power line conditions. Smart meters are equient that monitors and communicates power usage. We start with the goal of building a virtual smart grid and constructing a virtual environment in which real-time data is generated to accommodate large volumes of data that are small in capacity but regularly generated. A major role is given in creating a software/hardware architecture deployment environment suitable for the system for test operations. It is necessary to identify the advantages and disadvantages of the software according to the characteristics of the collected data and select sub-projects suitable for the purpose. The collected data was collected/loaded/processed/analyzed by the Hadoop ecosystem-based big data platform, and used to predict power demand through deep learning.

Designing Cost Effective Open Source System for Bigdata Analysis (빅데이터 분석을 위한 비용효과적 오픈 소스 시스템 설계)

  • Lee, Jong-Hwa;Lee, Hyun-Kyu
    • Knowledge Management Research
    • /
    • v.19 no.1
    • /
    • pp.119-132
    • /
    • 2018
  • Many advanced products and services are emerging in the market thanks to data-based technologies such as Internet (IoT), Big Data, and AI. The construction of a system for data processing under the IoT network environment is not simple in configuration, and has a lot of restrictions due to a high cost for constructing a high performance server environment. Therefore, in this paper, we will design a development environment for large data analysis computing platform using open source with low cost and practicality. Therefore, this study intends to implement a big data processing system using Raspberry Pi, an ultra-small PC environment, and open source API. This big data processing system includes building a portable server system, building a web server for web mining, developing Python IDE classes for crawling, and developing R Libraries for NLP and visualization. Through this research, we will develop a web environment that can control real-time data collection and analysis of web media in a mobile environment and present it as a curriculum for non-IT specialists.

Producing method of e-learning contents by collective intelligence (집단지성을 발현한 학습 컨텐츠 제작 방법)

  • Lee, Doo-young
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2013.10a
    • /
    • pp.759-760
    • /
    • 2013
  • Duaring IT industrial trend time, there are many important concept. Cloud computing, Bigdata issue, etc. One of the most important concept is 'Web 2.0' On educational industry, there is not enough up-dated at Web 2.0 concept. It has still One way study model. So apply 'web 2.0' concept on educational platform, and especially e-learning class, we can apply 'collective intelligence' concept.

  • PDF

Agriculture Bigdata Management and AI Research Platform Development (농업 빅데이터 관리 및 인공지능 연구 플랫폼 개발)

  • Kim, Ki-Hyeon;Seok, Woojin;Moon, Junghoon;Kim, Kwangsoo;Sim, Joonyong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.11a
    • /
    • pp.507-509
    • /
    • 2022
  • 농업은 우리의 삶에서 빼놓을 수 없는 중요한 분야이며, 농업은 토지를 이용하여 다양한 작물들을 길러 음식을 만드는 기본이라고 말할 수 있다. 이렇게 중요한 농업 분야를 ICT 분야에서 가장 이슈가 되는 기술인 인공지능 기술과 결합하여 스마트팜과 같은 농업의 디지털화를 구축할 수 있다. 이와 같은 스마트팜 구축을 위해서는 기본적으로 다양한 작물의 빅데이터를 제공하고, 이 데이터를 바탕으로 인공지능을 수행하여 다양한 결과를 제공할 수 있다. 하지만 인공지능 연구를 수행하기 위한 시스템 및 플랫폼의 부재라는 문제점이 존재한다. 이러한 문제점을 해결하기 위해 농업 빅데이터 관리 및 인공지능 연구 플랫폼 개발을 위한 과제를 통해 농업 빅데이터를 관리하고 인공지능을 연구자들이 손쉽게 수행할 수 있는 플랫폼을 개발하여 농업 분야의 작물 생산성 향상에 기여하고자 한다.