• Title/Summary/Keyword: Big data model

Search Result 1,365, Processing Time 0.028 seconds

A Study on implementation model for security log analysis system using Big Data platform (빅데이터 플랫폼을 이용한 보안로그 분석 시스템 구현 모델 연구)

  • Han, Ki-Hyoung;Jeong, Hyung-Jong;Lee, Doog-Sik;Chae, Myung-Hui;Yoon, Cheol-Hee;Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.351-359
    • /
    • 2014
  • The log data generated by security equipment have been synthetically analyzed on the ESM(Enterprise Security Management) base so far, but due to its limitations of the capacity and processing performance, it is not suited for big data processing. Therefore the another way of technology on the big data platform is necessary. Big Data platform can achieve a large amount of data collection, storage, processing, retrieval, analysis, and visualization by using Hadoop Ecosystem. Currently ESM technology has developed in the way of SIEM (Security Information & Event Management) technology, and to implement security technology in SIEM way, Big Data platform technology is essential that can handle large log data which occurs in the current security devices. In this paper, we have a big data platform Hadoop Ecosystem technology for analyzing the security log for sure how to implement the system model is studied.

Financial and Economic Risk Prevention and Countermeasures Based on Big Data and Internet of Things

  • Songyan Liu;Pengfei Liu;Hecheng Wang
    • Journal of Information Processing Systems
    • /
    • v.20 no.3
    • /
    • pp.391-398
    • /
    • 2024
  • Given the further promotion of economic globalization, China's financial market has also expanded. However, at present, this market faces substantial risks. The main financial and economic risks in China are in the areas of policy, credit, exchange rates, accounting, and interest rates. The current status of China's financial market is as follows: insufficient attention from upper management; insufficient innovation in the development of the financial economy; and lack of a sound financial and economic risk protection system. To further understand the current situation of China's financial market, we conducted a questionnaire survey on the financial market and reached the following conclusions. A comprehensive enterprise questionnaire from the government's perspective, the enterprise's perspective and the individual's perspective showed that the following problems exist in the financial and economic risk prevention aspects of big data and Internet of Things in China. The political system at the country's grassroots level is not comprehensive enough. The legal regulatory system is not comprehensive enough, leading to serious incidents of loan fraud. The top management of enterprises does not pay enough attention to financial risk prevention. Therefore, we constructed a financial and economic risk prevention model based on big data and Internet of Things that has effective preventive capabilities for both enterprises and individuals. The concept reflected in the model is to obtain data through Internet of Things, use big data for screening, and then pass these data to the big data analysis system at the grassroots level for analysis. The data initially screened as big data are analyzed in depth, and we obtain the original data that can be used to make decisions. Finally, we put forward the corresponding opinions, and their main contents represent the following points: the key is to build a sound national financial and economic risk prevention and assessment system, the guarantee is to strengthen the supervision of national financial risks, and the purpose is to promote the marketization of financial interest rates.

Social Safety Systems through Big Data Analysis of Public Data (공공 데이터의 빅데이터 분석을 통한 사회 안전망 시스템)

  • Lee, Sun Yui;Jung, Jun Hee;Cha, Gyeong Hyeon;Son, Ki Jun;Kim, Sang Ji;Kim, Jin Young
    • Journal of Satellite, Information and Communications
    • /
    • v.10 no.4
    • /
    • pp.77-82
    • /
    • 2015
  • This paper proposed an accident prediction model in order to prevent accidents in mountain areas using a big data analysis. Data of accidents in mountain areas are shown as graphs. We have analyzed cases: the number of accidents per year, day of week, time of day to find patterns of the negligent accident in mountain areas. The proposed prediction model consists of weighted variables of the accident in mountain through visualized big data analysis. The model of danger index performance is demonstrated by showing accident-prone areas with weighted variables.

Providing Service Model Based on Concept and Requirements of Spatial Big Data (공간 빅데이터의 개념 및 요구사항을 반영한 서비스 제공 방안)

  • Kim, Geun Han;Jun, Chul Min;Jung, Hui Cheul;Yoon, Jeong Ho
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.24 no.4
    • /
    • pp.89-96
    • /
    • 2016
  • By reviewing preceding studies of big data and spatial big data, spatial big data was defined as one part of big data, which spatialize location information and systematize time series data. Spatial big data, as one part of big data, should not be separated with big data and application methods within the system is to be examined. Therefore in this study, services that spatial big data is required to provide were suggested. Spatial big data must be available of various spatial analysis and is in need of services that considers present and future spatial information. Not only should spatial big data be able to detect time series changes in location, but also analyze various type of big data using attribute information of spatial data. To successfully provide the requirements of spatial big data and link various type of big data with spatial big data, methods of forming sample points and extracting attribute information were proposed in this study. The increasing application of spatial information related to big data is expected to attribute to the development of spatial data industry and technological advancement.

A Study on the Machine Learning Model for Product Faulty Prediction in Internet of Things Environment (사물인터넷 환경에서 제품 불량 예측을 위한 기계 학습 모델에 관한 연구)

  • Ku, Jin-Hee
    • Journal of Convergence for Information Technology
    • /
    • v.7 no.1
    • /
    • pp.55-60
    • /
    • 2017
  • In order to provide intelligent services without human intervention in the Internet of Things environment, it is necessary to analyze the big data generated by the IoT device and learn the normal pattern, and to predict the abnormal symptoms such as faulty or malfunction based on the learned normal pattern. The purpose of this study is to implement a machine learning model that can predict product failure by analyzing big data generated in various devices of product process. The machine learning model uses the big data analysis tool R because it needs to analyze based on existing data with a large volume. The data collected in the product process include the information about product faulty, so supervised learning model is used. As a result of the study, I classify the variables and variable conditions affecting the product failure, and proposed a prediction model for the product failure based on the decision tree. In addition, the predictive power of the model was significantly higher in the conformity and performance evaluation analysis of the model using the ROC curve.

Analyzing Factors of Success of Film Using Big Data : Focusing on the SNS Utilization Index and Topic Keywords of the Film (빅데이터를 활용한 영화흥행 요인 분석: 영화 <기생충>의 SNS 활용지수와 토픽키워드 중심으로)

  • Kim, Jin-Wook
    • Journal of Korea Entertainment Industry Association
    • /
    • v.14 no.4
    • /
    • pp.145-153
    • /
    • 2020
  • In the rapidly changing era of the fourth industry, big data is being used in various fields. In recent years, the use of big data has been rapidly applied to overall cultural and artistic contents, and among them, the use of big data is essential as a film genre with a lot of capital. This research method is analyzed as the film , which won the Palme d'Or Prize of the 72nd Cannes Film Festival in 2019 and the works and directors' award at the Academy Awards. The analyzed value predicts the film's performance through opinion mining, which gives the value of the change and sensitivity of each data cycle, and extracts the utilization index and topic keywords of SNS such as Facebook and Twitter to reflect the audience's interest. Identify the factors. As such, if model performance and model development can be predicted through model analysis of film performance using big data, the efficiency of the film production process will be maximized while the risk of production cost and the risk of film failure will be minimized.

Optimizing Employment and Learning System Using Big Data and Knowledge Management Based on Deduction Graph

  • Vishkaei, Behzad Maleki;Mahdavi, Iraj;Mahdavi-Amiri, Nezam;Askari, Masoud
    • Journal of Information Technology Applications and Management
    • /
    • v.23 no.3
    • /
    • pp.13-23
    • /
    • 2016
  • In recent years, big data has usefully been deployed by organizations with the aim of getting a better prediction for the future. Moreover, knowledge management systems are being used by organizations to identify and create knowledge. Here, the output from analysis of big data and a knowledge management system are used to develop a new model with the goal of minimizing the cost of implementing new recognized processes including staff training, transferring and employment costs. Strategies are proposed from big data analysis and new processes are defined accordingly. The company requires various skills to execute the proposed processes. Organization's current experts and their skills are known through a pre-established knowledge management system. After a gap analysis, managers can make decisions about the expert arrangement, training programs and employment to bridge the gap and accomplish their goals. Finally, deduction graph is used to analyze the model.

The Impact of Exploration and Exploitation Activities and Market Agility on the Relationship between Big Data Analytics Capability and Firms' Performance (빅 데이터 분석능력과 기업 성과 간의 관계에서 혁신 및 개선 활동과 시장 민첩성의 영향)

  • Jung, He-Kyung;Boo, Jeman
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.45 no.3
    • /
    • pp.150-162
    • /
    • 2022
  • This study investigated the impact of the latest developments in big data analytics capabilities (BDAC) on firm performance. The BDAC have the power to innovate existing management practices. Nevertheless, their impact on firm performance has not been fully is not yet fully elucidated. The BDAC relates to the flexibility of infrastructure as well as the skills of management and firm's personnel. Most studies have explored the phenomena from a theoretical perspective or based on factors such as organizational characteristics. However, this study extends the flow of previous research by proposing and testing a model which examines whether organizational exploration, exploitation and market agility mediate the relationship between the BDAC and firm performance. The proposed model was tested using survey data collected from the long-term employees over 10 years in 250 companies. The results analyzed through structural equation modeling show that a strong BDAC can help improve firm performance. An organization's ability to analyze big data affects its exploration and exploitation thereby affecting market agility, and, consequently, firm performance. These results also confirm the powerful mediating role of exploration, exploitation, and market agility in improving insights into big data utilization and improving firm performance.

Developing an Energy Self-Reliance Model in a Sri Lankan Rural Area (스리랑카 농촌 지역의 에너지 자립화 모델 개발)

  • Donggun Oh;Yong-heack Kang;Boyoung Kim;Chang-yeol Yun;Myeongchan Oh;Hyun-Goo Kim
    • New & Renewable Energy
    • /
    • v.20 no.1
    • /
    • pp.88-94
    • /
    • 2024
  • This study explored the potential and implementation of renewable energy sources in Sri Lanka, focusing on the theoretical potential of solar and wind energy to develop self-reliant energy models. Using advanced climate data from the European Centre for Medium-Range Weather Forecasts and Global Solar/Wind Atlas provided by the World Bank, we assessed the renewable energy potential across Sri Lanka. This study proposes off-grid and minigrid systems as viable solutions for addressing energy poverty in rural regions. Rural villages were classified based on solar and wind resources, via which we proposed four distinct energy self-reliance models: Renewable-Dominant, Solar-Dominant, Wind-Dominant, and Diesel-Dominant. This study evaluates the economic viability of these models considering Sri Lanka's current energy market and technological environment. The outcomes highlight the necessity for employing diversified energy strategies to enhance the efficiency of the national power supply system and maximize the utilization of renewable resources, contributing to Sri Lanka's sustainable development and energy security.

Can Big Data Help Predict Financial Market Dynamics?: Evidence from the Korean Stock Market

  • Pyo, Dong-Jin
    • East Asian Economic Review
    • /
    • v.21 no.2
    • /
    • pp.147-165
    • /
    • 2017
  • This study quantifies the dynamic interrelationship between the KOSPI index return and search query data derived from the Naver DataLab. The empirical estimation using a bivariate GARCH model reveals that negative contemporaneous correlations between the stock return and the search frequency prevail during the sample period. Meanwhile, the search frequency has a negative association with the one-week- ahead stock return but not vice versa. In addition to identifying dynamic correlations, the paper also aims to serve as a test bed in which the existence of profitable trading strategies based on big data is explored. Specifically, the strategy interpreting the heightened investor attention as a negative signal for future returns appears to have been superior to the benchmark strategy in terms of the expected utility over wealth. This paper also demonstrates that the big data-based option trading strategy might be able to beat the market under certain conditions. These results highlight the possibility of big data as a potential source-which has been left largely untapped-for establishing profitable trading strategies as well as developing insights on stock market dynamics.