• Title/Summary/Keyword: Big-data Management

Search Result 1,716, Processing Time 0.028 seconds

A Study on implementation model for security log analysis system using Big Data platform (빅데이터 플랫폼을 이용한 보안로그 분석 시스템 구현 모델 연구)

  • Han, Ki-Hyoung;Jeong, Hyung-Jong;Lee, Doog-Sik;Chae, Myung-Hui;Yoon, Cheol-Hee;Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.351-359
    • /
    • 2014
  • The log data generated by security equipment have been synthetically analyzed on the ESM(Enterprise Security Management) base so far, but due to its limitations of the capacity and processing performance, it is not suited for big data processing. Therefore the another way of technology on the big data platform is necessary. Big Data platform can achieve a large amount of data collection, storage, processing, retrieval, analysis, and visualization by using Hadoop Ecosystem. Currently ESM technology has developed in the way of SIEM (Security Information & Event Management) technology, and to implement security technology in SIEM way, Big Data platform technology is essential that can handle large log data which occurs in the current security devices. In this paper, we have a big data platform Hadoop Ecosystem technology for analyzing the security log for sure how to implement the system model is studied.

Correspondence Strategy for Big Data's New Customer Value and Creation of Business (빅 데이터의 새로운 고객 가치와 비즈니스 창출을 위한 대응 전략)

  • Koh, Joon-Cheol;Lee, Hae-Uk;Jeong, Jee-Youn;Kim, Kyung-Sik
    • Journal of the Korea Safety Management & Science
    • /
    • v.14 no.4
    • /
    • pp.229-238
    • /
    • 2012
  • Within last 10 years, internet has become a daily activity, and humankind had to face the Data Deluge, a dramatic increase of digital data (Economist 2012). Due to exponential increase in amount of digital data, large scale data has become a big issue and hence the term 'big data' appeared. There is no official agreement in quantitative and detailed definition of the 'big data', but the meaning is expanding to its value and efficacy. Big data not only has the standardized personal information (internal) like customer information, but also has complex data of external, atypical, social, and real time data. Big data's technology has the concept that covers wide range technology, including 'data achievement, save/manage, analysis, and application'. To define the connected technology of 'big data', there are Big Table, Cassandra, Hadoop, MapReduce, Hbase, and NoSQL, and for the sub-techniques, Text Mining, Opinion Mining, Social Network Analysis, Cluster Analysis are gaining attention. The three features that 'bid data' needs to have is about creating large amounts of individual elements (high-resolution) to variety of high-frequency data. Big data has three defining features of volume, variety, and velocity, which is called the '3V'. There is increase in complexity as the 4th feature, and as all 4features are satisfied, it becomes more suitable to a 'big data'. In this study, we have looked at various reasons why companies need to impose 'big data', ways of application, and advanced cases of domestic and foreign applications. To correspond effectively to 'big data' revolution, paradigm shift in areas of data production, distribution, and consumption is needed, and insight of unfolding and preparing future business by considering the unpredictable market of technology, industry environment, and flow of social demand is desperately needed.

Big Data Management Scheme using Property Information based on Cluster Group in adopt to Hadoop Environment (하둡 환경에 적합한 클러스터 그룹 기반 속성 정보를 이용한 빅 데이터 관리 기법)

  • Han, Kun-Hee;Jeong, Yoon-Su
    • Journal of Digital Convergence
    • /
    • v.13 no.9
    • /
    • pp.235-242
    • /
    • 2015
  • Social network technology has been increasing interest in the big data service and development. However, the data stored in the distributed server and not on the central server technology is easy enough to find and extract. In this paper, we propose a big data management techniques to minimize the processing time of information you want from the content server and the management server that provides big data services. The proposed method is to link the in-group data, classified data and groups according to the type, feature, characteristic of big data and the attribute information applied to a hash chain. Further, the data generated to extract the stored data in the distributed server to record time for improving the data index information processing speed of the data classification of the multi-attribute information imparted to the data. As experimental result, The average seek time of the data through the number of cluster groups was increased an average of 14.6% and the data processing time through the number of keywords was reduced an average of 13%.

Necessity of Safety Management System applying Big Data and Block Chain Technology (블록체인 기술과 빅데이터 기술을 적용한 안전 관리 시스템의 필요성)

  • Oh, Weon-Kyun;Kim, Ki-Hyuk;Lee, Donghoon
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2019.11a
    • /
    • pp.197-198
    • /
    • 2019
  • In this study, the study was conducted to derive the utility of the safety management system applying block chain technology and big data technology to improve the problems of construction sites where concealment and operation of safety accidents occur. If block chain technology and big data technology are applied to construction safety management, transparent data can be collected, and based on the collected data, it is possible to predict accidents that can occur at the construction site and establish countermeasures. It can also be an opportunity to strengthen the safety awareness of construction workers and managers, and can clearly identify the responsibility in the event of a safety accident. This study suggests that the application of the 4th Industrial Revolution technology could be a great opportunity to innovate the construction industry which is less than other industries.

  • PDF

A Study on the Collaborative Inventory Management of Big Data Supply Chain : Case of China's Beer Industry

  • Chen, Jinhui;Jin, Chan-Yong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.3
    • /
    • pp.77-88
    • /
    • 2021
  • The development history of China's big data is relatively short, and it has only been ten years so far. Although the application level of big data in real life is not high, some achievements have been made in the supply chain. Various kinds of data will be generated in the actual operation of the supply chain. If these data can be effectively classified and used, the "bullwhip effect" of the operation of the supply chain can be also effectively improved. Thus this paper proposes the development of a supply chain collaborative inventory management model and application framework using big data. In this study, we analyzed the supply chain of beer industry, which is the most prominent consumption industry with "bullwhip effect", and further established a big data collaborative inventory management model for the supply chain of beer industry based on system dynamics. We used the Vensim software for simulation and sensitivity test and after appling our model, we found that the inventory fluctuations of the participants in the beer industry supply chain became significantly smaller, which verified the effectiveness of the model. Our study can be also applied to the possible problems of the large data supply chain collaborative inventory management model, and gives certain countermeasures and suggestions.

A Study on the Influence of Expectation of Big Data Service on e-Commerce on the Use Intension (e-Commerce 상에서 빅데이터 서비스제공 기대가 이용의도에 미치는 영향 연구)

  • Kim, Young Kook;Yum, Su Whan;Kim, Jin Hyung;Bae, Suk Min;Jung, Jai Jin
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.9
    • /
    • pp.1132-1139
    • /
    • 2019
  • Big data is prominently used as a prediction method in achieving a goal, because it can analyze the regularities to predict future results from a vast amount of past data. Furthermore, big data has huge influence in very diverse academic fields. On such awareness, this study analyzed the regular effect of e-Commerce usefulness from the effects which expectations on big-data service affect the usage purpose of e-Commerce usefulness. This study categorized e-Commerce usefulness into quality recognition, service, and ease, and studied how each category works between the relationship of big-data service expectation and the use intention.

The Adoption of Big Data to Achieve Firm Performance of Global Logistic Companies in Thailand

  • KITCHAROEN, Krisana
    • Journal of Distribution Science
    • /
    • v.21 no.1
    • /
    • pp.53-63
    • /
    • 2023
  • Purpose: Big Data analytics (BDA) has been recognized to improve firm performance because it can efficiently manage and process large-scale, wide variety, and complex data structures. This study examines the determinants of Big Data analytics adoption toward marketing and financial performance of global logistic companies in Thailand. The research framework is adopted from the technology-organization-environment (TOE) model, including technological factors (relative advantages), organizational factors (technological infrastructure and absorptive capability), environmental factors (industry competition and government support), Big Data analytics adoption, marketing performance, and financial performance. Research design, data, and methodology: A quantitative method is applied by distributing the survey to 450 employees at the manager's level and above. The sampling methods include judgmental, stratified random, and convenience sampling. The data were analyzed by Confirmatory Factor Analysis (CFA) and Structural Equation Model (SEM). Results: The results showed that all factors significantly influence Big Data analytics adoption, except technological infrastructure. In addition, Big Data analytics adoption significantly influences marketing and financial performance. Conversely, marketing performance has no significant influence on financial performance. Conclusions: The findings of this study can contribute to the strategic improvement of firm performance through Big Data analytics adoption in the logistics, distribution, and supply chain industries.

PLS Path Modeling to Investigate the Relations between Competencies of Data Scientist and Big Data Analysis Performance : Focused on Kaggle Platform (데이터 사이언티스트의 역량과 빅데이터 분석성과의 PLS 경로모형분석 : Kaggle 플랫폼을 중심으로)

  • Han, Gyeong Jin;Cho, Keuntae
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.2
    • /
    • pp.112-121
    • /
    • 2016
  • This paper focuses on competencies of data scientists and behavioral intention that affect big data analysis performance. This experiment examined nine core factors required by data scientists. In order to investigate this, we conducted a survey to gather data from 103 data scientists who participated in big data competition at Kaggle platform and used factor analysis and PLS-SEM for the analysis methods. The results show that some key competency factors have influential effect on the big data analysis performance. This study is to provide a new theoretical basis needed for relevant research by analyzing the structural relationship between the individual competencies and performance, and practically to identify the priorities of the core competencies that data scientists must have.

Big Data Analysis for Public Libraries Utilizing Big Data Platform: A Case Study of Daejeon Hanbat Library (도서관 빅데이터 플랫폼을 활용한 공공도서관 빅데이터 분석 연구: 대전한밭도서관을 중심으로)

  • On, Jeongmee;Park, Sung Hee
    • Journal of the Korean Society for information Management
    • /
    • v.37 no.3
    • /
    • pp.25-50
    • /
    • 2020
  • Since big data platform services for the public library began January 1, 2016, libraries have used big data to improve their work performance. This paper aims to examine the use cases of library big data and attempts to draw improvement plan to improve the effectiveness of library big data. For this purpose, first, we examine big data used while utilizing the library big data platform, the usage pattern of big data and services/policies drawn by big data analysis. Next, the limitations and advantages of the library big data platform are examined by comparing the data analysis of the integrated library management system (ILUS) currently used in public libraries and data analysis through the library big data platform. As a result of case analysis, big data usage patterns were found program planning and execution, collection, collection, and other types, and services/policies were summarized as customizing bookshelf themes for the book curation and reading promotion program, increasing collection utilization, and building a collection based on special topics. and disclosure of loan status data. As a result of the comparative analysis, ILUS is specialized in statistical analysis of library collection unit, and the big data platform enables selective and flexible analysis according to various attributes (age, gender, region, time of loan, etc.) reducing analysis time. Finally, the limitations revealed in case analysis and comparative analysis are summarized and suggestions for improvement are presented.

Does Big Data Matter to Value Creation? : Based on Oracle Solution Case (Does Big Data Matter to Value Creation? : 오라클(Oracle) 솔루션을 중심으로)

  • Kim, Yonghee;You, Eungjoon;Kang, Miseon;Choi, Jeongil
    • Journal of Information Technology Services
    • /
    • v.11 no.3
    • /
    • pp.39-48
    • /
    • 2012
  • It is essential that firm makes a rational and scientific decision making and creates a news value for the future direction. To do so, many firms attempt to collect meaningful data and find the filtered and refined implication for the better customer relationship and the active market drive through the various analytic tools. Among the possible IT solutions, utilization of 'Big Data' is becoming more attractive and necessary in such a way that it would help firms obtain the systemized and demanding information and facilitate their decision making process to keep up with the market needs. In this paper, it introduces the concepts and development of 'Big Data' recognized as a IT resource and solution under the rapidly changing firm environment. This study also presents the several firm cases using Big Data' and the Oracle's total data management and analytic solutions in order to support the application of 'Big Data'. Finally this paper provides a holistic viewpoint and realistic approach on use of 'Big Data' to create a new value.