• Title/Summary/Keyword: big data analysis technology

Search Result 1,132, Processing Time 0.032 seconds

The Key Factors of Big Data Utilization for Improvement of Management Quality of Companies in terms of Technology, Organization and Environment (기술, 조직, 환경 관점에서 기업의 경영품질 향상을 위한 빅데이터 활용의 핵심요인에 관한 연구)

  • Shin, Soo Haeng;Lee, Sang Joon
    • Journal of Information Technology Services
    • /
    • v.18 no.1
    • /
    • pp.91-112
    • /
    • 2019
  • The IoT environment has led to explosive growth of existing enterprise data, and how to utilize such big data is becoming an important issue in the management field. In this paper, major factors affecting the decisions of companies to utilize big data have been studied. And also, the effect of big data utilization on the management quality is studied empirically. During this process, we have studied the difference according to the award of Korean national quality award. As a result of the study, we confirmed that the five factors such as cost from technology, organization and environment perspective, compatibility, company size, chief officer support, and competitor pressure are key factors influencing big data utilization. Also, it was confirmed that the use of big data for management activities has an important influence on the six management quality factors based on MBNQA, and that the management quality level of Korean national quality award companies is relatively high. This paper provides practical implications for companies' use of big data because it demonstrates for the first time that big data utilization has an impact on management quality improvement.

A Study on the Data Collection Methods based Hadoop Distributed Environment (하둡 분산 환경 기반의 데이터 수집 기법 연구)

  • Jin, Go-Whan
    • Journal of the Korea Convergence Society
    • /
    • v.7 no.5
    • /
    • pp.1-6
    • /
    • 2016
  • Many studies have been carried out for the development of big data utilization and analysis technology recently. There is a tendency that government agencies and companies to introduce a Hadoop of a processing platform for analyzing big data is increasing gradually. Increased interest with respect to the processing and analysis of these big data collection technology of data has become a major issue in parallel to it. However, study of the collection technology as compared to the study of data analysis techniques, it is insignificant situation. Therefore, in this paper, to build on the Hadoop cluster is a big data analysis platform, through the Apache sqoop, stylized from relational databases, to collect the data. In addition, to provide a sensor through the Apache flume, a system to collect on the basis of the data file of the Web application, the non-structured data such as log files to stream. The collection of data through these convergence would be able to utilize as a basic material of big data analysis.

Text Big Data Analysis and Summary for Free Semester Operational Plan Document (자유학기제 운영계획서에 대한 텍스트 빅데이터 분석 및 요약)

  • Lee, Suan;Park, Beomjun;Kim, Minkyu;Shin, Hye Sook;Kim, Jinho
    • The Journal of Korean Association of Computer Education
    • /
    • v.22 no.3
    • /
    • pp.135-146
    • /
    • 2019
  • Big data analysis is actively used for collecting and analyzing direct information on related topics in each field of society. Applying big data analysis technology in education field is increasingly interested in Korea, because applying this technology helps to identify the effectiveness of education methods and policies and applying them for policy formulation. In this paper, we propose our approach of utilizing big data analysis technology in education field. We focus on free semester program, one of the current core education policies, and we analyze the main points of interests and differences in the free semester through analysis and visualization of texts that are written on the operation reports prepared by each school. We compare regional differences in key characteristics and interests based on the free semester operation reports from middle schools particularly at Seoul and Gangwon-do regions. In conclusion, applying and utilizing big data analysis technology according to the needs and requirements of education field is a great significance.

A Study on implementation model for security log analysis system using Big Data platform (빅데이터 플랫폼을 이용한 보안로그 분석 시스템 구현 모델 연구)

  • Han, Ki-Hyoung;Jeong, Hyung-Jong;Lee, Doog-Sik;Chae, Myung-Hui;Yoon, Cheol-Hee;Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.351-359
    • /
    • 2014
  • The log data generated by security equipment have been synthetically analyzed on the ESM(Enterprise Security Management) base so far, but due to its limitations of the capacity and processing performance, it is not suited for big data processing. Therefore the another way of technology on the big data platform is necessary. Big Data platform can achieve a large amount of data collection, storage, processing, retrieval, analysis, and visualization by using Hadoop Ecosystem. Currently ESM technology has developed in the way of SIEM (Security Information & Event Management) technology, and to implement security technology in SIEM way, Big Data platform technology is essential that can handle large log data which occurs in the current security devices. In this paper, we have a big data platform Hadoop Ecosystem technology for analyzing the security log for sure how to implement the system model is studied.

Big Data Analysis of Weather Condition and Air Quality on Cosmetics Marketing

  • Wang, Zebin;Wu, Tong;Zhao, Xinshuang;Cheng, Shuchun;Dai, Genghui;Dai, Weihui
    • Journal of Information Technology Applications and Management
    • /
    • v.24 no.3
    • /
    • pp.93-105
    • /
    • 2017
  • Demands of cosmetics are affected not only by the well-known elements such as brand, price, and customer's consumption capacity, but also by some latent factors, for example, weather and air environment. Due to complexity and dynamic changes of the above factors, their influences can hardly be estimated in an accurate way by the traditional approaches such as survey and questionnaires. Through modeling and statistical analysis of big data, this article studied the impacts of weather condition and air quality on customer flow and sales of the cosmetics distributors in China, and found several hidden influencing factors. It provided a big-data based method for the analysis of unconventional factors on cosmetics marketing in the changing weather condition and air environment.

Analysis of Traffic Card Big Data by Hadoop and Sequential Mining Technique (하둡과 순차패턴 마이닝 기술을 통한 교통카드 빅데이터 분석)

  • Kim, Woosaeng;Kim, Yong Hoon;Park, Hee-Sung;Park, Jin-Kyu
    • Journal of Information Technology Applications and Management
    • /
    • v.24 no.4
    • /
    • pp.187-196
    • /
    • 2017
  • It is urgent to prepare countermeasures for traffic congestion problems of Korea's metropolitan area where central functions such as economic, social, cultural, and education are excessively concentrated. Most users of public transportation in metropolitan areas including Seoul use the traffic cards. If various information is extracted from traffic big data produced by the traffic cards, they can provide basic data for transport policies, land usages, or facility plans. Therefore, in this study, we extract valuable information such as the subway passengers' frequent travel patterns from the big traffic data provided by the Seoul Metropolitan Government Big Data Campus. For this, we use a Hadoop (High-Availability Distributed Object-Oriented Platform) to preprocess the big data and store it into a Mongo database in order to analyze it by a sequential pattern data mining technique. Since we analysis the actual big data, that is, the traffic cards' data provided by the Seoul Metropolitan Government Big Data Campus, the analyzed results can be used as an important referenced data when the Seoul government makes a plan about the metropolitan traffic policies.

A Study on Recognition of Artificial Intelligence Utilizing Big Data Analysis (빅데이터 분석을 활용한 인공지능 인식에 관한 연구)

  • Nam, Soo-Tai;Kim, Do-Goan;Jin, Chan-Yong
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.05a
    • /
    • pp.129-130
    • /
    • 2018
  • Big data analysis is a technique for effectively analyzing unstructured data such as the Internet, social network services, web documents generated in the mobile environment, e-mail, and social data, as well as well formed structured data in a database. The most big data analysis techniques are data mining, machine learning, natural language processing, and pattern recognition, which were used in existing statistics and computer science. Global research institutes have identified analysis of big data as the most noteworthy new technology since 2011. Therefore, companies in most industries are making efforts to create new value through the application of big data. In this study, we analyzed using the Social Matrics which a big data analysis tool of Daum communications. We analyzed public perceptions of "Artificial Intelligence" keyword, one month as of May 19, 2018. The results of the big data analysis are as follows. First, the 1st related search keyword of the keyword of the "Artificial Intelligence" has been found to be technology (4,122). This study suggests theoretical implications based on the results.

  • PDF

Frequency and Social Network Analysis of the Bible Data using Big Data Analytics Tools R (빅데이터 분석도구 R을 이용한 성경 데이터의 빈도와 소셜 네트워크 분석)

  • Ban, ChaeHoon;Ha, JongSoo;Kim, Dong Hyun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.2
    • /
    • pp.166-171
    • /
    • 2020
  • Big data processing technology that can store and analyze data and obtain new knowledge has been adjusted for importance in many fields of the society. Big data is emerging as an important problem in the field of information and communication technology, but the mind of continuous technology is rising. the R, a tool that can analyze big data, is a language and environment that enables information analysis of statistical bases. In this paper, we use this to analyze the Bible data. We analyze the four Gospels of the New Testament in the Bible. We collect the Bible data and perform filtering for analysis. The R is used to investigate the frequency of what text is distributed and analyze the Bible through social network analysis, in which words from a sentence are paired and analyzed between words for accurate data analysis.

Role of Big Data Technology and Whistleblowing System in Distribution of Fraud Detection

  • Idrawahyuni;Gagaring PAGALUNG;Darwis SAID;Grace T. PONTOH
    • Journal of Distribution Science
    • /
    • v.22 no.9
    • /
    • pp.1-12
    • /
    • 2024
  • Purpose: The purpose of the research is to find out and analyze the direct influence of forensic audits and auditor integrity on Fraud Detection and indirect effects through big data technology and whistleblowing systems in Indonesian BPK. The research method used is a survey research method. Surveys are primary data collection methods by asking 254 individual respondents. The unit of analysis is an individual, namely the BPK RI auditors. Results of this study found a forensic audit has a positive and significant effect on fraud detection, Auditor Integrity has a positive and significant effect on Fraud Detection; and forensic Audit has a positive and significant effect on big data technology, A forensic Audit has a positive and significant effect on the whistleblowing system, Integrity auditor has a positive and significant effect on big data technology, The whistleblowing system has a positive and significant effect on fraud detection, Big data technology has a positive and significant effect on fraud detection, The whistleblowing system has a positive and significant effect on fraud detection. Similar to how we used cross-sectional data, future research is urged to use an interview-based qualitative approach to avoid typical technique bias.

An Automatic Issues Analysis System using Big-data (빅데이터를 이용한 자동 이슈 분석 시스템)

  • Choi, Dongyeol;Ahn, Eungyoung
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.2
    • /
    • pp.240-247
    • /
    • 2020
  • There have been many efforts to understand the trends of IT environments that have been rapidly changed. In a view point of management, it needs to prepare the social systems in advance by using Big-data these days. This research is for the implementation of Issue Analysis System for the Big-data based on Artificial Intelligence. This paper aims to confirm the possibility of new technology for Big-data processing through the proposed Issue Analysis System using. We propose a technique for semantic reasoning and pattern analysis based on the AI and show the proposed method is feasible to handle the Big-data. We want to verify that the proposed method can be useful in dealing with Big-data by applying latest security issues into the system. The experiments show the potentials for the proposed method to use it as a base technology for dealing with Big-data for various purposes.