• Title/Summary/Keyword: Big Data Usage

Search Result 173, Processing Time 0.03 seconds

Implementation of High Speed Big Data Processing System using In Memory Data Grid in Semiconductor Process (반도체 공정에서 인 메모리 데이터 그리드를 이용한 고속의 빅데이터 처리 시스템 구현)

  • Park, Jong-Beom;Lee, Alex;Kim, Tony
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.15 no.5
    • /
    • pp.125-133
    • /
    • 2016
  • Data processing capacity and speed are rapidly increasing due to the development of hardware and software in recent time. As a result, data usage is geometrically increasing and the amount of data which computers have to process has already exceeded five-thousand transaction per second. That is, the importance of Big Data is due to its 'real-time' and this makes it possible to analyze all the data in order to obtain accurate data at right time under any circumstances. Moreover, there are many researches about this as construction of smart factory with the application of Big Data is expected to have reduction in development, production, and quality management cost. In this paper, system using In-Memory Data Grid for high speed processing is implemented in semiconductor process which numerous data occur and improved performance is proven with experiments. Implemented system is expected to be possible to apply on not only the semiconductor but also any fields using Big Data and further researches will be made for possible application on other fields.

A Time Series Analysis of Urban Park Behavior Using Big Data (빅데이터를 활용한 도시공원 이용행태 특성의 시계열 분석)

  • Woo, Kyung-Sook;Suh, Joo-Hwan
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.48 no.1
    • /
    • pp.35-45
    • /
    • 2020
  • This study focused on the park as a space to support the behavior of urban citizens in modern society. Modern city parks are not spaces that play a specific role but are used by many people, so their function and meaning may change depending on the user's behavior. In addition, current online data may determine the selection of parks to visit or the usage of parks. Therefore, this study analyzed the change of behavior in Yeouido Park, Yeouido Hangang Park, and Yangjae Citizen's Forest from 2000 to 2018 by utilizing a time series analysis. The analysis method used Big Data techniques such as text mining and social network analysis. The summary of the study is as follows. The usage behavior of Yeouido Park has changed over time to "Ride" (Dynamic Behavior) for the first period (I), "Take" (Information Communication Service Behavior) for the second period (II), "See" (Communicative Behavior) for the third period (III), and "Eat" (Energy Source Behavior) for the fourth period (IV). In the case of Yangjae Citizens' Forest, the usage behavior has changed over time to "Walk" (Dynamic Behavior) for the first, second, and third periods (I), (II), (III) and "Play" (Dynamic Behavior) for the fourth period (IV). Looking at the factors affecting behavior, Yeouido Park was had various factors related to sports, leisure, culture, art, and spare time compared to Yangjae Citizens' Forest. The differences in Yangjae Citizens' Forest that affected its main usage behavior were various elements of natural resources. Second, the behavior of the target areas was found to be focused on certain main behaviors over time and played a role in selecting or limiting future behaviors. These results indicate that the space and facilities of the target areas had not been utilized evenly, as various behaviors have not occurred, however, a certain main behavior has appeared in the target areas. This study has great significance in that it analyzes the usage of urban parks using Big Data techniques, and determined that urban parks are transformed into play spaces where consumption progressed beyond the role of rest and walking. The behavior occurring in modern urban parks is changing in quantity and content. Therefore, through various types of discussions based on the results of the behavior collected through Big Data, we can better understand how citizens are using city parks. This study found that the behavior associated with static behavior in both parks had a great impact on other behaviors.

e-Learning Course Reviews Analysis based on Big Data Analytics (빅데이터 분석을 이용한 이러닝 수강 후기 분석)

  • Kim, Jang-Young;Park, Eun-Hye
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.2
    • /
    • pp.423-428
    • /
    • 2017
  • These days, various and tons of education information are rapidly increasing and spreading due to Internet and smart devices usage. Recently, as e-Learning usage increasing, many instructors and students (learners) need to set a goal to maximize learners' result of education and education system efficiency based on big data analytics via online recorded education historical data. In this paper, the author applied Word2Vec algorithm (neural network algorithm) to find similarity among education words and classification by clustering algorithm in order to objectively recognize and analyze online recorded education historical data. When the author applied the Word2Vec algorithm to education words, related-meaning words can be found, classified and get a similar vector values via learning repetition. In addition, through experimental results, the author proved the part of speech (noun, verb, adjective and adverb) have same shortest distance from the centroid by using clustering algorithm.

Scalable Big Data Pipeline for Video Stream Analytics Over Commodity Hardware

  • Ayub, Umer;Ahsan, Syed M.;Qureshi, Shavez M.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.4
    • /
    • pp.1146-1165
    • /
    • 2022
  • A huge amount of data in the form of videos and images is being produced owning to advancements in sensor technology. Use of low performance commodity hardware coupled with resource heavy image processing and analyzing approaches to infer and extract actionable insights from this data poses a bottleneck for timely decision making. Current approach of GPU assisted and cloud-based architecture video analysis techniques give significant performance gain, but its usage is constrained by financial considerations and extremely complex architecture level details. In this paper we propose a data pipeline system that uses open-source tools such as Apache Spark, Kafka and OpenCV running over commodity hardware for video stream processing and image processing in a distributed environment. Experimental results show that our proposed approach eliminates the need of GPU based hardware and cloud computing infrastructure to achieve efficient video steam processing for face detection with increased throughput, scalability and better performance.

The Effect of the Organizational Characteristics of Fashion Companies on Acceptance Intention of Big Data Analysis System (패션기업의 조직 특성이 빅데이터 분석 시스템의 수용의도에 미치는 영향)

  • Jang, Seyoon;Yang, Sujin
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.41 no.2
    • /
    • pp.378-391
    • /
    • 2017
  • The application of Big Data has been introduced to the Korean fashion industry; however, the literature has not yet investigated how well high technologies are being perceived and adopted by the practitioners of fashion companies. Recognizing the lack of research, the current research explores how big data analysis has been adopted by fashion practitioners based on the Technology Acceptance Model (TAM) that considers the effect of organizational characteristics (i.e., innovation, slack, and IS infra maturity). First, all TAM relationships were accepted as significant; however, the effect of perceived ease of use on the attitude toward big data was greater than perceived usefulness. Regarding organizational characteristics, while organization innovation had positive impacts on perceived usefulness as well as perceived ease of use, organization slack did not show significant and positive influence on perceived ease of use only. On the other hand, IS infra maturity had a negative effect on perceived usefulness while it did not have any significant impact on perceived ease of use. Finally, the level of perceived usefulness is decreasing as the IS infra of the fashion organization becomes more mature. With the results, the study suggested that fashion industry needs more education on the usage of big data analysis systems and development in related analysis tools.

The Status and Suggestions for Big Data Adaptation in the Government and the Public Agency (정부 및 공공기관에서의 빅데이터 활용에 대한 현황 및 실행방안 제안)

  • Byeon, Hyeon-Su
    • Journal of Digital Convergence
    • /
    • v.15 no.4
    • /
    • pp.13-25
    • /
    • 2017
  • Volume in data storage is growing more than ever before. This phenomenon is caused by the participation of governments and firms as well as general users. As for big data, governments and public agencies are likely to play important roles in applications since they can access and operate personal data for public purposes. In this study, the author examined the status and countermeasure of big data from different countries and drew some common grounds. The suggestions are as follows. First of all, securing manpower and technology have to take precedence. In addition, share and development between the government and the private sector are required. And organizations should come up with long-term strategies along with the development of data loading and analysis. In conclusion, the author propose the recognition of the importance of data management, privacy protection and the expansion of field application possibilities for political usage of big data.

Planning Routes of Bicycle Lanes in Suwon City Using Big Data Analysis (빅데이터 분석을 통한 수원시 자전거 전용차로 도입 방안)

  • Kim, Suk Hee;Kim, Hyung Jun;Lee, Nam Il
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.42 no.1
    • /
    • pp.45-56
    • /
    • 2022
  • Recently, bicycle sharing system is introduced and the usage of shared bicycles is increasing in Suwon city. Despite the need to expand the bicycle road infrastructure, this is not the case. Therefore, this research attempts to propose a method for bicycle lane installation in Suwon city. For this, this research conducted location analysis based on the shared bicycle usage data and trip inducing facility data. Using location analysis results, appropriate routes for bicycle lanes are selected. As a result, two routes are selected. These routes have advantages that it is easy to connect with the existing bicycle roads or traffic inducing facilities and to install using the existing bicycle roads. However, these routes also have disadvantage that traffic congestion may occur due to the occupancy of the existing road space. It is expected that this research may contribute to expansion and maintenance of bicycle lane infrastructure, the bicycle and PM sharing service usage, implementation of sustainable urban transportation systems in Suwon city.

Access efficiency of small sized files in Big Data using various Techniques on Hadoop Distributed File System platform

  • Alange, Neeta;Mathur, Anjali
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.7
    • /
    • pp.359-364
    • /
    • 2021
  • In recent years Hadoop usage has been increasing day by day. The need of development of the technology and its specified outcomes are eagerly waiting across globe to adopt speedy access of data. Need of computers and its dependency is increasing day by day. Big data is exponentially growing as the entire world is working in online mode. Large amount of data has been produced which is very difficult to handle and process within a short time. In present situation industries are widely using the Hadoop framework to store, process and produce at the specified time with huge amount of data that has been put on the server. Processing of this huge amount of data having small files & its storage optimization is a big problem. HDFS, Sequence files, HAR, NHAR various techniques have been already proposed. In this paper we have discussed about various existing techniques which are developed for accessing and storing small files efficiently. Out of the various techniques we have specifically tried to implement the HDFS- HAR, NHAR techniques.

Identification of Visitation Density and Critical Management Area Regarding Marine Spatial Planning: Applying Social Big Data (해양공간계획 수립을 위한 방문밀집도 및 중점관리지역 규명: 소셜 빅데이터를 활용하여)

  • Kim, Yoonjung;Kim, Choongki;Kim, Gangsun
    • Journal of Environmental Impact Assessment
    • /
    • v.29 no.2
    • /
    • pp.122-131
    • /
    • 2020
  • Marine Spatial Planning is an emerging strategy that promoting sustainable development at coastal and marine areas based on the concept of ecosystem services. Regarding its methodology, usage rate of resources and its impact should be considered in the process of spatial planning. Particularly, considering the rapid increase of coastal tourism, visitation pattern is required to be identified across coastal areas. However, actions to quantify visitation pattern have been limited due to its required high cost and labor for conducting extensive field-study. In this regard, this study aimed to pose the usage of social big data in Marine Spatial Planning to identify spatial visitation density and critical management zone throughout coastal areas. We suggested the usage of GPS information from Flickr and Twitter, and evaluated the critical management zone by applying spatial statistics and density analysis. This study's results clearly showed the coastal areas having relatively high visitors in the southern sea of South Korea. Applied Flickr and Twitter information showed high correlation with field data, when proxy excluding over-estimation was applied and appropriate grid-scale was identified in assessment approach. Overall, this study offers insights to use social big data in Marine Spatial Planning for reflecting size and usage rate of coastal tourism, which can be used to designate conservation area and critical zones forintensive management to promote constant supply of cultural services.

A Study on the Anomaly Prediction System of Drone Using Big Data (빅데이터를 활용한 드론의 이상 예측시스템 연구)

  • Lee, Yang-Kyoo;Hong, Jun-Ki;Hong, Sung-Chan
    • Journal of Internet Computing and Services
    • /
    • v.21 no.2
    • /
    • pp.27-37
    • /
    • 2020
  • Recently, big data is rapidly emerging as a core technology in the 4th industrial revolution. Further, the utilization and the demand of drones are continuously increasing with the development of the 4th industrial revolution. However, as the drones usage increases, the risk of drones falling increases. Drones always have a risk of being able to fall easily even with small problems due to its simple structure. In this paper, in order to predict the risk of drone fall and to prevent the fall, ESC (Electronic Speed Control) is attached integrally with the drone's driving motor and the acceleration sensor is stored to collect the vibration data in real time. By processing and monitoring the data in real time and analyzing the data through big data obtained in such a situation using a Fast Fourier Transform (FFT) algorithm, we proposed a prediction system that minimizes the risk of drone fall by analyzing big data collected from drones.