• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.7
• /
• pp.2977-2997
• /
• 2018

In big data era, fresh data grows rapidly every day. More than 30,000 gigabytes of data are created every second and the rate is accelerating. Many organizations rely heavily on real time streaming, while big data stream computing helps them spot opportunities and risks from real time big data. Storm, one of the most common online stream computing platforms, has been used for big data stream computing, with response time ranging from milliseconds to sub-seconds. The performance of Storm plays a crucial role in different application scenarios, however, few studies were conducted to evaluate the performance of Storm. In this paper, we investigate the performance of Storm under different application scenarios. Our experimental results show that throughput and latency of Storm are greatly affected by the number of instances of each vertex in task topology, and the number of available resources in data center. The fault-tolerant mechanism of Storm works well in most big data stream computing environments. As a result, it is suggested that a dynamic topology, an elastic scheduling framework, and a memory based fault-tolerant mechanism are necessary for providing high throughput and low latency services on Storm platform.

• Journal of Distribution Science
• /
• v.22 no.8
• /
• pp.65-76
• /
• 2024

Purpose: The study aims to recognize the relationship between big data analytics capabilities, big data analytics process, and perceived business performance from supply chain management to total customer satisfaction. Research design, data and methodology: The study followed a quantitative approach with a descriptive design. The data was collected from leading e-commerce companies in India using a structured questionnaire, and the data was coded and decoded using MS Excel, SPSS, and R language. It was further tested using Cronbach's alpha, KMO, and Bartlett's test for reliability and internal consistency. Results: The results showed that the big data analytics process acts as a robust mediator between big data analytics capabilities and perceived business performance. The 'direct, indirect and total effect of the model' and 'PLS-SEM model' showed that the big data analytics process directly impacts business performance. Conclusions: A complete indirect relationship exists between big data analytics capabilities and perceived business performance through the big data analytics process. The research contributesto e-commerce companies' understanding of the importance of big data analytics capabilities and processes.

• Proceedings of the Korea Contents Association Conference
• /
• 2016.05a
• /
• pp.23-24
• /
• 2016

본 논문에서는 과학 데이터 특성을 고려한 아카이브 시스템 설계를 위한 Data Curation Profile을 분석한다. Data Curation Profile은 생명과학데이터, 천문우주 데이터, 지질 데이터화학데이터, 사회과학데이터 등과 같은 13개의 과학데이터로 이루어져 있다. 13개의 과학데이터의 분석된 내용을 바탕으로 아카이브 시스템 설계시 고려해야 할 과학데이터 특성을 도출하고 이를 아카이브 요소 기술과 연계한다.

• Journal of the Korean Ceramic Society
• /
• v.56 no.6
• /
• pp.596-600
• /
• 2019

Artificial intelligence with a sufficient amount of realistic big data in certain applications has been demonstrated to play an important role in designing new materials or in manufacturing high-quality products. To reduce cracks in ceramic products using machine learning, it is desirable to utilize big data in recently developed data-driven optimization schemes. However, there is insufficient big data for ceramic processes. Therefore, we developed a numerical algorithm to make "virtual" manufacturing data sets using indirect methods such as computer simulations and image processing. In this study, a numerical algorithm based on the random walk was demonstrated to generate images of cracks by adjusting the conditions of the random walk process such as the number of steps, changes in direction, and the number of cracks.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.3
• /
• pp.471-477
• /
• 2021

In the field of display, a smart factory means more efficient display manufacturing using AI/BIG DATA technology not only for job automation, but also for existing process management, moving facilities, process abnormalities, and defect classification. In the past, when defects appeared in the display manufacturing process, the classification of defects and coping with process abnormalities were different, a lot of time was consumed for this. However, in the field of display manufacturing, advanced process equipment must be used, and it can be said that the competitiveness of the display manufacturing industry is to quickly identify the cause of defects and increase the yield. In this paper, we will summarize the cases in which smart factory AI/BIG DATA technology is applied to domestic display manufacturing, and analyze what advantages can be derived compared to existing methods. This information can be used as prior knowledge for improved smart factory development in the field of display manufacturing using AI/BIG DATA.

• Journal of information and communication convergence engineering
• /
• v.20 no.2
• /
• pp.96-102
• /
• 2022

We aim to build predictive models for Airbnb's prices using a GPU-accelerated RAPIDS in a big data cluster. The Airbnb Listings datasets are used for the predictive analysis. Several machine-learning algorithms have been adopted to build models that predict the price of Airbnb listings. We compare the results of traditional and big data approaches to machine learning for price prediction and discuss the performance of the models. We built big data models using Databricks Spark Cluster, a distributed parallel computing system. Furthermore, we implemented models using multiple GPUs using RAPIDS in the spark cluster. The model was developed using the XGBoost algorithm, whereas other models were developed using traditional central processing unit (CPU)-based algorithms. This study compared all models in terms of accuracy metrics and computing time. We observed that the XGBoost model with RAPIDS using GPUs had the highest accuracy and computing time.

• Journal of Applied Reliability
• /
• v.18 no.3
• /
• pp.208-212
• /
• 2018

Purpose: The three Vs of volume, velocity and variety are commonly used to characterize different aspects of Big Data. Volume refers to the amount of data, variety refers to the number of types of data and velocity refers to the speed of data processing. According to these characteristics, the size of Big Data varies rapidly, some data buckets will contain outliers, and buckets might have different sizes. Correlation plays a big role in Big Data. We need something better than usual correlation measures. Methods: The correlation measures offered by traditional statistics are compared. And conditions to meet the characteristics of Big Data are suggested. Finally the correlation measure that satisfies the suggested conditions is recommended. Results: Mutual Information satisfies the suggested conditions. Conclusion: This article builds on traditional correlation measures to analyze the co-relation between two variables. The conditions for correlation measures to meet the characteristics of Big Data are suggested. The correlation measure that satisfies these conditions is recommended. It is Mutual Information.

• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.276-279
• /
• 2015

Along with the increase of the quantity of data in various industries, the construction industry has also developed various systems focusing on collecting data related to the construction performance such as productivity and costs achieved in construction job sites. Numerous researchers worldwide have been focusing on developing efficient methodologies to analyze such data. However, applications of such methodologies have shown serious limitations on practical applications due to lack of data and difficulty in finding appropriate analytic methodologies which were capable of implementing significant insights. With development of information technology, the new trend in analytic methodologies has been introduced and steeply developed with the new name of "big data analysis" in various fields in academia and industry. The new concept of big data can be applied for significant analysis on various formats of construction data such as structured, semi-structured, or non-structured formats. This study investigates preliminary application methods based on data collected from actual construction site. This preliminary investigation in this study expects to assess fundamental feasibility of big data analytic applications in construction.

• Journal of the Korea Convergence Society
• /
• v.4 no.1
• /
• pp.43-48
• /
• 2013

Designing of similarity on high dimensional data was done. Similarity measure between high dimensional data was considered by analysing neighbor information with respect to data sets. Obtained result could be applied to big data, because big data has multiple characteristics compared to simple data set. Definitely, analysis of high dimensional data could be the pre-study of big data. High dimensional data analysis was also compared with the conventional similarity. Traditional similarity measure on overlapped data was illustrated, and application to non-overlapped data was carried out. Its usefulness was proved by way of mathematical proof, and verified by calculation of similarity for artificial data example.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.42 no.4
• /
• pp.84-90
• /
• 2019

Lately, there have been tremendous shifts in the business technology landscape. Advances in cloud technology and mobile applications have enabled businesses and IT users to interact in entirely new ways. One of the most rapidly growing technologies in this sphere is business intelligence, and associated concepts such as big data and data mining. BI is the collection of systems and products that have been implemented in various business practices, but not the information derived from the systems and products. On the other hand, big data has come to mean various things to different people. When comparing big data vs business intelligence, some people use the term big data when referring to the size of data, while others use the term in reference to specific approaches to analytics. As the volume of data grows, businesses will also ask more questions to better understand the data analytics process. As a result, the analysis team will have to keep up with the rising demands on the infrastructure that supports analytics applications brought by these additional requirements. It's also a good way to ascertain if we have built a valuable analysis system. Thus, Business Intelligence and Big Data technology can be adapted to the business' changing requirements, if they prove to be highly valuable to business environment.