• Title/Summary/Keyword: BigData Platform

Search Result 514, Processing Time 0.028 seconds

Issue Analysis on Gas Safety Based on a Distributed Web Crawler Using Amazon Web Services (AWS를 활용한 분산 웹 크롤러 기반 가스 안전 이슈 분석)

  • Kim, Yong-Young;Kim, Yong-Ki;Kim, Dae-Sik;Kim, Mi-Hye
    • Journal of Digital Convergence
    • /
    • v.16 no.12
    • /
    • pp.317-325
    • /
    • 2018
  • With the aim of creating new economic values and strengthening national competitiveness, governments and major private companies around the world are continuing their interest in big data and making bold investments. In order to collect objective data, such as news, securing data integrity and quality should be a prerequisite. For researchers or practitioners who wish to make decisions or trend analyses based on objective and massive data, such as portal news, the problem of using the existing Crawler method is that data collection itself is blocked. In this study, we implemented a method of collecting web data by addressing existing crawler-style problems using the cloud service platform provided by Amazon Web Services (AWS). In addition, we collected 'gas safety' articles and analyzed issues related to gas safety. In order to ensure gas safety, the research confirmed that strategies for gas safety should be established and systematically operated based on five categories: accident/occurrence, prevention, maintenance/management, government/policy and target.

A Comparative Analysis of Recursive Query Algorithm Implementations based on High Performance Distributed In-Memory Big Data Processing Platforms (대용량 데이터 처리를 위한 고속 분산 인메모리 플랫폼 기반 재귀적 질의 알고리즘들의 구현 및 비교분석)

  • Kang, Minseo;Kim, Jaesung;Lee, Jaegil
    • Journal of KIISE
    • /
    • v.43 no.6
    • /
    • pp.621-626
    • /
    • 2016
  • Recursive query algorithm is used in many social network services, e.g., reachability queries in social networks. Recently, the size of social network data has increased as social network services evolve. As a result, it is almost impossible to use the recursive query algorithm on a single machine. In this paper, we implement recursive query on two popular in-memory distributed platforms, Spark and Twister, to solve this problem. We evaluate the performance of two implementations using 50 machines on Amazon EC2, and real-world data sets: LiveJournal and ClueWeb. The result shows that recursive query algorithm shows better performance on Spark for the Livejournal input data set with relatively high average degree, but smaller vertices. However, recursive query on Twister is superior to Spark for the ClueWeb input data set with relatively low average degree, but many vertices.

System Design for Real-Time Data Transmission in Web-based Open IoT System (웹 기반 개방형 IoT 환경에서 실시간 데이터 전송을 위한 시스템 설계)

  • Phyo, Gyung-soo;Park, Jin-tae;Moon, Il-young
    • Journal of Advanced Navigation Technology
    • /
    • v.20 no.6
    • /
    • pp.562-567
    • /
    • 2016
  • IoT is attracting attention as the development of the Internet and the spread of smart devices are rapidly increasing worldwide. As IoT is integrated into everyday life, the market is getting bigger. So, experts predict that IoT devices will grow to more than one trillion in a decade. Techniques related to IoT are also being developed steadily, and studies are underway to develop IoT in various fields. However, vendors launching IoT services do not interact with data from other platforms. Therefore, it is limited to growing into a big market by facing the obstacle called the silo phenomenon. To solve this problem, web technology attracts attention. Web technology can interact with data regardless of platform, and it can not only develop various services using the data, but also reduce unnecessary costs for developers. In this paper, we have studied a web - based open IoT system that can transmit data independently in real time to the IoT platform.

Real-time CRM Strategy of Big Data and Smart Offering System: KB Kookmin Card Case (KB국민카드의 빅데이터를 활용한 실시간 CRM 전략: 스마트 오퍼링 시스템)

  • Choi, Jaewon;Sohn, Bongjin;Lim, Hyuna
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.2
    • /
    • pp.1-23
    • /
    • 2019
  • Big data refers to data that is difficult to store, manage, and analyze by existing software. As the lifestyle changes of consumers increase the size and types of needs that consumers desire, they are investing a lot of time and money to understand the needs of consumers. Companies in various industries utilize Big Data to improve their products and services to meet their needs, analyze unstructured data, and respond to real-time responses to products and services. The financial industry operates a decision support system that uses financial data to develop financial products and manage customer risks. The use of big data by financial institutions can effectively create added value of the value chain, and it is possible to develop a more advanced customer relationship management strategy. Financial institutions can utilize the purchase data and unstructured data generated by the credit card, and it becomes possible to confirm and satisfy the customer's desire. CRM has a granular process that can be measured in real time as it grows with information knowledge systems. With the development of information service and CRM, the platform has change and it has become possible to meet consumer needs in various environments. Recently, as the needs of consumers have diversified, more companies are providing systematic marketing services using data mining and advanced CRM (Customer Relationship Management) techniques. KB Kookmin Card, which started as a credit card business in 1980, introduced early stabilization of processes and computer systems, and actively participated in introducing new technologies and systems. In 2011, the bank and credit card companies separated, leading the 'Hye-dam Card' and 'One Card' markets, which were deviated from the existing concept. In 2017, the total use of domestic credit cards and check cards grew by 5.6% year-on-year to 886 trillion won. In 2018, we received a long-term rating of AA + as a result of our credit card evaluation. We confirmed that our credit rating was at the top of the list through effective marketing strategies and services. At present, Kookmin Card emphasizes strategies to meet the individual needs of customers and to maximize the lifetime value of consumers by utilizing payment data of customers. KB Kookmin Card combines internal and external big data and conducts marketing in real time or builds a system for monitoring. KB Kookmin Card has built a marketing system that detects realtime behavior using big data such as visiting the homepage and purchasing history by using the customer card information. It is designed to enable customers to capture action events in real time and execute marketing by utilizing the stores, locations, amounts, usage pattern, etc. of the card transactions. We have created more than 280 different scenarios based on the customer's life cycle and are conducting marketing plans to accommodate various customer groups in real time. We operate a smart offering system, which is a highly efficient marketing management system that detects customers' card usage, customer behavior, and location information in real time, and provides further refinement services by combining with various apps. This study aims to identify the traditional CRM to the current CRM strategy through the process of changing the CRM strategy. Finally, I will confirm the current CRM strategy through KB Kookmin card's big data utilization strategy and marketing activities and propose a marketing plan for KB Kookmin card's future CRM strategy. KB Kookmin Card should invest in securing ICT technology and human resources, which are becoming more sophisticated for the success and continuous growth of smart offering system. It is necessary to establish a strategy for securing profit from a long-term perspective and systematically proceed. Especially, in the current situation where privacy violation and personal information leakage issues are being addressed, efforts should be made to induce customers' recognition of marketing using customer information and to form corporate image emphasizing security.

A research on the Design and Construction of Smart Environmental Protection Information Platform in Nanjing (난징시의 지능형 환경 보호 정보 플랫폼의 디자인 및 구축에 관한연구)

  • Shi, XiaoHe;Pan, Younghwan
    • Journal of the Korea Convergence Society
    • /
    • v.12 no.1
    • /
    • pp.77-87
    • /
    • 2021
  • Environment is an important factor in city life. Environmental elements are a subject that must be discussed in the smart city plan, but there is still a lack of information and data sharing in the urban environment, so improvements are needed. As part of the intelligent of Nanjing, this research has made in-depth investigation into the construction and service demand of environmental information, and has carried out the research on the design and construction of intelligent information platform that conforms to Nanjing intelligent city planning, improves environmental quality and provides environmental information service. The visualization of information is also studied. The result is an important module in the construction of intelligent city in Nanjing.

Energy Big Data Pre-processing System for Energy New Industries (에너지신산업을 위한 에너지 빅데이터 전처리 시스템)

  • Yang, Soo-Young;Kim, Yo-Han;Kim, Sang-Hyun;Kim, Won-Jung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.5
    • /
    • pp.851-858
    • /
    • 2021
  • Due to the increase in renewable energy and distributed resources, not only traditional data but also various energy-related data are being generated in the new energy industry. In other words, there are various renewable energy facilities and power generation data, system operation data, metering and rate-related data, as well as weather and energy efficiency data necessary for new services and analysis. Energy big data processing technology can systematically analyze and diagnose data generated in the first half of the power production and consumption infrastructure, including distributed resources, systems, and AMI. Through this, it will be a technology that supports the creation of new businesses in convergence between the ICT industry and the energy industry. To this end, research on the data analysis system, such as itemized characteristic analysis of the collected data, correlation sampling, categorization of each feature, and element definition, is needed. In addition, research on data purification technology for data loss and abnormal state processing should be conducted. In addition, it is necessary to develop and structure NIFI, Spark, and HDFS systems so that energy data can be stored and managed in real time. In this study, the overall energy data processing technology and system for various power transactions as described above were proposed.

Peer Network Based Shopping Mall Supporting platform with Metaverse Technique

  • Kim, Sea Woo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.3
    • /
    • pp.222-229
    • /
    • 2022
  • Through this technology development, companies that operate online shopping malls and prospective startups will support education, consulting and expert group matching so that they can solve various issues that may arise in the course of the entire business life cycle, from startups to closures. It is expected that differentiated consulting programs will be designed for companies that currently operate shopping malls and start ups, and customized consulting programs will be provided to improve the effectiveness of consulting while improving customer satisfaction. It is planning to develop a "successful start-up and operation helper" that helps successful start-ups. It is a system that primarily diagnoses problems of prospective entrepreneurs and operators through an automation system at the start-up and operation stage, and professional consultants participate to derive and solve problems, and takes care of all stages of shopping mall birth and growth. In this paper Metaverse based shopping mall Creation is also discussed. Through Big Data creation these accumulated data, we intend to help operators start and operate shopping malls through accurate information by managing all knowledge of shopping malls as a system in the long run.

A Design of Rehabilitation exercise device data interworking interface for Rehabilitation exercise Big data platform (재활 운동 빅데이터 플랫폼을 위한 재활 운동 기기 데이터 연동 인터페이스의 설계)

  • Choi, Wonhyuk;Kang, Il-Kwon;Kim, Jae-Chul
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.11a
    • /
    • pp.165-167
    • /
    • 2022
  • 본 논문은 병원과 지역사회에서 제공하는 재활 서비스를 연계하여 재활 단계별 개인 맞춤 재활서비스를 제공하기 위한 재활운동 빅데이터 플랫폼과 재활 서비스를 지원하는 재활 운동 기기간의 데이터 수집을 위한 인터페이스의 설계에 관한 것이다. 재활 운동 빅데이터 플랫폼은 병원과 지역사회에서 생성되는 재활 관련 데이터를 수집하고 이를 가공, 유통하기 위한 데이터 서비스와 수집된 데이터를 예측, 분석하여 개인 맞춤형의 단계별 재활을 지원하기 위한 다양한 서비스를 제공한다. 본 논문에서는 재활 운동을 보조하는 재활 운동 기기에서 생성되는 다양한 유형의 데이터를 재활 운동 빅데이터 플랫폼으로 전송하고, 수집된 데이터를 플랫폼 내외부에서 활용 가능하도록 제공할 수 있는 인터페이스에 대하여 설명한다.

Research on the Uses and Gratifications of Tiktok (Douyin short video)

  • Yaqi, Zhou;Lee, Jong-Yoon;Liu, Shanshan
    • International Journal of Contents
    • /
    • v.17 no.1
    • /
    • pp.37-53
    • /
    • 2021
  • With the advent of the 5G era, smart phones and communications network technology have progressed, and mobile short video of people's life can be made, Of the new tools of communication, at present, China's social short video industry has shown rapid development, and the most representative of the short video app is Douyin (international version: Tiktok). Under the background of Uses and Gratifications Theory, this study discusse the relationship between Douyin users' preference degree, use motivation, use satisfaction and attention intention. This study divides the content of Douyin video into 10 categories, selects the form of an online questionnaire survey, uses SPSS software to conduct quantitative analysis of 202 questionnaires after screening, and finally draws the following conclusions: (1) The content preference degree of Douyin short video (the high group and low group) is different in users' use motivation, users' satisfaction degree and users' attention intention. ALL results are within the range of statistical significance.(2) Douyin users' video content preference degree has a positive impact on users' use motivation, users' satisfaction degree, and users' attention intention. (3) Douyin users' motivation has a positive impact on users' satisfaction and user' attention intention. (4) Douyin users' satisfaction degree has a positive impact on users' attention intention. Based on the research results, we suggest that Douyin platform pushes videos according to users' preferences. In addition, as the preference degree has an impact on users' motivation, satisfaction degree and attention intention of using the platform, it is important that the platform's focus should to pay attention to the preference degree of users. Collecting users' preferences at the early stage of users' entering the platform is a good way to learn from, and doing a good job of big data collection and management in the later operation.

A study on deriving success factors and activating methods through metaverse marketing cases (메타버스(Metaverse) 마케팅 사례를 통한 성공요인 및 활성화 방안 연구)

  • Jo, Jae-Wook
    • Journal of Digital Convergence
    • /
    • v.20 no.4
    • /
    • pp.791-797
    • /
    • 2022
  • Through recent metaverse marketing case studies, success factors and activation methods were analyzed from the perspective of content, platform, network, and device of the metaverse ecosystem in each industry. The importance of contents and platform of metaverse could be found in entertainment, fashion, office space and real estate, education, advertisement and commerce industries. In order to vitalize the metaverse, firstly, it is necessary to strengthen active participation and retention by providing a stable revenue model for market participants. Secondly, the importance of attractive content to expand subscribers is a key trigger for metaverse activation. Thirdly, it is necessary to increase the convenience of using metaverse service by using a light and simple device for the user. Fourthly, a win-win cooperation strategy should be supported in the value chain of the industry through ecosystem scalability. In addition, business opportunities for market participants and additional revenue models should be continuously provided.