• Title/Summary/Keyword: Big data management

Search Result 1,731, Processing Time 0.033 seconds

Analysis of Traffic Card Big Data by Hadoop and Sequential Mining Technique (하둡과 순차패턴 마이닝 기술을 통한 교통카드 빅데이터 분석)

  • Kim, Woosaeng;Kim, Yong Hoon;Park, Hee-Sung;Park, Jin-Kyu
    • Journal of Information Technology Applications and Management
    • /
    • v.24 no.4
    • /
    • pp.187-196
    • /
    • 2017
  • It is urgent to prepare countermeasures for traffic congestion problems of Korea's metropolitan area where central functions such as economic, social, cultural, and education are excessively concentrated. Most users of public transportation in metropolitan areas including Seoul use the traffic cards. If various information is extracted from traffic big data produced by the traffic cards, they can provide basic data for transport policies, land usages, or facility plans. Therefore, in this study, we extract valuable information such as the subway passengers' frequent travel patterns from the big traffic data provided by the Seoul Metropolitan Government Big Data Campus. For this, we use a Hadoop (High-Availability Distributed Object-Oriented Platform) to preprocess the big data and store it into a Mongo database in order to analyze it by a sequential pattern data mining technique. Since we analysis the actual big data, that is, the traffic cards' data provided by the Seoul Metropolitan Government Big Data Campus, the analyzed results can be used as an important referenced data when the Seoul government makes a plan about the metropolitan traffic policies.

Advanced Resource Management with Access Control for Multitenant Hadoop

  • Won, Heesun;Nguyen, Minh Chau;Gil, Myeong-Seon;Moon, Yang-Sae
    • Journal of Communications and Networks
    • /
    • v.17 no.6
    • /
    • pp.592-601
    • /
    • 2015
  • Multitenancy has gained growing importance with the development and evolution of cloud computing technology. In a multitenant environment, multiple tenants with different demands can share a variety of computing resources (e.g., CPU, memory, storage, network, and data) within a single system, while each tenant remains logically isolated. This useful multitenancy concept offers highly efficient, and cost-effective systems without wasting computing resources to enterprises requiring similar environments for data processing and management. In this paper, we propose a novel approach supporting multitenancy features for Apache Hadoop, a large scale distributed system commonly used for processing big data. We first analyze the Hadoop framework focusing on "yet another resource negotiator (YARN)", which is responsible for managing resources, application runtime, and access control in the latest version of Hadoop. We then define the problems for supporting multitenancy and formally derive the requirements to solve these problems. Based on these requirements, we design the details of multitenant Hadoop. We also present experimental results to validate the data access control and to evaluate the performance enhancement of multitenant Hadoop.

Development of an Intelligent Control System to Integrate Computer Vision Technology and Big Data of Safety Accidents in Korea

  • KANG, Sung Won;PARK, Sung Yong;SHIN, Jae Kwon;YOO, Wi Sung;SHIN, Yoonseok
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.721-727
    • /
    • 2022
  • Construction safety remains an ongoing concern, and project managers have been increasingly forced to cope with myriad uncertainties related to human operations on construction sites and the lack of a skilled workforce in hazardous circumstances. Various construction fatality monitoring systems have been widely proposed as alternatives to overcome these difficulties and to improve safety management performance. In this study, we propose an intelligent, automatic control system that can proactively protect workers using both the analysis of big data of past safety accidents, as well as the real-time detection of worker non-compliance in using personal protective equipment (PPE) on a construction site. These data are obtained using computer vision technology and data analytics, which are integrated and reinforced by lessons learned from the analysis of big data of safety accidents that occurred in the last 10 years. The system offers data-informed recommendations for high-risk workers, and proactively eliminates the possibility of safety accidents. As an illustrative case, we selected a pilot project and applied the proposed system to workers in uncontrolled environments. Decreases in workers PPE non-compliance rates, improvements in variable compliance rates, reductions in severe fatalities through guidelines that are customized according to the worker, and accelerations in safety performance achievements are expected.

  • PDF

A Study on the ChatGPT: Focused on the News Big Data Service and ChatGPT Use Cases (ChatGPT에 관한 연구: 뉴스 빅데이터 서비스와 ChatGPT 활용 사례를 중심으로)

  • Lee Yunhee;Kim Chang-Sik;Ahn Hyunchul
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.19 no.1
    • /
    • pp.139-151
    • /
    • 2023
  • This study aims to gain insights into ChatGPT, which has recently received significant attention. The study utilized a mixed method involving case studies and news big data analysis. ChatGPT can be described as an optimized language model for dialogue. The question arises whether ChatGPT will replace Google search services, posing a potential threat to Google. It could hurt Google's advertising business, which is the foundation of its profits. With AI-based chatbots like ChatGPT likely to disrupt the web search industry, Google is establishing a new AI strategy. The study used the BIG KINDS service and analyzed 2,136 articles over six months, from August 23, 2022, to February 22, 2023. Thirty of these articles were written in 2022, while 2,106 have been reported recently as of February 22, 2023. Also, the study examined the contents of ChatGPT by utilizing literature research, news big data analysis, and use cases. Despite limitations such as the potential for false information, analyzing news big data and use cases suggests that ChatGPT is worth using.

A Study on the Semantic Network Analysis of "Cooking Academy" through the Big Data (빅데이터를 활용한 "조리학원"의 의미연결망 분석에 관한 연구)

  • Lee, Seung-Hoo;Kim, Hak-Seon
    • Culinary science and hospitality research
    • /
    • v.24 no.3
    • /
    • pp.167-176
    • /
    • 2018
  • In this study, Big Data was used to collect the information related to 'Cooking Academy' keywords. After collecting all the data, we calculated the frequency through the text mining and selected the main words for future data analysis. Data collection was conducted from Google Web and News during the period from January 1, 2013 to December 31, 2017. The selected 64 words were analyzed by using UCINET 6.0 program, and the analysis results were visualized with NetDraw in order to present the relationship of main words. As a result, it was found that the most important goal for the students from cooking school is to work as a cook, likewise to have practical classes. In addition, we obtained the result that SNS marketing system that the social sites, such as Facebook, Twitter, and Instagram are actively utilized as a marketing strategy of the institute. Therefore, the results can be helpful in searching for the method of utilizing big data and can bring brand-new ideas for the follow-up studies. In practical terms, it will be remarkable material about the future marketing directions and various programs that are improved by the detailed curriculums through semantic network of cooking school by using big data.

U-healthcare Service Management Scheme for Big Data of Patient Infomation (환자 정보를 빅 데이터화 하기 위한 유헬스케어 서비스 관리기법)

  • Jeong, Yoon-Su
    • Journal of Convergence Society for SMB
    • /
    • v.5 no.1
    • /
    • pp.1-6
    • /
    • 2015
  • Recently the disease by eating of the modern prevention, management, and trends in the u-healthcare service that provides healthcare services including health promotion is changing rapidly. However, u-healthcare service is a healthcare information that provides users of the disease can not be analyzed even if the service is stored or not stored in the management server status is giving the inconvenience caused to users of the health services. In this paper, we propose a management method of health care services and a big data formation information that provides users of the disease to facilitate the users of health care services through the use magazine big data information regardless of time and place. The proposed method has the user's bio-information and the measured health information and transmits data through a wired or wireless communication to the medical institution and the user's health information data formation by the big user of the analysis of the health information and the disease of the user feedback to the user.

  • PDF

An Analysis of the Hocance Phenomenon using Social Media Big Data (소셜 미디어 빅데이터를 활용한 호캉스(hocance) 현상 분석)

  • Choi, Hong-Yeol;Park, Eun-Kyung;Nam, Jang-Hyeon
    • Asia-Pacific Journal of Business
    • /
    • v.12 no.2
    • /
    • pp.161-174
    • /
    • 2021
  • Purpose - The purpose of this study was to examine the recent popular consumption trend, the hocance phenomenon, using social media big data. The study intended to present practical directions and marketing measures for the recovery and growth of the hotel industry after COVID-19 pandemic. Design/methodology/approach - Big data analysis has been used in various fields, and in this study, it was used to understand the hocance phenomenon. For three years from January 1, 2018 to December 31, 2020, we collected text data including the keyword 'hocance' from the blog and cafe of NAVER and Daum. TEXTOM and UCINET 6 were used to collect and analyze the data. Findings - According to the results of analysis, the words such as 'hocance', 'hotel', 'Seoul', 'travel', 'swimming pool', 'Incheon', 'breakfast', 'child' and 'friend' were identified with high frequency. The results of CONCOR analysis showed similar results in all three years. It has been confirmed that 'swimming pool', 'breakfast', 'child' and 'friend' are important when deciding on the hocance package. Research implications or Originality - The study was differentiated in that it used social media big data instead of traditional research methods. Furthermore, it reflected social phenomena as a consumption trend so there was practical value in establishing marketing strategies for the tourism and hotel industry.

A Study on analyzing brand character of myth material, relevant keyword and relevance with big data of portal site and SNS (포털사이트, SNS의 빅데이터를 이용한 신화소재의 브랜드 캐릭터와 연관어, 연관도 분석)

  • Oh, Sejong;Doo, Illchul
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.11 no.1
    • /
    • pp.157-169
    • /
    • 2015
  • In digital marketing, means of public relations and marketing of enterprises are changing into marketing techniques of predictive analytics. A significant study can be carried out by an analysis of 'the patterns of customers' uses' using big data on major portal sites and SNSs and their correlation with related keywords. This study analyzes the origins of mythological characters in major brands such as Nike, Hermes, Versace, Canon and Starbucks. Also, it extracts related keywords and relevance using big data on portal sites and SNS and their correlation. Nike marketing that reminds people of 'the goddess of victory, Nike' formed a good combination of the brand with relevance. Most of them are based on Greek mythology and have rich materials for storytelling and artistic values in common. Hopefully, this case analysis of foreign brands would become a starting point of discovering the materials of the domestic mythological characters.

A Study on Development Project Management using Open Source Configuration Management and Defect Tracking Tools (오픈소스 형상도구와 결함추적도구를 이용한 개발 프로젝트 관리에 관한 연구)

  • Lee, Jihyun;Park, Youngsik
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2012.11a
    • /
    • pp.1445-1447
    • /
    • 2012
  • 팀으로 구성된 개발 조직은 주어진 시간 안에 가용할 수 있는 인력으로 고객에게 전달될 최종 산출물인 소프트웨어를 개발한다. 개발과 통합을 거친 소프트웨어는 테스트를 거치며 발생되는 결함에 대해 수정 조치한다. 하지만 결함 수정과 병행하여 초기 요구사항은 변경되고 추가되어 개발되는 소프트웨어에 반영되야 함으로 팀에서는 메일, 전화, 또는 게시판 방식으로 결함 사항을 알리고 최종 소프트웨어를 개발해 나간다. 본 논문은 이러한 환경에 결함추적도구를 사용하여 결함 발견 시 등록하고, 해결된 소프트웨어의 버전을 관리하기 위한 방법에 대해 오픈소스 기반의 형상관리도구와 결함추적도구를 활용한 환경을 연구해 나가고자 한다.

Characteristics on Big Data of the Meteorology and Climate Reported in the Media in Korea

  • Choi, Jae-Won;Kim, Hae-Dong
    • Quantitative Bio-Science
    • /
    • v.37 no.2
    • /
    • pp.91-101
    • /
    • 2018
  • This study has analyzed applicable characteristics on big data of the meteorology and climate depending on press releases in the media. As a result, more than half of them were conducted by governmental departments and institutions (26.9%) and meteorological administration (25.0%). Most articles were written by journalists, especially the highest portion stems from straight articles focusing on delivering simple information. For each field, the number of cases had listed in order of rank to be exposed to the media; information service, business management, farming, livestock, and fishing industries, and disaster management, but others did rank far behind; insurance, construction, hydrology and energy. Application of big data about meteorology and climate differed depending on the seasonal change, it was directly related to temperature information during spring, to weather phenomenon such as monsoon and heat wave during summer, to meteorology and climate information during fall, and to weather phenomenon such as cold wave and heavy snow during winter.