• Title/Summary/Keyword: 핫-데이터

Search Result 68, Processing Time 0.024 seconds

A Big Data Analysis Methodology for Examining Emerging Trend Zones Identified by SNS Users: Focusing on the Spatial Analysis Using Instagram Data (SNS 사용자에 의해 형성된 트렌드 중심지 도출을 위한 빅 데이터 분석 방법론 연구: 인스타그램 데이터 활용 공간분석을 중심으로)

  • Il Sup Lee;Kyung Kyu Kim;Ae Ri Lee
    • Information Systems Review
    • /
    • v.20 no.2
    • /
    • pp.63-85
    • /
    • 2018
  • Emerging hotspot and trendy areas are formed into alleys and blocks with the help of viral effects among social network services (SNS) users called "Golmogleo." These users search for every corner of the alleys to share and promote their own favorite places through SNS. An analysis of hot places is limited if it is only based on macroeconomic indicators such as commercial area data published by national organizations, large-scale visiting facilities, and commuter figures. Careful analyses based on consumers' actual activities are needed. This study develops a "social big data analysis methodology" using Instagram data, which is one of the most popular SNSs suitable to identify recent consumer trends. We build a spatial analysis model using Local Moran's I. Results show that our model identifies new trend zones on the basis of posting data in Instagram, which are not included in the commercial information prepared by national organizations. The proposed analysis methodology enables better identification of the latest trend areas formulated by SNS user activities. It also provides practical information for start-ups, small business owners, and alley merchants for marketing purposes. This analytical methodology can be applied to future studies on social big data analysis.

An Energy Consumption Model using Hierarchical Unequal Clustering Method (계층적 불균형 클러스터링 기법을 이용한 에너지 소비 모델)

  • Kim, Jin-Su;Shin, Seung-Soo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.12 no.6
    • /
    • pp.2815-2822
    • /
    • 2011
  • Clustering method in wireless sensor networks is the technique that forms the cluster to aggregate the data and transmit them at the same time that they can use the energy efficiently. In this paper, I propose the hierarchical unequal clustering method using cluster group model. This divides the entire network into two layers. The data aggregated from layer 2 consisted of cluster group is sent to layer 1, after re-aggregation the total data is sent to base station. This method decreases whole energy consumption by using cluster group model with multi-hop communication architecture. Hot spot problem can be solved by establishing unequal cluster. I also show that proposed hierarchical unequal clustering method is better than previous clustering method at the point of network energy efficiency.

Design and Implementation of Host-side Cache Migration Engine for High Performance Storage in A Virtualization Environment (가상화 환경에서 스토리지 성능 향상을 위한 호스트 캐시 마이그레이션 엔진 설계 및 구현)

  • Park, Joon Young;Park, Hyunchan;Yoo, Chuck
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.6
    • /
    • pp.278-283
    • /
    • 2016
  • Due to explosive increase in the amount of data produced recently, cloud storage system is required to offer high and stable performance. However, VM (Virtual Machine) migration may result in lowered storage service performance. Especially, in an environment where the host-side flash cache is used in a cloud system, the existing warmed up cache is lost and the problematic cold start begins at a new cache due to a VM migration. In this paper, we first demonstrate and analyze the cold start problem and then propose Cachemior (Cache migrator) which enables efficient hot start of the flash cache.

Mobile Sink Supporting Routing Protocol using Agent of Cluster Node (클러스터 노드의 에이전트를 이용한 이동 싱크 지원 라우팅 프로토콜)

  • Kim, Young-Soo;Suh, Jung-Seok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.13 no.6
    • /
    • pp.1208-1214
    • /
    • 2009
  • Sensor networks are vulnerable to data congestion and hot-spot compared with wireless networks. Mobile sink supporting route protocol has such problems as hot-spot and data congestion because agent of cluster node transmits all data packet. Therefore, mobile sink supporting route protocol needs to reduce the number of packets and keep the packets from concentrating on a single node. To solve these problems, we propose mobile sink supporting routing Protocol using agent of cluster node. Cutting down on the number of packets compared with the existing mobile sink supporting routing Protocol, our proposed protocol has reduced both communication overhead and energy consumption.

An Efficient Cluster Management Scheme Using Wireless Power Transfer for Solar-powered Wireless Sensor Networks with a Mobile Sink (모바일 싱크 기반의 태양 에너지 수집형 무선 센서 네트워크에서 무선 전력 전송을 이용한 효율적인 클러스터 관리 기법)

  • Son, Youngjae;Kang, Minjae;Go, Junghyun;Noh, Dong Kun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2019.10a
    • /
    • pp.370-371
    • /
    • 2019
  • 태양 에너지 수집형 무선 센서 네트워크는 지속해서 에너지를 수집할 수 있어 배터리 기반 센서 네트워크의 에너지 제약 문제를 완화할 수 있지만, 고정된 싱크의 사용으로 싱크 주변에 존재하는 노드들이 상대적으로 에너지 소비가 증가하는 문제, 즉 에너지 사용 불균형 문제는 해결하지 못한다. 최근의 연구에서는 클러스터링을 기반으로 한 모바일 싱크를 도입하여 이를 해결하고자 했지만, 클러스터 헤드 및 그 주변 노드들의 에너지 부담은 여전히 존재한다. 한편, 무선 전력 전송 기술 발전에 따라 무선 센서 네트워크에서 모바일 싱크를 이용한 무선 전력 전송의 연구가 활발히 이루어지고 있다. 따라서 본 논문에서는 무선 전력 전송이 가능한 모바일 싱크와 효율적인 클러스터링 기법(클러스터 헤드 선출 포함)을 이용하여 에너지 불균형 문제를 최소화하는 기법을 제안한다. 제안 기법은 클러스터 헤드 및 헤드 주변 노드의 에너지 핫 스팟이 완화됨으로, 전체 네트워크의 정전 노드들이 감소하고 수집된 데이터양이 증가한 것을 성능평가를 통해 확인할 수 있다.

The Analysis of Research Trends in Electric Vehicle using Topic Modeling (토픽 모델링을 이용한 전기차 연구 동향 분석)

  • Yuan Chen;Seok-Swoo Cho
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.17 no.4
    • /
    • pp.255-265
    • /
    • 2024
  • To address environmental challenges and improve energy efficiency, the adoption of electric vehicles has led to a surge in related research. However, to comprehensively understand the research trends within the field of electric vehicles, it is necessary to systematically analyze vast amounts of data. This study systematically analyzed research trends in the field of electric vehicles and identified key research topics through LDA topic modeling, based on 36,519 papers related to electric vehicles collected from the SCIE database. The data analysis revealed a total of 10 major topics, of which three were identified as hot topics showing an upward trend: Electric Vehicle Charging Infrastructure, Energy and Environmental Policy, and Optimization and Algorithms. Conversely, five topics were identified as cold topics exhibiting a downward trend: Battery Temperature and Cooling, Battery Materials and Chemistry, Motor and Mechanical Design, Control Strategies and Systems, and Battery Components and Materials. This study provides basic data for understanding the current research trends in electric vehicles and offers valuable information for researchers in selecting research topics related to electric vehicles.

A Classification Model for Customs Clearance Inspection Results of Imported Aquatic Products Using Machine Learning Techniques (머신러닝 기법을 활용한 수입 수산물 통관검사결과 분류 모델)

  • Ji Seong Eom;Lee Kyung Hee;Wan-Sup Cho
    • The Journal of Bigdata
    • /
    • v.8 no.1
    • /
    • pp.157-165
    • /
    • 2023
  • Seafood is a major source of protein in many countries and its consumption is increasing. In Korea, consumption of seafood is increasing, but self-sufficiency rate is decreasing, and the importance of safety management is increasing as the amount of imported seafood increases. There are hundreds of species of aquatic products imported into Korea from over 110 countries, and there is a limit to relying only on the experience of inspectors for safety management of imported aquatic products. Based on the data, a model that can predict the customs inspection results of imported aquatic products is developed, and a machine learning classification model that determines the non-conformity of aquatic products when an import declaration is submitted is created. As a result of customs inspection of imported marine products, the nonconformity rate is less than 1%, which is very low imbalanced data. Therefore, a sampling method that can complement these characteristics was comparatively studied, and a preprocessing method that can interpret the classification result was applied. Among various machine learning-based classification models, Random Forest and XGBoost showed good performance. The model that predicts both compliance and non-conformance well as a result of the clearance inspection is the basic random forest model to which ADASYN and one-hot encoding are applied, and has an accuracy of 99.88%, precision of 99.87%, recall of 99.89%, and AUC of 99.88%. XGBoost is the most stable model with all indicators exceeding 90% regardless of oversampling and encoding type.

Major Class Recommendation System based on Deep learning using Network Analysis (네트워크 분석을 활용한 딥러닝 기반 전공과목 추천 시스템)

  • Lee, Jae Kyu;Park, Heesung;Kim, Wooju
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.3
    • /
    • pp.95-112
    • /
    • 2021
  • In university education, the choice of major class plays an important role in students' careers. However, in line with the changes in the industry, the fields of major subjects by department are diversifying and increasing in number in university education. As a result, students have difficulty to choose and take classes according to their career paths. In general, students choose classes based on experiences such as choices of peers or advice from seniors. This has the advantage of being able to take into account the general situation, but it does not reflect individual tendencies and considerations of existing courses, and has a problem that leads to information inequality that is shared only among specific students. In addition, as non-face-to-face classes have recently been conducted and exchanges between students have decreased, even experience-based decisions have not been made as well. Therefore, this study proposes a recommendation system model that can recommend college major classes suitable for individual characteristics based on data rather than experience. The recommendation system recommends information and content (music, movies, books, images, etc.) that a specific user may be interested in. It is already widely used in services where it is important to consider individual tendencies such as YouTube and Facebook, and you can experience it familiarly in providing personalized services in content services such as over-the-top media services (OTT). Classes are also a kind of content consumption in terms of selecting classes suitable for individuals from a set content list. However, unlike other content consumption, it is characterized by a large influence of selection results. For example, in the case of music and movies, it is usually consumed once and the time required to consume content is short. Therefore, the importance of each item is relatively low, and there is no deep concern in selecting. Major classes usually have a long consumption time because they have to be taken for one semester, and each item has a high importance and requires greater caution in choice because it affects many things such as career and graduation requirements depending on the composition of the selected classes. Depending on the unique characteristics of these major classes, the recommendation system in the education field supports decision-making that reflects individual characteristics that are meaningful and cannot be reflected in experience-based decision-making, even though it has a relatively small number of item ranges. This study aims to realize personalized education and enhance students' educational satisfaction by presenting a recommendation model for university major class. In the model study, class history data of undergraduate students at University from 2015 to 2017 were used, and students and their major names were used as metadata. The class history data is implicit feedback data that only indicates whether content is consumed, not reflecting preferences for classes. Therefore, when we derive embedding vectors that characterize students and classes, their expressive power is low. With these issues in mind, this study proposes a Net-NeuMF model that generates vectors of students, classes through network analysis and utilizes them as input values of the model. The model was based on the structure of NeuMF using one-hot vectors, a representative model using data with implicit feedback. The input vectors of the model are generated to represent the characteristic of students and classes through network analysis. To generate a vector representing a student, each student is set to a node and the edge is designed to connect with a weight if the two students take the same class. Similarly, to generate a vector representing the class, each class was set as a node, and the edge connected if any students had taken the classes in common. Thus, we utilize Node2Vec, a representation learning methodology that quantifies the characteristics of each node. For the evaluation of the model, we used four indicators that are mainly utilized by recommendation systems, and experiments were conducted on three different dimensions to analyze the impact of embedding dimensions on the model. The results show better performance on evaluation metrics regardless of dimension than when using one-hot vectors in existing NeuMF structures. Thus, this work contributes to a network of students (users) and classes (items) to increase expressiveness over existing one-hot embeddings, to match the characteristics of each structure that constitutes the model, and to show better performance on various kinds of evaluation metrics compared to existing methodologies.

Improved Internet Resource Recommendation Method using FOAF and SNA (FOAF와 SNA를 이용한 개선된 인터넷 자원 추천 방법)

  • Wang, Qing;Sohn, Jong-Soo;Chung, In-Jeong
    • The KIPS Transactions:PartB
    • /
    • v.19B no.3
    • /
    • pp.165-176
    • /
    • 2012
  • In recent years, due to rapidly increasing user-created internet contents coupled with the development of community-based websites, the internet resource recommendation systems are attracting attentions of the users. However, most of the systems have failed in properly reflecting users' characteristics and thus they have difficulty in recommending appropriate resources to users. In this paper, we propose an internet resource recommendation method using FOAF and SNA which fully reflects the characteristics of users. In our method, 1) we extract the data about user characteristics and tags using FOAF; 2) we generate graphs representing users, user characteristics and tags after inserting data into 3 matrixes and integrating them; 3) we recommend the appropriate internet resources after selecting common characteristics of the recommended items and Hot tags by analyzing social network. For verification of our proposed method, we implemented our method to establish and analyze an experimental social group. We verified through our experiments that the more users added in the social network, the higher quality of recommendation result we got than the item-based recommendation method. By using the suggested idea in this paper, we can make a more appropriate recommendation of resources to users while effectively retrieving explosively increasing internet resources.

Binary Locally Repairable Codes from Complete Multipartite Graphs (완전다분할그래프 기반 이진 부분접속복구 부호)

  • Kim, Jung-Hyun;Nam, Mi-Young;Song, Hong-Yeop
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.40 no.9
    • /
    • pp.1734-1740
    • /
    • 2015
  • This paper introduces a generalized notion, referred to as joint locality, of the usual locality in distributed storage systems and proposes a code construction of binary locally repairable codes with joint locality ($r_1$=2, $r_2$=3 or 4). Joint locality is a set of numbers of nodes for repairing various failure patterns of nodes. The proposed scheme simplifies the code design problem utilizing complete multipartite graphs. Moreover, our construction can generate binary locally repairable codes achieving (2,t)-availability for any positive integer t. It means that each node can be repaired by t disjoint repair sets of cardinality 2. This property is useful for distributed storage systems since it permits parallel access to hot data.