• Title/Summary/Keyword: LDA Topic Model

Search Result 109, Processing Time 0.03 seconds

Online Reviews Analysis for Prediction of Product Ratings based on Topic Modeling (토픽 모델링에 기반한 온라인 상품 평점 예측을 위한 온라인 사용 후기 분석)

  • Park, Sang Hyun;Moon, Hyun Sil;Kim, Jae Kyeong
    • Journal of Information Technology Services
    • /
    • v.16 no.3
    • /
    • pp.113-125
    • /
    • 2017
  • Customers have been affected by others' opinions when they make a purchase. Thanks to the development of technologies, people are sharing their experiences such as reviews or ratings through online or social network services, However, although ratings are intuitive information for others, many reviews include only texts without ratings. Also, because of huge amount of reviews, customers and companies can't read all of them so they are hard to evaluate to a product without ratings. Therefore, in this study, we propose a methodology to predict ratings based on reviews for a product. In a methodology, we first estimate the topic-review matrix using the Latent Dirichlet Allocation technic which is widely used in topic modeling. Next, we predict ratings based on the topic-review matrix using the artificial neural network model which is based on the backpropagation algorithm. Through experiments with actual reviews, we find that our methodology can predict ratings based on customers' reviews. And our methodology performs better with reviews which include certain opinions. As a result, our study can be used for customers and companies that want to know exactly a product with ratings. Moreover, we hope that our study leads to the implementation of future studies that combine machine learning and topic modeling.

Exploring the Trends and Challenges of Artificial Intelligence Education through the Analysis of Newspapers in Korea, 1991-2020: A topic-modeling approach

  • Kim, Sung-ae
    • Journal of information and communication convergence engineering
    • /
    • v.18 no.4
    • /
    • pp.216-221
    • /
    • 2020
  • Artificial intelligence (AI), an essential skill of the Fourth Industrial Revolution, is being actively taught in higher education; however, AI education is only in the preparatory stage in elementary, middle, and high schools. Investigating various newspaper articles related to AI education to date can aid in basic data collection, which is an important process in the preparatory stage. Accordingly, 13,378 newspaper articles were collected from a total of 21 newspapers, and five topics were extracted using the latent Dirichlet allocation (LDA)-based topic model along with frequency analysis. Newspaper articles from the early 2000s expanded to technologies related to the Fourth Industrial Revolution. Accordingly, education in AI fields should be linked with education in AI-based technology. In addition, efforts should be made to secure the continuity and sequence of AI education in cooperation with related higher institutions and companies.

A New Fine-grain SMS Corpus and Its Corresponding Classifier Using Probabilistic Topic Model

  • Ma, Jialin;Zhang, Yongjun;Wang, Zhijian;Chen, Bolun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.2
    • /
    • pp.604-625
    • /
    • 2018
  • Nowadays, SMS spam has been overflowing in many countries. In fact, the standards of filtering SMS spam are different from country to country. However, the current technologies and researches about SMS spam filtering all focus on dividing SMS message into two classes: legitimate and illegitimate. It does not conform to the actual situation and need. Furthermore, they are facing several difficulties, such as: (1) High quality and large-scale SMS spam corpus is very scarce, fine categorized SMS spam corpus is even none at all. This seriously handicaps the researchers' studies. (2) The limited length of SMS messages lead to lack of enough features. These factors seriously degrade the performance of the traditional classifiers (such as SVM, K-NN, and Bayes). In this paper, we present a new fine categorized SMS spam corpus which is unique and the largest one as far as we know. In addition, we propose a classifier, which is based on the probability topic model. The classifier can alleviate feature sparse problem in the task of SMS spam filtering. Moreover, we compare the approach with three typical classifiers on the new SMS spam corpus. The experimental results show that the proposed approach is more effective for the task of SMS spam filtering.

Research on Community Knowledge Modeling of Readers Based on Interest Labels

  • Kai, Wang;Wei, Pan;Xingzhi, Chen
    • Journal of Information Processing Systems
    • /
    • v.19 no.1
    • /
    • pp.55-66
    • /
    • 2023
  • Community portraits can deeply explore the characteristics of community structures and describe the personalized knowledge needs of community users, which is of great practical significance for improving community recommendation services, as well as the accuracy of resource push. The current community portraits generally have the problems of weak perception of interest characteristics and low degree of integration of topic information. To resolve this problem, the reader community portrait method based on the thematic and timeliness characteristics of interest labels (UIT) is proposed. First, community opinion leaders are identified based on multi-feature calculations, and then the topic features of their texts are identified based on the LDA topic model. On this basis, a semantic mapping including "reader community-opinion leader-text content" was established. Second, the readers' interest similarity of the labels was dynamically updated, and two kinds of tag parameters were integrated, namely, the intensity of interest labels and the stability of interest labels. Finally, the similarity distance between the opinion leader and the topic of interest was calculated to obtain the dynamic interest set of the opinion leaders. Experimental analysis was conducted on real data from the Douban reading community. The experimental results show that the UIT has the highest average F value (0.551) compared to the state-of-the-art approaches, which indicates that the UIT has better performance in the smooth time dimension.

Analyzing the Factors of Gentrification After Gradual Everyday Recovery

  • Yoon-Ah Song;Jeongeun Song;ZoonKy Lee
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.8
    • /
    • pp.175-186
    • /
    • 2023
  • In this paper, we aim to build a gentrification analysis model and examine its characteristics, focusing on the point at which rents rose sharply alongside the recovery of commercial districts after the gradual resumption of daily life. Recently, in Korea, the influence of social distancing measures after the pandemic has led to the formation of small-scale commercial districts, known as 'hot places', rather than large-scale ones. These hot places have gained popularity by leveraging various media and social networking services to attract customers effectively. As a result, with an increase in the floating population, commercial districts have become active, leading to a rapid surge in rents. However, for small business owners, coping with the sudden rise in rent even with increased sales can lead to gentrification, where they might be forced to leave the area. Therefore, in this study, we seek to analyze the periods before and after by identifying points where rents rise sharply as commercial districts experience revitalization. Firstly, we collect text data to explore topics related to gentrification, utilizing LDA topic modeling. Based on this, we gather data at the commercial district level and build a gentrification analysis model to examine its characteristics. We hope that the analysis of gentrification through this model during a time when commercial districts are being revitalized after facing challenges due to the pandemic can contribute to policies supporting small businesses.

Metaverse Augmented Reality Research Trends Using Topic Modeling Methodology (토픽 모델링 기법을 활용한 메타버스 증강현실 연구 동향 분석)

  • An, Jaeyoung;Shim, Soyun;Yun, Haejung
    • Knowledge Management Research
    • /
    • v.23 no.2
    • /
    • pp.123-142
    • /
    • 2022
  • The non-face-to-face environment accelerated by COVID-19 has speeded up the dissemination of digital virtual ecosystems and metaverse. In order for the metaverse to be sustainable, digital twins that are compatible with the real world are key, and critical technology for that is AR (Augmented Reality). In this study, we examined research trends about AR, and will propose the directions for future AR research. We conducted LDA based topic modeling on 11,049 abstracts of published domestic and foreign AR related papers from 2009 to Mar 2022, and then looked into AR that was comprehensive research trends, comparison of domestic and foreign research trends, and research trends before and after the popularity of metaverse concepts. As a result, the topics of AR related research were deduced from 11 topics such as device, network communication, surgery, digital twin, education, serious game, camera/vision, color application, therapy, location accuracy, and interface design. After popularity of metaverse, 6 topics were deduced such as camera/vision, training, digital twin, surgical/surgical, interaction performance, and network communication. We will expect, through this study, to encourage active research on metaverse AR with convergent characteristics in multidisciplinary fields and contribute to giving useful implications to practitioners.

Research on Ways to Revitalize Traditional Markets by Exploring Research Trends (연구동향 탐색을 통한 전통시장 활성화 방안 연구)

  • Choon-Ho LEE;Hoe-Chang YANG
    • The Journal of Economics, Marketing and Management
    • /
    • v.11 no.4
    • /
    • pp.53-63
    • /
    • 2023
  • Purpose: The purpose of this study is to examine the research trends in the papers published by Korean researchers related to traditional markets, to check what topics have been studied, and to make various suggestions for research directions and effective ways to revitalize traditional markets. Research design, data and methodology: To this end, this study conducted word frequency analysis, co-occurrence frequency analysis, BERTopic, LDA, dynamic topic modeling and OLS regression analysis using Python 3.7 on the English abstracts of a total of 502 papers extracted through ScienceON. Results: As a result of word frequency analysis and co-occurrence frequency analysis, it was found that studies related to traditional markets have been conducted not only on factors related to customers, but also on traditional market merchants and government policies, and the degree of service, quality, and satisfaction perceived by customers using traditional markets. Through BERTopic and LDA, three topics such as 'Traditional market safety management' were identified, and among them, it was found that 'Traditional market safety management' is relatively less attention by researchers. Conclusions: The results of this study suggest that future research on the revitalization of traditional markets should be conducted from a specific consulting perspective along with the establishment of various data, a causal model study from various perspectives such as the characteristics of merchants as well as consumers, and an integrated and convergent approach to policy formulation by the government and local governments.

Convergence Study on Research Topics for Thyroid Cancer in Korea (국내 갑상선암 논문 토픽에 대한 융합연구)

  • Yang, Ji-Yeon
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.2
    • /
    • pp.75-81
    • /
    • 2019
  • The purpose of this study was to perform a convergence study for the investigation of the trend of research topics related to thyroid cancer in Korea. We collected related research papers from DBpia and employed LDA-based topic model. In result, we identified four research topics, each of which concerns "Surgery", "Disease aggressiveness", "Survival analysis", and "Well-being of patients". With multinomial logistic regression, we found significant time trend, where "Surgery"-related topic was popular before 2000, topics regarding "Disease aggressiveness" and "Survival analysis" were frequently addressed in the 2000s, and "Survival analysis" and especially "Well-being of patients" have been pursued since 2010. The findings would serve as a reference guide for research directions. Future work may examine whether the recent change in research topics is observed in other diseases.

Empirical Comparison of Word Similarity Measures Based on Co-Occurrence, Context, and a Vector Space Model

  • Kadowaki, Natsuki;Kishida, Kazuaki
    • Journal of Information Science Theory and Practice
    • /
    • v.8 no.2
    • /
    • pp.6-17
    • /
    • 2020
  • Word similarity is often measured to enhance system performance in the information retrieval field and other related areas. This paper reports on an experimental comparison of values for word similarity measures that were computed based on 50 intentionally selected words from a Reuters corpus. There were three targets, including (1) co-occurrence-based similarity measures (for which a co-occurrence frequency is counted as the number of documents or sentences), (2) context-based distributional similarity measures obtained from a latent Dirichlet allocation (LDA), nonnegative matrix factorization (NMF), and Word2Vec algorithm, and (3) similarity measures computed from the tf-idf weights of each word according to a vector space model (VSM). Here, a Pearson correlation coefficient for a pair of VSM-based similarity measures and co-occurrence-based similarity measures according to the number of documents was highest. Group-average agglomerative hierarchical clustering was also applied to similarity matrices computed by individual measures. An evaluation of the cluster sets according to an answer set revealed that VSM- and LDA-based similarity measures performed best.

Enhancing Music Recommendation Systems Through Emotion Recognition and User Behavior Analysis

  • Qi Zhang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.5
    • /
    • pp.177-187
    • /
    • 2024
  • 177-Existing music recommendation systems do not sufficiently consider the discrepancy between the intended emotions conveyed by song lyrics and the actual emotions felt by users. In this study, we generate topic vectors for lyrics and user comments using the LDA model, and construct a user preference model by combining user behavior trajectories reflecting time decay effects and playback frequency, along with statistical characteristics. Empirical analysis shows that our proposed model recommends music with higher accuracy compared to existing models that rely solely on lyrics. This research presents a novel methodology for improving personalized music recommendation systems by integrating emotion recognition and user behavior analysis.