• 제목/요약/키워드: text analytics

검색결과 109건 처리시간 0.028초

빅데이터 분석도구 R을 활용한 기상뉴스 데이터분석 (Analysis of Weather News using Big Data Analytics Tools R)

  • 김용수;반재훈
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2016년도 추계학술대회
    • /
    • pp.448-450
    • /
    • 2016
  • 정보기술과 디지털 경제의 확산으로 대규모의 데이터가 생산되는 정보화시대에서 빅 데이터의 중요성이 강조되고 있으며 다양한 분야에서 이를 응용하고 있다. 빅 데이터 분석도구인 R은 통계 기반의 정보 분석을 가능하게 하는 언어와 환경이다. 본 논문에서는 R을 이용하여 기상뉴스에 나타난 기상관련 빅 데이터를 분석한다. 다양한 뉴스에서 기상 관련 데이터를 수집하고 어떠한 텍스트가 분포되어 있는지 빈도 조사를 수행한다.

  • PDF

Visual Analytic for Intangible Cultural Heritage in China

  • Nan Zhang
    • Journal of Information Processing Systems
    • /
    • 제19권6호
    • /
    • pp.722-729
    • /
    • 2023
  • Visual analytic for intangible cultural heritage has recently developed in China. Using advanced interactive visualization tools experts can observe data distribution trends and explore the implicit relationships among data within a short time. It can enhance human cognitive and analytical abilities and improve the scientific preservation of intangible cultural heritage. To support this research topic, we have reviewed recent visualization works on intangible cultural heritage in China. We divide these works into three types: text visualization, multi-dimensional visualization, and geographical visualization. Each type is illustrated by several representative works. New development trends in this area are also discussed.

Investigation on the Effect of Multi-Vector Document Embedding for Interdisciplinary Knowledge Representation

  • 박종인;김남규
    • 지식경영연구
    • /
    • 제21권1호
    • /
    • pp.99-116
    • /
    • 2020
  • Text is the most widely used means of exchanging or expressing knowledge and information in the real world. Recently, researches on structuring unstructured text data for text analysis have been actively performed. One of the most representative document embedding method (i.e. doc2Vec) generates a single vector for each document using the whole corpus included in the document. This causes a limitation that the document vector is affected by not only core words but also other miscellaneous words. Additionally, the traditional document embedding algorithms map each document into only one vector. Therefore, it is not easy to represent a complex document with interdisciplinary subjects into a single vector properly by the traditional approach. In this paper, we introduce a multi-vector document embedding method to overcome these limitations of the traditional document embedding methods. After introducing the previous study on multi-vector document embedding, we visually analyze the effects of the multi-vector document embedding method. Firstly, the new method vectorizes the document using only predefined keywords instead of the entire words. Secondly, the new method decomposes various subjects included in the document and generates multiple vectors for each document. The experiments for about three thousands of academic papers revealed that the single vector-based traditional approach cannot properly map complex documents because of interference among subjects in each vector. With the multi-vector based method, we ascertained that the information and knowledge in complex documents can be represented more accurately by eliminating the interference among subjects.

Competitive intelligence in Korean Ramen Market using Text Mining and Sentiment Analysis

  • Kim, Yoosin;Jeong, Seung Ryul
    • 인터넷정보학회논문지
    • /
    • 제19권1호
    • /
    • pp.155-166
    • /
    • 2018
  • These days, online media, such as blogospheres, online communities, and social networking sites, provides the uncountable user-generated content (UGC) to discover market intelligence and business insight with. The business has been interested in consumers, and constantly requires the approach to identify consumers' opinions and competitive advantage in the competing market. Analyzing consumers' opinion about oneself and rivals can help decision makers to gain in-depth and fine-grained understanding on the human and social behavioral dynamics underlying the competition. In order to accomplish the comparison study for rival products and companies, we attempted to do competitive analysis using text mining with online UGC for two popular and competing ramens, a market leader and a market follower, in the Korean instant noodle market. Furthermore, to overcome the lack of the Korean sentiment lexicon, we developed the domain specific sentiment dictionary of Korean texts. We gathered 19,386 pieces of blogs and forum messages, developed the Korean sentiment dictionary, and defined the taxonomy for categorization. In the context of our study, we employed sentiment analysis to present consumers' opinion and statistical analysis to demonstrate the differences between the competitors. Our results show that the sentiment portrayed by the text mining clearly differentiate the two rival noodles and convincingly confirm that one is a market leader and the other is a follower. In this regard, we expect this comparison can help business decision makers to understand rich in-depth competitive intelligence hidden in the social media.

디지털 포렌식 조사를 위한 NLP의 텍스트 전처리 연구 (A study on NLP Text Preprocessing for digital forensic investigation)

  • 이성원;김도현
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2022년도 춘계학술대회
    • /
    • pp.189-191
    • /
    • 2022
  • 현대 사회에서 메신저 서비스는 다른 사람과의 의사소통을 위해 필수적으로 사용되고 있으며 이는 범죄자들도 예외는 아니다. 따라서 메신저 데이터는 디지털 포렌식 조사에서 필수적으로 분석해야 하는 대상이며, 대표적으로 2018년 버닝 썬 게이트, 2019년 N 번 방 사건이 메신저 데이터가 범죄를 해결하는 데 중요한 증거로 활용됐다. 메신저 서비스가 널리 사용됨에 따라 디지털 기기에 대량의 메신저 데이터가 저장되고, 이에 따라 디지털 포렌식 조사 과정에서 메신저 데이터를 분석하는데 많은 시간이 소요되고 있기 때문에 이를 효과적으로 대응하기 위한 텍스트 마이닝 연구가 필요하다. 본 논문에서는 인스턴트 메신저를 대상으로 효과적인 NLP 분석을 하기 위해 인스턴트 메시지의 특성에 따른 다양한 자연어 전처리 방법을 연구한다.

  • PDF

텍스트마이닝을 이용한 약물유해반응 보고자료 분석 (Analysis of Adverse Drug Reaction Reports using Text Mining)

  • 김현희;유기연
    • 한국임상약학회지
    • /
    • 제27권4호
    • /
    • pp.221-227
    • /
    • 2017
  • Background: As personalized healthcare industry has attracted much attention, big data analysis of healthcare data is essential. Lots of healthcare data such as product labeling, biomedical literature and social media data are unstructured, extracting meaningful information from the unstructured text data are becoming important. In particular, text mining for adverse drug reactions (ADRs) reports is able to provide signal information to predict and detect adverse drug reactions. There has been no study on text analysis of expert opinion on Korea Adverse Event Reporting System (KAERS) databases in Korea. Methods: Expert opinion text of KAERS database provided by Korea Institute of Drug Safety & Risk Management (KIDS-KD) are analyzed. To understand the whole text, word frequency analysis are performed, and to look for important keywords from the text TF-IDF weight analysis are performed. Also, related keywords with the important keywords are presented by calculating correlation coefficient. Results: Among total 90,522 reports, 120 insulin ADR report and 858 tramadol ADR report were analyzed. The ADRs such as dizziness, headache, vomiting, dyspepsia, and shock were ranked in order in the insulin data, while the ADR symptoms such as vomiting, 어지러움, dizziness, dyspepsia and constipation were ranked in order in the tramadol data as the most frequently used keywords. Conclusion: Using text mining of the expert opinion in KIDS-KD, frequently mentioned ADRs and medications are easily recovered. Text mining in ADRs research is able to play an important role in detecting signal information and prediction of ADRs.

Investigation of Terminology Coverage in Radiology Reporting Templates and Free-text Reports

  • Hong, Yi;Zhang, Jin
    • International Journal of Knowledge Content Development & Technology
    • /
    • 제5권1호
    • /
    • pp.5-14
    • /
    • 2015
  • The Radiological Society of North America (RSNA) is improving reporting practices by developing an online library of clear and consistent report templates. To compare term occurrences in free-text radiology reports and RSNA reporting templates, the Wilcoxon signed-rank test method was applied to investigate how much of the content of conventional narrative reports is covered by the terms included in the RSNA reporting templates. The results show that the RSNA reporting templates cover most terms that appear in actual radiology reports. The Wilcoxon test may be helpful in evaluatingexisting templates and guiding the enhancement of reporting templates.

Opinion-Mining Methodology for Social Media Analytics

  • Kim, Yoosin;Jeong, Seung Ryul
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제9권1호
    • /
    • pp.391-406
    • /
    • 2015
  • Social media have emerged as new communication channels between consumers and companies that generate a large volume of unstructured text data. This social media content, which contains consumers' opinions and interests, is recognized as valuable material from which businesses can mine useful information; consequently, many researchers have reported on opinion-mining frameworks, methods, techniques, and tools for business intelligence over various industries. These studies sometimes focused on how to use opinion mining in business fields or emphasized methods of analyzing content to achieve results that are more accurate. They also considered how to visualize the results to ensure easier understanding. However, we found that such approaches are often technically complex and insufficiently user-friendly to help with business decisions and planning. Therefore, in this study we attempt to formulate a more comprehensive and practical methodology to conduct social media opinion mining and apply our methodology to a case study of the oldest instant noodle product in Korea. We also present graphical tools and visualized outputs that include volume and sentiment graphs, time-series graphs, a topic word cloud, a heat map, and a valence tree map with a classification. Our resources are from public-domain social media content such as blogs, forum messages, and news articles that we analyze with natural language processing, statistics, and graphics packages in the freeware R project environment. We believe our methodology and visualization outputs can provide a practical and reliable guide for immediate use, not just in the food industry but other industries as well.

Quantitative Study of Soft Masculine Trends in Contemporary Menswear Using Semantic Network Analysis

  • Tin Chun Cheung;Sun Young Choi
    • 한국의류학회지
    • /
    • 제46권6호
    • /
    • pp.1058-1073
    • /
    • 2022
  • Big data analytics and social media have shifted the way fashion trends are dictated. Fashion as a medium for expressing gender has created new concepts of masculinity in popular culture, where men are increasingly depicted in a softer style. In this study, we analyzed 2,879 menswear collections over a 10-year period from Vogue US to uncover key menswear trends. Using Semantic Network Analysis (SNA) on Orange3, we were able to quantitatively analyze how contemporary menswear designers interpreted diversified trends of masculinity on the runway. Frequency and degree centrality were measured to weigh the significance of trend keywords. "Jacket (f = 3056; DC = 0.80), shirt (f = 1912; DC = 0.60) and pant (f = 1618; DC = 0.53)" were among the most prominent keywords. Our results showed that soft masculine keywords, e.g., "lace, floral, and pink" also appeared, but with the majority scoring DC = < 0.10. The findings provide an insight into key menswear trends through frequency, degree centrality measurements, time-series analysis, egocentric, and visual semantic networks. This also demonstrates the feasibility of using text analytics to visualize design trends, concepts, and patterns for application as an ideation tool for academic researchers, designers, and fashion retailers.

Measuring Hotel Service Quality Using Social Media Analytics: The Moderating Effects of Brand of Origin

  • Byounggu Choi;Shin-Hyeok Kang
    • Asia pacific journal of information systems
    • /
    • 제33권3호
    • /
    • pp.677-701
    • /
    • 2023
  • With the rapid advancement of social media analytics and artificial intelligence, many studies have used online customer reviews as an important source to measure service quality in many industries, including the hotel industry. However, these studies have failed to identify the relative importance of different dimensions of service quality and their role in customer satisfaction. To fill this research gap, this study aims to identify the effects of service quality on hotel customer satisfaction from the multidimensional perspectives using sentiment analysis with self-training on online reviews. Additionally, the moderating role of the brand of origin for each service quality dimension is also investigated. Drawing on the SERVQUAL model and brand of origin concept, this study develops 12 hypotheses and empirically tests them using 30,070 online customer hotel reviews collected from TripAdvisor.com. The results indicated that overall service quality and each dimension of SERVQUAL significantly influenced customer satisfaction of hotels. The results also confirmed the moderating effects of brand of origin on overall service quality. However, the moderating effects of brand of origin for the tangible, reliability, and empathy dimensions of service quality were significant, whereas the effects for responsiveness and assurance were not. This study sheds new light on service quality measurement by analyzing the multidimensional features of service quality and the role of brand of origin in the hotel service context.