• Title/Summary/Keyword: term co-occurrence

Search Result 53, Processing Time 0.026 seconds

Multi-document Summarization Based on Cluster using Term Co-occurrence (단어의 공기정보를 이용한 클러스터 기반 다중문서 요약)

  • Lee, Il-Joo;Kim, Min-Koo
    • Journal of KIISE:Software and Applications
    • /
    • v.33 no.2
    • /
    • pp.243-251
    • /
    • 2006
  • In multi-document summarization by means of salient sentence extraction, it is important to remove redundant information. In the removal process, the similarities and differences of sentences are considered. In this paper, we propose a method for multi-document summarization which extracts salient sentences without having redundant sentences by way of cohesive term clustering method that utilizes co-occurrence Information. In the cohesive term clustering method, we assume that each term does not exist independently, but rather it is related to each other in meanings. To find the relations between terms, we cluster sentences according to topics and use the co-occurrence information oi terms in the same topic. We conduct experimental tests with the DUC(Document Understanding Conferences) data. In the tests, our method shows better performance of summarization than other summarization methods which use term co-occurrence information based on term cohesion of document or sentence unit, and simple statistical information.

Text Mining of Wood Science Research Published in Korean and Japanese Journals

  • Eun-Suk JANG
    • Journal of the Korean Wood Science and Technology
    • /
    • v.51 no.6
    • /
    • pp.458-469
    • /
    • 2023
  • Text mining techniques provide valuable insights into research information across various fields. In this study, text mining was used to identify research trends in wood science from 2012 to 2022, with a focus on representative journals published in Korea and Japan. Abstracts from Journal of the Korean Wood Science and Technology (JKWST, 785 articles) and Journal of Wood Science (JWS, 812 articles) obtained from the SCOPUS database were analyzed in terms of the word frequency (specifically, term frequency-inverse document frequency) and co-occurrence network analysis. Both journals showed a significant occurrence of words related to the physical and mechanical properties of wood. Furthermore, words related to wood species native to each country and their respective timber industries frequently appeared in both journals. CLT was a common keyword in engineering wood materials in Korea and Japan. In addition, the keywords "MDF," "MUF," and "GFRP" were ranked in the top 50 in Korea. Research on wood anatomy was inferred to be more active in Japan than in Korea. Co-occurrence network analysis showed that words related to the physical and structural characteristics of wood were organically related to wood materials.

Alleviating Semantic Term Mismatches in Korean Information Retrieval (한국어 정보 검색에서 의미적 용어 불일치 완화 방안)

  • Yun, Bo-Hyun;Park, Sung-Jin;Kang, Hyun-Kyu
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.12
    • /
    • pp.3874-3884
    • /
    • 2000
  • An information retrieval system has to retrieve all and only documents which are relevant to a user query, even if index terms and query terms are not matched exactly. However, term mismatches between index terms and qucry terms have been a serious obstacle to the enhancement of retrieval performance. In this paper, we discuss automatic term normalization between words in text corpora and their application to a Korean information retrieval system. We perform two types of term normalizations to alleviate semantic term mismatches: equivalence class and co-occurrence cluster. First, transliterations, spelling errors, and synonyms are normalized into equivalence classes bv using contextual similarity. Second, context-based terms are normalized by using a combination of mutual information and word context to establish word similarities. Next, unsupervised clustering is done by using K-means algorithm and co-occurrence clusters are identified. In this paper, these normalized term products are used in the query expansion to alleviate semantic tem1 mismatches. In other words, we utilize two kinds of tcrm normalizations, equivalence class and co-occurrence cluster, to expand user's queries with new tcrms, in an attempt to make user's queries more comprehensive (adding transliterations) or more specific (adding spc'Cializationsl. For query expansion, we employ two complementary methods: term suggestion and term relevance feedback. The experimental results show that our proposed system can alleviatl' semantic term mismatches and can also provide the appropriate similarity measurements. As a result, we know that our system can improve the rctrieval efficiency of the information retrieval system.

  • PDF

Text-Mining Analyses of News Articles on Schizophrenia (조현병 관련 주요 일간지 기사에 대한 텍스트 마이닝 분석)

  • Nam, Hee Jung;Ryu, Seunghyong
    • Korean Journal of Schizophrenia Research
    • /
    • v.23 no.2
    • /
    • pp.58-64
    • /
    • 2020
  • Objectives: In this study, we conducted an exploratory analysis of the current media trends on schizophrenia using text-mining methods. Methods: First, web-crawling techniques extracted text data from 575 news articles in 10 major newspapers between 2018 and 2019, which were selected by searching "schizophrenia" in the Naver News. We had developed document-term matrix (DTM) and/or term-document matrix (TDM) through pre-processing techniques. Through the use of DTM and TDM, frequency analysis, co-occurrence network analysis, and topic model analysis were conducted. Results: Frequency analysis showed that keywords such as "police," "mental illness," "admission," "patient," "crime," "apartment," "lethal weapon," "treatment," "Jinju," and "residents" were frequently mentioned in news articles on schizophrenia. Within the article text, many of these keywords were highly correlated with the term "schizophrenia" and were also interconnected with each other in the co-occurrence network. The latent Dirichlet allocation model presented 10 topics comprising a combination of keywords: "police-Jinju," "hospital-admission," "research-finding," "care-center," "schizophrenia-symptom," "society-issue," "family-mind," "woman-school," and "disabled-facilities." Conclusion: The results of the present study highlight that in recent years, the media has been reporting violence in patients with schizophrenia, thereby raising an important issue of hospitalization and community management of patients with schizophrenia.

Influence of Microbial Activity on the Long-Term Alteration of Compacted Bentonite/Metal Chip Blocks

  • Lee, Seung Yeop;Lee, Jae-Kwang;Kwon, Jang-Soon
    • Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
    • /
    • v.19 no.4
    • /
    • pp.469-477
    • /
    • 2021
  • Safe storage of spent nuclear fuel in deep underground repositories necessitates an understanding of the long-term alteration of metal canisters and buffer materials. A small-scale laboratory alteration test was performed on metal (Cu or Fe) chips embedded in compacted bentonite blocks placed in anaerobic water for 1 year. Lactate, sulfate, and bacteria were separately added to the water to promote biochemical reactions in the system. The bentonite blocks immersed in the water were dismantled after 1 year, showing that their alteration was insignificant. However, the Cu chip exhibited some microscopic etch pits on its surface, wherein a slight sulfur component was detected. Overall, the Fe chip was more corroded than the Cu chip under the same conditions. The secondary phase of the Fe chip was locally found as carbonate materials, such as siderite (FeCO3) and calcite ((Ca, Fe)CO3). These secondary products can imply that the local carbonate occurrence on the Fe chip may be initiated and developed by an evolution (alteration) of bentonite and a diffusive provision of biogenic CO2 gas. These laboratory scale results suggest that the actual long-term alteration of metal canisters/bentonite blocks in the engineered barrier could be possible by microbial activities.

A Study on Intellectual Structure of Library and Information Science in Korea (문헌정보학의 지식 구조에 관한 연구)

  • Yoo, Yeong-Jun
    • Journal of the Korean Society for information Management
    • /
    • v.20 no.3
    • /
    • pp.277-297
    • /
    • 2003
  • This study was conducted upon the premise that index terms display the intellectual structure of a specific subject field. In this study, and attempt was made to grasp the intellectual structure of Library and Information. Science by clustering the index terms of the journals of the related academic societies at the Library of National Assembly - such as the Journal of the Korean Society for Information Management, the Journal of the Korean Library and Information Science Society, and the Journal of the Korean Society for Library and Information Science. Through the course of the study, index term clusters were generated based on the linkage of the index terms and the frequency of co-occurrence, and moreover, time periods analysis was conducted along with studies on first-appearing terms, in order to clarify the trend and development process of the Library and Information Science. This study also analysed the difference between two intellectual structure by comparing the structure generated by index term clusters with the existing structure of traditional classification systems.

Identification of Distinct Vaginal Microbiota Signatures Contributing Toward Preterm Birth Using an Integrative Computational Approach

  • Sudeepti Kulshreshtha;Priyanka Narad;Brojen Singh;Deepak Modi;Abhishek Sengupta
    • Microbiology and Biotechnology Letters
    • /
    • v.51 no.1
    • /
    • pp.109-123
    • /
    • 2023
  • Preterm birth (PTB) is defined as giving birth prior to the 37th week of pregnancy and is a major cause of infant mortality. Studies have indicated that the vaginal microbiota's composition and its dysbiosis, particularly during pregnancy, may play a major role in PTB. While previous research work concentrated on well-studied microorganisms such as Lactobacillus, Prevotella, Gardnerella, various other microbes, and their significance in the vaginal microbiota's stability remain unknown. Moreover, current studies have focused primarily on the relative abundances of the microbes found, without considering their interactions with other members of the vaginal microbiota. In this work, we developed a novel computational approach and performed taxonomic classification of vaginal microbiota samples stratified longitudinally (Term/PTB) to observe compositional disparities and find underexamined microbes that may be contributing to PTB. Furthermore, we carried out a correlational analysis to build a microbial co-interaction network and investigated the functional implications of the genes present in both Term and PTB samples. The co-occurrence network revealed that Lactobacillus acts in solidarity to maintain the stability of the vaginal microbiota and did not have strong co-interactions with any of the other microbes. Similarly, microbes with strong interactions with Atopobium, a well-known marker microbe of PTB, were also observed. Additionally, several genes such as PTXA, FANCM, GPX, and DUSP were found to be playing an important role in the occurrence of PTB. This study provides a novel conceptual framework revealing distinct vaginal microbiota signatures that could be potential therapeutic targets for the prevention of PTB.

Ten Year Literature on Psychological and Behavioral Interventions Against Cancer: a Terms Analysis

  • Feng, Rui;Chai, Jing;Wang, De-Bin;Xia, Yi;Cheng, Peng-Lai;Dai, Zhao-Yang
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.13 no.10
    • /
    • pp.5171-5176
    • /
    • 2012
  • We here performed a systematic review of PBIC literature using terms analysis in a hope of both identifying potential trends and patterns and exploring methods leveraging traditional literature reviews in this specific area. Articles meeting inclusion criteria were retrieved from PUBMED and translated into dichotomized article records representing presence or non-presence of MeSH terms and a metric consisting of numbers of times of co-occurrence between all pairs of terms identified using a self-designed program. The occurrence of and relations among the terms were calculated and visualized using Excel2007 and UCINET respectively. A total of 1,742 terms were identified from 997 articles retrieved. Put in a descending order, the lines representing the times of term occurrence formed a typical hyperbolic curve; when plotted along the x-axis of whole MESH terms, the lines clustered within four specific regions. Comparison of term occurrence between 2002 and 2011 revealed priority changes in population and subjects (from general groups to priority groups), intervention approaches (from medicine to exercise and psychotherapy), methodology and techniques (from cohort studies to randomized controlled trials) and outcomes (from health and mental health to quality of life, depression etc.). Networks of the terms featured a number of closely linked groups of topics including method and questionnaires, therapy and outcomes, survival management, psychological assessment and intervention, behavioral intervention (individual and community oriented). Terms analysis revealed interesting trends and patterns about PBIC publications and both the analysis methods and findings have implications for future research and literature reviews.

A Study on the General Public's Perceptions of Dental Fear Using Unstructured Big Data

  • Han-A Cho;Bo-Young Park
    • Journal of dental hygiene science
    • /
    • v.23 no.4
    • /
    • pp.255-263
    • /
    • 2023
  • Background: This study used text mining techniques to determine public perceptions of dental fear, extracted keywords related to dental fear, identified the connection between the keywords, and categorized and visualized perceptions related to dental fear. Methods: Keywords in texts posted on Internet portal sites (NAVER and Google) between 1 January, 2000, and 31 December, 2022, were collected. The four stages of analysis were used to explore the keywords: frequency analysis, term frequency-inverse document frequency (TF-IDF), centrality analysis and co-occurrence analysis, and convergent correlations. Results: In the top ten keywords based on frequency analysis, the most frequently used keyword was 'treatment,' followed by 'fear,' 'dental implant,' 'conscious sedation,' 'pain,' 'dental fear,' 'comfort,' 'taking medication,' 'experience,' and 'tooth.' In the TF-IDF analysis, the top three keywords were dental implant, conscious sedation, and dental fear. The co-occurrence analysis was used to explore keywords that appear together and showed that 'fear and treatment' and 'treatment and pain' appeared the most frequently. Conclusion: Texts collected via unstructured big data were analyzed to identify general perceptions related to dental fear, and this study is valuable as a source data for understanding public perceptions of dental fear by grouping associated keywords. The results of this study will be helpful to understand dental fear and used as factors affecting oral health in the future.

Co-occurrence Network Analysis of Keywords in Geriatric Frailty

  • Kim, Youngji;Jang, Soong-nang;Lee, Jung Lim
    • Research in Community and Public Health Nursing
    • /
    • v.29 no.4
    • /
    • pp.429-439
    • /
    • 2018
  • Purpose: The aim of this study is to identify core keyword of frailty research in the past 35 years to understand the structure of knowledge of frailty. Methods: 10,367 frailty articles published between 1981 and April 2016 were retrieved from Web of Science. Keywords from these articles were extracted using Bibexcel and social network analysis was conducted with the occurrence network using NetMiner program. Results: The top five keywords with a high frequency of occurrence include 'disability', 'nursing home', 'sarcopenia', 'exercise', and 'dementia'. Keywords were classified by subheadings of MeSH and the majority of them were included under the healthcare and physical dimensions. The degree centralities of the keywords were arranged in the order of 'long term care' (0.55), 'gait' (0.42), 'physical activity' (0.42), 'quality of life' (0.42), and 'physical performance' (0.38). The betweenness centralities of the keywords were listed in the order of depression' (0.32), 'quality of life' (0.28), 'home care' (0.28), 'geriatric assessment' (0.28), and 'fall' (0.27). The cluster analysis shows that the frailty research field is divided into seven clusters: aging, sarcopenia, inflammation, mortality, frailty index, older people, and physical activity. Conclusion: After reviewing previous research in the 35 years, it has been found that only physical frailty and frailty related to medicine have been emphasized. Further research in psychological, cognitive, social, and environmental frailty is needed to understand frailty in a multifaceted and integrative manner.