• Title/Summary/Keyword: GPT2

Search Result 760, Processing Time 0.031 seconds

Biological Effects of Korean Puerariae Radix Catechins on the Liver Function in Rats Administrated with Ethanol

  • Lee, Chi-Ho
    • Preventive Nutrition and Food Science
    • /
    • v.2 no.2
    • /
    • pp.138-143
    • /
    • 1997
  • Crude catechin extracts were prepared using ethyl acetate from Korean Puerariae Radix (PR) and their biological effects on the alcoholic liver damage were investigated in male Sprague-Dawley rats (6 weeks old). Ethanol (5g ethanol/kg body weight/day) administration was performed for 8 weeks and after ethanol consuming rats were treated with one or two% catechin extracts of diet for 8 weeks. At the end of experimental period, lipid hydroperoxides in liver were analyzed using a chemiluminescence-high performance liquid chromatography (CL-HPLC) method. Compared with control animals, ethanol consumed rats showed lighter body weights, lower ratios of liver/body weight, higher activities of GOT and GPT, and increased lipid hydroperoxide amount in liver. With one or two% catechin extracts treatment, GOT and GPT activities returned to normal ranges. Lipid hydroperoxide contents in liver of on or two% PR treated rats lowered to 20% or 25% respectively, compared with the levels of those ethanol consumed animals without catechin extracts treatment. Therefore, we concluded that on or two% PR crude catechins treatment could be effective for alcoholic liver damage caused by lipid peroxidation.

  • PDF

A Study on the Psychological Counseling AI Chatbot System based on Sentiment Analysis (감정분석 기반 심리상담 AI 챗봇 시스템에 대한 연구)

  • An, Se Hun;Jeong, Ok Ran
    • Journal of Information Technology Services
    • /
    • v.20 no.3
    • /
    • pp.75-86
    • /
    • 2021
  • As artificial intelligence is actively studied, chatbot systems are being applied to various fields. In particular, many chatbot systems for psychological counseling have been studied that can comfort modern people. However, while most psychological counseling chatbots are studied as rule-base and deep learning-based chatbots, there are large limitations for each chatbot. To overcome the limitations of psychological counseling using such chatbots, we proposes a novel psychological counseling AI chatbot system. The proposed system consists of a GPT-2 model that generates output sentence for Korean input sentences and an Electra model that serves as sentiment analysis and anxiety cause classification, which can be provided with psychological tests and collective intelligence functions. At the same time as deep learning-based chatbots and conversations take place, sentiment analysis of input sentences simultaneously recognizes user's emotions and presents psychological tests and collective intelligence solutions to solve the limitations of psychological counseling that can only be done with chatbots. Since the role of sentiment analysis and anxiety cause classification, which are the links of each function, is important for the progression of the proposed system, we experiment the performance of those parts. We verify the novelty and accuracy of the proposed system. It also shows that the AI chatbot system can perform counseling excellently.

Speaker classification and prediction with language model (언어모델을 활용한 문서 내 발화자 예측 분류 모델)

  • Kim, Gyeongmin;Han, Seunggyu;Seo, Jaehyung;Lee, Chanhee;Lim, Heuiseok
    • Annual Conference on Human and Language Technology
    • /
    • 2020.10a
    • /
    • pp.317-320
    • /
    • 2020
  • 연설문은 구어체와 문어체 두 가지 특성을 모두 갖고 있는 복합적인 데이터 형태이다. 발화자의 문장 표현, 배열, 그리고 결합에 따라 그 구조가 다르기 때문에, 화자 별 갖는 문체적 특성 또한 모두 다르다. 국정을 다루는 정치인들의 연설문은 국정 현황을 포함한 다양한 주요 문제점을 다룬다. 그러면 발화자의 문서 내 문체적 특성을 고려할 경우, 해당 문서가 어느 정치인의 연설문인지 파악 할 수 있는가? 본 연구에서는 대한민국 정책 브리핑 사이트로부터 한국어 기반 사전 학습된 언어 모델을 활용하여 연설문에 대한 미세조정을 진행함으로써 발화자 예측 분류 모델을 생성하고, 그 가능성을 입증하고자 한다. 본 연구는 5-cross validation으로 모델 성능을 평가하였고 KoBERT, KoGPT2 모델에서 각각 90.22%, 84.41% 정확도를 보였다.

  • PDF

A Model to Automatically Generate Non-verbal Expression Information for Korean Utterance Sentence (한국어 발화 문장에 대한 비언어 표현 정보를 자동으로 생성하는 모델)

  • Jaeyoon Kim;Jinyea Jang;San Kim;Minyoung Jung;Hyunwook Kang;Saim Shin
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.91-94
    • /
    • 2023
  • 자연스러운 상호작용이 가능한 인공지능 에이전트를 개발하기 위해서는 언어적 표현뿐 아니라, 비언어적 표현 또한 고려되어야 한다. 본 논문에서는 한국어 발화문으로부터 비언어적 표현인 모션을 생성하는 연구를 소개한다. 유튜브 영상으로부터 데이터셋을 구축하고, Text to Motion의 기존 모델인 T2M-GPT와 이종 모달리티 데이터를 연계 학습한 VL-KE-T5의 언어 인코더를 활용하여 구현한 모델로 실험을 진행하였다. 실험 결과, 한국어 발화 텍스트에 대해 생성된 모션 표현은 FID 스코어 0.11의 성능으로 나타났으며, 한국어 발화 정보 기반 비언어 표현 정보 생성의 가능성을 보여주었다.

  • PDF

QA Pair Passage RAG-based LLM Korean chatbot service (QA Pair Passage RAG 기반 LLM 한국어 챗봇 서비스)

  • Joongmin Shin;Jaewwook Lee;Kyungmin Kim;Taemin Lee;Sungmin Ahn;JeongBae Park;Heuiseok Lim
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.683-689
    • /
    • 2023
  • 자연어 처리 분야는 최근에 큰 발전을 보였으며, 특히 초대규모 언어 모델의 등장은 이 분야에 큰 영향을 미쳤다. GPT와 같은 모델은 다양한 NLP 작업에서 높은 성능을 보이고 있으며, 특히 챗봇 분야에서 중요하게 다루어지고 있다. 하지만, 이러한 모델에도 여러 한계와 문제점이 있으며, 그 중 하나는 모델이 기대하지 않은 결과를 생성하는 것이다. 이를 해결하기 위한 다양한 방법 중, Retrieval-Augmented Generation(RAG) 방법이 주목받았다. 이 논문에서는 지식베이스와의 통합을 통한 도메인 특화형 질의응답 시스템의 효율성 개선 방안과 벡터 데이터 베이스의 수정을 통한 챗봇 답변 수정 및 업데이트 방안을 제안한다. 본 논문의 주요 기여는 다음과 같다: 1) QA Pair Passage RAG을 활용한 새로운 RAG 시스템 제안 및 성능 향상 분석 2) 기존의 LLM 및 RAG 시스템의 성능 측정 및 한계점 제시 3) RDBMS 기반의 벡터 검색 및 업데이트를 활용한 챗봇 제어 방법론 제안

  • PDF

Structured Pruning for Efficient Transformer Model compression (효율적인 Transformer 모델 경량화를 위한 구조화된 프루닝)

  • Eunji Yoo;Youngjoo Lee
    • Transactions on Semiconductor Engineering
    • /
    • v.1 no.1
    • /
    • pp.23-30
    • /
    • 2023
  • With the recent development of Generative AI technology by IT giants, the size of the transformer model is increasing exponentially over trillion won. In order to continuously enable these AI services, it is essential to reduce the weight of the model. In this paper, we find a hardware-friendly structured pruning pattern and propose a lightweight method of the transformer model. Since compression proceeds by utilizing the characteristics of the model algorithm, the size of the model can be reduced and performance can be maintained as much as possible. Experiments show that the structured pruning proposed when pruning GPT-2 and BERT language models shows almost similar performance to fine-grained pruning even in highly sparse regions. This approach reduces model parameters by 80% and allows hardware acceleration in structured form with 0.003% accuracy loss compared to fine-tuned pruning.

Nutritional and Health Status of the Elderly Living in Songnam - I. Anthropometric Measurements and Biochemical Nutritional Status - (성남지역 노인의 영양 및 건강상태 조사 I. 신체 계측 및 생화학적 영양상태)

  • 권종숙;이홍재
    • The Korean Journal of Food And Nutrition
    • /
    • v.16 no.4
    • /
    • pp.310-320
    • /
    • 2003
  • To study the nutritional and health status of the elderly in Songnam, the anthropometic measurments, fat composition of body(FAT), blood pressure(BP) and blood test for analyzing biochemical indies of the elderly in seongnam were carried out in 338 free-living elderly (161 men, 177 women) aged from 58 to 92. Anthropometric measurements and blood pressure were assessed, and body fat was analyzed by BI(Bioelectrical Impedence) method. Biochemical measurements including blood glucose(BG), GPT, serum total cholesterol(TC) and albumin(AL) were analyzed. Average heights of the subjects were lower than the standards established in the Korean Recommended Dietary Allowances, and average weights were similar to the standards. FAT were significantly higher in women(36.4%) than men(27.7%), and both groups showed higher values than the reference. Mean systolic BP levels of men and women were 153.3mmHg and 153.7mmHg, and diastolic BP levels were 87.5mmHg and 86.0mmHg, respectively, and there were no significant differences between the sex. Mean BG levels of men and women were 115.9mg/㎗ and 123.7mg/㎗, respectively, and there were no significant differences between the sex and among the age groups. Mean GPT levels of men and women were 19.4unit and 18.1unit, respectively, and women older than 75 years showed significanly low levels of GPT compared to other women's age groups. Mean TC levels of men and women were 186.0mg/㎗ and 206.6mg/㎗, respectively, and significantly higher TC levels were shown in women than men. Mean AL levels of men and women were 4.8g/㎗ and 4.8g/㎗, respectively, and men aged 50 ∼ 64 years showed significant high AL levels compared to other age groups of men. It was suggested that nutrition education program was a good way to improve health status of the elderly.

Effect of Water Soluble Extract of Lichens on Weights of Various Organs, Blood Components and Activities of Transaminases and 5-Nucleotidase in Rat (지의류(地衣類)의 수용성 추출물이 흰쥐의 각 장기무게, 혈액성분 및 Transaminases와 5-Nucleotidase 활성에 미치는 영향(I))

  • Cho, Ok-Lang;Suh, Jung-Soon;An, Mi-Jung;Lee, In-Ja;Cho, Sung-Hee
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.14 no.2
    • /
    • pp.137-144
    • /
    • 1985
  • In order to evaluate the effect of water soluble extract of lichens (Physcia, Parmelia and Clandonia species) on liver damage, activities transaminase(GPT) and 5'-nucleotidase in serum and liver were measured in rats fed lichens extract. DNA and RNA were measured in liver and spleen, as well as various organ weights and blood components. Control group was fed water to compare with the lichen group. Three sets of experiments were conducted: the first set was done with normal rats, the second one with rats with liver damage induced by $CCl_4$ injection was divided into three subgroups. i.e. no treatment group, pre-treatment group and post-treatment group, and the third one was with rats with acute and chronic liver damage. In normal rats, lichens extract feeding reduced serum GOT and GPT activities. In liver damaged rats, both pre-and post-treatment had suppressing effect against increase of serum enzymes. In rats with acute and chronic liver damage, lichens fed group had lower activities of serum GOT, GPT and 5'-nucleotidase but higher activities of liver enzymes than control group. This effect was more pronounced in rats with acute liver damage. Liver weight increased considerably with lichens intake. Hemoglobin and hematocrit levels were also higher in lichens fed group. Nucleic acid contents in spleen but not in liver were increased in lichens fed group. The latter increase was more significant with chronic liver damage. It is suggested from the present study that water soluble lichens extract play protective and therapeutic roles in organs against infection and atrophic disease.

  • PDF

Onion Favorably Affects Serum Markers of Ethanol-induced Fatty Liver in Rats (흰쥐에서 양파추출물의 알코올성 지방간 개선 작용)

  • Shin, Hye-Kyoung;Seo, Yun-Jung;Kim, Ju-Youn;Kim, Chang-Sun;Noh, Sang-K.
    • Food Science and Preservation
    • /
    • v.14 no.6
    • /
    • pp.662-668
    • /
    • 2007
  • Studies have shown that onions exhibit a wide variety of health-promoting properties. The health benefits by the onion have been attributed to its ability to scavenge free radicals, to reduce blood lipids, to lower blood pressure, and to inhibit platelet aggregation. This study was performed to investigate whether onion extract supplementation would affect the blood markers of ethanol-induced fatty liver in rats. Initially, male Sprague-Dawley rats were housed singly in a room of controlled temperature and lighting and had free access to a nutritionally adequate AIN-93G and deionized water. The rats were trained for meal feeding to prevent a decline in food intake, as inevitably observed following an ethanol feeding. After the training period, rats were weight-matched and assigned to the following three groups: 1) a control group, fed the AIN-93G diet alone (control); 2) an ethanol group, fed the AIN-93G diet with ethanol at 4 g/day/kg body weight (ethanol); and 3) an onion group, fed the AIN-93G diet with ethanol plus supplemental freeze-dried onion powder at 500 mg/day/rat (ethanol + onion). All three group were meal-fed 7.0 g of their respective diets at 0900 h and 7.5 g at 1600 h for 28 days. At 0, 2, and 4 wk, blood was collected via the orbital sinus and organs were collected following overnight food deprivation. Both control and experimental groups continually gained weight throughout the study. No significant differences in the weights of the liver, kidneys, heart, spleen, and testis were observed. However, the serum level of triglycerides was significantly increased by ethanol but significantly decreased by onion extract. The activities of serum glutamate oxaloacetate transaminase (GOT), glutamate pyruvate transaminase (GPT) at 4 wk were significantly increased by ethanol feeding but were significantly decreased by onion supplementation. However, no differences among groups were observed in the serum levels of alkaline phosphatase, gamma-glutamyl transpeptidase, bilirubin, and protein. These results provide that onion extract favorably affect alcoholic fatty liver by decreasing the serum concentration of triglyceride and the activities of GOT and GPT.

Effects of water extract of Paeoniae Radix Alba on a thioacetamide induced acute liver injury rat model (Thioacetamide 유발 급성 간손상 동물모델에 백작약 열수 추출물이 미치는 효능)

  • Lee, Se Hui;Shin, Mi-Rae;Lee, Ji Hye;Roh, Seong-Soo
    • Journal of Nutrition and Health
    • /
    • v.54 no.2
    • /
    • pp.224-237
    • /
    • 2021
  • Purpose: Paeonia Radix Alba is a traditional herbal medicine used to treat the liver and the spleen. Many studies have reported that Paeonia Radix Alba extract (PR) affects liver injury, but there has been no study on liver injuries induced by thioacetamide (TAA). Therefore, we aimed at evaluating the effect of PR on a TAA-induced acute liver injury (ALI) model. Methods: The antioxidant activity of PR was assayed by the content of total polyphenol, total flavonoid, 1,1-diphenyl-2'-picrylhydrazyl (DPPH), and 2,2'-azino-bis (3-ethylbenzo-thiazoline-6-sulfonicacid) (ABTS) radical scavenging activities in vitro test. ALI was induced via-intraperitoneal injection of TAA (200 mg/kg body weight) for three consecutive days. Also, silymarin (100 mg/kg body weight) and PR (100 or 200 mg/kg body weight) were administered at 1 hours 30 minutes prior to TAA treatment. The levels of ammonia, glutamic oxaloacetic transaminase (GOT), and glutamic pyruvic transaminase (GPT) were analyzed using an assay kit. The expressions of antioxidant proteins including Nrf2, Keap1, HO-1, SOD, catalase, and GPx-1/2 and oxidative stress-related proteins including NOX2, p47phox, and p22phox were evaluated by the western blot analysis. Results: PR showed excellent antioxidant activity in vitro. TAA administration increased the levels of ammonia, GOT, and GPT in the ALI control group compared to the normal group, whereas it was significantly reduced by PR pretreatment. Moreover, NADPH oxidase protein expressions were upregulated after TAA treatment, while the elevated expressions were inhibited by PR pretreatment. The expressions of antioxidant protein were downregulated in the ALI control group, whereas Nrf2 activation in the PR group was accompanied by increased levels of antioxidant enzymes. Conclusion: PR administration increased the antioxidant enzymes via activation of the Keap1/Nrf2 pathway and inhibited the protein levels of NADPH oxidase factors. Taken together, these results showed that PR treatment may be considered to ameliorate acute liver injury induced by TAA.