• Title/Summary/Keyword: GPT2

Search Result 768, Processing Time 0.025 seconds

QA Pair Passage RAG-based LLM Korean chatbot service (QA Pair Passage RAG 기반 LLM 한국어 챗봇 서비스)

  • Joongmin Shin;Jaewwook Lee;Kyungmin Kim;Taemin Lee;Sungmin Ahn;JeongBae Park;Heuiseok Lim
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.683-689
    • /
    • 2023
  • 자연어 처리 분야는 최근에 큰 발전을 보였으며, 특히 초대규모 언어 모델의 등장은 이 분야에 큰 영향을 미쳤다. GPT와 같은 모델은 다양한 NLP 작업에서 높은 성능을 보이고 있으며, 특히 챗봇 분야에서 중요하게 다루어지고 있다. 하지만, 이러한 모델에도 여러 한계와 문제점이 있으며, 그 중 하나는 모델이 기대하지 않은 결과를 생성하는 것이다. 이를 해결하기 위한 다양한 방법 중, Retrieval-Augmented Generation(RAG) 방법이 주목받았다. 이 논문에서는 지식베이스와의 통합을 통한 도메인 특화형 질의응답 시스템의 효율성 개선 방안과 벡터 데이터 베이스의 수정을 통한 챗봇 답변 수정 및 업데이트 방안을 제안한다. 본 논문의 주요 기여는 다음과 같다: 1) QA Pair Passage RAG을 활용한 새로운 RAG 시스템 제안 및 성능 향상 분석 2) 기존의 LLM 및 RAG 시스템의 성능 측정 및 한계점 제시 3) RDBMS 기반의 벡터 검색 및 업데이트를 활용한 챗봇 제어 방법론 제안

  • PDF

Structured Pruning for Efficient Transformer Model compression (효율적인 Transformer 모델 경량화를 위한 구조화된 프루닝)

  • Eunji Yoo;Youngjoo Lee
    • Transactions on Semiconductor Engineering
    • /
    • v.1 no.1
    • /
    • pp.23-30
    • /
    • 2023
  • With the recent development of Generative AI technology by IT giants, the size of the transformer model is increasing exponentially over trillion won. In order to continuously enable these AI services, it is essential to reduce the weight of the model. In this paper, we find a hardware-friendly structured pruning pattern and propose a lightweight method of the transformer model. Since compression proceeds by utilizing the characteristics of the model algorithm, the size of the model can be reduced and performance can be maintained as much as possible. Experiments show that the structured pruning proposed when pruning GPT-2 and BERT language models shows almost similar performance to fine-grained pruning even in highly sparse regions. This approach reduces model parameters by 80% and allows hardware acceleration in structured form with 0.003% accuracy loss compared to fine-tuned pruning.

Nutritional and Health Status of the Elderly Living in Songnam - I. Anthropometric Measurements and Biochemical Nutritional Status - (성남지역 노인의 영양 및 건강상태 조사 I. 신체 계측 및 생화학적 영양상태)

  • 권종숙;이홍재
    • The Korean Journal of Food And Nutrition
    • /
    • v.16 no.4
    • /
    • pp.310-320
    • /
    • 2003
  • To study the nutritional and health status of the elderly in Songnam, the anthropometic measurments, fat composition of body(FAT), blood pressure(BP) and blood test for analyzing biochemical indies of the elderly in seongnam were carried out in 338 free-living elderly (161 men, 177 women) aged from 58 to 92. Anthropometric measurements and blood pressure were assessed, and body fat was analyzed by BI(Bioelectrical Impedence) method. Biochemical measurements including blood glucose(BG), GPT, serum total cholesterol(TC) and albumin(AL) were analyzed. Average heights of the subjects were lower than the standards established in the Korean Recommended Dietary Allowances, and average weights were similar to the standards. FAT were significantly higher in women(36.4%) than men(27.7%), and both groups showed higher values than the reference. Mean systolic BP levels of men and women were 153.3mmHg and 153.7mmHg, and diastolic BP levels were 87.5mmHg and 86.0mmHg, respectively, and there were no significant differences between the sex. Mean BG levels of men and women were 115.9mg/㎗ and 123.7mg/㎗, respectively, and there were no significant differences between the sex and among the age groups. Mean GPT levels of men and women were 19.4unit and 18.1unit, respectively, and women older than 75 years showed significanly low levels of GPT compared to other women's age groups. Mean TC levels of men and women were 186.0mg/㎗ and 206.6mg/㎗, respectively, and significantly higher TC levels were shown in women than men. Mean AL levels of men and women were 4.8g/㎗ and 4.8g/㎗, respectively, and men aged 50 ∼ 64 years showed significant high AL levels compared to other age groups of men. It was suggested that nutrition education program was a good way to improve health status of the elderly.

Effect of Water Soluble Extract of Lichens on Weights of Various Organs, Blood Components and Activities of Transaminases and 5-Nucleotidase in Rat (지의류(地衣類)의 수용성 추출물이 흰쥐의 각 장기무게, 혈액성분 및 Transaminases와 5-Nucleotidase 활성에 미치는 영향(I))

  • Cho, Ok-Lang;Suh, Jung-Soon;An, Mi-Jung;Lee, In-Ja;Cho, Sung-Hee
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.14 no.2
    • /
    • pp.137-144
    • /
    • 1985
  • In order to evaluate the effect of water soluble extract of lichens (Physcia, Parmelia and Clandonia species) on liver damage, activities transaminase(GPT) and 5'-nucleotidase in serum and liver were measured in rats fed lichens extract. DNA and RNA were measured in liver and spleen, as well as various organ weights and blood components. Control group was fed water to compare with the lichen group. Three sets of experiments were conducted: the first set was done with normal rats, the second one with rats with liver damage induced by $CCl_4$ injection was divided into three subgroups. i.e. no treatment group, pre-treatment group and post-treatment group, and the third one was with rats with acute and chronic liver damage. In normal rats, lichens extract feeding reduced serum GOT and GPT activities. In liver damaged rats, both pre-and post-treatment had suppressing effect against increase of serum enzymes. In rats with acute and chronic liver damage, lichens fed group had lower activities of serum GOT, GPT and 5'-nucleotidase but higher activities of liver enzymes than control group. This effect was more pronounced in rats with acute liver damage. Liver weight increased considerably with lichens intake. Hemoglobin and hematocrit levels were also higher in lichens fed group. Nucleic acid contents in spleen but not in liver were increased in lichens fed group. The latter increase was more significant with chronic liver damage. It is suggested from the present study that water soluble lichens extract play protective and therapeutic roles in organs against infection and atrophic disease.

  • PDF

Onion Favorably Affects Serum Markers of Ethanol-induced Fatty Liver in Rats (흰쥐에서 양파추출물의 알코올성 지방간 개선 작용)

  • Shin, Hye-Kyoung;Seo, Yun-Jung;Kim, Ju-Youn;Kim, Chang-Sun;Noh, Sang-K.
    • Food Science and Preservation
    • /
    • v.14 no.6
    • /
    • pp.662-668
    • /
    • 2007
  • Studies have shown that onions exhibit a wide variety of health-promoting properties. The health benefits by the onion have been attributed to its ability to scavenge free radicals, to reduce blood lipids, to lower blood pressure, and to inhibit platelet aggregation. This study was performed to investigate whether onion extract supplementation would affect the blood markers of ethanol-induced fatty liver in rats. Initially, male Sprague-Dawley rats were housed singly in a room of controlled temperature and lighting and had free access to a nutritionally adequate AIN-93G and deionized water. The rats were trained for meal feeding to prevent a decline in food intake, as inevitably observed following an ethanol feeding. After the training period, rats were weight-matched and assigned to the following three groups: 1) a control group, fed the AIN-93G diet alone (control); 2) an ethanol group, fed the AIN-93G diet with ethanol at 4 g/day/kg body weight (ethanol); and 3) an onion group, fed the AIN-93G diet with ethanol plus supplemental freeze-dried onion powder at 500 mg/day/rat (ethanol + onion). All three group were meal-fed 7.0 g of their respective diets at 0900 h and 7.5 g at 1600 h for 28 days. At 0, 2, and 4 wk, blood was collected via the orbital sinus and organs were collected following overnight food deprivation. Both control and experimental groups continually gained weight throughout the study. No significant differences in the weights of the liver, kidneys, heart, spleen, and testis were observed. However, the serum level of triglycerides was significantly increased by ethanol but significantly decreased by onion extract. The activities of serum glutamate oxaloacetate transaminase (GOT), glutamate pyruvate transaminase (GPT) at 4 wk were significantly increased by ethanol feeding but were significantly decreased by onion supplementation. However, no differences among groups were observed in the serum levels of alkaline phosphatase, gamma-glutamyl transpeptidase, bilirubin, and protein. These results provide that onion extract favorably affect alcoholic fatty liver by decreasing the serum concentration of triglyceride and the activities of GOT and GPT.

Effects of water extract of Paeoniae Radix Alba on a thioacetamide induced acute liver injury rat model (Thioacetamide 유발 급성 간손상 동물모델에 백작약 열수 추출물이 미치는 효능)

  • Lee, Se Hui;Shin, Mi-Rae;Lee, Ji Hye;Roh, Seong-Soo
    • Journal of Nutrition and Health
    • /
    • v.54 no.2
    • /
    • pp.224-237
    • /
    • 2021
  • Purpose: Paeonia Radix Alba is a traditional herbal medicine used to treat the liver and the spleen. Many studies have reported that Paeonia Radix Alba extract (PR) affects liver injury, but there has been no study on liver injuries induced by thioacetamide (TAA). Therefore, we aimed at evaluating the effect of PR on a TAA-induced acute liver injury (ALI) model. Methods: The antioxidant activity of PR was assayed by the content of total polyphenol, total flavonoid, 1,1-diphenyl-2'-picrylhydrazyl (DPPH), and 2,2'-azino-bis (3-ethylbenzo-thiazoline-6-sulfonicacid) (ABTS) radical scavenging activities in vitro test. ALI was induced via-intraperitoneal injection of TAA (200 mg/kg body weight) for three consecutive days. Also, silymarin (100 mg/kg body weight) and PR (100 or 200 mg/kg body weight) were administered at 1 hours 30 minutes prior to TAA treatment. The levels of ammonia, glutamic oxaloacetic transaminase (GOT), and glutamic pyruvic transaminase (GPT) were analyzed using an assay kit. The expressions of antioxidant proteins including Nrf2, Keap1, HO-1, SOD, catalase, and GPx-1/2 and oxidative stress-related proteins including NOX2, p47phox, and p22phox were evaluated by the western blot analysis. Results: PR showed excellent antioxidant activity in vitro. TAA administration increased the levels of ammonia, GOT, and GPT in the ALI control group compared to the normal group, whereas it was significantly reduced by PR pretreatment. Moreover, NADPH oxidase protein expressions were upregulated after TAA treatment, while the elevated expressions were inhibited by PR pretreatment. The expressions of antioxidant protein were downregulated in the ALI control group, whereas Nrf2 activation in the PR group was accompanied by increased levels of antioxidant enzymes. Conclusion: PR administration increased the antioxidant enzymes via activation of the Keap1/Nrf2 pathway and inhibited the protein levels of NADPH oxidase factors. Taken together, these results showed that PR treatment may be considered to ameliorate acute liver injury induced by TAA.

Effects of Supplemention of Rehmannia radix on Performance and Physiological Status in Broiler Chicks (건지황 첨가가 육계의 성장과 생리적 변화에 미치는 영향)

  • 박성진;박희성;유성오
    • Korean Journal of Poultry Science
    • /
    • v.25 no.4
    • /
    • pp.195-202
    • /
    • 1998
  • The present study was conducted to investigate the effects of dietary supplemental dry powder of Rehmannia radix (RR) root on the growth performance and physiological status of broiler chicks. The treatments consisted of corn-soybean meal control diet, and RR 0.5, 1, and 2% diets. A total of 160 Arbor Acre male broiler chicks were randomly allotted to 16 pens ; four pens per treatment and 10 birds per pen. The growth performance, feed intake and carcass weight did not show any differences among the treatment groups, but feed conversion was significantly lower (P< 0.05) in RR 1% group than that of the control group. The muscle color was lighter (P < 0.05) in RR lof group than those of the other treatment groups. The blood concentrations of protein, glutamic-oxaloacetic-transaminase (GOT) and glutamic- pyruvic-transaminase (GPT) were not different (P > 0.05) among the treatment groups, but the blood total cholesterol content was significantly decreased (P < 0.05) in RR 2% group than those the other treatment groups. The blood concentration of sugar was lower (P <0.05) in RR 2% group than those of the other treatment groups, and hemoglobin concentration was decreased (P <0.05) by addition RR. Crude fat content of thigh muscle was higher in RR 1% group than those of the other treatment groups, and bone hardness of broiler chicks fed RR was higher (P < 0.05) than that of the control group. The saturated fatty acid content of the thigh muscle tende to be high in control and RR 0.5% groups, and unsaturated fatty acid content tende to be high in RR 1 and 2% groups than those of the other treatment groups

  • PDF

Protective Effects of a Composite Preparation (Samulchungkan-Tang) of Crude Drugs on Hepatic Injury Induced by Toxic Drugs in Rats (생약복합제제(生藥複合製劑)(사물청간장(四物淸肝腸))의 흰쥐 약물성(藥物性) 간(肝) 장해(障害)에 대한 보호작용(保護作用))

  • Um, Kie-Jin;Chung, Myung-Hyun
    • Korean Journal of Pharmacognosy
    • /
    • v.26 no.4
    • /
    • pp.390-410
    • /
    • 1995
  • This study was attempted to investigate the effects of Composite Preparation (Samulchungkan-Tang) extract (SCTE), Scutellarias Radix extract (SRE), Artemisiae iwayomogii Herba extract (AIHE), Artemisia capillaris Flos extract (ACFE), Paeaniae Radix extract (PRE) and Gardeniae Fructus extract (GFE) on the activities of GOT, GPT, ALP and LDH, and Content of total cholesterol in serum of $CCl_4$ and ${_D}-galactosamime$ intoxicated rats, and bile flow in rats. 1) In $CCl_4-intoxicated$ rats-The activities of S-GOT and S-GPT which were elevated by $CCl_4$ were significantly decreased in dose of SCTE 450 mg/kg, ACFE 600 mg/kg and GFE 300 mg/kg, respectively as compared to $CCl_4$ intoxicated rats. ALP activity increased by $CC1_4-treatment$ was markedly decreased in dose of SCTE 450 mg and 600 mg/kg, SRE 400 mg/kg, AIHE 400 mg/kg, ACFE 600 mg/kg and PRE 300 mg/kg, and LDH activity in SCTE 450 mg and 600 mg/kg, ACFE 600 mg/kg and GFE 300 mg/kg, respectively compared to $CCl_4$ treated rates. ACFE 400 mg/kg and PRE 300 mg/kg decreased the content of total cholesterol increased by $CCl_4$, the liver weight in all sample administered groups was decreased significantly as compared to $CCl_4$ treated groups. 2) In ${_D}-galactosamine$ intoxicated rats-Sample of SCTE 450 mg and 600 mg/kg, SRE 400 mg/kg, AIHF 400 mg and 600 mg/kg, ACFE 600 mg/kg, PRE 300 mg/kg and GFE 300 mg and 500 mg/kg decreased the activities of S-GPT, ALP and LDH which was increased by ${_D}-galactosamine$ intoxication, compared to ${_D}-galactosamine$ intoxicated groups. In S-GOT activity elevated by ${_D}-galactosamine$ was significantly decreased by SCTE 450 mg/kg, ACFE 600mg/kg, AIHE 600 mg/kg, PRE 300 mg/kg, GFE 300 mg and 500 mg/kg. However, SCTE 600 mg/kg, SRE 400 mg/kg, and AIHE 400 mg/kg were not effected significantly. 3) In bile secretion-SCTE 450 mg and 600 mg/kg, ACFE 600 mg/kg and GFE 500mg/kg increased significantly the amount of bile secretion as compared to normal groups, but AIHE 400 mg/kg, SRE 400 mg/kg, and PRE 300 mg/kg did not effected significantiy.

  • PDF

The effects of Samduhaejungtang-gamibang on liver injury of rats induced by $CCl_4$ and d-Galactosamine (삼두해정탕가미방이 $CCl_4$ 및 d-Galactosamine에 依하여 誘發된 흰쥐의 肝損傷에 미치는 影響)

  • Kang, Jae-Chun;Lee, Sang-Min
    • The Journal of Internal Korean Medicine
    • /
    • v.20 no.1
    • /
    • pp.181-197
    • /
    • 1999
  • In order to investigate the protective effect of Samduhaejungtang-gamibang on the liver injury of rats induced by $CCl_4$ and d-galactosamine, the serum transaminase(GOT& GPT) alkaline phosphatase(ALP), lactic dehydrogenase(LDH) for enzyme activities and triglyceride, total bilirubin amounts for serum component were measured. All animals were divided into 4 groups, those were normal group(untreated), control group(treated with vehicle 0.9% Saline solution), sample Ⅰ group(1500mg/kg administrated), sample Ⅱ group(3000mg/kg administrated). The results were as follows: 1. The inhibitory effects of the serum GOT activities in rats induced by $CCl_4$ were noted in sample Ⅱ group(p<0.01). In serum GPT activities, sample Ⅱ group(p<0.05) only showed the inhibitory effects. 2. The inhibitory effects of the serum ALP activities in rats induced by $CCl_4$ were noted in sample Ⅱ group(p<0.01) 3. The inhibitory effects of the serum LPH activities in rats induced by $CCl_4$ were noted in sample Ⅱ group, but it is not recognized statistically. 4. The increases effects of the serum triglyceride content level in rats induced by $CCl_4$ were inhibited in both sample Ⅰ group(p<0.05) and sample Ⅱ group(p<0.01) 5. The increases effects of the serum total bilirubin content level in rats induced by $CCl_4$ were inhibited in sample Ⅱ group(p<0.05) 6. The inhibitory effects of the serum GOT, GPT activities in rats induced by d-galactosamine were noted in sample Ⅱ group (p<0.001), but sample Ⅰ group was not recognized. 7. The signiticantly inhibitory effects of in the serum LDH activities in rats induced by d-galactosamine were noted in both sample Ⅰ group(p<0.05) and sample Ⅱ group (p<0.001) 8. The increases of the serum ALP content level in rats induced by d-galactosamine were inhibited in sample Ⅱ group(p<0.05) 9. The increases of the serum total bilirubin content level in rats induced d-galactosamine were inhibited in sample Ⅱgroup(p<0.05) According to the above results, it is considered that Samduhaejungtang-gamibang has protective effect against liver injury in rats induced by $CCl_4$ and d-galactosamine. So it is required to study about the actions of mutual relation of medicines and patho-mechanism by experiment.

  • PDF

Protective Effects of Mesangi (Capsosiphon fulvecens) on Hepatotoxicity in Carbon Tetrachloride (CCI4)-Intoxicated Rats (매생이가 사염화탄소로 유발된 흰쥐의 간손상에 미치는 영향)

  • Kwon, Mi-Jin;Nam, Taek-Jeong
    • Journal of Life Science
    • /
    • v.16 no.5
    • /
    • pp.734-739
    • /
    • 2006
  • This study investigated the hepatoprotective effects of mesangi (Capsosiphon fulvecens) in carbon tetrachloride $(CCI_4)$-induced liver injury. Thirty healthy male Sprague-Dawley rats were divided into three groups : the normal (Normal), $CCI_4$-treated $(CCI_4)$, and mesangi-treated (Exp-CF) groups. Administration of $CCI_4$ increased the levels of GOT, GPT, and LDH in serum, while the levels were significantly decreased by the addition of mesangi. Higher levels of HDL-cholesterol were found in the Normal and Exp-CF groups, which has lower levels of total and LDL-cholesterol. Administration of $CCI_4$ also increased IGFBP-1 expression in serum, but it was decreased in the Exp-CF group. This suggests that $CCI_4$ is involved in the change in IGFBP-1 expression via its hepatotoxicity. The results indicate that mesangi has a hepatoprotective effect in rats given $CCI_4$.