• Title/Summary/Keyword: corpora

Search Result 249, Processing Time 0.024 seconds

CRNN-Based Korean Phoneme Recognition Model with CTC Algorithm (CTC를 적용한 CRNN 기반 한국어 음소인식 모델 연구)

  • Hong, Yoonseok;Ki, Kyungseo;Gweon, Gahgene
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.8 no.3
    • /
    • pp.115-122
    • /
    • 2019
  • For Korean phoneme recognition, Hidden Markov-Gaussian Mixture model(HMM-GMM) or hybrid models which combine artificial neural network with HMM have been mainly used. However, current approach has limitations in that such models require force-aligned corpus training data that is manually annotated by experts. Recently, researchers used neural network based phoneme recognition model which combines recurrent neural network(RNN)-based structure with connectionist temporal classification(CTC) algorithm to overcome the problem of obtaining manually annotated training data. Yet, in terms of implementation, these RNN-based models have another difficulty in that the amount of data gets larger as the structure gets more sophisticated. This problem of large data size is particularly problematic in the Korean language, which lacks refined corpora. In this study, we introduce CTC algorithm that does not require force-alignment to create a Korean phoneme recognition model. Specifically, the phoneme recognition model is based on convolutional neural network(CNN) which requires relatively small amount of data and can be trained faster when compared to RNN based models. We present the results from two different experiments and a resulting best performing phoneme recognition model which distinguishes 49 Korean phonemes. The best performing phoneme recognition model combines CNN with 3hop Bidirectional LSTM with the final Phoneme Error Rate(PER) at 3.26. The PER is a considerable improvement compared to existing Korean phoneme recognition models that report PER ranging from 10 to 12.

Anti-inflammatory effects of Lespedeza Cuneata in vivo and in vitro (야관문(夜關門)의 항염증효과(抗炎症效果))

  • Lee, Hoil;Jung, Ji Yun;Hwangbo, Min;Ku, Sea Kwang;Kim, Young Woo;Jee, Seon Young
    • The Korea Journal of Herbology
    • /
    • v.28 no.4
    • /
    • pp.83-92
    • /
    • 2013
  • Objectives : Lespedeza Cuneata has been used to treat leukorrhea, asthma, stomach pain, diarrhea, acute mastitis, in Korean traditional medicine. According to recent studies, Lespedeza Cuneata has antioxidation, hypoglycemia, cell protective, insulin secretion, whitening, corpora cavernosa smooth muscle relaxation and antimicrobial activities, but it has been rarely conducted to evaluate the immuno-biological activity. The present study was examined to evaluate the anti-inflammatory effects of the Lespedeza Cuneata MeOH extract (LCE) in vivo and in vitro. Methods : In vitro, inflammatory mediators, such as cytokines, nitric oxide and prostaglandin $E_2$ were detected after the addition of LPS with or without LCE in Raw 264.7 macrophage cell line. In vivo, anti-edema effect of LCE was determined in the carrageenan-induced paw edema model in rats. Results : In vitro assay, LCE decreased release of nitric oxide (NO) and prostaglandin $E_2$ ($PGE_2$) via suppression of iNOS and COX-2 expression. LCE inhibited the phosphorylation of $I{\kappa}B$ indicating the suppression of NF-${\kappa}B$ pathway. In vivo assay, LCE significantly inhibited the formation of paw edema induced by carrageenan injection in rats. LCE effectively inhibited increases of hind paw skin thickness and inflammatory cell infilterations. Conclusion : These findings demonstrate that LCE has inhibitory effect on inflammatory mediators in LPS-activated Raw 264.7 cells and on paw edema in carrageenan-stimulated rats, showing the possibility of anti-inflammatory use of Lespedeza Cuneata.

The Error Pattern Analysis of the HMM-Based Automatic Phoneme Segmentation (HMM기반 자동음소분할기의 음소분할 오류 유형 분석)

  • Kim Min-Je;Lee Jung-Chul;Kim Jong-Jin
    • The Journal of the Acoustical Society of Korea
    • /
    • v.25 no.5
    • /
    • pp.213-221
    • /
    • 2006
  • Phone segmentation of speech waveform is especially important for concatenative text to speech synthesis which uses segmented corpora for the construction of synthetic units. because the quality of synthesized speech depends critically on the accuracy of the segmentation. In the beginning. the phone segmentation was manually performed. but it brings the huge effort and the large time delay. HMM-based approaches adopted from automatic speech recognition are most widely used for automatic segmentation in speech synthesis, providing a consistent and accurate phone labeling scheme. Even the HMM-based approach has been successful, it may locate a phone boundary at a different position than expected. In this paper. we categorized adjacent phoneme pairs and analyzed the mismatches between hand-labeled transcriptions and HMM-based labels. Then we described the dominant error patterns that must be improved for the speech synthesis. For the experiment. hand labeled standard Korean speech DB from ETRI was used as a reference DB. Time difference larger than 20ms between hand-labeled phoneme boundary and auto-aligned boundary is treated as an automatic segmentation error. Our experimental results from female speaker revealed that plosive-vowel, affricate-vowel and vowel-liquid pairs showed high accuracies, 99%, 99.5% and 99% respectively. But stop-nasal, stop-liquid and nasal-liquid pairs showed very low accuracies, 45%, 50% and 55%. And these from male speaker revealed similar tendency.

Roles of Spleen Cells in the Regulation of Progesterone and IGF -I Secretion in the Hanwoo Luteal Cells (한우 황체세포의 Progesterone 및 IGF-I 분비에 대한 비장세포의 역할)

  • 성환후;민관식;박진기;박성재;양병철;이장형;장원경
    • Korean Journal of Animal Reproduction
    • /
    • v.23 no.2
    • /
    • pp.105-111
    • /
    • 1999
  • The effects of exogenous spleen cells on the progesterone and insulin like-growth factor-I (IGF-I) secretions in luteal cells were studied by using in vitro luteal cell culture system in the Hanwoo luteal cells. The corpora lutea(CL) were collected and pooled from the Korean native cattle(Hanwoo) ovaries from a local slaughter house. After enzymatic dissociation, combined large and small luteal cells(LLC and SLC)(1.0$\times$10$^{6}$ cells/$m\ell$) were incubated in D-MEM media containing antibiotics and 10% FCS. Spleen cells (1.0$\times$10$^{6}$ cells/$m\ell$) obtained from castrated adult male Hanwoo were added to luteal cells and co-cultured for 24 h in the absence or presence of luteinizing hormone (LH) (100 ng). Progesterone contents from luteal tissues were increased at CL-3 stage during each stage of estrous cycle. Progesterone secretion from luteal cell culture by the presence of LH (100 ng/$m\ell$) was positively stimulated compared with control. However, progesterone secretion was not changed by the addition of 5, 10 and 20% of spleen cells in the absence of LH. Co-culture of luteal cells with 10% of spleen cells in the presence of LH(l00ng/$m\ell$) significantly. enhanced after 24 h of culture. IGF-Isecretion from in vitro luteal cells co-culture by the addition of spleen cells (5%, 10% and 20%) was not significantly effected. Besides, in the presence of LH (100ng/$m\ell$), IGF-Isecretions from luteal cells by addition of spleen cells were higher than control media. However, LH alone significantly increased IGF-I secretion at 24 h of culture. These data provide the demonstrate that spleen cells can enhance LH action so as to stimulate progesterone secretion from Hanwoo luteal cells but have no effect to stimulate IGF-I secretion.

  • PDF

Effect of Genistein on the Onset of Puberty in Female Rats (암컷 흰쥐의 사춘기 개시에 미치는 Genistein의 효과)

  • Lee, Kyeung-Yeup;Lee, Sung-Ho
    • Development and Reproduction
    • /
    • v.10 no.1
    • /
    • pp.55-61
    • /
    • 2006
  • There is growing concern that dietary soy intake is associated with protection of breast cancer. However, questions persist on the potential adverse effects of the main soy constituent genistein(GS) on female reproductive physiology. In this study, we examined whether prepubertal exposure to GS affected on the onset of puberty and the associated reproductive parameters such as hormone receptor expressions in female rats. GS(100mg/kg/day) was administrated daily from postnatal day 25(PND 25) to the day when the first vaginal opening(VO) was observed, and the animals were sacrificed on the day after VO occurred. Gross anatomy and tissue weight were compared to test the GS's effect on the cell proliferation. Furthermore, histological studies were performed to assess the structural alterations in tissues. Specific radioimmunoassay(RIA) were carried out to measure serum LH levels. To determine the transcriptional changes in progesterone receptors(PR), total RNAs were extracted from ovary and uterus and were applied to semi-quantitative reverse transcription polymerase chain reaction(RT-PCR). As a results, advanced VO was shown in the GS group(PND $31.2{\pm}0.6$) compared to the vehicle group (PND $35.3{\pm}0.7$). GS treatment significantly increased wet weight of ovaries and uteri compared to the vehicle group. Increased serum LH levels were also shown in the GS group. Graafian follicles and corpora lutea(CL) were observed only in the ovaries from GS treated animals. Similarly, hypertrophy of luminal and glandular uterine epithelium were found only in the GS group. Collectively, these effects were probably due to the estrogenic effects of GS. In the semi-quantitative RT-PCR studies, the transcriptional activities of PR in both ovary and uterus from GS-treated group were significantly higher than those from the vehicle group. The present studies demonstrated that acute exposure to GS, at levels comparable to the ranges of human exposure, during the critical period of prepubertal stage activates the reproductive system resulting precocious puberty in immature female rats.

  • PDF

Effect of Di(2-ethyl hexyl)phthalate(DEHP) on the Onset of Puberty in Female Rat (암컷 흰쥐의 사춘기 개시에 미치는 di(2-ethyl hexyl)phthalate(DEHP)의 효과)

  • Lee, Kyeung-Yeup;Lee, Sung-Ho
    • Development and Reproduction
    • /
    • v.10 no.2
    • /
    • pp.147-154
    • /
    • 2006
  • Phthalates such as di(2-ethyl hexyl)phthalate(DEHP) are industrial chemicals with wide-ranging human exposures because of their use in plastics and other common consumer products. Consequently, their adverse effects as endocrine disruptor in the reproductive physiology of both laboratory rodents and human have been studied extensively. The present study was undertaken to examine whether prepubertal exposure to DEHP affects on the onset of puberty and the associated reproductive parameters such as hormone receptor expressions in female rats. DEHP(100mg/kg/day) was administered daily from postnatal day 25(PND 25) through the day when the first vaginal opening(VO) was observed, and the animals were sacrificed on the next day. Gross anatomy and weight of reproductive tissues were compared to test the DEHP's effects on the cell proliferation. Furthermore, histological studies were performed to assess the structural alterations in the tissues. Specific radioimmunoassay was carried out to measure serum LH levels. To determine the transcriptional changes in progesterone receptor(PR), total RNAs were extracted and applied to the semi-quantitative reverse transcription polymerase chain reaction(RT-PCR). As a result, delayed VO was shown in the DEHP group(PND $37.3{\pm}0.7$) compared to the control group(PND $35.3{\pm}0.7$; p<0.05). DEHP treatment significantly decreased the wet weight of ovaries and uteri compared to the control group(p<0.05). Interestingly, elevation of serum LH levels was shown in the DEHP group(p<0.05). Graafian follicles and corpora lutea were observed only in the ovaries from the control animals. Numerous primary, secondary follicles and small atretic follicles were observed in the ovaries from DEHP-treated animals. Similarly, hypotrophy of luminal and glandular uterine epithelium was found in the DEHP-treated group. These effects were probably due to the inhibitory effects of DEHP on the synthesis and secretion of estrogen from granulosa cells. In the semiquantitative RT-PCR studies, the transcriptional activities of PR in both ovary(p<0.05) and uterus(p<0.01) from DEHP-treated animals were significantly lower than those from the control animals. The present studies demonstrated that the acute exposure to DEHP during the critical period of prepubertal stage could inactivate the reproductive system resulting delayed puberty in female rats.

  • PDF

Effect of Vinclozolin on the Onset of Puberty in Immature Female Rats (미성숙 암컷 흰쥐의 사춘기 개시에 미치는 Vinclozolin의 영향)

  • An, Na-Kyung;Lee, Sung-Ho
    • Development and Reproduction
    • /
    • v.11 no.3
    • /
    • pp.245-251
    • /
    • 2007
  • Vinclozolin(VCZ), a systemic dicarboximide fungicide, has been used in the control of diseases caused by microorganism of some species in fruits, vegatables and ornamental plants. Although VCZ itself is a very weak antagonist for androgen receptor binding, both melabolites M1 and M2 are effective antagonists. The present study was undertaken to examine whether prepubertal exposure to VCZ affects on the onset of puberty and the associated reproductive parameters such as hormone receptor expressions in female rats. VCZ(10 mg/kg/day) was administered daily from postnatal day 21(PND 21) through the day when the first vaginal opening(V.O.) was observed. Gross anatomy and weight of reproductive tissues were compared to test the VCZ's effects on the cell proliferation. Furthermore, histological studies were performed to assess the structural alterations in the tissues. To determine the transcriptional changes in progesterone receptor(PR), total RNAs were extracted and applied to the semi-quantitative reverse transcription polymerase chain reaction(RT-PCR). As a result, delayed V.O. was shown in the VCZ group(PND $34.00{\pm}1.22$) compared to the control group(PND $38.20{\pm}1.92$; p<0.01). VCZ treatment significantly decreased the wet weight of ovaries and uteri compared to the control group(p<0.01). Graafian follicles and corpora lutea were observed only in the ovaries from the control animals, while numerous primary, secondary follicles and small atretic follicles were observed in the ovaries from VCZ group. Similarly, hypotrophy of luminal and glandular uterine epithelium was found in the VCZ group. In the semi-quantitative RT-PCR studies, the transcriptional activity of PR in ovary(p<0.01) from VCZ group were significantly lower than those from the control group while in uterus were similar compared with the control group. The present studies demonstrated that the acute exposure to VCZ during the critical period of prepubertal stage could inactivate the reproductive system resulting delayed puberty in female rats.

  • PDF

Effects of Removal Times of Transplanted Pituitary Gland on Induction of Ovulation and Levels of Estrogen and Progesterone in Immature Rats (미성숙 쥐에 이식한 뇌하수체의 경시별제거가 배란유도와 Estrogen 및 Progesterone수준에 미치는 영향)

  • Lee, J. H.;Kim, Y. H.;Lee, W.
    • Journal of Embryo Transfer
    • /
    • v.2 no.1
    • /
    • pp.36-46
    • /
    • 1987
  • The present work was designed to understand the mechanism of superovuiation and the cause of early embryo loss and Implantation failure in the superovulating immature female rats which were elaborated by a pituitary gland transplantation. A pituitary gland obtained from the orchidectomized rats was transplanted under the right kidney capsule of 28 day old female rats (PGT group) on the starting day of experiment which was designated as Day 2. The grafted pituitary glands were removed at 6h (RPGT 6h group), 12h (RPGT 12hgroup) and 24h (RPGT 24h group) after the transplantation. Control rats were treated with 41U PMSG on Day 2 (PMSG group). The estrous cycle and the levels of plasma progesterone and estradiol-17$\beta$ were observed on Day 0, Day 5, respectively. The implantation sites, the weights of ovary and uterus, and the number of corpora lutea were examined in all group on Day 8. The resuft obtained were summarized as follows: 1. The percentages of the number of the rats in proestrus and estrus were 93.0%, 82.6%, 0%, 90.7% and 89.5% in PMSG, PGT, RPGT6h, RPGT12h and RPGT24h group, respectively. The synchronization of estrus cycle was dchieved in all groups. 2. The mating rates of each group were 80.2, 75.0, 0, 56.4, 57.8% in PMSG, PGT, RPGT6h, RPGT12h, RPGT24h group, respectively. 3. The numbers of copora lutea on Day 8 were 47.1 i 4.9, 18.1 $\pm$0.5, 14.1 i 0.3 and 8.9 $\pm$ 0.3 in PGT, RPGT24h, RPGTl2h and PMSG group, respectively. There were signIficantly difference between all groups (P<0.05). 4. The numbers of implantation sites (18.1 +- 4.0) in PGT group on Day 8 were higher than those of PMSG (8.5 $\pm$ 2.5), RPGT 12h (9.8 i 0.2) and RPGT 24h group (10.8 i 0.2) (P<0.05). 5. The ovarlan weights in PGT (95.2 $\pm$ 14.3mgIlOOg BW), RPGT 12h (51.7 $\pm$ 0.6mgIlOOg BW), and RPGT24h (57.9 $\pm$ 0.9mg/l00g 8W) groups were significantly higher than those of PMSG group (30.4 $\pm$7.4mg/l00g BW) (P<0.05). 6. The uterine weights in PMSG (672.4 $\pm$ 4.7mg/l00g 8W), and PGT (660.7 $\pm$7.8mg/l00g BW) groupswere greater than those of RPGT 12h (403.0 $\pm$ 1.lmg/lOOg BW) and RPGT 24h (490.1 $\pm$ 0.9mg/l00g BW) group (P<0.05). 7. The plasma progesterone levels in PGT groups (15 lng/ml) on Day 5 were higher than those of PMSG (83ng/ml), RPGT 12h (S7ng/ml), RPGT24h (8lng/ml) group (P<0.05). 8. The plasma estradiol-17$\beta$ levels in PMSG group (lBSpg/ml) on Day S were higher than those of RPGT 24h (l3pg/ml) group (P<0.05). But estradiol-17$\beta$ levels in PGT and RPGT 12h group were too low to discuss.

  • PDF

KB-BERT: Training and Application of Korean Pre-trained Language Model in Financial Domain (KB-BERT: 금융 특화 한국어 사전학습 언어모델과 그 응용)

  • Kim, Donggyu;Lee, Dongwook;Park, Jangwon;Oh, Sungwoo;Kwon, Sungjun;Lee, Inyong;Choi, Dongwon
    • Journal of Intelligence and Information Systems
    • /
    • v.28 no.2
    • /
    • pp.191-206
    • /
    • 2022
  • Recently, it is a de-facto approach to utilize a pre-trained language model(PLM) to achieve the state-of-the-art performance for various natural language tasks(called downstream tasks) such as sentiment analysis and question answering. However, similar to any other machine learning method, PLM tends to depend on the data distribution seen during the training phase and shows worse performance on the unseen (Out-of-Distribution) domain. Due to the aforementioned reason, there have been many efforts to develop domain-specified PLM for various fields such as medical and legal industries. In this paper, we discuss the training of a finance domain-specified PLM for the Korean language and its applications. Our finance domain-specified PLM, KB-BERT, is trained on a carefully curated financial corpus that includes domain-specific documents such as financial reports. We provide extensive performance evaluation results on three natural language tasks, topic classification, sentiment analysis, and question answering. Compared to the state-of-the-art Korean PLM models such as KoELECTRA and KLUE-RoBERTa, KB-BERT shows comparable performance on general datasets based on common corpora like Wikipedia and news articles. Moreover, KB-BERT outperforms compared models on finance domain datasets that require finance-specific knowledge to solve given problems.