Korean Sentence Generation Using Phoneme-Level LSTM Language Model (한국어 음소 단위 LSTM 언어모델을 이용한 문장 생성)
-
- Journal of Intelligence and Information Systems
- /
- v.23 no.2
- /
- pp.71-88
- /
- 2017
Language models were originally developed for speech recognition and language processing. Using a set of example sentences, a language model predicts the next word or character based on sequential input data. N-gram models have been widely used but this model cannot model the correlation between the input units efficiently since it is a probabilistic model which are based on the frequency of each unit in the training set. Recently, as the deep learning algorithm has been developed, a recurrent neural network (RNN) model and a long short-term memory (LSTM) model have been widely used for the neural language model (Ahn, 2016; Kim et al., 2016; Lee et al., 2016). These models can reflect dependency between the objects that are entered sequentially into the model (Gers and Schmidhuber, 2001; Mikolov et al., 2010; Sundermeyer et al., 2012). In order to learning the neural language model, texts need to be decomposed into words or morphemes. Since, however, a training set of sentences includes a huge number of words or morphemes in general, the size of dictionary is very large and so it increases model complexity. In addition, word-level or morpheme-level models are able to generate vocabularies only which are contained in the training set. Furthermore, with highly morphological languages such as Turkish, Hungarian, Russian, Finnish or Korean, morpheme analyzers have more chance to cause errors in decomposition process (Lankinen et al., 2016). Therefore, this paper proposes a phoneme-level language model for Korean language based on LSTM models. A phoneme such as a vowel or a consonant is the smallest unit that comprises Korean texts. We construct the language model using three or four LSTM layers. Each model was trained using Stochastic Gradient Algorithm and more advanced optimization algorithms such as Adagrad, RMSprop, Adadelta, Adam, Adamax, and Nadam. Simulation study was done with Old Testament texts using a deep learning package Keras based the Theano. After pre-processing the texts, the dataset included 74 of unique characters including vowels, consonants, and punctuation marks. Then we constructed an input vector with 20 consecutive characters and an output with a following 21st character. Finally, total 1,023,411 sets of input-output vectors were included in the dataset and we divided them into training, validation, testsets with proportion 70:15:15. All the simulation were conducted on a system equipped with an Intel Xeon CPU (16 cores) and a NVIDIA GeForce GTX 1080 GPU. We compared the loss function evaluated for the validation set, the perplexity evaluated for the test set, and the time to be taken for training each model. As a result, all the optimization algorithms but the stochastic gradient algorithm showed similar validation loss and perplexity, which are clearly superior to those of the stochastic gradient algorithm. The stochastic gradient algorithm took the longest time to be trained for both 3- and 4-LSTM models. On average, the 4-LSTM layer model took 69% longer training time than the 3-LSTM layer model. However, the validation loss and perplexity were not improved significantly or became even worse for specific conditions. On the other hand, when comparing the automatically generated sentences, the 4-LSTM layer model tended to generate the sentences which are closer to the natural language than the 3-LSTM model. Although there were slight differences in the completeness of the generated sentences between the models, the sentence generation performance was quite satisfactory in any simulation conditions: they generated only legitimate Korean letters and the use of postposition and the conjugation of verbs were almost perfect in the sense of grammar. The results of this study are expected to be widely used for the processing of Korean language in the field of language processing and speech recognition, which are the basis of artificial intelligence systems.
This study was conducted to investigate the effects of domestic clay minerals on feed efficiency, meat quantity, meat quality and economic traits in 24 head of Hanwoo steers(166.1kg in body weight) for 540 days from six to 24 months in age. Feeding trial was conducted with 4 treatment(six heads/treatment) which were T1(Control), T2(Control+Kaolinite), T3(Control+Bentonite), T4(Control+Illite). The results obtained are summarized as follows; The range of average daily gains were 0.682 to 0.713, 0.669 to 0.714, 0.690 to 0.840 and 0.699 to 0.756kg in growing, fattening, finishing and over-all period, respectively, and the gains were high in T1 for growing and fattening period but in clay mineral groups for finishing and over-all period, especially it was high in Illite and Bentonite groups. Concentrates and TDN intakes per unit of kg gains were lower in clay mineral groups than in control and was lower especially in Bentonite groups. In carcass characteristics, dressed carcass and fresh meat and retailed cut percent were not apparently difference by treatments, and yield index was 69.3, 68.9, 68.8 and 68.6 in T3, T2, T4 and T1, respectively. Marbling scores were 5.1, 4.6, 4.4 and 3.3 in T3, T2, T4 and T1, respectively, and the range of shear force by treatment was from 3.51 to 6.02kg/cm2. and were improved with significant difference(P<0.05) in clay mineral groups than in control. Also in palatability traits, panel test scores of juiciness, tenderness and flavor were improved in clay mineral feeding groups, especially the flavor was improved with highly significant difference(P<0.01) in clay mineral groups than in control. In total fatty acid contents, the rate of SFA(saturated fatty acid) in longissimus muscle of beef was higher in the order of T2, T3, T1 and T4 while the rate of MUFA(monounsaturated fatty acid) was high in the order of T4, T3, T1 and T2. The content of oleic acid which is major influential factor at the flavor of beef was higher in Illite groups than in any other groups. In composition of amino acids in longissimus muscles of beef, the rate of essential amino acids was high in the order of T1, T2, T3 and T4. and the rate of amino acids in clay mineral groups was smaller than in control.In chemical component in Gom-Tang(soup of bone) made by Hanwoo steer’s leg-bone, the ranges of crude protein, ether extract, and crude ash was 0.81 to 1.24, 0.17 to 0.35 and 0.07 to 0.09%, respectively. In mineral composition, the ranges of Ca, P, Na and Mg was 14.01 to 15.77, 11.45 to 16.40, 37.92 to 49.99 and 0.26 to 0.46ppm, respectively. Chemical composition were not apparently different but mineral composition was increased in clay mineral groups than in control. Income by treatments was 967,096 to 1,524,055 Won per head for 540 days and income of clay mineral groups in comparison with control’s increased by 23.7 to 57.6 percent, and especially it was higher in bentonite and(or) Illite groups than others. According to the above results it may be concluded that clay mineral to growing-fattening Hanwoo steers can be improved the meat quantity, meat quality and income. Especially the effect of bentonite and illite is large and can be recommended for usage to improve animal performance as feed additives of growing-fattening Hanwoo steers.
The Boziguoer A-type granitoids in Baicheng County, Xinjiang, belong to the northern margin of the Tarim platform as well as the neighboring EW-oriented alkaline intrusive rocks. The rocks comprise an aegirine or arfvedsonite quartz alkali feldspar syenite, an aegirine or arfvedsonite alkali feldspar granite, and a biotite alkali feldspar syenite. The major rock-forming minerals are albite, K-feldspar, quartz, arfvedsonite, aegirine, and siderophyllite. The accessory minerals are mainly zircon, pyrochlore, thorite, fluorite, monazite, bastnaesite, xenotime, and astrophyllite. The chemical composition of the alkaline granitoids show that
Statement of problems: Stress analysis on implant components of the combined screw- and cement-retained implant prosthesis has not investigated yet. Purpose: The purpose of this study was to assess the load distribution characteristics of implant prostheses with the different prosthodontic retention types, such as cement-type, screw-type and combined type by using 3-dimensional finite element analysis. Material and methods: A 3-dimensional finite element model was created in which two SS II implants (Osstem Co. Ltd.) were placed in the areas of the first premolar and the first molar in the mandible, and three-unit fixed partial dentures with four different retention types were fabricated on the two SS II implants. Model 1 was a cement-retained implant restoration made on two cement-retained type abutments (Comocta abutment; Osstem Co. Ltd.), and Model 2 was a screw-retained implant restoration made on the screw-retained type abutments (Octa abutment; Osstem Co. Ltd.). Model 3 was a combined type implant restoration made on the cement-retained type abutment (Comocta abutment) for the first molar and the screw-retained type abutment (Octa abutment) for the first premolar. Lastly, Model 4 was a combined type implant restoration made on the screw-retained type abutment (Octa abutment) for the first molar and the cement-retained type abutment (Comocta abutment) for the first premolar. Average masticatory force was applied on the central fossa in a vertical direction, and on the buccal cusp in a vertical and oblique direction for each model. Von-Mises stress patterns on alveolar bone, implant body, abutment, abutment screw, and prosthetic screw around implant prostheses were evaluated through 3-dimensional finite element analysis. Results: Model 2 showed the lowest von Mises stress. In all models, the von Mises stress distribution of cortical bone, cancellous bone and implant body showed the similar pattern. Regardless of loading conditions and type of abutment system, the stress of bone was concentrated on the cortical bone. The von-Mises stress on abutment, abutment screw, and prosthetic screw showed the lower values for the screw-retained type abutment than for the cement-retained type abutment regardless of the model type. There was little reciprocal effect of the abutment system between the molar and the premolar position. For all models, buccal cusp oblique loading caused the largest stress, followed by buccal cusp vertical loading and center vertical loading. Conclusion: Within the limitation of the FEA study, the combined type implant prosthesis did not demonstrate more stress around implant components than the cement type implant prosthesis. Under the assumption of ideal passive fit, the screw-type implant prosthesis showed the east stress around implant components.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The result of the research conducted for the purpose of investigating the semantic value and the layout of the Cheongryu Gugok of Dorimsa Valley, which exhibits a high level of completeness and scenic preservation value among the three gugoks distributed in the area around Mt. Dongak of Gogseong is as follows.4) The area around Cheongryu Gugok shows a case where the gugok culture, which has been enjoyed as a model of the Neo-Confucianism culture and bedrock scenery, such as waterfall, riverside, pond, and flatland, following the beautiful valley, has been actually substituted, and is an outstanding scenery site as stated in a local map of Gokseong-hyeon in 1872 as "Samnam Jeil Amban Gyeryu Cheongryu-dong(三南第一巖盤溪流 淸流洞: Cheongryu-dong, the best rock mooring in the Samnam area)." Cheongryu Gugok, which is differentiated through the seasonal scenery and epigrams established on both land route and waterway, was probably established by the lead of Sun-tae Jeong(丁舜泰, ?~1916) and Byeong-sun Cho(曺秉順, 1876~1921) before 1916 during the Japanese colonization period. However, based on the fact that a number of Janggugiso of ancient sages, such as political activists, Buddhist leaders, and Neo-Confucian scholars, have been established, it is presumed to have been utilized as a hermit site and scenery site visited by masters from long ago. Cheongryu Gugok, which is formed on the rock floor of the bed rock of Dorimsa Valley, is formed in a total length of 1.2km and average gok(曲) length of 149m on a mountain type stream, which appears to be shorter compared to other gugoks in Korea. The rock writings of the three gugoks in Mt. Dongak, such as Cheongryu Gugok, which was the only one verified in the Jeonnam area, total 165 in number, which is determined to be the assembly place for the highest number of rock writings in the nation. In particular, a result of analyzing the rock writings in Cheongryu Gugok totaling 112 places showed 49pieces(43.8%) with the meaning of 'moral training' in epigram, 21pieces (18.8%) of human life, 16pieces(14.2%) of seasonal scenery, and 12pieces(10.6%) of Janggugiso such as Jangguchur, and the ratio occupied by poem verses appeared to be six cases(3.6%). Sweyeonmun(鎖烟門), which was the first gok of land route, and Jesiinganbyeolyucheon(除是人間別有天) which was the ninth gok of the waterway, corresponds to the Hongdanyeonse(虹斷烟鎖) of the first gok and Jesiinganbyeolyucheon of the ninth gok established in Jaecheon, Chungbuk by Se-hwa Park(朴世和, 1834~1910), which is inferred to be the name of Gugok having the same origin. In addition, the Daeeunbyeong(大隱屛) of the sixth gok. of land route corresponds to the Chu Hsi's Wuyi-Gugok of the seventh gok, which is acknowledged as the basis for Gugok Wollim, and the rock writings and stonework of 'Amseojae(巖棲齋)' and 'Pogyeongjae(抱經齋)' between the seventh gok and eighth gok is a trace comparable with Wuyi Jeongsa(武夷精舍) placed below Wuyi Gugok Eunbyeon-bong, which is understood to be the activity base of Cheongryu-dong of the Giho Sarim(畿湖士林). The rock writings in the Mt. Dongak area, including famous sayings by masters such as Sunsaeuhje(鮮史御帝, Emperor Gojong), Bogahyowoo(保家孝友, Emperor Gojong), Manchunmungywol(萬川明月, King Joengjo), Biryeobudong(非禮不動, Chongzhen Emperor of the Ming Dynasty)', Samusa(思無邪, Euijong of the Ming Dynasty), Baksechungpwoong(百世淸風, Chu Hsi), and Chungryususuk-Dongakpungkyung(淸流水石 動樂風景, Heungseon Daewongun) can be said to be a repository of semantic symbolic cultural scenery, instead of only expressing Confucian aesthetics. In addition, Cheongryu Gugok is noticeable with its feature as a cluster of cultural scenery of the three religions of Confucian-Buddhism-Taoism, where the Confucianism value system, Buddhist concept, and Taoist concept co-exists for mind training and cultivation. Cheongryu Gugok has a semantic feature and spatial character as a basis for history and cultural struggle for the Anti-Japan spirit that has been conceived during the process of establishing and utilizing the spirit of the learning, loyalty for the Emperor and expulsion of barbarians, and inspiration of Anti-Japan force, by inheriting the sense of Dotong(道統) of Neo-Confucianism by the Confucian scholar class at the end of the Joseon era that is represented by Ik-hyun Choi(崔益鉉, 1833~1906), Woo Jeon(田愚, 1841~1922), Woo-man Gi(奇宇萬, 1846~1916), Byung-sun Song(宋秉璿, 1836~1905), and Hyeon Hwang(黃玹, 1855~1910).
In order to investigate the utilization probability of two years old laying hen for W.L. and R.I.R. breeds, carcass weight and percentage were examined and dried old chicken meat products were manufactured for experiments. The results obtained are as follows. 1. Average living body weight were 1,635.40g for the W.L. breeds and 2,289.29g for the R.I.R. breeds and percentage carcass and lean meat for the W.L. were 58.73% and 43.95%, for the R.I.R. 60.34%, 41.98%, respectively. 2. In constitution percentage of carcass on different parts for W.L. and R.I.R. breeds, head were 4.13% and 3.94%, wing 9.97% and 8.62%, breast 32.54% and 20.94%, back 11.35% and 9.75%, thigh 30.75% and 31.34%, hypordermic fat 11.37% and 17.34%, respectively. 3. In constitution percentage of lean meat on different parts for W.L. and R.I.R. breeds, head were 4.03% and 3.95%, wing 9.47% and 9.79%, breast 39.37% and 38.14%, back 11.24% and 9.40%, thigh 36.16% and 38.74%, respectively. 4. In chemical composition of old chicken meat for W.L. breed, moisture was 68.18%, crude protein 22.80%, crude fat 2.70%, extract 5.15% and crude ash 1.18% and for R.I.R. breed, moisture was 68.04%, crude protein 22.18%, crude fat 3.13%, extract 5.45% and crude ash 1.21%. 5. Weight loss in steaming for W.L. at
This study was peformed to document the association between nutrient intakes, body mass index (BMI), waist/hip ratio (WHR), and a major risk factor for chronic diseases. A three-day dietary intake survey, using a 24 hour recall method, was obtained from 187 subjects aged 46 to 84 (mean age 65.3) living in Wando island area. The average daily mean energy intakes were 1869.0 kcal for male and 1943.9 kcal for female, respectively. Daily intakes of protein for male and female were 28.0 and 30.4 g, and those of fat were 31.5 and 28.51 g, respectively Carbohydrate dependency was decreased with age. Protein dependency was increased with age. The mean intakes of energy, protein, Vit. A, Vit. D, Vit. E, Ca, Zn did not meet Korean RDA for elderly. The level of serum triglyceride was higher in males than in females and showed the tendency to increase with age in both sexes, whereas HDL-cholesterol tended to decrease with age in both sexes. The levels of serum total-cholesterol and LDL-cholesterol were significantly higher in males than in females, particularly in the age of