• Title/Summary/Keyword: Memory improvement

Search Result 693, Processing Time 0.029 seconds

Feasibility of Deep Learning Algorithms for Binary Classification Problems (이진 분류문제에서의 딥러닝 알고리즘의 활용 가능성 평가)

  • Kim, Kitae;Lee, Bomi;Kim, Jong Woo
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.1
    • /
    • pp.95-108
    • /
    • 2017
  • Recently, AlphaGo which is Bakuk (Go) artificial intelligence program by Google DeepMind, had a huge victory against Lee Sedol. Many people thought that machines would not be able to win a man in Go games because the number of paths to make a one move is more than the number of atoms in the universe unlike chess, but the result was the opposite to what people predicted. After the match, artificial intelligence technology was focused as a core technology of the fourth industrial revolution and attracted attentions from various application domains. Especially, deep learning technique have been attracted as a core artificial intelligence technology used in the AlphaGo algorithm. The deep learning technique is already being applied to many problems. Especially, it shows good performance in image recognition field. In addition, it shows good performance in high dimensional data area such as voice, image and natural language, which was difficult to get good performance using existing machine learning techniques. However, in contrast, it is difficult to find deep leaning researches on traditional business data and structured data analysis. In this study, we tried to find out whether the deep learning techniques have been studied so far can be used not only for the recognition of high dimensional data but also for the binary classification problem of traditional business data analysis such as customer churn analysis, marketing response prediction, and default prediction. And we compare the performance of the deep learning techniques with that of traditional artificial neural network models. The experimental data in the paper is the telemarketing response data of a bank in Portugal. It has input variables such as age, occupation, loan status, and the number of previous telemarketing and has a binary target variable that records whether the customer intends to open an account or not. In this study, to evaluate the possibility of utilization of deep learning algorithms and techniques in binary classification problem, we compared the performance of various models using CNN, LSTM algorithm and dropout, which are widely used algorithms and techniques in deep learning, with that of MLP models which is a traditional artificial neural network model. However, since all the network design alternatives can not be tested due to the nature of the artificial neural network, the experiment was conducted based on restricted settings on the number of hidden layers, the number of neurons in the hidden layer, the number of output data (filters), and the application conditions of the dropout technique. The F1 Score was used to evaluate the performance of models to show how well the models work to classify the interesting class instead of the overall accuracy. The detail methods for applying each deep learning technique in the experiment is as follows. The CNN algorithm is a method that reads adjacent values from a specific value and recognizes the features, but it does not matter how close the distance of each business data field is because each field is usually independent. In this experiment, we set the filter size of the CNN algorithm as the number of fields to learn the whole characteristics of the data at once, and added a hidden layer to make decision based on the additional features. For the model having two LSTM layers, the input direction of the second layer is put in reversed position with first layer in order to reduce the influence from the position of each field. In the case of the dropout technique, we set the neurons to disappear with a probability of 0.5 for each hidden layer. The experimental results show that the predicted model with the highest F1 score was the CNN model using the dropout technique, and the next best model was the MLP model with two hidden layers using the dropout technique. In this study, we were able to get some findings as the experiment had proceeded. First, models using dropout techniques have a slightly more conservative prediction than those without dropout techniques, and it generally shows better performance in classification. Second, CNN models show better classification performance than MLP models. This is interesting because it has shown good performance in binary classification problems which it rarely have been applied to, as well as in the fields where it's effectiveness has been proven. Third, the LSTM algorithm seems to be unsuitable for binary classification problems because the training time is too long compared to the performance improvement. From these results, we can confirm that some of the deep learning algorithms can be applied to solve business binary classification problems.

A Study of Anomaly Detection for ICT Infrastructure using Conditional Multimodal Autoencoder (ICT 인프라 이상탐지를 위한 조건부 멀티모달 오토인코더에 관한 연구)

  • Shin, Byungjin;Lee, Jonghoon;Han, Sangjin;Park, Choong-Shik
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.3
    • /
    • pp.57-73
    • /
    • 2021
  • Maintenance and prevention of failure through anomaly detection of ICT infrastructure is becoming important. System monitoring data is multidimensional time series data. When we deal with multidimensional time series data, we have difficulty in considering both characteristics of multidimensional data and characteristics of time series data. When dealing with multidimensional data, correlation between variables should be considered. Existing methods such as probability and linear base, distance base, etc. are degraded due to limitations called the curse of dimensions. In addition, time series data is preprocessed by applying sliding window technique and time series decomposition for self-correlation analysis. These techniques are the cause of increasing the dimension of data, so it is necessary to supplement them. The anomaly detection field is an old research field, and statistical methods and regression analysis were used in the early days. Currently, there are active studies to apply machine learning and artificial neural network technology to this field. Statistically based methods are difficult to apply when data is non-homogeneous, and do not detect local outliers well. The regression analysis method compares the predictive value and the actual value after learning the regression formula based on the parametric statistics and it detects abnormality. Anomaly detection using regression analysis has the disadvantage that the performance is lowered when the model is not solid and the noise or outliers of the data are included. There is a restriction that learning data with noise or outliers should be used. The autoencoder using artificial neural networks is learned to output as similar as possible to input data. It has many advantages compared to existing probability and linear model, cluster analysis, and map learning. It can be applied to data that does not satisfy probability distribution or linear assumption. In addition, it is possible to learn non-mapping without label data for teaching. However, there is a limitation of local outlier identification of multidimensional data in anomaly detection, and there is a problem that the dimension of data is greatly increased due to the characteristics of time series data. In this study, we propose a CMAE (Conditional Multimodal Autoencoder) that enhances the performance of anomaly detection by considering local outliers and time series characteristics. First, we applied Multimodal Autoencoder (MAE) to improve the limitations of local outlier identification of multidimensional data. Multimodals are commonly used to learn different types of inputs, such as voice and image. The different modal shares the bottleneck effect of Autoencoder and it learns correlation. In addition, CAE (Conditional Autoencoder) was used to learn the characteristics of time series data effectively without increasing the dimension of data. In general, conditional input mainly uses category variables, but in this study, time was used as a condition to learn periodicity. The CMAE model proposed in this paper was verified by comparing with the Unimodal Autoencoder (UAE) and Multi-modal Autoencoder (MAE). The restoration performance of Autoencoder for 41 variables was confirmed in the proposed model and the comparison model. The restoration performance is different by variables, and the restoration is normally well operated because the loss value is small for Memory, Disk, and Network modals in all three Autoencoder models. The process modal did not show a significant difference in all three models, and the CPU modal showed excellent performance in CMAE. ROC curve was prepared for the evaluation of anomaly detection performance in the proposed model and the comparison model, and AUC, accuracy, precision, recall, and F1-score were compared. In all indicators, the performance was shown in the order of CMAE, MAE, and AE. Especially, the reproduction rate was 0.9828 for CMAE, which can be confirmed to detect almost most of the abnormalities. The accuracy of the model was also improved and 87.12%, and the F1-score was 0.8883, which is considered to be suitable for anomaly detection. In practical aspect, the proposed model has an additional advantage in addition to performance improvement. The use of techniques such as time series decomposition and sliding windows has the disadvantage of managing unnecessary procedures; and their dimensional increase can cause a decrease in the computational speed in inference.The proposed model has characteristics that are easy to apply to practical tasks such as inference speed and model management.

Social Network-based Hybrid Collaborative Filtering using Genetic Algorithms (유전자 알고리즘을 활용한 소셜네트워크 기반 하이브리드 협업필터링)

  • Noh, Heeryong;Choi, Seulbi;Ahn, Hyunchul
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.2
    • /
    • pp.19-38
    • /
    • 2017
  • Collaborative filtering (CF) algorithm has been popularly used for implementing recommender systems. Until now, there have been many prior studies to improve the accuracy of CF. Among them, some recent studies adopt 'hybrid recommendation approach', which enhances the performance of conventional CF by using additional information. In this research, we propose a new hybrid recommender system which fuses CF and the results from the social network analysis on trust and distrust relationship networks among users to enhance prediction accuracy. The proposed algorithm of our study is based on memory-based CF. But, when calculating the similarity between users in CF, our proposed algorithm considers not only the correlation of the users' numeric rating patterns, but also the users' in-degree centrality values derived from trust and distrust relationship networks. In specific, it is designed to amplify the similarity between a target user and his or her neighbor when the neighbor has higher in-degree centrality in the trust relationship network. Also, it attenuates the similarity between a target user and his or her neighbor when the neighbor has higher in-degree centrality in the distrust relationship network. Our proposed algorithm considers four (4) types of user relationships - direct trust, indirect trust, direct distrust, and indirect distrust - in total. And, it uses four adjusting coefficients, which adjusts the level of amplification / attenuation for in-degree centrality values derived from direct / indirect trust and distrust relationship networks. To determine optimal adjusting coefficients, genetic algorithms (GA) has been adopted. Under this background, we named our proposed algorithm as SNACF-GA (Social Network Analysis - based CF using GA). To validate the performance of the SNACF-GA, we used a real-world data set which is called 'Extended Epinions dataset' provided by 'trustlet.org'. It is the data set contains user responses (rating scores and reviews) after purchasing specific items (e.g. car, movie, music, book) as well as trust / distrust relationship information indicating whom to trust or distrust between users. The experimental system was basically developed using Microsoft Visual Basic for Applications (VBA), but we also used UCINET 6 for calculating the in-degree centrality of trust / distrust relationship networks. In addition, we used Palisade Software's Evolver, which is a commercial software implements genetic algorithm. To examine the effectiveness of our proposed system more precisely, we adopted two comparison models. The first comparison model is conventional CF. It only uses users' explicit numeric ratings when calculating the similarities between users. That is, it does not consider trust / distrust relationship between users at all. The second comparison model is SNACF (Social Network Analysis - based CF). SNACF differs from the proposed algorithm SNACF-GA in that it considers only direct trust / distrust relationships. It also does not use GA optimization. The performances of the proposed algorithm and comparison models were evaluated by using average MAE (mean absolute error). Experimental result showed that the optimal adjusting coefficients for direct trust, indirect trust, direct distrust, indirect distrust were 0, 1.4287, 1.5, 0.4615 each. This implies that distrust relationships between users are more important than trust ones in recommender systems. From the perspective of recommendation accuracy, SNACF-GA (Avg. MAE = 0.111943), the proposed algorithm which reflects both direct and indirect trust / distrust relationships information, was found to greatly outperform a conventional CF (Avg. MAE = 0.112638). Also, the algorithm showed better recommendation accuracy than the SNACF (Avg. MAE = 0.112209). To confirm whether these differences are statistically significant or not, we applied paired samples t-test. The results from the paired samples t-test presented that the difference between SNACF-GA and conventional CF was statistical significant at the 1% significance level, and the difference between SNACF-GA and SNACF was statistical significant at the 5%. Our study found that the trust/distrust relationship can be important information for improving performance of recommendation algorithms. Especially, distrust relationship information was found to have a greater impact on the performance improvement of CF. This implies that we need to have more attention on distrust (negative) relationships rather than trust (positive) ones when tracking and managing social relationships between users.

Functional recovery after transplantation of mouse bone marrow-derived mesenchymal stem cells for hypoxic-ischemic brain injury in immature rats (저산소 허혈 뇌 손상을 유발시킨 미성숙 흰쥐에서 마우스 골수 기원 중간엽 줄기 세포 이식 후 기능 회복)

  • Choi, Wooksun;Shin, Hye Kyung;Eun, So-Hee;Kang, Hoon Chul;Park, Sung Won;Yoo, Kee Hwan;Hong, Young Sook;Lee, Joo Won;Eun, Baik-Lin
    • Clinical and Experimental Pediatrics
    • /
    • v.52 no.7
    • /
    • pp.824-831
    • /
    • 2009
  • Purpose : We aimed to investigate the efficacy of and functional recovery after intracerebral transplantation of different doses of mouse mesenchymal stem cells (mMSCs) in immature rat brain with hypoxic-ischemic encephalopathy (HIE). Methods : Postnatal 7-days-old Sprague-Dawley rats, which had undergone unilateral HI operation, were given stereotaxic intracerebral injections of either vehicle or mMSCs and then tested for locomotory activity in the 2nd, 4th, 6th, and 8th week of the stem cell injection. In the 8th week, Morris water maze test was performed to evaluate the learning and memory dysfunction for a week. Results : In the open field test, no differences were observed in the total distance/the total duration (F=0.412, P=0.745) among the 4 study groups. In the invisible-platform Morris water maze test, significant differences were observed in escape latency (F=380.319, P<0.01) among the 4 groups. The escape latency in the control group significantly differed from that in the high-dose mMSC and/or sham group on training days 2-5 (Scheffe's test, P<0.05) and became prominent with time progression (F=6.034, P<0.01). In spatial probe trial and visible-platform Morris water maze test, no significant improvement was observed in the rats that had undergone transplantation. Conclusion : Although the rats that received a high dose of mMSCs showed significant recovery in the learning-related behavioral test only, our data support that mMSCs may be used as a valuable source to improve outcome in HIE. Further study is necessary to identify the optimal dose that shows maximal efficacy for HIE treatment.

Ethyl acetate fraction from Pteridium aquilinum ameliorates cognitive impairment in high-fat diet-induced diabetic mice (고지방 식이로 유도된 실험동물의 당뇨성 인지기능 장애에 대한 고사리 아세트산에틸 분획물의 개선효과)

  • Kwon, Bong Seok;Guo, Tian Jiao;Park, Seon Kyeong;Kim, Jong Min;Kang, Jin Yong;Park, Sang Hyun;Kang, Jeong Eun;Lee, Chang Jun;Lee, Uk;Heo, Ho Jin
    • Korean Journal of Food Science and Technology
    • /
    • v.49 no.6
    • /
    • pp.649-658
    • /
    • 2017
  • The potential of the ethyl acetate fraction from Pteridium aquilinum (EFPA) to improve the cognitive function in high-fat diet (HFD)-induced diabetic mice was investigated. EFPA-treatment resulted in a significant improvement in the spatial, learning, and memory abilities compared to the HFD group in behavioral tests, including the Y-maze, passive avoidance, and Morris water maze. The diabetic symptoms of the EFPA-treated groups, such as fasting glucose and glucose tolerance, were alleviated. The administration of EFPA reduced the acetylcholinesterase (AChE) activity and malondialdehyde (MDA) content in mice brains, but increased the acetylcholine (ACh) and superoxide dismutase (SOD) levels. Finally, kaempferol-3-o-glucoside, a major physiological component of EFPA, was identified by using high-performance liquid chromatography coupled with a hybrid triple quadrupole-linear ion trap mass spectrometer (QTRAP LC-MS/MS).

The Effect of the Integrated Therapy of Neurofeedback, Brain Gymnastics, and Oriental Herbal Tea on the Improvement of Brain Functions and the Quality of Life of Elders living alone (뉴로피드백·뇌체조·한방차를 병행한 통합요법이 독거노인의 뇌기능 향상 및 삶의 질에 미치는 영향)

  • Jeong, Eun-sil;Lee, Jung-eun;Jung, Hyun-mo;Kim, Soo-Kyung;Youn, Mee-Kyung;Lee, Eun-han
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.12
    • /
    • pp.569-581
    • /
    • 2016
  • This experimental study employs a pretest -posttest method concerning the integrated therapy of neurofeedback training, brain gymnastics, and oriental herbal tea effects on seniors living alone. The purpose of the study is to identify effects on brain functions and quality of life. The study participants included 23 seniors living alone (male 10, female 13), ranging in age from 65~90. The experiment lasted 8 weeks, from December 22, 2014, to February 28, 2015. The neurofeedback training utilized the 2 Channel neurofeedback system by Braintech Corporation and was conducted a total of 16 times over 8 weeks, having two sessions per week lasting for 30 minutes focusing on relaxation, concentration and memory. Brain gymnastics, developed by the Korean Science Institute of Psychiatry, ran for 30 minutes, twice a week for a total of 16 sessions administered over 8 weeks. Participants were required to drink 3 cups of oriental herbal tea developed according to Donguibogam for 8 weeks. The results of applying integrated therapy found positive effects on brain function resulting from changes in level of tension and anti-stress quotient. Quality of life, daily life basic measurements, and depression symptoms were significantly influenced by decreases in blood pressure and blood sugar. Results of this study find the integrated therapy of neurofeedback training, brain gymnastics, and oriental herbal tea can significantly enhance brain functions and quality of life within seniors living alone. Therefore integrated therapy involving neurofeedback, brain gymnastics, and oriental herbal tea is a necessary intervention to improve the quality of life of seniors living alone, and will improve the quality of life through healing both mind and body in a more practical and systematical manner.

Advanced Hybrid EER Transmitter for WCDMA Application Using Efficiency Optimized Power Amplifier and Modified Bias Modulator (효율이 특화된 전력 증폭기와 개선된 바이어스 모듈레이터로 구성되는 진보된 WCDMA용 하이브리드 포락선 제거 및 복원 전력 송신기)

  • Kim, Il-Du;Woo, Young-Yun;Hong, Sung-Chul;Kim, Jang-Heon;Moon, Jung-Hwan;Jun, Myoung-Su;Kim, Jung-Joon;Kim, Bum-Man
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.18 no.8
    • /
    • pp.880-886
    • /
    • 2007
  • We have proposed a new "hybrid" envelope elimination and restoration(EER) transmitter architecture using an efficiency optimized power amplifier(PA) and modified bias modulator. The efficiency of the PA at the average drain voltage is very important for the overall transmitter efficiency because the PA operates mostly at the average power region of the modulation signal. Accordingly, the efficiency of the PA has been optimized at the region. Besides, the bias modulator has been accompanied with the emitter follower for the minimization of memory effect. A saturation amplifier, class $F^{-1}$ is built using a 5-W PEP LDMOSFET for forward-link single-carrier wideband code-division multiple-access(WCDMA) at 1-GHz. For the interlock experiment, the bias modulator has been built with the efficiency of 64.16% and peak output voltage of 31.8 V. The transmitter with the proposed PA and bias modulator has been achieved an efficiency of 44.19%, an improvement of 8.11%. Besides, the output power is enhanced to 32.33 dBm due to the class F operation and the PAE is 38.28% with ACLRs of -35.9 dBc at 5-MHz offset. These results show that the proposed architecture is a very good candidate for the linear and efficient high power transmitter.

Memory improvement effect of Artemisia argyi H. fermented with Monascus purpureus on streptozotocin-induced diabetic mice (스트렙토조토신으로 유도된 당뇨 마우스에서 Monascus purpureus을 이용한 발효 쑥의 기억력 개선 효과)

  • Lee, Chang Jun;Lee, Du Sang;Kang, Jin Yong;Kim, Jong Min;Park, Seon Kyeong;Kang, Jeong Eun;Kwon, Bong Seok;Park, Sang Hyun;Park, Su Bin;Ha, Gi-Jeong;Heo, Ho Jin
    • Korean Journal of Food Science and Technology
    • /
    • v.49 no.5
    • /
    • pp.550-558
    • /
    • 2017
  • The effect of Artemisia argyi H. under liquid-state fermentation by Monascus purpureus (AAFM) on cognitive impairments has been studied in a mice model of diabetes-associated cognitive decline induced by streptozotocin (STZ). C57BL/6 mice (9 weeks of age, male) were separated into four groups: a normal control, STZ-induced diabetic mouse group (STZ group), Artemisia argyi H. (AA) 10 group (diabetic mouse+AA 10 mg/kg/day), AAFM 10 group (diabetic mouse+AAFM 10 mg/kg/day). Administration of AA and AAFM significantly improved glucose tolerance, as shown by the intraperitoneal glucose tolerance test (IPGTT), and ameliorated cognitive deficit, as shown by the behavioral tests including passive avoidance, Morris water maze, and Y-maze tests. After behavioral tests, the cholinergic system was examined by assessment of the acetylcholine (ACh) level and acetylcholinesterase (AChE) inhibitory activity, and the antioxidant system was also assessed by measuring malondialdehyde (MDA) and superoxide dismutase (SOD) levels in the brain and liver.

Properties of the Silkworm (Bombyx mori) Dongchunghacho, a Newly Developed Korean Medicinal Insect-borne Mushroom: Mass-production and Pharmacological Actions (한국에서 개발된 곤충유래 약용버섯인 누에동충하초의 생산기술개발 및 약리학적 특성)

  • Lee, Sang Mong;Kim, Yong Gyun;Park, Hyean Cheal;Kim, Keun Ki;Son, Hong Joo;Hong, Chang Oh;Park, Nam Sook
    • Journal of Life Science
    • /
    • v.27 no.2
    • /
    • pp.247-266
    • /
    • 2017
  • Cordyceps is a traditional Chinese medicinal herb well-known in China, Korea and Japan since B.C. 2,000. The original entomopathogenic fungus, Cordyceps sinensis belonging to the genus Cordyceps could not be found inside Korean peninsula due to the absence of the host insect for the corresponding entomogenous fungus. The development of artificial production methods of Korean type Cordyceps using the silkworm Bombyx mori as in vivo culture medium for the the entomopathogenic fungus Paecilomyces tenuipes is the first, and wonderful occasion in the research history of insect industry of this global world. The aim of this article is to review the historical research background, mass-production methods, and pharmacological effects of the silkworm-dongchunghacho (Paecilomyces tenuipes) which is a newly developed Korean medicinal insect-borne mushroom, and another non-insect-borne medicinal mushroom (Cordyceps militaris and Cordyceps pruinosa). Their biological actions include anti-tumor, immunostimulating, anti-fatigue, anti-stress, anti-oxidant, anti-aging, anti-diabetic, anti-inflammatory, anti-thrombosis, hypolipidaemic and insecticidal effects. The bioactive principles are protein-bound polysaccharides (hexose, hexosamin), cordycepin, D-manitol, acidic polysaccharide etc. Protein-bound polysaccharides and n-butanol fractions were demonstrated to show a significant anti-tumor activities but did not show a cytotoxicities. D-mannitol exhibited a significant prolongation of the life span in tumor bearing mice. Ergosterol did not show an efficient anti-tumor activity, but showed a significant phagocytosis enhancing activity. Anti-tumor activity of silkworm-dongchunghacho might be attributed to immuno-stimulating activities rather than cytotoxic effects [164]. Also this review comprises the breeding of Dongchunghacho varieties, optimization of culture conditions, improvement of learning and memory by Dongchunghacho, application of them as foods and chemical constituents.

A study on the improving and constructing the content for the Sijo database in the Period of Modern Enlightenment (계몽기·근대시조 DB의 개선 및 콘텐츠화 방안 연구)

  • Chang, Chung-Soo
    • Sijohaknonchong
    • /
    • v.44
    • /
    • pp.105-138
    • /
    • 2016
  • Recently with the research function, "XML Digital collection of Sijo Texts in the Period of Modern Enlightenment" DB data is being provided through the Korean Research Memory (http://www.krm.or.kr) and the foundation for the constructing the contents of Sijo Texts in the Period of Modern Enlightenment has been laid. In this paper, by reviewing the characteristics and problems of Digital collection of Sijo Texts in the Period of Modern Enlightenment and searching for the improvement, I tried to find a way to make it into the content. This database has the primary meaning in the integrating and glancing at the vast amounts of Sijo in the Period of Modern Enlightenment to reaching 12,500 pieces. In addition, it is the first Sijo data base which is provide the variety of search features according to literature, name of poet, title of work, original text, per period, and etc. However, this database has the limits to verifying the overall aspects of the Sijo in the Period of Modern Enlightenment. The title and original text, which is written in the archaic word or Chinese character, could not be searched, because the standard type text of modern language is not formatted. And also the works and the individual Sijo works released after 1945 were missing in the database. It is inconvenient to extract the datum according to the poet, because poets are marked in the various ways such as one's real name, nom de plume and etc. To solve this kind of problems and improve the utilization of the database, I proposed the providing the standard type text of modern language, giving the index terms about content, providing the information on the work format and etc. Furthermore, if the Sijo database in the Period of Modern Enlightenment which is prepared the character of the Sijo Culture Information System could be built, it could be connected with the academic, educational contents. For the specific plan, I suggested as follow, - learning support materials for the Modern history and the national territory recognition on the Modern Age - source materials for studying indigenous animals and plants characters creating the commercial characters - applicability as the Sijo learning tool such as Sijo Game.

  • PDF