• Title/Summary/Keyword: Retention Vector

Search Result 15, Processing Time 0.022 seconds

Robustness of Differentiable Neural Computer Using Limited Retention Vector-based Memory Deallocation in Language Model

  • Lee, Donghyun;Park, Hosung;Seo, Soonshin;Son, Hyunsoo;Kim, Gyujin;Kim, Ji-Hwan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.3
    • /
    • pp.837-852
    • /
    • 2021
  • Recurrent neural network (RNN) architectures have been used for language modeling (LM) tasks that require learning long-range word or character sequences. However, the RNN architecture is still suffered from unstable gradients on long-range sequences. To address the issue of long-range sequences, an attention mechanism has been used, showing state-of-the-art (SOTA) performance in all LM tasks. A differentiable neural computer (DNC) is a deep learning architecture using an attention mechanism. The DNC architecture is a neural network augmented with a content-addressable external memory. However, in the write operation, some information unrelated to the input word remains in memory. Moreover, DNCs have been found to perform poorly with low numbers of weight parameters. Therefore, we propose a robust memory deallocation method using a limited retention vector. The limited retention vector determines whether the network increases or decreases its usage of information in external memory according to a threshold. We experimentally evaluate the robustness of a DNC implementing the proposed approach according to the size of the controller and external memory on the enwik8 LM task. When we decreased the number of weight parameters by 32.47%, the proposed DNC showed a low bits-per-character (BPC) degradation of 4.30%, demonstrating the effectiveness of our approach in language modeling tasks.

Identification of Iranian Vectors of Malaria by Analysis of Cuticular Hydrocarbons

  • Rasoolian, Mohammad;Nikbakhtzadeh, Mahmood Reza
    • Animal cells and systems
    • /
    • v.13 no.3
    • /
    • pp.331-337
    • /
    • 2009
  • Twenty-eight Anopheles species has been so-far identified in Iran, while only 8 species was proved as malaria vector. In this study, we principally examined the cuticular hydrocarbon (CHC) potency in identification of Iranian vectors of malaria and then differentiation of vector and non-vector species of Anopheles. Seven species of malaria vectors and the non-vector species, Anopheles claviger were collected throughout Iran. Female extracts were made out of every five conspecific specimens by surface immersion in pure n-hexane. Each sample was injected into a FID-GC instrument along with the known concentrations of standards. CHC profiles of the eight Anopheles species indicated no qualitative difference. The average mass of each eluted CHC were compared using Repeated ANOVA and Mann-Whitney tests. Results confirmed a significant difference in mass of each single CHC at a specific retention time (RT). Statistical comparison of CHC mass in An. sacharovi, An. stephensi, An. culicifacies and An. fluviatilis at RT 39.6 indicated significant differences (P<0.05) among these species. Analysis of CHC mass of An. dthali, An. superpictus & An. sacharovi at RT 28.5, An. stephensi & An. sacharovi at RT 30.7 and An. sacharovi & An. claviger at RT 30.6 similarly indicated significant differences (P<0.05). An. sacharovi could be distinguished from other species, which showed only trace, by integratable peaks at retention times of 29.7, 31 and 32.6. Similarly, An. claviger could be distinguished from the other species with a trace peak at RT 30.6. In order to separate An. stephensi from the five other species, the integratable peak at RT 30.7 was used. An. dthali could be identified at RT 26.2 by an integratable peak v.s. the trace peaks of other species. An. superpictus had indicator peaks at RTs 27.4 & 28.5 v.s. trace peaks of other species. An. maculipennis with its trace peak at RT 39.6 could be easily differentiated from An. fluviatilis & An. culicifacies. This study proved that all of the examined species of Anopheles could be well identified based on their quantitative differences in CHCs, except for An. fluviatilis & An. culicifacies for which no CHC indicator peak was detected.

Segmented Douglas-Peucker Algorithm Based on the Node Importance

  • Wang, Xiaofei;Yang, Wei;Liu, Yan;Sun, Rui;Hu, Jun;Yang, Longcheng;Hou, Boyang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.4
    • /
    • pp.1562-1578
    • /
    • 2020
  • Vector data compression algorithm can meet requirements of different levels and scales by reducing the data amount of vector graphics, so as to reduce the transmission, processing time and storage overhead of data. In view of the fact that large threshold leading to comparatively large error in Douglas-Peucker vector data compression algorithm, which has difficulty in maintaining the uncertainty of shape features and threshold selection, a segmented Douglas-Peucker algorithm based on node importance is proposed. Firstly, the algorithm uses the vertical chord ratio as the main feature to detect and extract the critical points with large contribution to the shape of the curve, so as to ensure its basic shape. Then, combined with the radial distance constraint, it selects the maximum point as the critical point, and introduces the threshold related to the scale to merge and adjust the critical points, so as to realize local feature extraction between two critical points to meet the requirements in accuracy. Finally, through a large number of different vector data sets, the improved algorithm is analyzed and evaluated from qualitative and quantitative aspects. Experimental results indicate that the improved vector data compression algorithm is better than Douglas-Peucker algorithm in shape retention, compression error, results simplification and time efficiency.

The Numerical Analysis of Extrusion Forming on the Manufactured Artificial Lightweight Aggregate Made of Incinerated Sewage Sludge Ash by a Finite Element Method (유한요소법을 이용한 하수슬러지 소각재의 인공경량골재 제조시 압출성형해석)

  • Jung, Byung-Gil;Bae, Jin-Woo;Sung, Nak-Chang
    • Journal of Environmental Science International
    • /
    • v.16 no.10
    • /
    • pp.1169-1177
    • /
    • 2007
  • The main objective of this research was to evaluate the effects of process variables which were forming ability, flow displacement, effective stress, effective strain, fluid vector and products defects on manufactured artificial lightweight aggregate made of both incinerated sewage sludge ash and clay by means of the numerical analysis of a rigid-plastic finite element method. CATIA (3D CAD program) was used for an extrusion metal mold design that was widely used in designing aircraft, automobile and metallic molds. A metal forming analysis program (ATES Co.) had a function of a rigid-plastic finite element method was used to analyze the program. The result of extrusion forming analysis indicated clearly that a shape retention of the manufactured artificial light-weight aggregate could be maintained by increasing the extrusion ratio (increasing compressive strength inside of extrusion die) and decreasing the die angle. The stress concentration of metal mold was increased by increasing an extrusion ratio, and it was higher in a junction of punch and materials, friction parts between a bottom of the punch and inside of a container, a place of die angle and a place of die of metal mold. Therefore, a heat treatment as well as a rounding treatment for stress distribution in the higher stress concentration regions were necessary to extend a lifetime of the metallic mold. A deformity of the products could have made from several factors which were a surface crack, a lack of the shape retention and a crack of inside of the products. Specially, the surface crack in the products was the most notably affected by the extrusion ratio.

A Hybrid SVM Classifier for Imbalanced Data Sets (불균형 데이터 집합의 분류를 위한 하이브리드 SVM 모델)

  • Lee, Jae Sik;Kwon, Jong Gu
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.2
    • /
    • pp.125-140
    • /
    • 2013
  • We call a data set in which the number of records belonging to a certain class far outnumbers the number of records belonging to the other class, 'imbalanced data set'. Most of the classification techniques perform poorly on imbalanced data sets. When we evaluate the performance of a certain classification technique, we need to measure not only 'accuracy' but also 'sensitivity' and 'specificity'. In a customer churn prediction problem, 'retention' records account for the majority class, and 'churn' records account for the minority class. Sensitivity measures the proportion of actual retentions which are correctly identified as such. Specificity measures the proportion of churns which are correctly identified as such. The poor performance of the classification techniques on imbalanced data sets is due to the low value of specificity. Many previous researches on imbalanced data sets employed 'oversampling' technique where members of the minority class are sampled more than those of the majority class in order to make a relatively balanced data set. When a classification model is constructed using this oversampled balanced data set, specificity can be improved but sensitivity will be decreased. In this research, we developed a hybrid model of support vector machine (SVM), artificial neural network (ANN) and decision tree, that improves specificity while maintaining sensitivity. We named this hybrid model 'hybrid SVM model.' The process of construction and prediction of our hybrid SVM model is as follows. By oversampling from the original imbalanced data set, a balanced data set is prepared. SVM_I model and ANN_I model are constructed using the imbalanced data set, and SVM_B model is constructed using the balanced data set. SVM_I model is superior in sensitivity and SVM_B model is superior in specificity. For a record on which both SVM_I model and SVM_B model make the same prediction, that prediction becomes the final solution. If they make different prediction, the final solution is determined by the discrimination rules obtained by ANN and decision tree. For a record on which SVM_I model and SVM_B model make different predictions, a decision tree model is constructed using ANN_I output value as input and actual retention or churn as target. We obtained the following two discrimination rules: 'IF ANN_I output value <0.285, THEN Final Solution = Retention' and 'IF ANN_I output value ${\geq}0.285$, THEN Final Solution = Churn.' The threshold 0.285 is the value optimized for the data used in this research. The result we present in this research is the structure or framework of our hybrid SVM model, not a specific threshold value such as 0.285. Therefore, the threshold value in the above discrimination rules can be changed to any value depending on the data. In order to evaluate the performance of our hybrid SVM model, we used the 'churn data set' in UCI Machine Learning Repository, that consists of 85% retention customers and 15% churn customers. Accuracy of the hybrid SVM model is 91.08% that is better than that of SVM_I model or SVM_B model. The points worth noticing here are its sensitivity, 95.02%, and specificity, 69.24%. The sensitivity of SVM_I model is 94.65%, and the specificity of SVM_B model is 67.00%. Therefore the hybrid SVM model developed in this research improves the specificity of SVM_B model while maintaining the sensitivity of SVM_I model.

Expression and Characterization of Recombinant Human Cu,Zn-Superoxide Dismutase in Escherichia coli

  • Kang, Jung-Hoon;Choi, Bong-Jin;Kim, Sung-Moon
    • BMB Reports
    • /
    • v.30 no.1
    • /
    • pp.60-65
    • /
    • 1997
  • Expression of human Cu.Zn-superoxide dismutase (SOD) with activity comparable to human erythrocyte enzyme was achieved in E. coli B21(DE3) by using the pET-17b expression vector containing a T7 promoter. Recombinant human SOD was found in the cytosol of disrupted bacterial cells and represented > 25% of the total bacterial proteins. The protein produced by the E. coli cells was purified using a combination of ammonium sulfate precipitation, Sephacryl S-100 gel filtration and DEAE-Sephacel ion exchange chromatography. The recombinant Cu,Zn-SOD and human erythrocyte enzyme were compared using dismutation activity, SDS-PAGE and immunoblotting analysis. The mass of the subunits was determined to be 15,809 by using a electrospray mass spectrometer. The copper specific chelator. diethyldithiocarbamate (DOC) reacted with the recombinant Cu,Zn-SOD. At $50{\mu}M$ and $100{\mu}M$ concentrations of DOC, the dismutation activity was not inhibited for one hour but gradually reduced after one hour. This result suggests that the reaction of DOC with the enzyme occurred in two distinct phases (phase I and phase II). During phase I of this reaction, one DOC reacted with the copper center, with retention of the dismutation activity while the second DOC displaced the copper, with a loss of activity in phase II.

  • PDF

Use of In Vivo and In Vitro Systems to Select Leishmania amazonensis Expressing Green Fluorescent Protein

  • Costa, Solange Dos Santos;Golim, Marjorie De Assis;Bergmann, Bartira Rossi;Costa, Fabio Trindade Maranhao;Giorgio, Selma
    • Parasites, Hosts and Diseases
    • /
    • v.49 no.4
    • /
    • pp.357-364
    • /
    • 2011
  • Various Leishmania species were engineered with green fluorescent protein (GFP) using episomal vectors that encoded an antibiotic resistance gene, such as aminoglycoside geneticin sulphate (G418). Most reports of GFP-Leishmania have used the flagellated extracellular promastigote, the stage of parasite detected in the midgut of the sandfly vector; fewer studies have been performed with amastigotes, the stage of parasite detected in mammals. In this study, comparisons were made regarding the efficiency for in vitro G418 selection of GFP-Leishmania amazonensis promastigotes and amastigotes and the use of in vivo G418 selection. The GFP-promastigotes retained episomal plasmid for a prolonged period and G418 treatment was necessary and efficient for in vitro selection. In contrast, GFP-amastigotes showed low retention of the episomal plasmid in the absence of G418 selection and low sensitivity to antibiotics in vitro. The use of protocols for G418 selection using infected BALB/c mice also indicated low sensitivity to antibiotics against amastigotes in cutaneous lesions.

Heterologous Production and Detection of Recombinant Directing 2-Deoxystreptamine (DOS) in the Non-Aminoglycoside-Producing Host Streptomyces venezuelae YJ003

  • Kurumbang, Nagendra Prasad;Oh, Tae-Jin;Liou, Kwangkyoung;Sohng, Jae-Kyung
    • Journal of Microbiology and Biotechnology
    • /
    • v.18 no.5
    • /
    • pp.866-873
    • /
    • 2008
  • 2-Deoxystreptamine is a core aglycon that is vital to backbone formation in various aminoglycosides. This core structure can be modified to develop hybrid types of aminoglycoside antibiotics. We obtained three genes responsible for 2-deoxystreptamine production, neo7, neo6, and neo5, which encode 2-deoxy-scyllo-inosose synthase, L-glutamine: 2-deoxy-scyllo-inosose aminotransferase, and dehydrogenase, respectively, from the neomycin gene cluster. These genes were cloned into pIBR25, a Streptomyces expression vector, resulting in pNDOS. The recombinant pNDOS was transformed into a non-aminoglycoside-producing host, Streptomyces venezuelae YJ003, for heterologous expression. Based on comparisons of the retention time on LC-ESI/MS and ESI-MS data with those of the 2-deoxystreptamine standard, a compound produced by S. venezuelae YJ003/pNDOS was found to be 2-deoxystreptamine.

Effect of Poly(ethylene glycol)Grafting on Polyethylenimine as a Gene Transfer Vector in vitro

  • Choe, Jin Hui;Choe, Jun Sik;Seo, Hye Ran;Park, Jong Sang
    • Bulletin of the Korean Chemical Society
    • /
    • v.22 no.1
    • /
    • pp.46-52
    • /
    • 2001
  • To evaluate the non-ionic polymer, poly(ethylene glycol) (PEG), as a component in cationic copolymers for non-viral gene delivery systems, PEG was coupled to polyethylenimine (PEI). We present the effects of different degrees and shapes of pegylation of PEI on cytotoxicity, water solubility and transfection efficiency. This work reports the synthesis and characterization of a series of cationic copolymers on the basis of the conjugates of PEI with PEG. The modified molecules were significantly less toxic than the original polymer. Moreover, the chemical modification led to enhancement of their solubility. The comparison of pegylated PEIs with different degrees of derivation showed that all the polymers tested reached comparable levels of transgene expression to that of native PEI. As assessed by agarose gel electrophoresis, even highly substituted PEI derivatives were still able to form polyionic complexes with DNA. However, aside from an increase in solubility and retention of the ability to condense DNA, methoxy-PEG-modified PEIs resulted in a significant decrease in the transfection activity of the DNA complexes. In fact, the efficiency of the copolymer was compromised even at a low degree of modification suggesting that the PEG action resulting from its shape is important for efficient gene transfer. The mode of PEG grafting and the degree of modification influenced the transfection efficiency of PEI.

Effect of an Endoplasmic Reticulum Retention Signal Tagged to Human Anti-Rabies mAb SO57 on Its Expression in Arabidopsis and Plant Growth

  • Song, Ilchan;Lee, Young Koung;Kim, Jin Wook;Lee, Seung-Won;Park, Se Ra;Lee, Hae Kyung;Oh, Soyeon;Ko, Kinarm;Kim, Mi Kyung;Park, Soon Ju;Kim, Dae Heon;Kim, Moon-Soo;Kim, Do Sun;Ko, Kisung
    • Molecules and Cells
    • /
    • v.44 no.10
    • /
    • pp.770-779
    • /
    • 2021
  • Transgenic Arabidopsis thaliana expressing an anti-rabies monoclonal antibody (mAb), SO57, was obtained using Agrobacterium-mediated floral dip transformation. The endoplasmic reticulum (ER) retention signal Lys-Asp-Glu-Leu (KDEL) was tagged to the C-terminus of the anti-rabies mAb heavy chain to localize the mAb to the ER and enhance its accumulation. When the inaccurately folded proteins accumulated in the ER exceed its storage capacity, it results in stress that can affect plant development and growth. We generated T1 transformants and obtained homozygous T3 seeds from transgenic Arabidopsis to investigate the effect of KDEL on plant growth. The germination rate did not significantly differ between plants expressing mAb SO57 without KDEL (SO plant) and mAb SO57 with KDEL (SOK plant). The primary roots of SOK agar media grown plants were slightly shorter than those of SO plants. Transcriptomic analysis showed that expression of all 11 ER stress-related genes were not significantly changed in SOK plants relative to SO plants. SOK plants showed approximately three-fold higher mAb expression levels than those of SO plants. Consequently, the purified mAb amount per unit of SOK plant biomass was approximately three times higher than that of SO plants. A neutralization assay revealed that both plants exhibited efficient rapid fluorescent focus inhibition test values against the rabies virus relative to commercially available human rabies immunoglobulins. KDEL did not upregulate ER stress-related genes; therefore, the enhanced production of the mAb did not affect plant growth. Thus, KDEL fusion is recommended for enhancing mAb production in plant systems.