• Title/Summary/Keyword: multi-domain fusion

Search Result 28, Processing Time 0.028 seconds

Ghost-free High Dynamic Range Imaging Based on Brightness Bitmap and Hue-angle Constancy (밝기 비트맵과 색도 일관성을 이용한 무 잔상 High Dynamic Range 영상 생성)

  • Yuan, Xi;Ha, Ho-Gun;Lee, Cheol-Hee;Ha, Yeong-Ho
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.1
    • /
    • pp.111-120
    • /
    • 2015
  • HDR(High dynamic range) imaging is a technique to represent a dynamic range of real world. Exposure fusion is a method to obtain a pseudo-HDR image and it directly fuses multi-exposure images instead of generating the true-HDR image. However, it results ghost artifacts while fusing the multi-exposure images with moving objects. To solve this drawback, temporal consistency assessment is proposed to remove moving objects. Firstly, multi-level threshold bitmap and brightness bitmap are proposed. In addition, hue-angle constancy map between multi-exposure images is proposed for compensating a bitmap. Then, two bitmaps are combined as a temporal weight map. Spatial domain image quality assessment is used to generate a spatial weight map. Finally, two weight maps are applied at each multi-exposure image and combined to get the pseudo-HDR image. In experiments, the proposed method reduces ghost artifacts more than previous methods. The quantitative ghost-free evaluation of the proposed method is also less than others.

Graph Reasoning and Context Fusion for Multi-Task, Multi-Hop Question Answering (다중 작업, 다중 홉 질문 응답을 위한 그래프 추론 및 맥락 융합)

  • Lee, Sangui;Kim, Incheol
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.10 no.8
    • /
    • pp.319-330
    • /
    • 2021
  • Recently, in the field of open domain natural language question answering, multi-task, multi-hop question answering has been studied extensively. In this paper, we propose a novel deep neural network model using hierarchical graphs to answer effectively such multi-task, multi-hop questions. The proposed model extracts different levels of contextual information from multiple paragraphs using hierarchical graphs and graph neural networks, and then utilize them to predict answer type, supporting sentences and answer spans simultaneously. Conducting experiments with the HotpotQA benchmark dataset, we show high performance and positive effects of the proposed model.

Generating Radiology Reports via Multi-feature Optimization Transformer

  • Rui Wang;Rong Hua
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.10
    • /
    • pp.2768-2787
    • /
    • 2023
  • As an important research direction of the application of computer science in the medical field, the automatic generation technology of radiology report has attracted wide attention in the academic community. Because the proportion of normal regions in radiology images is much larger than that of abnormal regions, words describing diseases are often masked by other words, resulting in significant feature loss during the calculation process, which affects the quality of generated reports. In addition, the huge difference between visual features and semantic features causes traditional multi-modal fusion method to fail to generate long narrative structures consisting of multiple sentences, which are required for medical reports. To address these challenges, we propose a multi-feature optimization Transformer (MFOT) for generating radiology reports. In detail, a multi-dimensional mapping attention (MDMA) module is designed to encode the visual grid features from different dimensions to reduce the loss of primary features in the encoding process; a feature pre-fusion (FP) module is constructed to enhance the interaction ability between multi-modal features, so as to generate a reasonably structured radiology report; a detail enhanced attention (DEA) module is proposed to enhance the extraction and utilization of key features and reduce the loss of key features. In conclusion, we evaluate the performance of our proposed model against prevailing mainstream models by utilizing widely-recognized radiology report datasets, namely IU X-Ray and MIMIC-CXR. The experimental outcomes demonstrate that our model achieves SOTA performance on both datasets, compared with the base model, the average improvement of six key indicators is 19.9% and 18.0% respectively. These findings substantiate the efficacy of our model in the domain of automated radiology report generation.

Construction of Modified Bacillus thuringiensis cry1Ac Genes for Transgenic Crop Through Multi Site-directed Mutagenesis

  • Xu, Hong Guang;Roh, Jong-Yul;Wang, Yong;Choi, Jae-Young;Shim, Hee-Jin;Liu, Qin;Tao, Xueying;Woo, Soo-Dong;Jin, Byung-Rae;Je, Yeon-Ho
    • International Journal of Industrial Entomology and Biomaterials
    • /
    • v.19 no.1
    • /
    • pp.199-204
    • /
    • 2009
  • The newly cloned Bacillus thuringiensis cry1-5 gene showed high activity to both Plutella xylostella and Spodoptera exigua, while cry1Ac only showed high activity against P. xylostella but low to S. exigua. Through the alignment of amino acid sequences between Cry1Ac and Cry1-5, we found 12 different residues in domain I (6 residues) and domain II (6 residues). In this study, the modified cry1Ac gene, which is constructed according to a crop-preferring codon usage, was used as a template to construct mutant B. thuringiensis cry1Ac genes based on cry1-5 gene through multi site-directed mutagenesis. Total 63 various mutant cry genes were obtained at 12 positions randomly. Among them, ten mutant cry genes, whose domain I was totally converted and domain II was randomly, were selected to express in baculovirus expression system as a polyhedrin fusion form. The recombinant proteins were 95 kDa in size and were stably activated as 65 kDa by trypsin. The expressed mutant Cry proteins were applied to bioassays against P. xylostella and S. exigua. All mutants showed high insecticidal activity both to P. xylostella and S. exigua similar to cry1-5. These results suggest that these mutant cry genes might be expected of desirable cry genes for introduction to transgenic crops.

The Works of John Galliano in Haute Couture - With a Focus on C. Dior in 20005 - (Haute Couture에 나타난 John Galliano의 작품세계 -2000년대 C. Dior 중심으로-)

  • Bang, Soo-Ran
    • Journal of the Korean Society of Costume
    • /
    • v.59 no.5
    • /
    • pp.19-40
    • /
    • 2009
  • The purpose of this study is to grasp the world of Galliano works who lead Dior Couture and to make use of this knowledge to comprehension of general trend in Haute Couture and $pr{\hat{e}}t-{\acute{a}}$-porter in the future. The method of research is to search for the characteristic of Haute Couture and the general tendency of Galliano works, and to view the inclination of Dior Couture by Galliano. For sphere of research, 2000s is discussed with focus on Haute Couture, exclusive of ready-to-wear. As a result, Galliano's Couture works were distinguished into four specificities. First, the historicity including historical event, personage and epoch. Second, the orientalism. Third, the pictorial characteristic including synthetic art and public art. Forth, the quality of humor. These subjects bring about a result that break down each boundary, in the method of interpreting, as try out mixing between every elements. Galliano pursue a new domain through the fusion of East and West, past and present, classic and pop, artistry and commercialism, this induce more familiar Haute Couture to the public, breaking the strict form of Couture. It seems that this tendency will be advanced toward extrovert Couture producing the low-age phenomenon in Couture, the mixture of multi-culture and the vitality. This fusion suggest the popularity and the commerciality of Couture, which is predicted decrease the difference between Couture and $pr{\hat{e}}t-{\acute{a}}$-porter.

Multi-fidelity Data-fusion for Improving Strain accuracy using Optical Fiber Sensors (이종 광섬유 센서 데이터 융합을 통한 변형률 정확도 향상 기법)

  • Park, Young-Soo;Jin, Seung-Seop;Yoo, Chul-Hwan;Kim, Sungtae;Park, Young-Hwan
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.40 no.6
    • /
    • pp.547-553
    • /
    • 2020
  • As aging infrastructures increase along with time, the efficient maintenance becomes more significant and accurate responses from the sensors are pre-requisite. Among various responses, strain is commonly used to detect damage such as crack and fatigue. Optical fiber sensor is one of the promising sensing techniques to measure strains with high-durability, immunity for electrical noise, long transmission distance. Fiber Bragg Grating (FBG) is a point sensor to measure the strain based on reflected signals from the grating, while Brillouin Optic Correlation Domain Analysis (BOCDA) is a distributed sensor to measure the strain along with the optical fiber based on scattering signals. Although the FBG provides the signal with high accuracy and reproducibility, the number of sensing points is limited. On the other hand, the BOCDA can measure a quasi-continuous strain along with the optical fiber. However, the measured signals from BOCDA have low accuracy and reproducibility. This paper proposed a multi-fidelity data-fusion method based on Gaussian Process Regression to improve the fidelity of the strain distribution by fusing the advantages of both systems. The proposed method was evaluated by laboratory test. The result shows that the proposed method is promising to improve the fidelity of the strain.

Lightweight Attention-Guided Network with Frequency Domain Reconstruction for High Dynamic Range Image Fusion

  • Park, Jae Hyun;Lee, Keuntek;Cho, Nam Ik
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2022.06a
    • /
    • pp.205-208
    • /
    • 2022
  • Multi-exposure high dynamic range (HDR) image reconstruction, the task of reconstructing an HDR image from multiple low dynamic range (LDR) images in a dynamic scene, often produces ghosting artifacts caused by camera motion and moving objects and also cannot deal with washed-out regions due to over or under-exposures. While there has been many deep-learning-based methods with motion estimation to alleviate these problems, they still have limitations for severely moving scenes. They also require large parameter counts, especially in the case of state-of-the-art methods that employ attention modules. To address these issues, we propose a frequency domain approach based on the idea that the transform domain coefficients inherently involve the global information from whole image pixels to cope with large motions. Specifically we adopt Residual Fast Fourier Transform (RFFT) blocks, which allows for global interactions of pixels. Moreover, we also employ Depthwise Overparametrized convolution (DO-conv) blocks, a convolution in which each input channel is convolved with its own 2D kernel, for faster convergence and performance gains. We call this LFFNet (Lightweight Frequency Fusion Network), and experiments on the benchmarks show reduced ghosting artifacts and improved performance up to 0.6dB tonemapped PSNR compared to recent state-of-the-art methods. Our architecture also requires fewer parameters and converges faster in training.

  • PDF

Construction and Production of Concatameric Human TNF Receptor-Immunoglobulin Fusion Proteins

  • Yim, Su-Bin;Chung, Yong-Hoon
    • Journal of Microbiology and Biotechnology
    • /
    • v.14 no.1
    • /
    • pp.81-89
    • /
    • 2004
  • Tumor necrosis factor-$\alpha$ (TNF-$\alpha$) and lymphotoxin-$\alpha$ (LT-$\alpha$, TNF-$\beta$) can initiate and perpetuate human diseases such as multiple sclerosis (MS), rheumatoid arthritis (RA), and insulin-dependent diabetes mellitus (IDDM). TNFs can be blocked by the use of soluble TNF receptors. However, since monomeric soluble receptors generally exhibit low affinity or function as agonists, the use of monomeric soluble receptors has been limited in the case of cytokines such as TNF-$\alpha$, TNF-$\alpha$, interleukin (IL)-1, IL-4, IL-6, and IL-13, which have adapted to a multi component receptor system. For these reasons, very high-affinity inhibitors were created for the purpose of a TNFs antagonist to bind the TNFR and trigger cellular signal by using the multistep polymerase chain reaction method. First, recombinant simple TNFR-Ig fusion proteins were constructed from the cDNA sequences encoding the extracellular domain of the human p55 TNFR (CD120a) and the human p75 TNFR (CD120b), which were linked to hinge and constant regions of human $IgG_1$ heavy chain, respectively using complementary primers (CP) encoding the complementary sequences. Then, concatameric TNFR-Ig fusion proteins were constructed using recombinant PCR and a complementary primer base of recombinant simple TNFR-Ig fusion proteins. For high level expression of recombinant fusion proteins, Chinese hamster ovary (CHO) cells were used with a retroviral expression system. The transfected cells produced the simple concatameric TNFR-Ig fusion proteins capable of binding TNF and inactivating it. These soluble versions of simple concantameric TNFR-Ig fusion proteins gave rise to multiple forms such as simple dimers and concatameric homodimers. Simple TNFR-1g fusion proteins were shown to have much more reduced TNF inhibitory activity than concatameric TNFR-Ig fusion proteins. Concatameric TNFR-Ig fusion proteins showed higher affinity than simple TNFR-Ig fusion proteins in a receptor inhibitor binding assay (RIBA). Additionally, concatameric TNFR-Ig fusion proteins were shown to have a progressive effect as a TNF inhibitor compared to the simple TNFR-Ig fusion proteins and conventional TNFR-Fc in cytotoxicity assays, and showed the same results for collagen induced arthritis (CIA) in mice in vivo.

B3(Fab)-streptavidin Tetramer Has Higher Binding Avidity than B3(scFv)-streptavidin Tetramer

  • Won, Jae-Seon;Kang, Hye-Won;Nam, Pil-Won;Choe, Mu-Hyeon
    • Bulletin of the Korean Chemical Society
    • /
    • v.30 no.5
    • /
    • pp.1101-1106
    • /
    • 2009
  • Multivalent and multi-specific antibodies can provide valuable tools for bio-medical research, diagnosis and therapy. In antigen-antibody interactions, the avidity of antibodies depends on the affinity and the number of binding sites.$^1$ As artificial multivalent antibody agents, single chain Fv-streptavidin fusion tetramer proteins $(scFv-SA)_4$ have been previously tested.$^{1,\;2}$ Although, the Fab domain is known to be more stable than scFv in animal models,$^{3,\;4}$ it has never been used to make a multivalent agent with a streptavidin fusion. In this study, we prepared tetra-valent $(Fab-cSA)_4$ by fusing Fab with core streptavidin (cSA). This molecule was made using inclusion body production, refolding and chromatography purification. Affinities of the Fab-cSA tetramer and a scFv-cSA tetramer to a cell surface antigen were compared by ELISA using biotin-HRP. The Fab-cSA tetramer showed higher binding avidity than the scFv-cSA tetramer. The higher binding avidity of the Fab-cSA tetramer demonstrates its potential as a therapeutic agent for target-specific antibody therapy.

Online correction of drift in structural identification using artificial white noise observations and an unscented Kalman Filter

  • Chatzi, Eleni N.;Fuggini, Clemente
    • Smart Structures and Systems
    • /
    • v.16 no.2
    • /
    • pp.295-328
    • /
    • 2015
  • In recent years the monitoring of structural behavior through acquisition of vibrational data has become common practice. In addition, recent advances in sensor development have made the collection of diverse dynamic information feasible. Other than the commonly collected acceleration information, Global Position System (GPS) receivers and non-contact, optical techniques have also allowed for the synchronous collection of highly accurate displacement data. The fusion of this heterogeneous information is crucial for the successful monitoring and control of structural systems especially when aiming at real-time estimation. This task is not a straightforward one as measurements are inevitably corrupted with some percentage of noise, often leading to imprecise estimation. Quite commonly, the presence of noise in acceleration signals results in drifting estimates of displacement states, as a result of numerical integration. In this study, a new approach based on a time domain identification method, namely the Unscented Kalman Filter (UKF), is proposed for correcting the "drift effect" in displacement or rotation estimates in an online manner, i.e., on the fly as data is attained. The method relies on the introduction of artificial white noise (WN) observations into the filter equations, which is shown to achieve an online correction of the drift issue, thus yielding highly accurate motion data. The proposed approach is demonstrated for two cases; firstly, the illustrative example of a single degree of freedom linear oscillator is examined, where availability of acceleration measurements is exclusively assumed. Secondly, a field inspired implementation is presented for the torsional identification of a tall tower structure, where acceleration measurements are obtained at a high sampling rate and non-collocated GPS displacement measurements are assumed available at a lower sampling rate. A multi-rate Kalman Filter is incorporated into the analysis in order to successfully fuse data sampled at different rates.