• Title/Summary/Keyword: Fusion system

Search Result 2,136, Processing Time 0.031 seconds

Infrared and visible image fusion based on Laplacian pyramid and generative adversarial network

  • Wang, Juan;Ke, Cong;Wu, Minghu;Liu, Min;Zeng, Chunyan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.5
    • /
    • pp.1761-1777
    • /
    • 2021
  • An image with infrared features and visible details is obtained by processing infrared and visible images. In this paper, a fusion method based on Laplacian pyramid and generative adversarial network is proposed to obtain high quality fusion images, termed as Laplacian-GAN. Firstly, the base and detail layers are obtained by decomposing the source images. Secondly, we utilize the Laplacian pyramid-based method to fuse these base layers to obtain more information of the base layer. Thirdly, the detail part is fused by a generative adversarial network. In addition, generative adversarial network avoids the manual design complicated fusion rules. Finally, the fused base layer and fused detail layer are reconstructed to obtain the fused image. Experimental results demonstrate that the proposed method can obtain state-of-the-art fusion performance in both visual quality and objective assessment. In terms of visual observation, the fusion image obtained by Laplacian-GAN algorithm in this paper is clearer in detail. At the same time, in the six metrics of MI, AG, EI, MS_SSIM, Qabf and SCD, the algorithm presented in this paper has improved by 0.62%, 7.10%, 14.53%, 12.18%, 34.33% and 12.23%, respectively, compared with the best of the other three algorithms.

A Study of Biomechanical Simulation Model for Spinal Fusion using Spinal Fixation System (척추경 고정 나사 시스템을 이용한 척추 유합 시술의 생체역학적 분석 모델 연구)

  • Kim, Sung-Min;Yang, In-Chul;Kang, Ho-Chul
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.27 no.2
    • /
    • pp.137-144
    • /
    • 2010
  • In general, spinal fusion surgery takes pressure off the pain induced nerves, by restoring the alignment of the spine. Therefore spinal fixation system is used to maintain the alignment of spine. In this study, a biomechanical study was performed comparing the SROM(Spinal Range Of Motion) of three types of system such as Rigid, Dynesys, and Fused system to analyze the behavior of spinal fixation system inserted in vertebra. Dynesys system, a flexible posterior stabilization system that provides an alternative to fusion, is designed to preserve inter-segmental kinematics and alleviate loading at the facet joints. In this study, SROM of inter-vertebra with spinal fixation system installed in the virtual vertebra from L4 to S1 is estimated. To compare with spinal fixation system, a simulation was performed by BRG. LifeMOD 2005.5.0 was used to create the human virtual model of spinal fixation system. Through this, each SROM of flexion, extension, lateral bending, and axial rotation of human virtual model was measured. The result demonstrates that the movement of Dynesys system was similar to normal condition through allowing the movement of lumbar.

Efficient Object Tracking System Using the Fusion of a CCD Camera and an Infrared Camera (CCD카메라와 적외선 카메라의 융합을 통한 효과적인 객체 추적 시스템)

  • Kim, Seung-Hun;Jung, Il-Kyun;Park, Chang-Woo;Hwang, Jung-Hoon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.3
    • /
    • pp.229-235
    • /
    • 2011
  • To make a robust object tracking and identifying system for an intelligent robot and/or home system, heterogeneous sensor fusion between visible ray system and infrared ray system is proposed. The proposed system separates the object by combining the ROI (Region of Interest) estimated from two different images based on a heterogeneous sensor that consolidates the ordinary CCD camera and the IR (Infrared) camera. Human's body and face are detected in both images by using different algorithms, such as histogram, optical-flow, skin-color model and Haar model. Also the pose of human body is estimated from the result of body detection in IR image by using PCA algorithm along with AdaBoost algorithm. Then, the results from each detection algorithm are fused to extract the best detection result. To verify the heterogeneous sensor fusion system, few experiments were done in various environments. From the experimental results, the system seems to have good tracking and identification performance regardless of the environmental changes. The application area of the proposed system is not limited to robot or home system but the surveillance system and military system.

Centralized Kalman Filter with Adaptive Measurement Fusion: its Application to a GPS/SDINS Integration System with an Additional Sensor

  • Lee, Tae-Gyoo
    • International Journal of Control, Automation, and Systems
    • /
    • v.1 no.4
    • /
    • pp.444-452
    • /
    • 2003
  • An integration system with multi-measurement sets can be realized via combined application of a centralized and federated Kalman filter. It is difficult for the centralized Kalman filter to remove a failed sensor in comparison with the federated Kalman filter. All varieties of Kalman filters monitor innovation sequence (residual) for detection and isolation of a failed sensor. The innovation sequence, which is selected as an indicator of real time estimation error plays an important role in adaptive mechanism design. In this study, the centralized Kalman filter with adaptive measurement fusion is introduced by means of innovation sequence. The objectives of adaptive measurement fusion are automatic isolation and recovery of some sensor failures as well as inherent monitoring capability. The proposed adaptive filter is applied to the GPS/SDINS integration system with an additional sensor. Simulation studies attest that the proposed adaptive scheme is effective for isolation and recovery of immediate sensor failures.

Fusion Techniques Comparison of GeoEye-1 Imagery

  • Kim, Yong-Hyun;Kim, Yong-Il;Kim, Youn-Soo
    • Korean Journal of Remote Sensing
    • /
    • v.25 no.6
    • /
    • pp.517-529
    • /
    • 2009
  • Many satellite image fusion techniques have been developed in order to produce a high resolution multispectral (MS) image by combining a high resolution panchromatic (PAN) image and a low resolution MS image. Heretofore, most high resolution image fusion techniques have used IKONOS and QuickBird images. Recently, GeoEye-1, offering the highest resolution of any commercial imaging system, was launched. In this study, we have experimented with GeoEye-1 images in order to evaluate which fusion algorithms are suitable for these images. This paper presents compares and evaluates the efficiency of five image fusion techniques, the $\grave{a}$ trous algorithm based additive wavelet transformation (AWT) fusion techniques, the Principal Component analysis (PCA) fusion technique, Gram-Schmidt (GS) spectral sharpening, Pansharp, and the Smoothing Filter based Intensity Modulation (SFIM) fusion technique, for the fusion of a GeoEye-1 image. The results of the experiment show that the AWT fusion techniques maintain more spatial detail of the PAN image and spectral information of the MS image than other image fusion techniques. Also, the Pansharp technique maintains information of the original PAN and MS images as well as the AWT fusion technique.

Computer Integrated Surgical Robot System for Spinal Fusion

  • Kim Sungmin;Chung Goo Bong;Oh Se Min;Yi Byung-Ju;Kim Whee Kuk;Park Jong Il;Kim Young Soo
    • Journal of Biomedical Engineering Research
    • /
    • v.26 no.5
    • /
    • pp.265-270
    • /
    • 2005
  • A new Computer Integrated Surgical Robot system is composed of a surgical robot, a surgical planning system, and an optical tracking system. The system plays roles of an assisting surgeon and taking the place of surgeons for inserting a pedicle screw in spinal fusion. Compared to pure surgical navigation systems as well as conventional methods for spinal fusion, it is able to achieve better accuracy through compensating for the portending movement of the surgical target area. Furthermore, the robot can position and guide needles, drills, and other surgical instruments or conducts drilling/screwing directly. Preoperatively, the desired entry point, orientation, and depth of surgical tools for pedicle screw insertion are determined by the surgical planning system based on CT/MR images. Intra-operatively, position information on surgical instruments and targeted surgical areas is obtained from the navigation system. Two exemplary experiments employing the developed image-guided surgical robot system are conducted.

OVERVIEW OF SUPERCONDUCTING MAGNET POWER SUPPLY SYSTEM FOR THE KSTAR 1ST PLASMA EXPERIMENT

  • Choi, Jae-Hoon;Yang, Hyung-Lyeol;Ahn, Hyun-Sik;Jang, Gye-Yong;Lee, Dong-Keun;Kim, Kuk-Hee;Hahn, Sang-Hee;Kim, Chang-Hwan;Hong, Jae-Sic;Chu, Yong;Kong, Jong-Dae;Hong, Seong-Lok;Hwang, In-Sung
    • Nuclear Engineering and Technology
    • /
    • v.40 no.6
    • /
    • pp.459-466
    • /
    • 2008
  • The KSTAR Magnet Power Supply (MPS) was dedicated to the SC coil commissioning and $1^{st}$ plasma experiment as a part of the system commissioning. Although many efforts to develop large-current power supplies that are useful for high power electronic devices have been made in various application fields, such as for large metal-plating devices, there were clear discrepancies between conventional power supply technologies and that for the SC coils due to the special SC coil load conditions. Therefore, most of the power supply technologies for the SC coils were a challenge in the domestic research area due to their limited application. However, the MPS commissioning result showed that all of the hardware and controlling software operated well, and this result finally led to the success of SC coil commissioning and the KSTAR $1^{st}$ plasma experiment. This paper will describe key features of KSTAR MPS for the $1^{st}$ plasma experiment, and will also report the commissioning results of the magnet power supplies.

Sensor Fusion System for Improving the Recognition Performance of 3D Object (3차원 물체의 인식 성능 향상을 위한 감각 융합 시스템)

  • Kim, Ji-Kyoung;Oh, Yeong-Jae;Chong, Kab-Sung;Wee, Jae-Woo;Lee, Chong-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2004.11c
    • /
    • pp.107-109
    • /
    • 2004
  • In this paper, authors propose the sensor fusion system that can recognize multiple 3D objects from 2D projection images and tactile information. The proposed system focuses on improving recognition performance of 3D object. Unlike the conventional object recognition system that uses image sensor alone, the proposed method uses tactual sensors in addition to visual sensor. Neural network is used to fuse these informations. Tactual signals are obtained from the reaction force by the pressure sensors at the fingertips when unknown objects are grasped by four-fingered robot hand. The experiment evaluates the recognition rate and the number of teaming iterations of various objects. The merits of the proposed systems are not only the high performance of the learning ability but also the reliability of the system with tactual information for recognizing various objects even though visual information has a defect. The experimental results show that the proposed system can improve recognition rate and reduce learning time. These results verify the effectiveness of the proposed sensor fusion system as recognition scheme of 3D object.

  • PDF