• Title/Summary/Keyword: real-time fusion

Search Result 302, Processing Time 0.029 seconds

Design and Implementation of Real-Time Helmet Pose Tracking System (실시간 헬멧자세 추적시스템의 설계 및 구현)

  • Hwang, Sang-Hyun;Chung, Chul-Ju;Kim, Dong-Sung
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.44 no.2
    • /
    • pp.123-130
    • /
    • 2016
  • This paper describes the design and implementation scheme of HTS(Helmet Tracking System) providing coincident LOS(Line of Sight) between aircraft and HMD(Helmet Mounted Display) which displays flight and mission information on Pilot helmet. The functionality and performance of HMD system depends on the performance of helmet tracking system. The target of HTS system design is to meet real-time performance and reliability by predicting non-periodic latency and high accuracy performance. To prove an availability of a proposed approach, a robust hybrid scheme with a fusion optical and inertial tracking system are tested through a implemented test-bed. Experimental results show real-time and reliable tracking control in spite of external errors.

Preliminary Application of Synthetic Computed Tomography Image Generation from Magnetic Resonance Image Using Deep-Learning in Breast Cancer Patients

  • Jeon, Wan;An, Hyun Joon;Kim, Jung-in;Park, Jong Min;Kim, Hyoungnyoun;Shin, Kyung Hwan;Chie, Eui Kyu
    • Journal of Radiation Protection and Research
    • /
    • v.44 no.4
    • /
    • pp.149-155
    • /
    • 2019
  • Background: Magnetic resonance (MR) image guided radiation therapy system, enables real time MR guided radiotherapy (RT) without additional radiation exposure to patients during treatment. However, MR image lacks electron density information required for dose calculation. Image fusion algorithm with deformable registration between MR and computed tomography (CT) was developed to solve this issue. However, delivered dose may be different due to volumetric changes during image registration process. In this respect, synthetic CT generated from the MR image would provide more accurate information required for the real time RT. Materials and Methods: We analyzed 1,209 MR images from 16 patients who underwent MR guided RT. Structures were divided into five tissue types, air, lung, fat, soft tissue and bone, according to the Hounsfield unit of deformed CT. Using the deep learning model (U-NET model), synthetic CT images were generated from the MR images acquired during RT. This synthetic CT images were compared to deformed CT generated using the deformable registration. Pixel-to-pixel match was conducted to compare the synthetic and deformed CT images. Results and Discussion: In two test image sets, average pixel match rate per section was more than 70% (67.9 to 80.3% and 60.1 to 79%; synthetic CT pixel/deformed planning CT pixel) and the average pixel match rate in the entire patient image set was 69.8%. Conclusion: The synthetic CT generated from the MR images were comparable to deformed CT, suggesting possible use for real time RT. Deep learning model may further improve match rate of synthetic CT with larger MR imaging data.

RTTC System through Fusion of Dynamic and Static Game Elements (동적·정적 게임 요소의 퓨전을 통한 RTTC 시스템 )

  • Chang-Jo, Sung;Kyung-Soo, Park;Seo-Hyun, Kim;Chae-Lim, Lee;Ji-Hye, Huh;Sung-Jun, Park
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.1
    • /
    • pp.183-189
    • /
    • 2023
  • Most of the games in the RTS genre, including games such as Starcraft and LOL, which are considered the most successful works in E-sports, have become increasingly uniform and boring. In order to make more changes in a uniform and boring system, I thought it could be solved through a combination of genres that have been fully developed and verified, so I tried to present a new game paradigm. To this end, let's focus on the genres of RTS andt TCG among the popular game genres and present a new paradigm by combining the dynamic and static features of these two genres. The new Real-Time Trading Card (RTTC) genre of game system proposed in this paper refers to a new type of game system that fuses the dynamic and static elements of the game. This mixed genre can be a new paradigm for games that can satisfy both gamers and viewers by minimizing the uniformity of the game while adding the randomness of cards to the characteristics of RTS called real-time warfare.

A Study on the Implementation of Real-Time Marine Deposited Waste Detection AI System and Performance Improvement Method by Data Screening and Class Segmentation (데이터 선별 및 클래스 세분화를 적용한 실시간 해양 침적 쓰레기 감지 AI 시스템 구현과 성능 개선 방법 연구)

  • Wang, Tae-su;Oh, Seyeong;Lee, Hyun-seo;Choi, Donggyu;Jang, Jongwook;Kim, Minyoung
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.3
    • /
    • pp.571-580
    • /
    • 2022
  • Marine deposited waste is a major cause of problems such as a lot of damage and an increase in the estimated amount of garbage due to abandoned fishing grounds caused by ghost fishing. In this paper, we implement a real-time marine deposited waste detection artificial intelligence system to understand the actual conditions of waste fishing gear usage, distribution, loss, and recovery, and study methods for performance improvement. The system was implemented using the yolov5 model, which is an excellent performance model for real-time object detection, and the 'data screening process' and 'class segmentation' method of learning data were applied as performance improvement methods. In conclusion, the object detection results of datasets that do screen unnecessary data or do not subdivide similar items according to characteristics and uses are better than the object recognition results of unscreened datasets and datasets in which classes are subdivided.

Intelligent Traffic Prediction by Multi-sensor Fusion using Multi-threaded Machine Learning

  • Aung, Swe Sw;Nagayama, Itaru;Tamaki, Shiro
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.5 no.6
    • /
    • pp.430-439
    • /
    • 2016
  • Estimation and analysis of traffic jams plays a vital role in an intelligent transportation system and advances safety in the transportation system as well as mobility and optimization of environmental impact. For these reasons, many researchers currently mainly focus on the brilliant machine learning-based prediction approaches for traffic prediction systems. This paper primarily addresses the analysis and comparison of prediction accuracy between two machine learning algorithms: Naïve Bayes and K-Nearest Neighbor (K-NN). Based on the fact that optimized estimation accuracy of these methods mainly depends on a large amount of recounted data and that they require much time to compute the same function heuristically for each action, we propose an approach that applies multi-threading to these heuristic methods. It is obvious that the greater the amount of historical data, the more processing time is necessary. For a real-time system, operational response time is vital, and the proposed system also focuses on the time complexity cost as well as computational complexity. It is experimentally confirmed that K-NN does much better than Naïve Bayes, not only in prediction accuracy but also in processing time. Multi-threading-based K-NN could compute four times faster than classical K-NN, whereas multi-threading-based Naïve Bayes could process only twice as fast as classical Bayes.

An A2CL Algorithm based on Information Optimization Strategy for MMRS

  • Dong, Qianhui;Li, Yibing;Sun, Qian;Tian, Yuan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.4
    • /
    • pp.1603-1623
    • /
    • 2020
  • Multiple Mobile Robots System (MMRS) has shown many attractive features in lots of real-world applications that motivate their rapid and wide diffusion. In MMRS, the Cooperative Localization (CL) is the basis and premise of its high-performance task. However, the statistical characteristics of the system noise should be already known in traditional CL algorithms, which is difficult to satisfy in actual MMRS because of the numerous of disturbances form the complex external environment. So the CL accuracy will be reduced. To solve this problem, an improved Adaptive Active Cooperative Localization (A2CL) algorithm based on information optimization strategy for MMRS is proposed in this manuscript. In this manuscript, an adaptive information fusion algorithm based on the variance component estimation under Extended Kalman filter (VCEKF) method for MMRS is introduced firstly to enhance the robustness and accuracy of information fusion by estimating the covariance matrix of the system noise or observation noise in real time. Besides, to decrease the effect of observation uncertainty on CL accuracy further, an observation optimization strategy based on information theory, the Model Predictive Control (MPC) strategy, is used here to maximize the information amount from observations. And semi-physical simulation experiments were carried out to verity the A2CL algorithm's performance finally. Results proved that the presented A2CL algorithm based on information optimization strategy for MMRS cannot only enhance the CL accuracy effectively but also have good robustness.

An Analysis of Test Results Using the New Fusion Weight Conversion Algorithm for High-speed Weigh-In-Motion System (주행시험을 통한 고속축중기의 융합형 중량환산 알고리즘 효과 분석)

  • Kim, Jong Woo;Jung, Young Woo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.19 no.4
    • /
    • pp.67-80
    • /
    • 2020
  • High-speed weigh in motion (HS-WIM) is a real-time unmanned system for measuring the weight of a freight-carrying vehicle while it is in motion without controlling vehicle traffic flow or deceleration. In Korea, HS-WIM systems are installed on the national highways and general national ways for pre-selection by law enforcement. In this study, to improve the measurement accuracy of HS-WIM, we devise improvements to the existing integral and peak weight conversion algorithms, and we provide a new fusion algorithm that can be applied to the mat-type HS-WIM. As a result of analyzing vehicle driving tests at a real site, we confirmed the highest level of weight-measuring accuracy.

Prediction Performance of Ocean Temperature and Salinity in Global Seasonal Forecast System Version 5 (GloSea5) on ARGO Float Data

  • Jieun Wie;Jae-Young Byon;Byung-Kwon Moon
    • Journal of the Korean earth science society
    • /
    • v.45 no.4
    • /
    • pp.327-337
    • /
    • 2024
  • The ocean is linked to long-term climate variability, but there are very few methods to assess the short-term performance of forecast models. This study analyzes the short-term prediction performance regarding ocean temperature and salinity of the Global Seasonal prediction system version 5 (GloSea5). GloSea5 is a historical climate re-creation (2001-2010) performed on the 1st, 9th, 17th, and 25th of each month. It comprises three ensembles. High-resolution hindcasts from the three ensembles were compared with the Array for Real-Time Geostrophic Oceanography (ARGO) float data for the period 2001-2010. The horizontal position was preprocessed to match the ARGO float data and the vertical layer to the GloSea5 data. The root mean square error (RMSE), Brier Score (BS), and Brier Skill Score (BSS) were calculated for short-term forecast periods with a lead-time of 10 days. The results show that sea surface temperature (SST) has a large RMSE in the western boundary current region in Pacific and Atlantic Oceans and Antarctic Circumpolar Current region, and sea surface salinity (SSS) has significant errors in the tropics with high precipitation, with both variables having the largest errors in the Atlantic. SST and SSS had larger errors during the fall for the NINO3.4 region and during the summer for the East Sea. Computing the BS and BSS for ocean temperature and salinity in the NINO3.4 region revealed that forecast skill decreases with increasing lead-time for SST, but not for SSS. The preprocessing of GloSea5 forecasts to match the ARGO float data applied in this study, and the evaluation methods for forecast models using the BS and BSS, could be applied to evaluate other forecast models and/or variables.

New Evaluation of Initial Growth Mechanisms of Hydroxyapatite on Self-assembled Collagen Nanofibrils by Using ToF-SIMS and AFM Techniques

  • Park, Young-Jae;Choi, Gyu-Jin;Lee, Tae-Geol;Lee, Won-Jong;Moon, Dae-Won
    • Proceedings of the Korean Vacuum Society Conference
    • /
    • 2010.02a
    • /
    • pp.397-397
    • /
    • 2010
  • Bone is considered as hierarchically organized biocomposites of organic (collagen) and inorganic (hydroxyapatite) materials. The precise structural dependence between hydroxyapatite (HAp, $Ca_{10}(PO_4)_6(OH)_2)$ crystals and collagen fibril is critical to unique characteristics of bone. To meet those conditions and obtain optimal properties, it is essential to understand and control the initial growth mechanisms of hydroxyapatite at the molecular level, such as other nano-structured materials. In this study, collagen fibrils were prepared by adsorbing native type I collagen molecules onto hydrophobic surface. Hydrophobicity was introduced on the Si wafer surface by using PECVD (plasma enhanced chemical vapor deposition) method and cyclohexane as a precursor. Biomimetic nucleation and growth of HAp on the self-assembled collagen nanofibrils were occurred through incubation of the sample in SBF (simulated body fluid). Chemical and morphological evolution of HAp nanocrystals was investigated by surface-sensitive analytical techniques such as ToF-SIMS (Time-of-Flight Secondary Ion Mass Spectrometry) and AFM (Atomic Force Microscopy) in the early growth stages (< 24 hrs). The very initial stages (< 12 hrs) of mineralization could be clearly demonstrated by ToF-SIMS chemical mapping of surface. In addition to ToF-SIMS and AFM measurement, scanning electron microscopy, energy dispersive spectroscopy and X-ray diffraction analysis were conducted to characterize the HAp layer in the late stages. This study is of great importance in the growth of real bone-like materials with a structure analogous to that of natural bones and the development of biomimetic nanomaterials.

  • PDF

3D Reconstruction of Structure Fusion-Based on UAS and Terrestrial LiDAR (UAS 및 지상 LiDAR 융합기반 건축물의 3D 재현)

  • Han, Seung-Hee;Kang, Joon-Oh;Oh, Seong-Jong;Lee, Yong-Chang
    • Journal of Urban Science
    • /
    • v.7 no.2
    • /
    • pp.53-60
    • /
    • 2018
  • Digital Twin is a technology that creates a photocopy of real-world objects on a computer and analyzes the past and present operational status by fusing the structure, context, and operation of various physical systems with property information, and predicts the future society's countermeasures. In particular, 3D rendering technology (UAS, LiDAR, GNSS, etc.) is a core technology in digital twin. so, the research and application are actively performed in the industry in recent years. However, UAS (Unmanned Aerial System) and LiDAR (Light Detection And Ranging) have to be solved by compensating blind spot which is not reconstructed according to the object shape. In addition, the terrestrial LiDAR can acquire the point cloud of the object more precisely and quickly at a short distance, but a blind spot is generated at the upper part of the object, thereby imposing restrictions on the forward digital twin modeling. The UAS is capable of modeling a specific range of objects with high accuracy by using high resolution images at low altitudes, and has the advantage of generating a high density point group based on SfM (Structure-from-Motion) image analysis technology. However, It is relatively far from the target LiDAR than the terrestrial LiDAR, and it takes time to analyze the image. In particular, it is necessary to reduce the accuracy of the side part and compensate the blind spot. By re-optimizing it after fusion with UAS and Terrestrial LiDAR, the residual error of each modeling method was compensated and the mutual correction result was obtained. The accuracy of fusion-based 3D model is less than 1cm and it is expected to be useful for digital twin construction.