• Title/Summary/Keyword: simultaneous localization and mapping

Search Result 129, Processing Time 0.022 seconds

Functional Magnetic Resonance Imaging and Diffusion Tensor Imaging for Language Mapping in Brain Tumor Surgery: Validation With Direct Cortical Stimulation and Cortico-Cortical Evoked Potential

  • Koung Mi Kang;Kyung Min Kim;In Seong Kim;Joo Hyun Kim;Ho Kang;So Young Ji;Yun-Sik Dho;Hyongmin Oh;Hee-Pyoung Park;Han Gil Seo;Sung-Min Kim;Seung Hong Choi;Chul-Kee Park
    • Korean Journal of Radiology
    • /
    • v.24 no.6
    • /
    • pp.553-563
    • /
    • 2023
  • Objective: Functional magnetic resonance imaging (fMRI) and diffusion tensor imaging-derived tractography (DTI-t) contribute to the localization of language areas, but their accuracy remains controversial. This study aimed to investigate the diagnostic performance of preoperative fMRI and DTI-t obtained with a simultaneous multi-slice technique using intraoperative direct cortical stimulation (DCS) or corticocortical evoked potential (CCEP) as reference standards. Materials and Methods: This prospective study included 26 patients (23-74 years; male:female, 13:13) with tumors in the vicinity of Broca's area who underwent preoperative fMRI and DTI-t. A site-by-site comparison between preoperative (fMRI and DTI-t) and intraoperative language mapping (DCS or CCEP) was performed for 226 cortical sites to calculate the sensitivity and specificity of fMRI and DTI-t for mapping Broca's areas. For sites with positive signals on fMRI or DTI-t, the true-positive rate (TPR) was calculated based on the concordance and discordance between fMRI and DTI-t. Results: Among 226 cortical sites, DCS was performed in 100 sites and CCEP was performed in 166 sites. The specificities of fMRI and DTI-t ranged from 72.4% (63/87) to 96.8% (122/126), respectively. The sensitivities of fMRI (except for verb generation) and DTI-t were 69.2% (9/13) to 92.3% (12/13) with DCS as the reference standard, and 40.0% (16/40) or lower with CCEP as the reference standard. For sites with preoperative fMRI or DTI-t positivity (n = 82), the TPR was high when fMRI and DTI-t were concordant (81.2% and 100% using DCS and CCEP, respectively, as the reference standards) and low when fMRI and DTI-t were discordant (≤ 24.2%). Conclusion: fMRI and DTI-t are sensitive and specific for mapping Broca's area compared with DCS and specific but insensitive compared with CCEP. A site with a positive signal on both fMRI and DTI-t represents a high probability of being an essential language area.

Obstacle Avoidance for Unmanned Air Vehicles Using Monocular-SLAM with Chain-Based Path Planning in GPS Denied Environments

  • Bharadwaja, Yathirajam;Vaitheeswaran, S.M;Ananda, C.M
    • Journal of Aerospace System Engineering
    • /
    • v.14 no.2
    • /
    • pp.1-11
    • /
    • 2020
  • Detecting obstacles and generating a suitable path to avoid obstacles in real time is a prime mission requirement for UAVs. In areas, close to buildings and people, detecting obstacles in the path and estimating its own position (egomotion) in GPS degraded/denied environments are usually addressed with vision-based Simultaneous Localization and Mapping (SLAM) techniques. This presents possibilities and challenges for the feasible path generation with constraints of vehicle dynamics in the configuration space. In this paper, a near real-time feasible path is shown to be generated in the ORB-SLAM framework using a chain-based path planning approach in a force field with dynamic constraints on path length and minimum turn radius. The chain-based path plan approach generates a set of nodes which moves in a force field that permits modifications of path rapidly in real time as the reward function changes. This is different from the usual approach of generating potentials in the entire search space around UAV, instead a set of connected waypoints in a simulated chain. The popular ORB-SLAM, suited for real time approach is used for building the map of the environment and UAV position and the UAV path is then generated continuously in the shortest time to navigate to the goal position. The principal contribution are (a) Chain-based path planning approach with built in obstacle avoidance in conjunction with ORB-SLAM for the first time, (b) Generation of path with minimum overheads and (c) Implementation in near real time.

Performance Simulation of Various Feature-Initialization Algorithms for Forward-Viewing Mono-Camera-Based SLAM (전방 모노카메라 기반 SLAM 을 위한 다양한 특징점 초기화 알고리즘의 성능 시뮬레이션)

  • Lee, Hun;Kim, Chul Hong;Lee, Tae-Jae;Cho, Dong-Il Dan
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.10
    • /
    • pp.833-838
    • /
    • 2016
  • This paper presents a performance evaluation of various feature-initialization algorithms for forward-viewing mono-camera based simultaneous localization and mapping (SLAM), specifically in indoor environments. For mono-camera based SLAM, the position of feature points cannot be known from a single view; therefore, it should be estimated from a feature initialization method using multiple viewpoint measurements. The accuracy of the feature initialization method directly affects the accuracy of the SLAM system. In this study, four different feature initialization algorithms are evaluated in simulations, including linear triangulation; depth parameterized, linear triangulation; weighted nearest point triangulation; and particle filter based depth estimation algorithms. In the simulation, the virtual feature positions are estimated when the virtual robot, containing a virtual forward-viewing mono-camera, moves forward. The results show that the linear triangulation method provides the best results in terms of feature-position estimation accuracy and computational speed.

Object Detection of AGV in Manufacturing Plants using Deep Learning (딥러닝 기반 제조 공장 내 AGV 객체 인식에 대한 연구)

  • Lee, Gil-Won;Lee, Hwally;Cheong, Hee-Woon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.1
    • /
    • pp.36-43
    • /
    • 2021
  • In this research, the accuracy of YOLO v3 algorithm in object detection during AGV (Automated Guided Vehicle) operation was investigated. First of all, AGV with 2D LiDAR and stereo camera was prepared. AGV was driven along the route scanned with SLAM (Simultaneous Localization and Mapping) using 2D LiDAR while front objects were detected through stereo camera. In order to evaluate the accuracy of YOLO v3 algorithm, recall, AP (Average Precision), and mAP (mean Average Precision) of the algorithm were measured with a degree of machine learning. Experimental results show that mAP, precision, and recall are improved by 10%, 6.8%, and 16.4%, respectively, when YOLO v3 is fitted with 4000 training dataset and 500 testing dataset which were collected through online search and is trained additionally with 1200 dataset collected from the stereo camera on AGV.

Collision Avoidance Using Omni Vision SLAM Based on Fisheye Image (어안 이미지 기반의 전방향 영상 SLAM을 이용한 충돌 회피)

  • Choi, Yun Won;Choi, Jeong Won;Im, Sung Gyu;Lee, Suk Gyu
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.3
    • /
    • pp.210-216
    • /
    • 2016
  • This paper presents a novel collision avoidance technique for mobile robots based on omni-directional vision simultaneous localization and mapping (SLAM). This method estimates the avoidance path and speed of a robot from the location of an obstacle, which can be detected using the Lucas-Kanade Optical Flow in images obtained through fish-eye cameras mounted on the robots. The conventional methods suggest avoidance paths by constructing an arbitrary force field around the obstacle found in the complete map obtained through the SLAM. Robots can also avoid obstacles by using the speed command based on the robot modeling and curved movement path of the robot. The recent research has been improved by optimizing the algorithm for the actual robot. However, research related to a robot using omni-directional vision SLAM to acquire around information at once has been comparatively less studied. The robot with the proposed algorithm avoids obstacles according to the estimated avoidance path based on the map obtained through an omni-directional vision SLAM using a fisheye image, and returns to the original path. In particular, it avoids the obstacles with various speed and direction using acceleration components based on motion information obtained by analyzing around the obstacles. The experimental results confirm the reliability of an avoidance algorithm through comparison between position obtained by the proposed algorithm and the real position collected while avoiding the obstacles.

A Study on Implementation of Motion Graphics Virtual Camera with AR Core

  • Jung, Jin-Bum;Lee, Jae-Soo;Lee, Seung-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.8
    • /
    • pp.85-90
    • /
    • 2022
  • In this study, to reduce the time and cost disadvantages of the traditional motion graphic production method in order to realize the movement of a virtual camera identical to that of the real camera, motion graphics virtualization using AR Core-based mobile device real-time tracking data A method for creating a camera is proposed. The proposed method is a method that simplifies the tracking operation in the video file stored after shooting, and simultaneously proceeds with shooting on an AR Core-based mobile device to determine whether or not tracking is successful in the shooting stage. As a result of the experiment, there was no difference in the motion graphic result image compared to the conventional method, but the time of 6 minutes and 10 seconds was consumed based on the 300frame image, whereas the proposed method has very high time efficiency because this step can be omitted. At a time when interest in image production using virtual augmented reality and various studies are underway, this study will be utilized in virtual camera creation and match moving.

Simultaneous Estimation of Landmark Location and Robot Pose Using Particle Filter Method (파티클 필터 방법을 이용한 특징점과 로봇 위치의 동시 추정)

  • Kim, Tae-Gyun;Ko, Nak-Yong;Noh, Sung-Woo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.22 no.3
    • /
    • pp.353-360
    • /
    • 2012
  • This paper describes a SLAM method which estimates landmark locations and robot pose simultaneously. The particle filter can deal with nonlinearity of robot motion as well as the non Gaussian property of robot motion uncertainty and sensor error. The state to be estimated includes the locations of landmarks in addition to the robot pose. In the experiment, four beacons which transmit ultrasonic signal are used as landmarks. The robot receives the ultrasonic signals from the beacons and detects the distance to them. The method uses rang scanning sensor to build geometric feature of the environment. Since robot location and heading are estimated by the particle filter, the scanned range data can be converted to the geometric map. The performance of the method is compared with that of the deadreckoning and trilateration.

Development and Performance Evaluation of Multi-sensor Module for Use in Disaster Sites of Mobile Robot (조사로봇의 재난현장 활용을 위한 다중센서모듈 개발 및 성능평가에 관한 연구)

  • Jung, Yonghan;Hong, Junwooh;Han, Soohee;Shin, Dongyoon;Lim, Eontaek;Kim, Seongsam
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_3
    • /
    • pp.1827-1836
    • /
    • 2022
  • Disasters that occur unexpectedly are difficult to predict. In addition, the scale and damage are increasing compared to the past. Sometimes one disaster can develop into another disaster. Among the four stages of disaster management, search and rescue are carried out in the response stage when an emergency occurs. Therefore, personnel such as firefighters who are put into the scene are put in at a lot of risk. In this respect, in the initial response process at the disaster site, robots are a technology with high potential to reduce damage to human life and property. In addition, Light Detection And Ranging (LiDAR) can acquire a relatively wide range of 3D information using a laser. Due to its high accuracy and precision, it is a very useful sensor when considering the characteristics of a disaster site. Therefore, in this study, development and experiments were conducted so that the robot could perform real-time monitoring at the disaster site. Multi-sensor module was developed by combining LiDAR, Inertial Measurement Unit (IMU) sensor, and computing board. Then, this module was mounted on the robot, and a customized Simultaneous Localization and Mapping (SLAM) algorithm was developed. A method for stably mounting a multi-sensor module to a robot to maintain optimal accuracy at disaster sites was studied. And to check the performance of the module, SLAM was tested inside the disaster building, and various SLAM algorithms and distance comparisons were performed. As a result, PackSLAM developed in this study showed lower error compared to other algorithms, showing the possibility of application in disaster sites. In the future, in order to further enhance usability at disaster sites, various experiments will be conducted by establishing a rough terrain environment with many obstacles.

Study on the Shortest Path finding of Engine Room Patrol Robots Using the A* Algorithm (A* 알고리즘을 이용한 기관실 순찰로봇의 최단 경로 탐색에 관한 연구)

  • Kim, Seon-Deok
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.28 no.2
    • /
    • pp.370-376
    • /
    • 2022
  • Smart ships related studies are being conducted in various fields owing to the development of technology, and an engine room patrol robot that can patrol the unmanned engine room is one such study. A patrol robot moves around the engine room based on the information learned through artificial intelligence and checks the machine normality and occurrence of abnormalities such as water leakage, oil leakage, and fire. Study on engine room patrol robots is mainly conducted on machine detection using artificial intelligence, however study on movement and control is insufficient. This causes a problem in that even if a patrol robot detects an object, there is no way to move to the detected object. To secure maneuverability to quickly identify the presence of abnormality in the engine room, this study experimented with whether a patrol robot can determine the shortest path by applying the A* algorithm. Data were obtained by driving a small car equipped with LiDAR in the ship engine room and creating a map by mapping the obtained data with SLAM(Simultaneous Localization And Mapping). The starting point and arrival point of the patrol robot were set on the map, and the A* algorithm was applied to determine whether the shortest path from the starting point to the arrival point was found. Simulation confirmed that the shortest route was well searched while avoiding obstacles from the starting point to the arrival point on the map. Applying this to the engine room patrol robot is believed to help improve ship safety.