• Title/Summary/Keyword: 2D/3D map navigation

Search Result 49, Processing Time 0.045 seconds

Deep Learning-based Depth Map Estimation: A Review

  • Abdullah, Jan;Safran, Khan;Suyoung, Seo
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.1
    • /
    • pp.1-21
    • /
    • 2023
  • In this technically advanced era, we are surrounded by smartphones, computers, and cameras, which help us to store visual information in 2D image planes. However, such images lack 3D spatial information about the scene, which is very useful for scientists, surveyors, engineers, and even robots. To tackle such problems, depth maps are generated for respective image planes. Depth maps or depth images are single image metric which carries the information in three-dimensional axes, i.e., xyz coordinates, where z is the object's distance from camera axes. For many applications, including augmented reality, object tracking, segmentation, scene reconstruction, distance measurement, autonomous navigation, and autonomous driving, depth estimation is a fundamental task. Much of the work has been done to calculate depth maps. We reviewed the status of depth map estimation using different techniques from several papers, study areas, and models applied over the last 20 years. We surveyed different depth-mapping techniques based on traditional ways and newly developed deep-learning methods. The primary purpose of this study is to present a detailed review of the state-of-the-art traditional depth mapping techniques and recent deep learning methodologies. This study encompasses the critical points of each method from different perspectives, like datasets, procedures performed, types of algorithms, loss functions, and well-known evaluation metrics. Similarly, this paper also discusses the subdomains in each method, like supervised, unsupervised, and semi-supervised methods. We also elaborate on the challenges of different methods. At the conclusion of this study, we discussed new ideas for future research and studies in depth map research.

Localization of A Moving Vehicle using Backward-looking Camera and 3D Road Map (후방 카메라 영상과 3차원 도로지도를 이용한 이동차량의 위치인식)

  • Choi, Sung-In;Park, Soon-Yong
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.3
    • /
    • pp.160-173
    • /
    • 2013
  • In this paper, we propose a new visual odometry technique by combining a forward-looking stereo camera and a backward-looking monocular camera. The main goal of the proposed technique is to identify the location of a moving vehicle which travels long distance and comes back to the initial position in urban road environments. While the vehicle is moving to the destination, a global 3D map is updated continuously by a stereo visual odometry technique using a graph theorem. Once the vehicle reaches the destination and begins to come back to the initial position, a map-based monocular visual odometry technqieu is used. To estimate the position of the returning vehicle accurately, 2D features in the backward-looking camera image and the global map are matched. In addition, we utilize the previous matching nodes to limit the search ranges of the next vehicle position in the global map. Through two navigation paths, we analyze the accuracy of the proposed method.

Semantic SLAM & Navigation Based on Sensor Fusion (센서융합 기반 의미론적 SLAM 및 내비게이션)

  • Gihyeon Lee;Seung-hyun Ahn;Suhyeon Sin;Hyesun Ryu;Yuna Hong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.11a
    • /
    • pp.848-849
    • /
    • 2023
  • 본 논문은 로봇의 실내 환경에서의 자율성을 높이기 위한 SLAM과 내비게이션 방법을 제시한다. 2D LiDAR와 카메라를 이용하여 위치를 인식하고 사람과 장애물을 의미론적으로 검출하며, ICP와 RTAB-map, YOLOv3를 통합하여 Semantic Map을 생성하고 실내 환경에서 자율성을 유지한다. 이 연구를 통해 로봇이 복잡한 환경에서도 높은 수준의 자율성을 유지할 수 있는지 확인하고자 한다.

A GNSS Signal Correlation Using Map-based Partial-time Common Intermediate Frequency Removal Method (맵 기반의 부분시간 공통 중간주파수 제거방식을 이용한 GNSS 신호의 상관 기법)

  • Im, Sung-Hyuck;Jee, Gyu-In
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.7
    • /
    • pp.695-701
    • /
    • 2008
  • In this paper, we propose the efficient Doppler removal method using map-based partial-time common intermediate frequency removal technique. In the proposed algorithm, the 2-stage carrier removal process was used. First, the component of common intermediate frequency is removed. Next the component of Doppler was removed with averaging and approximation. For the evaluation of the proposed algorithm, The real-time software GPS L1 C/A-code receiver was implemented. When the proposed algorithms are used, 12 tracking channels with 3 track arm(early, prompt, late) is operated real-time on PC using a Intel Pentium-III 1.0GHz CPU. Also, the requirement of memory was less than 2Mbytes. The real-time software GNSS receiver using the proposed algorithms provides the navigation solution with below 10 meter rms error. Especially, in spited of using the various approximations for implementing the algorithms, the high sensitivity capability (able to track the weak signal with -159dBm) was achieved.

Big Data Architecture Design for the Development of Hyper Live Map (HLM)

  • Moon, Sujung;Pyeon, Muwook;Bae, Sangwon;Lee, Dorim;Han, Sangwon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.34 no.2
    • /
    • pp.207-215
    • /
    • 2016
  • The demand for spatial data service technologies is increasing lately with the development of realistic 3D spatial information services and ICT (Information and Communication Technology). Research is being conducted on the real-time provision of spatial data services through a variety of mobile and Web-based contents. Big data or cloud computing can be presented as alternatives to the construction of spatial data for the effective use of large volumes of data. In this paper, the process of building HLM (Hyper Live Map) using multi-source data to acquire stereo CCTV and other various data is presented and a big data service architecture design is proposed for the use of flexible and scalable cloud computing to handle big data created by users through such media as social network services and black boxes. The provision of spatial data services in real time using big data and cloud computing will enable us to implement navigation systems, vehicle augmented reality, real-time 3D spatial information, and single picture based positioning above the single GPS level using low-cost image-based position recognition technology in the future. Furthermore, Big Data and Cloud Computing are also used for data collection and provision in U-City and Smart-City environment as well, and the big data service architecture will provide users with information in real time.

Robust Object Extraction Algorithm in the Sea Environment (해양환경에서 강건한 물표 추적 알고리즘)

  • Park, Jiwon;Jeong, Jongmyeon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.3
    • /
    • pp.298-303
    • /
    • 2014
  • In this paper, we proposed a robust object extraction and tracking algorithm in the IR image sequence acquired in the sea environment. In order to extract size-invariant object, we detect horizontal and vertical edges by using DWT and combine it to generate saliency map. To extract object region, binarization technique is applied to saliency map. The correspondences between objects in consecutive frames are defined by the calculating minimum weighted Euclidean distance as a matching measure. Finally, object trajectories are determined by considering false correspondences such as entering object, vanishing objects and false object and so on. The proposed algorithm can find trajectories robustly, which has shown by experimental results.

Fuzzy Footstep Planning for Humanoid Robots Using Locomotion Primitives (보행 프리미티브 기반 휴머노이드 로봇의 퍼지 보행 계획)

  • Kim, Yong-Tae;Noh, Su-Hee;Han, Nam-I
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2007.04a
    • /
    • pp.7-10
    • /
    • 2007
  • This paper presents a fuzzy footstep planner for humanoid robots in complex environments. First, we define locomotion primitives for humanoid robots. A global planner finds a global path from a navigation map that is generated based on a combination of 2.5 dimensional maps of the 3D workspace. A local planner searches for an optimal sequence of locomotion primitives along the global path by using fuzzy footstep planning. We verify our approach on a virtual humanoid robot in a simulated environment. Simulation results show a reduction in planning time and the feasibility of the proposed method.

  • PDF

Confidence Map based Multi-view Image Generation Method from Stereoscopic Images (양안식 영상을 이용한 신뢰도 기반의 다시점 영상 생성 방법)

  • Kim, Do Young;Ho, Yo-Sung
    • Smart Media Journal
    • /
    • v.2 no.4
    • /
    • pp.27-33
    • /
    • 2013
  • Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

  • PDF

Experimental Applicability Evaluation for Renewal and Modification Task of Digital Topographic Map by Low-Cost Drone Acquired Images (저가형 드론영상을 이용한 수치지형도 수정·갱신업무 적용 가능성 실험 평가)

  • YUN, Bu-Yeol
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.20 no.4
    • /
    • pp.115-125
    • /
    • 2017
  • In current, as the release of national base map with an equivalent scale and accuracy for the whole territory areas in South Korea, rapid spatial information industry such as national land development, GIS, and car navigation are used in a variety of spatial information industry as decision making method, and a lot of research and policies are proposed for the wide expansion of spatial information industry. For this, as of 2013, it contributes to the latest trend of spatial information field in order to solve the problems for the latest trend of spatial information, replacing modification of base maps as dividing the whole territory to zone with policy transformation by ordinary modifications. Therefore, this paper evaluates the possibility of modification and renewal of national base maps(scale: 1:5,000) using drones which currently get the limelight from a variety of research fields and industries. In particular, as a result of overlapping orthophoto, 3D point clouds extracted from images acquired by low-cost drones, and digital maps which are applied for the tasks of modification and renewal, it presents 0.2m precision and 0.1m accuracy. This means that drone-based photorgammetry technique can be fully utilized in the tasks of digital map modification and renewal because it conforms the error range of work regulation in making the national base maps(scale 1: 5000).