• Title/Summary/Keyword: Visual Landmark

Search Result 42, Processing Time 0.025 seconds

Efficient Visual Place Recognition by Adaptive CNN Landmark Matching

  • Chen, Yutian;Gan, Wenyan;Zhu, Yi;Tian, Hui;Wang, Cong;Ma, Wenfeng;Li, Yunbo;Wang, Dong;He, Jixian
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.11
    • /
    • pp.4084-4104
    • /
    • 2021
  • Visual place recognition (VPR) is a fundamental yet challenging task of mobile robot navigation and localization. The existing VPR methods are usually based on some pairwise similarity of image descriptors, so they are sensitive to visual appearance change and also computationally expensive. This paper proposes a simple yet effective four-step method that achieves adaptive convolutional neural network (CNN) landmark matching for VPR. First, based on the features extracted from existing CNN models, the regions with higher significance scores are selected as landmarks. Then, according to the coordinate positions of potential landmarks, landmark matching is improved by removing mismatched landmark pairs. Finally, considering the significance scores obtained in the first step, robust image retrieval is performed based on adaptive landmark matching, and it gives more weight to the landmark matching pairs with higher significance scores. To verify the efficiency and robustness of the proposed method, evaluations are conducted on standard benchmark datasets. The experimental results indicate that the proposed method reduces the feature representation space of place images by more than 75% with negligible loss in recognition precision. Also, it achieves a fast matching speed in similarity calculation, satisfying the real-time requirement.

A Study on the special property in presentation of spatial factors in a landmark of a hotel lobby, which affects visual cognition (호텔 로비공간에서 시지각적 인지에 영향을 미치는 랜드마크 공간요소의 표현 특성에 관한 연구)

  • Lee, Hyo-Chang;Ha, Mi-Kyoung
    • Korean Institute of Interior Design Journal
    • /
    • v.17 no.1
    • /
    • pp.110-119
    • /
    • 2008
  • A lobby of a hotel is an important space by which the image of a hotel as a whole, the brand-identity, is determined. This study has researched and analyzed the special property in presentation of a landmark in a hotel lobby for its spatial factors, which affects visual cognition, and it is to provide information that can set out the foundation of space design for the appropriate landmark in a certain hotel lobby corresponding to the unique characteristics of a hotel. The regional range of this study includes the lobby spaces of 10 five-star hotels in Shanghai China and Seoul Korea. The types of spatial factors as landmarks and manifestation of those, which affect the visual cognition of the users are the range of context in this study. For this study, field-study and survey were both used in research. The results that have been concluded through this study are as follow. First, manifestational quality of a landmark in a hotel lobby is represented in its size, figure and contrast of 'shape', in its visibility and territory of 'space' and in its symbolic value and historical property of 'meaning', and each of those factors are related to the others. Secondly, the types of spatial factors in a landmark are displayed as being focused on the openness of the space or with large-scaled spatial factors. Light and lumination intensify the manifestation of various spatial factors in a landmark. Thirdly, each representational characteristic of spatial factors in a landmark, which are closely linked to each other should be controlled precisely in order to bring out functional and symbolic feature of a hotel lobby.

Vision-based AGV Parking System (비젼 기반의 무인이송차량 정차 시스템)

  • Park, Young-Su;Park, Jee-Hoon;Lee, Je-Won;Kim, Sang-Woo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.5
    • /
    • pp.473-479
    • /
    • 2009
  • This paper proposes an efficient method to locate the automated guided vehicle (AGV) into a specific parking position using artificial visual landmark and vision-based algorithm. The landmark has comer features and a HSI color arrangement for robustness against illuminant variation. The landmark is attached to left of a parking spot under a crane. For parking, an AGV detects the landmark with CCD camera fixed to the AGV using Harris comer detector and matching descriptors of the comer features. After detecting the landmark, the AGV tracks the landmark using pyramidal Lucas-Kanade feature tracker and a refinement process. Then, the AGV decreases its speed and aligns its longitudinal position with the center of the landmark. The experiments showed the AGV parked accurately at the parking spot with small standard deviation of error under bright illumination and dark illumination.

Visual Landmark based Parking Assistance System in Constrained Environment (제한된 환경에서 시각적 랜드마크를 기반으로 한 주차 보조 시스템)

  • Park, Soon-Young;Song, Young-Sub;Kim, Hang-Joon
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.49 no.1
    • /
    • pp.31-40
    • /
    • 2012
  • This paper proposes a visual landmark, and presents a parking assistance system using the landmarks. The visual landmark is a feature corresponding to the parking slots, it must be selected considering the parking lot's environment. The parking lot has simple repetitive pattern environment without noticeable features. The previous landmarks are not proper to the parking lot's environment. We propose the visual landmark for this environment. We estimate the vehicle's location using the proposed landmarks, and expect the vehicle's trajectory according to the vehicle's state. The system's inputs are images from the camera fixed to the vehicle. The presented system estimates the vehicle's location using the input images, and assists a driver through displaying the expected vehicle's trajectory from the steering angle. The experimental results showed the proposed landmark's performance and the parking assistance system's performance.

Visual-Attention Using Corner Feature Based SLAM in Indoor Environment (실내 환경에서 모서리 특징을 이용한 시각 집중 기반의 SLAM)

  • Shin, Yong-Min;Yi, Chu-Ho;Suh, Il-Hong;Choi, Byung-Uk
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.49 no.4
    • /
    • pp.90-101
    • /
    • 2012
  • The landmark selection is crucial to successful perform in SLAM(Simultaneous Localization and Mapping) with a mono camera. Especially, in unknown environment, automatic landmark selection is needed since there is no advance information about landmark. In this paper, proposed visual attention system which modeled human's vision system will be used in order to select landmark automatically. The edge feature is one of the most important element for attention in previous visual attention system. However, when the edge feature is used in complicated indoor area, the response of complicated area disappears, and between flat surfaces are getting higher. Also, computation cost increases occurs due to the growth of the dimensionality since it uses the responses for 4 directions. This paper suggests to use a corner feature in order to solve or prevent the problems mentioned above. Using a corner feature can also increase the accuracy of data association by concentrating on area which is more complicated and informative in indoor environments. Finally, this paper will prove that visual attention system based on corner feature can be more effective in SLAM compared to previous method by experiment.

Landmark Detection Based on Sensor Fusion for Mobile Robot Navigation in a Varying Environment

  • Jin, Tae-Seok;Kim, Hyun-Sik;Kim, Jong-Wook
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.10 no.4
    • /
    • pp.281-286
    • /
    • 2010
  • We propose a space and time based sensor fusion method and a robust landmark detecting algorithm based on sensor fusion for mobile robot navigation. To fully utilize the information from the sensors, first, this paper proposes a new sensor-fusion technique where the data sets for the previous moments are properly transformed and fused into the current data sets to enable an accurate measurement. Exploration of an unknown environment is an important task for the new generation of mobile robots. The mobile robots may navigate by means of a number of monitoring systems such as the sonar-sensing system or the visual-sensing system. The newly proposed, STSF (Space and Time Sensor Fusion) scheme is applied to landmark recognition for mobile robot navigation in an unstructured environment as well as structured environment, and the experimental results demonstrate the performances of the landmark recognition.

Study on Characteristics of Visual-Perception by Presence of Object in Exhibition Hall (전시공간 홀에서 대상체의 유무에 따른 시지각 특성 연구)

  • Choi, Gae-Young
    • Korean Institute of Interior Design Journal
    • /
    • v.26 no.6
    • /
    • pp.106-115
    • /
    • 2017
  • This study has analysed the characteristics of observation by presence of objects in exhibition spaces through eye-tracking. The area with prevailing observation by the change of observation time with visual-perception response to the presence of objects has been analyzed to figure out the mechanism of sensibility estimation which can take place while the visual-perception is being estimated in spaces. Research results are able to ascertain that First, it was very characteristic that the signs right and left were observed more when there were no objects while when there were objects they were observed prevailingly. Second, the characteristics by section when there were any objects showed that there were more high observation scale I (more than 1000ms). When there were any objects with the number of areas where all the participants prevailed commonly, the scale was more, also. Third, in the process of acquiring any visual-perception information in spaces, the element of landmark can be regarded as a control point for space cognition, where the objects (people) became landmark when there were the objects but the signs became landmark when there were no objects. Fourth, the polynomial trend line of the changes to prevailing observation frequency by observation time shows that there was a gradual average value in general when there were any objects and then after the time range[8] the prevailing observation frequency increased. Without any objects, after a particular time range the value sharply dropped along with the increase of observation time because no objects to be observed prevailingly couln't be seen. The gradual average value means that some elements in the space were prevailingly observed all the time.

Fast Algorithm for Location Determination of Mobile Robot: Vertical Line to Point Correspondences (이동로보트의 실시간 위치결정을 위한 수직선과 점 대응 알고리즘)

  • 김재희;조형석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10a
    • /
    • pp.716-721
    • /
    • 1990
  • It is one of the essential task to determine the absolute location of mobile robot during its navigation. In this paper we propose an algorithm to calculate the distance and orientation of camera from landmark through the visual image of stripe typed landmark. Exact closed form solution of camera location is obtained with the correspondences from vertical line on mark plane to the intersection point of projected line with horizontal axis of image plane. It needs only one line image information, so that location determination can be processed in real time.

  • PDF

A Study on the Relationship between Influential Range and Cognition Factor of Landmark (랜드마크의 영향력 범위와 인지요인과의 관계)

  • 김종호;변재상;임승빈
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.30 no.4
    • /
    • pp.9-18
    • /
    • 2002
  • This study investigated the influential range of landmarks and the relationship between landmarks and cognition factor so as to offer basic data to be used for the effective use and the management of landmarks. In this study, eighteen famous landmark in Seoul were selected and analyzed. The result of this study can be summarized as follows : 1) First, eighteen determining elements of cognition factors were selected via documents survey. Second, general cognition factors of landmarks were analysed using these elements through questionnaires to specialists. As a result of factor analysis, historic cultural factor, scale factor, visual form factor, locational factor and uniqueness factor were revealed. 2) According to revealed cognition factor, eighteen landmarks are categorized into four types using MDS method via questionnaire to resident in Seoul city. These four types of landmarks are: type I that are recognized by historic cultural factor; type II that are recognized by scale factor; type III that are recognized by uniqueness factor; and type IV that are recognized by visual form factor. 3) As the result of regression, the influential range of landmarks were revealed at about a 10km radius(type I : 12km type II : whole area of Seoul city≒15km, typeIII : 8.7km, typeIV : 8.5km). 4) As a result of analysing the correlation between the influential range and the cognition factor through multiple linear regression analysis, the locational factor is the main factor affecting the influential range of landmarks in every type. The uniqueness factor comes next, which affects influential range partially. 5) Except type 1, as a result of analysing the correlation between influential range and the physical heights of landmarks, a quadratic equation is revealed, showing that the influential range of landmarks over 200 meters in height shows a radical change. Landmarks can be used as reinforcement tools of legibility, effective tools for landscape management and for the improvement of a community's image. This study on the influential range of landmarks and main cognition factor can be utilized as a landmark management plan and in urban planning, such as a new town plan.