• Title/Summary/Keyword: multi-view fusion

Search Result 33, Processing Time 0.027 seconds

Map-Building and Position Estimation based on Multi-Sensor Fusion for Mobile Robot Navigation in an Unknown Environment (이동로봇의 자율주행을 위한 다중센서융합기반의 지도작성 및 위치추정)

  • Jin, Tae-Seok;Lee, Min-Jung;Lee, Jang-Myung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.5
    • /
    • pp.434-443
    • /
    • 2007
  • Presently, the exploration of an unknown environment is an important task for thee new generation of mobile service robots and mobile robots are navigated by means of a number of methods, using navigating systems such as the sonar-sensing system or the visual-sensing system. To fully utilize the strengths of both the sonar and visual sensing systems. This paper presents a technique for localization of a mobile robot using fusion data of multi-ultrasonic sensors and vision system. The mobile robot is designed for operating in a well-structured environment that can be represented by planes, edges, comers and cylinders in the view of structural features. In the case of ultrasonic sensors, these features have the range information in the form of the arc of a circle that is generally named as RCD(Region of Constant Depth). Localization is the continual provision of a knowledge of position which is deduced from it's a priori position estimation. The environment of a robot is modeled into a two dimensional grid map. we defines a vision-based environment recognition, phisically-based sonar sensor model and employs an extended Kalman filter to estimate position of the robot. The performance and simplicity of the approach is demonstrated with the results produced by sets of experiments using a mobile robot.

High-resolution Depth Generation using Multi-view Camera and Time-of-Flight Depth Camera (다시점 카메라와 깊이 카메라를 이용한 고화질 깊이 맵 제작 기술)

  • Kang, Yun-Suk;Ho, Yo-Sung
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.1-7
    • /
    • 2011
  • The depth camera measures range information of the scene in real time using Time-of-Flight (TOF) technology. Measured depth data is then regularized and provided as a depth image. This depth image is utilized with the stereo or multi-view image to generate high-resolution depth map of the scene. However, it is required to correct noise and distortion of TOF depth image due to the technical limitation of the TOF depth camera. The corrected depth image is combined with the color image in various methods, and then we obtain the high-resolution depth of the scene. In this paper, we introduce the principal and various techniques of sensor fusion for high-quality depth generation that uses multiple camera with depth cameras.

The Works of John Galliano in Haute Couture - With a Focus on C. Dior in 20005 - (Haute Couture에 나타난 John Galliano의 작품세계 -2000년대 C. Dior 중심으로-)

  • Bang, Soo-Ran
    • Journal of the Korean Society of Costume
    • /
    • v.59 no.5
    • /
    • pp.19-40
    • /
    • 2009
  • The purpose of this study is to grasp the world of Galliano works who lead Dior Couture and to make use of this knowledge to comprehension of general trend in Haute Couture and $pr{\hat{e}}t-{\acute{a}}$-porter in the future. The method of research is to search for the characteristic of Haute Couture and the general tendency of Galliano works, and to view the inclination of Dior Couture by Galliano. For sphere of research, 2000s is discussed with focus on Haute Couture, exclusive of ready-to-wear. As a result, Galliano's Couture works were distinguished into four specificities. First, the historicity including historical event, personage and epoch. Second, the orientalism. Third, the pictorial characteristic including synthetic art and public art. Forth, the quality of humor. These subjects bring about a result that break down each boundary, in the method of interpreting, as try out mixing between every elements. Galliano pursue a new domain through the fusion of East and West, past and present, classic and pop, artistry and commercialism, this induce more familiar Haute Couture to the public, breaking the strict form of Couture. It seems that this tendency will be advanced toward extrovert Couture producing the low-age phenomenon in Couture, the mixture of multi-culture and the vitality. This fusion suggest the popularity and the commerciality of Couture, which is predicted decrease the difference between Couture and $pr{\hat{e}}t-{\acute{a}}$-porter.

Visible and SWIR Satellite Image Fusion Using Multi-Resolution Transform Method Based on Haze-Guided Weight Map (Haze-Guided Weight Map 기반 다중해상도 변환 기법을 활용한 가시광 및 SWIR 위성영상 융합)

  • Taehong Kwak;Yongil Kim
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.3
    • /
    • pp.283-295
    • /
    • 2023
  • With the development of sensor and satellite technology, numerous high-resolution and multi-spectral satellite images have been available. Due to their wavelength-dependent reflection, transmission, and scattering characteristics, multi-spectral satellite images can provide complementary information for earth observation. In particular, the short-wave infrared (SWIR) band can penetrate certain types of atmospheric aerosols from the benefit of the reduced Rayleigh scattering effect, which allows for a clearer view and more detailed information to be captured from hazed surfaces compared to the visible band. In this study, we proposed a multi-resolution transform-based image fusion method to combine visible and SWIR satellite images. The purpose of the fusion method is to generate a single integrated image that incorporates complementary information such as detailed background information from the visible band and land cover information in the haze region from the SWIR band. For this purpose, this study applied the Laplacian pyramid-based multi-resolution transform method, which is a representative image decomposition approach for image fusion. Additionally, we modified the multiresolution fusion method by combining a haze-guided weight map based on the prior knowledge that SWIR bands contain more information in pixels from the haze region. The proposed method was validated using very high-resolution satellite images from Worldview-3, containing multi-spectral visible and SWIR bands. The experimental data including hazed areas with limited visibility caused by smoke from wildfires was utilized to validate the penetration properties of the proposed fusion method. Both quantitative and visual evaluations were conducted using image quality assessment indices. The results showed that the bright features from the SWIR bands in the hazed areas were successfully fused into the integrated feature maps without any loss of detailed information from the visible bands.

Bayesian Sensor Fusion of Monocular Vision and Laser Structured Light Sensor for Robust Localization of a Mobile Robot (이동 로봇의 강인 위치 추정을 위한 단안 비젼 센서와 레이저 구조광 센서의 베이시안 센서융합)

  • Kim, Min-Young;Ahn, Sang-Tae;Cho, Hyung-Suck
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.4
    • /
    • pp.381-390
    • /
    • 2010
  • This paper describes a procedure of the map-based localization for mobile robots by using a sensor fusion technique in structured environments. A combination of various sensors with different characteristics and limited sensibility has advantages in view of complementariness and cooperation to obtain better information on the environment. In this paper, for robust self-localization of a mobile robot with a monocular camera and a laser structured light sensor, environment information acquired from two sensors is combined and fused by a Bayesian sensor fusion technique based on the probabilistic reliability function of each sensor predefined through experiments. For the self-localization using the monocular vision, the robot utilizes image features consisting of vertical edge lines from input camera images, and they are used as natural landmark points in self-localization process. However, in case of using the laser structured light sensor, it utilizes geometrical features composed of corners and planes as natural landmark shapes during this process, which are extracted from range data at a constant height from the navigation floor. Although only each feature group of them is sometimes useful to localize mobile robots, all features from the two sensors are simultaneously used and fused in term of information for reliable localization under various environment conditions. To verify the advantage of using multi-sensor fusion, a series of experiments are performed, and experimental results are discussed in detail.

A Study on Maximalism in the Modern Fashion - Focused on the 2000s - (현대 패션에 표현된 맥시멀리즘에 관한 연구 - 2000년대를 중심으로 -)

  • Park, Eun-Kyung
    • Journal of the Korean Society of Costume
    • /
    • v.58 no.3
    • /
    • pp.1-18
    • /
    • 2008
  • The tendency of exuberant multi-everything, enormous volumes and decoration has been showed in fashion since the 21st century. This tendency is very interesting in contrast to the tendency of restraint, simplicity and removing decoration which has been showed in the modern fashion throughout the 20th Century and especially minimalism fashion in the 1960s and the 1990s with the expectation of New Millenium. Maximalism is this kind of exuberant expression emerged since 2000. However, studies about maximalism in fashion have not been performed enough. Thus this study tried to analyze the aesthetic characteristics of maximalism in the modern fashion according to the previous studies of maximalism in design and architecture with social cultural background. The scope of this study was from 2000 to 2006, and this study was performed through literature survey with demonstrative analyzation of fashion collection photographs. The results are as follows; Maximalism has the meaning of 'maximum oriented-ism' and has aesthetic view of 'more/bigger is more beautiful.' The formativeness of maximalism in modern fashion was analyzed as fusion, enlargement, decoration, and fantasy. The internal meaning was analyzed as recovery of human being through pursuing of sensibility, fun and newness.

Bird's Eye View Semantic Segmentation based on Improved Transformer for Automatic Annotation

  • Tianjiao Liang;Weiguo Pan;Hong Bao;Xinyue Fan;Han Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.8
    • /
    • pp.1996-2015
    • /
    • 2023
  • High-definition (HD) maps can provide precise road information that enables an autonomous driving system to effectively navigate a vehicle. Recent research has focused on leveraging semantic segmentation to achieve automatic annotation of HD maps. However, the existing methods suffer from low recognition accuracy in automatic driving scenarios, leading to inefficient annotation processes. In this paper, we propose a novel semantic segmentation method for automatic HD map annotation. Our approach introduces a new encoder, known as the convolutional transformer hybrid encoder, to enhance the model's feature extraction capabilities. Additionally, we propose a multi-level fusion module that enables the model to aggregate different levels of detail and semantic information. Furthermore, we present a novel decoupled boundary joint decoder to improve the model's ability to handle the boundary between categories. To evaluate our method, we conducted experiments using the Bird's Eye View point cloud images dataset and Cityscapes dataset. Comparative analysis against stateof-the-art methods demonstrates that our model achieves the highest performance. Specifically, our model achieves an mIoU of 56.26%, surpassing the results of SegFormer with an mIoU of 1.47%. This innovative promises to significantly enhance the efficiency of HD map automatic annotation.

Implementation of Integrated Player System based on Free-Viewpoint Video Service according to User Selection (사용자 선택에 따른 자유 시점 비디오 서비스 기반의 통합 플레이어 시스템 구현)

  • Yang, Ji-hee;Song, Min-ki;Park, Gooman
    • Journal of Broadcast Engineering
    • /
    • v.25 no.2
    • /
    • pp.265-274
    • /
    • 2020
  • Free-viewpoint video service is a technology that allows users to watch at any angle, location and distance through interaction. In this paper, the free-viewpoint video services are defined in four viewing modes: Inward view, outward view, 3D object view and first person view. And we developed and implemented a new integrated program that plays all the suggested views. In the contents of girl band performances and basketball games, multi-view cameras suitable for each viewing mode are installed to acquire media, and data stored on the server is streamed over the network, making it available for viewing. Users can freely choose four viewing modes, space location, angle and so on, and the media data such as images and sounds are provided to them by rendering appropriately for the selected the viewpoint. Our system is expected to be a scalable free-viewpoint video service player as well as provide users with immersion and presence by combining various viewing modes.

A Study on Cubism Fashion Style Appearing in Modern Fashion: Focused on the 2010 S/S-2013 S/S Paris Collection (현대 패션에 나타난 큐비즘스타일패션 연구: 2010 S/S - 2013 S/S 파리컬렉션을 중심으로)

  • Choi, Yeree;Choi, Jeongwook
    • Journal of Fashion Business
    • /
    • v.18 no.2
    • /
    • pp.14-28
    • /
    • 2014
  • This study analyzed the group of experts who were related to cubism, selected among the works of 2010~2013 Paris Collection based on F.G.R.(Focus Group Research). According to the results of this study, there were appeared first, 'a one-piece dress' second, 'H silhouette' third, 'cotton', in case of item distribution and frequency. The analysis was done by using the manner of expression, cubical expression, exaggeration, distortion, dismantlement, geometrical division of face, mix-match look, wraparound repetition, asymmetric structure, etc. Based on the outcomes of the analysis on figurative design elements, this study adjusted three manners appearing on cubism fashion style. First, it was 'avant garde manner' of constitution or 'dismantlement' which was compiled into multi-view representations of overlaps and viewpoints by repetitive use of color tone trimming detail. Second, it was 'geomagnetic block placement' which expresses cubism with geometric partitioning of surface and separation of panel by cutting disintegration. Finally, it was 'distortion and simplification of silhouette' which is a distortion created by constitution-line pressed thin with silhouette. It maximizes the beauty of human body outline, which was distorted by three-dimensional-manipulation, and simplified by ellipsis for another shape for the extension or expansion of detail trimming.

Improving Spatial Resolution in Real-time for Ultra-thin Light Field Cameras (초박형 라이트필드 카메라의 실시간 분해능 향상 알고리즘 개발)

  • Kim, Donggun;Ryu, Jaekwan;Jo, Yongjin;Kim, Min H.
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.3
    • /
    • pp.25-29
    • /
    • 2021
  • 초박형 라이트필드 카메라 시스템은 이미지 센서 위에 렌즈 어레이를 부착하는 방식으로 만들어진다. 이러한 초박형 라이트필드 카메라는 하나의 이미지 센서를 여러 개의 sub-aperture가 나눠쓰는 방식으로 되어있어 개별 이미지의 분해능이 낮으며, sub-aperture 이미지들을 융합해 추가적인 분해능 향상이 수행되어야 한다. 본 연구에서는 초박형 라이트필드 카메라 시스템을 개발했으며, 개발된 카메라 시스템을 위한 실시간 분해능 향상 알고리즘을 개발, 실험을 통해 검증했다. 개발된 초박형 라이트필드 카메라는 두께 2mm, 24개(6×4)의 551×551 해상도의 sub-aperture로 구성되어 있으며, 임베디드 컴퓨팅 보드를 사용해 휴대가 가능하도록 제작되었다. 실시간 분해능 향상 알고리즘은 임베디드 컴퓨팅 보드의 GPU에서 병렬처리를 통해 라플라시안 피라미드 기반의 이미지 융합 알고리즘을 수행한다. 실험을 통해 검증한 결과로, 개발 시스템은 MTF50값이 평균 35% 정도 개선되었으며, 10.65fps의 처리속도로 실시간 처리가 가능함을 확인했다.