• Title/Summary/Keyword: Depth Information Matching

Search Result 181, Processing Time 0.032 seconds

A Real-time Face Tracking Algorithm using Improved CamShift with Depth Information

  • Lee, Jun-Hwan;Jung, Hyun-jo;Yoo, Jisang
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.5
    • /
    • pp.2067-2078
    • /
    • 2017
  • In this paper, a new face tracking algorithm is proposed. The CamShift (Continuously adaptive mean SHIFT) algorithm shows unstable tracking when there exist objects with similar color to that of face in the background. This drawback of the CamShift is resolved by the proposed algorithm using Kinect's pixel-by-pixel depth information and the skin detection method to extract candidate skin regions in HSV color space. Additionally, even when the target face is disappeared, or occluded, the proposed algorithm makes it robust to this occlusion by the feature point matching. Through experimental results, it is shown that the proposed algorithm is superior in tracking performance to that of existing TLD (Tracking-Learning-Detection) algorithm, and offers faster processing speed. Also, it overcomes all the existing shortfalls of CamShift with almost comparable processing time.

The IP development for the real-time process of SoC image protection system (SoC 영상 보안 시스템의 실시간 처리를 위한 IP 개발)

  • Jung, Kwang-Sung;Moon, Cheol-Hong
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.605-606
    • /
    • 2008
  • The distance detection system receives stereo video input through 2 CCD cameras. Using a decoder, the image is changed to the YCbCr4:2:2 format and only the Y signal is saved in the 4*256*8bit shift register of the Dual-Port SRAM. As a result of the matching procedure, the Depth value, which is the distance information, is saved in SRAM, and the Depth Map is made and output to the TFT-LCD screen.

  • PDF

An improved Boolean Circuit for Maximum Matching in Convex Bipartite Graphs (볼록 이분할 그래프에서 최대 매칭을 찾기 위한 개선된 Boolean 회로)

  • Park Eun-Hui;Park Kun-Soo
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2006.06a
    • /
    • pp.403-405
    • /
    • 2006
  • Boolean 회로는 parallel 알고리즘을 위한 단순하면서도 실제적인 모델이다. Chung & Lee은 Boolean 회로 모델에서 볼록 이분할 그래프를 위한 최대 매칭을 찾는 O($log^2n+logn$ loglogn logb)depth와 $O(bn^3)$ size의 알고리즘을 제시하였다. 본 논문에서는 prefix compulsion 및 ASCEND, odd-even-merge의 방법을 이용하여 이를 개선한 O($log^2n$ logb) depth, O($bn^2$ logn) size의 최대 매칭 알고리즘을 제시한다.

  • PDF

A Study on the Depth Map using Single Edge (단일 엣지를 이용한 깊이 정보에 관한 연구)

  • Kim, Young-Seop;Song, Eung-Yeol
    • Journal of the Semiconductor & Display Technology
    • /
    • v.9 no.2
    • /
    • pp.123-126
    • /
    • 2010
  • An implementation of modified stereo matching using efficient belief propagation (BP) algorithm is presented in this paper. We do recommend the use of the simple sobel, prewitt edge operator. The application of B band sobel edge operator over image demonstrates result with somewhat noisy (distinct border). When we adopt the only MRF + BP algorithm, however, borders cannot be distinguished due to that the message functions in the BP algorithm is just the mechanism which passes energy data to the only large gap of each Message functions In order to address the abovementioned disadvantageous phenomenon, we use the sobel edge operator + MRF + BP algorithm to distinguish the border that is located between the similar message data. Using edge information, the result shows that our proposed process diminishes the propagation of wrong probabilistic information. The enhanced result is due to that our proposed method effectively reduced errors incurred by ambiguous scene properties.

Application of Stereo Vision for Shape Measurement of Free-form Surface using Shape-from-shading (자유곡면의 형상 측정에서 shape-from-shading을 접목한 스테레오 비전의 적용)

  • Yang, Young-Soo;Bae, Kang-Yul
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.16 no.5
    • /
    • pp.134-140
    • /
    • 2017
  • Shape-from-shading (SFS) or stereo vision algorithms can be utilized to measure the shape of an object with imaging techniques for effective sensing in non-contact measurements. SFS algorithms could reconstruct the 3D information from a 2D image data, offering relatively comprehensive information. Meanwhile, a stereo vision algorithm needs several feature points or lines to extract 3D information from two 2D images. However, to measure the size of an object with a freeform surface, the two algorithms need some additional information, such as boundary conditions and grids, respectively. In this study, a stereo vision scheme using the depth information obtained by shape-from-shading as patterns was proposed to measure the size of an object with a freeform surface. The feasibility of the scheme was proved with an experiment where the images of an object were acquired by a CCD camera at two positions, then processed by SFS, and finally by stereo matching. The experimental results revealed that the proposed scheme could recognize the size and shape of freeform surface fairly well.

An Algorithm to Obtain Location Information of Objects with Concentric Noise Patterns (동심원 잡음패턴을 가진 물체의 위치정보획득 알고리즘)

  • 심영석;문영식;박성한
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.11
    • /
    • pp.1393-1404
    • /
    • 1995
  • For the factory automation(FA) of production or assembly lines, computer vision techniques have been widely used for the recognition and position-control of objects. In this application, it is very important to analyze characteristic features of each object and to find an efficient matching algorithm using the selected features. If the object has regular or homogeneous patterns, the problem is relatively simple. However, If the object is shifted or rotated, and if the depth of the input visual system is not fixed, the problem becomes very complicated. Also, in order to understand and recognize objects with concentric noise patterns, it is more effective to use feature-information represented in polar coordinates than in cartesian coordinates. In this paper, an algorithm for the recognition of objects with concentric circular noise-patterns is proposed. And position-conrtol information is calculated with the matching result. First, a filtering algorithm for eliminating concentric noise patterns is proposed to obtain concentric-feature patterns. Then a shift, rotation and scale invariant alogrithm is proposed for the recognition and position-control of objects uusing invariant feature information. Experimental results indicate the effectiveness of the proposed alogrithm.

  • PDF

Integrated Color Matching in Stereoscopic Image by Combining Local and Global Color Compensation (지역과 전역적인 색보정을 결합한 스테레오 영상에서의 색 일치)

  • Shu, Ran;Ha, Ho-Gun;Kim, Dae-Chul;Ha, Yeong-Ho
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.12
    • /
    • pp.168-175
    • /
    • 2013
  • Color consistency in stereoscopic contents is important for 3D display systems. Even with a stereo camera of the same model and with the same hardware settings, complex color discrepancies occur when acquiring high quality stereo images. In this paper, we propose an integrated color matching method that use cumulative histogram in global matching and estimated 3D-distance for the stage of local matching. The distance between the current pixel and the target local region is computed using depth information and the spatial distance in the 2D image plane. The 3D-distance is then used to determine the similarity between the current pixel and the target local region. The overall algorithm is described as follow; First, the cumulative histogram matching is introduced for reducing global color discrepancies. Then, the proposed local color matching is established for reducing local discrepancies. Finally, a weight-based combination of global and local matching is computed. Experimental results show the proposed algorithm has improved global and local error correction performance for stereoscopic contents with respect to other approaches.

MultiView-Based Hand Posture Recognition Method Based on Point Cloud

  • Xu, Wenkai;Lee, Ick-Soo;Lee, Suk-Kwan;Lu, Bo;Lee, Eung-Joo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.7
    • /
    • pp.2585-2598
    • /
    • 2015
  • Hand posture recognition has played a very important role in Human Computer Interaction (HCI) and Computer Vision (CV) for many years. The challenge arises mainly due to self-occlusions caused by the limited view of the camera. In this paper, a robust hand posture recognition approach based on 3D point cloud from two RGB-D sensors (Kinect) is proposed to make maximum use of 3D information from depth map. Through noise reduction and registering two point sets obtained satisfactory from two views as we designed, a multi-viewed hand posture point cloud with most 3D information can be acquired. Moreover, we utilize the accurate reconstruction and classify each point cloud by directly matching the normalized point set with the templates of different classes from dataset, which can reduce the training time and calculation. Experimental results based on posture dataset captured by Kinect sensors (from digit 1 to 10) demonstrate the effectiveness of the proposed method.

Performance Improvement of Offline Phase for Indoor Positioning Systems Using Asus Xtion and Smartphone Sensors

  • Yeh, Sheng-Cheng;Chiou, Yih-Shyh;Chang, Huan;Hsu, Wang-Hsin;Liu, Shiau-Huang;Tsai, Fuan
    • Journal of Communications and Networks
    • /
    • v.18 no.5
    • /
    • pp.837-845
    • /
    • 2016
  • Providing a customer with tailored location-based services (LBSs) is a fundamental problem. For location-estimation techniques with radio-based measurements, LBS applications are widely available for mobile devices (MDs), such as smartphones, enabling users to run multi-task applications. LBS information not only enables obtaining the current location of an MD but also provides real-time push-pull communication service. For indoor environments, localization technologies based on radio frequency (RF) pattern-matching approaches are accurate and commonly used. However, to survey radio information for pattern-matching approaches, a considerable amount of time and work is spent in indoor environments. Consequently, in order to reduce the system-deployment cost and computing complexity, this article proposes an indoor positioning approach, which involves using Asus Xtion to facilitate capturing RF signals during an offline site survey. The depth information obtained using Asus Xtion is utilized to estimate the locations and predict the received signal strength (RF information) at uncertain locations. The proposed approach effectively reduces not only the time and work costs but also the computing complexity involved in determining the orientation and RF during the online positioning phase by estimating the user's location by using a smartphone. The experimental results demonstrated that more than 78% of time was saved, and the number of samples acquired using the proposed method during the offline phase was twice as much as that acquired using the conventional method. For the online phase, the location estimates have error distances of less than 2.67 m. Therefore, the proposed approach is beneficial for use in various LBS applications.

Detection of View Reversal in a Stereo Video (스테레오 동영상에서의 좌우 영상 바뀜 검출 기법)

  • Son, Ji Deok;Song, Byung Cheol
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.5
    • /
    • pp.191-198
    • /
    • 2013
  • This paper proposes detection of view reversal in a stereo video using depth map and motion vector information. We obtain a depth map by using a stereo matching and divide the input image into foreground and background. Next, we obtain a motion vector field by using a motion estimation. In general, an occluded region is in background when foreground goes toward the adjacent background or the background goes toward the adjacent foreground. But, we will face with the change of foreground and background because their depths also change when view reversal occurs. Therefore, we can detect the view reversal in stereo videos by using the observation that the foreground goes toward the adjacent background or the background goes toward the adjacent foreground. The experimental results show that the proposed algorithm achieves good detection rate when the background region is sufficiently occluded by the moving foreground.