• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.12C
• /
• pp.1147-1153
• /
• 2009

We propose a novel image segmentation and segment-based stereo matching technique using color, depth, and motion information. Proposed technique firstly splits reference images into foreground region or background region using depth information from depth camera. Then each region is segmented into small segments with color information. Moreover, extracted segments in current frame are tracked in the next frame in order to maintain depth consistency between frames. The initial depth from the depth camera is also used to set the depth search range for stereo matching. Proposed segment-based stereo matching technique was compared with conventional one without foreground and background separation and other conventional one without motion tracking of segments. Simulation results showed that the improvement of segment extraction and depth estimation consistencies by proposed technique compared to conventional ones especially at the static background region.

• Journal of Broadcast Engineering
• /
• v.16 no.1
• /
• pp.44-53
• /
• 2011

In this paper, we propose a 3D conversion algorithm of 2D video using depth layer partition method. In the proposed algorithm, we first set frame groups using cut detection algorithm. Each divided frame groups will reduce the possibility of error propagation in the process of motion estimation. Depth image generation is the core technique in 2D/3D conversion algorithm. Therefore, we use two depth map generation algorithms. In the first, segmentation and motion information are used, and in the other, edge directional histogram is used. After applying depth layer partition algorithm which separates objects(foreground) and the background from the original image, the extracted two depth maps are properly merged. Through experiments, we verify that the proposed algorithm generates reliable depth map and good conversion results.

• Journal of Biomedical Engineering Research
• /
• v.32 no.2
• /
• pp.144-150
• /
• 2011

The primary purpose of this study was to analyze the motion of the scaphoid, capitate, and lunate during dart-throwing motion by three-dimensional modeling. Five series of CT images of five normal right wrists were acquired from five motion steps from radial extension to ulnar flexion in the dart-throwing motion plane. Segmentation and three-dimensional modeling of bones from CT images was performed using Analyze. Distances among centroids of the scaphoid, capitate and lunate and angles between principal axes of three carpal bones were calculated to analyze the motion by using MATLAB. As the wrist motion changed from radial extension to ulnar flexion, the distance between two adjacent bones decreased. The scaphoid and lunate rotated less than the capitates during dart-throwing motion. This study reports the Three-dimensional in vivo measurement of carpal motion using CT images.

• Proceedings of the IEEK Conference
• /
• 2001.06d
• /
• pp.89-92
• /
• 2001

In this paper, we propose a new approach for tracking a moving object in moving image sequences using active contour models and optical flow. In our approach object segmentation is achieved by active contours, and object tracking is done by motion estimation based on optical flow. To get more dynamic characteristics, Lagrangian dynamics combined to the active contour models. For the optical flow computation, a method, which is based on Spatiotempo-ral Energy Models, is employed to perform robust tracking under poor environments. A prototype real tracking system has been developed and applied to a contents-based video retrieval systems.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1998.06b
• /
• pp.29-33
• /
• 1998

In this paper, we propose a hierarchical segmentation method for tracking a semantic video object using a watershed algorithm based on morphological filtering. In the proposed method, each hierarchy consists of three steps: First, markers are extracted on the simplified current frame. Second, region growing by a modified watershed algorithm is performed for segmentation. Finally, the segmented regions are classified into 3 categories, i.e., inside, outside, and uncertain regions according to region probability values, which are acquired by the probability map calculated from a estimated motion field. Then, for the remaining uncertain regions, the above three steps are repeated at lower hierarchies with less simplified frames until every region is decided to a certain region. The proposed algorithm provides prospective results in video sequences such as Miss America, Clair, and Akiyo.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2018.10a
• /
• pp.441-443
• /
• 2018

This paper deals with the analysis of leg motion using RGB image. We used RGB image as gait analysis element by using BMC(Background Model Challenge) method and by using combining object recognition segmentation algorithm and attitude detection algorithm. It is considered that gait analysis incorporating image can be used as a parameter for classification of gait pattern recognition and abnormal gait.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.04b
• /
• pp.766-768
• /
• 2004

동영상에서 객체의 추출은 객체 단위로 압축하는 MPEG-4와 객체의 특성을 기술하고 유사한 영상을 검색하는 기능을 가진 MPEG-7에 기반 기술로, 동영상의 효과적인 압축 및 색인, 검색에 유용하게 사용되는 방법이다. 본 논문에서는 시간적 정보와 공간적 정보를 이용한 영상 분할 방법을 제시한다. 동영상은 배경 화면과 전방 객체로 이루어져 있는데, 여기서 프레임간 모션벡터로 글로벌영상(배경영상)의 움직임을 분리할 수 있다. 이 Motion-based Segmentation을 통해 배경과 전방객체를 분리하여 rough한 전방객체를 추출하게 된다. 그리고 시간적 분할을 통해 얻은 rough한 전방객체에 모폴로지 변환과 Watershed 알고리즘을 적용하여 배경과 전방객체의 모호한 부분을 제거함으로써 효과적으로 전방객체를 추출한다.

• Journal of the Korea Computer Graphics Society
• /
• v.15 no.4
• /
• pp.31-40
• /
• 2009

Captured motion data is widely used today in a variety of areas including film production, game development, sports analysis, and medical rehabilitation. The ability of analyzing and processing motion data has increased rapidly for last decades. However, it is still difficult for users to quickly understand the contents of motion data consisting of a series of time-varying poses. One typical approach is to visualize consecutive poses in sequence while adjusting three-dimensional view, which is often time-consuming and laborious especially when users need to repeatedly control time and view in order to search for desired motions. We present a method of visualizing motion data as a sequence of images in comic book layout so that users can rapidly understand the overall flows of motion data, and easily identify their desired motions. The usefulness of our approach is demonstrated by visualizing various kinds of motion data including locomotion, boxing, and interaction with environments.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.396-401
• /
• 2009

This paper describes the improvements made on hardware and software of the remote controller for realistic contents. The controller can provide vibrotactile feedback which uses both of a voice-coil actuator and a vibration motor. A vision tracking system for the 3D position of the controller is optimized with respect to the marker size and the camera parameters. We also present the improvements of motion recognition due to the effective motion segmentation and the fusion of vision and acceleration data. We apply the developed controller to realistic contents and validate its usability.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.2
• /
• pp.11-23
• /
• 2011

In this paper, an accurate and fully automatic video object segmentation method is proposed for video conferencing systems in which the real-time performance is required. The proposed method consists of two steps: 1) accurate object extraction on the initial frame, 2) real-time object extraction from the next frame using the result of the first step. Object extraction on the initial frame starts with generating a cumulative edge map obtained from frame differences in the beginning. This is because we can estimate the initial shape of the foreground object from the cumulative motion. This estimated shape is used to assign the seeds for both object and background, which are needed for Graph-Cut segmentation. Once the foreground object is extracted by Graph-Cut segmentation, real-time object extraction is conducted using the extracted object and the double edge map obtained from the difference between two successive frames. Experimental results show that the proposed method is suitable for real-time processing even in VGA resolution videos contrary to previous methods, being a useful tool for immersive video conferencing systems.