• Title/Summary/Keyword: 3-D pose

Search Result 337, Processing Time 0.034 seconds

3D Face Modeling based on 3D Morphable Shape Model (3D 변형가능 형상 모델 기반 3D 얼굴 모델링)

  • Jang, Yong-Suk;Kim, Boo-Gyoun;Cho, Seong-Won;Chung, Sun-Tae
    • The Journal of the Korea Contents Association
    • /
    • v.8 no.1
    • /
    • pp.212-227
    • /
    • 2008
  • Since 3D face can be rotated freely in 3D space and illumination effects can be modeled properly, 3D face modeling Is more precise and realistic in face pose, illumination, and expression than 2D face modeling. Thus, 3D modeling is necessitated much in face recognition, game, avatar, and etc. In this paper, we propose a 3D face modeling method based on 3D morphable shape modeling. The proposed 3D modeling method first constructs a 3D morphable shape model out of 3D face scan data obtained using a 3D scanner Next, the proposed method extracts and matches feature points of the face from 2D image sequence containing a face to be modeled, and then estimates 3D vertex coordinates of the feature points using a factorization based SfM technique. Then, the proposed method obtains a 3D shape model of the face to be modeled by fitting the 3D vertices to the constructed 3D morphable shape model. Also, the proposed method makes a cylindrical texture map using 2D face image sequence. Finally, the proposed method builds a 3D face model by rendering the 3D face shape model with the cylindrical texture map. Through building processes of 3D face model by the proposed method, it is shown that the proposed method is relatively easy, fast and precise than the previous 3D face model methods.

A GAN-based face rotation technique using 3D face model for game characters (3D 얼굴 모델 기반의 GAN을 이용한 게임 캐릭터 회전 기법)

  • Kim, Handong;Han, Jongdae;Yang, Heekyung;Min, Kyungha
    • Journal of Korea Game Society
    • /
    • v.21 no.3
    • /
    • pp.13-24
    • /
    • 2021
  • This paper shows the face rotation applicable to game character facial illustration. Existing studies limited data to human face data, required a large amount of data, and the synthesized results were not good. In this paper, the following method was introduced to solve the existing problems of existing studies. First, a 3D model with features of the input image was rotated and then rendered as a 2D image to construct a data set. Second, by designing GAN that can learn features of various poses from the data built through the 3D model, the input image can be synthesized at a desired pose. This paper presents the results of synthesizing the game character face illustration. From the synthesized result, it can be confirmed that the proposed method works well.

Geometrical Featured Voxel Based Urban Structure Recognition and 3-D Mapping for Unmanned Ground Vehicle (무인 자동차를 위한 기하학적 특징 복셀을 이용하는 도시 환경의 구조물 인식 및 3차원 맵 생성 방법)

  • Choe, Yun-Geun;Shim, In-Wook;Ahn, Seung-Uk;Chung, Myung-Jin
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.5
    • /
    • pp.436-443
    • /
    • 2011
  • Recognition of structures in urban environments is a fundamental ability for unmanned ground vehicles. In this paper we propose the geometrical featured voxel which has not only 3-D coordinates but also the type of geometrical properties of point cloud. Instead of dealing with a huge amount of point cloud collected by range sensors in urban, the proposed voxel can efficiently represent and save 3-D urban structures without loss of geometrical properties. We also provide an urban structure classification algorithm by using the proposed voxel and machine learning techniques. The proposed method enables to recognize urban environments around unmanned ground vehicles quickly. In order to evaluate an ability of the proposed map representation and the urban structure classification algorithm, our vehicle equipped with the sensor system collected range data and pose data in campus and experimental results have been shown in this paper.

Robust Real-Time Visual Odometry Estimation for 3D Scene Reconstruction (3차원 장면 복원을 위한 강건한 실시간 시각 주행 거리 측정)

  • Kim, Joo-Hee;Kim, In-Cheol
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.4 no.4
    • /
    • pp.187-194
    • /
    • 2015
  • In this paper, we present an effective visual odometry estimation system to track the real-time pose of a camera moving in 3D space. In order to meet the real-time requirement as well as to make full use of rich information from color and depth images, our system adopts a feature-based sparse odometry estimation method. After matching features extracted from across image frames, it repeats both the additional inlier set refinement and the motion refinement to get more accurate estimate of camera odometry. Moreover, even when the remaining inlier set is not sufficient, our system computes the final odometry estimate in proportion to the size of the inlier set, which improves the tracking success rate greatly. Through experiments with TUM benchmark datasets and implementation of the 3D scene reconstruction application, we confirmed the high performance of the proposed visual odometry estimation method.

A study on pattern and 3D restoration of Chinese traditional women's robe, straight Ju(直裾深衣) (중국 전통 귀족 여성 예복인 직거심의(直裾深衣)의 패턴 및 3D 복원 연구)

  • Sun Yuan;Jihyeon Kim;Mi-hyang Na
    • Journal of the Korea Fashion and Costume Design Association
    • /
    • v.25 no.4
    • /
    • pp.107-122
    • /
    • 2023
  • This study analyzed the style, dimensions, fabric patterns, colors, and fabrics of a traditional Chinese women's dress from the Zhou Dynasty, and reconstructed it in the form of a virtual garment using 3D CLO. Based on ancient flat image data and three-dimensional portrait data, who wore them, how they were worn, and how they were coordinated was analyzed. In order to analyze the size and pattern of the straight Ju Chines dress, data from the excavation report and the tomb owner's anthropometric measurements were combined to infer the wearing condition and organize the sculptural features. Dimensional analysis was carried out using a well-preserved small-scale woven cotton cloth as a restoration model, and the horizontal and vertical dimensions were reasonably estimated using the shape proportioning method. The analysis of the colors and patterns of the fabrics was based on the colors and patterns of the fabrics excavated from Masan Tomb No. 1 during the Eastern Zhou, Qin, and Han periods. Finally, a virtual model was created using data from the excavation report and the age and height information of the owner of the excavated robe, and the pose and size of the virtual model were determined using 3D CLO. Based on the previous research data, the garment was virtually sewn and simulated. The shape, pressure, and strain of the garment in different postures was also compared. Through the research direction of pattern and 3D restoration, this research maximizes the restoration of Chinese traditional women's dress and presents it in a more intuitive, comprehensive, and vivid way.

Characterization of Binding Mode for Human Coagulation Factor XI (FXI) Inhibitors

  • Cho, Jae Eun;Kim, Jun Tae;Jung, Seo Hee;Kang, Nam Sook
    • Bulletin of the Korean Chemical Society
    • /
    • v.34 no.4
    • /
    • pp.1212-1220
    • /
    • 2013
  • The human coagulation factor XI (FXI) is a serine protease that plays a significant role in blocking of the blood coagulation cascade as an attractive antithrombotic target. Selective inhibition of FXIa (an activated form of factor XI) disrupts the intrinsic coagulation pathway without affecting the extrinsic pathway or other coagulation factors such as FXa, FIIa, FVIIa. Furthermore, targeting the FXIa might significantly reduce the bleeding side effects and improve the safety index. This paper reports on a docking-based three dimensional quantitative structure activity relationship (3D-QSAR) study of the potent FXIa inhibitors, the chloro-phenyl tetrazole scaffold series, using comparative molecular field analysis (CoMFA) and comparative molecular similarity analysis (CoMSIA) methods. Due to the characterization of FXIa binding site, we classified the alignment of the known FXIa inhibitors into two groups according to the docked pose: S1-S2-S4 and S1-S1'-S2'. Consequently, highly predictive 3D-QSAR models of our result will provide insight for designing new potent FXIa inhibitors.

Efficient Reconstruction of 3D Human Body Pose Using Spatio-Temporal Features (시-공간 특징을 이용한 효율적인 3차원 인체 자세 재구성)

  • Yang Hee-Deok;Ahmad Mohiuddin;Lee Seong-Whan
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2005.11b
    • /
    • pp.892-894
    • /
    • 2005
  • 본 논문에서는 스테레오 영상에서 깊이 정보를 추출하여 사람의 자세를 학습된 2차원 깊이 영상들의 선형 결함으로 표현하여 3차원 인체 모델을 재구성하는 방법을 제안한다. 한 장의 2차원 깊이 영상으로 최소 제곱법을 이용하여 프로토타입 깊이 영상의 선형 결합으로 표현되는 최적의 계수를 찾을 수 있다. 입력된 깊이 영상의 3차원 인체 모델은 프로토타입 깊이 영상에서 예측된 계수를 적용하여 생성한다. 학습 단계에서는 데이터를 계층적으로 나누어 모델을 생성한다. 또한, 재구성 단계에서는 실루엣 영상과 깊이 영상으로부터 계층적으로 나누어진 학습 데이터를 이용하여 3차원 인체 자세를 재구성한다. 학습 및 재구성의 마지막 단계에서는 실루엣 영상 대신 깊이 영상을 이용하여 3차원 인체 모델을 재구성한다. 한 장의 실루엣 영상을 이용하면 영상의 노이즈에 민감하기 때문에 재구성 단계의 상위 레벨에서는 실루엣 영상의 누적 영상을 이용한다. 실험 결과는 제안된 방법이 효율적으로 3차원 인체 자세를 재구성함을 보여준다.

  • PDF

3D-QSAR, Docking and Molecular Dynamics Simulation Study of C-Glycosylflavones as GSK-3β Inhibitors

  • Ghosh, Suparna;Keretsu, Seketoulie;Cho, Seung Joo
    • Journal of Integrative Natural Science
    • /
    • v.13 no.4
    • /
    • pp.170-180
    • /
    • 2020
  • Abnormal regulation, hyperphosphorylation, and aggregation of the tau protein are the hallmark of several types of dementia, including Alzheimer's Disease. Increased activity of Glycogen Synthase Kinase-3β (GSK-3β) in the Central Nervous System (CNS), increased the tau hyperphosphorylation and caused the neurofibrillary tangles (NFTs) formation in the brain cells. Over the last two decades, numerous adenosine triphosphate (ATP) competitive inhibitors have been discovered that show inhibitory activity against GSK-3β. But these compounds exhibited off-target effects which motivated researchers to find new GSK-3β inhibitors. In the present study, we have collected the dataset of 31 C-Glycosylflavones derivatives that showed inhibitory activity against GSK-3β. Among the dataset, the most active compound was docked with the GSK-3β and molecular dynamics (MD) simulation was performed for 50 ns. Based on the 50 ns MD pose of the most active compound, the other dataset compounds were sketched, minimized, and aligned. The 3D-QSAR based Comparative Molecular Field Analysis (CoMFA) model was developed, which showed a reasonable value of q2=0.664 and r2=0.920. The contour maps generated based on the CoMFA model elaborated on the favorable substitutions at the R2 position. This study could assist in the future development of new GSK-3β inhibitors.

Realtime Markerless 3D Object Tracking for Augmented Reality (증강현실을 위한 실시간 마커리스 3차원 객체 추적)

  • Min, Jae-Hong;Islam, Mohammad Khairul;Paul, Anjan Kumar;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.14 no.2
    • /
    • pp.272-277
    • /
    • 2010
  • AR(Augmented Reality) needs medium between real and virtual, world, and recognition techniques are necessary to track an object continuously. Optical tracking using marker is mainly used, but it takes time and is inconvenient to attach marker onto the target objects. Therefore, many researchers try to develop markerless tracking techniques nowaday. In this paper, we extract features and 3D position from 3D objects and suggest realtime tracking based on these features and positions, which do not use just coplanar features and 2D position. We extract features using SURF, get rotation matrix and translation vector of 3D object using POSIT with these features and track the object in real time. If the extracted features are nor enough and it fail to track the object, then new features are extracted and re-matched to recover the tracking. Also, we get rotation in matrix and translation vector of 3D object using POSIT and track the object in real time.

Object Recognition Method for Industrial Intelligent Robot (산업용 지능형 로봇의 물체 인식 방법)

  • Kim, Kye Kyung;Kang, Sang Seung;Kim, Joong Bae;Lee, Jae Yeon;Do, Hyun Min;Choi, Taeyong;Kyung, Jin Ho
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.30 no.9
    • /
    • pp.901-908
    • /
    • 2013
  • The introduction of industrial intelligent robot using vision sensor has been interested in automated factory. 2D and 3D vision sensors have used to recognize object and to estimate object pose, which is for packaging parts onto a complete whole. But it is not trivial task due to illumination and various types of objects. Object image has distorted due to illumination that has caused low reliability in recognition. In this paper, recognition method of complex shape object has been proposed. An accurate object region has detected from combined binary image, which has achieved using DoG filter and local adaptive binarization. The object has recognized using neural network, which is trained with sub-divided object class according to object type and rotation angle. Predefined shape model of object and maximal slope have used to estimate the pose of object. The performance has evaluated on ETRI database and recognition rate of 96% has obtained.