• Title/Summary/Keyword: warping

Search Result 754, Processing Time 0.029 seconds

Structural RC computer aided intelligent analysis and computational performance via experimental investigations

  • Y.C. Huang;M.D. TuMuli Lulios;Chu-Ho Chang;M. Nasir Noor;Jen-Chung Shao;Chien-Liang Chiu;Tsair-Fwu Lee;Renata Wang
    • Structural Engineering and Mechanics
    • /
    • v.90 no.3
    • /
    • pp.253-261
    • /
    • 2024
  • This research explores a new finite element model for the free vibration analysis of bi-directional functionally graded (BDFG) beams. The model is based on an efficient higher-order shear deformation beam theory that incorporates a trigonometric warping function for both transverse shear deformation and stress to guarantee traction-free boundary conditions without the necessity of shear correction factors. The proposed two-node beam element has three degrees of freedom per node, and the inter-element continuity is retained using both C1 and C0 continuities for kinematics variables. In addition, the mechanical properties of the (BDFG) beam vary gradually and smoothly in both the in-plane and out-of-plane beam's directions according to an exponential power-law distribution. The highly elevated performance of the developed model is shown by comparing it to conceptual frameworks and solution procedures. Detailed numerical investigations are also conducted to examine the impact of boundary conditions, the bi-directional gradient indices, and the slenderness ratio on the free vibration response of BDFG beams. The suggested finite element beam model is an excellent potential tool for the design and the mechanical behavior estimation of BDFG structures.

Region of Interest Extraction and Bilinear Interpolation Application for Preprocessing of Lipreading Systems (입 모양 인식 시스템 전처리를 위한 관심 영역 추출과 이중 선형 보간법 적용)

  • Jae Hyeok Han;Yong Ki Kim;Mi Hye Kim
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.4
    • /
    • pp.189-198
    • /
    • 2024
  • Lipreading is one of the important parts of speech recognition, and several studies have been conducted to improve the performance of lipreading in lipreading systems for speech recognition. Recent studies have used method to modify the model architecture of lipreading system to improve recognition performance. Unlike previous research that improve recognition performance by modifying model architecture, we aim to improve recognition performance without any change in model architecture. In order to improve the recognition performance without modifying the model architecture, we refer to the cues used in human lipreading and set other regions such as chin and cheeks as regions of interest along with the lip region, which is the existing region of interest of lipreading systems, and compare the recognition rate of each region of interest to propose the highest performing region of interest In addition, assuming that the difference in normalization results caused by the difference in interpolation method during the process of normalizing the size of the region of interest affects the recognition performance, we interpolate the same region of interest using nearest neighbor interpolation, bilinear interpolation, and bicubic interpolation, and compare the recognition rate of each interpolation method to propose the best performing interpolation method. Each region of interest was detected by training an object detection neural network, and dynamic time warping templates were generated by normalizing each region of interest, extracting and combining features, and mapping the dimensionality reduction of the combined features into a low-dimensional space. The recognition rate was evaluated by comparing the distance between the generated dynamic time warping templates and the data mapped to the low-dimensional space. In the comparison of regions of interest, the result of the region of interest containing only the lip region showed an average recognition rate of 97.36%, which is 3.44% higher than the average recognition rate of 93.92% in the previous study, and in the comparison of interpolation methods, the bilinear interpolation method performed 97.36%, which is 14.65% higher than the nearest neighbor interpolation method and 5.55% higher than the bicubic interpolation method. The code used in this study can be found a https://github.com/haraisi2/Lipreading-Systems.

Synthesis of Realistic Facial Expression using a Nonlinear Model for Skin Color Change (비선형 피부색 변화 모델을 이용한 실감적인 표정 합성)

  • Lee Jeong-Ho;Park Hyun;Moon Young-Shik
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.43 no.3 s.309
    • /
    • pp.67-75
    • /
    • 2006
  • Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance. Since it is difficult to generate realistic facial expressions by using only geometric deformations, detailed features such as textures should also be deformed to achieve more realistic expression. The existing methods such as the expression ratio image have drawbacks, in that detailed changes of complexion by lighting can not be generated properly. In this paper, we propose a nonlinear model for skin color change and a model-based synthesis method for facial expression that can apply realistic expression details under different lighting conditions. The proposed method is composed of the following three steps; automatic extraction of facial features using active appearance model and geometric deformation of expression using warping, generation of facial expression using a model for nonlinear skin color change, and synthesis of original face with generated expression using a blending ratio that is computed by the Euclidean distance transform. Experimental results show that the proposed method generate realistic facial expressions under various lighting conditions.

A Robust Depth Map Upsampling Against Camera Calibration Errors (카메라 보정 오류에 강건한 깊이맵 업샘플링 기술)

  • Kim, Jae-Kwang;Lee, Jae-Ho;Kim, Chang-Ick
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.8-17
    • /
    • 2011
  • Recently, fusion camera systems that consist of depth sensors and color cameras have been widely developed with the advent of a new type of sensor, time-of-flight (TOF) depth sensor. The physical limitation of depth sensors usually generates low resolution images compared to corresponding color images. Therefore, the pre-processing module, such as camera calibration, three dimensional warping, and hole filling, is necessary to generate the high resolution depth map that is placed in the image plane of the color image. However, the result of the pre-processing step is usually inaccurate due to errors from the camera calibration and the depth measurement. Therefore, in this paper, we present a depth map upsampling method robust these errors. First, the confidence of the measured depth value is estimated by the interrelation between the color image and the pre-upsampled depth map. Then, the detailed depth map can be generated by the modified kernel regression method which exclude depth values having low confidence. Our proposed algorithm guarantees the high quality result in the presence of the camera calibration errors. Experimental comparison with other data fusion techniques shows the superiority of our proposed method.

Strength and Lateral Torsional Behavior of Horizontally Curved Steel I-Girders Subjected to Equal End Moments (양단 균일 모멘트를 받는 수평곡선 I형 강재 거더의 횡-비틀림 거동 및 강도 산정 방안)

  • Lee, Keesei;Lee, Manseop;Choi, Junho;Kang, Youngjong
    • Journal of Korean Society of Steel Construction
    • /
    • v.30 no.1
    • /
    • pp.1-12
    • /
    • 2018
  • A curved member should resist bending and torsional moments simultaneously even though the primary load is usually supposed to be gravitational load. The torsional moment causes complicate stress state and also can result in early yielding of material to reduce member strength. According to analysis results, the strength of a curved member that has 45 degrees of subtended angle could decrease more than 50% compare to straight girder. Nevertheless, there have been very few of researches related with ultimate strength of curved girders. In this study, various kinds of stiffness about bending, pure torsion and warping were considered with a number of models in order to verify the main factor that affects ultimate behavior of curved girder. Lateral and rotational displacement of curved member were introduced as lateral-torsional-vertical behavior and bending-torsional moment interaction curve was derived. Finally, a strength equation for ultimate moment of horizontally curved steel I-girders subjected to equal end moments based on the interaction curves. The equation could take account of the effect of curvature, unbraced length and sectional properties.

Speaker-Adaptive Speech Synthesis based on Fuzzy Vector Quantizer Mapping and Neural Networks (퍼지 벡터 양자화기 사상화와 신경망에 의한 화자적응 음성합성)

  • Lee, Jin-Yi;Lee, Gwang-Hyeong
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.1
    • /
    • pp.149-160
    • /
    • 1997
  • This paper is concerned with the problem of speaker-adaptive speech synthes is method using a mapped codebook designed by fuzzy mapping on FLVQ (Fuzzy Learning Vector Quantization). The FLVQ is used to design both input and reference speaker's codebook. This algorithm is incorporated fuzzy membership function into the LVQ(learning vector quantization) networks. Unlike the LVQ algorithm, this algorithm minimizes the network output errors which are the differences of clas s membership target and actual membership values, and results to minimize the distances between training patterns and competing neurons. Speaker Adaptation in speech synthesis is performed as follow;input speaker's codebook is mapped a reference speaker's codebook in fuzzy concepts. The Fuzzy VQ mapping replaces a codevector preserving its fuzzy membership function. The codevector correspondence histogram is obtained by accumulating the vector correspondence along the DTW optimal path. We use the Fuzzy VQ mapping to design a mapped codebook. The mapped codebook is defined as a linear combination of reference speaker's vectors using each fuzzy histogram as a weighting function with membership values. In adaptive-speech synthesis stage, input speech is fuzzy vector-quantized by the mapped codcbook, and then FCM arithmetic is used to synthesize speech adapted to input speaker. The speaker adaption experiments are carried out using speech of males in their thirties as input speaker's speech, and a female in her twenties as reference speaker's speech. Speeches used in experiments are sentences /anyoung hasim nika/ and /good morning/. As a results of experiments, we obtained a synthesized speech adapted to input speaker.

  • PDF

Development of Theoretical Formulae for Calculation of Required Torque in Roll-up Type Ventilation System (권취식 창개폐시스템의 소요토크모델 개발)

  • 박규식;이기명;정석현
    • Journal of Bio-Environment Control
    • /
    • v.6 no.3
    • /
    • pp.133-142
    • /
    • 1997
  • Most of the greenhouses employ the roll-up type ventilation control system. Torque required to roll-up and down might be theoretically expressed with the weight times radius of the ventilation roll; however, measured torques were two times of the theoretically estimated values. As the window film of roll-up vent is used over the periods of time, the warping and crumpling of the material caused the increase of the torque in addition to a span deformation. Therefore, this study was performed to develop an empirical torque formulae to present basic torque data and to assist the development of roll-up type ventilation control system. The empirically adjusted rolling radius (r+a) exponentially increased at the maximum span deformation. The coefficient of rolling resistance (Cr) was about 0.7―0.8 depending upon the wrinkle status of film material.

  • PDF

Geometric Distortion Compensation of Projector Image based on Equation of Straight Line (직선의 방정식을 기반으로 한 프로젝터 영상의 기하왜곡 보정)

  • Jung, Jung-Il;Cho, Jin-Soo
    • Journal of Internet Computing and Services
    • /
    • v.11 no.5
    • /
    • pp.27-35
    • /
    • 2010
  • In this paper, we propose a method that can compensate the geometric distortions of image caused from an arbitrary nonflat display surface(or wall) under the environment of portable overhead projector without a flat screen. In the proposed method, we first project a grid pattern to an arbitrary nonflat display surface and then derive an equation of straight line that represents the geometry relationship between the distorted grid pattern and the original grid pattern. Next, after determining the proper size of the original grid pattern according to the form of the display surface, we generate a compensation pattern from the derived equation of straight line, which can symmetrically compensate for the distorted image. Finally, we compensate for the geometric distortions of the projected image by segmenting the real image to be projected from portable overhead projector and prewarping it according to the compensation pattern. To evaluate the proposed method, we performed experiments of image compensation on inclined surface, bent surface and curved surface that are frequently occurred in the environment of portable overhead projector without a flat screen. From the experimental results, we found that the proposed method could be very effective in compensating for the general types of the geometric distortions of the projected images.

Interactive Projection by Closed-loop based Position Tracking of Projected Area for Portable Projector (이동 프로젝터 투사영역의 폐회로 기반 위치추적에 의한 인터랙티브 투사)

  • Park, Ji-Young;Rhee, Seon-Min;Kim, Myoung-Hee
    • Journal of KIISE:Software and Applications
    • /
    • v.37 no.1
    • /
    • pp.29-38
    • /
    • 2010
  • We propose an interactive projection technique to display details of a large image in a high resolution and brightness by tracking a portable projector. A closed-loop based tracking method is presented to update the projected image while a user changes the position of the detail area by moving the portable projector. A marker is embedded in the large image to indicate the position to be occupied by the detail image projected by the portable projector. The marker is extracted in sequential images acquired by a camera attached to the portable projector. The marker position in the large display image is updated under a constraint that the center positions of marker and camera frame coincide in every camera frame. The image and projective transformation for warping are calculated using the marker position and shape in the camera frame. The marker's four corner points are determined by a four-step segmentation process which consists of camera image preprocessing based on HSI, edge extraction by Hough transformation, quadrangle test, and cross-ratio test. The interactive projection system implemented by the proposed method performs at about 24fps. In the user study, the overall feedback about the system usability was very high.

Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera (고해상도 스테레오 카메라와 저해상도 깊이 카메라를 이용한 다시점 영상 생성)

  • Lee, Cheon;Song, Hyok;Choi, Byeong-Ho;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.4A
    • /
    • pp.239-249
    • /
    • 2012
  • Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views' depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints' color and depth videos in real-time and generated 10 additional views at 7 fps.