• Title/Summary/Keyword: 텍스처 합성

Search Result 29, Processing Time 0.025 seconds

Audio Texture Synthesis using EM Optimization (EM 최적화를 이용한 오디오 텍스처 합성)

  • Roe, Chang-Hwan;Yoo, Min-Joon;Lee, In-Kwon
    • 한국HCI학회:학술대회논문집
    • /
    • 2007.02a
    • /
    • pp.274-280
    • /
    • 2007
  • 오디오 텍스처 합성은 주어진 짧은 오디오 클립으로부터 임의의 길이를 갖는 새로운 오디오 클립을 생성하는 방법이다. 이는 애니메이션이나 영화에서 비디오와 정확한 동기화를 이루는 사운드 효과를, 혹은 임의의 길이를 갖는 배경 음악을 효율적으로 만들 수 있는 방법이다. 최근 Lie Lu는 주어진 예제 오디오 클립을 여러 조각으로 나눈 후, 이 조각들을 그래프 형태로 연결하고, 생성된 그래프를 탐색하면서 임의의 길이를 가지는 오디오 클립을 합성하는 방법을 제안하였다. 비교적 간단한 방법으로도 원본 오디오 클립과 비슷한 느낌의 오디오 클립을 만들어낸다는 장점이 있지만, 이는 원본 내의 여러 오디오 조각들이 단지 지속적으로 연결되는 형태로 합성되기 때문에 종종 반복되는 느낌을 받는다는 단점이 있다. 본 논문에서는 Lie Lu의 방법과는 달리 주어진 예제 오디오 클립을 직접 합성함으로써 반복성을 줄이면서도 원본과 비슷한 느낌을 갖는 결과 오디오 클립을 생성할 수 있는 방법을 제안한다. 특히 본 논문에서는 정확한 합성을 위하여 EM 최적화 방법을 사용한다. 본 논문에서 제안하는 합성 방법은 먼저 예제 오디오 클립을 일정 단위로 나누고 이렇게 나눠진 부분들을 일정 길이만큼 서로 겹쳐지게 합성하여 임의의 길이의 오디오 클립을 만든다. 그 후 만들어진 오디오 클립을 예제 오디오 클립과 부분 부분을 비교하여 확장된 오디오 클립과 최대한 비슷한 부분을 예제 오디오 클립에서 찾는다. 그 다음 찾아진 결과를 결과 오디오에 다시 합성하여 오디오 클립을 만든다. 이런 과정을 반복하여 최적화된 가장 적절한 결과값을 구한다. 이 결과는 분할된 부분들이 가장 자연스럽게 이어지는 결과가 된다. 본 논문에서는 최적화를 사용하여 오디오를 합성하기 때문에 합성 결과를 쉽게 조정할 수 있다는 장점이 있다. 최적화 문제에 특정 제약 조건을 넣음으로써 사용자가 원하는 부분의 음악이 결과 사운드의 특정 부분에 위치 할 수 있게 하고 이로써 특정 흐름을 만들어낼 수 있으며, 일부가 손실된 사운드 데이터의 복구를 가능하게 하는 등의 결과를 생성할 수 있다. EM 최적화를 사용한 오디오 텍스처 합성 방법은 기존의 합성 방법에 비해 질적인 측면에서 보다 좋은 결과를 생성할 수 있고, 비교적 반복이 덜한 패턴들을 만들어 낼 수 있다. 이를 입증하기 위해 이에 대한 사용자 설문 조사 결과가 제시된다.

  • PDF

A Study on the Analysis of Jeju Island Precipitation Patterns using the Convolution Neural Network (합성곱신경망을 이용한 제주도 강수패턴 분석 연구)

  • Lee, Dong-Hoon;Lee, Bong-Kyu
    • Journal of Software Assessment and Valuation
    • /
    • v.15 no.2
    • /
    • pp.59-66
    • /
    • 2019
  • Since Jeju is the absolute weight of agriculture and tourism, the analysis of precipitation is more important than other regions. Currently, some numerical models are used for analysis of precipitation of Jeju Island using observation data from meteorological satellites. However, since precipitation changes are more diverse than other regions, it is difficult to obtain satisfactory results using the existing numerical models. In this paper, we propose a Jeju precipitation pattern analysis method using the texture analysis method based on Convolution Neural Network (CNN). The proposed method converts the water vapor image and the temperature information of the area of ​​Jeju Island from the weather satellite into texture images. Then converted images are fed into the CNN to analyse the precipitation patterns of Jeju Island. We implement the proposed method and show the effectiveness of the proposed method through experiments.

Quality Characteristics of Korean Rice Cakes (Karedduk) with a Mixture of Fructooligosaccharide and Modified Starch (프락토올리고당과 변성전분 혼합사용 떡의 품질 특성)

  • Chung, Hae Young
    • Culinary science and hospitality research
    • /
    • v.21 no.4
    • /
    • pp.145-154
    • /
    • 2015
  • The quality characteristics of Korean rice cakes (Karedduk) with a mixture of fructooligosaccharide (95%) and AA (acetylated adipate distarch) added, after 2 and 24 hours of storage at $5^{\circ}C$, were investigated. A central composite design was used for arrangement of treatment. Different levels of fructooligosaccharide (95%), 0, 3, 6, 9, and 12%, were added to dry rice flour. In addition, different levels of AA, 0, 0.3, 0.6, 0.9, and 1.2%, were added to the same dry rice flour. The texture properties analysis using a Texture Analyzer revealed that the springiness, cohesiveness, chewiness, gumminess, adhesiveness, and hardness were significantly different. The effect of retarding retrogradation of Korean rice cakes (Karedduk) with added mixtures of fructooligosaccharide (95%) and AA showed an increasing trend as the amount of fructooligosaccharide (95%) and AA increased. Overall, the instrumental texture properties were highly correlated with the sensory characteristics. These results suggest that adding a mixture of 6% fructooligosaccharide (95%) and 1.2% AA to Korean rice cakes (Karedduk) is effective for retarding retrogradation.

Synthesis of Realistic Facial Expression using a Nonlinear Model for Skin Color Change (비선형 피부색 변화 모델을 이용한 실감적인 표정 합성)

  • Lee Jeong-Ho;Park Hyun;Moon Young-Shik
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2006.06a
    • /
    • pp.121-123
    • /
    • 2006
  • 얼굴의 표정은 얼굴의 구성요소 같은 기하학적 정보와 조명이나 주름 같은 세부적인 정보들로 표현된다. 얼굴 표정은 기하학적 변형만으로는 실감적인 표정을 생성하기 힘들기 때문에 기하학적 변형과 더불어 텍스쳐 같은 세부적인 정보도 함께 변형해야만 실감적인 표현을 할 수 있다. 표정비율이미지 (Expression Ratio Image)같은 얼굴 텍스처의 세부적인 정보를 변형하기 위한 기존 방법들은 조명에 따른 피부색의 변화를 정확히 표현할 수 없는 단점이 있다. 따라서 본 논문에서는 이러한 문제를 해결하기 위해 서로 다른 조명 조건에서도 실감적인 표정 텍스처 정보를 적용할 수 있는 비선형 피부색 모델 기반의 표정 합성 방법을 제안한다. 제안된 방법은 동적 외양 모델을 이용한 자동적인 얼굴 특징 추출과 와핑을 통한 표정 변형 단계, 비선형 피부색 변화 모델을 이용한 표정 생성 단계, Euclidean Distance Transform (EDT)에 의해 계산된 혼합 비율을 사용한 원본 얼굴 영상과 생성된 표정의 합성 등 총 3 단계로 구성된다. 실험결과는 제안된 방법이 다양한 조명조건에서도 자연스럽고 실감적인 표정을 표현한다는 것을 보인다.

  • PDF

Texture and Descriptive Sensory Characteristics of Korean Rice Cakes (Karedduk) with a Mixture of Fructooligosaccharide and Emulsifier (프락토올리고당과 유화제 혼합사용 가래떡의 텍스처와 관능적 묘사 특성)

  • Kim, Sang-Sook;Chung, Hae-Young
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.41 no.6
    • /
    • pp.823-828
    • /
    • 2012
  • Texture and descriptive sensory characteristics of a Korean rice cake (Karedduk) with added mixtures of fructooligosaccharide (95%) and emulsifier, Sodium Stearoyl Lactylate-90 (SSL-90), were investigated after 2 and 24 hr of storage at $5^{\circ}C$. A central composite design was used for the arrangement of treatment. Different levels of fructooligosaccharide (95%), 0, 3, 6, 9, and 12%, were added to dry rice flour. Also, different levels of emulsifier, 0, 0.3, 0.6, 0.9, and 1.2%, were added to the same dry rice flour. The texture properties analysis using a Texture Analyzer revealed that the chewiness, gumminess, and hardness were significantly different. The effect of retarding retrogradation of Korean rice cakes (Karedduk) with added mixtures of fructooligosaccharide (95%) and SSL-90 showed an increasing trend as the amount of fructooligosaccharide (95%) increased. Overall, the instrumental texture properties were highly correlated with the sensory characteristics. The results suggested that Korean rice cakes (Karedduk) with the addition of a mixture of fructooligosaccharide (95%) and SSL-90 can be made from the mixture of 9% fructooligosaccharide (95%) and 0.9% SSL-90 in order to retard starch retrogradation.

A Depth-based Disocclusion Filling Method for Virtual Viewpoint Image Synthesis (가상 시점 영상 합성을 위한 깊이 기반 가려짐 영역 메움법)

  • Ahn, Il-Koo;Kim, Chang-Ick
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.48-60
    • /
    • 2011
  • Nowadays, the 3D community is actively researching on 3D imaging and free-viewpoint video (FVV). The free-viewpoint rendering in multi-view video, virtually move through the scenes in order to create different viewpoints, has become a popular topic in 3D research that can lead to various applications. However, there are restrictions of cost-effectiveness and occupying large bandwidth in video transmission. An alternative to solve this problem is to generate virtual views using a single texture image and a corresponding depth image. A critical issue on generating virtual views is that the regions occluded by the foreground (FG) objects in the original views may become visible in the synthesized views. Filling this disocclusions (holes) in a visually plausible manner determines the quality of synthesis results. In this paper, a new approach for handling disocclusions using depth based inpainting algorithm in synthesized views is presented. Patch based non-parametric texture synthesis which shows excellent performance has two critical elements: determining where to fill first and determining what patch to be copied. In this work, a noise-robust filling priority using the structure tensor of Hessian matrix is proposed. Moreover, a patch matching algorithm excluding foreground region using depth map and considering epipolar line is proposed. Superiority of the proposed method over the existing methods is proved by comparing the experimental results.

Image Denoising Via Structure-Aware Deep Convolutional Neural Networks (구조 인식 심층 합성곱 신경망 기반의 영상 잡음 제거)

  • Park, Gi-Tae;Son, Chang-Hwan
    • The Journal of Korean Institute of Information Technology
    • /
    • v.16 no.11
    • /
    • pp.85-95
    • /
    • 2018
  • With the popularity of smartphones, most peoples have been using mobile cameras to capture photographs. However, due to insufficient amount of lights in a low lighting condition, unwanted noises can be generated during image acquisition. To remove the noise, a method of using deep convolutional neural networks is introduced. However, this method still lacks the ability to describe textures and edges, even though it has made significant progress in terms of visual quality performance. Therefore, in this paper, the HOG (Histogram of Oriented Gradients) images that contain information about edge orientations are used. More specifically, a method of learning deep convolutional neural networks is proposed by stacking noise and HOG images into an input tensor. Experiment results confirm that the proposed method not only can obtain excellent result in visual quality evaluations, compared to conventional methods, but also enable textures and edges to be improved visually.

Synthesis of Realistic Facial Expression using a Nonlinear Model for Skin Color Change (비선형 피부색 변화 모델을 이용한 실감적인 표정 합성)

  • Lee Jeong-Ho;Park Hyun;Moon Young-Shik
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.43 no.3 s.309
    • /
    • pp.67-75
    • /
    • 2006
  • Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance. Since it is difficult to generate realistic facial expressions by using only geometric deformations, detailed features such as textures should also be deformed to achieve more realistic expression. The existing methods such as the expression ratio image have drawbacks, in that detailed changes of complexion by lighting can not be generated properly. In this paper, we propose a nonlinear model for skin color change and a model-based synthesis method for facial expression that can apply realistic expression details under different lighting conditions. The proposed method is composed of the following three steps; automatic extraction of facial features using active appearance model and geometric deformation of expression using warping, generation of facial expression using a model for nonlinear skin color change, and synthesis of original face with generated expression using a blending ratio that is computed by the Euclidean distance transform. Experimental results show that the proposed method generate realistic facial expressions under various lighting conditions.

Analysis and Synthesis of Structural Textures Using Projection Information (투사정보를 이용한 구조적 텍스처의 분석 및 합성)

  • 김한빈;박래홍
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.26 no.9
    • /
    • pp.1428-1435
    • /
    • 1989
  • In this paper we propose a new algorithm which extracts spatial arrangement information of texture elements in structural textures. In the proposed algorithm, by the use of projection information in several directions obtained from the texture image we can get two directions which determine the texture structure and the parallelogram grid which isolates texture elements. The isolated texture elements are analyzed and used to synthesize texture images. Computer simulation shows that the proposed method can extract proper spatial structure of the texture element even when the texture image is highly corrupted by additive noise.

  • PDF

Appearance Information Extraction and Shading for Realistic Caricature Generation (실사형 캐리커처 생성을 위한 형태 정보 추출 및 음영 함성)

  • Park, Yeon-Chool;Oh, Hae-Seok
    • The KIPS Transactions:PartB
    • /
    • v.11B no.3
    • /
    • pp.257-266
    • /
    • 2004
  • This paper proposes caricature generation system that uses shading mechanism that extracts textural features of face. Using this method, we can get more realistic caricature. Since this system If vector-based, the generated character's face has no size limit and constraint. so it is available to transform the shape freely and to apply various facial expressions to 2D face. Moreover, owing to the vector file's advantage, It can be used in mobile environment as small file size This paper presents methods that generate vector-based face, create shade and synthesize the shade with the vector face.