• Title/Summary/Keyword: image synthesizing

Search Result 81, Processing Time 0.026 seconds

A Vision-based Approach for Facial Expression Cloning by Facial Motion Tracking

  • Chun, Jun-Chul;Kwon, Oryun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.2 no.2
    • /
    • pp.120-133
    • /
    • 2008
  • This paper presents a novel approach for facial motion tracking and facial expression cloning to create a realistic facial animation of a 3D avatar. The exact head pose estimation and facial expression tracking are critical issues that must be solved when developing vision-based computer animation. In this paper, we deal with these two problems. The proposed approach consists of two phases: dynamic head pose estimation and facial expression cloning. The dynamic head pose estimation can robustly estimate a 3D head pose from input video images. Given an initial reference template of a face image and the corresponding 3D head pose, the full head motion is recovered by projecting a cylindrical head model onto the face image. It is possible to recover the head pose regardless of light variations and self-occlusion by updating the template dynamically. In the phase of synthesizing the facial expression, the variations of the major facial feature points of the face images are tracked by using optical flow and the variations are retargeted to the 3D face model. At the same time, we exploit the RBF (Radial Basis Function) to deform the local area of the face model around the major feature points. Consequently, facial expression synthesis is done by directly tracking the variations of the major feature points and indirectly estimating the variations of the regional feature points. From the experiments, we can prove that the proposed vision-based facial expression cloning method automatically estimates the 3D head pose and produces realistic 3D facial expressions in real time.

Hardware Design of Super Resolution on Human Faces for Improving Face Recognition Performance of Intelligent Video Surveillance Systems (지능형 영상 보안 시스템의 얼굴 인식 성능 향상을 위한 얼굴 영역 초해상도 하드웨어 설계)

  • Kim, Cho-Rong;Jeong, Yong-Jin
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.48 no.9
    • /
    • pp.22-30
    • /
    • 2011
  • Recently, the rising demand for intelligent video surveillance system leads to high-performance face recognition systems. The solution for low-resolution images acquired by a long-distance camera is required to overcome the distance limits of the existing face recognition systems. For that reason, this paper proposes a hardware design of an image resolution enhancement algorithm for real-time intelligent video surveillance systems. The algorithm is synthesizing a high-resolution face image from an input low-resolution image, with the help of a large collection of other high-resolution face images, called training set. When we checked the performance of the algorithm at 32bit RISC micro-processor, the entire operation took about 25 sec, which is inappropriate for real-time target applications. Based on the result, we implemented the hardware module and verified it using Xilinx Virtex-4 and ARM9-based embedded processor(S3C2440A). The designed hardware can complete the whole operation within 33 msec, so it can deal with 30 frames per second. We expect that the proposed hardware could be one of the solutions not only for real-time processing at the embedded environment, but also for an easy integration with existing face recognition system.

Efficient Implementation of Synthetic Aperture Imaging with Virtual Source Element in B-mode Ultrasound System Based on Sparse Array (희박 어레이 기반의 효율적인 양방향 화소단위 집속 기법의 구현)

  • 김강식;송태경
    • Journal of Biomedical Engineering Research
    • /
    • v.23 no.6
    • /
    • pp.419-430
    • /
    • 2002
  • In this paper. we propose an efficient method for implementing hi-directional pixel-based focusing(BiPBF) based on a sparse array imaging technique. The proposed method can improve spatial resolution and frame rate of ultrasound imaging with reduced hardware complexity by synthesizing transmit apertures with a small number of sparsely distributed subapertures. As the distance between adjacent subapertures increases, however. the image resolution tends to decrease due to the elevation of grating lobes. Such grating lobes can be eliminated in conventional synthetic aperture imaging techniques. On the contrary, grating lobes arisen from employing sparse synthetic transmit apertures can not be eliminated, which has been shown analytically in this paper. We also propose the condition and method for suppressing the grating lobes below -40dB, which is generally required in practical imaging. by placing the transmit focal depth at a near depth and properly selecting the subaperture distance in Proportion to receive aperture size. The results of both the Phantom and in vivo experiments show that the proposed method implements two-wav dynamic focusing using a smaller number of subapertures, resulting in reduced system complexity and increased frame rate.

Touch-based Gaming System using Augmented Reality Technology (증강현실 기술을 이용한 터치기반 게임 시스템)

  • Lee, Jae-Young;Kwon, Jun-Sik
    • Journal of Digital Contents Society
    • /
    • v.15 no.1
    • /
    • pp.69-76
    • /
    • 2014
  • In this study, by using the control technique of the user using augmented reality technology, to provide a game system touch-based. The augmented reality technology, can be advantageously used vehicle is easily recognized as a technique for synthesizing (images, video, text) object of the virtual image of the real world. Augmented reality technology has been studied to make the application in various fields. Studies of natural marker-based marker and base are underway, but there is no sense of incongruity in reality research natural marker-based and has been studied much. By using the augmented reality technology natural marker-based In this paper, we implemented a game system. The system also has the advantage that can be absorbed in the game by using the techniques of the interaction through a user's touch. Touch interface-based, are available as well as user environments, even in mobile devices such as smart-phone and touch pad.

Medical Service Based on AR and VR (가상 증강현실 기반의 의료서비스)

  • Yeon, YunMo;Woo, SungHee
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2016.10a
    • /
    • pp.803-806
    • /
    • 2016
  • 'Pokemon Go',which is game program, provides a clue to solve the problem of healthcare in the sense of leading changes in behavior of the users. 'Pokemon Go'is a spin-off of the $Pok{\acute{e}}mon$ game series and uses Augmented Reality(AR) technology. AR, which can be said to complement the real world, has been used in many fields such as medical applications, broadcasting, manufacturing, the mobile sector as a wide range of technologies. In particular, the medical field as area of the active application from the start of AR, provides a great help in medical fields, that is accurate medical diagnosis and prevention of unnecessary dissection by synthesizing the patient information and the image of actual patient on three-dimensional data of the sensor such as MRI or ultrasonic wave. In this study, we analyze the VR technology trends, application examples, and the future of VR and AR based medical services in healthcare.

  • PDF

A Study on Improvement Technology of Image Resolution using Mobile Camera (이동 카메라를 이용한 사진 해상도 향상 기술 연구)

  • Buri Kim;Jongtaek Oh
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.4
    • /
    • pp.93-98
    • /
    • 2023
  • Recently, as the size of display devices tends to increase and taking pictures with smart phones has become commonplace, the need for taking high-resolution pictures with smart phones is increasing. However, when the lens size of a camera is limited, such as in a smartphone, there is a physical limit to increasing the resolution of a photo. This paper is about a technique for increasing the resolution of a picture even when using a small-sized lens like a smartphone camera. It is to take multiple pictures while moving the smartphone, and to increase the resolution by combining these pictures into one picture. First of all, two pictures were taken while moving the smartphone horizontally for the 2D picture. Processes such as camera matrix estimation, and homograph inverse transformation were performed using OpenCV, and the resolution was improved by synthesizing one picture. It was confirmed that the resolution was improved in parts such as oblique lines or arcs on several test pictures.

Multi-task Deep Neural Network Model for T1CE Image Synthesis and Tumor Region Segmentation in Glioblastoma Patients (교모세포종 환자의 T1CE 영상 생성 및 암 영역분할을 위한 멀티 태스크 심층신경망 모델)

  • Kim, Eunjin;Park, Hyunjin
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.474-476
    • /
    • 2021
  • Glioblastoma is the most common brain malignancies arising from glial cells. Early diagnosis and treatment plan establishment are important, and cancer is diagnosed mainly through T1CE imaging through injection of a contrast agent. However, the risk of injection of gadolinium-based contrast agents is increasing recently. Region segmentation that marks cancer regions in medical images plays a key role in CAD systems, and deep neural network models for synthesizing new images are also being studied. In this study, we propose a model that simultaneously learns the generation of T1CE images and segmentation of cancer regions. The performance of the proposed model is evaluated using similarity measurements including mean square error and peak signal-to-noise ratio, and shows average result values of 21 and 39 dB.

  • PDF

Hard Example Generation by Novel View Synthesis for 3-D Pose Estimation (3차원 자세 추정 기법의 성능 향상을 위한 임의 시점 합성 기반의 고난도 예제 생성)

  • Minji Kim;Sungchan Kim
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.19 no.1
    • /
    • pp.9-17
    • /
    • 2024
  • It is widely recognized that for 3D human pose estimation (HPE), dataset acquisition is expensive and the effectiveness of augmentation techniques of conventional visual recognition tasks is limited. We address these difficulties by presenting a simple but effective method that augments input images in terms of viewpoints when training a 3D human pose estimation (HPE) model. Our intuition is that meaningful variants of the input images for HPE could be obtained by viewing a human instance in the images from an arbitrary viewpoint different from that in the original images. The core idea is to synthesize new images that have self-occlusion and thus are difficult to predict at different viewpoints even with the same pose of the original example. We incorporate this idea into the training procedure of the 3D HPE model as an augmentation stage of the input samples. We show that a strategy for augmenting the synthesized example should be carefully designed in terms of the frequency of performing the augmentation and the selection of viewpoints for synthesizing the samples. To this end, we propose a new metric to measure the prediction difficulty of input images for 3D HPE in terms of the distance between corresponding keypoints on both sides of a human body. Extensive exploration of the space of augmentation probability choices and example selection according to the proposed distance metric leads to a performance gain of up to 6.2% on Human3.6M, the well-known pose estimation dataset.

A Study on Forming 'Body Schema' for Role Creating (역할 창조를 위한 '몸틀(body schema)' 형성 연구)

  • Song, Hyo-sook
    • Journal of Korean Theatre Studies Association
    • /
    • no.52
    • /
    • pp.319-357
    • /
    • 2014
  • Formation of 'body schema' is the start for actor to create role and becomes the root and the foundation of existing as a role on the stage. For this, an actor needs to form 'scheme of role' with escaping from own 'body schema.' 'Schema of role' is formed by acquiring through synthesizing daily basic actions, namely, walking, standing, sitting, hand stretching, bending, and touching. The body schema, which was made with simple and usual actions, has fundamental significance in a sense of becoming the body in which the past traces in a role are habituated while energy as a role flows. As for the process of forming body schema, an actor first needs to obtain the visualized materials like photo, magazine, picture and image available for seeing a role specifically and clearly based on what analyzed a character. An actor needs to have three-dimensional image available for always recalling it in the head during acting. To do this, image data available for fundamentally capturing routine actions along with body structure are still more useful. Next, the body schema is formed by interaction with environment. Thus, there is a need of passing through the two-time process of forming body schema. Firstly, the body schema is made on routine actions in a role as physical condition of a role in actor's own everyday life. Secondly, the body schema is made on routine actions available for moving efficiently and economically in line with the environment of performance. A theatrical stage is the temporal space of rhythm and rule different from routine space. What forms body schema immediately in the second phase without body schema in the first phase ultimately becomes what exists as actor's own body, not the body of a role. The body schema, which was formed as the second process, is what truly has identity as a role in the ontological aspect, comes to experience the oppositional force in muscle, a qualitative change in energy, and emotional agitation in the physical aspect, and experiences perception, thinking, volition, and even consciousness with the entire body in the cognitive dimension. Thus, the formation of body schema can be known to be just a method of changing even spiritual and emotional layer. Body schema cannot be made if there is no process of embodiment and habit. Embodiment and habit are not simply the repeated, empty and mechanical action in the body. But, habit itself has very important meanings for forming body schema for role creating. First, habit allows the body itself to learn and understand a meaning. Second, habit relies upon environment, thereby allowing an actor of making the habituated body schema to recognize environment. Third, habit makes the mind. The habituated body schema is just the mind and the ego of a person who possesses the body schema. Fourth, habit comes to experience the expansion in energy and the expansion in existence. It may be experienced through interrelation among actor's body, tool, and environment. Fifth, habit makes identity of the body. Hence, this just becomes what secures identity of a role. These implications of habit are the formation of body schema, which is maintained with the body of being remembered firmly through being closely connected with the process of neural adaptation. Finally, it sought for possibility of practice as one method of forming body schema for role creating through Deleuze's '-becoming' theory. As 'actual animal-becoming' is real '-becoming' of forming structural transformation in the physical dimension, it meets with what the formation of body schema pursues actuality and reality. This was explained with a concept as saying of 'all '-becoming' molecular' by Deleuze/Guattari. 'Animal of having imitated animal's characteristic- becoming' is formed by which the body schema relies upon environment. In this way, relationship among the body, tool and environment has influence even upon a change in consciousness, thinking, and emotion, thereby being able to be useful for forming body schema in a sense of possibly experiencing ultimately expansion in role, namely, expansion in existence.

A study on the effect of introducing EBS AR production system on content (EBS AR 실감영상 제작 시스템 도입이 콘텐츠에 끼친 영향에 대한 연구)

  • Kim, Ho-sik;Kwon, Soon-chul;Lee, Seung-hyun
    • The Journal of the Convergence on Culture Technology
    • /
    • v.7 no.4
    • /
    • pp.711-719
    • /
    • 2021
  • EBS has been producing numerous educational contents with traditional virtual studio production systems since the early 2000s and applied AR video production system in October 2020, twenty-years after. Although the basic concept of synthesizing graphic elements and actual image in real time by tracking camera movement and lens information is similar to the previous one but the newly applied AR video production system contains some of advanced technologies that are improved over the previous ones. Marker tracking technology that enables camera movement free and position tracking has been applied that can track the location stably, and the operating software has been applied with Unreal Engine, one of the representative graphic engines used in computer game production, therefore the system's rendering burden has been reduced, enabling high-quality and real-time graphic effects. This system is installed on a crane camera that is mainly used in a crane shot at the live broadcasting studio and applied for live broadcasting programs for children and some of the videos such as program introductions and quiz events that used to be expressed in 2D graphics were converted to 3D AR videos which has been enhanced. This paper covers the effect of introduction and application of the AR video production system on EBS content production and the future development direction and possibility.