• 제목/요약/키워드: human visual perception

Search Result 264, Processing Time 0.031 seconds

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

An Adaptive Image Quality Assessment Algorithm

  • Sankar, Ravi;Ivkovic, Goran
    • International journal of advanced smart convergence
    • /
    • v.1 no.1
    • /
    • pp.6-13
    • /
    • 2012
  • An improved algorithm for image quality assessment is presented. First a simple model of human visual system, consisting of a nonlinear function and a 2-D filter, processes the input images. This filter has one user-defined parameter, whose value depends on the reference image. This way the algorithm can adapt to different scenarios. In the next step the average value of locally computed correlation coefficients between the two processed images is found. This criterion is closely related to the way in which human observer assesses image quality. Finally, image quality measure is computed as the average value of locally computed correlation coefficients, adjusted by the average correlation coefficient between the reference and error images. By this approach the proposed measure differentiates between the random and signal dependant distortions, which have different effects on human observer. Performance of the proposed quality measure is illustrated by examples involving images with different types of degradation.

Image Enhancement Using Human Visual Perception (인간 시각의 인지 특성을 이용한 영상 화질 향상 방법)

  • Bang, Seangbae;Kim, Wonha
    • Journal of Broadcast Engineering
    • /
    • v.23 no.2
    • /
    • pp.206-217
    • /
    • 2018
  • We develop the signal processing method for adaptive implementing direction of signal and the frequency sensitivity of human visual system(HVS). Existing multiband energy scaling method makes ringing artifact because it does not consider signal direction. To solve this problem, we use block gradient for signal direction in addition to existing method. And we use the fact that frequency component of signal is more sensitive than value of signal over human eyes. we enhance the signal according to contrast sensitivity function(CSF) which is the model of frequency sensitivity of human eye. Compared that the existing analysis models only improve the efficiencies in the existing systems, the developed method can process the image signals to be more desirable and suitable to HVS.

Development of an Edutainment Contents using Wiimote Controller for Children with Visual Perception Disabilities (위모트를 활용한 시지각 장애아동 교육 콘텐츠개발)

  • Yoo, Sang-Jo;Han, Kyeong-Im;Kim, Bong-Seok;Park, Dong-Gyu
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.10
    • /
    • pp.1547-1556
    • /
    • 2010
  • Until now, many Computer Aided Education(CAE) contents are developed for kids and children with disabilities The contents cover various types of training, including visual perception training, intelligence development training, and literature education areas. Major problems on those contents are those contents requires long training time on desktop machine, which deteriorates human activities. These problems also cause inaction syndrome for young kids and children with disabilities. Solving this problem, we require a human motion sensing contents on touch screen or touch board, which interacts with a trainees and enhancing activity, collaboration and immersiveness. We implement and develope an education contents interacts with a trainee using beam projector or screen and IR(Infra-Red) pens using wiimote controller sensing technology.

Acceptable Luminance Levels of a LCD TV Based on Glare of Human Visual System

  • Kim, Ki-Duk;Ahn, Ji-Young;Yoon, Jae-Kyung;Shin, Hyun-Ho;Chung, In-Jae
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2005.07a
    • /
    • pp.125-128
    • /
    • 2005
  • The visual perception tests were conducted to determine limits of luminance of a LCD TV from a viewpoint of glare. The results showed that people, who watch TV in their living room, perceive glare above $410\;cd/m^2$ at full window and $590\;cd/m^2$ at 1/25 window.

  • PDF

NEUROPSYCHOLOGY IN NEURODEVELOPMENT (발달 신경심리학)

  • Shin Min-Sup;Kim Hyun-Mi
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.16 no.1
    • /
    • pp.33-46
    • /
    • 2005
  • First, the author reviewed the relationship between human brain development and cognitive functions such as attention, perception, memory, and language. And then Luria's neurodevelopmental theory and its application on the Neuropsychological test battery for children were reviewed. Finally, various assessment tools to evaluate attention, intellectual function, visual-perception, visual-motor coordination, and executive function were examined.

  • PDF

Analysis of Visual Perception of Cinemagraph Images: Focusing on Q Methodology

  • Kim, Young Il
    • Journal of Multimedia Information System
    • /
    • v.6 no.4
    • /
    • pp.251-258
    • /
    • 2019
  • In the image methodology, cinemagraphs are needed to find out how to think through the empirical studies of the audiences in actual empirical theory. Therefore, this study analyzes what cinemagraph images represent and what groups are inclined to see them. The analytical study aims to reveal the grouping categorized as a preference survey according to the subjectivity study by Q methodology. Research reveals how images should be read and how disparities tend to differ from or agree with those in understanding images. Therefore, four types categorized into Q analysis through 1: 1 interview using a sample group and using samples showed that human interpretation and cinemagraph images were represented in understanding cinemagraphs.

The acceptable limit of the contrast ratio of LCD TV based on human visual system

  • Shin, Kwang-Hoon;Moon, Jong-Won;Park, Sun-Ah;Ahn, Ji-Young;Kang, Dong-Woo;Shin, Hyun-Ho
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2007.08b
    • /
    • pp.1497-1499
    • /
    • 2007
  • Visual perception experiments were conducted to determine the acceptable limit of the contrast ratio of LCD TV under the watching condition. The results showed that the corresponding contrast ratio should be below 10,000:1 at the 3H(height of screen) distance in the living room environment.

  • PDF

Robust Image Watermarking via Perceptual Structural Regularity-based JND Model

  • Wang, Chunxing;Xu, Meiling;Wan, Wenbo;Wang, Jian;Meng, Lili;Li, Jing;Sun, Jiande
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.2
    • /
    • pp.1080-1099
    • /
    • 2019
  • A better tradeoff between robustness and invisibility will be realized by using the just noticeable (JND) model into the quantization-based watermarking scheme. The JND model is usually used to describe the perception characteristics of human visual systems (HVS). According to the research of cognitive science, HVS can adaptively extract the structure features of an image. However, the existing JND models in the watermarking scheme do not consider the structure features. Therefore, a novel JND model is proposed, which includes three aspects: contrast sensitivity function, luminance adaptation, and contrast masking (CM). In this model, the CM effect is modeled by analyzing the direction features and texture complexity, which meets the human visual perception characteristics and matches well with the spread transform dither modulation (STDM) watermarking framework by employing a new method to measure edge intensity. Compared with the other existing JND models, the proposed JND model based on structural regularity is more efficient and applicable in the STDM watermarking scheme. In terms of the experimental results, the proposed scheme performs better than the other watermarking scheme based on the existing JND models.

Evaluate of allowable acceleration for Occupants in Horizontal Vibration of Buildings according to Natural Frequency (고유주기에 따른 건축물의 수평진동에 대한 거주자의 허용가속도평가)

  • Cho, Kang-Pyo;Jeong, Seung-Hwan;Cho, Gi-Sung
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2008.04a
    • /
    • pp.228-233
    • /
    • 2008
  • In this paper, peak acceleration for horizontal vibration of buildings was estimated from the results of vibration tests using a shaking table. Human comfort of occupants is supposed to be satisfied according to the peak acceleration in NBCC and ISO6897, which have been used by Korean structural engineers. In the paper, we used a one-dimensional shaking table for horizontal vibration tests, which was mounted with a vibration house similar to a living space. Experimental results were obtained according to increasing accelerations in the range of 0.2Hz through 1.2Hz of frequency with five experimental groups, each of which was composed of eight persons. We obtained performance curves by dividing the distribution of perception from horizontal vibration tests into the ranges of 0${\sim}$25%, 26${\sim}$50%, 51${\sim}$75%, 76${\sim}$100% and then fitting the curves. Also we made a questionnaire based on human comfort criteria of foreign countries, and examined the feelings of subjects. From the results of horizontal vibration tests, it was found that acceleration of perception was low when frequency was high, and that visual and auditory senses affect the human perception for horizontal vibration of buildings.

  • PDF