• Title/Summary/Keyword: Human visual system

Search Result 867, Processing Time 0.031 seconds

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

Spatio-temporal Characteristics Analysis of Visual System (시각계통의 시.공간적 특성 해석)

  • 한만춘;박상희;김강서
    • 전기의세계
    • /
    • v.21 no.5
    • /
    • pp.7-12
    • /
    • 1972
  • Applying the theory of physiology and control systems, the visual system was studied as a regulator of impining light. The characteristics function of visual system is mainly analysed by spato-temporal characteristics based upon Enroth's model, Broca-Sulzer phenomenon and Mach effect. Some aims of this paper are as follows. (1) In order to get the excitatory and inhibitory potential of the intermediated cell layer in the retina, the exponential value, {exp(FM/kT)- $I_{mn}$ } is caculated based on the physiological theory in neuro-phenomena. (2) To show the visual characteristics by analog simulation for generating stimulus waveforms and analysis, the visual adaptation was recorded as electrical stimulation in the form of step functions. Furthermore, ti is shown that the above experimental data agrees satisfactorily with the theoretical (psychophysiological) values. This study is expected to lead to further studies concerned with human observer and human operator in control and especially pattern recognition systems.stems.

  • PDF

A Study on the Quantitative Human Visual Preference with PDP and LCD

  • Lee, Hwal-Ly;Whang, Ki-Woong
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2007.08b
    • /
    • pp.1143-1146
    • /
    • 2007
  • We carried out the human visual evaluation on PDPs and LCDs to clarify the viewer preference and the related physical and physiological factors. In the subjective evaluation, the impression test using the semantic differential method was carried out. In the objective evaluation, the eye motion tracking system was used. Our study showed that considering the real usage, the optimum display for viewers was that which showed more soft and smooth image without blurring.

  • PDF

Multi-scale and Interactive Visual Analysis of Public Bicycle System

  • Shi, Xiaoying;Wang, Yang;Lv, Fanshun;Yang, Xiaohang;Fang, Qiming;Zhang, Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.6
    • /
    • pp.3037-3054
    • /
    • 2019
  • Public bicycle system (PBS) is a new emerging and popular mode of public transportation. PBS data can be adopted to analyze human movement patterns. Previous work usually focused on specific scales, and the relationships between different levels of hierarchies are ignored. In this paper, we introduce a multi-scale and interactive visual analytics system to investigate human cycling movement and PBS usage condition. The system supports level-of-detail explorative analysis of spatio-temporal characteristics in PBS. Visual views are designed from global, regional and microcosmic scales. For the regional scale, a bicycle network is constructed to model PBS data, and an flow-based community detection algorithm is applied on the bicycle network to determine station clusters. In contrast to the previous used Louvain algorithm, our method avoids producing super-communities and generates better results. We provide two cases to demonstrate how our system can help analysts explore the overall cycling condition in the city and spatio-temporal aggregation of stations.

3D Human Motion Control System using Visual Script (시각 스크립트 기반 3차원 인체 동작 제어 시스템)

  • Cha, Gyeong-Ae;Kim, Sang-Wook
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.6 no.5
    • /
    • pp.536-542
    • /
    • 2000
  • This paper proposes Visual Script Language which can direct a type of motion to 3D human model and create by dragging gesture like as we can express a certain meaning with hand gestures. Traditional motion control technique of articulated figures such as human needs a complex task that draws on highly developed human skills. So it will reduce the amount of motion specification to provide the motion control method that allow users to describe characters' motion at the higher level abstraction. Visual script is the visual gestures to direct various human motions, so users can express the spatial attributes of a motion such as the path of moving with high-level concepts if they use visual script. And we can show that it is possible to control the motion of human model directly and intuitively by development of 3D human motion control system based on visual script.

  • PDF

Neuro-Net Based Automatic Sorting And Grading of A Mushroom (Lentinus Edodes L)

  • Hwang, H.;Lee, C.H.;Han, J.H.
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1993.10a
    • /
    • pp.1243-1253
    • /
    • 1993
  • Visual features of a mushroom(Lentinus Edodes L) are critical in sorting and grading as most agricultural products are. Because of its complex and various visual features, grading and sorting of mushrooms have been done manually by the human expert. Though actions involved in human grading looks simple, a decision making undereath the simple action comes form the results of the complex neural processing of the visual image. And processing details involved in the visual recognition of the human brain has not been fully investigated yet. Recently, however, an artificial neural network has drawn a great attention because of its functional capability as a partial substitute of the human brain. Since most agricultural products are not uniquely defined in its physical properties and do not have a well defined job structure, a research of the neuro-net based human like information processing toward the agricultural product and processing are widely open and promising. In this pape , neuro-net based grading and sorting system was developed for a mushroom . A computer vision system was utilized for extracting and quantifying the qualitative visual features of sampled mushrooms. The extracted visual features and their corresponding grades were used as input/output pairs for training the neural network and the trained results of the network were presented . The computer vision system used is composed of the IBM PC compatible 386DX, ITEX PFG frame grabber, B/W CCD camera , VGA color graphic monitor , and image output RGB monitor.

  • PDF

Optical Visual Cryptography based on Binary Phase Exctraction JTC (BPEJTC를 이용한 광 비쥬얼 크립토그래피)

  • 이상이;이승현
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.40 no.8
    • /
    • pp.589-597
    • /
    • 2003
  • Visual cryptography made it possible to decrypt thresholding scheme with not digital system but human vision system. This method, however, has some limit in it. Optical visual cryptography was proposed which used laser instead of human eyesight. As a result, it was possible to adapt cryptography to optical system. However, it also had some difficulties because it did not overcome the existing problem of visual cryptography completely. These problems occurred in the process of transferring data processing system from visual to optics. Therefore, it is appropriate to approach these problems in terms of optics. This paper analyzes the level of noise and the security characteristics for optical visual cryptography in terms of frequency based on joint transform correlator.

The Study on the Medical Image Compression using the Characteristics of Human Visual System (인간 시각 장치의 특성을 이용한 의학 영상 압축에 관한 연구)

  • Chee, Young-Joon;Park, Kwang-Seok
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1993 no.05
    • /
    • pp.38-41
    • /
    • 1993
  • For efficient transmission and storage of digital images, the requirements of image compression is incresing. Because the medical images contain diagnostic information small distortion has been more important factor than the low rate in such images. Generally the distortion in image is the difference of pixel values. However the image is percieved by human visual systems. So it is reasonable that human visual system characteristics be used as criteria of the image compression. In this paper, the Just Noticeable Difference curve is used as criteria of determining the homogeniety of a block and acceptibility of distortions. And Block Truncation Coding using spatial masking effect of eyes is adopted to code the blocks which contain line components. And small blocks which varies slowly can be approximated to polynomial functions successfully. We proposed the hybrid block coding scheme based on the block characteristics and human visual system characteristics. Simulation to several kinds of the medical images using this method showed that medical images can be compressed 5:1 - 10:1 without noticeable distortion.

  • PDF

Blind Watermarking Using HVS and Wavelet Transform (HVS 모델과 웨이블릿 변환을 이용한 블라인드 워터마킹)

  • 주상현;이선화
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.28 no.11C
    • /
    • pp.1169-1176
    • /
    • 2003
  • In this paper, we propose a blind watermarking that embeds watermarks into wavelet middle frequency subbands using human visual system. Wavelet middle frequency pairs(MFP) show similar distortion against general image processing attacks such as compression and filtering. So the quantization between MFPs is more robust than conventional methods that directly quantize DWT coefficients. We use a noise visibility function(NVF) to obtain a good visual quality This is able to preserve embedding positions after many attacks. Our experimental results show that the proposed scheme is robust to various image processing such as JPEG, while preserving good visual quality above 44㏈.

Defect Detection Method using Human Visual System and MMTF (MMTF와 인간지각 특성을 이용한 결함성분 추출기법)

  • Huh, Kyung-Moo;Joo, Young-Bok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.12
    • /
    • pp.1094-1098
    • /
    • 2013
  • AVI (Automatic Vision Inspection) systems automatically detect defect features and measure their sizes via camera vision. Defect detection is not an easy process because of noises from various sources and optical distortion. In this paper the acquired images from a TFT panel are enhanced with the adoption of an HVS (Human Visual System). A human visual system is more sensitive on the defect area than the illumination components because it has greater sensitivity to variations of intensity. In this paper we modified an MTF (Modulation Transfer Function) in the Wavelet domain and utilized the characteristics of an HVS. The proposed algorithm flattens the inner illumination components while preserving the defect information intact.