• 제목/요약/키워드: Human visual system

검색결과 867건 처리시간 0.024초

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 한국정보컨버전스학회 2008년도 International conference on information convergence
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

시각계통의 시.공간적 특성 해석 (Spatio-temporal Characteristics Analysis of Visual System)

  • 한만춘;박상희;김강서
    • 전기의세계
    • /
    • 제21권5호
    • /
    • pp.7-12
    • /
    • 1972
  • Applying the theory of physiology and control systems, the visual system was studied as a regulator of impining light. The characteristics function of visual system is mainly analysed by spato-temporal characteristics based upon Enroth's model, Broca-Sulzer phenomenon and Mach effect. Some aims of this paper are as follows. (1) In order to get the excitatory and inhibitory potential of the intermediated cell layer in the retina, the exponential value, {exp(FM/kT)- $I_{mn}$ } is caculated based on the physiological theory in neuro-phenomena. (2) To show the visual characteristics by analog simulation for generating stimulus waveforms and analysis, the visual adaptation was recorded as electrical stimulation in the form of step functions. Furthermore, ti is shown that the above experimental data agrees satisfactorily with the theoretical (psychophysiological) values. This study is expected to lead to further studies concerned with human observer and human operator in control and especially pattern recognition systems.stems.

  • PDF

A Study on the Quantitative Human Visual Preference with PDP and LCD

  • Lee, Hwal-Ly;Whang, Ki-Woong
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 한국정보디스플레이학회 2007년도 7th International Meeting on Information Display 제7권2호
    • /
    • pp.1143-1146
    • /
    • 2007
  • We carried out the human visual evaluation on PDPs and LCDs to clarify the viewer preference and the related physical and physiological factors. In the subjective evaluation, the impression test using the semantic differential method was carried out. In the objective evaluation, the eye motion tracking system was used. Our study showed that considering the real usage, the optimum display for viewers was that which showed more soft and smooth image without blurring.

  • PDF

Multi-scale and Interactive Visual Analysis of Public Bicycle System

  • Shi, Xiaoying;Wang, Yang;Lv, Fanshun;Yang, Xiaohang;Fang, Qiming;Zhang, Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권6호
    • /
    • pp.3037-3054
    • /
    • 2019
  • Public bicycle system (PBS) is a new emerging and popular mode of public transportation. PBS data can be adopted to analyze human movement patterns. Previous work usually focused on specific scales, and the relationships between different levels of hierarchies are ignored. In this paper, we introduce a multi-scale and interactive visual analytics system to investigate human cycling movement and PBS usage condition. The system supports level-of-detail explorative analysis of spatio-temporal characteristics in PBS. Visual views are designed from global, regional and microcosmic scales. For the regional scale, a bicycle network is constructed to model PBS data, and an flow-based community detection algorithm is applied on the bicycle network to determine station clusters. In contrast to the previous used Louvain algorithm, our method avoids producing super-communities and generates better results. We provide two cases to demonstrate how our system can help analysts explore the overall cycling condition in the city and spatio-temporal aggregation of stations.

시각 스크립트 기반 3차원 인체 동작 제어 시스템 (3D Human Motion Control System using Visual Script)

  • 차경애;김상욱
    • 한국정보과학회논문지:컴퓨팅의 실제 및 레터
    • /
    • 제6권5호
    • /
    • pp.536-542
    • /
    • 2000
  • 본 논문은 제스춰를 이용하여 3차원 인체 모델의 동작을 지시하고 생성하는 시각 스크립트 언어를 제안한다. 인체와 같은 다관절체의 동작 생성을 위해서는 일반적으로 많은 세부적 작업과 전문성을 요구한다. 그러나 동작의 추상적 의미 전달을 통한 동작 생성이 가능하다면 동작 생성을 위한 작업량의 감소와 더불어 동작 시나리오 작성이 보다 용이할 것이다. 본 논문에서 제시하는 시각 스크립트는 실생활에서 손짓을 이용한 제스춰로 의미를 전달하는 것처럼 동작의 종류와 방향, 경로 등을 지시학 위해서 마우스 드래깅으로 입력되는 궤적이다. 따라서 시각 스크립트를 이용하면 동작의 의미적 기술이 가능하며 동작 경로 등의 공간적 속성을 시각적으로 부여할 수 있다. 그리고 동작 대상이 되는 신체 부위나 드래킹 속도 등의 제약 조건을 이용하여 동일한 형태의 시각 스크립트로도 다양한 인체 동작을 지시할 수 있도록 하였다. 이러한 시각 스크립트를 이용한 인체 동작 제어 시스템의 구현을 통해서 보다 직관적인 시각 제스춰를 통한 동작 제어가 가능함을 보인다.

  • PDF

Neuro-Net Based Automatic Sorting And Grading of A Mushroom (Lentinus Edodes L)

  • Hwang, H.;Lee, C.H.;Han, J.H.
    • 한국농업기계학회:학술대회논문집
    • /
    • 한국농업기계학회 1993년도 Proceedings of International Conference for Agricultural Machinery and Process Engineering
    • /
    • pp.1243-1253
    • /
    • 1993
  • Visual features of a mushroom(Lentinus Edodes L) are critical in sorting and grading as most agricultural products are. Because of its complex and various visual features, grading and sorting of mushrooms have been done manually by the human expert. Though actions involved in human grading looks simple, a decision making undereath the simple action comes form the results of the complex neural processing of the visual image. And processing details involved in the visual recognition of the human brain has not been fully investigated yet. Recently, however, an artificial neural network has drawn a great attention because of its functional capability as a partial substitute of the human brain. Since most agricultural products are not uniquely defined in its physical properties and do not have a well defined job structure, a research of the neuro-net based human like information processing toward the agricultural product and processing are widely open and promising. In this pape , neuro-net based grading and sorting system was developed for a mushroom . A computer vision system was utilized for extracting and quantifying the qualitative visual features of sampled mushrooms. The extracted visual features and their corresponding grades were used as input/output pairs for training the neural network and the trained results of the network were presented . The computer vision system used is composed of the IBM PC compatible 386DX, ITEX PFG frame grabber, B/W CCD camera , VGA color graphic monitor , and image output RGB monitor.

  • PDF

BPEJTC를 이용한 광 비쥬얼 크립토그래피 (Optical Visual Cryptography based on Binary Phase Exctraction JTC)

  • 이상이;이승현
    • 대한전자공학회논문지SD
    • /
    • 제40권8호
    • /
    • pp.589-597
    • /
    • 2003
  • 비쥬얼 크립토그래피는 암호법에서 중요한 정보를 암호화하여 복수 회원에게 분산시킨 후 회원의 합의에 의하여 해독이 가능하게 하는 thresholding scheme을 디지털 시스템인 아닌 인간의 시각 시스템으로 해독이 가능하게 하였다. 그러나 표현의 한계로 인하여 몇 가지 문제점을 지니고 있었다. 이후 인간의 시각을 대신하여 레이져를 사용하는 광 비쥬얼 크립토그래피가 제안되어 광학 시스템에 암호법을 적용할 수 있게 되었다. 그러나 이 시스템은 기존의 비쥬얼 크립토그래피의 문제점을 완전히 극복하지 못함으로 인하여 또 다른 문제를 발생하였다. 이 것은 데이터 처리 시스템을 시각에서 광학으로 전환하는 과정에서 발생하였으므로 문제의 분석과 해결 역시 광학적으로 접근하는 것이 타당하다. 본 논문에서는 joint transform correlator를 이용하여 광 비쥬얼 크립토그래피에서 발생하는 잡음의 정도와 안정성을 주파수 관점에서 분석하였다.

인간 시각 장치의 특성을 이용한 의학 영상 압축에 관한 연구 (The Study on the Medical Image Compression using the Characteristics of Human Visual System)

  • 지영준;박광석
    • 대한의용생체공학회:학술대회논문집
    • /
    • 대한의용생체공학회 1993년도 춘계학술대회
    • /
    • pp.38-41
    • /
    • 1993
  • For efficient transmission and storage of digital images, the requirements of image compression is incresing. Because the medical images contain diagnostic information small distortion has been more important factor than the low rate in such images. Generally the distortion in image is the difference of pixel values. However the image is percieved by human visual systems. So it is reasonable that human visual system characteristics be used as criteria of the image compression. In this paper, the Just Noticeable Difference curve is used as criteria of determining the homogeniety of a block and acceptibility of distortions. And Block Truncation Coding using spatial masking effect of eyes is adopted to code the blocks which contain line components. And small blocks which varies slowly can be approximated to polynomial functions successfully. We proposed the hybrid block coding scheme based on the block characteristics and human visual system characteristics. Simulation to several kinds of the medical images using this method showed that medical images can be compressed 5:1 - 10:1 without noticeable distortion.

  • PDF

HVS 모델과 웨이블릿 변환을 이용한 블라인드 워터마킹 (Blind Watermarking Using HVS and Wavelet Transform)

  • 주상현;이선화
    • 한국통신학회논문지
    • /
    • 제28권11C호
    • /
    • pp.1169-1176
    • /
    • 2003
  • 본 논문에서는 인간의 심리 시각적 특성을 고려한 HVS(Human Visual System) 모델과 웨이블릿 중간주파수 대역의 계수쌍을 이용한 블라인드 워터마킹 기법을 제안한다. 중간주파수 대역의 계수쌍은 각종 영상처리를 이용한 공격과 압축 공격 등에 대해서 비슷한 왜곡 현상을 보인다. 따라서 웨이블릿 계수를 일정한 크기로 양자화 하는 기존 방법들보다 중간주파수대역의 계수쌍 사이의 관계를 이용한 양자화 방법이 보다 안정적인 성능을 나타낸다. 또한 Noise Visibility Function(NVF)을 이용한 HVS 모델을 적용함으로써 워터마크 삽입 후의 비가시성을 확보하였다. 실험을 통하여 이진 워터마크를 삽입한 영상이 평균 44㏈ 이상의 우수한 화질을 유지하면서도 각종 영상처리 공격 및 JPEG 압축 공격에 대해서 견고성이 우수함을 확인하였다.

MMTF와 인간지각 특성을 이용한 결함성분 추출기법 (Defect Detection Method using Human Visual System and MMTF)

  • 허경무;주영복
    • 제어로봇시스템학회논문지
    • /
    • 제19권12호
    • /
    • pp.1094-1098
    • /
    • 2013
  • AVI (Automatic Vision Inspection) systems automatically detect defect features and measure their sizes via camera vision. Defect detection is not an easy process because of noises from various sources and optical distortion. In this paper the acquired images from a TFT panel are enhanced with the adoption of an HVS (Human Visual System). A human visual system is more sensitive on the defect area than the illumination components because it has greater sensitivity to variations of intensity. In this paper we modified an MTF (Modulation Transfer Function) in the Wavelet domain and utilized the characteristics of an HVS. The proposed algorithm flattens the inner illumination components while preserving the defect information intact.