• Title/Summary/Keyword: scene perception

Search Result 68, Processing Time 0.026 seconds

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

Traffic Flow Sensing Using Wireless Signals

  • Duan, Xuting;Jiang, Hang;Tian, Daxin;Zhou, Jianshan;Zhou, Gang;E, Wenjuan;Sun, Yafu;Xia, Shudong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.10
    • /
    • pp.3858-3874
    • /
    • 2021
  • As an essential part of the urban transportation system, precise perception of the traffic flow parameters at the traffic signal intersection ensures traffic safety and fully improves the intersection's capacity. Traditional detection methods of road traffic flow parameter can be divided into the micro and the macro. The microscopic detection methods include geomagnetic induction coil technology, aerial detection technology based on the unmanned aerial vehicles (UAV) and camera video detection technology based on the fixed scene. The macroscopic detection methods include floating car data analysis technology. All the above methods have their advantages and disadvantages. Recently, indoor location methods based on wireless signals have attracted wide attention due to their applicability and low cost. This paper extends the wireless signal indoor location method to the outdoor intersection scene for traffic flow parameter estimation. In this paper, the detection scene is constructed at the intersection based on the received signal strength indication (RSSI) ranging technology extracted from the wireless signal. We extracted the RSSI data from the wireless signals sent to the road side unit (RSU) by the vehicle nodes, calibrated the RSSI ranging model, and finally obtained the traffic flow parameters of the intersection entrance road. We measured the average speed of traffic flow through multiple simulation experiments, the trajectory of traffic flow, and the spatiotemporal map at a single intersection inlet. Finally, we obtained the queue length of the inlet lane at the intersection. The simulation results of the experiment show that the RSSI ranging positioning method based on wireless signals can accurately estimate the traffic flow parameters at the intersection, which also provides a foundation for accurately estimating the traffic flow state in the future era of the Internet of Vehicles.

A Study on Pre-service Early Childhood Teachers' Perception of Bullying (예비유아교사의 따돌림 인식에 대한 연구)

  • Bae, Jae-Hyun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.5
    • /
    • pp.417-426
    • /
    • 2019
  • This study examined to offer practical implications for the bullying for the prevention and response in early childhood education at the scene of the bullying that occur by to confirm the perception of the bullying to pre-service early childhood teachers. The survey questionnaire was completed by 313 pre-service early childhood teachers. SPSS Win program was used to perform frequency analysis, ANOVA. (1)The perception of bullying were significantly different according to grade and experience of child care practice, classroom observation, education program for taking preventive measure. (2)Teachers' perception about the action that can be seen as bullying followed by 'apply the violence, such as kicking, or were frequent', 'shared in things that often prevents','often to another carrier or shame in front of a friend'. (3)Perception about characteristics of bullying Perpetrators was 'aggressive behavior and talk much' and perception about characteristics of bullying victims was 'shy and not much'. (4)The reason of bullying perpetrators was 'Just for fun without a special reason' and the cause of bullying victims was 'problem of parents' child-rearing attitudes and home environment'. (5)Important institutions to combat bullying prevention followed by teacher, parents and family, community and the nation, preschool educational institution. Teachers guidance content of combat and prevent bullying was 'to be isolated from the class to infants continue to monitor'. Parents guidance content of combat and prevent bullying was 'communicate a lot and attention to children'. Early childhood education institutions guidance content of combat and prevent bullying was 'operations to come up with the bullying prevention education in educational time'. This study indicated that it is necessary to make efforts for increasing perception of bullying in pre-service early childhood teachers.

A Study on Perception of Teachers for the Happiness Eduction Practices in Mathematics Education (수학교육에서의 행복교육 실천방안에 대한 교사 인식 조사)

  • Kim, Changil;Jeon, Young Ju
    • Journal of the Korean School Mathematics Society
    • /
    • v.18 no.4
    • /
    • pp.471-486
    • /
    • 2015
  • Happiness education is not aim at rising in the world and gaining fame about goal of education but that it is a transition movement to mature educational direction to conduce to demonstrate the student's aptitude and potential. It is to search for a specific practices of happiness education in school mathematics curriculum is important at mathematics education. In this study, we surveyed about practices of happiness education of primary teachers and math teachers of the secondary schools. The practices of a reasonable and a practical happiness education which is conform to the scene of school was especially seek by the analysis of survey results.

Adaptive Processing for Feature Extraction: Application of Two-Dimensional Gabor Function

  • Lee, Dong-Cheon
    • Korean Journal of Remote Sensing
    • /
    • v.17 no.4
    • /
    • pp.319-334
    • /
    • 2001
  • Extracting primitives from imagery plays an important task in visual information processing since the primitives provide useful information about characteristics of the objects and patterns. The human visual system utilizes features without difficulty for image interpretation, scene analysis and object recognition. However, to extract and to analyze feature are difficult processing. The ultimate goal of digital image processing is to extract information and reconstruct objects automatically. The objective of this study is to develop robust method to achieve the goal of the image processing. In this study, an adaptive strategy was developed by implementing Gabor filters in order to extract feature information and to segment images. The Gabor filters are conceived as hypothetical structures of the retinal receptive fields in human vision system. Therefore, to develop a method which resembles the performance of human visual perception is possible using the Gabor filters. A method to compute appropriate parameters of the Gabor filters without human visual inspection is proposed. The entire framework is based on the theory of human visual perception. Digital images were used to evaluate the performance of the proposed strategy. The results show that the proposed adaptive approach improves performance of the Gabor filters for feature extraction and segmentation.

Research on the Continuous Use Intention of Mobile Bus Payment App from the Perspective of user Quality Perception

  • Li, Shuo;Sun, Cong-Ying
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.9
    • /
    • pp.217-224
    • /
    • 2022
  • Based on the success model and Expectation Confirmation model of information system, the concept model of mobile bus payment App users' willingness to continue using is constructed by introducing function quality and interface design quality. A total of 264 valid questionnaires are obtained by issuing online questionnaires, and the model is tested by SmartPLS3.0 software The results show that users' perceptions of information quality, system quality and interface design quality will affect users' perceived usefulness and satisfaction through the scene, and then affect users' willingness to continue to use; Perceived functional quality has a significant impact on perceived usefulness, but has no significant impact on satisfaction. Perceived usefulness has a significant impact on user satisfaction.

Semi-Supervised Domain Adaptation on LiDAR 3D Object Detection with Self-Training and Knowledge Distillation (자가학습과 지식증류 방법을 활용한 LiDAR 3차원 물체 탐지에서의 준지도 도메인 적응)

  • Jungwan Woo;Jaeyeul Kim;Sunghoon Im
    • The Journal of Korea Robotics Society
    • /
    • v.18 no.3
    • /
    • pp.346-351
    • /
    • 2023
  • With the release of numerous open driving datasets, the demand for domain adaptation in perception tasks has increased, particularly when transferring knowledge from rich datasets to novel domains. However, it is difficult to solve the change 1) in the sensor domain caused by heterogeneous LiDAR sensors and 2) in the environmental domain caused by different environmental factors. We overcome domain differences in the semi-supervised setting with 3-stage model parameter training. First, we pre-train the model with the source dataset with object scaling based on statistics of the object size. Then we fine-tine the partially frozen model weights with copy-and-paste augmentation. The 3D points in the box labels are copied from one scene and pasted to the other scenes. Finally, we use the knowledge distillation method to update the student network with a moving average from the teacher network along with a self-training method with pseudo labels. Test-Time Augmentation with varying z values is employed to predict the final results. Our method achieved 3rd place in ECCV 2022 workshop on the 3D Perception for Autonomous Driving challenge.

Visual Narrative as a Color Storytelling in DISNEY and GHIBLI Studios (디즈니와 지브리 애니메이션 비주얼 서사구조에 관한 비교 연구)

  • Brito, Yahaira Moreno;Cho, Dong-Min
    • Cartoon and Animation Studies
    • /
    • s.49
    • /
    • pp.221-246
    • /
    • 2017
  • Visual narrative or storytelling involve two important aspects of the cognitive perception: the conscious and subconscious. Color is one of the cognitive storytelling elements, its interpretation is captured by the subconscious and it is considered an emotional resource due to its psychological background. On the other hand, the character is also part of cognitive perception and storytelling tool, but this is interpreted consciously, character is considered as a logical resource. Ghibli and Disney have organized their cinematographic techniques in different ways, so it would be unfair to say that one narrative style is better than the other, it depends of perception of beauty which varies according to society. However the present study seeks to determine the differences between Ghibli and Disney narrative style, taking as reference color. Ghibli and Disney are perfect example about color effects as a storytelling agent, It can be classified in two aspects: dynamics of color and color as a narrative sequence. The dynamics of color analyzes how color acts and is perceived into a stage, its meaning and symbolism regardless of the character's actions. The narrative sequence studies how color thermologic evolves in scene's development.

Haptic Perception presented in Picturesque Gardens - With a Focus on Picturesque Garden in Eighteenth-Century England - (픽처레스크 정원에 나타난 촉지적 지각 - 18세기 영국 픽처레스크 정원을 중심으로 -)

  • Kim, Jin-Seob;Kim, Jin-Seon
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.44 no.2
    • /
    • pp.37-51
    • /
    • 2016
  • Modern optical mechanisms slanted toward Ocular-centrism have neglected diverse functions of vision, judged objects in abstract and binary perspectives, and organized spaces accordingly, there by neglecting the function of eyes groping objects. Recently, various experiences have been induced through communication with other senses by the complex perception beyond the binary perception system of vision. Haptic perception is dynamic vision that induces accompanying bodily experiences through interaction among the various senses; it recognizes the characteristics of material properties and various sensitive stimulations of human beings. This study elaborates on the major features of haptic perception by examining the theoretical background of this concept, which stimulates the active experience of the subject and determines how characteristics of haptic perception are displayed in picturesque gardens. In order to identify the major features of haptic perception, this study examines how Adolf Hildebrand's theory of vision is developed, expanded, and reinterpreted by Alois Riegl, Wilhelm Worringer, Walter Benjamin, Maurice Merleau Ponty, and Gilles Deleuze in the histories of philosophy and aesthetics. Based thereon, the core differences in haptic perception models and visual perception models are analyzed, and the features of haptic perception are identified. Then, classical gardens are set for visual perception and picturesque gardens are set for haptic perception so that the features from haptic perception identified previously are projected onto the picturesque gardens. The research results drawn from this study regarding features of haptic perception presented in picturesque gardens are as follows. The core differences of haptic perception in contrast to visual perception can be summarized as ambiguity and obscureness of boundaries, generation of dynamic perspectives, induction of motility by indefinite circulation, and strangeness and sublime beauty by the impossibility of perception. In picturesque gardens, the ambiguity and obscureness of boundaries are presented in the irregularity and asymmetric elements of planes and the rejection of a single view, and the generation of dynamic perspectives results from the adoption of narrative structure and overlapping of spaces through the creation of complete views, medium range views, and distant views, which the existing gardens lack. Thus, the scene composition technique is reproduced. The induction of motility by indefinite circulation is created by branching circulation, and strangeness and sublime beauty are presented through the use of various elements and the adoption of 'roughness', 'irregularity', and 'ruins' in the gardens.

Real time tracking of multiple humans for mobile robot application

  • Park, Joon-Hyuk;Park, Byung-Soo;Lee, Seok;Park, Sung-Kee;Kim, Munsang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.100.3-100
    • /
    • 2002
  • This paper presents the method for detection and tracking of multiple humans robustly in mobile platform. The perception of human is performed in real time through the processing of images acquired from a moving stereo vision system. We performed multi-cue integration such as human shape, skin color and depth information to detect and track each human in moving background scene. Human shape is measured by edge-based template matching on distance transformed image. Improving robustness for human detection, we apply the human face skin color in HSV color space. And we could increase the accuracy and the robustness in both detection and tracking by applying random sampling stochastic estimati...

  • PDF