• Title/Summary/Keyword: 3D Based

Search Result 15,822, Processing Time 0.045 seconds

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

A New Object Region Detection and Classification Method using Multiple Sensors on the Driving Environment (다중 센서를 사용한 주행 환경에서의 객체 검출 및 분류 방법)

  • Kim, Jung-Un;Kang, Hang-Bong
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.8
    • /
    • pp.1271-1281
    • /
    • 2017
  • It is essential to collect and analyze target information around the vehicle for autonomous driving of the vehicle. Based on the analysis, environmental information such as location and direction should be analyzed in real time to control the vehicle. In particular, obstruction or cutting of objects in the image must be handled to provide accurate information about the vehicle environment and to facilitate safe operation. In this paper, we propose a method to simultaneously generate 2D and 3D bounding box proposals using LiDAR Edge generated by filtering LiDAR sensor information. We classify the classes of each proposal by connecting them with Region-based Fully-Covolutional Networks (R-FCN), which is an object classifier based on Deep Learning, which uses two-dimensional images as inputs. Each 3D box is rearranged by using the class label and the subcategory information of each class to finally complete the 3D bounding box corresponding to the object. Because 3D bounding boxes are created in 3D space, object information such as space coordinates and object size can be obtained at once, and 2D bounding boxes associated with 3D boxes do not have problems such as occlusion.

A Development Case of 3D Game: Dream3D Prototype Game Contents (3차원 게임 개발 사례: Dream3D 시범 컨텐츠)

  • 이헌주;박태준;김현빈
    • Proceedings of the IEEK Conference
    • /
    • 2003.07d
    • /
    • pp.1431-1434
    • /
    • 2003
  • Computer game has become the core part of multimedia and entertainment in our knowledge and information based society We are competitive in developing 2D games. However, we have difficulties in maintaining the competitive edge in the area of 3D game technologies owing to the limited funds and technologies. Game engines are very useful to develop high-quality 3D games. In this paper, we discuss game engines and development of contents, and also present a development case of 3D games using Dream3D.

  • PDF

Analysis of Switched Reluctance Motor based on 3D Equivalent Magnetic Circuit Network Method of New Shape Element (새로운 요소를 이용한 SRM의 3차원 등가자기회로망 해석)

  • Kim, Wa-Sung;Chun, Yon-Do;Kim, Youn-Hyun;Lee, Ju;Kim, Suk-Tae;Lee, Chol-Jik
    • Proceedings of the KIEE Conference
    • /
    • 2001.07b
    • /
    • pp.570-573
    • /
    • 2001
  • This paper presents the characteristics of Switched Reluctance Motor (SRM) based on 3D Equivalent Magnetic Circuit Network Method (3D EMCNM). 3D EMCNM supplements magnetic equivalent circuit by numerical technique using distributive magnetic circuit parameters. However in case of SRM the previous 3D EMCNM which uses fan shape element is not proper for analysis. This paper solved this problem by developing the trapezoid element and verified the validity of the suggested element by comparing the results of 3D EMCNM with 2D FEM.

  • PDF

Open Standard Based 3D Urban Visualization and Video Fusion

  • Enkhbaatar, Lkhagva;Kim, Seong-Sam;Sohn, Hong-Gyoo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.28 no.4
    • /
    • pp.403-411
    • /
    • 2010
  • This research demonstrates a 3D virtual visualization of urban environment and video fusion for effective damage prevention and surveillance system using open standard. We present the visualization and interaction simulation method to increase the situational awareness and optimize the realization of environmental monitoring through the CCTV video and 3D virtual environment. New camera prototype was designed based on the camera frustum view model to project recorded video prospectively onto the virtual 3D environment. The demonstration was developed by the X3D, which is royalty-free open standard and run-time architecture, and it offers abilities to represent, control and share 3D spatial information via the internet browsers.

Development of Structured Light 3D Scanner Based on Image Processing

  • Kim, Kyu-Ha;Lee, Sang-Hyun
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.11 no.4
    • /
    • pp.49-58
    • /
    • 2019
  • 3D scanners are needed in various fields, and their usage range is greatly expanded. In particular, it is being used to reduce costs at various stages during product development and production. Now, the importance of quality inspection in the manufacturing industry is increasing. Structured optical system applied in this study is suitable for measuring high precision of mold, press work, precision products, etc. and economical and effective 3D scanning system for measuring inspection in manufacturing industry can be implemented. We developed Structured light 3D scanner which can measure high precision by using Digital Light Processing (DLP) projector and camera. In this paper, 3D image scanner based on structured optical system can realize 3D scanning system economically and effectively when measuring inspection in the manufacturing industry.

Evaluation of shape similarity for 3D models (3차원 모델을 위한 형상 유사성 평가)

  • Kim, Jeong-Sik;Choi, Soo-Mi
    • The KIPS Transactions:PartA
    • /
    • v.10A no.4
    • /
    • pp.357-368
    • /
    • 2003
  • Evaluation of shape similarity for 3D models is essential in many areas - medicine, mechanical engineering, molecular biology, etc. Moreover, as 3D models are commonly used on the Web, many researches have been made on the classification and retrieval of 3D models. In this paper, we describe methods for 3D shape representation and major concepts of similarity evaluation, and analyze the key features of recent researches for shape comparison after classifying them into four categories including multi-resolution, topology, 2D image, and statistics based methods. In addition, we evaluated the performance of the reviewed methods by the selected criteria such as uniqueness, robustness, invariance, multi-resolution, efficiency, and comparison scope. Multi-resolution based methods have resulted in decreased computation time for comparison and increased preprocessing time. The methods using geometric and topological information were able to compare more various types of models and were robust to partial shape comparison. 2D image based methods incurred overheads in time and space complexity. Statistics based methods allowed for shape comparison without pose-normalization and showed robustness against affine transformations and noise.

Schema Definition and Implementation for Web3D Physical Units (웹3D 물리 단위 스키마 정의와 구현)

  • Kim, Lee-Hyun;Park, Chang-Sup;Lee, Myeong-Won
    • Journal of the Korea Computer Graphics Society
    • /
    • v.16 no.3
    • /
    • pp.11-19
    • /
    • 2010
  • This paper describes how to define and implement the schema for 3D virtual objects with physical units so that the objects can be compared in virtual environments based on physical properties, such as length, according to the specified units. We define physical units for virtual objects using the International System of Units and based on the X3D (Extensible 3D) specification. The schema must be defined with validation so that it does not violate the original X3D data structure. In this paper, we have extended the original X3D schema with a physical unit specification, and demonstrate the difference between units-specified and non-units-specified 3D scenes using an X3D browser that we developed.

Comparison of Slim Appearance for 2D Image and 3D Virtual Clothing Images Based on Stripe Arrangement (스트라이프 조건에 따른 2차원 이미지와 3차원 가상착의 이미지의 착용효과 비교)

  • Park, Soyoung;Lee, Yejin
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.46 no.2
    • /
    • pp.321-330
    • /
    • 2022
  • This study analyzed the difference between 2D image and 3D virtual clothing images based on stripe arrangement to obtain fundamental data for slim appearance. First, the slimming effect according to the three types of stripe ratio was examined. Subsequently, the slimming effects of seven types of one-piece dress designs according to the stripe location were analyzed. Subjective ranking was evaluated. The width items and radius of curvature were measured for the image's respective parts. Consequently, in 2D image and 3D virtual clothing images, the one with the narrowest stripe ratio was evaluated as the slimmest; however, the conditions for the slimming effect were different. In the seven one-piece dress designs, a difference was apparent in the ranking of the 2D image and 3D virtual clothing images. In the 3D virtual clothing image, arranging the stripes on the entire garment proved inefficient. The stripes were curved according to the curvature of the human body, creating an optical illusion that differed from that of the 2D image.

Reliability of 3D-Inertia Measurement Unit Based Shoes in Gait Analysis (관성센서 기반 신발형 보행 분석기의 신뢰성 연구)

  • Joo, Ji-Yong;Kim, Young-Kwan;Park, Jae-Young
    • Korean Journal of Applied Biomechanics
    • /
    • v.25 no.1
    • /
    • pp.123-130
    • /
    • 2015
  • Purpose : The purpose of this study was to investigate the reliability of 3D-inertia measurement unit (IMU) based shoes in gait analysis. This was done with respect to the results of the optical motion capturing system and to collect reference gait data of healthy subjects with this device. Methods : The Smart Balance$^{(R)}$ system of 3D-IMU based shoes and Osprey$^{(R)}$ motion capturing cameras were used to collect motion data simultaneously. Forty four healthy subjects consisting of individuals in 20s (N=20), 40s (N=13), and 60s (N=11) participated in this study voluntarily. They performed natural walking on a treadmill for one minute at 4 different target speeds (3, 4, 5, 6 km/h), respectively. Results : Cadence (ICC=.998), step length (ICC=.970), stance phase (ICC=.845), and double-support phase (ICC=.684) from 3D-IMU based shoes were in agreement with results of optical motion system. Gait data of healthy subjects according to different treadmill speeds and ages were matched to previous literature showing increased cadence and reduced step length for elderly subjects. Conclusion : Conclusively, 3D-IMU based shoes in gait analysis were a satisfactory alternative option in measuring linear gait parameters.