• Title/Summary/Keyword: 가상카메라

Search Result 511, Processing Time 0.026 seconds

Visual Tracking Technique Based on Projective Modular Active Shape Model (투영적 모듈화 능동 형태 모델에 기반한 영상 추적 기법)

  • Kim, Won
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.2
    • /
    • pp.77-89
    • /
    • 2009
  • Visual tracking technique is one of the essential things which are very important in the major fields of modern society. While contour tracking is especially necessary technique in the aspect of its fast performance with target's external contour information, it sometimes fails to track target motion because it is affected by the surrounding edges around target and weak egdes on the target boundary. To overcome these weak points, in this research it is suggested that PDMs can be obtained by generating the virtual 6-DOF motions of the mobile robot with a CCD camera and the image tracking system which is robust to the local minima around the target can be configured by constructing Active Shape Model in modular base. To show the effectiveness of the proposed method, the experiment is performed on the image stream obtained by a real mobile robot and the better performance is confirmed by comparing the experimental results with the ones of other major tracking techniques.

Panorama Image Stitching Using Sythetic Fisheye Image (Synthetic fisheye 이미지를 이용한 360° 파노라마 이미지 스티칭)

  • Kweon, Hyeok-Joon;Cho, Donghyeon
    • Journal of Broadcast Engineering
    • /
    • v.27 no.1
    • /
    • pp.20-30
    • /
    • 2022
  • Recently, as VR (Virtual Reality) technology has been in the spotlight, 360° panoramic images that can view lively VR contents are attracting a lot of attention. Image stitching technology is a major technology for producing 360° panorama images, and many studies are being actively conducted. Typical stitching algorithms are based on feature point-based image stitching. However, conventional feature point-based image stitching methods have a problem that stitching results are intensely affected by feature points. To solve this problem, deep learning-based image stitching technologies have recently been studied, but there are still many problems when there are few overlapping areas between images or large parallax. In addition, there is a limit to complete supervised learning because labeled ground-truth panorama images cannot be obtained in a real environment. Therefore, we produced three fisheye images with different camera centers and corresponding ground truth image through carla simulator that is widely used in the autonomous driving field. We propose image stitching model that creates a 360° panorama image with the produced fisheye image. The final experimental results are virtual datasets configured similar to the actual environment, verifying stitching results that are strong against various environments and large parallax.

Development of a Fault Detection Algorithm for Multi-Autonomous Driving Perception Sensors Based on FIR Filters (FIR 필터 기반 다중 자율주행 인지 센서 결함 감지 알고리즘 개발)

  • Jae-lee Kim;Man-bok Park
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.22 no.3
    • /
    • pp.175-189
    • /
    • 2023
  • Fault detection and diagnosis (FDI) algorithms are actively being researched for ensuring the integrity and reliability of environment perception sensors in autonomous vehicles. In this paper, a fault detection algorithm based on a multi-sensor perception system composed of radar, camera, and lidar is proposed to guarantee the safety of an autonomous vehicle's perception system. The algorithm utilizes reference generation filters and residual generation filters based on finite impulse response (FIR) filter estimates. By analyzing the residuals generated from the filtered sensor observations and the estimated state errors of individual objects, the algorithm detects faults in the environment perception sensors. The proposed algorithm was evaluated by comparing its performance with a Kalman filter-based algorithm through numerical simulations in a virtual environment. This research could help to ensure the safety and reliability of autonomous vehicles and to enhance the integrity of their environment perception sensors.

Comparing State Representation Techniques for Reinforcement Learning in Autonomous Driving (자율주행 차량 시뮬레이션에서의 강화학습을 위한 상태표현 성능 비교)

  • Jihwan Ahn;Taesoo Kwon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.109-123
    • /
    • 2024
  • Research into vision-based end-to-end autonomous driving systems utilizing deep learning and reinforcement learning has been steadily increasing. These systems typically encode continuous and high-dimensional vehicle states, such as location, velocity, orientation, and sensor data, into latent features, which are then decoded into a vehicular control policy. The complexity of urban driving environments necessitates the use of state representation learning through networks like Variational Autoencoders (VAEs) or Convolutional Neural Networks (CNNs). This paper analyzes the impact of different image state encoding methods on reinforcement learning performance in autonomous driving. Experiments were conducted in the CARLA simulator using RGB images and semantically segmented images captured by the vehicle's front camera. These images were encoded using VAE and Vision Transformer (ViT) networks. The study examines how these networks influence the agents' learning outcomes and experimentally demonstrates the role of each state representation technique in enhancing the learning efficiency and decision- making capabilities of autonomous driving systems.

Enterprise Human Resource Management using Hybrid Recognition Technique (하이브리드 인식 기술을 이용한 전사적 인적자원관리)

  • Han, Jung-Soo;Lee, Jeong-Heon;Kim, Gui-Jung
    • Journal of Digital Convergence
    • /
    • v.10 no.10
    • /
    • pp.333-338
    • /
    • 2012
  • Human resource management is bringing the various changes with the IT technology. In particular, if HRM is non-scientific method such as group management, physical plant, working hours constraints, personal contacts, etc, the current enterprise human resources management(e-HRM) appeared in the individual dimension management, virtual workspace (for example: smart work center, home work, etc.), working time flexibility and elasticity, computer-based statistical data and the scientific method of analysis and management has been a big difference in the sense. Therefore, depending on changes in the environment, companies have introduced a variety of techniques as RFID card, fingerprint time & attendance systems in order to build more efficient and strategic human resource management system. In this paper, time and attendance, access control management system was developed using multi camera for 2D and 3D face recognition technology-based for efficient enterprise human resource management. We had an issue with existing 2D-style face-recognition technology for lighting and the attitude, and got more than 90% recognition rate against the poor readability. In addition, 3D face recognition has computational complexities, so we could improve hybrid video recognition and the speed using 3D and 2D in parallel.

Realtime Video Visualization based on 3D GIS (3차원 GIS 기반 실시간 비디오 시각화 기술)

  • Yoon, Chang-Rak;Kim, Hak-Cheol;Kim, Kyung-Ok;Hwang, Chi-Jung
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.63-70
    • /
    • 2009
  • 3D GIS(Geographic Information System) processes, analyzes and presents various real-world 3D phenomena by building 3D spatial information of real-world terrain, facilities, etc., and working with visualization technique such as VR(Virtual Reality). It can be applied to such areas as urban management system, traffic information system, environment management system, disaster management system, ocean management system, etc,. In this paper, we propose video visualization technology based on 3D geographic information to provide effectively real-time information in 3D geographic information system and also present methods for establishing 3D building information data. The proposed video visualization system can provide real-time video information based on 3D geographic information by projecting real-time video stream from network video camera onto 3D geographic objects and applying texture-mapping of video frames onto terrain, facilities, etc.. In this paper, we developed sem i-automatic DBM(Digital Building Model) building technique using both aerial im age and LiDAR data for 3D Projective Texture Mapping. 3D geographic information system currently provide static visualization information and the proposed method can replace previous static visualization information with real video information. The proposed method can be used in location-based decision-making system by providing real-time visualization information, and moreover, it can be used to provide intelligent context-aware service based on geographic information.

  • PDF

A study on 3D Modeling Process & Rendering Image of CAD Program-With Case study on Cellular Phone Design- (캐드에 의한 3차원 모델링 제작과정과 렌더링 이미지 연출에 관한 연구-무선 이동 전화기 디자인 사례를 중심으로-)

  • 이대우
    • Archives of design research
    • /
    • no.18
    • /
    • pp.25-34
    • /
    • 1996
  • Industrial design development methods and processes have changed in accordance with Industrial Information Age. These days, problems are created by existing methods and evaluation of design value , all problems concerned with time and finances sitaution have been made a subject of discussion. Development of design processes have been changed by the development of problem recognition and solving tools, and dpsign tpchnulugy havp hppn replaced by computer technology,Thus. software design processes linking thoughtware to hardware are used in the solution of design problems with many parts. In this study, 3D Modeling samples are presented, 3D Modeling can realise ' Ideas' to '3Dimentional Virtual Ohjects'. These effect and value are anle to decisively influence the process of design problem conference-ebealuation-solution.Proxesses of actual modeling and rendering are made as follows. By compusition of simple 20 drawings and shaping them into 30 objects, 30 solid models can be made. To prssent effectivley, we can make a sample model by varying camera views,light sourses,materials and colours etc. This sample is evaluated by various cumposition, methods and PERT(Program Evaluation and Review Technique). This cuncrete sample (tentative plan)is changed within the CAD SYSTEM by design evaluation, and then converted to flowchart of mass productive conception through refined data. So, that tentative plan can be conformed to design desire actuillly, to the utmost degree. Finally, this design process can be proposed as il new method in cuntrast with current methods. The aim of this study is to suggest effective evaluation methods of design outcome among many evaluating elements.

  • PDF

A study on the characteristics of brain image and yeongsang expression in the digital information environment (디지털 정보환경에 있어 뇌내 이미지와 영상표현의 특성에 관한 연구)

  • 이규옥
    • Archives of design research
    • /
    • v.16 no.2
    • /
    • pp.323-334
    • /
    • 2003
  • This study is focused on subjective images that are produced before visualization in the digital information environment and on characteristics of objective, dynamic image expression that specifies the subjective images. In this study, the visual world that works in the action of "see"is expanded into vision of eyes, vision of brain, and vision of camera. Also we have redefined the definitions of image and its materialized image, yeongsang. It is defined that image contains a strong meaning of consciousness and mind, and that yeongsang involves vision in which constantly changing information of light is created and reproduced by physical processes. We made it clear that image expression in the 21 st century is becoming more generalized, simplified, and concentrated, by the digital technology, from existing specific non-real images to "informationalized" non-real images. This means that there exists an intrinsic difference in the expressional form of the modern analog environment and that of the recent digital environment in the area of yeongsang communication. Along with development of technology, image information raises plastic reality through indirect experience in the virtual space by expanding the sensual faculty of human. However, there also is a tendency for humans to rely more on technology instead of utilizing their creative faculty. Image expression by“the digital information environment” in the 21st century will pursue two sides; one is to shift from external expression of the human body in the cyber space to internal expression, and the other is to internalize the image world and make it connected worldwide. Further research is necessary in these fields.ary in these fields.

  • PDF

Vision-based Motion Control for the Immersive Interaction with a Mobile Augmented Reality Object (모바일 증강현실 물체와 몰입형 상호작용을 위한 비전기반 동작제어)

  • Chun, Jun-Chul
    • Journal of Internet Computing and Services
    • /
    • v.12 no.3
    • /
    • pp.119-129
    • /
    • 2011
  • Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.

Implementation of Smart Shopping Cart using Object Detection Method based on Deep Learning (딥러닝 객체 탐지 기술을 사용한 스마트 쇼핑카트의 구현)

  • Oh, Jin-Seon;Chun, In-Gook
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.7
    • /
    • pp.262-269
    • /
    • 2020
  • Recently, many attempts have been made to reduce the time required for payment in various shopping environments. In addition, for the Fourth Industrial Revolution era, artificial intelligence is advancing, and Internet of Things (IoT) devices are becoming more compact and cheaper. So, by integrating these two technologies, access to building an unmanned environment to save people time has become easier. In this paper, we propose a smart shopping cart system based on low-cost IoT equipment and deep-learning object-detection technology. The proposed smart cart system consists of a camera for real-time product detection, an ultrasonic sensor that acts as a trigger, a weight sensor to determine whether a product is put into or taken out of the shopping cart, an application for smartphones that provides a user interface for a virtual shopping cart, and a deep learning server where learned product data are stored. Communication between each module is through Transmission Control Protocol/Internet Protocol, a Hypertext Transmission Protocol network, a You Only Look Once darknet library, and an object detection system used by the server to recognize products. The user can check a list of items put into the smart cart via the smartphone app, and can automatically pay for them. The smart cart system proposed in this paper can be applied to unmanned stores with high cost-effectiveness.