• Title/Summary/Keyword: multi-vision

Search Result 483, Processing Time 0.026 seconds

A Full Body Gumdo Game with an Intelligent Cyber Fencer using Multi-modal(3D Vision and Speech) Interface (멀티모달 인터페이스(3차원 시각과 음성 )를 이용한 지능적 가상검객과의 전신 검도게임)

  • 윤정원;김세환;류제하;우운택
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.9 no.4
    • /
    • pp.420-430
    • /
    • 2003
  • This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

Control Architecture for N-Screen Based Interactive Mutli-Vision System (N-스크린 기반 인터렉티브 멀티 비전 시스템 제어 구조)

  • Sarwar, Ghulam;Ullah, Farman;Yoon, Changwoo;Lee, Sungchang
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.6
    • /
    • pp.72-81
    • /
    • 2013
  • In this paper, we propose the architecture and user interaction mechanism to implement N-Screen services on Multi-Vision System (MVS) that are not supported in existing systems. N-Screen services enable users to control the MVS displays through any of their devices and share contents among MVS displays and user's active-devices with service continuation at any location. We provide N-Screen interactive services on MVS by introducing N-Screen interaction & session management server and agent. Furthermore, we present some examples of the protocols such as application launching, user interaction for service control and visualcasting to support N-Screen services. In addition, we explain the N-Screen service scenarios for providing split sessions on user's active-devices and launching metadata content on any of his devices at any location supported by these protocols. The simulation result demonstrates the feasibility and performance improvement of the proposed visualcasting mechanisms.

Optimal 3D Grasp Planning for unknown objects (임의 물체에 대한 최적 3차원 Grasp Planning)

  • 이현기;최상균;이상릉
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.462-465
    • /
    • 2002
  • This paper deals with the problem of synthesis of stable and optimal grasps with unknown objects by 3-finger hand. Previous robot grasp research has analyzed mainly with either unknown objects 2D by vision sensor or unknown objects, cylindrical or hexahedral objects, 3D. Extending the previous work, in this paper we propose an algorithm to analyze grasp of unknown objects 3D by vision sensor. This is archived by two steps. The first step is to make a 3D geometrical model of unknown objects by stereo matching which is a kind of 3D computer vision technique. The second step is to find the optimal grasping points. In this step, we choose the 3-finger hand because it has the characteristic of multi-finger hand and is easy to modeling. To find the optimal grasping points, genetic algorithm is used and objective function minimizing admissible farce of finger tip applied to the object is formulated. The algorithm is verified by computer simulation by which an optimal grasping points of known objects with different angles are checked.

  • PDF

The Optimal Grasp Planning by Using a 3-D Computer Vision Technique (3차원 영상처리 기술을 이용한 Grasp planning의 최적화)

  • 이현기;김성환;최상균;이상룡
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.19 no.11
    • /
    • pp.54-64
    • /
    • 2002
  • This paper deals with the problem of synthesis of stable and optimal grasps with unknown objects by 3-finger hand. Previous robot grasp research has mainly analyzed with either unknown objects 2-dimensionally by vision sensor or known objects, such as cylindrical objects, 3-dimensionally. As extending the previous work, in this study we propose an algorithm to analyze grasp of unknown objects 3-dimensionally by using vision sensor. This is archived by two steps. The first step is to make a 3-dimensional geometrical model for unknown objects by using stereo matching. The second step is to find the optimal grasping points. In this step, we choose the 3-finger hand which has the characteristic of multi-finger hand and is easy to model. To find the optimal grasping points, genetic algorithm is employed and objective function minimizes the admissible force of finger tip applied to the objects. The algorithm is verified by computer simulation by which optimal grasping points of known objects with different angle are checked.

Development of Vision System Model for Manipulator's Assemble task (매니퓰레이터의 조립작업을 위한 비젼시스템 모델 개발)

  • 장완식
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.6 no.2
    • /
    • pp.10-18
    • /
    • 1997
  • This paper presents the development of real-time estimation and control details for a computer vision-based robot control method. This is accomplished using a sequential estimation scheme that permits placement of these points in each of the two-dimensional image planes of monitoring cameras. Estimation model is developed based on a model that generalizes know 4-axis Scorbot manipulator kinematics to accommodate unknown relative camera position and orientation, etc. This model uses six uncertainty-of-view parameters estimated by the iteration method. The method is tested experimentally in two ways : First the validity of estimation model is tested by using the self-built test model. Second, the practicality of the presented control method is verified in performing 4-axis manipulator's assembly task. These results show that control scheme used is precise and robust. This feature can open the door to a range of application of multi-axis robot such as deburring and welding.

  • PDF

A Study on the Vision-Based Inspection System for Ball-Stud (비전을 이용한 볼-스터드 검사 시스템에 관한 연구)

  • 장영훈;권태종;한창수;문영식
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.15 no.12
    • /
    • pp.7-13
    • /
    • 1998
  • In this paper, an automatic ball-stud inspection system has been developed using the computer-aided vision system. Index table has been used to get the rapid measurement and multi-camera has been used to get the high resolution in physical system. Camera calibration was suggested to perform the reliable inspection. Image processing and data analysis algorithms for ball stud inspection system have been investigated and were performed quickly with high accuracy. As a result, inspection system of a ball stud could be used with a high resolution in real time.

  • PDF

A study on the rigid bOdy placement task of robot system based on the computer vision system (컴퓨터 비젼시스템을 이용한 로봇시스템의 강체 배치 실험에 대한 연구)

  • 장완식;유창규;신광수;김호윤
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1995.10a
    • /
    • pp.1114-1119
    • /
    • 1995
  • This paper presents the development of estimation model and control method based on the new computer vision. This proposed control method is accomplished using a sequential estimation scheme that permits placement of the rigid body in each of the two-dimensional image planes of monitoring cameras. Estimation model with six parameters is developed based on a model that generalizes known 4-axis scara robot kinematics to accommodate unknown relative camera position and orientation, etc. Based on the estimated parameters,depending on each camers the joint angle of robot is estimated by the iteration method. The method is tested experimentally in two ways, the estimation model test and a three-dimensional rigid body placement task. Three results show that control scheme used is precise and robust. This feature can open the door to a range of application of multi-axis robot such as assembly and welding.

  • PDF

Three Dimensional Geometric Feature Detection Using Computer Vision System and Laser Structured Light (컴퓨터 시각과 레이저 구조광을 이용한 물체의 3차원 정보 추출)

  • Hwang, H.;Chang, Y.C.;Im, D.H.
    • Journal of Biosystems Engineering
    • /
    • v.23 no.4
    • /
    • pp.381-390
    • /
    • 1998
  • An algorithm to extract the 3-D geometric information of a static object was developed using a set of 2-D computer vision system and a laser structured lighting device. As a structured light pattern, multi-parallel lines were used in the study. The proposed algorithm was composed of three stages. The camera calibration, which determined a coordinate transformation between the image plane and the real 3-D world, was performed using known 6 pairs of points at the first stage. Then, utilizing the shifting phenomena of the projected laser beam on an object, the height of the object was computed at the second stage. Finally, using the height information of the 2-D image point, the corresponding 3-D information was computed using results of the camera calibration. For arbitrary geometric objects, the maximum error of the extracted 3-D feature using the proposed algorithm was less than 1~2mm. The results showed that the proposed algorithm was accurate for 3-D geometric feature detection of an object.

  • PDF

Development of Precision Vision Inspection System for Micro Optical Parts using a New Optical Probe Implemented to have Multiple Fields of Views (다중광학창을 가진 광학소자 자동 검사 시스템 개발)

  • 이일환;이기수;박희재
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2001.04a
    • /
    • pp.105-109
    • /
    • 2001
  • The micro optical parts such as ferrules are required to be manufactured within very small tolerances, as the slight deviation of the tolerance would give very large amount of loss in communication efficiency. For efficient optical communication, outer diameter, fiber diameter, fiber separation and eccentricity are significant parameters to be inspected., Thus we developed an automatic inspection system to evaluate shape parameters of the optical fiber connectors(ferrule) upto submicron accuracy using machine vision. new optical probe of multi fields of views has been developed and the image processing and data analysis algorithms have been complemented in real time basis. The developed system is successfully used in the practical ferrule manufacturing industry, and about 0.1$\mu\textrm{m}$ accuracy can be obtained with very fast inspection time.

  • PDF

Multi-Camera Vision System for Tele-Robotics

  • Park, Changhwn;Kohtaro Ohba;Park, Kyihwan;Sayaka Odano;Hisayaki Sasaki;Nakyoung Chong;Tetsuo Kotoku;Kazuo Tanie
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.25.6-25
    • /
    • 2001
  • A new monitoring system is proposed to give direct visual information of the remote site when working with a tele-operation system. In order to have a similar behavior of a human when he is inspecting an object, multiple cameras that have different view point are attached around the robot hand and are switched on and elf according to the operator´s motion such as joystick manipulation or operator´s head movement. The performance of the system is estimated by performing comparison experiments among single camera (SC) vision system, head mount display (HMD)system and proposed multiple camera (MC) vision system by applying a task to several examines. The reality, depth feeling and controllability are estimated for the examines ...

  • PDF