• Title/Summary/Keyword: Vision-based interface

Search Result 130, Processing Time 0.025 seconds

Hand Gesture Sequence Recognition using Morphological Chain Code Edge Vector (형태론적 체인코드 에지벡터를 이용한 핸드 제스처 시퀀스 인식)

  • Lee Kang-Ho;Choi Jong-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • v.9 no.4 s.32
    • /
    • pp.85-91
    • /
    • 2004
  • The use of gestures provides an attractive alternate to cumbersome interface devices for human-computer interaction. This has motivated a very active research area concerned with computer vision-based analysis and interpretation of hand gestures The most important issues in gesture recognition are the simplification of algorithm and the reduction of processing time. The mathematical morphology based on geometrical set theory is best used to perform the processing. The key idea of proposed algorithm is to track a trajectory of center points in primitive elements extracted by morphological shape decomposition. The trajectory of morphological center points includes the information on shape orientation. Based on this characteristic we proposed the morphological gesture sequence recognition algorithm using feature vectors calculated to the trajectory of morphological center points. Through the experiment, we demonstrated the efficiency of proposed algorithm.

  • PDF

Dynamic Manipulation of a Virtual Object in Marker-less AR system Based on Both Human Hands

  • Chun, Jun-Chul;Lee, Byung-Sung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.4 no.4
    • /
    • pp.618-632
    • /
    • 2010
  • This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

A Review of Motion Capture Systems: Focusing on Clinical Applications and Kinematic Variables (모션 캡처 시스템에 대한 고찰: 임상적 활용 및 운동형상학적 변인 측정 중심으로)

  • Lim, Wootaek
    • Physical Therapy Korea
    • /
    • v.29 no.2
    • /
    • pp.87-93
    • /
    • 2022
  • To solve the pathological problems of the musculoskeletal system based on evidence, a sophisticated analysis of human motion is required. Traditional optical motion capture systems with high validity and reliability have been utilized in clinical practice for a long time. However, expensive equipment and professional technicians are required to construct optical motion capture systems, hence they are used at a limited capacity in clinical settings despite their advantages. The development of information technology has overcome the existing limit and paved the way for constructing a motion capture system that can be operated at a low cost. Recently, with the development of computer vision-based technology and optical markerless tracking technology, webcam-based 3D human motion analysis has become possible, in which the intuitive interface increases the user-friendliness to non-specialists. In addition, unlike conventional optical motion capture, with this approach, it is possible to analyze motions of multiple people at simultaneously. In a non-optical motion capture system, an inertial measurement unit is typically used, which is not significantly different from a conventional optical motion capture system in terms of its validity and reliability. With the development of markerless technology and advent of non-optical motion capture systems, it is a great advantage that human motion analysis is no longer limited to laboratories.

Developing Interactive Game Contents using 3D Human Pose Recognition (3차원 인체 포즈 인식을 이용한 상호작용 게임 콘텐츠 개발)

  • Choi, Yoon-Ji;Park, Jae-Wan;Song, Dae-Hyeon;Lee, Chil-Woo
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.12
    • /
    • pp.619-628
    • /
    • 2011
  • Normally vision-based 3D human pose recognition technology is used to method for convey human gesture in HCI(Human-Computer Interaction). 2D pose model based recognition method recognizes simple 2D human pose in particular environment. On the other hand, 3D pose model which describes 3D human body skeletal structure can recognize more complex 3D pose than 2D pose model in because it can use joint angle and shape information of body part. In this paper, we describe a development of interactive game contents using pose recognition interface that using 3D human body joint information. Our system was proposed for the purpose that users can control the game contents with body motion without any additional equipment. Poses are recognized comparing current input pose and predefined pose template which is consist of 14 human body joint 3D information. We implement the game contents with the our pose recognition system and make sure about the efficiency of our proposed system. In the future, we will improve the system that can be recognized poses in various environments robustly.

A vision and strategy for developing virtual construction system (가상 건설 시스템 비전과 구축 방향)

  • Choi, Cheol-Ho;Chin, Sang-Yoon;Kim, Jae-Jun;Shin, Hyun-Mock;Lee, Kwang-Myong;Yoon, Su-Won
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2007.04a
    • /
    • pp.62-67
    • /
    • 2007
  • The research team for the virtual construction development was established with the support of Korea Ministry of Construction and Transportation, and KICTEP (Korea Institute of Construction and Transportation Technology Evaluation and Planning). Its aims are to develop system that is to improve productivity & quality, to create a higher value-added business, and to cultivate international competitiveness in the construction industry. The virtual construction system is a design, engineering, and construction management information system that allows the project participants to effectively share the information throughout the construction life cycle with the support of 3D and design information. To achieve this, the research team focuses on developing several systems. First, the team focuses on developing for the pre-planning, the structural engineering, MEP, and the 3D based estimation system. Second, they focus on developing a simulation system for the construction process planning and feasibility study with help of the virtual reality technologies. Third, they focus on developing the CPLM (Construction Project Life-cycle Management) system for managing construction project data, and the decision support system that makes the collaboration among the project participants based on 3D technologies and information. We also focus on developing the SDAI (Standard Data Access Interface), the localized guideline for 3D design, and a training program. In addition, we focus on developing the undeveloped area of the commercial system and building an environment that can support the communication and collaboration in the construction life-cycle rather than developing the existing and commercialized system.

  • PDF

IoL Field Gateway: An Integrated IoT Agent using Networked Smart LED Lighting Controller

  • Mariappan, Vinayagam;Jung, Soonho;Lee, Sangwoon;Cha, Jaesang
    • Information and Communications Magazine
    • /
    • v.34 no.2
    • /
    • pp.12-19
    • /
    • 2017
  • The LED technology advancement introduce cuttingedge technology on Internet of Things (IoT) to connect the physical world to the digital realm, using digital smart lighting infrastructure called Internet of light (IoL). This paper proposes an Integrated IoT agent on networked smart LED lighting controller called IoL Filed Gateway using lighting infrastructure in which a lighting system that can connect to a network and can be monitored and controlled from a centralized system or via the cloud. The IoL Field Gateway defines new world of smart connected intelligence, lighting can become an integral and responsive part of everyday human life environments. The proposed connected lighting gateway uses the concept of multi-hop ad hoc network using visible light communication (VLC) with RF wireless technologies and Wired PLC (Power Line Communication). This connectivity and intelligence integrated into LED-based luminaires form the backbone of smart buildings and cities and make the Internet of Things (IoT) vision feasible and enables the lighting administrator can control numerous lightings easily and visitors can get visual information from the lightings with their smart devices. The proposed IoL gateway design is emulated on Arduino based HW platform with VLC, RF, and PLC connectivity and evaluated with four sensor interface.

Unconstrained e-Book Control Program by Detecting Facial Characteristic Point and Tracking in Real-time (얼굴의 특이점 검출 및 실시간 추적을 이용한 e-Book 제어)

  • Kim, Hyun-Woo;Park, Joo-Yong;Lee, Jeong-Jick;Yoon, Young-Ro
    • Journal of Biomedical Engineering Research
    • /
    • v.35 no.2
    • /
    • pp.14-18
    • /
    • 2014
  • This study is about e-Book program based on human-computer interaction(HCI) system for physically handicapped person. By acquiring background knowledge of HCI, we know that if we use vision-based interface we can replace current computer input devices by extracting any characteristic point and tracing it. We decided betweeneyes as a characteristic point by analyzing facial input image using webcam. But because of three-dimensional structure of glasses, the person who is wearing glasses wasn't suitable for tracing between-eyes. So we changed characteristic point to the bridge of the nose after detecting between-eyes. By using this technique, we could trace rotation of head in real-time regardless of glasses. To test this program's usefulness, we conducted an experiment to analyze the test result on actual application. Consequently, we got 96.5% rate of success for controlling e-Book under proper condition by analyzing the test result of 20 subjects.

Neural Interface-based Hyper Sensory Device Technology Trend (신경 인터페이스 기반 초감각 디바이스 기술 동향)

  • Kim, H.J.;Byun, C.W.;Kim, S.E.;Lee, J.I.
    • Electronics and Telecommunications Trends
    • /
    • v.33 no.6
    • /
    • pp.69-80
    • /
    • 2018
  • Sensory devices have been developed to help people with disabled or weakened sensory functions. Such devices play a role in collecting and transferring data for the five senses (vision, sound, smell, taste, and tactility) and also stimulating nerves. To provide brain or prosthesis devices with more sophisticated senses, hyper sensory devices with a high resolution comparable to or even better than the human system based on individual neuron cells are essential. As for data collecting components, technologies for sensors with higher resolution and sensitivity, and the conversion of algorithms from physical sensing data to human neuron signals, are needed. Converted data can be transferred to neurons that are responsible for human senses through communication with high security, and neural interfaces with high resolution. When communication deals with human data, security is the most important consideration, and intra-body communication is expected to be a candidate with high priority. To generate sophisticated human senses by modulating neurons, neural interfaces should modulate individual neurons, and therefore a high resolution compared to human neurons (~ several tens of um) with a large area covering neuron cells for human senses (~ several tens of mm) should be developed. The technological challenges for developing sensory devices with human and even beyond-human capabilities have been tackled by various research groups, the details of which are described in this paper.

Online Monitoring System based notifications on Mobile devices with Kinect V2 (키넥트와 모바일 장치 알림 기반 온라인 모니터링 시스템)

  • Niyonsaba, Eric;Jang, Jong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.6
    • /
    • pp.1183-1188
    • /
    • 2016
  • Kinect sensor version 2 is a kind of camera released by Microsoft as a computer vision and a natural user interface for game consoles like Xbox one. It allows acquiring color images, depth images, audio input and skeletal data with a high frame rate. In this paper, using depth image, we present a surveillance system of a certain area within Kinect's field of view. With computer vision library(Emgu CV), if an object is detected in the target area, it is tracked and kinect camera takes RGB image to send it in database server. Therefore, a mobile application on android platform was developed in order to notify the user that Kinect has sensed strange motion in the target region and display the RGB image of the scene. User gets the notification in real-time to react in the best way in the case of valuable things in monitored area or other cases related to a reserved zone.

Development of The Flexible User-Friendly Real-Time Machine Vision Inspection System (사용자 중심의 유연한 실시간 머신비전 검사시스템 개발)

  • Cho, In-Sung;Lee, Ji-Hong;Oh, Sang-Jin
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.45 no.3
    • /
    • pp.42-50
    • /
    • 2008
  • We developed a visual inspection system for detecting defective products. Most existing inspection systems are designed to be dedicated to one product, which makes operator spend extra money and time to adopt other products. In this work, we propose a flexible visual inspection system that can inspect various products without any additional major job at a low-cost. The developed system contained image processing algorithm libraries and user-friendly graphic interface for adaptable image-based inspection system. We can find a proper threshold value using the proposed algorithm which uses correlation coefficient between a non-defective product and existing sample images of defective product. And We tested the performance of the proposed algorithm using Otsu's method. The proposed system is applied to a automated inspection line for cellular phone.