• Title/Summary/Keyword: eye-in-hand camera

Search Result 34, Processing Time 0.028 seconds

3D View Controlling by Using Eye Gaze Tracking in First Person Shooting Game (1 인칭 슈팅 게임에서 눈동자 시선 추적에 의한 3차원 화면 조정)

  • Lee, Eui-Chul;Cho, Yong-Joo;Park, Kang-Ryoung
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.10
    • /
    • pp.1293-1305
    • /
    • 2005
  • In this paper, we propose the method of manipulating the gaze direction of 3D FPS game's character by using eye gaze detection from the successive images captured by USB camera, which is attached beneath HMD. The proposed method is composed of 3 parts. In the first fart, we detect user's pupil center by real-time image processing algorithm from the successive input images. In the second part of calibration, the geometric relationship is determined between the monitor gazing position and the detected eye position gazing at the monitor position. In the last fart, the final gaze position on the HMB monitor is tracked and the 3D view in game is control]ed by the gaze position based on the calibration information. Experimental results show that our method can be used for the handicapped game player who cannot use his (or her) hand. Also, it can increase the interest and immersion by synchronizing the gaze direction of game player and that of game character.

  • PDF

Rehabilitation System through Image Analysis Method (이미지 분석 방식을 적용한 인지 재활 시스템)

  • Lim, Myung-Jae;Jung, Hee-Woong;Kwon, Young-Man
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.10 no.6
    • /
    • pp.209-214
    • /
    • 2010
  • In this paper, We analyzes the image along the platform (Open Eye), through prevention of dementia or stroke patients and cognitive rehabilitation for the proposed system. This way through the camera image according to user's movement gained OpenCV image processing library, which is based on motion analysis, a part of this rehabilitation is to apply to cognitive rehabilitation. Therefore, this paper proposes a new image analysis system has been exposed to the elderly or stroke patients with dementia, their hand gestures through which patients can detect the image of the cognitive rehabilitation to help them in the analysis of the image analysis system is proposed.

Traded control of telerobot system with an autonomous visual sensor feedback (자율적인 시각 센서 피드백 기능을 갖는 원격 로보트 시스템교환 제어)

  • 김주곤;차동혁;김승호
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.940-943
    • /
    • 1996
  • In teleoperating, as seeing the monitor screen obtained from a camera instituted in the working environment, human operator generally controls the slave arm. Because we can see only 2-D image in a monitor, human operator does not know the depth information and can not work with high accuracy. In this paper, we proposed a traded control method using an visual sensor for the purpose of solving this problem. We can control a teleoperation system with precision when we use the proposed algorithm. Not only a human operator command but also an autonomous visual sensor feedback command is given to a slave arm for the purpose of coincidence current image features and target image features. When the slave arm place in a distant place from the target position, human operator can know very well the difference between the desired image features and the current image features, but calculated visual sensor command have big errors. And when the slave arm is near the target position, the state of affairs is changed conversely. With this visual sensor feedback, human does not need coincide the detail difference between the desired image features and the current image features and proposed method can work with higher accuracy than other method without, sensor feedback. The effectiveness of the proposed control method is verified through series of experiments.

  • PDF

Dynamic Visual Servoing of Robot Manipulators (로봇 메니퓰레이터의 동력학 시각서보)

  • Baek, Seung-Min;Im, Gyeong-Su;Han, Ung-Gi;Guk, Tae-Yong
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.49 no.1
    • /
    • pp.41-47
    • /
    • 2000
  • A better tracking performance can be achieved, if visual sensors such as CCD cameras are used in controling a robot manipulator, than when only relative sensors such as encoders are used. However, for precise visual servoing of a robot manipulator, an expensive vision system which has fast sampling rate must be used. Moreover, even if a fast vision system is implemented for visual servoing, one cannot get a reliable performance without use of robust and stable inner joint servo-loop. In this paper, we propose a dynamic control scheme for robot manipulators with eye-in-hand camera configuration, where a dynamic learning controller is designed to improve the tracking performance of robotic system. The proposed control scheme is implemented for tasks of tracking moving objects and shown to be robust to parameter uncertainty, disturbances, low sampling rate, etc.

  • PDF

Smartphone Fundus Photography in an Infant with Abusive Head Trauma (학대뇌손상 영아에서 스마트폰으로 촬영한 안저소견)

  • Kim, Yong Hyun;Choi, Shin Young;Lee, Ji Sook;Yoon, Soo Han;Chung, Seung Ah
    • Journal of The Korean Ophthalmological Society
    • /
    • v.58 no.11
    • /
    • pp.1313-1316
    • /
    • 2017
  • Purpose: To report fundus photography using a smartphone in an infant with abusive head trauma. Case summary: An 8-month-old male infant presented to the emergency room with decreased consciousness and epileptic seizures that the parents attributed to a fall from a chair. He had no external wounds or fractures to the skull or elsewhere. However, computerized tomography of the brain revealed an acute subdural hematoma in the right cranial convexity and diffuse cerebral edema, leading to a midline shift to the left and effacement of the right lateral ventricle and basal cistern. The attending neurosurgeon promptly administered a decompressive craniectomy. Immediately after the emergency surgery, a fundus examination revealed numerous multi-layered retinal hemorrhages in the posterior pole extending to the periphery in each eye. He also had white retinal ridges with cherry hemorrhages in both eyes. We acquired retinal photographs using the native camera of a smartphone in video mode. The photographer held the smartphone with one hand, facing the patient's eye at 15-20 cm, and held a 20 diopter condensing lens at 5 cm from the eye in the other hand. Our documentation using a smartphone led to a diagnosis of abusive head trauma and to obtain the criminal's confession, because the findings were specific for repetitive acceleration-deceleration forces to an infant's eye with a strong vitreoretinal attachment. Conclusions: This ophthalmic finding had a key role in the diagnosis of abusive head trauma. This case presented the diagnostic use of a smartphone for fundus photography in this important medicolegal case.

Automatic Registration of Two Parts using Robot with Multiple 3D Sensor Systems

  • Ha, Jong-Eun
    • Journal of Electrical Engineering and Technology
    • /
    • v.10 no.4
    • /
    • pp.1830-1835
    • /
    • 2015
  • In this paper, we propose an algorithm for the automatic registration of two rigid parts using multiple 3D sensor systems on a robot. Four sets of structured laser stripe system consisted of a camera and a visible laser stripe is used for the acquisition of 3D information. Detailed procedures including extrinsic calibration among four 3D sensor systems and hand/eye calibration of 3D sensing system on robot arm are presented. We find a best pose using search-based pose estimation algorithm where cost function is proposed by reflecting geometric constraints between sensor systems and target objects. A pose with minimum gap and height difference is found by greedy search. Experimental result using demo system shows the robustness and feasibility of the proposed algorithm.

A Novel Visual Servoing Method involving Disturbance Observer (외란 관측기를 이용한 새로운 시각구동 방법)

  • Lee, Joon-Soo;Suh, Il-Hong
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.48 no.3
    • /
    • pp.294-303
    • /
    • 1999
  • To improve the visual servoing performance, several strategies were proposed in the past such as redundant feature points, using a point with different height and weighted selection of image features. The performance of these visual servoing methods depends on the configuration between the camera and object. And redundant feature points require much computation efforts. This paper proposes the visual servoing method based on the disturbance obsever, which compensates the upper off-diagonal component of image feature jacobian to be the null. The performance indices such as sensitivity for a measure of richness, sensitivity of the control to noise, and comtrollability are shown to be improved when the image feature Jacobian is given as a block diagonal matrix. Computer simulations are carried out for a UUMA560 robot and show some results to verify the effectiveness of the proposed method.

  • PDF

3D First Person Shooting Game by Using Eye Gaze Tracking (눈동자 시선 추적에 의한 3차원 1인칭 슈팅 게임)

  • Lee, Eui-Chul;Park, Kang-Ryoung
    • The KIPS Transactions:PartB
    • /
    • v.12B no.4 s.100
    • /
    • pp.465-472
    • /
    • 2005
  • In this paper, we propose the method of manipulating the gaze direction of 3D FPS game's character by using eye gaze detection from the successive images captured by USB camera, which is attached beneath HMB. The proposed method is composed of 3 parts. At first, we detect user's pupil center by real-time image processing algorithm from the successive input images. In the second part of calibration, when the user gaze on the monitor plane, the geometric relationship between the gazing position of monitor and the detected position of pupil center is determined. In the last part, the final gaze position on the HMD monitor is tracked and the 3D view in game is controlled by the gaze position based on the calibration information. Experimental results show that our method can be used for the handicapped game player who cannot use his(or her) hand. Also, it can Increase the interest and the immersion by synchronizing the gaze direction of game player and the view direction of game character.

The Visual Aesthetics of Drone Shot and Hand-held Shot based on the Representation of Place and Space : focusing on World Travel' Peninsula de Yucatán' Episode (장소와 공간의 재현적 관점에서 본 드론 쇼트와 핸드헬드 쇼트의 영상 미학 : <세계테마기행> '유카탄 반도'편을 중심으로)

  • Ryu, Jae-Hyung
    • Journal of Korea Entertainment Industry Association
    • /
    • v.14 no.3
    • /
    • pp.251-265
    • /
    • 2020
  • The Drone shot is moving images captured by a remotely controlled unmanned aerial vehicle, takes usually bird's eye view. The hand-held shot is moving images recorded by literal handheld shooting which is specialized to on-the-spot filming. It takes a walker's viewpoint through vivid realism of its self-reflexive camera movements. The purpose of this study is to analyze comparatively aesthetic functions of the drone shot and the hand-held shot. For this, the study understood Certeau's concepts of 'place' and 'space,' chose World Travel 'Peninsula de Yucatan' episode as a research object, and analytically applied two concepts to the scenes clearly presenting two shots' aesthetic characteristics. As a result, the drone shot took the authoritative viewpoint providing the general information and atmosphere as it overlooked the city with silent movements removing the self-reflexivity. This aesthetic function was reinforced the narration and subtitles mediating prior-knowledge about proper rules and orders of the place. The drone shot tended to project the location as a place. Conversely, the hand-held shot practically experienced the space with free walking which is free from rules and orders inherent in the city. The aesthetics of hand-held images represented the tactic resisting against the strategy of a subject of will and power in that the hand-held shot practiced anthropological walking by means of noticing everyday lives of the small town and countryside than main tourist attraction. In opposition to the drone shot, the hand-held shot tended to reflect the location as a space.

ERGONOMIC ANALYSIS OF A TELEMANIPULATION TECHNIQUE FOR A PYROPROCESS DEMONSTRATION FACILITY

  • Yu, Seungnam;Lee, Jongkwang;Park, Byungsuk;Kim, Kiho;Cho, Ilje
    • Nuclear Engineering and Technology
    • /
    • v.46 no.4
    • /
    • pp.489-500
    • /
    • 2014
  • In this study, remote handling strategies for a large-scale argon cell facility were considered. The suggested strategies were evaluated by several types of field test. The teleoperation tasks were performed using a developed remote handling system, which enabled traveling over entire cell area using a bridge transport system. Each arm of the system had six DOFs (degrees of freedom), and the bridge transport system had four DOFs. However, despite the dexterous manipulators and redundant monitoring system, many operators, including professionals, experienced difficulties in operating the remote handling system. This was because of the lack of a strategy for handling the installed camera system, and the difficulty in recognizing the gripper pose, which might fall outside the FOV (field of vision) of the system during teleoperation. Hence, in this paper, several considerations for the remote handling tasks performed in the target facility were discussed, and the tasks were analyzed based on ergonomic factors such as the workload. Toward the development of a successful operation strategy, several ergonomic issues, such as active/passive view of the remote handling system, eye/hand alignment, and FOV were considered. Furthermore, using the method for classifying remote handling tasks, several unit tasks were defined and evaluated.