• Title/Summary/Keyword: Robotic camera

Search Result 93, Processing Time 0.026 seconds

Effective Real Time Tracking System using Stereo Vision

  • Lee, Hyun-Jin;Kuc, Tae-Young
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.70.1-70
    • /
    • 2001
  • Recently, research of visual control is getting more essential in robotic application, and acquiring 3D informations from the 2D images is becoming more important with development of vision system. For this application, we propose the effective way of controlling stereo vision tracking system for target tracking and calculating distance between target and camera. In this paper we address improved controller using dual-loop visual servo which is more effective compared with using single-loop visual servo for stereo vision tracking system. The speed and the accuracy for realizing a real time tracking are important. However, the vision processing speed is too slow to track object in real time by using only vision feedback data. So we use another feedback data from controller parts which offer state feedback ...

  • PDF

Development of a Robot System for Automatic De-palletizing of Parcels loaded in Rolltainer (롤테이너 적재 소포를 자동으로 디팔레타이징하기 위한 로봇 시스템 개발)

  • Kim, Donghyung;Lim, Eul Gyoon;Kim, Joong Bae
    • The Journal of Korea Robotics Society
    • /
    • v.17 no.4
    • /
    • pp.431-437
    • /
    • 2022
  • This paper deals with a study on the automatic depalletizing robot for parcels loaded in rolltainer of domestic postal distribution centers. Specifically, we proposed a robot system that detect parcels loaded in a rolltainer with a 3D camera and perform de-palletizing using a cooperative robot. In addition, we developed the task flow chart for parcel de-palletizing and the method of retreat motion generation in the case of collision with rolltainer. Then, we implemented the proposed methods to the robot's controller by developing robot program. The proposed robot system was installed at the Anyang Post Distribution Center and field tests were completed. Field tests have shown that the robotic system has a success rate of over 90% for depalletizing task. And it was confirmed that the average tact time per parcel was 7.3 seconds.

Implementation of a Remote Peg-in-Hole Operation using a Two Degrees of Freedom Force-Reflective Joystick

  • Sung K. An;Seung J. Han;Lee, Jang M.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.340-345
    • /
    • 1998
  • A virtual reality system is implemented for the operator supervising a robot's operation at a remote site. For this implementation, a two D.O.F force-reflective joystick is designed to reflect the force/torque measured at the end of robotic manipulator and to generate the motion command for the robot by the operator using this joystick. In addition, the visual information that is captured by a CCD camera, is transmitted to the remote operator and is displayed on a CRT monitor. The operator who is holding the force reflective joystick and watching the CRT monitor can resolve unexpected problems that the robot confronts with. That is, the robot performs the tasks autonomously unless it confronts with unexpected events that can be resolved by only the operator. To demonstrate the feasibility of this system, a remote peg-in-hole operation is implemented and the experimental data are shown.

  • PDF

Multiple SL-AVS(Small size & Low power Around View System) Synchronization Maintenance Method (다중 SL-AVS 동기화 유지기법)

  • Park, Hyun-Moon;Park, Soo-Huyn;Seo, Hae-Moon;Park, Woo-Chool
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.3
    • /
    • pp.73-82
    • /
    • 2009
  • Due to the many advantages including low price, low power consumption, and miniaturization, the CMOS camera has been utilized in many applications, including mobile phones, the automotive industry, medical sciences and sensoring, robotic controls, and research in the security field. In particular, the 360 degree omni-directional camera when utilized in multi-camera applications has displayed issues of software nature, interface communication management, delays, and a complicated image display control. Other issues include energy management problems, and miniaturization of a multi-camera in the hardware field. Traditional CMOS camera systems are comprised of an embedded system that consists of a high-performance MCU enabling a camera to send and receive images and a multi-layer system similar to an individual control system that consists of the camera's high performance Micro Controller Unit. We proposed the SL-AVS (Small Size/Low power Around-View System) to be able to control a camera while collecting image data using a high speed synchronization technique on the foundation of a single layer low performance MCU. It is an initial model of the omni-directional camera that takes images from a 360 view drawing from several CMOS camera utilizing a 110 degree view. We then connected a single MCU with four low-power CMOS cameras and implemented controls that include synchronization, controlling, and transmit/receive functions of individual camera compared with the traditional system. The synchronization of the respective cameras were controlled and then memorized by handling each interrupt through the MCU. We were able to improve the efficiency of data transmission that minimizes re-synchronization amongst a target, the CMOS camera, and the MCU. Further, depending on the choice of users, respective or groups of images divided into 4 domains were then provided with a target. We finally analyzed and compared the performance of the developed camera system including the synchronization and time of data transfer and image data loss, etc.

Development of a Nuclear Steam Generator Tube Inspection/maintenance Robot

  • Shin, Ho-Cheol;Kim, Seung-Ho;Seo, Yong-Chil;Jung, Kyung-Min;Jung, Seung-Ho;Choi, Chang-Hwan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2508-2513
    • /
    • 2003
  • This paper presents a nuclear steam generator tube inspection/maintenance robot system. The robot assists in automatic non-destructive testing and the repair of nuclear steam generator tubes welded into a thick tube sheet that caps a hemispherical or quarter-sphere plenum which is a high-radiation area. For easy carriage and installation, the robot system consists of three separable parts: a manipulator, a water-chamber entering and leaving device for the manipulator and a manipulator base pose adjusting device. A software program to control and manage the robotic system has been developed on the NT based OS to increase the usability. The software program provides a robot installation function, a robot calibration function, a managing and arranging function for the eddy-current test, a real time 3-D graphic simulation function which offers remote reality to operators and so on. The image information acquired from the camera attached to the end-effecter is used to calibrate the end-effecter pose error and the time-delayed control algorithm is applied to calculate the optimal PID gain of the position controller. The developed robotic system has been tested in the Ulchin NPP type steam generator mockup in a laboratory.

  • PDF

3D Object Recognition for Localization of Outdoor Robotic Vehicles (실외 주행 로봇의 위치 추정을 위한 3 차원 물체 인식)

  • Baek, Seung-Min;Kim, Jae-Woong;Lee, Jang-Won;Zhaojin, Lu;Lee, Suk-Han
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.200-204
    • /
    • 2008
  • In this paper, to solve localization problem for out-door navigation of robotic vehicles, a particle filter based 3D object recognition framework that can estimate the pose of a building or its entrance is presented. A particle filter framework of multiple evidence fusion and model matching in a sequence of images is presented for robust recognition and pose estimation of 3D objects. The proposed approach features 1) the automatic selection and collection of an optimal set of evidences 2) the derivation of multiple interpretations, as particles representing possible object poses in 3D space, and the assignment of their probabilities based on matching the object model with evidences, and 3) the particle filtering of interpretations in time with the additional evidences obtained from a sequence of images. The proposed approach has been validated by the stereo-camera based experimentation of 3D object recognition and pose estimation, where a combination of photometric and geometric features are used for evidences.

  • PDF

A Study on Development of a Smart Wellness Robot Platform (스마트 웰니스 로봇 플랫폼 개발에 관한 연구)

  • Lee, Byoungsu;Kim, Seungwoo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.1
    • /
    • pp.331-339
    • /
    • 2016
  • This paper developed a home wellness robot platform to perform the roles in basic health care and life care in an aging society. A robotic platform and a sensory platform were implemented for an indoor wellness service. In the robotic platform, the precise mobility and the dexterous manipulation are not only developed in a symbiotic service-robot, but they also ensure the robot architecture of human friendliness. The mobile robot was made in the agile system, which consists of Omni-wheels. The manipulator was made in the anthropomorphic system to carry out dexterous handwork. In the sensing platform, RF tags and stereo camera were used for self and target localization. They were processed independently and cooperatively for accurate position and posture. The wellness robot platform was integrated in a real-time system. Finally, its good performance was confirmed through live indoor tests for health and life care.

B-COV:Bio-inspired Virtual Interaction for 3D Articulated Robotic Arm for Post-stroke Rehabilitation during Pandemic of COVID-19

  • Allehaibi, Khalid Hamid Salman;Basori, Ahmad Hoirul;Albaqami, Nasser Nammas
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.2
    • /
    • pp.110-119
    • /
    • 2021
  • The Coronavirus or COVID-19 is contagiousness virus that infected almost every single part of the world. This pandemic forced a major country did lockdown and stay at a home policy to reduce virus spread and the number of victims. Interactions between humans and robots form a popular subject of research worldwide. In medical robotics, the primary challenge is to implement natural interactions between robots and human users. Human communication consists of dynamic processes that involve joint attention and attracting each other. Coordinated care involves sharing among agents of behaviours, events, interests, and contexts in the world from time to time. The robotics arm is an expensive and complicated system because robot simulators are widely used instead of for rehabilitation purposes in medicine. Interaction in natural ways is necessary for disabled persons to work with the robot simulator. This article proposes a low-cost rehabilitation system by building an arm gesture tracking system based on a depth camera that can capture and interpret human gestures and use them as interactive commands for a robot simulator to perform specific tasks on the 3D block. The results show that the proposed system can help patients control the rotation and movement of the 3D arm using their hands. The pilot testing with healthy subjects yielded encouraging results. They could synchronize their actions with a 3D robotic arm to perform several repetitive tasks and exerting 19920 J of energy (kg.m2.S-2). The average of consumed energy mentioned before is in medium scale. Therefore, we relate this energy with rehabilitation performance as an initial stage and can be improved further with extra repetitive exercise to speed up the recovery process.

Initial Experience of Robotic Cardiac Surgery (수술로봇을 이용한 심장수술 첫 체험)

  • Cho Sung Woo;Chung Cheol Hyun;Kim Kyoung Sun;Choo Suk Jung;Song Hyung;Song Meong Gun;Lee Jae Won
    • Journal of Chest Surgery
    • /
    • v.38 no.5 s.250
    • /
    • pp.366-370
    • /
    • 2005
  • Background: In general, cardiac surgery has been performed via median sternotomy. During the past decade, improvements in endoscopic equipment and operative techniques have resulted in development of minimally invasive cardiac operation using small incisions. With the advent of a voice controlled camera-holding robotic arm (AESOP 3000, Automated Endoscope System for Optimal Positioning), cardiac surgery entered the robotic age. Material and Method: Between April 2004 and December 2004, a total of seventy eight patients underwent robotic cardiac surgery, of whom sixty four patients underwent robot-assisted minimally invasive cardiac surgery via 5cm right lateral minithoracotomy using voice controlled robotic arm, femoral vessels cannulation, percutaneous internal jugular cannulation, transthoracic aortic cross clamp. Other fourteen patients underwent MIDCAB via internal mammary artery harvesting using AESOP. Result: Robotic cardiac surgery were mitral valve repair in 37 cases, mitral valve replacement in 10 cases, aortic valve replacement in 1 case, MIDCAB in 14 cases, ASD operation in 9 cases, and isolated Maze procedure in 1 case. In mitral operation, mean CPB time was $165.3\pm43.1$ minutes and mean ACC time was $110.4\pm48.2$ minutes. Median length of hospital stay was 6 days (range 3 to 30) in mitral operation, 4 days (range 2 to 7) in MIDCAB, and 4 days (range 2 to 6) in ASD operation. For complications, 3 patients were required by reoperation for bleeding. There was no hospital mortality. Conclusion: Our experience of robot cardiac surgery suggests that many cardiovascular surgeons will be able to perform minimally invasive cardiac operations through small incisions with robot-assisted video-direction. Well-designed studies and close long-term follow-up will be required to analyze the benefits of robot-assisted operation.

Development of Dental Light Robotic System using Image Processing Technology (영상처리 기술을 이용한 치과용 로봇 조명장치의 개발)

  • Moon, Hyun-Il;Kim, Myoung-Nam;Lee, Kyu-Bok
    • Journal of Dental Rehabilitation and Applied Science
    • /
    • v.26 no.3
    • /
    • pp.285-296
    • /
    • 2010
  • Robot-assisted illuminating equipment based on image-processing technology was developed and then its accuracy was measured. The current system was designed to detect facial appearance using a camera and to illuminate it using a robot-assisted system. It was composed of a motion control component, a light control component and an image-processing component. Images were captured with a camera and following their acquisition the images that showed motion change were extracted in accordance with the Adaboost algorithm. Following the detection experiment for the oral cavity of patients based on image-processing technology, a higher degree of the facial recognition was obtained from the frontal view and the light robot arm was stably controlled.