• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.3
• /
• pp.1189-1204
• /
• 2018

Detecting and capturing 3D human structures from the intensity-based image sequences is an inherently arguable problem, which attracted attention of several researchers especially in real-time activity recognition (Real-AR). These Real-AR systems have been significantly enhanced by using depth intensity sensors that gives maximum information, in spite of the fact that conventional Real-AR systems are using RGB video sensors. This study proposed a depth-based routine-logging Real-AR system to identify the daily human activity routines and to make these surroundings an intelligent living space. Our real-time routine-logging Real-AR system is categorized into two categories. The data collection with the use of a depth camera, feature extraction based on joint information and training/recognition of each activity. In-addition, the recognition mechanism locates, and pinpoints the learned activities and induces routine-logs. The evaluation applied on the depth datasets (self-annotated and MSRAction3D datasets) demonstrated that proposed system can achieve better recognition rates and robust as compare to state-of-the-art methods. Our Real-AR should be feasibly accessible and permanently used in behavior monitoring applications, humanoid-robot systems and e-medical therapy systems.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.7
• /
• pp.870-874
• /
• 2005

This paper presents capacitive tactile sensor that can detect normal and shear forces. This tactile sensor consists of index plate, sensing plate, and elastic dielectric layer. The calculated sensing character is based on the changes of space between two horizontal plate. Larger overlap areas and narrow space between top and bottom plate guarantees higher sensitivity. Tactile sense information can be calculated from the changes of phase of output signal. The symmetric arrangement of sensing plates makes the manufacturing process easier and guarantees the stability of the structure. In this paper, the sensor structure is designed, the mechanism of the Proposed sensor is theoretically explained, and the simulated result is presented.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.2
• /
• pp.1201-1216
• /
• 2017

In this study, we described the development of a methodology to measure tip-pinch strength on the paretic hand rehabilitation device and aimed to investigate reliability of the device. FSR sensors were embedded on the device, and tip pinch strength was estimated with data collected from the sensors using a developed equation while participants were demonstrating tip pinch. Reliability tests included inter-rater, test-retest, and inter-instrument reliability. B&L Engineering pinch gauge was utilized for the comparison. Thirty-seven healthy students participated in the experiment. Both inter-rater and test-retest reliability were excellent as Intraclass Correlation Coefficients (ICCs) were greater than 0.9 (p<0.01). There were no statistically significant differences in tip-pinch strengths. Inter-instrument reliability analysis confirmed good correlation between the two instruments (r = 0.88, p < 0.01). The findings of this study suggest that the two instruments are not interchangeable. However, the tip-pinch mechanism used in the paretic hand rehabilitation device is reliable that can be used to evaluate tip pinch strength in clinical environment and can provides a parameter that monitors changes in the hand functions.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.54 no.3
• /
• pp.156-165
• /
• 2005

Human being recognizes the physical world by integrating a great variety of sensory inputs, the information acquired by their own action, and their knowledge of the world using hierarchically parallel-distributed mechanism. In this paper, authors propose the sensor fusion system that can recognize multiple 3D objects from 2D projection images and tactile informations. The proposed system focuses on improving recognition performance of 3D objects. Unlike the conventional object recognition system that uses image sensor alone, the proposed method uses tactual sensors in addition to visual sensor. Neural network is used to fuse the two sensory signals. Tactual signals are obtained from the reaction force of the pressure sensors at the fingertips when unknown objects are grasped by four-fingered robot hand. The experiment evaluates the recognition rate and the number of learning iterations of various objects. The merits of the proposed systems are not only the high performance of the learning ability but also the reliability of the system with tactual information for recognizing various objects even though the visual sensory signals get defects. The experimental results show that the proposed system can improve recognition rate and reduce teeming time. These results verify the effectiveness of the proposed sensor fusion system as recognition scheme for 3D objects.

• The Journal of Korea Robotics Society
• /
• v.9 no.1
• /
• pp.48-56
• /
• 2014

In robotic surgery, a surgeon checks only a surgical site of patient in the progress of surgery by vision and sound information. In order to solve this limited information, the haptic function is necessary. And haptic surgical robot is also necessary to design a haptic master device. The master device for laparoscope operation with cable-conduit was developed in previous research to give haptic function. It suggested a possibility of developing a master device by using the cable-conduit. However, it is very inconvenient to use. Therefore, this paper suggests a new mechanism design structure to solve the problems of the previous work by new forming a new master device. And it has proved that it's usability is better than previous one. Furthermore it has also experimented and analyzed that a backlash of new master device is compensated by smooth backlash inverse algorithm.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.12
• /
• pp.1160-1166
• /
• 2013

This paper presents feedforward controllers to improve the control performance of the motion and grasping force of a surgical instrument used in an MIS (Minimally Invasive Surgery) robot. The surgical instrument has a long distance between the drive motors and its active joints. Therefore, the gripper on the instrument is controlled by a cable drive mechanism, which generates a coupled motion between the wrist joint and the grip direction. In order to solve the problem, this paper analyzes the pulley composition of the surgical instrument and proposes feedforward controllers to eliminate the coupled motion. Furthermore, feedforward controllers to regulate the grasping force are proposed to deal with another coupling problem between the grasping force of the instrument and the motion of the instrument joints. The experimental results demonstrate the improved control performance of the motion and grasping force of the instrument.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.13 no.1
• /
• pp.60-68
• /
• 1999

This paper deals with the tracking control problem of industrial robotic manipulators with unknown or changing dynamics. The proposed method makes use of multiple moodels and switching mechanism by fuzzy inference of the manipulator in an indirect adaptive controller architecture. The models used for the indmtification of the manipliator are identical, except for the initial estimates of the unknown inertial pararmeters of the manipulator and its load. The torque input that is applied to the joint actuators is determined at every instant by the identification model that best approximates the robot dynamics. Simulation results are also included to dermnstrate the improvement in the tracking perfermance when the proposed method is used.s used.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.53 no.2
• /
• pp.127-134
• /
• 2004

In this paper, human motor behaving model based sensory motor coordination(SMC) algorithm is implemented on robotic grasping task. Compare to conventional SMC models which connect sensor to motor directly, the proposed method used biologically inspired human behaving system in conjunction with SMC algorithm for fast grasping force control of robot arm. To characterize various grasping objects, pressure sensors on hand gripper were used. Measured sensory data are simultaneously transferred to perceptual mechanism(PM) and long term memory(LTM), and then the sensory information is forwarded to the fastest channel among several information-processing flows in human motor system. In this model, two motor learning routes are proposed. One of the route uses PM and the other uses short term memory(STM) and LTM structure. Through motor learning procedure, successful information is transferred from STM to LTM. Also, LTM data are used for next moor plan as reference information. STM is designed to single layered perception neural network to generate fast motor plan and receive required data which comes from LTM. Experimental results showed that proposed method can control of the grasping force adaptable to various shapes and types of greasing objects, and also it showed quicker grasping-behavior lumining time compare to simple feedback system.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.18 no.1
• /
• pp.1-11
• /
• 1994

This paper presents an intelligent robotic control method for chamferless parts mating by integrating fuzzy control and neural network. The successful assembly task requires an extremely high position accuracy and a good knowledge of mating parts. However, conventional assembly method alone makes it difficult to achieve satisfactory assembly performance because of the complexity and the uncertainties of the process and its environments such as not only the limitation of the devices performing the assembly but also imperfect knowledge of the parts being assembled. To cope with these problems, an intelligent robotic assembly method is proposed, which is composed of fuzzy controller and learning mechanism based upon neural net. In this method, fuzzy controller copes with the complexity and the uncertainties of the assembly process, while neural network enhances the assembly scheme so as to learn fuzzy rules from experience and adapt to changes in environment of uncertainty and imprecision. The performance of the proposed assembly scheme is evaluted through a series of experiments using SCARA robot. The results show that the proposed control method can be effectively applied to chamferless precision parts mating.

• The Journal of Korea Robotics Society
• /
• v.16 no.2
• /
• pp.94-102
• /
• 2021

This study addresses a method for 3D reconstruction using acoustic data with heterogeneous sonar devices: Forward-Looking Multibeam Sonar (FLMS) and Profiling Sonar (PS). The challenges in sonar image processing are perceptual ambiguity, the loss of elevation information, and low signal to noise ratio, which are caused by the ranging and intensity-based image generation mechanism of sonars. The conventional approaches utilize additional constraints such as Lambertian reflection and redundant data at various positions, but they are vulnerable to environmental conditions. Our approach is to use two sonars that have a complementary data type. Typically, the sonars provide reliable information in the horizontal but, the loss of elevation information degrades the quality of data in the vertical. To overcome the characteristic of sonar devices, we adopt the crossed installation in such a way that the PS is laid down on its side and mounted on the top of FLMS. From the installation, FLMS scans horizontal information and PS obtains a vertical profile of the front area of AUV. For the fusion of the two sonar data, we propose the probabilistic approach. A likelihood map using geometric constraints between two sonar devices is built and a monte-carlo experiment using a derived model is conducted to extract 3D points. To verify the proposed method, we conducted a simulation and field test. As a result, a consistent seabed map was obtained. This method can be utilized for 3D seabed mapping with an AUV.