• Smart Structures and Systems
• /
• v.31 no.4
• /
• pp.383-392
• /
• 2023

Post-earthquake building condition assessment is crucial for subsequent rescue and remediation and can be automated by emerging computer vision and deep learning technologies. This study is based on an endeavour for the 2nd International Competition of Structural Health Monitoring (IC-SHM 2021). The task package includes five image segmentation objectives - defects (crack/spall/rebar exposure), structural component, and damage state. The structural component and damage state tasks are identified as the priority that can form actionable decisions. A multi-task Convolutional Neural Network (CNN) is proposed to conduct the two major tasks simultaneously. The rest 3 sub-tasks (spall/crack/rebar exposure) were incorporated as auxiliary tasks. By synchronously learning defect information (spall/crack/rebar exposure), the multi-task CNN model outperforms the counterpart single-task models in recognizing structural components and estimating damage states. Particularly, the pixel-level damage state estimation witnesses a mIoU (mean intersection over union) improvement from 0.5855 to 0.6374. For the defect detection tasks, rebar exposure is omitted due to the extremely biased sample distribution. The segmentations of crack and spall are automated by single-task U-Net but with extra efforts to resample the provided data. The segmentation of small objects (spall and crack) benefits from the resampling method, with a substantial IoU increment of nearly 10%.

• Journal of Institute of Control, Robotics and Systems
• /
• v.10 no.10
• /
• pp.930-939
• /
• 2004

In this paper, both dynamic constraints and kinematic constraints are considered for the analysis of manipulability of robotic systems comprised of multiple cooperating arms. Given bounds on the torques of each Joint actuator for every robot, the purpose of this study is to drive the bounds of task-space acceleration of object carried by the system. Bounds on each joint torque, described as a polytope, is transformed to the task-space acceleration through matrices related with robot dynamics, robot kinematics, object dynamics, grasp conditions, and contact conditions. A series of mathematical manipulations including the procedure calculating minimum infinite-norm solution of linear equation is applied to get the reachable acceleration bounds from given actuator dynamic constrains. Several examples including two robot systems as well as three robot system are shown with the assumptions of complete-constraint contact model(or' very soft contact') and insufficient or proper degree of freedom robot.

• Safety and Health at Work
• /
• v.10 no.1
• /
• pp.67-74
• /
• 2019

Background: Few studies have examined the effects of a forward rotating shift pattern on police employee performance and well-being. This study sought to compare sleep duration, cognitive performance, and vigilance at the start and end of each shift within a three-shift, forward rotating shift pattern, common in United Kingdom police forces. Methods: Twenty-three police employee participants were recruited from North Yorkshire Police (mean age, 43 years). The participants were all working the same, 10-day, forward rotating shift pattern. No other exclusion criteria were stipulated. Sleep data were gathered using both actigraphy and self-reported methods; cognitive performance and vigilance were assessed using a customized test battery, comprising five tests: motor praxis task, visual object learning task, NBACK, digital symbol substitution task, and psychomotor vigilance test. Statistical comparisons were conducted, taking into account the shift type, shift number, and the start and end of each shift worked. Results: Sleep duration was found to be significantly reduced after night shifts. Results showed a significant main effect of shift type in the visual object learning task and NBACK task and also a significant main effect of start/end in the digital symbol substitution task, along with a number of significant interactions. Conclusion: The results of the tests indicated that learning and practice effects may have an effect on results of some of the tests. However, it is also possible that due to the fast rotating nature of the shift pattern, participants did not adjust to any particular shift; hence, their performance in the cognitive and vigilance tests did not suffer significantly as a result of this particular shift pattern.

• Journal of the Korean Society for Precision Engineering
• /
• v.13 no.9
• /
• pp.104-113
• /
• 1996

In robot system, the robot manipulation needs the information of task and objects to be handled in possessing a variaty of positions and orientations. In the current industrial robot system, determining position and orientation of objects under industrial environments is one of major problems. In order to pick up an object, the roblt needs the information about the position and orientation of object, and between objects and gripper. When sensing is accomplished by pinhole model camera, the mathematical relationship between object points and their images is expressed in terms of perspective, i.e., central projection. In this paper, a new approach to determine the information of the supporting points related to position and orientation of the object using the robot vision system is developed and testified in experimental setup. The result will be useful for the industrial, agricultural, and autonomous robot.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.223-228
• /
• 2009

We propose an on-line machine learning approach for object recognition, where new images are continuously added and the recognition decision is made without delay. Random forest (RF) classifier has been extensively used as a generative model for classification and regression applications. We extend this technique for the task of building incremental component-based detector. First we employ object descriptor model based on bag of covariance matrices, to represent an object region then run our on-line RF learner to select object descriptors and to learn an object classifier. Experiments of the object recognition are provided to verify the effectiveness of the proposed approach. Results demonstrate that the propose model yields in object recognition performance comparable to the benchmark standard RF, AdaBoost, and SVM classifiers.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.3
• /
• pp.223-228
• /
• 2015

This paper analyses the torque characteristics of the shoulder and elbow joints of a humanoid robot arm that is useful for an object lifting and transferring task instead of human beings. For the purpose, some typical human lifting behaviors are considered, and various simulations for lifting and transferring an object have been performed by employing a humanoid robot arm having a simple configuration of shoulder and elbow joints. Through the simulation, it is shown that the torque patterns and ranges of the shoulder and elbow joints required for such a humanoid lifting and transferring task can be found earlier in the design of a humanoid robot arm. As a result, this effort is useful for us to design an effective robot arm.

• The Journal of Korea Robotics Society
• /
• v.3 no.3
• /
• pp.212-218
• /
• 2008

Collision avoidance is a fundamental and important task of an autonomous mobile robot for safe navigation in real environments with high uncertainty. Obstacles are classified into static and dynamic obstacles. It is difficult to avoid dynamic obstacles because the positions of dynamic obstacles are likely to change at any time. This paper proposes a scheme for vision-based avoidance of dynamic obstacles. This approach extracts object candidates that can be considered moving objects based on the labeling algorithm using depth information. Then it detects moving objects among object candidates using motion vectors. In case the motion vectors are not extracted, it can still detect the moving objects stably through their color information. A robot avoids the dynamic obstacle using the dynamic window approach (DWA) with the object path estimated from the information of the detected obstacles. The DWA is a well known technique for reactive collision avoidance. This paper also proposes an algorithm which autonomously registers the obstacle color. Therefore, a robot can navigate more safely and efficiently with the proposed scheme.

• Journal of Korea Multimedia Society
• /
• v.18 no.5
• /
• pp.575-582
• /
• 2015

Obtaining the complete trajectory of the object is a very important task in computer vision applications, such as video surveillance. Previous studies to recover the trajectory between two disconnected trajectory segments, however, do not takes into account the object's motion characteristics and uncertainty of trajectory segments. In this paper, we present a novel approach to recover the trajectory between two disjoint but associated trajectory segments, called goal-directed tracking. To incorporate the object's motion characteristics and uncertainty, the goal-directed state equation is first introduced. Then the goal-directed tracking framework is constructed by integrating the equation to the object tracking and trajectory linking process pipeline. Evaluation on challenging dataset demonstrates that proposed method can accurately recover the missing trajectory between two disconnected trajectory segments as well as appropriately constrain a motion of the object to the its goal(or the target state) with uncertainty.

• Journal of Institute of Control, Robotics and Systems
• /
• v.14 no.10
• /
• pp.998-1004
• /
• 2008

In this paper, a visual servoing control technique of humanoid robot arms is implemented for tracking a moving object. An embedded time-delayed controller is designed on an FPGA(Programmable field gate array) chip and implemented to control humanoid robot arms. The position of the moving object is detected by a stereo vision camera and converted to joint commands through the inverse kinematics. Then the robot arm performs visual servoing control to track a moving object in real time fashion. Experimental studies are conducted and results demonstrate the feasibility of the visual feedback control method for a moving object tracking task by the humanoid robot arms called the ROBOKER.

• The Journal of Korea Robotics Society
• /
• v.6 no.4
• /
• pp.344-352
• /
• 2011

A mobile manipulator is a system with a robotic manipulator mounted on top of a mobile base. It has both indoor and outdoor applications for transporting or transferring materials. When a user gives commands, they are usually at high levels such as "move the object to the table," or "tidy the room." By intelligently decomposing these complex commands into several subtasks, the mobile manipulator can perform the tasks with a greater efficiency. One of the crucial subtasks for these commands is the pick-and-place task. For the mobile manipulator, selection of a good base position and orientation is essential to accomplishing this task. This paper presents an algorithm that determines one of the position and orientation of a mobile manipulator in order to complete the pick-and-place task without human intervention. Its effectiveness are shown for a mobile manipulator with 9 degrees-of-freedom in simulation.