• Journal of Advanced Research in Ocean Engineering
• /
• v.3 no.3
• /
• pp.136-148
• /
• 2017

The paper presents dual arm ROV manipulation using deep reinforcement learning. The purpose of this underwater manipulator is to investigate and excavate natural resources in ocean, finding lost aircraft blackboxes and for performing other extremely dangerous tasks without endangering humans. This research work emphasizes on a self-learning approach using Deep Reinforcement Learning (DRL). DRL technique allows ROV to learn the policy of performing manipulation task directly, from raw image data. Our proposed architecture maps the visual inputs (images) to control actions (output) and get reward after each action, which allows an agent to learn manipulation skill through trial and error method. We have trained our network in simulation. The raw images and rewards are directly provided by our simple Lua simulator. Our simulator achieve accuracy by considering underwater dynamic environmental conditions. Major goal of this research is to provide a smart self-learning way to achieve manipulation in highly dynamic underwater environment. The results showed that a dual robotic arm trained for a 3DOF movement successfully achieved target reaching task in a 2D space by considering real environmental factor.

• The Journal of Korea Robotics Society
• /
• v.8 no.1
• /
• pp.37-42
• /
• 2013

In this paper, a localization algorithm and an autonomous controller for PETASUS system II which is an underwater vehicle-manipulator system, are proposed. To estimate its position and to identify manipulation targets in a structured environment, a multi-rate extended Kalman filter is developed, where map information and data from inertial sensors, sonar sensors, and vision sensors are used. In addition, a three layered control structure is proposed as a controller for autonomy. By this controller, PETASUS system II is able to generate waypoints and make decisions on its own behaviors. Experiment results are provided for verifying proposed algorithms.

• International Journal of Naval Architecture and Ocean Engineering
• /
• v.11 no.1
• /
• pp.274-284
• /
• 2019

The control architectures of Chuan Suo (CS) deep submergence rescue vehicle are introduced. The hardware and software architectures are also discussed. The hardware part adopts a distributed control system composed of surface and underwater nodes. A computer is used as a surface control machine. Underwater equipment is based on a multi-board-embedded industrial computer with PC104 BUS, which contains IO, A/D, D/A, eight-channel serial, and power boards. The hardware and software parts complete data transmission through optical fibers. The software part involves an IPC of embedded Vxworks real-time operating system, upon which the operation of I/O, A/D, and D/A boards and serial ports is based on; this setup improves the real-time manipulation. The information flow is controlled by the software part, and the thrust distribution is introduced. A submergence vehicle heeling control method based on ballast water tank regulation is introduced to meet the special heeling requirements of the submergence rescue vehicle during docking. Finally, the feasibility and reliability of the entire system are verified by a pool test.

• Journal of Ocean Engineering and Technology
• /
• v.34 no.3
• /
• pp.180-193
• /
• 2020

In this study, the end-effector tracking performance of a manipulator installed on a remotely operated vehicle (ROV) for autonomous underwater intervention is verified. The underwater manipulator is an ARM 7E MINI model produced by the ECA group, which consists of six joints and one gripper. Of the six joints of the manipulator, two are revolute joints and the other four are prismatic joints. Velocity control is used to control the manipulator with forward and inverse kinematics. When the manipulator approaches a target object, it is difficult for the ROV to maintain its position and posture, owing to various disturbances, such as the variation in both the center of mass and the reaction force resulting from the manipulator motion. Therefore, it is necessary to compensate for the influences and ensure the relative distance to the object. Simulations and experiments are performed to track the trajectory of a virtual object, and the tracking performance is verified from the results.