• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.884-892
• /
• 2006

This paper describes a framework for multimodal object manipulation in virtual environments. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. These commands are used to reposition the objects in the virtual environments. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment as it will be in the real world.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10a
• /
• pp.251-254
• /
• 1996

We propose a coordinated motion control algorithm of dual manipulators handling a flexible object. The controller is designed so that it can specify the apparent impedance of the object as well as can control its deformation. The experimental results will illustrate validity of the proposed algorithm.

• Journal of the HCI Society of Korea
• /
• v.1 no.1
• /
• pp.9-20
• /
• 2006

This paper describes a framework for multimodal object manipulation in virtual environments. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. These commands are used to reposition the objects in the virtual environments. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment as it will be in the real world.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.31 no.8
• /
• pp.855-861
• /
• 2007

Haptic rendering is a process providing force feedback during interactions between a user and a virtual object. This paper presents a real-time haptic rendering technique for deformable objects based on visual information of intervention between a tool and a real object in a remote place. A user can feel the artificial reaction force through a haptic device in real-time when a slave system exerts manipulation tasks on a deformable object. The models of the deformable object and the manipulator are created from the captured image obtained with a CCD camera and the recognition of objects is achieved using image processing techniques. The force at a rate of 1 kHz for stable haptic interaction is deduced using extrapolation of forces at a low update rate. The rendering algorithm developed was tested and validated on a test platform consisting of a one-dimensional indentation device and an off-the shelf force feedback device. This software system can be used in a cellular manipulation system providing artificial force feedback to enhance a success rate of operations.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.09a
• /
• pp.24-27
• /
• 2003

This paper discusses practical strategies for transition from a pinching to a power grasping, where a multi-fingered hand mounted on a robotic arm envelops a cylindrical object on a table. When the manipulation system grasps a cylindrical object like a pen on a desk, a complete enveloping is not impossible in the initial configuration. The system firstly pinches the object only with two or three fingers and then grasp it with fingers and a palm after regrasping. In this pinching-grasping transition maneuver, human unconsciously selects proper strategy according to some conditions including object dimensions and initial pinching positions. In this paper we therefore develop six possible strategies for this pinching-grasping transition and then investigate their performances for some objects with various dimensions and various grasping positions, using numerical simulations. Based on their results, effective strategies are implemented by using a hand-arm system.

• Journal of the Korea Society of Computer and Information
• /
• v.23 no.7
• /
• pp.49-56
• /
• 2018

Virtual object weight perception is an important topic, as it heightens the believability of object manipulation in immersive virtual environments. Although weight perception can be achieved using haptic interfaces, their technical complexity makes them difficult to apply in immersive virtual environments. In this study, we present a visual pseudo-haptic feedback system that simulates and depicts the weights of virtual objects, the effect of which is weight perception. The proposed method recognizes grasping and manipulating hand motions using computer vision-based tracking methods, visualizing a Force Arrow to indicate the current lifting forces and its difference from the standard lifting force. With the proposed Force Arrow method, a user can more accurately perceive the logical and unidirectional weight and therefore control the force used to lift a virtual object. In this paper, we investigate the potential of the proposed method in discriminating between different weights of virtual objects.

• The Journal of Korea Robotics Society
• /
• v.4 no.3
• /
• pp.225-232
• /
• 2009

In the high precision robot systems, the most popular tasks may be handling of micro-scale objects on a surface such as a micromanipulation robot system. In handling of micro-scale objects, the stiction effect becomes a fundamental issue since the micro-contact mechanics dominates the micromanipulation robot system. In the paper, a theoretical non-stick condition derived from the micro-contact mechanics is carried out for the propose of micro-scale object manipulation. To verify the non-stick condition, a micro-manipulation robot system equipped with a high precision stage system and a microscope system is developed. Experimental results show that the proposed non-stick condition guarantees successful micro-scale object manipulation.

• The Journal of Korea Robotics Society
• /
• v.17 no.1
• /
• pp.40-47
• /
• 2022

A reward function suitable for a task is required to manipulate objects through reinforcement learning. However, it is difficult to design the reward function if the ample information of the objects cannot be obtained. In this study, a demonstration-based object manipulation algorithm called stochastic exploration guided by demonstration (SEGD) is proposed to solve the design problem of the reward function. SEGD is a reinforcement learning algorithm in which a sparse reward explorer (SRE) and an interpolated policy using demonstration (IPD) are added to soft actor-critic (SAC). SRE ensures the training of the critic of SAC by collecting prior data and IPD limits the exploration space by making SEGD's action similar to the expert's action. Through these two algorithms, the SEGD can learn only with the sparse reward of the task without designing the reward function. In order to verify the SEGD, experiments were conducted for three tasks. SEGD showed its effectiveness by showing success rates of more than 96.5% in these experiments.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2010.11a
• /
• pp.73-74
• /
• 2010

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.11
• /
• pp.75-84
• /
• 2021

In this paper, we propose an adaptive concurrency control scheme to reduce conflicts and working time in the cooperative work in mixed reality. To this ends, we first classified the goals, tasks and ownerships of the cooperative work. Then, the classified relationships are mapped according to their temporal and hierarchical relationships of shared object manipulation in the cooperative work. The proposed system provides adaptive concurrency controls of the shared object according to temporal orders of the sub-goals. With the proposed scheme, a participant is enable to move and rotate a shared object although another already has an ownership of the shared object in a specific order of the sub-goal. Thus, the proposed system provides adaptive and realistic cooperative working environment. We conducted a user study of the proposed scheme. The proposed system could reduce conflicts and working times comparing to conventional approaches.