• Journal of Korea Multimedia Society
• /
• v.6 no.5
• /
• pp.896-908
• /
• 2003

Interaction technique in .3D virtual environment is a decisive factor that affects the immersion and presence felt by users in virtual space. Especially, in fields that require exquisite manipulation of objects such as electronic manuals in desktop environment, interaction technique that supports effective and natural manipulation of object is in demand. In this paper, 3D scene graph can be internally divided and reconstructed to a list defending on the users selection and through moving focus among the selection candidate objects list, the user can select 3D object more accurately Also, by providing various feedbacks for each manipulation stage, more effective manipulation is possible. The proposed technique can be used as 3D user interface in areas that require exquisite object manipulation.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.1011-1018
• /
• 2006

멀티모달 인터페이스는 인간의 제스처, 시선, 손의 움직임, 행동의 패턴, 음성, 물리적인 위치 등 인간의 자연스러운 행동들에 대한 정보를 해석하고 부호화하는 인지기반 기술이다. 본 논문에서는 제스처와 음성, 터치를 이용한 3D 오브젝트 기반의 멀티모달 인터페이스를 설계, 구현한다. 서비스 도메인은 스마트 홈이며 사용자는 3D 오브젝트 직접조작을 통해 원격으로 가정의 오브젝트들을 모니터링하고 제어할 수 있다. 멀티모달 인터랙션 입출력 과정에서는 여러 개의 모달리티를 병렬적으로 인지하고 처리해야 하기 때문에 입출력 과정에서 각 모달리티의 조합과 부호화 방법, 입출력 형식 등이 문제시된다. 본 연구에서는 모달리티들의 특징과 인간의 인지구조 분석을 바탕으로 제스처, 음성, 터치 모달리티 간의 입력조합방식을 제시하고 멀티모달을 이용한 효율적인 3D Object 인터랙션 프로토타입을 설계한다.

• Journal of Korea Multimedia Society
• /
• v.10 no.3
• /
• pp.381-390
• /
• 2007

3D object contents are used for various applications in the Web virtual space, where the main concerns are to navigate the 3D virtual space and visualize 3D objects. The techniques to manipulate 3D objects like disassembling and assembling and to record the manipulation process are the very first step. Until now, we can record only the result of 3D object manipulation. Thus, we have tried to study the representation technique to record meaningfully and replay the manipulation process of 3D structured objects. We analyzed the structures and their relations between components to construct 3D objects that are described in XML or VRML. Compared to the previous method, we studied a XML based annotation technique to record and store selectively by user. This technique makes 3D structured objects be used in the various applications by the selective recording and also selective replaying.

• Journal of Internet Computing and Services
• /
• v.25 no.1
• /
• pp.9-15
• /
• 2024

As virtual reality technology became popular, a high demand emerged for natural and efficient interaction with the virtual environment. Mid-air manipulation is one of the solutions to such needs, letting a user manipulate a virtual object in a 3D virtual space. In this paper, we focus on manipulating a remote virtual object while visually displaying the object and providing tactile information on the object's weight. We developed two types of wearable interfaces that can provide cutaneous or vibrotactile feedback on the virtual object weight to the user's fingertips. Human perception of the remote virtual object weight during manipulation was evaluated by conducting a psychophysics experiment. The results indicate a significant effect of haptic feedback on the perceived weight of the virtual object during manipulation.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.884-892
• /
• 2006

This paper describes a framework for multimodal object manipulation in virtual environments. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. These commands are used to reposition the objects in the virtual environments. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment as it will be in the real world.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.16 no.4
• /
• pp.117-123
• /
• 2016

A hand-gesture interface to manipulate a 3D object of augmented reality is implemented by recognizing the user hand-gesture in this paper. Proposed method extracts the hand region from real image, and creates augmented object by hand marker recognized user hand-gesture. Also, 3D object manipulation corresponding to user hand-gesture is performed by analyzing a hand region ratio, a numbet of finger and a variation ratio of hand region center. In order to evaluate the performance of the our proposed method, after making a 3D object by using the OpenGL library, all processing tasks are implemented by using the Intel OpenCV library and C++ language. As a result, the proposed method showed the average 90% recognition ratio by the user command-modes successfully.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.19 no.1
• /
• pp.1-8
• /
• 2024

Robotic arms have been widely utilized in various labor-intensive industries such as manufacturing, agriculture, and food services, contributing to increasing productivity. In the development of industrial robotic arms, camera sensors have many advantages due to their cost-effectiveness and small sizes. However, estimating object positions is a challenging problem, and it critically affects to the robustness of object manipulation functions. This paper proposes a method for estimating the 3D positions of objects, and it is applied to a pick-and-place task. A deep learning model is utilized to detect 2D bounding boxes in the image plane, and the pinhole camera model is employed to compute the object positions. To improve the robustness of measuring the 3D positions of objects, we analyze the effect of lens distortion and introduce a false positive filtering process. Experiments were conducted on a real-world scenario for moving medicine bottles by using a camera-based manipulator. Experimental results demonstrated that the distortion removal and false positive filtering are effective to improve the position estimation precision and the manipulation success rate.

• Journal of the HCI Society of Korea
• /
• v.1 no.1
• /
• pp.9-20
• /
• 2006

This paper describes a framework for multimodal object manipulation in virtual environments. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. These commands are used to reposition the objects in the virtual environments. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment as it will be in the real world.

• Journal of the HCI Society of Korea
• /
• v.5 no.2
• /
• pp.15-24
• /
• 2010

A Digilog Book is an augmented reality (AR) based next generation publication supporting both sentimental analog emotions and digitized multi-sensory feedbacks by combining a conventional printed book and digital contents. As a Digilog Book authoring software, ARtalet provides an intuitive authoring environment through 3D user interface in AR environment. In this paper, we suggest ARtalet authoring environment based trajectory editing method to generate and manipulate a movement path of an augmented 3D object on the Digilog Book. Specifically, the translation points of the 3D manipulation prop is examined to determine that the point is a proper control point of a trajectory. Then the interpolation using splines is conducted to reconstruct the trajectory with smoothed form. The dynamic score based selection method is also exploited to effectively select small and dense control points of the trajectory. In an experimental evaluation our method took the same time and generated a similar amount of errors as the usual approach, but reduced the number of control points needed by over 90%. The reduced number of control points can properly reconstruct a movement path and drastically decrease the number of control point selections required for movement path modification. For control manipulation, the task completion time was reduced and there was less hand movement needed than with conventional method. Our method can be applicable to drawing or curve editing method in immersive In-Situ AR based education, game, design, animation, simulation application domains.

• Journal of Broadcast Engineering
• /
• v.7 no.3
• /
• pp.248-261
• /
• 2002

In this paper, we proposed a new 3-dimensional(3-D) object-tracking algorithm that can control a stereo camera using a variable window mask supported by which uses ,B-D information and an optical BPEJTC. Hence, three-dimensional information characteristics of a stereo vision system, distance information from the stereo camera to the tracking object. can be easily acquired through the elements of a stereo vision system. and with this information, we can extract an area of the tracking object by varying window masks. This extractive area of the tracking object is used as the next updated reference image. furthermore, by carrying out an optical BPEJTC between a reference image and a stereo input image the coordinates of the tracking objects location can be acquired, and with this value a 3-D object tracking can be accomplished through manipulation of the convergence angie and a pan/tilt of a stereo camera. From the experimental results, the proposed algorithm was found to be able to the execute 3-D object tracking by extracting the area of the target object from an input image that is independent of the background noise in the stereo input image. Moreover a possible implementation of a 3-D tele-working or an adaptive 3-D object tracker, using the proposed algorithm is suggested.