• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.54 no.3
• /
• pp.156-165
• /
• 2005

Human being recognizes the physical world by integrating a great variety of sensory inputs, the information acquired by their own action, and their knowledge of the world using hierarchically parallel-distributed mechanism. In this paper, authors propose the sensor fusion system that can recognize multiple 3D objects from 2D projection images and tactile informations. The proposed system focuses on improving recognition performance of 3D objects. Unlike the conventional object recognition system that uses image sensor alone, the proposed method uses tactual sensors in addition to visual sensor. Neural network is used to fuse the two sensory signals. Tactual signals are obtained from the reaction force of the pressure sensors at the fingertips when unknown objects are grasped by four-fingered robot hand. The experiment evaluates the recognition rate and the number of learning iterations of various objects. The merits of the proposed systems are not only the high performance of the learning ability but also the reliability of the system with tactual information for recognizing various objects even though the visual sensory signals get defects. The experimental results show that the proposed system can improve recognition rate and reduce teeming time. These results verify the effectiveness of the proposed sensor fusion system as recognition scheme for 3D objects.

• The Journal of the Acoustical Society of Korea
• /
• v.38 no.4
• /
• pp.427-432
• /
• 2019

In this paper, we propose a home monitoring system using sound event detection based on a bidirectional gated recurrent neural network for the hard-of-hearing. First, in the proposed system, packet loss concealment is used to recover a lost signal captured through wireless sensor networks, and reliable channels are selected using multi-channel cross correlation coefficient for effective sound event detection. The detected sound event is converted into the text and haptic signal through a harmonic/percussive sound source separation method to be provided to hearing impaired people. Experimental results show that the performance of the proposed sound event detection method is superior to the conventional methods and the sound can be expressed into detailed haptic signal using the source separation.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.3 no.4
• /
• pp.244-250
• /
• 2008

This paper describes the design and implementation of an unmanned ground vehicle (UGV) and also estimates how well autonomous navigation and remote control of UGV can be performed through the optimized arbitration of several sensor data, which are acquired from vision, obstacle detection, positioning system, etc. For the autonomous navigation, lane detection and tracing, global positioning, and obstacle avoidance are necessarily required. In addition, for the remote control, two types of experimental environments are established. One is to use a commercial racing wheel module, and the other is to use a haptic device that is useful for a user application based on virtual reality. Experimental results show that autonomous navigation and remote control of the designed UGV can be achieved with more effectiveness and accuracy using the proper arbitration of sensor data and navigation plan.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.741-744
• /
• 2009

In this paper, We introduce the glove mouse using a Gyroscope, acceleration sensor, Pin-type Viboratctile Display Device and USB HID. The device recognize a user's wrist by Gyroscope and acceleration sensor in the glove and transmit the data to USB dongle which is recognized the manufactured mouse by Blutooth. Also, using a special application, We transmit the tactile information to user through the Pin-type Vibrotactile Display. We implement wearable system in the glove except USB device. If user want to use general spatial mouse, we recognize mouse USB dongle only without another application. If user want to feel the tactile sensationn, we can use by connecting PC serial communication port to USB dongle.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.04a
• /
• pp.1129-1130
• /
• 2017

본 연구에서는 현대인들의 하루 중 많은 시간을 차지하는 착좌 생활을 관리하기 위한 롤러블(rollable) 스마트패드를 개발하였다. 이를 위해 PVDF(polyvinylidene fluoride) 필름을 이용한 압전센서(piezoelectric sensor)를 제작하였으며, 센서에서 데이터를 획득하고 및 햅틱 피드백(haptic feedback)을 주기 위한 측정시스템을 개발하였다. 또한, 스마트폰 어플리케이션을 통해 착좌 자세에 대한 정보를 실시간으로 제공하도록 하였다. 제작된 시스템의 착좌 자세 구분 정확도는 10명의 피험자를 대상으로 평가되었으며, 4가지 자세(상체를 좌, 우, 앞, 뒤로 기울인 앉은 자세)에 대한 실험결과 제작된 시스템은 92.5%의 정확도로 제시한 4가지의 자세를 구분하였다.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.8
• /
• pp.585-591
• /
• 2003

A virtual force is generated and fed back to the operator to make the teleoperation more reliable, which reflects the relationship between a slave robot and an uncertain remote environment as a form of an impedance. In general, for the teleoperation, the teleoperated mobile robot takes pictures of the remote environment and sends the visual information back to the operator over the Internet. Because of the limitations of communication bandwidth and narrow view-angles of camera, it is not possible to watch certain regions, for examples, the shadow and curved areas. To overcome this problem, a virtual force is generated according to both the distance between the obstacle and the robot and the approaching velocity of the obstacle w.r.t the collision vector based on the ultrasonic sensor data. This virtual force is transferred back to the master (two degrees of freedom joystick) over the Internet to enable a human operator to estimate the position of obstacle at the remote site. By holding this master, in spite of limited visual information, the operator can feel the spatial sense against the remote environment. It is demonstrated by experiments that this collision vector based haptic reflection improves the performance of teleoperated mobile robot significantly.

• Journal of Sensor Science and Technology
• /
• v.31 no.5
• /
• pp.324-329
• /
• 2022

This paper proposes a shift-register-based multichannel ultrasonic focusing delay control method using a complex programmable logic device (CPLD) for a high resolution of ultrasonic focusing system. The proposed method can achieve the ultrasonic focusing through the delay control of driving signals of each ultrasonic transducer of an ultrasonic array. The delay of the driving signals of all ultrasonic channels can be controlled by setting the shift register in the CPLD. The experiment verified that the frequency of the clock used for the delay control increased, the error of the focusing point decreased, and the diameter of the focusing point decreased as the length of the shift register in the proposed method. The proposed method used only one CPLD for ultrasonic focusing and did not require to use complex hardware circuits. Therefore, the resources required for the design of an ultrasonic focusing system could be reduced. The proposed method can be applied to the fields of human computer interaction (HCI), virtual reality (VR) and augmented reality (AR).

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.32 no.2
• /
• pp.11-19
• /
• 2024

Flight simulators are crucial devices for aircraft piloting training and simulation, requiring regular inspections to maintain performance and operational quality. This study explores the development of an automated inspection system for flight simulators to automate quality inspections of control loading systems (CLS). While quality inspection of the control loading system (CLS) is essential for flight simulators, manual inspections are common practice. To address this, we developed an Auto Qualification Test Guide (Auto QTG) using artificial control logic and sensor data and applied it to the militarily simulator. Experimental results demonstrate that Auto QTG successfully automates quality inspections of CLS, enhancing accuracy and efficiency. This automated inspection system is expected to contribute to improving the operation and maintenance of flight simulators.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.1
• /
• pp.42-48
• /
• 2011

This paper presents the vibration reduction algorithm at the walking-will recognition sensors on the uneven terrain. Recently, concern about walking assistant aids is increasing according to the increase in population of elder and handicapped person. However, most of walking aids don't have any actuators for its movement. So, general walking aids have weakness for its movement to upward/download direction of slope. To overcome the weakness of the general walking aids, many researches for active type walking aids are being progressed. Especially, vibration analysis and impulse reduction are one of the important elements of the active-type walking aid during moving on the outdoor area because the ground has many kinds of obstacles such as speed dumps, puddles and so on. So, we analyze the influence from vibration by uneven terrain. And then, we propose the impulse reduction algorithm to overcome the vibration. All the processes are verified experimentally in an active-type walking aid.

• Journal of the HCI Society of Korea
• /
• v.2 no.2
• /
• pp.1-9
• /
• 2007

In this paper, we propose a reconstruction technique of the lost hair region for 3D human actor modeling. An active depth sensor system can simultaneously capture both color and geometry information of any objects in real-time. However, it cannot acquire some regions whose surfaces are shiny and dark. Therefore, to get a natural 3D human model, the lost region in depth image should be recovered, especially human hair region. The recovery is performed using both color and depth images. We find out the hair region using color image first. After the boundary of hair region is estimated, the inside of hair region is estimated using an interpolation technique and closing operation. A 3D mesh model is generated after performing a series of operations including adaptive sampling, triangulation, mesh smoothing, and texture mapping. The proposed method can generate recovered 3D mesh stream automatically. The final 3D human model allows the user view interaction or haptic interaction in realistic broadcasting system.