• The Journal of the Acoustical Society of Korea
• /
• v.38 no.4
• /
• pp.427-432
• /
• 2019

In this paper, we propose a home monitoring system using sound event detection based on a bidirectional gated recurrent neural network for the hard-of-hearing. First, in the proposed system, packet loss concealment is used to recover a lost signal captured through wireless sensor networks, and reliable channels are selected using multi-channel cross correlation coefficient for effective sound event detection. The detected sound event is converted into the text and haptic signal through a harmonic/percussive sound source separation method to be provided to hearing impaired people. Experimental results show that the performance of the proposed sound event detection method is superior to the conventional methods and the sound can be expressed into detailed haptic signal using the source separation.

• Journal of the Korean Society for Precision Engineering
• /
• v.30 no.3
• /
• pp.300-307
• /
• 2013

This paper describes the development of a cylindrical-object grasping force measuring system applied haptic technology to measure the grasping force of strokes patients' fingers and other patients' paralyzed fingers. Because the cylindrical-object and the force measuring device of the developed cylindrical-object grasping force measuring system are connected with the electrical wires, patients and their families have difficulty not only measuring the patients' grasping force using the system but also knowing their rehabilitation extent when using it. In this paper, the cylindrical-object grasping force measuring system applied haptic technology was developed, and the cylindrical-object grasping force measuring device sends data to the rehabilitation evaluating system applied haptic technology by wireless communication. The grasping force measurement characteristic test using the system was carried out, and it was confirmed that the rehabilitation extent of the patients' paralyzed fingers and normal people fingers can be evaluated.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.04a
• /
• pp.1129-1130
• /
• 2017

본 연구에서는 현대인들의 하루 중 많은 시간을 차지하는 착좌 생활을 관리하기 위한 롤러블(rollable) 스마트패드를 개발하였다. 이를 위해 PVDF(polyvinylidene fluoride) 필름을 이용한 압전센서(piezoelectric sensor)를 제작하였으며, 센서에서 데이터를 획득하고 및 햅틱 피드백(haptic feedback)을 주기 위한 측정시스템을 개발하였다. 또한, 스마트폰 어플리케이션을 통해 착좌 자세에 대한 정보를 실시간으로 제공하도록 하였다. 제작된 시스템의 착좌 자세 구분 정확도는 10명의 피험자를 대상으로 평가되었으며, 4가지 자세(상체를 좌, 우, 앞, 뒤로 기울인 앉은 자세)에 대한 실험결과 제작된 시스템은 92.5%의 정확도로 제시한 4가지의 자세를 구분하였다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.1
• /
• pp.42-48
• /
• 2011

This paper presents the vibration reduction algorithm at the walking-will recognition sensors on the uneven terrain. Recently, concern about walking assistant aids is increasing according to the increase in population of elder and handicapped person. However, most of walking aids don't have any actuators for its movement. So, general walking aids have weakness for its movement to upward/download direction of slope. To overcome the weakness of the general walking aids, many researches for active type walking aids are being progressed. Especially, vibration analysis and impulse reduction are one of the important elements of the active-type walking aid during moving on the outdoor area because the ground has many kinds of obstacles such as speed dumps, puddles and so on. So, we analyze the influence from vibration by uneven terrain. And then, we propose the impulse reduction algorithm to overcome the vibration. All the processes are verified experimentally in an active-type walking aid.

• Journal of Sensor Science and Technology
• /
• v.31 no.4
• /
• pp.260-265
• /
• 2022

In this study, we establish hyper-elastic haptic feedback in a virtual environment using finite element analysis techniques and develop a Force Torque (FT) sensor utilization method for application in tele-operation environments. In general, regarding haptic feedback data, in a tele-operation environment, the user is provided with feedback according to the measured force data when the model is inserted through an FT sensor. Conversely, in a virtual environment, the press-fitting model can be expressed through the spring-damper system rather than an FT sensor to provide feedback. However, unlike rigid and the elastic bodies, the hyper-elastic body represented by a spring-damper system in a virtual environment is a simple impedance model using stiffness and damping coefficients; it is limited in terms of providing actual feedback. Thus, in this study, haptic feedback was implemented using the data obtained from POD-RBF analysis results during hyper-elastic press-fitting experiments. The haptic feedback mechanism developed in this study was verified by comparing the FT sensor feedback data measured and calculated through hyper-elastic press-fitting experiments with spring-damper feedback data. Subsequently, the POD-RBF analysis feedback was compared and evaluated against the feedback mechanism of each environment through the test subject, and the similarities between the POD-RBF analysis feedback and FT sensor data feedback were verified.

• Proceedings of the Korea Concrete Institute Conference
• /
• 2008.04a
• /
• pp.957-960
• /
• 2008

The purpose of this study is to explore a safe, advanced, and environment-friendly demolition equipments and their operation methods. As an initial achievement, the capacity of the existing equipments have been evaluated through technical discussions and demonstrations with some experts in the related industry. From these evaluations, it was concluded that a haptic based remote control with force feed-back mechanism and sensor fusion functions would be the most appropriate to the demolition equipments. Therefore, a novel haptic device that is adequately designed for the demolition equipments is proposed in this paper. Top-down demolition method is also proposed, which is very effective in the demolition of high-rise buildings.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.25 no.8
• /
• pp.1308-1316
• /
• 2001

A hybrid type master system is proposed to take the advantage of the link mechanism and magnetic levitation mechanism without using a force sensor. Two different types of electromagnetic actuators, moving coil type and moving magnet types are used to drive the master system which is capable of 4-DOF actuation. It is designed that the rotation motions about x-y axis are decoupled and the whole system is represented by simple dynamic equations. The force reflection is achieved by using the simple relation between the force and applied current and position. The simulation and experimental results are presented to show its performance.

• Journal of the Korea Convergence Society
• /
• v.10 no.11
• /
• pp.111-116
• /
• 2019

With recent rapid development of computer capabilities, various technologies that can facilitate the interaction between humans and computers are being studied. The paradigm tends to change to NUI using the body such as 3D motion, haptics, and multi-touch with GUI using traditional input devices. Various studies have been conducted on transferring human movements to computers using sensors. In addition to the development of optical sensors that can acquire 3D objects, the range of applications in the industrial, medical, and user interface fields has been expanded. In this paper, I provide a model that can execute other programs through gestures instead of the mouse, which is the default input device, and control Windows based on the lip motion. To propose a model which converges with an Android application and can be controlled by various media and voice instruction functions using voice recognition and buttons through connection with a main client. It is expected that Internet media such as video and music can be controlled not only by a client computer but also by an application at a long distance and that convenient media viewing can be performed through the proposal model.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.1188-1193
• /
• 2006

본 논문에서는 동적 객체의 3 차원 정보를 표현하는 깊이 영상의 노이즈 필터링 방법을 제안한다. 실제 객체의 동적인 3 차원 정보는 적외선 깊이 센서가 장착된 깊이 비디오 카메라를 이용하여 실시간으로 획득되며, 일련의 깊이 영상, 즉 깊이 비디오(depth video)로 표현될 수 있다. 하지만 측정환경의 조명조건, 객체의 반사속성, 카메라의 시스템 오차 등으로 인해 깊이 영상에는 고주파 성분의 노이즈가 발생하게 된다. 이를 효과적으로 제거하기 위해 깊이 영상기반의 모델링 기법(depth image-based modeling)을 이용한 3 차원 메쉬 모델링을 수행한다. 생성된 3 차원 메쉬 모델은 깊이 영상의 노이즈로 인해 경계 영역과 형상 내부 영역에 심각한 형상 오차를 가진다. 경계 영역의 오차를 제거하기 위해 깊이 영상으로부터 경계 영역을 추출하고, 가까운 순서로 정렬한 후 angular deviation 을 이용하여 불필요하게 중복된 점들을 제거한다. 그리고 나서 2 차원 가우시안 스무딩 기법을 적용하여 부드러운 경계영역을 생성한다. 형상 내부에 대해서는 경계영역에 제약조건을 주고 3 차원 가우시안 스무딩 기법을 적용하여 전체적으로 부드러운 형상을 생성한다. 최종적으로 스무딩된 3 차원 메쉬모델을 렌더링할 때, 깊이 버퍼에 있는 정규화된 깊이 값들을 추출하여 원래 깊이 영상과 동일한 깊이 영역을 가지도록 저장함으로서 전역적으로 연속적이면서 부드러운 깊이 영상을 생성할 수 있다. 제안된 방법에 의해 노이즈가 제거된 깊이 영상을 이용하여 고품질의 영상기반 렌더링이나 깊이 비디오 기반의 햅틱 렌더링에 적용할 수 있다.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.99-104
• /
• 2009

최근 멀티미디어 기술과 가상/증강현실 기술의 발전으로 사용자에게 몰입감 있는 콘텐츠를 제공하는 여러 시스템들이 제안되고 있다. 또한 기존의 시각과 음향효과만으로 이루어진 시스템의 한계를 넘어서 실제와 같은 느낌을 전달할 수 있는 햅틱기술을 적용하여 보다 몰입감있는 체험형 실감책들이 고안되고 있다. 본 논문은 과학교과서를 중심으로 과학적 이론을 보다 효과적으로 가르치고 배우기 위해 필요한 다양한 촉감(Haptic)을 분류하고, 이를 실감책에 적용하여 책이 담고 있는 주요 내용 또는 삽화와 관련된 다양한 멀티미디어 콘텐츠를 가상/증강환경에서 시청각정보와 함께 촉각콘텐츠를 독자에게 제공함으로써 보고, 듣고 만질 수 있는 적극적인 촉감 상호작용이 가능한 실감책 ('Sil-Gam' Book) 시스템의 기본 프레임워크를 제시한다. 제시된 실감책은 크게 세 부분으로 구성된다. 첫째, 실감책을 읽고 있는 사용자의 손가락의 위치, 시선과 같은 사용자의 움직임을 추적하고 책의 크기, 페이지 등을 인식하는 센서가 부착된 센싱 부; 둘째, 장비에 따라 적용 가능한 촉감 속성, 물체의 움직임에 따라 적용할 수 있는 촉감 속성등 다양한 촉감콘텐츠의 속성을 저작하고 편집하는 소프트웨어 부; 마지막으로 사용자에게 저작된 실감 콘텐츠를 사용자가 쉽고 직관적으로 체험하게 하기 위한 디스플레이부로 구성된다. 여기서 디스플레이 부는 세부적으로 시청각 콘텐츠를 전달하는 시청각 디스플레이 부와 역촉감 콘텐츠를 전달하는 역촉감 디스플레이부로 구성된다. 본 논문에서는 또한 실감책 촉감 저작도구를 사용하여 제시할 수 있는 다양한 촉감을 중고등학교 교육과정에서 배우는 과학 이론에 적용하여 과학 실험시 경험할 수 있는 다양한 역/촉감을 전달하는 몇 가지 시나리오를 예시하였다.