• 한국컴퓨터정보학회논문지
• /
• 제17권12호
• /
• pp.219-228
• /
• 2012

본 논문에서는 키넥트의 3차원 영상정보를 이용하여 손가락 움직임을 검출하고 이 정보를 이용하여 종이건반 피아노를 구현하는 방법을 제안한다. 키넥트의 컬러영상과 깊이영상을 이용하여 먼저 건반 식별을 위해 필요한 건반 패턴 정보와 사용자의 종이건반 누름 여부를 판정하기 위한 건반깊이 정보를 검출한다. 배경의 깊이정보를 이용하여 입력된 깊이정보로부터 손 영역을 검출할 경우 종이건반과 접촉한 손가락 끝부분이 잘려나가는 문제를 해결하기 위해 스킨 컬러를 이용하여 정확도를 향상시켰다. 그리고 면적을 이용한 외곽선 검출과 convex hull 알고리즘을 이용하여 손가락 끝점을 검출하고 건반 패턴 정보와 비교하여 건반 누름을 판정하였다. 본 논문에서 제안하는 방법을 이용하여 종이건반 피아노 성능평가를 수행한 결과 높은 검출 정확도를 보였다. 구현된 종이건반 피아노 기능을 활용하여 피아노 연주 입력장치를 구현함으로써 PC기반 피아노 연주시스템 구현의 편리성을 보였으며 악기 초보자가 PC 기반 피아노 연주 학습에 사용자 인터페이스로 활용할 수 있는 가능성을 확인하였다.

• 대한산업공학회지
• /
• 제39권2호
• /
• pp.99-104
• /
• 2013

With diversity of mobile services (e.g., messenger, and social network service) on smartphone, the demand of text input using a soft keyboard is increasing. However, studies on subjective and physiological responses of users for various touch locations are lacking. The present study investigated the ergonomic effects according to touch locations of a soft keyboard on smartphone. The experiment of the present study measured perceived discomfort using Borg's CR-10 scale and electromyography (EMG) on forearm (abductor pollicis longus, and extensor digitorum communis) and thumb (abductor pollicis brevis, and first dorsal interossei) muscles. Perceived discomfort was significantly varied from 0.7 (extremely weak discomfort) to 2.5 (weak discomfort) depending on touch locations. %MVC according to touch locations was only significant at abductor pollicis brevis which varied from 10% to 23%. The experimental results of the present study can be utilized in the ergonomic design of a soft keyboard.

• 디지털융복합연구
• /
• 제12권7호
• /
• pp.253-259
• /
• 2014

본 논문에서는 사용자 친화적이면서 좁은 영역에서도 효과적으로 입력을 수행할 수 있는 새로운 방식의 키보드를 제안한다. 기존의 키보드는 문자의 배열 형태나 사용 방식은 다르지만 대부분 키를 나열한 다음 선택하도록하는 방식이었다. 본 논문에서는 기존의 방식과 다르게 키보드 내용이 동적으로 변화하는 새로운 방식의 정보 입력장치인 Dynamic Keyboard(DynaKey)를 설계한다. Dynakey는 정확한 위치 선택이 어려운 장애인이나 화면이 작은 이동기기에서 사용하기 편리한 정보입력장치이다.

• 한국콘텐츠학회:학술대회논문집
• /
• 한국콘텐츠학회 2010년도 춘계 종합학술대회 논문집
• /
• pp.272-273
• /
• 2010

마이크로프로세서 시스템의 키보드 버튼의 누름 결과를 기존의 입력 스캔 제어방법이 아닌 인터럽트 제어방법으로 시도하였다. 키보드 스캔 결과를 인터럽트 제어 방법으로 제어 시 적절한 30ms의 주기로 인식하도록 함으로써 마이크로프로세서의 작업부하를 줄이는 키보드 버튼 누름 제어 인식 알고리즘을 제시하였다.

• Journal of Mechanical Science and Technology
• /
• 제17권12호
• /
• pp.2004-2009
• /
• 2003

The purpose of this study is to define how wrist motion is affected by different postures and supporting devices and to discover functional range of wrist motion for keyboard typing. The range of wrist motion (ROM) needed for fourteen experienced typists to type on a computer keyboard was measured by flexible and biaxial electrogoniometers. The most frequent wrist motion during typing was in extended and ulnarly deviated positions in both wrists. Range of wrist motion was similar in both wrists. The average ROM for keyboard typing with the typists' own posture was about 39 in flexion/extension (FEM) and 29 in radial/ulnar deviation (RUD) in both wrists. The range of wrist motion was significantly reduced to 30 in FEM and 27 in RUD with use of either wrist or forearm supporting devices, which suggests that these devices might help to relieve fatigue, discomfort, or pain during and/or after typing. Results of this study will be of interest to clinicians and helpful to those who are professionally or non-professionally involved in typing.

• 제어로봇시스템학회논문지
• /
• 제9권9호
• /
• pp.720-726
• /
• 2003

A virtual keyboard may be efficient as a new mobile input device supporting QWERTY keyboard layout. As a preliminary study for developing a virtual keyboard, the typing pattern of a skilled human is investigated. In the study the touch-positions of the fingers are measured with a touchscreen while five skilled typists perform typing of long sentences. From these measurements it can be observed that the groups of touch-positions are classified into alphabetic characters. Though there are some mismatches, we can find constant distances capable of being discriminated among the groups. Based on the analysis the prediction algorithm of the constant distance is proposed and evaluated, which is useful for realization of a portable virtual keyboard.

• 한국멀티미디어학회논문지
• /
• 제18권3호
• /
• pp.368-375
• /
• 2015

Nowaday, financial institutions provide secure mobile keyboard solutions to keep their mobile banking services safe. However, these are still vulnerable to attacks, such as shoulder surfing attack. Especially, in the case of handicapped person such as visual impairment and blindness, they are more vulnerable than ordinary person because of inconvenience of secure information input. Among them, we focused on the color blind. For the color blind, 4-color based secure keyboard method causes more inconvenience to notify exact color. Thus, we propose a secure mobile keyboard solution to provide advanced functionality for the color blind users. Our method is based on 4-color theorem to support color blind users. In addition, our scheme is robust against shoulder surfing attack. According to the evaluation result, our method offers increased security against shoulder surfing attack compare with existing methods.

• 한국멀티미디어학회논문지
• /
• 제21권11호
• /
• pp.1263-1270
• /
• 2018

Dynamic adaptation method is an effective technique to enhance the usability by personalizing the soft keyboard layout using the user's key input information. In this paper, we propose a dynamic adaptation method of a keyboard by automatically extracting typos from key input information and using adjacent-typo information classified through the relationship between typos. This technique does not limit a range of adaptation to the inside of the key but extends the range to the neighbor key so that the adaptation effect can be achieved in a wide range at a high speed, thereby the proposed method improves the usability of the keyboard with a small number of inputs. The proposed method showed 25% increase in usability compared to the existing method through experiment and it was confirmed that usability improves up to 33% when used with the existing method.

• 대한산업공학회지
• /
• 제42권1호
• /
• pp.57-64
• /
• 2016

Pen-based interaction is universally available on smart devices and especially on Tablet PCs. Previous studies compared various input methods like fingers, a mouse or a stylus pen on PCs or on a touchscreen based devices such as smart phones. At the same time, various soft keyboard applications are being developed on application stores of smart devices. However, these previous studies did not suggest which one is a suitable keyboard application for Tablet PCs when users perform a certain interaction as input type. In this study, we compared two types of input methods (finger and pen) and three types of soft keyboard applications (QWERTY, Gesture and Swype) in a Tablet PC using performance measurements (accuracy and input speed) and discussed what types of applications showed better performance with each interaction on tablet PC. From these results, recommendations for the keyboard types depending on the input methods on tablet PCs were developed.

• 한국멀티미디어학회논문지
• /
• 제15권1호
• /
• pp.51-62
• /
• 2012

본 논문에서는 초등학교 저학년 학생들이 쉽고 효율적으로 건반악기 연주 방법을 학습할 수 있도록 개발한 악기 자율학습기를 설명한다. 개발한 악기 자율학습기는 PC기반의 학습 소프트웨어와 외장 전자건반악기 모듈로 구성된다. 우리는 USB 인터페이스를 적용한 전자건반악기와 PC용 S/W를 연동하여 악기 연주에 필요한 정보를 PC 화면에 제공하는 기능과 타자연습과 유사한 형식의 게임을 통해 학습내용을 재미있게 복습하는 기능을 구현하였다. 개발한 외장 전자건반모듈은 USB 인터페이스를 통하여 PC로부터 선택적으로 악기연주 안내정보를 수신하여 LED 및 7-세그먼트에 표시해줌으로써 초보자들이 쉽게 악보 내 음계와 건반의 상관관계를 숙지할 수 있도록 하였다. 또한 사용자가 건반을 잘못 눌렀을 때 이를 감지하여 LED와 PC 화면에 안내정보를 출력하도록 구현하였다. 구현된 악기 자율학습기를 이용한 악보 연주 실험을 통하여 학습효율이 향상됨을 확인하였다.