• Clinical and Experimental Pediatrics
• /
• 제63권6호
• /
• pp.232-236
• /
• 2020

Background: Children today get access to smartphones at an early age. However, their ability to use mobile apps has not yet been studied in detail. Purpose: This study aimed to assess the ability of children aged 2-8 years to perform touchscreen gestures and follow prompting techniques, i.e., ways apps provide instructions on how to use them. Methods: We developed one mobile app to test the ability of children to perform various touchscreen gestures and another mobile app to test their ability to follow various prompting techniques. We used these apps in this study of 90 children in a kindergarten and a primary school in New Delhi in July 2019. We noted the touchscreen gestures that the children could perform and the most sophisticated prompting technique that they could follow. Results: Two- and 3-year-old children could not follow any prompting technique and only a minority (27%) could tap the touchscreen at an intended place. Four- to 6-year-old children could perform simple gestures like a tap and slide (57%) and follow instructions provided through animation (63%). Seven- and 8-year-old children could perform more sophisticated gestures like dragging and dropping (30%) and follow instructions provided in audio and video formats (34%). We observed a significant difference between the number of touchscreen gestures that the children could perform and the number of prompting techniques that they could follow (F=544.0407, P<0.05). No significant difference was observed in the performance of female versus male children (P>0.05). Conclusion: Children gradually learn to use mobile apps beginning at 2 years of age. They become comfortable performing single-finger gestures and following nontextual prompting techniques by 8 years of age. We recommend that these results be considered in the development of mobile apps for children.

• 제어로봇시스템학회논문지
• /
• 제14권1호
• /
• pp.62-69
• /
• 2008

A specialized anthropomorphic robot hand which can be attached to the biped humanoid robot MAHRU-R in KIST, has been developed. This built-in type hand consists of three fingers and a thumb with total four DOF(Degrees of Freedom) where the finger mechanism is well designed for grasping typical objects stably in human's daily activities such as sphere and cylinder shaped objects. The restriction of possible motions and the limitation of grasping objects arising from the reduction of DOF can be overcome by reflecting a typical human finger's motion profile to the design procedure. As a result, the developed hand can imitate not only human hand's shape but also its motion in a compact and efficient manner. Also this novel robot hand can perform various human hand gestures naturally and grasp normal objects with both power and precision grasping capability.

• 스마트미디어저널
• /
• 제8권4호
• /
• pp.53-57
• /
• 2019

In this paper, we propose a flex sensor-based data glove to track the movements of human fingers for virtual reality education. By putting flex sensors and utilizing an accelerometer, this data glove allows people to enjoy applications for virtual reality (VR) or augmented reality (AR). With the maximum and minimum values of the flex sensor at each finger joint, it determines an angle corresponding to the bending value of the flex sensor. It tracks the movements of fingers and hand gestures with respect to the angle values at finger joints. In order to prove the effectiveness of the proposed data glove, we implemented a VR classroom application.

• 한국멀티미디어학회논문지
• /
• 제13권8호
• /
• pp.1235-1244
• /
• 2010

최근 아이폰을 필두로 급부상하는 스마트폰의 정전기식 입력 장치에서는 펜 입력장치나 감압식 입력 장치를 위해 만들어진 제스처기반 인터페이스가 적합하지 않다. 손가락 튕김 인터페이스는 기존의 제스처기반 인터페이스에서 사용했던 플릭 제스처와 달리 명령을 적용시킬 대상과 명령을 동시에 선택함으로 작업 단계를 절반으로 감소시킬 수 있다. 뿐만 아니라, 멀티터치 인터페이스와 병합하여 사용함으로 다양한 메뉴 지원이 가능하여 복잡한 제스처를 학습할 필요가 없고, 정전기식 입력 장치 장치에 사용하기 적합하여 입력 오류를 최소화 시킨다. 본 연구에서는 정전기식 입력 장치를 가지는 스마트 폰 장치에서의 파일 관리를 빠르게 해주는 다중 손가락 튕김 인터페이스를 설계하고 구현한다. 실험에서는 사용자 평가를 통해 제안하는 인터페이스가 정전기식 입력 장치에서 기존 방식보다 유용함을 증명한다.

• 제어로봇시스템학회논문지
• /
• 제7권4호
• /
• pp.309-318
• /
• 2001

In this paper, we describe methods that analyze a human gesture. A human interface(HI) system for analyzing gesture extracts the head and hand regions after taking image sequence of and operators continuous behavior using CCD cameras. As gestures are accomplished with operators head and hands motion, we extract the head and hand regions to analyze gestures and calculate geometrical information of extracted skin regions. The analysis of head motion is possible by obtaining the face direction. We assume that head is ellipsoid with 3D coordinates to locate the face features likes eyes, nose and mouth on its surface. If was know the center of feature points, the angle of the center in the ellipsoid is the direction of the face. The hand region obtained from preprocessing is able to include hands as well as arms. For extracting only the hand region from preprocessing, we should find the wrist line to divide the hand and arm regions. After distinguishing the hand region by the wrist line, we model the hand region as an ellipse for the analysis of hand data. Also, the finger part is represented as a long and narrow shape. We extract hand information such as size, position, and shape.

• 한국방송∙미디어공학회:학술대회논문집
• /
• 한국방송공학회 2009년도 IWAIT
• /
• pp.664-667
• /
• 2009

There is strong demand to create wearable PC systems that can support the user outdoors. When we are outdoors, our movement makes it impossible to use traditional input devices such as keyboards and mice. We propose a hand gesture interface based on image processing to operate wearable PCs. The semi-transparent PC screen is displayed on the head mount display (HMD), and the user makes hand gestures to select icons on the screen. The user's hand is extracted from the images captured by a color camera mounted above the HMD. Since skin color can vary widely due to outdoor lighting effects, a key problem is accurately discrimination the hand from the background. The proposed method does not assume any fixed skin color space. First, the image is divided into blocks and blocks with similar average color are linked. Contiguous regions are then subjected to hand recognition. Blocks on the edges of the hand region are subdivided for more accurate finger discrimination. A change in hand shape is recognized as hand movement. Our current input interface associates a hand grasp with a mouse click. Tests on a prototype system confirm that the proposed method recognizes hand gestures accurately at high speed. We intend to develop a wider range of recognizable gestures.

• 로봇학회논문지
• /
• 제17권3호
• /
• pp.322-333
• /
• 2022

The Avatar robot, which is one of the teleoperation robots, aims to enable users to feel the robot as a part of the body to intuitively and naturally perform various tasks. Considering the purpose of the avatar robot, an end-effector identical to a human hand is advantageous, but a robotic hand with human hand level performance has not yet been developed. In this paper we propose a new 3-finger robotic hand with human-avatar hand posture mapping algorithm which were integrated with TOCABI-AVATAR, one of the teleoperation system. Due to the flexible rolling contact joints and tendon driven mechanism applied to the finger, the finger could implement adaptive grasping and absorb the impact force caused by unexpected contacts. In addition, human-avatar hand mapping algorithm using five calibration hand postures propose to compensate physical differences between operators. Using the TOCABI-AVATAR system with the robotic hands and mapping algorithm, the operator can perform 13 out of 16 hand postures of grasping taxonomy and 4 gestures. In addition, using the system, we participated in the ANA AVATAR XPRIZE Semi-final and successfully performed three scenarios which including various social interactions as well as object manipulation.

• 한국과학예술포럼
• /
• 제20권
• /
• pp.307-314
• /
• 2015

Tele-Gesture is a tangible user interface(TUI) device that allows a user to physically point to a 3D object in real life and have their gestures play back by a robotic finger that can point to the same object, either at the same time, or at another point in time. To understand the extent of the gestures as new way of digital collaborative communication, collaboration situation and types were experimented as TUI implementations. The design prototype reveals that there is a rich non-verbal component of communication in the form of gesture-clusters and body movements that happen in an digital communication. This result of analysis can contribute to compile relevant contributions to the fields of communication, human behavior, and interaction with high technology through an interpretive social experience.

• 인터넷정보학회논문지
• /
• 제17권2호
• /
• pp.29-37
• /
• 2016

인간은 의사소통을 통해서 상호관계를 유지시키고 발전시켜나간다. 의사소통은 크게 언어적 의사소통과 비언어적 의사소통으로 나뉜다. 언어적 의사소통은 말 또는 글을 사용하는 것이고 비언어적 의사소통은 몸동작으로 의사를 전달하는 것이다. 우리는 일상생활에서 대화를 할 때 말과 더불어 제스처를 함께 사용한다. 제스처는 비언어적 의사소통에 속하며, 다양한 형태와 움직임으로 의사를 전달할 수 있다. 이러한 이유로 제스처는 HCI 분야와 HRI 분야에서 NUI/NUX를 구현하기 위한 수단으로 각광받고 있다. 본 논문에서는 키넥트와 손의 기하학적인 특징을 사용하여 손 영역 검출과 손가락 개수를 인식하는 방법을 제안한다. 키넥트가 제공하는 깊이 영상을 이용하여 영상에서 손 영역을 검출하고 손의 윤곽선과 중점의 거리를 비교하여 손가락 개수를 파악한다. 본 논문에서 제안한 방법에 따른 손가락 개수 인식률은 평균 98.5%이고 수행시간은 0.065ms이다. 이 방법은 기존의 연구와 비교 했을 때, 인식 속도가 빠르며, 복잡도가 O(n),으로써 성능 또한 우수하다. 향후 이를 통해 제스처의 인식 가능한 범위를 증가시켜 보다 컴퓨터와 인간의 상호작용이 수월해지는데 도움이 될 것이다.

• Journal of Multimedia Information System
• /
• 제5권3호
• /
• pp.179-188
• /
• 2018

In order to overcome the problems of contact palmprint recognition, a non-contact palmprint recognition system is developed on personal computer (PC) platform. Three methods, namely "double-line-single-point" (DLSP), "double-assistant-crosshair" (DAC) and "none-assistant-graphic" (NAG), are implemented for the palmprint localization to solve the severe technical challenges, including the complex background, variant illuminations, uncontrollable locations and gestures of hands. In NAG, hand segmentation and the cropping of region of interest are performed without any assistant graphics. The convex hull contour of hand helps detect the outside contour of little finger as well as the valley bottom between thumb and index finger. The three methods of palmprint localization have good operating efficiency and can meet the performance requirements of real-time system. Furthermore, an attendance system on PC platform is designed and developed based on non-contact palmprint recognition.