• Title/Summary/Keyword: Motion based interface

Search Result 309, Processing Time 0.03 seconds

Implementation of hand motion recognition-based rock-paper-scissors game using ResNet50 transfer learning (ResNet50 전이학습을 활용한 손동작 인식 기반 가위바위보 게임 구현)

  • Park, Changjoon;Kim, Changki;Son, Seongkyu;Lee, Kyoungjin;Yoo, Heekyung;Gwak, Jeonghwan
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.01a
    • /
    • pp.77-82
    • /
    • 2022
  • GUI(Graphical User Interface)를 대신하는 차세대 인터페이스로서 NUI(Natural User Interace)에 기대가 모이는 것은 자연스러운 흐름이다. 본 연구는 NUI의 손가락 관절을 포함한 손동작 전체를 인식시키기 위해 웹캠과 카메라를 활용하여 다양한 배경과 각도의 손동작 데이터를 수집한다. 수집된 데이터는 전처리를 거쳐 데이터셋을 구축하며, ResNet50 모델을 활용하여 전이학습한 합성곱 신경망(Convolutional Neural Network) 알고리즘 분류기를 설계한다. 구축한 데이터셋을 입력시켜 분류학습 및 예측을 진행하며, 실시간 영상에서 인식되는 손동작을 설계한 모델에 입력시켜 나온 결과를 통해 가위바위보 게임을 구현한다.

  • PDF

Improved prediction of soil liquefaction susceptibility using ensemble learning algorithms

  • Satyam Tiwari;Sarat K. Das;Madhumita Mohanty;Prakhar
    • Geomechanics and Engineering
    • /
    • v.37 no.5
    • /
    • pp.475-498
    • /
    • 2024
  • The prediction of the susceptibility of soil to liquefaction using a limited set of parameters, particularly when dealing with highly unbalanced databases is a challenging problem. The current study focuses on different ensemble learning classification algorithms using highly unbalanced databases of results from in-situ tests; standard penetration test (SPT), shear wave velocity (Vs) test, and cone penetration test (CPT). The input parameters for these datasets consist of earthquake intensity parameters, strong ground motion parameters, and in-situ soil testing parameters. liquefaction index serving as the binary output parameter. After a rigorous comparison with existing literature, extreme gradient boosting (XGBoost), bagging, and random forest (RF) emerge as the most efficient models for liquefaction instance classification across different datasets. Notably, for SPT and Vs-based models, XGBoost exhibits superior performance, followed by Light gradient boosting machine (LightGBM) and Bagging, while for CPT-based models, Bagging ranks highest, followed by Gradient boosting and random forest, with CPT-based models demonstrating lower Gmean(error), rendering them preferable for soil liquefaction susceptibility prediction. Key parameters influencing model performance include internal friction angle of soil (ϕ) and percentage of fines less than 75 µ (F75) for SPT and Vs data and normalized average cone tip resistance (qc) and peak horizontal ground acceleration (amax) for CPT data. It was also observed that the addition of Vs measurement to SPT data increased the efficiency of the prediction in comparison to only SPT data. Furthermore, to enhance usability, a graphical user interface (GUI) for seamless classification operations based on provided input parameters was proposed.

Development of an Intrinsic Continuum Robot and Attitude Estimation of Its End-effector Based on a Kalman Filter (내부형 연속체로봇 개발 및 칼만필터를 이용한 말단장치 자세추정)

  • Kang, Chang Hyun;Bae, Ji Hwan;Kang, Bong Soo
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.39 no.4
    • /
    • pp.361-367
    • /
    • 2015
  • This paper presents the design concept of an intrinsic continuum robot for safe man-machine interface and characteristic behaviors of its end-effector based on real experiments. Since pneumatic artificial muscles having similar antagonistic actuation to human muscles are used for main backbones of the proposed robot as well as in the role of the actuating devices, variable stiffness of robotic joints can be available in the actual environment. In order to solve the inherent shortcoming of an intrinsic continuum robot due to bending motion of the backbone materials, a Kalman filter scheme based on a triaxial accelerometer and a triaxial gyroscope was proposed to conduct an attitude estimation of the end-effector of the robot. The experimental results verified that the proposed method was effective in estimating the attitude of the end-effector of the intrinsic continuum robot.

A Study on Development of Wearable Technology Based Biker Suits Part.1 (이륜차운전자를 위한 웨어러블 테크놀로지 의류 개발에 관한 연구 제1보)

  • Lee, Hyun-Seung;Lee, Jae-Jung
    • Journal of the Korean Society of Costume
    • /
    • v.61 no.8
    • /
    • pp.57-72
    • /
    • 2011
  • The purpose of this research is to develop a safe and convenient wearable technology wear for bikers. For this, we studied the current usage of two-wheeled vehicles and have also researched the rate of accidents and its causes. We then used them along with previous studies in terms of visual perception as factors to decide the crucial elements of the riders' apparel. Case studies and the break down for the established prototypes for bikers were practiced as well. Based on this process, a survey was conducted to find out the needs of the bikers in the areas of both apparel and technology and then proceeded to produce the appropriate design and device modules. In the apparel sector, the result of the survey indicated that it was considerable that any digital devices were not shown to sustain a natural visible look. It also was essential that the materials were durable and made for safety and easy movement. In the digital function sector, it was significant that a motion input interface which will be embedded into the wear was needed to avoid any dangerous situations. This would ensure the safety of not only the rider but the surrounding riders as well. Lastly, protecting the rider's skin from any harmful elements was regarded necessary as well. Based on these requirements, a new prototype was created and will be tested if the requirements stated above are all met and will be evaluated according to the effectiveness of its functions.

Experimental Study the on Hysteretic Characteristics of Rotational Friction Energy Dissipative Devices (회전 마찰형 제진장치의 이력특성에 대한 실험적 연구)

  • Park, Jin-Young;Han, Sang Whan;Moon, Ki-Hoon;Lee, Kang Seok;Kim, Hyung-Joon
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.17 no.5
    • /
    • pp.227-235
    • /
    • 2013
  • Friction energy dissipative devices have been increasingly implemented as structural seismic damage protecting systems due to their excellent seismic energy dissipating capacity and high stiffness. This study develops rotational friction energy dissipative devices and verifies experimentally their cyclic response. Based on the understanding of the differences between the traditional linear-motion friction behavior and the rotational friction behavior, the configuration of the frictional surface was determined by investigating the characteristics of the micro-friction behavior. The friction surface suggested in this paper consists of brake-lining pads and stainless steel sheets and is normally stressed by high-strength bolts. Based upon these frictional characteristics of the selected interface, the rotational friction energy dissipative devices were developed. Bolt torque-bearing force tests, rotational friction tests of the suggested friction interfaces were carried out to identify their frictional behavior. Test results show that the bearing force is almost linearly proportional to the applied bolt torque and presents stable cyclic response regardless of the experimental parameters selected this testing program. Finally, cyclic tests of the rotational friction energy dissipative devices were performed to find out their structural characteristics and to confirm their stable cyclic response. The developed friction energy dissipative devices present very stable cyclic response and meet the requirements for displacement-dependent energy dissipative devices prescribed in ASCE/SEI 7-10.

Visual Multi-touch Input Device Using Vision Camera (비젼 카메라를 이용한 멀티 터치 입력 장치)

  • Seo, Hyo-Dong;Joo, Young-Hoon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.6
    • /
    • pp.718-723
    • /
    • 2011
  • In this paper, we propose a visual multi-touch air input device using vision cameras. The implemented device provides a barehanded interface which copes with the multi-touch operation. The proposed device is easy to apply to the real-time systems because of its low computational load and is cheaper than the existing methods using glove data or 3-dimensional data because any additional equipment is not required. To do this, first, we propose an image processing algorithm based on the HSV color model and the labeling from obtained images. Also, to improve the accuracy of the recognition of hand gestures, we propose a motion recognition algorithm based on the geometric feature points, the skeleton model, and the Kalman filter. Finally, the experiments show that the proposed device is applicable to remote controllers for video games, smart TVs and any computer applications.

Realistic 3D Scene Reconstruction from an Image Sequence (연속적인 이미지를 이용한 3차원 장면의 사실적인 복원)

  • Jun, Hee-Sung
    • The KIPS Transactions:PartB
    • /
    • v.17B no.3
    • /
    • pp.183-188
    • /
    • 2010
  • A factorization-based 3D reconstruction system is realized to recover 3D scene from an image sequence. The image sequence is captured from uncalibrated perspective camera from several views. Many matched feature points over all images are obtained by feature tracking method. Then, these data are supplied to the 3D reconstruction module to obtain the projective reconstruction. Projective reconstruction is converted to Euclidean reconstruction by enforcing several metric constraints. After many triangular meshes are obtained, realistic reconstruction of 3D models are finished by texture mapping. The developed system is implemented in C++, and Qt library is used to implement the system user interface. OpenGL graphics library is used to realize the texture mapping routine and the model visualization program. Experimental results using synthetic and real image data are included to demonstrate the effectiveness of the developed system.

Robust Hand Region Extraction Using a Joint-based Model (관절 기반의 모델을 활용한 강인한 손 영역 추출)

  • Jang, Seok-Woo;Kim, Sul-Ho;Kim, Gye-Young
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.9
    • /
    • pp.525-531
    • /
    • 2019
  • Efforts to utilize human gestures to effectively implement a more natural and interactive interface between humans and computers have been ongoing in recent years. In this paper, we propose a new algorithm that accepts consecutive three-dimensional (3D) depth images, defines a hand model, and robustly extracts the human hand region based on six palm joints and 15 finger joints. Then, the 3D depth images are adaptively binarized to exclude non-interest areas, such as the background, and accurately extracts only the hand of the person, which is the area of interest. Experimental results show that the presented algorithm detects only the human hand region 2.4% more accurately than the existing method. The hand region extraction algorithm proposed in this paper is expected to be useful in various practical applications related to computer vision and image processing, such as gesture recognition, virtual reality implementation, 3D motion games, and sign recognition.

Ergonomic Evaluation of Refrigerator Design (냉장고 디자인의 인간공학적 평가)

  • 박재희;황민철;박세진;김명석
    • Archives of design research
    • /
    • v.14
    • /
    • pp.1-7
    • /
    • 1996
  • Designers often hesitate to decide the shape, size, and layout of a product. Though ergonomic principles and data are absolutely needed in this process, they don have enough guidelines to refer. For the refrigerator designers, they also are not convinced of their decision: the vertical position of the freezing and refrigerating rooms, the height of shelves, the shape of door-handle, etc. To support the refrigerator design, we applied several ergonomic methods to the evaluation of refrigerator. EMG was measured to evaluate the load of users lumbar muscle. Based upon the experimental EMG data, we developed a model to estimate the relative load corresponding to the height of refrigerator shelves. Two different layouts of a refrigerator, R/F and F/R styles, were compared with the model. A three-dimensional motion analysis method was used to evaluate the users motion of using a refrigerator. Ten door-handles with the different shapes and positions were evaluated by tracking the rotations of the users arm. Video protocol analysis was used to evaluate the user interface of a control panel in a refrigerator. Finally, we suggested several ergonomic design guidelines based on the facts found in this research and the anthropometric data of the Korean adults. The results of this study can be applied to the ergonomic design of refrigerators

  • PDF

Online Monitoring System based notifications on Mobile devices with Kinect V2 (키넥트와 모바일 장치 알림 기반 온라인 모니터링 시스템)

  • Niyonsaba, Eric;Jang, Jong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.6
    • /
    • pp.1183-1188
    • /
    • 2016
  • Kinect sensor version 2 is a kind of camera released by Microsoft as a computer vision and a natural user interface for game consoles like Xbox one. It allows acquiring color images, depth images, audio input and skeletal data with a high frame rate. In this paper, using depth image, we present a surveillance system of a certain area within Kinect's field of view. With computer vision library(Emgu CV), if an object is detected in the target area, it is tracked and kinect camera takes RGB image to send it in database server. Therefore, a mobile application on android platform was developed in order to notify the user that Kinect has sensed strange motion in the target region and display the RGB image of the scene. User gets the notification in real-time to react in the best way in the case of valuable things in monitored area or other cases related to a reserved zone.