• Title/Summary/Keyword: Cooperative robot

Search Result 169, Processing Time 0.029 seconds

Accelerometer-based Gesture Recognition for Robot Interface (로봇 인터페이스 활용을 위한 가속도 센서 기반 제스처 인식)

  • Jang, Min-Su;Cho, Yong-Suk;Kim, Jae-Hong;Sohn, Joo-Chan
    • Journal of Intelligence and Information Systems
    • /
    • v.17 no.1
    • /
    • pp.53-69
    • /
    • 2011
  • Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

The Technique of Human tracking using ultrasonic sensor for Human Tracking of Cooperation robot based Mobile Platform (모바일 플랫폼 기반 협동로봇의 사용자 추종을 위한 초음파 센서 활용 기법)

  • Yum, Seung-Ho;Eom, Su-Hong;Lee, Eung-Hyuk
    • Journal of IKEEE
    • /
    • v.24 no.2
    • /
    • pp.638-648
    • /
    • 2020
  • Currently, the method of user-follwoing in intelligent cooperative robots usually based in vision system and using Lidar is common and have excellent performance. But in the closed space of Corona 19, which spread worldwide in 2020, robots for cooperation with medical staff were insignificant. This is because Medical staff are all wearing protective clothing to prevent virus infection, which is not easy to apply with existing research techniques. Therefore, in order to solve these problems in this paper, the ultrasonic sensor is separated from the transmitting and receiving parts, and based on this, this paper propose that estimating the user's position and can actively follow and cooperate with people. However, the ultrasonic sensors were partially applied by improving the Median filter in order to reduce the error caused by the short circuit in communication between hard reflection and the number of light reflections, and the operation technology was improved by applying the curvature trajectory for smooth operation in a small area. Median filter reduced the error of degree and distance by 70%, vehicle running stability was verified through the training course such as 'S' and '8' in the result.

Analysis of Remote Driving Simulation Performance for Low-speed Mobile Robot under V2N Network Delay Environment (V2N 네트워크 지연 환경에서 저속 이동 로봇 원격주행 모의실험을 통한 성능 분석)

  • Song, Yooseung;Min, Kyoung-wook;Choi, Jeong Dan
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.3
    • /
    • pp.18-29
    • /
    • 2022
  • Recently, cooperative intelligent transport systems (C-ITS) testbeds have been deployed in great numbers, and advanced autonomous driving research using V2X communication technology has been conducted actively worldwide. In particular, the broadcasting services in their beginning days, giving warning messages, basic safety messages, traffic information, etc., gradually developed into advanced network services, such as platooning, remote driving, and sensor sharing, that need to perform real-time. In addition, technologies improving these advanced network services' throughput and latency are being developed on many fronts to support these services. Notably, this research analyzed the network latency requirements of the advanced network services to develop a remote driving service for the droid type low-speed robot based on the 3GPP C-V2X communication technology. Subsequently, this remote driving service's performance was evaluated using system modeling (that included the operator behavior) and simulation. This evaluation showed that a respective core and access network latency of less than 30 ms was required to meet more than 90 % of the remote driving service's performance requirements under the given test conditions.

A Hazardous Substance Monitoring Sensor Network Using Multiple Robot Vehicle (다수의 무인기를 이용한 유해 물질 감시 센서 네트워크)

  • Chun, Jeongmyong;Kim, Samok;Lee, Sanghu;Yoon, Seokhoon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.15 no.1
    • /
    • pp.147-155
    • /
    • 2015
  • In this paper, we consider a mobile sensor network for monitoring a polluted area where human beings cannot access. Due to the limited sensing range of individual unmanned vehicles, they need to cooperate to achieve an effective sensing coverage and move to a more polluted region. In order to address the limitations of sensing and communication ranges, we propose a hazardous substance monitoring network based on virtual force algorithms, and develop a testbed. In the considered monitoring network, each unmanned vehicle achieves an optimal coverage and move to the highest interest area based on neighboring nodes sensing values and locations. By using experiments based on the developed testbed, we show that the proposed monitoring network can autonomously move toward a more polluted area and obtain a high weighted coverage.

Development of Magnet Position Device for Outdoor Magnet Guidance Vehicle (실외 자기유도 무인운반차를 위한 자기 위치측정 장치 개발)

  • Cho, Hyunhak;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.3
    • /
    • pp.259-264
    • /
    • 2014
  • This paper is research paper on the MPD(Magnet Position Device) for the outdoor MGV(Magnet /Magnet Gyro Guidance Vehicle). Usually, MGV is used in indoor environment because of a measurement height of the magnet position device. CMPD(Commercial magnet position device) has 30 mm measurement height, so this is suitable structure in indoor environment like to a flat surface. Outdoor environment is an uneven and irregular, So Outdoor MGV must has a suspension. But CMPD is unsuitable for outdoor environment because of a collision with a surface caused by suspension. Thus, measurement height of the outdoor MPD is positively necessary more than 100 mm. So, we suggest the outdoor MPD using analog magnet hall sensor, moving average filter and Characteristic(rate of the magnet hall sensor) function of the localization. Result of the experiments, the proposed Magnet Position Device for the outdoor MGV has localization accuracy 4.31 mm, measurement height 150 mm and width 150 mm and is efficient more than CMPD.

Magnetic Guidance Vehicle using Up-and-down Rotating Type Differential Drive Unit (상하 회전형 차동 구동부를 이용한 자기 유도 무인운반차)

  • Song, Hajun;Cho, Hyunhak;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.2
    • /
    • pp.123-128
    • /
    • 2014
  • This paper presents the study about MGV(Magnetic guidance vehicle) with up-and-down rotating type differential drive unit. Previous MGV needs the landmarks to get the driving information and additional sensor to recognize the landmarks except for localization sensor. Previous MGV requires at least 2 drive units when common fixed differential drive unit is used because it occurs the problems with driving control and localization error from imbalance of the MGV's weight. To solve such problems, we propose the MGV using up-and-down rotating type differential drive unit. Proposed MGV recognizes the driving information from the pattern which is consisted of both pole of magnet without landmarks and additional sensors, and it control the backward movement using up-and-down rotating type differential drive unit instead of common drive units. Proposed MGV considers KF(Kalman filter) to improve the localization accuracy. To verify the performance of proposed method, we designed MGV for the experiment. As the results, we can confirm the performance of propoesed method to recognize the pattern and to control the backward movement. With respect to localization, proposed method has the less RMSE about 5.6904 mm than previous method.

Performance Improvement of Stereo Matching by Image Segmentation based on Color and Multi-threshold (컬러와 다중 임계값 기반 영상 분할 기법을 통한 스테레오 매칭의 성능 향상)

  • Kim, Eun Kyeong;Cho, Hyunhak;Jang, Eunseok;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.26 no.1
    • /
    • pp.44-49
    • /
    • 2016
  • This paper proposed the method to improve performance of a pixel, which has low accuracy, by applying image segmentation methods based on color and multi-threshold of brightness. Stereo matching is the process to find the corresponding point on the right image with the point on the left image. For this process, distance(depth) information in stereo images is calculated. However, in the case of a region which has textureless, stereo matching has low accuracy and bad pixels occur on the disparity map. In the proposed method, the relationship between adjacent pixels is considered for compensating bad pixels. Generally, the object has similar color and brightness. Therefore, by considering the relationship between regions based on segmented regions by means of color and multi-threshold of brightness respectively, the region which is considered as parts of same object is re-segmented. According to relationship information of segmented sets of pixels, bad pixels in the disparity map are compensated efficiently. By applying the proposed method, the results show a decrease of nearly 28% in the number of bad pixels of the image applied the method which is established.

Improvement of Disparity Map using Loopy Belief Propagation based on Color and Edge (Disparity 보정을 위한 컬러와 윤곽선 기반 루피 신뢰도 전파 기법)

  • Kim, Eun Kyeong;Cho, Hyunhak;Lee, Hansoo;Wibowo, Suryo Adhi;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.25 no.5
    • /
    • pp.502-508
    • /
    • 2015
  • Stereo images have an advantage of calculating depth(distance) values which can not analyze from 2-D images. However, depth information obtained by stereo images has due to following reasons: it can be obtained by computation process; mismatching occurs when stereo matching is processing in occlusion which has an effect on accuracy of calculating depth information. Also, if global method is used for stereo matching, it needs a lot of computation. Therefore, this paper proposes the method obtaining disparity map which can reduce computation time and has higher accuracy than established method. Edge extraction which is image segmentation based on feature is used for improving accuracy and reducing computation time. Color K-Means method which is image segmentation based on color estimates correlation of objects in an image. And it extracts region of interest for applying Loopy Belief Propagation(LBP). For this, disparity map can be compensated by considering correlation of objects in the image. And it can reduce computation time because of calculating region of interest not all pixels. As a result, disparity map has more accurate and the proposed method reduces computation time.

Grading meat quality of Hanwoo based on SFTA and AdaBoost (SFTA와 AdaBoost 기반 한우의 육질 등급 분석)

  • Cho, Hyunhak;Kim, Eun Kyeong;Jang, Eunseok;Kim, Kwang Baek;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.26 no.6
    • /
    • pp.433-438
    • /
    • 2016
  • This paper proposes a grade prediction method to measure meat quality in Hanwoo (Korean Native Cattle) using classification and feature extraction algorithms. The applied classification algorithm is an AdaBoost and the texture features of the given ultrasound images are extracted using SFTA. In this paper, as an initial phase, we selected ultrasound images of Hanwoo for verifying experimental results; however, we ultimately aimed to develop a diagnostic decision support system for human body scan using ultrasound images. The advantages of using ultrasound images of Hanwoo are: accurate grade prediction without butchery, optimizing shipping and feeding schedule and economic benefits. Researches on grade prediction using biometric data such as ultrasound images have been studied in countries like USA, Japan, and Korea. Studies have been based on accurate prediction method of different images obtained from different machines. However, the prediction accuracy is low. Therefore, we proposed a prediction method of meat quality. From the experimental results compared with that of the real grades, the experimental results demonstrated that the proposed method is superior to the other methods.