• Journal of the Semiconductor & Display Technology
• /
• v.17 no.3
• /
• pp.113-116
• /
• 2018

This paper proposes a mobile image search system which uses a sensor information of smart phone, and enables running in a variety of environments, which is implemented on Android platform. The implemented system deals with a new image descriptor using combination of the visual feature (CEDD) with EXIF attributes in the target of JPEG image, and image matching scheme, which is optimized to the mobile platform. Experimental result shows that the proposed method exhibited a significant improved searching results of around 80% in precision in the large image database. Considering the performance such as processing time and precision, we think that the proposed method can be used in other application field.

• ETRI Journal
• /
• v.43 no.4
• /
• pp.617-629
• /
• 2021

Although the actual visual simultaneous localization and mapping (SLAM) algorithms provide highly accurate tracking and mapping, most algorithms are too heavy to run live on embedded devices. In addition, the maps they produce are often unsuitable for path planning. To mitigate these issues, we propose a completely closed-loop online dense RGB-D SLAM algorithm targeting autonomous indoor mobile robot navigation tasks. The proposed algorithm runs live on an NVIDIA Jetson board embedded on a two-wheel differential-drive robot. It exhibits lightweight three-dimensional mapping, room-scale consistency, accurate pose tracking, and robustness to moving objects. Further, we introduce a navigation strategy based on the proposed algorithm. Experimental results demonstrate the robustness of the proposed SLAM algorithm, its computational efficiency, and its benefits for on-the-fly navigation while mapping.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.179-188
• /
• 2024

Recently, unmanned terminals (kiosks) have greatly increased their scope of use by allowing orders or payments to be made efficiently while replacing existing manpower. With the acceleration of digital transformation, the rate of kiosk installations has soared, making it an important task to help all age groups easily use kiosks. In this study, based on the function of the game engine and Hand Tracking technology, we developed content that can conduct kiosk education in a virtual world. The goal of this content is to help users unfamiliar with kiosks confidently cope with real-world situations by experiencing visual and auditory stress caused by waiting guests in virtual reality. To this end, two VR contents were developed. One is a simple kiosk experience content, and the other is specialized content that causes visual and auditory stress. The experiment was divided into two groups: one group experienced general VR content, while the other group experienced specialized VR content. After the experience, both groups proceeded to place orders in an actual store. Survey results showed that 85% of the experimental group and 95% of the control group were satisfied with the training. This confirms that the specialized experience described in this paper is effective for kiosk education.

• The Journal of Korean Academy of Sensory Integration
• /
• v.21 no.3
• /
• pp.39-53
• /
• 2023

Objective : The purpose was the effect of sensory integration therapy combined with an eye tracker on the sensory processing and visual perception of children with developmental disabilities. Methods : It was a single-subject study with a multiple baseline design between subjects, and the intervention applied sensory integration therapy combined with an eye tracker. Visual-motor speed and saccadic eye movements were assessed at each session of baseline and intervention periods. As pre- and post-evaluation, sensory profile, Korean-Developmental Test of Visual Perception and Trail Making Test were conducted. The results of each session evaluation and pre- and post-evaluation researched the effectiveness of the intervention through visual analysis and trend line analysis. Results : As a result of the evaluation for each session, the slope of the trend line for all children in visual-motor speed and saccadic eye movement increased sharply during the intervention compared to the baseline. As a result of the pre- and post-evaluation, the sensory processing of movement, body position, and visual changed from more than that of peers to a level similar to that of peers. In visual perception, all children's ability of Visual Closure increased. As a result of Trail Making Test conducted to confirm the improvement of children's visual tracking and visual-motor abilities, all children showed a decrease in performance time after the test compared to before. Conclusion : It was confirmed that sensory integration therapy combined with an eye tracker for developmental disabilities has effect on sensory processing and visual perception. It is expected to play an important role clinically as it can stimulate children's interest and motivation in line with recent technological improvements and the spread of smart devices.

• Journal of Computing Science and Engineering
• /
• v.7 no.2
• /
• pp.122-131
• /
• 2013

The MPI CyberMotion Simulator provides a unique motion platform, as it features an anthropomorphic robot with a large workspace, combined with an actuated cabin and a linear track for lateral movement. This paper introduces the simulator as a tool for studying human perception, and compares its characteristics to conventional Stewart platforms. Furthermore, an experimental evaluation is presented in which multimodal human control behavior is studied by identifying the visual and vestibular responses of participants in a roll-lateral helicopter hover task. The results show that the simulator motion allows participants to increase tracking performance by changing their control strategy, shifting from reliance on visual error perception to reliance on simulator motion cues. The MPI CyberMotion Simulator has proven to be a state-of-the-art motion simulator for psychophysical research to study humans with various experimental paradigms, ranging from passive perception experiments to active control tasks, such as driving a car or flying a helicopter.

• Proceedings of the Korean Society of Laser Processing Conference
• /
• 2005.06a
• /
• pp.3-8
• /
• 2005

The robot systems are widely used in the welding manufacturing. The essential tasks to operate the welding robot are the acquisition of the position and/or shape of the parent metal. For the seam tracking or the robot automation, many kinds of contact and non-contact of the system which monitors the shape of the welding part is described. This system uses the line-type structured laser diode and the visual sensor. It includes the correction of radial distortion which is often found in the image from the camera with short focal length. Direct Linear Transformation (DLT) is used for the camera calibration. The three dimensional shape of the parent metal is obtained after simple linear transformation. Therefore, the system operates in real time. Some experiments are carried out to evaluate the performance of the developed system.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.11a
• /
• pp.134-137
• /
• 2017

Follow-me function of drones is new and attractive for selfie drone users, where the drone autonomously follows and capture the user. Currently the products use the difference between GPS's in the drone and user side mobile GCS, but the targeting accuracy is not satisfactory owing to the low accuracy of GPS data, often the order of ten meters. We designed a new follow-me mode algorithm that utilizes the accuracy of visual tracking algorithm and the reliability of GPS-based. The experiment shows that proposed follow-me can capture much accurately the target user in the center of video content than GPS-only methods, and recover the vision algorithm failure quickly in 5-10 seconds.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.14 no.1
• /
• pp.8-16
• /
• 2014

We consider the visual barcode recognition problem in a noisy video data setup. Unlike most existing single-frame recognizers that require considerable user effort to acquire clean, motionless and blur-free barcode signals, we eliminate such extra human efforts by proposing a robust video-based barcode recognition algorithm. We deal with a sequence of noisy blurred barcode image frames by posing it as an online filtering problem. In the proposed dynamic recognition model, at each frame we infer the blur level of the frame as well as the digit class label. In contrast to a frame-by-frame based approach with heuristic majority voting scheme, the class labels and frame-wise noise levels are propagated along the frame sequences in our model, and hence we exploit all cues from noisy frames that are potentially useful for predicting the barcode label in a probabilistically reasonable sense. We also suggest a visual barcode tracking approach that efficiently localizes barcode areas in video frames. The effectiveness of the proposed approaches is demonstrated empirically on both synthetic and real data setup.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2014.01a
• /
• pp.149-151
• /
• 2014

주의(attention)를 어떻게 할당하는가는 정신물리학뿐만 아니라, 컴퓨터 시각과정을 모델링하는데 중요한 주제 중 하나이다. 기존 연구는 saliency와 같은 활성화 값에 의해서 주의탐사 순위가 결정된다. 본 논문에서는 주의탐사과정을 병렬처리를 통한 활성화 값 추출과정과 순차적 처리를 통한 공간적 전략과정으로 구분하였다. 단서패러다임에 기초한 계산모형을 이용하여, 실제 인간의 수행결과를 AUC와 Levenshtein 척도를 이용하여 비교하였다. Fixation point 비교에서는 인간과 활성화를 기반으로 한 계산모형의 수행은 높은 상관성을 가지고 있었다. 주의궤적 혹은 scanpath 분석에서는 활성화기반 전략보다는 공간적 전략 모형이 더 높은 유사성을 보였다. 이는 주의탐사과정이 병렬처리과정을 통해 얻어진 saliency에 의해서만 결정되는 것이 아니라, 목표물간의 근접성 등의 공간적 전략을 통해 순차적 (sequential) 경로가 생성됨을 의미한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.07a
• /
• pp.105-106
• /
• 2012

일반적으로 CG 합성이라 하면 '자연스러운' 것을 잘된 CG영상이라고 한다. 이 때 촬영된 영상이 정지화면 일 수 만은 없다. 카메라가 움직이는 영상에서는 CG합성도 실사카메라 무빙에 맞게 정확한 정합이 되어야 자연스러운 영상이 된다. 이를 위해 합성단계에서 작업할 때 3D 카메라 트래킹 기술이 필요하다. 카메라트래킹은 촬영된 실사영상만으로 카메라의 3차원 이동정보와 광학적 파라미터 등 촬영시의 3차원 공간을 복원하는 과정을 포함하고 있다. 이 과정에서 카메라 트래킹에 대한 오류의 발생으로 실사와 CG의 합성에 대한 생산성에 많은 문제점을 가지고 있다. 본 논문에서는 이러한 문제를 해결하기 위하여 소프트웨어에서 트래킹데이터를 보정하는 방법을 제안한다.