• International Journal of Computer Science & Network Security
• /
• v.21 no.2
• /
• pp.110-119
• /
• 2021

The Coronavirus or COVID-19 is contagiousness virus that infected almost every single part of the world. This pandemic forced a major country did lockdown and stay at a home policy to reduce virus spread and the number of victims. Interactions between humans and robots form a popular subject of research worldwide. In medical robotics, the primary challenge is to implement natural interactions between robots and human users. Human communication consists of dynamic processes that involve joint attention and attracting each other. Coordinated care involves sharing among agents of behaviours, events, interests, and contexts in the world from time to time. The robotics arm is an expensive and complicated system because robot simulators are widely used instead of for rehabilitation purposes in medicine. Interaction in natural ways is necessary for disabled persons to work with the robot simulator. This article proposes a low-cost rehabilitation system by building an arm gesture tracking system based on a depth camera that can capture and interpret human gestures and use them as interactive commands for a robot simulator to perform specific tasks on the 3D block. The results show that the proposed system can help patients control the rotation and movement of the 3D arm using their hands. The pilot testing with healthy subjects yielded encouraging results. They could synchronize their actions with a 3D robotic arm to perform several repetitive tasks and exerting 19920 J of energy (kg.m².S^-2). The average of consumed energy mentioned before is in medium scale. Therefore, we relate this energy with rehabilitation performance as an initial stage and can be improved further with extra repetitive exercise to speed up the recovery process.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.14 no.4
• /
• pp.239-246
• /
• 2021

In the field of computer graphics and HCI, there are many studies on systems that create characters and interact naturally. Such studies have focused on the user's response to the user's behavior, and the study of the character's behavior to elicit positive emotions from the user remains a difficult problem. In this paper, we develop a prototype of an interaction system to elicit positive emotions from users according to the movement of virtual characters using artificial intelligence technology. The proposed system is divided into face recognition and motion generation of a virtual character. A depth camera is used for face recognition, and the recognized data is transferred to motion generation. We use imitation learning as a learning model. In motion generation, random actions are performed according to the first user's facial expression data, and actions that the user can elicit positive emotions are learned through continuous imitation learning.

• Journal of Broadcast Engineering
• /
• v.27 no.3
• /
• pp.351-360
• /
• 2022

Image blurring is a phenomenon that occurs due to factors such as movement of a subject and shaking of a camera. Recently, the research for image deblurring has been actively conducted based on convolution neural networks. In particular, the method of guiding the restoration process via the difference between blur and sharp images has shown the promising performance. This paper proposes a novel method for improving the deblurring performance based on the distortion information. To this end, the transformer-based neural network module is designed to guide the restoration process. The proposed method efficiently reflects the distorted region, which is predicted through the global inference during the deblurring process. We demonstrate the efficiency and robustness of the proposed module based on experimental results with various deblurring architectures and benchmark datasets.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.5
• /
• pp.221-228
• /
• 2022

With the application of artificial intelligence technology, robots can provide efficient services in real life. Unlike industrial manipulators that do simple repetitive work, this study presented design methods of 6 degree of freedom robot arm and intelligent object search and movement methods for use alone or in collaboration with no place restrictions in the service robot field and verified performance. Using a depth camera and deep learning in the ROS environment of the embedded board included in the robot arm, the robot arm detects objects and moves to the object area through inverse kinematics analysis. In addition, when contacting an object, it was possible to accurately hold and move the object through the analysis of the force sensor value. To verify the performance of the manufactured robot arm, experiments were conducted on accurate positioning of objects through deep learning and image processing, motor control, and object separation, and finally robot arm was tested to separate various cups commonly used in cafes to check whether they actually operate.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.5
• /
• pp.933-940
• /
• 2022

In this paper, the algorithm was developed to recognize hand 3D position through 2D image sensor and implemented a system to remotely control the 6 d.o.f. robot arm by using it. The system consists of a camera that acquires hand position in 2D, a computer that controls robot arm that performs movement by hand position recognition. The image sensor recognizes the specific color of the glove putting on operator's hand and outputs the recognized range and position by including the color area of the glove as a shape of rectangle. We recognize the velocity vector of end effector and control the robot arm by the output data of the position and size of the detected rectangle. Through the several experiments using developed 6 axis robot, it was confirmed that the 6 d.o.f. robot arm remote control was successfully performed.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.290-293
• /
• 2021

In this paper, we implement a learning efficiency verification system to inspire learning motivation and help improve concentration by detecting the situation of the user studying. To this aim, data on learning attitude and concentration are measured by extracting the movement of the user's face or body through a real-time camera. The Jetson board was used to implement the real-time embedded system, and a convolutional neural network (CNN) was implemented for image recognition. After detecting the feature part of the object using a CNN, motion detection is performed. The captured image is shown in a GUI written in PYQT5, and data is collected by sending push messages when each of the actions is obstructed. In addition, each function can be executed on the main screen made with the GUI, and functions such as a statistical graph that calculates the collected data, To do list, and white noise are performed. Through learning efficiency checking system, various functions including data collection and analysis of targets were provided to users.

• The Journal of Korean Institute of Next Generation Computing
• /
• v.13 no.5
• /
• pp.39-50
• /
• 2017

Moving object tracking techniques can be considered as one of the most essential technique in the video understanding of which the importance is much more emphasized recently. However, irregularity of light condition in the video, variations in shape and size of object, camera motion, and occlusion make it difficult to tracking moving object in the video. Swarm based methods are developed to improve the performance of Kalman filter and particle filter which are known as the most representative conventional methods, but these methods also need to consider dynamic property of moving object. This paper proposes adaptive parameter control method which can dynamically change weight value among parameters in particle swarm optimization. The proposed method classifies each particle to 3 groups, and assigns different weight values to improve object tracking performance. Experimental results show that our scheme shows considerable improvement of performance in tracking objects which have nonlinear movements such as occlusion or unexpected movement.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.10a
• /
• pp.35-40
• /
• 2021

People counting data is crucial for most business owners, since they can derive meaningful information about customers movement within their businesses. For example, owners of the supermarkets can increase or decrease the number of checkouts counters depending on number of occupants. Also, it has many applications in smart buildings, too. Where it can be used as a smart controller to control heating and cooling systems depending on a number of occupants in each room. There are advanced technologies like camera-based people counting system, which can give more accurate counting result. But they are expensive, hard to deploy and privacy invasive. In this paper, we propose a method and a hardware sensor for counting people passing through a passage or an entrance using IR Infrared sensors. Proposed sensor operates at low voltage, so low power consumption ensure long duration on batteries. Moreover, we propose a new method that distinguishes human body and other objects. Proposed method is inexpensive, easy to install and most importantly, it is real-time. The evaluation of our proposed method showed that when counting people passing one by one without overlapping, recall was 96% and when people carrying handbag like objects, the precision was 88%. Our proposed method outperforms IR Infrared based people counting systems in term of counting accuracy.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.3
• /
• pp.167-173
• /
• 2022

The size of the virtual reality market is growing every year, but cybersickness that occurs in virtual reality has not been resolved yet. In this paper, results were derived through experiments on the relationship between cybersickness and gaze guidance occurring in virtual reality contents. Using eye tracking technique, the relationship of gaze movement with cybersickness was identified. The experiment was divided into two groups to find out whether visual induction affects cyber sickness. In addition, the results were analyzed by dividing the two groups to check whether cyber sickness showed different results according to gender. We also analyzed using the SSQ questionnaire to measure cybersickness. We tried to understand the relationship between gaze guidance and cybersickness through two methods. As a result of the experiment, it was found that the induction of a clear gaze caused the concentration of the gaze, and it was effective in cybersickness through the rotation of the camera. In order to alleviate cyber sickness, it has been confirmed that concentrating one's eyes through gaze-guided production is effective for cyber sickness. It is hoped that this result will be used as a way to alleviate cyber sickness for producers who want to use virtual reality to produce content.

• Korean Journal of Environment and Ecology
• /
• v.37 no.6
• /
• pp.429-438
• /
• 2023

The forest in the lower Tumen River serves as an important ecosystem spanning the territories of North Korea, Russia, and China, and it provides habitat and movement corridors for diverse mammals, including the endangered Amur tiger (Panthera tigris) and Amur leopard (Panthera pardus). This study focuses on the Mijiang area, situated as a potential ecological corridor connecting North Korea and China in the lower Tumen River, playing a crucial role in conserving and restoring the biodiversity of the Korean Peninsula. This study aimed to identify mammal species and estimate their relative abundance, occupancy, and distribution based on the 48 camera traps installed in the Mijiang area from May 2019 to May 2021. The results confirmed the presence of 18 mammal species in the Mijiang area, including large carnivores like tigers and leopards. Among the dominant mammals, four species of ungulates showed high occupancy and detection rates, particularly the Roe deer (Capreolus pygargus) and Wild boar (Sus scrofa). The roe deer was distributed across all areas with a predicted high occupancy rate of 0.97, influenced by altitude, urban residential areas, and patch density. Wild boars showed a predicted occupancy rate of 0.73 and were distributed throughout the entire area, with factors such as wetland ratio, grazing intensity, and spatial heterogeneity in aspects of the landscape influencing their occupancy and detection rates. Sika deer (Cervus nippon) exhibited a predicted occupancy rate of 0.48, confined to specific areas, influenced by slope, habitat fragmentation diversity affecting detection rates, and the ratio of open forests impacting occupancy. Water deer (Hydropotes inermis) displayed a very low occupancy rate of 0.06 along the Tumen River Basin, with higher occupancy in lower altitude areas and increased detection in locations with high spatial heterogeneity in aspects. This study confirmed that the Mijiang area serves as a habitat supporting diverse mammals in the lower Tumen River while also playing a crucial role in facilitating animal movement and habitat connectivity. Additionally, the occupancy prediction model developed in this study is expected to contribute to predicting mammal distribution within the disrupted Tumen River basin due to human interference and identifying and protecting potential ecological corridors in this transboundary region.