• Title/Summary/Keyword: human-machine communication

Search Result 221, Processing Time 0.02 seconds

A Study on Environmental Micro-Dust Level Detection and Remote Monitoring of Outdoor Facilities

  • Kim, Seung Kyun;Mariappan, Vinayagam;Cha, Jae Sang
    • International journal of advanced smart convergence
    • /
    • v.9 no.1
    • /
    • pp.63-69
    • /
    • 2020
  • The rapid development in modern industrialization pollutant the water and atmospheric air across the globe that have a major impact on the human and livings health. In worldwide, every country government increasing the importance to improve the outdoor air pollution monitoring and control to provide quality of life and prevent the citizens and livings life from hazard disease. We proposed the environmental dust level detection method for outdoor facilities using sensor fusion technology to measure precise micro-dust level and monitor in realtime. In this proposed approach use the camera sensor and commercial dust level sensor data to predict the micro-dust level with data fusion method. The camera sensor based dust level detection uses the optical flow based machine learning method to detect the dust level and then fused with commercial dust level sensor data to predict the precise micro-dust level of the outdoor facilities and send the dust level informations to the outdoor air pollution monitoring system. The proposed method implemented on raspberry pi based open-source hardware with Internet-of-Things (IoT) framework and evaluated the performance of the system in realtime. The experimental results confirm that the proposed micro-dust level detection is precise and reliable in sensing the air dust and pollution, which helps to indicate the change in the air pollution more precisely than the commercial sensor based method in some extent.

Modeling and Simulation of HMI Behaviors of 3D Virtual Products using XML (XML을 이용한 3D 가상 제품의 HMI 행동양태 모델링과 시뮬레이션 방안)

  • Jung, Ho-Kyun;Park, Hyungjun
    • Korean Journal of Computational Design and Engineering
    • /
    • v.20 no.1
    • /
    • pp.75-83
    • /
    • 2015
  • In the virtual prototyping (VP) of digital products, it is important to provide the people involved in product development with the visualization and interaction of the products, and the simulation of their human machine interaction (HMI) behaviors in interactive 3D virtual environments. Especially, for the HMI behavior simulation, it is necessary to represent them properly and to play them back effectively according to user interaction in the virtual environments. In a conventional approach to HMI behavior simulation, user interface (UI) designers use UI design software tools to generate the HMI behavior of a digital product of interest. Due to lack of reusability of the HMI behavior, VP developers need to analyze and integrate it into a VP system for its simulation in a 3D virtual environment. As this approach hinders the effective communication between the UI designers and the VP developers, it is easy to create errors and thereby it takes significant time and effort especially when it is required to represent the HMI behavior to the finest level of detail. In order to overcome the shortcomings of the conventional approach, we propose an approach for representing the HMI behavior of a digital product using XML (eXtensible Markup Language) and for reusing it to perform the HMI behavior simulation in 3D virtual environments. Based on the approach, a VP system has been developed and applied for the design evaluation of various products. A case study about the design evaluation is given to show the usefulness of the proposed approach.

Changes in the Industrial Structure caused by the IoT and AI (사물인터넷과 AI가 가져올 산업구조의 변화)

  • Kim, Jang-Hwan
    • Convergence Security Journal
    • /
    • v.17 no.5
    • /
    • pp.93-99
    • /
    • 2017
  • Recently IoT(Internet of Things) service industry has grown very rapidly. In this paper, we investigated the changes in IoT service industry as well as new direction of human life in future global society. Under these changing market conditions, competition has been also changed into global and ecological competition. But compared to the platform initiatives and ecological strategies of global companies, Korean companies' vision of building ecosystems is still unclear. In addition, there is a need of internetworking between mobile and IoT services. IoT security Protocol has weakness of leaking out information from Gateway which connected wire and wireless communication. As such, we investigate the structure of IoT and AI service ecosystem in order to gain strategic implications and insights for the security industry in this paper.

Development of Squat Posture Guidance System Using Kinect and Wii Balance Board

  • Oh, SeungJun;Kim, Dong Keun
    • Journal of information and communication convergence engineering
    • /
    • v.17 no.1
    • /
    • pp.74-83
    • /
    • 2019
  • This study designs a squat posture recognition system that can provide correct squat posture guidelines. This system comprises two modules: a Kinect camera for monitoring users' body movements and a Wii Balance Board(WBB) for measuring balanced postures with legs. Squat posture recognition involves two states: "Stand" and "Squat." Further, each state is divided into two postures: correct and incorrect. The incorrect postures of the Stand and Squat states were classified into three and two different types of postures, respectively. The factors that determine whether a posture is incorrect or correct include the difference between shoulder width and ankle width, knee angle, and coordinate of center of pressure(CoP). An expert and 10 participants participated in experiments, and the three factors used to determine the posture were measured using both Kinect and WBB. The acquired data from each device show that the expert's posture is more stable than that of the subjects. This data was classified using a support vector machine (SVM) and $na{\ddot{i}}ve$ Bayes classifier. The classification results showed that the accuracy achieved using the SVM and $na{\ddot{i}}ve$ Bayes classifier was 95.61% and 81.82%, respectively. Therefore, the developed system that used Kinect and WBB could classify correct and incorrect postures with high accuracy. Unlike in other studies, we obtained the spatial coordinates using Kinect and measured the length of the body. The balance of the body was measured using CoP coordinates obtained from the WBB, and meaningful results were obtained from the measured values. Finally, the developed system can help people analyze the squat posture easily and conveniently anywhere and can help present correct squat posture guidelines. By using this system, users can easily analyze the squat posture in daily life and suggest safe and accurate postures.

Design and Implementation of A Smart Crosswalk System based on Vehicle Detection and Speed Estimation using Deep Learning on Edge Devices (엣지 디바이스에서의 딥러닝 기반 차량 인식 및 속도 추정을 통한 스마트 횡단보도 시스템의 설계 및 구현)

  • Jang, Sun-Hye;Cho, Hee-Eun;Jeong, Jin-Woo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.4
    • /
    • pp.467-473
    • /
    • 2020
  • Recently, the number of traffic accidents has also increased with the increase in the penetration rate of cars in Korea. In particular, not only inter-vehicle accidents but also human accidents near crosswalks are increasing, so that more attention to traffic safety around crosswalks are required. In this paper, we propose a system for predicting the safety level around the crosswalk by recognizing an approaching vehicle and estimating the speed of the vehicle using NVIDIA Jetson Nano-class edge devices. To this end, various machine learning models are trained with the information obtained from deep learning-based vehicle detection to predict the degree of risk according to the speed of an approaching vehicle. Finally, based on experiments using actual driving images and web simulation, the performance and the feasibility of the proposed system are validated.

Calculating Data and Artificial Neural Network Capability (데이터와 인공신경망 능력 계산)

  • Yi, Dokkyun;Park, Jieun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.1
    • /
    • pp.49-57
    • /
    • 2022
  • Recently, various uses of artificial intelligence have been made possible through the deep artificial neural network structure of machine learning, demonstrating human-like capabilities. Unfortunately, the deep structure of the artificial neural network has not yet been accurately interpreted. This part is acting as anxiety and rejection of artificial intelligence. Among these problems, we solve the capability part of artificial neural networks. Calculate the size of the artificial neural network structure and calculate the size of data that the artificial neural network can process. The calculation method uses the group method used in mathematics to calculate the size of data and artificial neural networks using an order that can know the structure and size of the group. Through this, it is possible to know the capabilities of artificial neural networks, and to relieve anxiety about artificial intelligence. The size of the data and the deep artificial neural network are calculated and verified through numerical experiments.

Emotion Recognition Implementation with Multimodalities of Face, Voice and EEG

  • Udurume, Miracle;Caliwag, Angela;Lim, Wansu;Kim, Gwigon
    • Journal of information and communication convergence engineering
    • /
    • v.20 no.3
    • /
    • pp.174-180
    • /
    • 2022
  • Emotion recognition is an essential component of complete interaction between human and machine. The issues related to emotion recognition are a result of the different types of emotions expressed in several forms such as visual, sound, and physiological signal. Recent advancements in the field show that combined modalities, such as visual, voice and electroencephalography signals, lead to better result compared to the use of single modalities separately. Previous studies have explored the use of multiple modalities for accurate predictions of emotion; however the number of studies regarding real-time implementation is limited because of the difficulty in simultaneously implementing multiple modalities of emotion recognition. In this study, we proposed an emotion recognition system for real-time emotion recognition implementation. Our model was built with a multithreading block that enables the implementation of each modality using separate threads for continuous synchronization. First, we separately achieved emotion recognition for each modality before enabling the use of the multithreaded system. To verify the correctness of the results, we compared the performance accuracy of unimodal and multimodal emotion recognitions in real-time. The experimental results showed real-time user emotion recognition of the proposed model. In addition, the effectiveness of the multimodalities for emotion recognition was observed. Our multimodal model was able to obtain an accuracy of 80.1% as compared to the unimodality, which obtained accuracies of 70.9, 54.3, and 63.1%.

Machine Parts(O-Ring) Defect Detection Using Adaptive Binarization and Convex Hull Method Based on Deep Learning (적응형 이진화와 컨벡스 헐 기법을 적용한 심층학습 기반 기계부품(오링) 불량 판별)

  • Kim, Hyun-Tae;Seong, Eun-San
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.12
    • /
    • pp.1853-1858
    • /
    • 2021
  • O-rings fill the gaps between mechanical parts. Until now, the sorting of defective products has been performed visually and manually, so classification errors often occur. Therefore, a camera-based defect classification system without human intervention is required. However, a binarization process is required to separate the required region from the background in the camera input image. In this paper, an adaptive binarization technique that considers the surrounding pixel values is applied to solve the problem that single-threshold binarization is difficult to apply due to factors such as changes in ambient lighting or reflections. In addition, the convex hull technique is also applied to compensate for the missing pixel part. And the learning model to be applied to the separated region applies the residual error-based deep learning neural network model, which is advantageous when the defective characteristic is non-linear. It is suggested that the proposed system through experiments can be applied to the automation of O-ring defect detection.

Meta-heuristic optimization algorithms for prediction of fly-rock in the blasting operation of open-pit mines

  • Mahmoodzadeh, Arsalan;Nejati, Hamid Reza;Mohammadi, Mokhtar;Ibrahim, Hawkar Hashim;Rashidi, Shima;Mohammed, Adil Hussein
    • Geomechanics and Engineering
    • /
    • v.30 no.6
    • /
    • pp.489-502
    • /
    • 2022
  • In this study, a Gaussian process regression (GPR) model as well as six GPR-based metaheuristic optimization models, including GPR-PSO, GPR-GWO, GPR-MVO, GPR-MFO, GPR-SCA, and GPR-SSO, were developed to predict fly-rock distance in the blasting operation of open pit mines. These models included GPR-SCA, GPR-SSO, GPR-MVO, and GPR. In the models that were obtained from the Soungun copper mine in Iran, a total of 300 datasets were used. These datasets included six input parameters and one output parameter (fly-rock). In order to conduct the assessment of the prediction outcomes, many statistical evaluation indices were used. In the end, it was determined that the performance prediction of the ML models to predict the fly-rock from high to low is GPR-PSO, GPR-GWO, GPR-MVO, GPR-MFO, GPR-SCA, GPR-SSO, and GPR with ranking scores of 66, 60, 54, 46, 43, 38, and 30 (for 5-fold method), respectively. These scores correspond in conclusion, the GPR-PSO model generated the most accurate findings, hence it was suggested that this model be used to forecast the fly-rock. In addition, the mutual information test, also known as MIT, was used in order to investigate the influence that each input parameter had on the fly-rock. In the end, it was determined that the stemming (T) parameter was the most effective of all the parameters on the fly-rock.

Development of the Artwork using Music Visualization based on Sentiment Analysis of Lyrics (가사 텍스트의 감성분석에 기반 한 음악 시각화 콘텐츠 개발)

  • Kim, Hye-Ran
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.10
    • /
    • pp.89-99
    • /
    • 2020
  • In this study, we tried to produce moving-image works through sentiment analysis of music. First, Google natural language API was used for the sentiment analysis of lyrics, then the result was applied to the image visualization rules. In prior engineering researches, text-based sentiment analysis has been conducted to understand users' emotions and attitudes by analyzing users' comments and reviews in social media. In this study, the data was used as a material for the creation of artworks so that it could be used for aesthetic expressions. From the machine's point of view, emotions are substituted with numbers, so there is a limit to normalization and standardization. Therefore, we tried to overcome these limitations by linking the results of sentiment analysis of lyrics data with the rules of formative elements in visual arts. This study aims to transform existing traditional art works such as literature, music, painting, and dance to a new form of arts based on the viewpoint of the machine, while reflecting the current era in which artificial intelligence even attempts to create artworks that are advanced mental products of human beings. In addition, it is expected that it will be expanded to an educational platform that facilitates creative activities, psychological analysis, and communication for people with developmental disabilities who have difficulty expressing emotions.