• The Journal of the Acoustical Society of Korea
• /
• v.42 no.3
• /
• pp.214-220
• /
• 2023

In this paper, we propose a method to improve texture recognition performance from haptic acceleration signals representing the texture characteristics of object surface materials by using a Conformer model that combines the advantages of a convolutional neural network and a transformer. In the proposed method, three-axis acceleration signals generated by impact sound and vibration are combined into one-dimensional acceleration data while a person contacts the surface of the object materials using a tool such as a stylus , and the logarithmic Mel-spectrogram is extracted from the haptic acceleration signal similar to the audio signal. Then, Conformer is applied to the extracted the logarithmic Mel-spectrogram to learn main local and global frequency features in recognizing the texture of various object materials. Experiments on the Lehrstuhl für Medientechnik (LMT) haptic texture dataset consisting of 60 materials to evaluate the performance of the proposed model showed that the proposed method can effectively recognize the texture of the object surface material better than the existing methods.

• Korean Journal of Artificial Intelligence
• /
• v.11 no.4
• /
• pp.9-13
• /
• 2023

In this study, we explored the potential of integrating interactive AI callbot technology into the medical consultation domain as part of a broader service development initiative. Aimed at enhancing patient satisfaction, the AI callbot was designed to efficiently address queries from hospitals' primary users, especially the elderly and those using phone services. By incorporating an AI-driven callbot into the hospital's customer service center, routine tasks such as appointment modifications and cancellations were efficiently managed by the AI Callbot Agent. On the other hand, tasks requiring more detailed attention or specialization were addressed by Human Agents, ensuring a balanced and collaborative approach. The deep learning model for voice recognition for this study was based on the Transformer model and fine-tuned to fit the medical field using a pre-trained model. Existing recording files were converted into learning data to perform SSL(self-supervised learning) Model was implemented. The ANN (Artificial neural network) neural network model was used to analyze voice signals and interpret them as text, and after actual application, the intent was enriched through reinforcement learning to continuously improve accuracy. In the case of TTS(Text To Speech), the Transformer model was applied to Text Analysis, Acoustic model, and Vocoder, and Google's Natural Language API was applied to recognize intent. As the research progresses, there are challenges to solve, such as interconnection issues between various EMR providers, problems with doctor's time slots, problems with two or more hospital appointments, and problems with patient use. However, there are specialized problems that are easy to make reservations. Implementation of the callbot service in hospitals appears to be applicable immediately.

• Journal of the Earthquake Engineering Society of Korea
• /
• v.28 no.4
• /
• pp.183-191
• /
• 2024

Accurate seismic vulnerability assessment requires high quality and large amounts of ground motion data. Ground motion data generated from time series contains not only the seismic waves but also the background noise. Therefore, it is crucial to determine the high-pass cut-off frequency to reduce the background noise. Traditional methods for determining the high-pass filter frequency are based on human inspection, such as comparing the noise and the signal Fourier Amplitude Spectrum (FAS), f² trend line fitting, and inspection of the displacement curve after filtering. However, these methods are subject to human error and unsuitable for automating the process. This study used a deep learning approach to determine the high-pass filter frequency. We used the Mel-spectrogram for feature extraction and mixup technique to overcome the lack of data. We selected convolutional neural network (CNN) models such as ResNet, DenseNet, and EfficientNet for transfer learning. Additionally, we chose ViT and DeiT for transformer-based models. The results showed that ResNet had the highest performance with R² (the coefficient of determination) at 0.977 and the lowest mean absolute error (MAE) and RMSE (root mean square error) at 0.006 and 0.074, respectively. When applied to a seismic event and compared to the traditional methods, the determination of the high-pass filter frequency through the deep learning method showed a difference of 0.1 Hz, which demonstrates that it can be used as a replacement for traditional methods. We anticipate that this study will pave the way for automating ground motion processing, which could be applied to the system to handle large amounts of data efficiently.

• ETRI Journal
• /
• v.44 no.2
• /
• pp.194-207
• /
• 2022

In the last decade, substantial progress has been achieved in intelligent traffic control technologies to overcome consistent difficulties of traffic congestion and its adverse effect on smart cities. Edge computing is one such advanced progress facilitating real-time data transmission among vehicles and roadside units to mitigate congestion. An edge computing-based deep reinforcement learning system is demonstrated in this study that appropriately designs a multiobjective reward function for optimizing different objectives. The system seeks to overcome the challenge of evaluating actions with a simple numerical reward. The selection of reward functions has a significant impact on agents' ability to acquire the ideal behavior for managing multiple traffic signals in a large-scale road network. To ascertain effective reward functions, the agent is trained withusing the proximal policy optimization method in several deep neural network models, including the state-of-the-art transformer network. The system is verified using both hypothetical scenarios and real-world traffic maps. The comprehensive simulation outcomes demonstrate the potency of the suggested reward functions.

• Smart Structures and Systems
• /
• v.30 no.6
• /
• pp.613-626
• /
• 2022

Guaranteeing the quality and integrity of structural health monitoring (SHM) data is very important for an effective assessment of structural condition. However, sensory system may malfunction due to sensor fault or harsh operational environment, resulting in multiple types of data anomaly existing in the measured data. Efficiently and automatically identifying anomalies from the vast amounts of measured data is significant for assessing the structural conditions and early warning for structural failure in SHM. The major challenges of current automated data anomaly detection methods are the imbalance of dataset categories. In terms of the feature of actual anomalous data, this paper proposes a data anomaly detection method based on data-level and deep learning technique for SHM of civil engineering structures. The proposed method consists of a data balancing phase to prepare a comprehensive training dataset based on data-level technique, and an anomaly detection phase based on a sophisticatedly designed network. The advanced densely connected convolutional network (DenseNet) and Transformer encoder are embedded in the specific network to facilitate extraction of both detail and global features of response data, and to establish the mapping between the highest level of abstractive features and data anomaly class. Numerical studies on a steel frame model are conducted to evaluate the performance and noise immunity of using the proposed network for data anomaly detection. The applicability of the proposed method for data anomaly classification is validated with the measured data of a practical supertall structure. The proposed method presents a remarkable performance on data anomaly detection, which reaches a 95.7% overall accuracy with practical engineering structural monitoring data, which demonstrates the effectiveness of data balancing and the robust classification capability of the proposed network.

• Journal of Broadcast Engineering
• /
• v.27 no.4
• /
• pp.538-547
• /
• 2022

Recently introduced image classification methods using Transformers show remarkable performance improvements over conventional neural network-based methods. In order to effectively consider regional features, research has been actively conducted on how to apply transformers by dividing image areas into multiple window areas, but learning of inter-window relationships is still insufficient. In this paper, to overcome this problem, we propose a transformer structure that can reflect the relationship between windows in learning. The proposed method computes the importance of each window region through compression and a fully connected layer based on self-attention operations for each window region. The calculated importance is scaled to each window area as a learned weight of the relationship between the window areas to re-calibrate the feature value. Experimental results show that the proposed method can effectively improve the performance of existing transformer-based methods.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.9 no.3
• /
• pp.150-159
• /
• 2000

In-process diagnosis of the cutting state is essential for the automation of manufacturing systems. Especially when the cutting process becomes unstable it induces self-exited vibrations a frequent case of poor tool life rough surface finish damage to the workpiece and the machine tool itself and excessive down time. To ensure that the cutting process main-tains stable it is highly desirable to have the capability of real-time. To ensure that the cutting process main-tains stable it is highly desirable to have the capability of real-time monitoring and controlling chatter. This paper describes the detection method of chatter vibration using cutting force in turning process. In order to detect a chatter vibra-tion the dynamic fluctuation of radial force is analyzed since this components is sensitive to the chatter. The envelope sig-nal of radial force has been calculated by the use of FIR Hilbert transformer and it was useful to classify the chatter signal from the dynamically unstable circumstances. It was found that the mode and the mode width were closely correlated with the chatter amplitude was well. Finally back propagation(BP) neural network have been applied to the pattern recognition for the classification of chatter signal in various cutting conditions. The validity of this systed was confirmed by the experiments under the various cutting conditions.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.25 no.8
• /
• pp.30-38
• /
• 2011

This paper proposes a new intelligent diagnosis equipment for the partial discharge, which keeps deteriorating the insulating materials inside electric machineries, ultimately leading to electrical breakdown. In order to simulate experimentally the partial discharge inside the electric machinery, the tip-to-plate, the sphere-to-plate, the sphere-to-sphere and the plate-to-plate electrodes are used respectively, of which the gaps are 1[mm], 3[mm] or 5[mm] and the applied voltages are 3[kV], 5[kV] or 7[kV]. Ceramic coupler sensor and FIR digital filter are used to measure the partial discharge and the artificial neural network is used for the deterioration diagnosis of the electric machinery. The microprocessor of PD diagnosis equipment is DSP (TMS320C6713) with FPGA (Cyclone II). The results of the real-time and on-line experiments performed with the developed equipment are also explained.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.18 no.3
• /
• pp.89-100
• /
• 2023

Recently, on-device artificial intelligence (AI) solutions using mobile devices and embedded edge devices have emerged in various fields, such as computer vision, to address network traffic burdens, low-energy operations, and security problems. Although vision transformer deep learning models have outperformed conventional convolutional neural network (CNN) models in computer vision, they require more computations and parameters than CNN models. Thus, they are not directly applicable to embedded edge devices with limited hardware resources. Many researchers have proposed various model compression methods or lightweight architectures for vision transformers; however, there are only a few studies evaluating the effects of model compression techniques of vision transformers on performance. Regarding this problem, this paper presents a performance evaluation of vision transformers on embedded platforms. We investigated the behaviors of three vision transformers: DeiT, LeViT, and MobileViT. Each model performance was evaluated by accuracy and inference time on edge devices using the ImageNet dataset. We assessed the effects of the quantization method applied to the models on latency enhancement and accuracy degradation by profiling the proportion of response time occupied by major operations. In addition, we evaluated the performance of each model on GPU and EdgeTPU-based edge devices. In our experimental results, LeViT showed the best performance in CPU-based edge devices, and DeiT-small showed the highest performance improvement in GPU-based edge devices. In addition, only MobileViT models showed performance improvement on EdgeTPU. Summarizing the analysis results through profiling, the degree of performance improvement of each vision transformer model was highly dependent on the proportion of parts that could be optimized in the target edge device. In summary, to apply vision transformers to on-device AI solutions, either proper operation composition and optimizations specific to target edge devices must be considered.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.18 no.2
• /
• pp.142-149
• /
• 2004

This paper presents a neural network controller of a grid-connected wind energy conversion system for extracting maximum power from wind and a power controller to transfer the maximum power extracted into a utility grid. It discusses the modeling and simulation of the wind energy conversion system with the controllers, which consists of an induction generator, a transformer, a link of a rectifier, and an inverter. The paper describes tile drive train model, induction generator model and grid-interface model for dynamics analysis. Maximum power extraction is achieved by controlling the pitch angle of the rotor blades by a neural network controller. Pitch control method is mechanically complicated, but the control performance is better than that of the stall regulation. The simulation results performed on MATLAB show the variation of the generator torque, the generator rotor speed, the pitch angle, and real/reactive power injected into the grid, etc. Based on the simulation results, the effectiveness of the proposed controllers is verified.