• The Journal of the Acoustical Society of Korea
• /
• v.40 no.5
• /
• pp.515-522
• /
• 2021

It is hard to prepare sufficient training data for speech emotion recognition due to the difficulty of emotion labeling. In this paper, we apply transfer learning with large-scale training data for speech recognition on a transformer-based model to improve the performance of speech emotion recognition. In addition, we propose a method to utilize context information without decoding by multi-task learning with speech recognition. According to the speech emotion recognition experiments using the IEMOCAP dataset, our model achieves a weighted accuracy of 70.6 % and an unweighted accuracy of 71.6 %, which shows that the proposed method is effective in improving the performance of speech emotion recognition.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.2
• /
• pp.329-335
• /
• 2023

Avocado, a superfood selected by Time magazine and one of the late ripening fruits, is one of the foods with a big difference between local prices and domestic distribution prices. If this sorting process of avocados is automated, it will be possible to lower prices by reducing labor costs in various fields. In this paper, we aim to create an optimal classification model by creating an avocado dataset through crawling and using a number of deep learning-based transfer learning models. Experiments were conducted by directly substituting a deep learning-based transfer learning model from a dataset separated from the produced dataset and fine-tuning the hyperparameters of the model. When an avocado image is input, the model classifies the ripeness of the avocado with an accuracy of over 99%, and proposes a dataset and algorithm that can reduce manpower and increase accuracy in avocado production and distribution households.

• Structural Engineering and Mechanics
• /
• v.91 no.2
• /
• pp.163-175
• /
• 2024

The objective of this research is to improve public safety in civil engineering by recognizing fractures in concrete structures quickly and correctly. The study offers a new crack detection method based on advanced image processing and machine learning techniques, specifically transfer learning with convolutional neural networks (CNNs). Four pre-trained models (VGG16, AlexNet, ResNet18, and DenseNet161) were fine-tuned to detect fractures in concrete surfaces. These models constantly produced accuracy rates greater than 80%, showing their ability to automate fracture identification and potentially reduce structural failure costs. Furthermore, the study expands its scope beyond crack detection to identify concrete health, using a dataset with a wide range of surface defects and anomalies including cracks. Notably, using VGG16, which was chosen as the most effective network architecture from the first phase, the study achieves excellent accuracy in classifying concrete health, demonstrating the model's satisfactorily performance even in more complex scenarios.

• Journal of the Korean Recycled Construction Resources Institute
• /
• v.9 no.3
• /
• pp.348-355
• /
• 2021

Asphalt, widely used for road pavement, has different required physical properties depending on the environment to which the road is exposed. Therefore, it is essential to maximize the life of asphalt roads by evaluating the physical properties of asphalt according to additives and selecting an appropriate formulation considering road traffic and climatic environment. Dynamic shear rheometer(DSR) test is mainly used to measure resistance to rutting among various physical properties of asphalt. However, the DSR test has limitations in that the results are different depending on the experimental setting and can only be measured within a specific temperature range. Therefore, in this study, to overcome the limitations of the DSR test, the rheological characteristics were predicted by learning the images collected from atomic force microscopy. Images and rheology properties were trained through EfficientNet, one of the deep learning architectures, and transfer learning was used to overcome the limitation of the deep learning model, which require many data. The trained model predicted the rheological properties of the asphalt binder with high accuracy even though different types of additives were used. In particular, it was possible to train faster than when transfer learning was not used.

• Educational Technology International
• /
• v.22 no.2
• /
• pp.311-339
• /
• 2021

This study examined the effects of scaffolding types (Toulmin's Argument Pattern: TAP or Argumentation Vee Diagram: AVD) and individual metacognition levels (low or high) on students' learning achievement in online collaborative argumentation. A total of 191 Chinese undergraduates took part in this study. They were randomly assigned to either the TAP scaffolding, AVD scaffolding, or no scaffolding condition. They were teamed up in small groups of two or three students to argue with their peers using SNS as the online collaborative argumentation environment. The results revealed that students in the TAP and AVD scaffolding conditions did not gain significantly higher retention or transfer scores than students without scaffolding. However, students in the TAP scaffolding condition significantly outperformed those in the AVD scaffolding condition on transfer scores. Individual metacognition did not significantly affect learning achievement in online collaborative argumentation. Additionally, there was no significant interaction effect between scaffolding types and individual metacognition levels on retention or on transfer. The findings have implications for scaffolding design for online collaborative argumentation and also suggest that more attention should be paid to social metacognition rather than to individual metacognition when students work collaboratively.

• Journal of the Korea Convergence Society
• /
• v.12 no.10
• /
• pp.27-35
• /
• 2021

Automatic post editing is a research field that aims to automatically correct errors in machine translation results. This research is mainly being focus on high resource language pairs, such as English-German. Recent APE studies are mainly adopting transfer learning based research, where pre-training language models, or translation models generated through self-supervised learning methodologies are utilized. While translation based APE model shows superior performance in recent researches, as such researches are conducted on the high resource languages, the same perspective cannot be directly applied to the low resource languages. In this work, we apply two transfer learning strategies to Korean-English APE studies and show that transfer learning with translation model can significantly improves APE performance.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.37 no.3
• /
• pp.119-127
• /
• 2019

In this study, we investigated the application of deep learning to the manufacturing process of traffic and road signs which are constituting the road layer in map production with 1 / 1,000 digital topographic map. Automated classification of road traffic sign images was carried out through construction of training data for images acquired by using transfer learning which is used in image classification of deep learning. As a result of the analysis, the signs of attention, regulation, direction and assistance were irregular due to various factors such as the quality of the photographed images and sign shape, but in the case of the guide sign, the accuracy was higher than 97%. In the digital mapping, it is expected that the automatic image classification method using transfer learning will increase the utilization in data acquisition and classification of various layers including traffic safety signs.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.39 no.3
• /
• pp.399-407
• /
• 2019

In Korea, the construction industry has been known to have the highest risk of safety accidents compared to other industries. Therefore, in order to improve safety in the construction industry, several researches have been carried out from the past. This study aims at improving safety of labors in construction site by constructing an effective automatic safety helmet detection system using object detection algorithm based on image data of construction field. Deep learning was conducted using Region-based Fully Convolutional Network (R-FCN) which is one of the object detection algorithms based on Convolutional Neural Network (CNN) with Transfer Learning technique. Learning was conducted with 1089 images including human and safety helmet collected from ImageNet and the mean Average Precision (mAP) of the human and the safety helmet was measured as 0.86 and 0.83, respectively.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.4
• /
• pp.21-28
• /
• 2021

This study proposes a deep learning-based flat foot classification methodology using transfer learning. We used a transfer learning with VGG16 pre-trained model and a data augmentation technique to generate a model with high predictive accuracy from a total of 176 image data consisting of 88 flat feet and 88 normal feet. To evaluate the performance of the proposed model, we performed an experiment comparing the prediction accuracy of the basic CNN-based model and the prediction model derived through the proposed methodology. In the case of the basic CNN model, the training accuracy was 77.27%, the validation accuracy was 61.36%, and the test accuracy was 59.09%. Meanwhile, in the case of our proposed model, the training accuracy was 94.32%, the validation accuracy was 86.36%, and the test accuracy was 84.09%, indicating that the accuracy of our model was significantly higher than that of the basic CNN model.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.5
• /
• pp.674-677
• /
• 2020

The cultural background of users utilizing image search engines has a significant impact on the satisfaction of the search results. Therefore, it is important to analyze and understand the cultural context of images for more accurate image search. In this paper, we investigate how the cultural context of images can affect the performance of image classification. To this end, we first collected various types of images (e.g,. food, temple, etc.) with various cultural contexts (e.g., Korea, Japan, etc.) from web search engines. Afterwards, a deep transfer learning approach using VGG19 and MobileNetV2 pre-trained with ImageNet was adopted to learn the cultural features of the collected images. Through various experiments we show the performance of image classification can be differently affected according to the cultural context of images.