• Title/Summary/Keyword: Transfer Learning

Search Result 711, Processing Time 0.033 seconds

One-dimensional CNN Model of Network Traffic Classification based on Transfer Learning

  • Lingyun Yang;Yuning Dong;Zaijian Wang;Feifei Gao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.18 no.2
    • /
    • pp.420-437
    • /
    • 2024
  • There are some problems in network traffic classification (NTC), such as complicated statistical features and insufficient training samples, which may cause poor classification effect. A NTC architecture based on one-dimensional Convolutional Neural Network (CNN) and transfer learning is proposed to tackle these problems and improve the fine-grained classification performance. The key points of the proposed architecture include: (1) Model classification--by extracting normalized rate feature set from original data, plus existing statistical features to optimize the CNN NTC model. (2) To apply transfer learning in the classification to improve NTC performance. We collect two typical network flows data from Youku and YouTube, and verify the proposed method through extensive experiments. The results show that compared with existing methods, our method could improve the classification accuracy by around 3-5%for Youku, and by about 7 to 27% for YouTube.

A Feature-Based Malicious Executable Detection Approach Using Transfer Learning

  • Zhang, Yue;Yang, Hyun-Ho;Gao, Ning
    • Journal of Internet Computing and Services
    • /
    • v.21 no.5
    • /
    • pp.57-65
    • /
    • 2020
  • At present, the existing virus recognition systems usually use signature approach to detect malicious executable files, but these methods often fail to detect new and invisible malware. At the same time, some methods try to use more general features to detect malware, and achieve some success. Moreover, machine learning-based approaches are applied to detect malware, which depend on features extracted from malicious codes. However, the different distribution of features oftraining and testing datasets also impacts the effectiveness of the detection models. And the generation oflabeled datasets need to spend a significant amount time, which degrades the performance of the learning method. In this paper, we use transfer learning to detect new and previously unseen malware. We first extract the features of Portable Executable (PE) files, then combine transfer learning training model with KNN approachto detect the new and unseen malware. We also evaluate the detection performance of a classifier in terms of precision, recall, F1, and so on. The experimental results demonstrate that proposed method with high detection rates andcan be anticipated to carry out as well in the real-world environment.

Multi-class Classification of Histopathology Images using Fine-Tuning Techniques of Transfer Learning

  • Ikromjanov, Kobiljon;Bhattacharjee, Subrata;Hwang, Yeong-Byn;Kim, Hee-Cheol;Choi, Heung-Kook
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.7
    • /
    • pp.849-859
    • /
    • 2021
  • Prostate cancer (PCa) is a fatal disease that occurs in men. In general, PCa cells are found in the prostate gland. Early diagnosis is the key to prevent the spreading of cancers to other parts of the body. In this case, deep learning-based systems can detect and distinguish histological patterns in microscopy images. The histological grades used for the analysis were benign, grade 3, grade 4, and grade 5. In this study, we attempt to use transfer learning and fine-tuning methods as well as different model architectures to develop and compare the models. We implemented MobileNet, ResNet50, and DenseNet121 models and used three different strategies of freezing layers techniques of fine-tuning, to get various pre-trained weights to improve accuracy. Finally, transfer learning using MobileNet with the half-layer frozen showed the best results among the nine models, and 90% accuracy was obtained on the test data set.

A Computer-Aided Diagnosis of Brain Tumors Using a Fine-Tuned YOLO-based Model with Transfer Learning

  • Montalbo, Francis Jesmar P.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.12
    • /
    • pp.4816-4834
    • /
    • 2020
  • This paper proposes transfer learning and fine-tuning techniques for a deep learning model to detect three distinct brain tumors from Magnetic Resonance Imaging (MRI) scans. In this work, the recent YOLOv4 model trained using a collection of 3064 T1-weighted Contrast-Enhanced (CE)-MRI scans that were pre-processed and labeled for the task. This work trained with the partial 29-layer YOLOv4-Tiny and fine-tuned to work optimally and run efficiently in most platforms with reliable performance. With the help of transfer learning, the model had initial leverage to train faster with pre-trained weights from the COCO dataset, generating a robust set of features required for brain tumor detection. The results yielded the highest mean average precision of 93.14%, a 90.34% precision, 88.58% recall, and 89.45% F1-Score outperforming other previous versions of the YOLO detection models and other studies that used bounding box detections for the same task like Faster R-CNN. As concluded, the YOLOv4-Tiny can work efficiently to detect brain tumors automatically at a rapid phase with the help of proper fine-tuning and transfer learning. This work contributes mainly to assist medical experts in the diagnostic process of brain tumors.

Transfer Learning-Based Feature Fusion Model for Classification of Maneuver Weapon Systems

  • Jinyong Hwang;You-Rak Choi;Tae-Jin Park;Ji-Hoon Bae
    • Journal of Information Processing Systems
    • /
    • v.19 no.5
    • /
    • pp.673-687
    • /
    • 2023
  • Convolutional neural network-based deep learning technology is the most commonly used in image identification, but it requires large-scale data for training. Therefore, application in specific fields in which data acquisition is limited, such as in the military, may be challenging. In particular, the identification of ground weapon systems is a very important mission, and high identification accuracy is required. Accordingly, various studies have been conducted to achieve high performance using small-scale data. Among them, the ensemble method, which achieves excellent performance through the prediction average of the pre-trained models, is the most representative method; however, it requires considerable time and effort to find the optimal combination of ensemble models. In addition, there is a performance limitation in the prediction results obtained by using an ensemble method. Furthermore, it is difficult to obtain the ensemble effect using models with imbalanced classification accuracies. In this paper, we propose a transfer learning-based feature fusion technique for heterogeneous models that extracts and fuses features of pre-trained heterogeneous models and finally, fine-tunes hyperparameters of the fully connected layer to improve the classification accuracy. The experimental results of this study indicate that it is possible to overcome the limitations of the existing ensemble methods by improving the classification accuracy through feature fusion between heterogeneous models based on transfer learning.

A Study on the International Transfer of Retail Know-how: A Case of 7-Eleven (소매 노하우의 국제이전에 관한 연구 : 7-Eleven 사례를 중심으로)

  • Kim, Hyun-Chul
    • Journal of Distribution Research
    • /
    • v.13 no.4
    • /
    • pp.1-19
    • /
    • 2008
  • This study investigated the international transfer of retail know-how via the prism of Learning Organizational Theory. As a case, 7-Eleven, a worldwide chain of convenience stores was examined. Its international transfer of retail know-how occurred when 7-Eleven, originally founded by Southland Corporation in Dallas, Texas, was introduced in Japan in 1973 in the form of 7-Eleven Japan. Our analysis shows that both strategic core learning and adaptive learning played a significant role during the international transfer of retail know-how. Our findings reveal the evidence of the following elements of strategic core learning such as the convenience store concept, the three principles of store management, the minimum profit guarantee system, and the margin-based royalty system. On the other hand, the retailing mix such as store type, store location, store size, and merchandising acted as the acting agents of adaptive learning. The hypothesis verification methods acted as the main methods for adaptive learning. Through the persistent adaptive learning, inimitable innovations could be brought forth. However, the elements of strategic core learning should provide the direction for the adaptive learning.

  • PDF

Transfer Learning Technique for Accelerating Learning of Reinforcement Learning-Based Horizontal Pod Autoscaling Policy (강화학습 기반 수평적 파드 오토스케일링 정책의 학습 가속화를 위한 전이학습 기법)

  • Jang, Yonghyeon;Yu, Heonchang;Kim, SungSuk
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.11 no.4
    • /
    • pp.105-112
    • /
    • 2022
  • Recently, many studies using reinforcement learning-based autoscaling have been performed to make autoscaling policies that are adaptive to changes in the environment and meet specific purposes. However, training the reinforcement learning-based Horizontal Pod Autoscaler(HPA) policy in a real environment requires a lot of money and time. And it is not practical to retrain the reinforcement learning-based HPA policy from scratch every time in a real environment. In this paper, we implement a reinforcement learning-based HPA in Kubernetes, and propose a transfer leanring technique using a queuing model-based simulation to accelerate the training of a reinforcement learning-based HPA policy. Pre-training using simulation enabled training the policy through simulation experience without consuming time and resources in the real environment, and by using the transfer learning technique, the cost was reduced by about 42.6% compared to the case without transfer learning technique.

Deep Learning based Scrapbox Accumulated Status Measuring

  • Seo, Ye-In;Jeong, Eui-Han;Kim, Dong-Ju
    • Journal of the Korea Society of Computer and Information
    • /
    • v.25 no.3
    • /
    • pp.27-32
    • /
    • 2020
  • In this paper, we propose an algorithm to measure the accumulated status of scrap boxes where metal scraps are accumulated. The accumulated status measuring is defined as a multi-class classification problem, and the method with deep learning classify the accumulated status using only the scrap box image. The learning was conducted by the Transfer Learning method, and the deep learning model was NASNet-A. In order to improve the accuracy of the model, we combined the Random Forest classifier with the trained NASNet-A and improved the model through post-processing. Testing with 4,195 data collected in the field showed 55% accuracy when only NASNet-A was applied, and the proposed method, NASNet with Random Forest, improved the accuracy by 88%.

Analogical Transfer: Sequence and Connection

  • LIM, Mi-Ra
    • Educational Technology International
    • /
    • v.9 no.1
    • /
    • pp.79-96
    • /
    • 2008
  • The issue of connection between entities has a lengthy history in educational research, especially since it provides the necessary bridge between base and target in analogical transfer. Recently, the connection has been viewed through the application of technology to bridge between sequences in order to be cognitively useful. This study reports the effect of sequence type (AT vs. TA) and connection type (fading vs. popping) on the achievement and analogical transfer in a multimedia application. In the current research, 10th -grade and 11th -grade biology students in Korea were randomly assigned to five groups to test the effects of presentation sequence and entity connection type on analogical transfer. Consistent with previous studies, sequence type has a significant effect: analogical transfer performance was better when base representations were presented first followed by target representations rather than the reverse order. This is probably because presenting a familiar base first helps in understanding a less familiar target. However, no fully significant differences were found with the entity connection types (fading vs. popping) in analogical transfer. According to the Markman and Gentner's (2005) spatial model, analogy in a space is influenced only by the differences between concepts, not by distance in space. Thus connection types fail on the basis of this spatial model in analogical transfer test. The findings and their implications for sequence and connection research and practice are discussed. Leveraging on the analogical learning process, specific implications for scaffolding learning processes and the development of adaptive expertise are drawn.

A Study of Situated Cognition and Transfer in Mathematics Learning

  • Park, Sung-Sun
    • Research in Mathematical Education
    • /
    • v.3 no.1
    • /
    • pp.57-68
    • /
    • 1999
  • In this paper, we investigate the comparative effectiveness of two kinds of instructional methods in transfer of mathematics learning: one based on the situated cognition, i.e. situated learning (SL) and the other based on traditional learning (TL). Both classes (of grade 2) studied addition and subtraction of 3-digit numbers. After that, they completed two written tests (Written Test 1 included computation problems, Written Test 2 included computation problems and story problems) and a real situation test. As a result, no significant differences were found between the two groups' performance on computation skill in Written Tests 1 and 2. But the SL group performed significantly better on the performance of story problem and real situation test than TL group. This result indicated that the SL made improvement in transfer of mathematics learning. As a result of interviews with 12 children of the SL group were able to use contextual resources in solving real situation as well as story problems.

  • PDF