• Title/Summary/Keyword: End-to-end learning

Search Result 1,128, Processing Time 0.03 seconds

Collecting and utilizing virtual driving data reflecting real-world environment for autonomous driving based on End to End deep learning (End to End 딥러닝 기반의 자율주행을 위한 실세계 환경을 반영한 가상 주행 데이터 수집 및 활용)

  • Kim, Jun-Tae;Bae, Changseok
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2018.05a
    • /
    • pp.394-397
    • /
    • 2018
  • 최근 인공지능 연구가 활발하게 진행이 되면서 여러 기업에서 자율 주행연구도 활발하게 진행되고 있다. 하지만 실제 상황에서 자동차 주행 데이터를 얻기에는 여러 위험사항들과 경제적인 낭비가 있다. 그렇기 때문에 게임 상에서 데이터를 수집하고 딥러닝을 이용해 학습을 하기로 했다. 본 논문에서는 실제 세계와 유사한 환경을 가지고 있는 자동차 게임을 이용하여 자율 주행을 시도 했다. 자율 주행 시 많이 쓰이는 End to End 방법으로 데이터를 수집하면 두 가지 데이터가 저장된다. 하나는 이미지 데이터고 두 번째는 방향키 데이터다. 이러한 데이터들을 numpy 타입으로 40분간 데이터를 수집한 후 딥러닝에 많이 쓰이는 tensorflow를 사용하여 구현한 CNN을 이용하여 학습이 되는 것을 확인을 하고 91.9%의 정확도를 얻었다. 이를 기반으로 실세계에서의 사용 가능성을 확인했다.

End-to-end Korean Document Summarization using Copy Mechanism and Input-feeding (복사 방법론과 입력 추가 구조를 이용한 End-to-End 한국어 문서요약)

  • Choi, Kyoung-Ho;Lee, Changki
    • Journal of KIISE
    • /
    • v.44 no.5
    • /
    • pp.503-509
    • /
    • 2017
  • In this paper, the copy mechanism and input feeding are applied to recurrent neural network(RNN)-search model in a Korean-document summarization in an end-to-end manner. In addition, the performances of the document summarizations are compared according to the model and the tokenization format; accordingly, the syllable-unit, morpheme-unit, and hybrid-unit tokenization formats are compared. For the experiments, Internet newspaper articles were collected to construct a Korean-document summary data set (train set: 30291 documents; development set: 3786 documents; test set: 3705 documents). When the format was tokenized as the morpheme-unit, the models with the input feeding and the copy mechanism showed the highest performances of ROUGE-1 35.92, ROUGE-2 15.37, and ROUGE-L 29.45.

Modeling of AutoML using Colored Petri Net

  • Yo-Seob, Lee
    • International Journal of Advanced Culture Technology
    • /
    • v.10 no.4
    • /
    • pp.420-426
    • /
    • 2022
  • Developing a machine learning model and putting it into production goes through a number of steps. Automated Machine Learning(AutoML) appeared to increase productivity and efficiency by automating inefficient tasks that occur while repeating this process whenever machine learning is applied. The high degree of automation of AutoML models allows non-experts to use machine learning models and techniques without the need to become machine learning experts. Automating the process of applying machine learning end-to-end with AutoML models has the added benefit of creating simpler solutions, generating these solutions faster, and often generating models that outperform hand-designed models. In this paper, the AutoML data is collected and AutoML's Color Petri net model is created and analyzed based on it.

Distributed Edge Computing for DNA-Based Intelligent Services and Applications: A Review (딥러닝을 사용하는 IoT빅데이터 인프라에 필요한 DNA 기술을 위한 분산 엣지 컴퓨팅기술 리뷰)

  • Alemayehu, Temesgen Seyoum;Cho, We-Duke
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.9 no.12
    • /
    • pp.291-306
    • /
    • 2020
  • Nowadays, Data-Network-AI (DNA)-based intelligent services and applications have become a reality to provide a new dimension of services that improve the quality of life and productivity of businesses. Artificial intelligence (AI) can enhance the value of IoT data (data collected by IoT devices). The internet of things (IoT) promotes the learning and intelligence capability of AI. To extract insights from massive volume IoT data in real-time using deep learning, processing capability needs to happen in the IoT end devices where data is generated. However, deep learning requires a significant number of computational resources that may not be available at the IoT end devices. Such problems have been addressed by transporting bulks of data from the IoT end devices to the cloud datacenters for processing. But transferring IoT big data to the cloud incurs prohibitively high transmission delay and privacy issues which are a major concern. Edge computing, where distributed computing nodes are placed close to the IoT end devices, is a viable solution to meet the high computation and low-latency requirements and to preserve the privacy of users. This paper provides a comprehensive review of the current state of leveraging deep learning within edge computing to unleash the potential of IoT big data generated from IoT end devices. We believe that the revision will have a contribution to the development of DNA-based intelligent services and applications. It describes the different distributed training and inference architectures of deep learning models across multiple nodes of the edge computing platform. It also provides the different privacy-preserving approaches of deep learning on the edge computing environment and the various application domains where deep learning on the network edge can be useful. Finally, it discusses open issues and challenges leveraging deep learning within edge computing.

A TabNet - Based System for Water Quality Prediction in Aquaculture

  • Nguyen, Trong–Nghia;Kim, Soo Hyung;Do, Nhu-Tai;Hong, Thai-Thi Ngoc;Yang, Hyung Jeong;Lee, Guee Sang
    • Smart Media Journal
    • /
    • v.11 no.2
    • /
    • pp.39-52
    • /
    • 2022
  • In the context of the evolution of automation and intelligence, deep learning and machine learning algorithms have been widely applied in aquaculture in recent years, providing new opportunities for the digital realization of aquaculture. Especially, water quality management deserves attention thanks to its importance to food organisms. In this study, we proposed an end-to-end deep learning-based TabNet model for water quality prediction. From major indexes of water quality assessment, we applied novel deep learning techniques and machine learning algorithms in innovative fish aquaculture to predict the number of water cells counting. Furthermore, the application of deep learning in aquaculture is outlined, and the obtained results are analyzed. The experiment on in-house data showed an optimistic impact on the application of artificial intelligence in aquaculture, helping to reduce costs and time and increase efficiency in the farming process.

Domain adaptation of Korean coreference resolution using continual learning (Continual learning을 이용한 한국어 상호참조해결의 도메인 적응)

  • Yohan Choi;Kyengbin Jo;Changki Lee;Jihee Ryu;Joonho Lim
    • Annual Conference on Human and Language Technology
    • /
    • 2022.10a
    • /
    • pp.320-323
    • /
    • 2022
  • 상호참조해결은 문서에서 명사, 대명사, 명사구 등의 멘션 후보를 식별하고 동일한 개체를 의미하는 멘션들을 찾아 그룹화하는 태스크이다. 딥러닝 기반의 한국어 상호참조해결 연구들에서는 BERT를 이용하여 단어의 문맥 표현을 얻은 후 멘션 탐지와 상호참조해결을 동시에 수행하는 End-to-End 모델이 주로 연구가 되었으며, 최근에는 스팬 표현을 사용하지 않고 시작과 끝 표현식을 통해 상호참조해결을 빠르게 수행하는 Start-to-End 방식의 한국어 상호참조해결 모델이 연구되었다. 최근에 한국어 상호참조해결을 위해 구축된 ETRI 데이터셋은 WIKI, QA, CONVERSATION 등 다양한 도메인으로 이루어져 있으며, 신규 도메인의 데이터가 추가될 경우 신규 데이터가 추가된 전체 학습데이터로 모델을 다시 학습해야 하며, 이때 많은 시간이 걸리는 문제가 있다. 본 논문에서는 이러한 상호참조해결 모델의 도메인 적응에 Continual learning을 적용해 각기 다른 도메인의 데이터로 모델을 학습 시킬 때 이전에 학습했던 정보를 망각하는 Catastrophic forgetting 현상을 억제할 수 있음을 보인다. 또한, Continual learning의 성능 향상을 위해 2가지 Transfer Techniques을 함께 적용한 실험을 진행한다. 실험 결과, 본 논문에서 제안한 모델이 베이스라인 모델보다 개발 셋에서 3.6%p, 테스트 셋에서 2.1%p의 성능 향상을 보였다.

  • PDF

Research Trends on Wireless Transmission and Access Technologies Using Deep Learning (딥러닝을 활용한 무선 전송 및 접속 기술 동향)

  • Kim, K.;Myung, J.;Seo, J.
    • Electronics and Telecommunications Trends
    • /
    • v.33 no.5
    • /
    • pp.13-23
    • /
    • 2018
  • Deep learning is a promising solution to a number of complex problems based on its inherent capability to approximate almost all types of functions without the demand for handcrafted feature extraction. New wireless transmission and access schemes based on deep learning are being increasingly proposed as substitutes for existing approaches, providing a lower complexity and better performance gain. Among such schemes, a communications system is viewed as an end-to-end autoencoder. The learning process applied in autoencoders can automatically deal with some nonlinear or unknown properties in communications systems. Deep learning can also be used to optimize each processing block for required tasks such as channel decoding, signal detection, and multiple access. On top of recent related research trends, we suggest appropriate research approaches for communications systems to adopt deep learning.

Analysis on learning curves of end-use appliances for the establishment of price-sensitivity load model in competitive electricity market (전력산업 경쟁 환경에서의 요금부하모델 수립을 위한 부하기기의 학습곡선 분석)

  • Hwang, Sung-Wook;Kim, Jung-Hoon;Song, Kyung-Bin;Choi, Joon-Young
    • Proceedings of the KIEE Conference
    • /
    • 2001.07a
    • /
    • pp.386-388
    • /
    • 2001
  • The change of the electricity charge from cost base to price base due to the introduction of the electricity market competition causes consumer to choose a variety of charge schemes and a portion of loads to be affected by this change. Besides, it is required the index that consolidate the price volatility experienced on the power exchange with gaming and strategic bidding by suppliers to increase profits. Therefore, in order to find a mathematical model of the sensitively-responding-to-price loads, the price-sensitive load model is needed. And the development of state-of-the-art technologies affects the electricity price, so the diffusion of high-efficient end-uses and these price affect load patterns. This paper shows the analysis on learning curves algorithms which is used to investigate the correlation of the end-uses' price and load patterns.

  • PDF

The Influence of Introducing New Technologies and DSM Strategies on End-Use Learning Curves (신기술 보급 및 DSM 정책이 부하기기 학습곡선에 미치는 영향)

  • Hwang, Sung-Wook;Kim, Jung-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 2001.11b
    • /
    • pp.435-437
    • /
    • 2001
  • The change of the electricity charge from cost base to price base due to the introduction of the electricity market competition causes consumer to choose a variety of charge schemes and a portion of loads to be affected by this change. Besides, it is required the index that consolidate the price volatility experienced on the power exchange with gaming and strategic bidding by suppliers to increase profits. Therefore, in order to find a mathematical model of the sensitively-responding-to-price loads, the price-sensitive load model is needed. And the development of state-of-the-art technologies affects the electricity price, so the diffusion of high-efficient end-uses and these price affect load patterns. This paper shows the analysis on learning curves algorithms which is used to investigate the correlation of the end-uses' price and load patterns.

  • PDF

Conformer with lexicon transducer for Korean end-to-end speech recognition (Lexicon transducer를 적용한 conformer 기반 한국어 end-to-end 음성인식)

  • Son, Hyunsoo;Park, Hosung;Kim, Gyujin;Cho, Eunsoo;Kim, Ji-Hwan
    • The Journal of the Acoustical Society of Korea
    • /
    • v.40 no.5
    • /
    • pp.530-536
    • /
    • 2021
  • Recently, due to the development of deep learning, end-to-end speech recognition, which directly maps graphemes to speech signals, shows good performance. Especially, among the end-to-end models, conformer shows the best performance. However end-to-end models only focuses on the probability of which grapheme will appear at the time. The decoding process uses a greedy search or beam search. This decoding method is easily affected by the final probability output by the model. In addition, the end-to-end models cannot use external pronunciation and language information due to structual problem. Therefore, in this paper conformer with lexicon transducer is proposed. We compare phoneme-based model with lexicon transducer and grapheme-based model with beam search. Test set is consist of words that do not appear in training data. The grapheme-based conformer with beam search shows 3.8 % of CER. The phoneme-based conformer with lexicon transducer shows 3.4 % of CER.