• Title/Summary/Keyword: learning rate scheduler

Search Result 2, Processing Time 0.014 seconds

Time Series Data Analysis using WaveNet and Walk Forward Validation (WaveNet과 Work Forward Validation을 활용한 시계열 데이터 분석)

  • Yoon, Hyoup-Sang
    • Journal of the Korea Society for Simulation
    • /
    • v.30 no.4
    • /
    • pp.1-8
    • /
    • 2021
  • Deep learning is one of the most widely accepted methods for the forecasting of time series data which have the complexity and non-linear behavior. In this paper, we investigate the modification of a state-of-art WaveNet deep learning architecture and walk forward validation (WFV) in order to forecast electric power consumption data 24-hour-ahead. WaveNet originally designed for raw audio uses 1D dilated causal convolution for long-term information. First of all, we propose a modified version of WaveNet which activates real numbers instead of coded integers. Second, this paper provides with the training process with tuning of major hyper-parameters (i.e., input length, batch size, number of WaveNet blocks, dilation rates, and learning rate scheduler). Finally, performance evaluation results show that the prediction methodology based on WFV performs better than on the traditional holdout validation.

Framework Switching of Speaker Overlap Detection System (화자 겹침 검출 시스템의 프레임워크 전환 연구)

  • Kim, Hoinam;Park, Jisu;Cha, Shin;Son, Kyung A;Yun, Young-Sun;Park, Jeon Gue
    • Journal of Software Assessment and Valuation
    • /
    • v.17 no.1
    • /
    • pp.101-113
    • /
    • 2021
  • In this paper, we introduce a speaker overlap system and look at the process of converting the existed system on the specific framework of artificial intelligence. Speaker overlap is when two or more speakers speak at the same time during a conversation, and can lead to performance degradation in the fields of speech recognition or speaker recognition, and a lot of research is being conducted because it can prevent performance degradation. Recently, as application of artificial intelligence is increasing, there is a demand for switching between artificial intelligence frameworks. However, when switching frameworks, performance degradation is observed due to the unique characteristics of each framework, making it difficult to switch frameworks. In this paper, the process of converting the speaker overlap detection system based on the Keras framework to the pytorch-based system is explained and considers components. As a result of the framework switching, the pytorch-based system showed better performance than the existing Keras-based speaker overlap detection system, so it can be said that it is valuable as a fundamental study on systematic framework conversion.