• The Korean Journal of Applied Statistics
• /
• v.33 no.5
• /
• pp.603-614
• /
• 2020

This study focuses on the prediction and factors of apartment prices in Seoul using a convolutional neural networks (CNN) model that has shown excellent performance as a predictive model of image data. To do this, we consider natural environmental factors, infrastructure factors, and social economic factors of the apartments as input variables of the CNN model. The natural environmental factors include rivers, green areas, and altitudes of apartments. The infrastructure factors have bus stops, subway stations, commercial districts, schools, and the social economic factors are the number of jobs and criminal rates, etc. We predict apartment prices and interpret the factors for the prices by converting the values of these input variables to play the same role as pixel values of image channels for the input layer in the CNN model. In addition, the CNN model used in this study takes into account the spatial characteristics of each apartment by describing the natural environmental and infrastructure factors variables as binary images centered on each apartment in each input layer.

• Journal of The Korean Society of Agricultural Engineers
• /
• v.63 no.1
• /
• pp.11-25
• /
• 2021

The objective of this study was to analyze the impact of activation functions on flood forecasting model based on Artificial neural networks (ANNs). The traditional activation functions, the sigmoid and tanh functions, were compared with the functions which have been recently recommended for deep neural networks; the ReLU, leaky ReLU, and ELU functions. The flood forecasting model based on ANNs was designed to predict real-time runoff for 1 to 6-h lead time using the rainfall and runoff data of the past nine hours. The statistical measures such as R2, Nash-Sutcliffe Efficiency (NSE), Root Mean Squared Error (RMSE), the error of peak time (ETp), and the error of peak discharge (EQp) were used to evaluate the model accuracy. The tanh and ELU functions were most accurate with R2=0.97 and RMSE=30.1 (㎥/s) for 1-h lead time and R2=0.56 and RMSE=124.6~124.8 (㎥/s) for 6-h lead time. We also evaluated the learning speed by using the number of epochs that minimizes errors. The sigmoid function had the slowest learning speed due to the 'vanishing gradient problem' and the limited direction of weight update. The learning speed of the ELU function was 1.2 times faster than the tanh function. As a result, the ELU function most effectively improved the accuracy and speed of the ANNs model, so it was determined to be the best activation function for ANNs-based flood forecasting.

• International journal of advanced smart convergence
• /
• v.10 no.1
• /
• pp.1-11
• /
• 2021

Document page segmentation is an important step in building a quality optical character recognition module. The study examined already existing work on the topic of page segmentation and focused on the development of a segmentation model that has greater functional significance for application in an organization, as well as broad capabilities for managing the quality of the model. The main problems of document segmentation were highlighted, which include a complex background of intersecting objects. As classes for detection, not only classic text, table and figure were selected, but also additional types, such as signature, logo and table without borders (or with partially missing borders). This made it possible to pose a non-trivial task of detecting non-standard document elements. The authors compared existing neural network architectures for object detection based on published research data. The most suitable architecture was RetinaNet. To ensure the possibility of quality control of the model, a method based on neural network modeling using the RetinaNet architecture is proposed. During the study, several models were built, the quality of which was assessed on the test sample using the Mean average Precision metric. The best result among the constructed algorithms was shown by a model that includes four neural networks: the focus of the first neural network on detecting tables and tables without borders, the second - seals and signatures, the third - pictures and logos, and the fourth - text. As a result of the analysis, it was revealed that the approach based on four neural networks showed the best results in accordance with the objectives of the study on the test sample in the context of most classes of detection. The method proposed in the article can be used to recognize other objects. A promising direction in which the analysis can be continued is the segmentation of tables; the areas of the table that differ in function will act as classes: heading, cell with a name, cell with data, empty cell.

• Journal of Information Processing Systems
• /
• v.16 no.6
• /
• pp.1250-1260
• /
• 2020

This study proposes a novel deep neural network model that can accurately detect objects and their relationships in an image and represent them as a scene graph. The proposed model utilizes several multimodal features, including linguistic features and visual context features, to accurately detect objects and relationships. In addition, in the proposed model, context features are embedded using graph neural networks to depict the dependencies between two related objects in the context feature vector. This study demonstrates the effectiveness of the proposed model through comparative experiments using the Visual Genome benchmark dataset.

• Structural Engineering and Mechanics
• /
• v.18 no.4
• /
• pp.441-459
• /
• 2004

This paper explores the potential use of neural networks (NNs) in the field of contact mechanics. A neural network model is developed for predicting, with sufficient approximation, the contact lengths between the elastic layer and two elastic circular punches. A backpropagation neural network of three layers is employed. First contact problem is solved according to the theory of elasticity with integral transformation technique, and then the results are used to train the neural network. The effectiveness of different neural network configurations is investigated. Effect of parameters such as load factor, elastic punch radii and flexibilities that influence the contact lengths is also explored. The results of the theoretical solution and the outputs generated from the neural network are compared. Results indicate that NN predicted the contact length with high accuracy. It is also demonstrated that NN is an excellent method that can reduce time consumed.

• The Journal of the Acoustical Society of Korea
• /
• v.18 no.3
• /
• pp.62-67
• /
• 1999

In this paper, we investigates a reliable model of the Predictive Recurrent Neural Network for the speech recognition. Predictive Neural Networks are modeled by syllable units. For the given input syllable, then a model which gives the minimum prediction error is taken as the recognition result. The Predictive Neural Network which has the structure of recurrent network was composed to give the dynamic feature of the speech pattern into the network. We have compared with the recognition ability of the Recurrent Network proposed by Elman and Jordan. ETRI's SAMDORI has been used for the speech DB. In order to find a reliable model of neural networks, the changes of two recognition rates were compared one another in conditions of: (1) changing prediction order and the number of hidden units: and (2) accumulating previous values with self-loop coefficient in its context. The result shows that the optimum prediction order, the number of hidden units, and self-loop coefficient have differently responded according to the structure of neural network used. However, in general, the Jordan's recurrent network shows relatively higher recognition rate than Elman's. The effects of recognition rate on the self-loop coefficient were variable according to the structures of neural network and their values.

• Journal of The Korean Society of Agricultural Engineers
• /
• v.61 no.2
• /
• pp.63-74
• /
• 2019

The objective of this study was to evaluate the influence of rainfall observation network on daily dam inflow using artificial neural networks(ANNs). Chungju Dam and Soyangriver Dam were selected for the study watershed. Rainfall and dam inflow data were collected as input data for construction of ANNs models. Five ANNs models, represented by Model 1 (In watershed, point rainfall), Model 2 (All in the Thiessen network, point rainfall), Model 3 (Out of watershed in the Thiessen network, point rainfall), Model 1-T (In watershed, area mean rainfall), Model 2-T (All in the Thiessen network, area mean rainfall), were adopted to evaluate the influence of rainfall observation network. As a result of the study, the models that used all station in the Thiessen network performed better than the models that used station only in the watershed or out of the watershed. The models that used point rainfall data performed better than the models that used area mean rainfall. Model 2 achieved the highest level of performance. The model performance for the ANNs model 2 in Chungju dam resulted in the $R^2$ value of 0.94, NSE of 0.94 $NSE_{ln}$ of 0.88 and PBIAS of -0.04 respectively. The model-2 predictions of Soyangriver Dam with the $R^2$ and NSE values greater than 0.94 were reasonably well agreed with the observations. The results of this study are expected to be used as a reference for rainfall data utilization in forecasting dam inflow using artificial neural networks.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.48 no.10
• /
• pp.1231-1238
• /
• 1999

This paper presents an approach for the optimal heating load Identification using Diagonal Recurrent Neural Networks(DRNN). In this paper, the DRNN captures the dynamic nature of a system and since it is not fully connected, training is much faster than a fully connected recurrent neural network. The architecture of DRNN is a modified model of the fully connected recurrent neural network with one hidden layer. The hidden layer is comprised of self-recurrent neurons, each feeding its output only into itself. In this study, A dynamic backpropagation (DBP) with delta-bar-delta learning method is used to train an optimal heating load identifier. Delta-bar-delta learning method is an empirical method to adapt the learning rate gradually during the training period in order to improve accuracy in a short time. The simulation results based on experimental data show that the proposed model is superior to the other methods in most cases, in regard of not only learning speed but also identification accuracy.

• Korean Journal of Air-Conditioning and Refrigeration Engineering
• /
• v.16 no.9
• /
• pp.838-844
• /
• 2004

In a long road tunnel, a tunnel ventilation system may be used in order to reduce the pollution below the required level. To develop control algorithms for a tunnel ventilation system, a dynamic simulation program may be used to predict the pollution level in a tunnel. Research was carried out to develop better pollution models for a tunnel ventilation control system. A neural network structure was adopted and compared by using actual poilution data. Simulation results showed that the dynamic model developed by a neural network may be effective for the development of tunnel ventilation control algorithms.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.32B no.11
• /
• pp.1489-1495
• /
• 1995

In this paper, we propose recurrent neural prediction models (RNPM), recurrent neural networks trained as a nonlinear predictor of speech, as a new connectionist model for speech recognition. RNPM modulates its mapping effectively by internal representation, and it requires no time alignment algorithm. Therefore, computational load at the recognition stage is reduced substantially compared with the well known predictive neural networks (PNN), and the size of the required memory is much smaller. And, RNPM does not suffer from the problem of deciding the time varying target function. In the speaker dependent and independent speech recognition experiments under the various conditions, the proposed model was comparable in recognition performance to the PNN, while retaining the above merits that PNN doesn't have.