• Title/Summary/Keyword: Multiple Output

Search Result 1,726, Processing Time 0.024 seconds

Deep Learning Architectures and Applications (딥러닝의 모형과 응용사례)

  • Ahn, SungMahn
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.2
    • /
    • pp.127-142
    • /
    • 2016
  • Deep learning model is a kind of neural networks that allows multiple hidden layers. There are various deep learning architectures such as convolutional neural networks, deep belief networks and recurrent neural networks. Those have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. Among those architectures, convolutional neural networks and recurrent neural networks are classified as the supervised learning model. And in recent years, those supervised learning models have gained more popularity than unsupervised learning models such as deep belief networks, because supervised learning models have shown fashionable applications in such fields mentioned above. Deep learning models can be trained with backpropagation algorithm. Backpropagation is an abbreviation for "backward propagation of errors" and a common method of training artificial neural networks used in conjunction with an optimization method such as gradient descent. The method calculates the gradient of an error function with respect to all the weights in the network. The gradient is fed to the optimization method which in turn uses it to update the weights, in an attempt to minimize the error function. Convolutional neural networks use a special architecture which is particularly well-adapted to classify images. Using this architecture makes convolutional networks fast to train. This, in turn, helps us train deep, muti-layer networks, which are very good at classifying images. These days, deep convolutional networks are used in most neural networks for image recognition. Convolutional neural networks use three basic ideas: local receptive fields, shared weights, and pooling. By local receptive fields, we mean that each neuron in the first(or any) hidden layer will be connected to a small region of the input(or previous layer's) neurons. Shared weights mean that we're going to use the same weights and bias for each of the local receptive field. This means that all the neurons in the hidden layer detect exactly the same feature, just at different locations in the input image. In addition to the convolutional layers just described, convolutional neural networks also contain pooling layers. Pooling layers are usually used immediately after convolutional layers. What the pooling layers do is to simplify the information in the output from the convolutional layer. Recent convolutional network architectures have 10 to 20 hidden layers and billions of connections between units. Training deep learning networks has taken weeks several years ago, but thanks to progress in GPU and algorithm enhancement, training time has reduced to several hours. Neural networks with time-varying behavior are known as recurrent neural networks or RNNs. A recurrent neural network is a class of artificial neural network where connections between units form a directed cycle. This creates an internal state of the network which allows it to exhibit dynamic temporal behavior. Unlike feedforward neural networks, RNNs can use their internal memory to process arbitrary sequences of inputs. Early RNN models turned out to be very difficult to train, harder even than deep feedforward networks. The reason is the unstable gradient problem such as vanishing gradient and exploding gradient. The gradient can get smaller and smaller as it is propagated back through layers. This makes learning in early layers extremely slow. The problem actually gets worse in RNNs, since gradients aren't just propagated backward through layers, they're propagated backward through time. If the network runs for a long time, that can make the gradient extremely unstable and hard to learn from. It has been possible to incorporate an idea known as long short-term memory units (LSTMs) into RNNs. LSTMs make it much easier to get good results when training RNNs, and many recent papers make use of LSTMs or related ideas.

Calculation of Soil Moisture and Evapotranspiration for KLDAS(Korea Land Data Assimilation System) using Hydrometeorological Data Set (수문기상 데이터 세트를 이용한 KLDAS(Korea Land Data Assimilation System)의 토양수분·증발산량 산출)

  • PARK, Gwang-Ha;LEE, Kyung-Tae;KYE, Chang-Woo;YU, Wan-Sik;HWANG, Eui-Ho;KANG, Do-Hyuk
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.24 no.4
    • /
    • pp.65-81
    • /
    • 2021
  • In this study, soil moisture and evapotranspiration were calculated throughout South Korea using the Korea Land Data Assimilation System(KLDAS) of the Korea-Land Surface Information System(K-LIS) built on the basis of the Land Information System (LIS). The hydrometeorological data sets used to drive K-LIS and build KLDAS are MERRA-2(Modern-Era Retrospective analysis for Research and Applications, version 2) GDAS(Global Data Assimilation System) and ASOS(Automated Synoptic Observing System) data. Since ASOS is a point-based observation, it was converted into grid data with a spatial resolution of 0.125° for the application of KLDAS(ASOS-S, ASOS-Spatial). After comparing the hydrometeorological data sets applied to KLDAS against the ground-based observation, the mean of R2 ASOS-S, MERRA-2, and GDAS were analyzed as temperature(0.994, 0.967, 0.975), pressure(0.995, 0.940, 0.942), humidity (0.993, 0.895, 0.915), and rainfall(0.897, 0.682, 0.695), respectively. For the hydrologic output comparisons, the mean of R2 was ASOS-S(0.493), MERRA-2(0.56) and GDAS (0.488) in soil moisture, and the mean of R2 was analyzed as ASOS-S(0.473), MERRA-2(0.43) and GDAS(0.615) in evapotranspiration. MERRA-2 and GDAS are quality-controlled data sets using multiple satellite and ground observation data, whereas ASOS-S is grid data using observation data from 103 points. Therefore, it is concluded that the accuracy is lowered due to the error from the distance difference between the observation data. If the more ASOS observation are secured and applied in the future, the less error due to the gridding will be expected with the increased accuracy.

A Phenomenological Interpretation on the Principle of 'Coincidentia Oppositorum' of Daesoon Thought (대순사상의 대대성 원리에 대한 현상학적 해석)

  • Chung, Byung-hwa
    • Journal of the Daesoon Academy of Sciences
    • /
    • v.33
    • /
    • pp.63-90
    • /
    • 2019
  • In pluralistic political realities that have been exposed as antagonistic relationships between self and others, the principle of 'Coincidentia Oppositorum' in Daesoon Thought emphasizes the complementarity between self and others and presents us with a new form of cognition and attitude which can overcome pluralistic political realities. Though solipsism that objectificates others on the basis of the self, the principle of 'Coincidentia Oppositorum' presents us a new form of cognition and attitude with which we can approach others. The principle of 'Coincidentia Oppositorum' is based on the logic that we can secure and extend ourselves only in relation between self and others. Self is not fully formed or perfected without others. Previous discussions on the principle of 'Coincidentia Oppositorum' as it is exists within Daesoon Thought have been limited to Eastern Philosophy. On one hand, this inclination may be due to a narrow understanding of Western Philosophy. The flow of Modern Western Philosophy can at times be a self-reflective output for solipsism. On the other hand, the understanding of the principle of 'Coincidentia Oppositorum in context of a dualistic contrast between Eastern Philosophy and Western Philosophy is not concordant with the principle of 'Coincidentia Oppositorum' which emphasizes the creation of harmony between self and others. This paper aims to investigate avenues to create harmony between Eastern Philosophy and Western Philosophy regarding the principle of 'Coincidentia Oppositorum' in Daesoon Thought. Specifically, attention will be paid to 'flesh' as used by Merleau-Ponty. In his writings, flesh is the matrix which activates the fundamental involvement between self and others. Self is a being of flesh and an ambiguous being which is formed in a double position (seeing and being seen). Flesh can secure and extend the self only through its relationship to an other or multiple others. Restoring the other that has been excluded from modern Western Philosophy, Merleau-Ponty's flesh call for contemplation into the meaning of the other and of otherness.

Proposal for the Hourglass-based Public Adoption-Linked National R&D Project Performance Evaluation Framework (Hourglass 기반 공공도입연계형 국가연구개발사업 성과평가 프레임워크 제안: 빅데이터 기반 인공지능 도시계획 기술개발 사업 사례를 바탕으로)

  • SeungHa Lee;Daehwan Kim;Kwang Sik Jeong;Keon Chul Park
    • Journal of Internet Computing and Services
    • /
    • v.24 no.6
    • /
    • pp.31-39
    • /
    • 2023
  • The purpose of this study is to propose a scientific performance evaluation framework for measuring and managing the overall outcome of complex types of projects that are linked to public demand-based commercialization, such as information system projects and public procurement, in integrated national R&D projects. In the case of integrated national R&D projects that involve multiple research institutes to form a single final product, and in the case of demand-based demonstration and commercialization of the project results, the existing evaluation system that evaluates performance based on the short-term outputs of the detailed tasks comprising the R&D project has limitations in evaluating the mid- and long-term effects and practicality of the integrated research products. (Moreover, as the paradigm of national R&D projects is changing to a mission-oriented one that emphasizes efficiency, there is a need to change the performance evaluation of national R&D projects to focus on the effectiveness and practicality of the results.) In this study, we propose a performance evaluation framework from a structural perspective to evaluate the completeness of each national R&D project from a practical perspective, such as its effectiveness, beyond simple short-term output, by utilizing the Hourglass model. In particular, it presents an integrated performance evaluation framework that links the top-down and bottom-up approaches leading to Tool-System-Service-Effect according to the structure of R&D projects. By applying the proposed detailed evaluation indicators and performance evaluation frame to actual national R&D projects, the validity of the indicators and the effectiveness of the proposed performance evaluation frame were verified, and these results are expected to provide academic, policy, and industrial implications for the performance evaluation system of national R&D projects that emphasize efficiency in the future.

Application of Support Vector Regression for Improving the Performance of the Emotion Prediction Model (감정예측모형의 성과개선을 위한 Support Vector Regression 응용)

  • Kim, Seongjin;Ryoo, Eunchung;Jung, Min Kyu;Kim, Jae Kyeong;Ahn, Hyunchul
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.185-202
    • /
    • 2012
  • .Since the value of information has been realized in the information society, the usage and collection of information has become important. A facial expression that contains thousands of information as an artistic painting can be described in thousands of words. Followed by the idea, there has recently been a number of attempts to provide customers and companies with an intelligent service, which enables the perception of human emotions through one's facial expressions. For example, MIT Media Lab, the leading organization in this research area, has developed the human emotion prediction model, and has applied their studies to the commercial business. In the academic area, a number of the conventional methods such as Multiple Regression Analysis (MRA) or Artificial Neural Networks (ANN) have been applied to predict human emotion in prior studies. However, MRA is generally criticized because of its low prediction accuracy. This is inevitable since MRA can only explain the linear relationship between the dependent variables and the independent variable. To mitigate the limitations of MRA, some studies like Jung and Kim (2012) have used ANN as the alternative, and they reported that ANN generated more accurate prediction than the statistical methods like MRA. However, it has also been criticized due to over fitting and the difficulty of the network design (e.g. setting the number of the layers and the number of the nodes in the hidden layers). Under this background, we propose a novel model using Support Vector Regression (SVR) in order to increase the prediction accuracy. SVR is an extensive version of Support Vector Machine (SVM) designated to solve the regression problems. The model produced by SVR only depends on a subset of the training data, because the cost function for building the model ignores any training data that is close (within a threshold ${\varepsilon}$) to the model prediction. Using SVR, we tried to build a model that can measure the level of arousal and valence from the facial features. To validate the usefulness of the proposed model, we collected the data of facial reactions when providing appropriate visual stimulating contents, and extracted the features from the data. Next, the steps of the preprocessing were taken to choose statistically significant variables. In total, 297 cases were used for the experiment. As the comparative models, we also applied MRA and ANN to the same data set. For SVR, we adopted '${\varepsilon}$-insensitive loss function', and 'grid search' technique to find the optimal values of the parameters like C, d, ${\sigma}^2$, and ${\varepsilon}$. In the case of ANN, we adopted a standard three-layer backpropagation network, which has a single hidden layer. The learning rate and momentum rate of ANN were set to 10%, and we used sigmoid function as the transfer function of hidden and output nodes. We performed the experiments repeatedly by varying the number of nodes in the hidden layer to n/2, n, 3n/2, and 2n, where n is the number of the input variables. The stopping condition for ANN was set to 50,000 learning events. And, we used MAE (Mean Absolute Error) as the measure for performance comparison. From the experiment, we found that SVR achieved the highest prediction accuracy for the hold-out data set compared to MRA and ANN. Regardless of the target variables (the level of arousal, or the level of positive / negative valence), SVR showed the best performance for the hold-out data set. ANN also outperformed MRA, however, it showed the considerably lower prediction accuracy than SVR for both target variables. The findings of our research are expected to be useful to the researchers or practitioners who are willing to build the models for recognizing human emotions.

The Recent Outcomes after Repair of Tetralogy of Fallot Associated with Pulmonary Atresia and Major Aortopulmonary Collateral Arteries (폐동맥폐쇄와 주대동맥폐동맥부행혈관을 동반한 활로씨사징증 교정의 최근 결과)

  • Kim Jin-Hyun;Kim Woong-Han;Kim Dong-Jung;Jung Eui-Suk;Jeon Jae-Hyun;Min Sun-Kyung;Hong Jang-Mee;Lee Jeong-Ryul;Rho Joon-Ryuang;Kim Yong-Jin
    • Journal of Chest Surgery
    • /
    • v.39 no.4 s.261
    • /
    • pp.269-274
    • /
    • 2006
  • Background: Tetralogy of Fallot (TOF) with pulmonary atresia and major aortopulmonary collateral arteries (MAPCAS) is complex lesion with marked heterogeneity of pulmonary blood supply and arborization anomalies. Patients with TOF with PA and MAPCAS have traditionally required multiple staged unifocalization of pulmonary blood supply before undergoing complete repair. In this report, we describe recent change of strategy and the results in our institution. Material and Method: We established surgical stratagies: early correction, central mediastinal approach, initial RV-PA conduit interposition, and aggressive intervention. Between July 1998 and August 2004, 23 patients were surgically treated at our institution. We divided them into 3 groups by initial operation method; group I: one stage total correction, group II: RV-PA conduit and unifocalization, group III: RV-PA conduit interposition only. Result: Mean ages at initial operation in each group were $13.9{\pm}16.0$ months (group 1), $10.4{\pm}15.6$ months (group II), and $7.9{\pm}7.7$ months (group III). True pulmonary arteries were not present in f patient and the pulmonary arteries were confluent in 22 patients. The balloon angioplasty was done in average 1.3 times (range: $1{\sim}6$). There were 4 early deaths relating initial operation, and 1 late death due to incracranial hemorrhage after definitive repair. The operative mortalities of initial procedures in each group were 25.0% (1/4: group I), 20.0% (2/10: group II), and 12.2% (1/9: group III). The causes of operative mortality were hypoxia (2), low cardiac output (1) and sudden cardiac arrest (1). Definitive repair rates in each group were 75% (3/4) in group I, 20% (2/10, fenestration: 2) in group II, and 55.0% (5/9, fenestration: 1) in group III. Conclusion: In patients of TOF with PA and MAPCAS, RV-PA connection as a initial procedure could be performed with relatively low risk, and high rate of definitive repair can be obtained in the help of balloon pulmonary angioplasty. One stage RV-PA connection and unifocalization appeared to be successful in selected patients.