• Journal of Internet Computing and Services
• /
• v.21 no.5
• /
• pp.1-7
• /
• 2020

Deep neural networks(DNN), which are used as approximation functions in reinforcement learning (RN), theoretically can be attributed to realistic results. In empirical benchmark works, time difference learning (TD) shows better results than Monte-Carlo learning (MC). However, among some previous works show that MC is better than TD when the reward is very rare or delayed. Also, another recent research shows when the information observed by the agent from the environment is partial on complex control works, it indicates that the MC prediction is superior to the TD-based methods. Most of these environments can be regarded as 5-step Q-learning or 20-step Q-learning, where the experiment continues without long roll-outs for alleviating reduce performance degradation. In other words, for networks with a noise, a representative network that is regardless of the controlled roll-outs, it is better to learn MC, which is robust to noisy rewards than TD, or almost identical to MC. These studies provide a break with that TD is better than MC. These recent research results show that the way combining MC and TD is better than the theoretical one. Therefore, in this study, based on the results shown in previous studies, we attempt to exploit a random balance with a mixture of TD and MC in RL without any complicated formulas by rewards used in those studies do. Compared to the DQN using the MC and TD random mixture and the well-known DQN using only the TD-based learning, we demonstrate that a well-performed TD learning are also granted special favor of the mixture of TD and MC through an experiments in OpenAI Gym.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2008.05a
• /
• pp.967-970
• /
• 2008

The liver cancer in our country cancerous occurrence frequency to be the gastric cancer in the common cancer, to initially at second unique condition or symptom after the case which is slowly advanced without gets condition many the case which will be diagnosed in the liver cancer, most there was not a reasonable treatment method especially and if what kind of its treated and convalescence of the patient non quantity one, the case which will be discovered in early rising the treatment record was considered seriously about under the early detection. The system which it sees with the system for the early detection of the liver cancer reacts the blood of the control group other than the patient who is confirmed as the liver cancer and the liver cancer to the bio chip and bio chip Profiles mechanical studying leads and it is a system which it classifies. 1149 each other it reacted blood samples of the control group other than the liver cancer patient who is composed of the total 50 samples and the liver cancer which is composed of 100 samples to the bio chip which is composed with different oligo from the present paper and it was a data which it makes acquire worker the neural network it led and it analyzes the classification efficiency of the result $92{\sim}96%$ which it was visible.

• Journal of Korea Water Resources Association
• /
• v.31 no.6
• /
• pp.727-739
• /
• 1998

The main objectives o reservoir optimal operation can be described as follows : maximization of the benefits through optimal allocation of the limited water resources for various purpose; minimization of t도 costs by the flood damage in potential damaging regions and risk of dam failure, etc. through safe drainage of a bulky volume of excessive water by a proper reservoir operation. Reviewing the past research works related to reservoir operation, we can find that the study on the matter of the former has been extensively carried out in last decades rather than the matter of the latter. This study is focused on developing a methodology of optimal reservoir operation for flood control, and a case study is performed on the Chungju multipurpose reservoir in Korea. The final goal of the study is to establish a reservoir optimal operation system which can search optimal policy to compromise two conflicting objectives: downstream flood damage and dam safety-upstream flood damage. In order to reach the final goal of the study, the following items were studied : (1)validation of hydrological data using HYMOS: (2)establishment of a downstream flood routing model coupling a rainfall-runoff model and SOBEK system for 1-D hydrodynamic flood routing; (3)replication of a flood damage estimation model by a neural network; (4)development of an integrated reservoir optimization module for an optimal operation policy.

• Resources Recycling
• /
• v.26 no.6
• /
• pp.73-83
• /
• 2017

Used small household appliances have a wide variety of product types and component materials, and contain high percentage of black plastics. However, they are not being recycled efficiently as conventional sensors such as near-infrared ray (NIR), etc. are not able to detect black plastic by types. In the present study, an automatic sorting system was developed based on laser-induced breakdown spectroscopy (LIBS) to promote the recycling of waste plastics. The system we developed mainly consists of sample feeder, automatic position recognition system, LIBS device, separator and control unit. By applying laser pulse on the target sample, characteristic spectral data can be obtained and analyzed by using CCD detectors. The obtained data was then treated by using a classifier, which was developed based on artificial intelligent algorithm. The separation tests on waste plastics also were carried out by using a lab-scale automatic sorting system and the test results will be discussed. The classification rate of the radial basis neural network (RBFNNs) classifier developed in this study was about > 97%. The recognition rate of the black plastic by types with the automatic sorting system was more than 94.0% and the sorting efficiency was more than 80.0%. Automatic sorting system based on LIBS technology is in its infant stage and it has a high potential for utilization in and outside Korea due to its excellent economic efficiency.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.39 no.11
• /
• pp.1123-1129
• /
• 2015

A pair of two-way valves typically is used in automotive washing machines, where the water flow direction is frequently reversed and highly pressurized clean water is sprayed to remove the oil and dirt remaining on machined engine and transmission blocks. Although this valve system has been widely used because of its competitive price, its application is sometimes restricted by surging effects, such as pressure ripples occurring in rapid changes in water flow caused by inaccurate valve control. As an alternative, one three-way reversing valve can replace the valve system because it provides rapid and accurate changes to the water flow direction without any precise control device. However, a cavitation effect occurs because of the complicated bottom plug shape of the valve. In this study, the cavitation index and percent of cavitation (POC) were introduced to numerically evaluate fluid flows via computational fluid dynamics (CFD) analysis. To reduce the cavitation effect generated by the bottom plug, the optimal shape design was carried out through a parametric study, in which a simple computer-aided engineering (CAE) model was applied to avoid time-consuming CFD analysis and difficulties in achieving convergence. The optimal shape design process using full factorial design of experiments (DOEs) and an artificial neural network meta-model yielded the optimal waist and tail length of the bottom plug with a POC value of less than 30%, which meets the requirement of no cavitation occurrence. The optimal waist length, tail length and POC value were found to 6.42 mm, 6.96 mm and 27%, respectively.

• The Korean Journal of Physiology and Pharmacology
• /
• v.2 no.3
• /
• pp.297-305
• /
• 1998

This study used in vivo intracellular recording in rat hippocampus to evaluate the effect of lidocaine and MK-801 on the membrane properties and the synaptic responses of individual neurons to electrical stimulation of the commissural pathway. Cells in control group typically fired in a tonic discharge mode with an average firing frequency of $2.4{\pm}0.9$ Hz. Neuron in MK-801 treated group (0.2 mg/kg, i.p.) had an average input resistance of $3.28{\pm}5.7\;M{\Omega}$ and a membrane time constant of $7.4{\pm}1.8$ ms. These neurons exhibited $2.4{\pm}0.2$ ms spike durations, which were similar to the average spike duration recorded in the neurons of the control group. Slightly less than half of these neurons were firing spontaneously with an average discharge rate of $2.4{\pm}1.1$ Hz. The average peak amplitude of the AHP following the spikes in these groups was $7.4{\pm}0.6$ mV with respect to the resting membrane potential. Cells in MK-801 and lidocaine treated group (5 mg/kg, i.c.v.) had an average input resistance of $3.45{\pm}6.0\;M{\Omega}$ and an average time constant of $8.0{\pm}1.4$ ms. The cells were firing spontaneously at an average discharge rate of $0.6{\pm}0.4$ Hz. Upon depolarization of the membrane by 0.8 nA for 400 ms, all of the tested cells exhibited accommodation of spike discharge. The most common synaptic response contained an EPSP followed by early-IPSP and late-IPSP. Analysis of the voltage dependence revealed that the early-IPSP and late-IPSP were putative $Cl^--and\;K^+-dependent$, respectively. Systemic injection of the NMDA receptor blocker, MK-801, did not block synaptic responses to the stimulation of the commissural pathway. No significant modifications of EPSP, early-IPSP, or late-IPSP components were detected in the MK-801 and/or lidocaine treated group. These results suggest that MK-801 and lidocaine manifest their CNS effects through firing pattern of hippocampal pyramidal cells and neural network pattern by changing the synaptic efficacy and cellular membrane properties.

• Journal of Korea Water Resources Association
• /
• v.51 no.12
• /
• pp.1207-1216
• /
• 2018

Discharge or water level predictions at tidally affected river reaches are currently still a great challenge in hydrological practices. This research aims to predict water level of the tide dominated site, Jamsu bridge in the Han River downstream. Physics-based hydrodynamic approaches are sometimes not applicable for water level prediction in such a tidal river due to uncertainty sources like rainfall forecasting data. In this study, TensorFlow deep learning framework was used to build a deep neural network based LSTM model and its applications. The LSTM model was trained based on 3 data sets having 10-min temporal resolution: Paldang dam release, Jamsu bridge water level, predicted tidal level for 6 years (2011~2016) and then predict the water level time series given the six lead times: 1, 3, 6, 9, 12, 24 hours. The optimal hyper-parameters of LSTM model were set up as follows: 6 hidden layers number, 0.01 learning rate, 3000 iterations. In addition, we changed the key parameter of LSTM model, sequence length, ranging from 1 to 6 hours to test its affect to prediction results. The LSTM model with the 1 hr sequence length led to the best performing prediction results for the all cases. In particular, it resulted in very accurate prediction: RMSE (0.065 cm) and NSE (0.99) for the 1 hr lead time prediction case. However, as the lead time became longer, the RMSE increased from 0.08 m (1 hr lead time) to 0.28 m (24 hrs lead time) and the NSE decreased from 0.99 (1 hr lead time) to 0.74 (24 hrs lead time), respectively.

• Journal of Ginseng Research
• /
• v.45 no.3
• /
• pp.390-400
• /
• 2021

Background: We recently showed that gintonin, an active ginseng ingredient, exhibits antibrain neurodegenerative disease effects including multiple target mechanisms such as antioxidative stress and antiinflammation via the lysophosphatidic acid (LPA) receptors. Amyotrophic lateral sclerosis (ALS) is a spinal disease characterized by neurodegenerative changes in motor neurons with subsequent skeletal muscle paralysis and death. However, pathophysiological mechanisms of ALS are still elusive, and therapeutic drugs have not yet been developed. We investigate the putative alleviating effects of gintonin in ALS. Methods: The G93A-SOD1 transgenic mouse ALS model was used. Gintonin (50 or 100 mg/kg/day, p.o.) administration started from week seven. We performed histological analyses, immunoblot assays, and behavioral tests. Results: Gintonin extended mouse survival and relieved motor dysfunctions. Histological analyses of spinal cords revealed that gintonin increased the survival of motor neurons, expression of brain-derived neurotrophic factors, choline acetyltransferase, NeuN, and Nissl bodies compared with the vehicle control. Gintonin attenuated elevated spinal NAD(P) quinone oxidoreductase 1 expression and decreased oxidative stress-related ferritin, ionized calcium-binding adapter molecule 1-immunoreactive microglia, S100β-immunoreactive astrocyte, and Olig2-immunoreactive oligodendrocytes compared with the control vehicle. Interestingly, we found that the spinal LPA1 receptor level was decreased, whereas gintonin treatment restored decreased LPA1 receptor expression levels in the G93A-SOD1 transgenic mouse, thereby attenuating neurological symptoms and histological deficits. Conclusion: Gintonin-mediated symptomatic improvements of ALS might be associated with the attenuations of neuronal loss and oxidative stress via the spinal LPA1 receptor regulations. The present results suggest that the spinal LPA1 receptor is engaged in ALS, and gintonin may be useful for relieving ALS symptoms.

• Geophysics and Geophysical Exploration
• /
• v.13 no.1
• /
• pp.80-87
• /
• 2010

This study was conducted to develop a reservoir modelling workflow to reproduce the heterogeneous distribution of effective permeability that impacts on the performance of SAGD (Steam Assisted Gravity Drainage), the in-situ bitumen recovery technique in the Athabasca Oil Sands. Lithologic facies distribution is the main cause of the heterogeneity in bitumen reservoirs in the study area. The target formation consists of sand with mudstone facies in a fluvial-to-estuary channel system, where the mudstone interrupts fluid flow and reduces effective permeability. In this study, the lithologic facies is classified into three classes having different characteristics of effective permeability, depending on the shapes of mudstones. The reservoir modelling workflow of this study consists of two main modules; facies modelling and permeability modelling. The facies modelling provides an identification of the three lithologic facies, using a stochastic approach, which mainly control the effective permeability. The permeability modelling populates mudstone volume fraction first, then transforms it into effective permeability. A series of flow simulations applied to mini-models of the lithologic facies obtains the transformation functions of the mudstone volume fraction into the effective permeability. Seismic data contribute to the facies modelling via providing prior probability of facies, which is incorporated in the facies models by geostatistical techniques. In particular, this study employs a probabilistic neural network utilising multiple seismic attributes in facies prediction that improves the prior probability of facies. The result of using the improved prior probability in facies modelling is compared to the conventional method using a single seismic attribute to demonstrate the improvement in the facies discrimination. Using P-wave velocity in combination with density in the multiple seismic attributes is the essence of the improved facies discrimination. This paper also discusses sand matrix porosity that makes P-wave velocity differ between the different facies in the study area, where the sand matrix porosity is uniquely evaluated using log-derived porosity, P-wave velocity and photographically-predicted mudstone volume.

• Korean Journal of Remote Sensing
• /
• v.33 no.5_2
• /
• pp.631-640
• /
• 2017

The estimation of rice yield affects the income of farmers as well as the fields related to agriculture. Moreover, it has an important effect on the government's policy making including the control of supply demand and the price estimation. Thus, it is necessary to build the crop yield estimation model and from the past, many studies utilizing empirical statistical models or artificial neural network algorithms have been conducted through climatic and satellite data. Presently, scientists have achieved successful results with deep learning algorithms in the field of pattern recognition, computer vision, speech recognition, etc. Among deep learning algorithms, the SSAE (Stacked Sparse AutoEncoder) algorithm has been confirmed to be applicable in the field of forecasting through time series data and in this study, SSAE was utilized to estimate the rice yield in South Korea. The climatic and satellite data were used as the input variables and different types of input data were constructed according to the period of rice growth in South Korea. As a result, the combination of the satellite data from May to September and the climatic data using the 16 day average value showed the best performance with showing average annual %RMSE (percent Root Mean Square Error) and region %RMSE of 7.43% and 7.16% that the applicability of the SSAE algorithm could be proved in the field of rice yield estimation.