• Journal of Korea Multimedia Society
• /
• v.9 no.5
• /
• pp.649-657
• /
• 2006

Reinforcement Learning is a computational approach to learning whereby an agent take an action which maximize the total amount of reward it receives among possible actions within current state when interacting with a uncertain environment. Q-learning, one of the most active algorithm in Reinforcement Learning, is consist of rewards which is obtained when an agent take an action. But it has the problem with mapping real world to discrete states. When state spaces are very large, Q-learning suffers from time for learning. In constant, when the state space is reduced, many state spaces map to single state space. Because an agent only learns single action within many states, an agent takes an action monotonously. In this paper, to reduce time for learning and complement simple action, we propose the Q-learning using influence map(QIM). By using influence map and adjacent state space's learning result, an agent could choose proper action within uncertain state where an agent does not learn. When this paper compares simulation results of QIM and Q-learning, we show that QIM effects as same as Q-learning even thought QIM uses 4.6% of the Q-learning's state spaces. This is because QIM learns faster than Q-learning about 2.77 times and the state spaces which is needed to learn is reduced, so the occurred problem is complemented by the influence map.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2019.05a
• /
• pp.185-185
• /
• 2019

Sustaining future wheat production is challenged by anthropogenically forced climate warming and drying led by increased concentration of greenhouse gases all around the globe. Warming stresses, originating from the elevated $CO_2$ concentration, are continuously reported to have negative impacts on wheat growth and yield. Yet, elevated $CO_2$ concentration, despite being disparagingly blamed for promoting warming, is also associated with a phenomenon called $CO_2$ enrichment; in which wheat yield can improve due to the enhanced photosynthesis rates and less water loss through transpiration. The conflicting nature of climate warming and $CO_2$ enrichment and their interplay can have specific implications under different environments. It is established form the field and simulation studies that the two contrasting phenomena would act severely in their own respect under arid and semi-arid environments. Wheat is a dietary staple for masses in Pakistan. The country's wheat production system is under constant stress to produce more from irrigated agricultural lands, primarily lying under arid to semi-arid environments, to meet the rapidly growing domestic needs. This work comprehensively examines the warming impacts over wheat yield and water productivity (WP), with and without the inclusion of $CO_2$ enrichment, under semi-arid environment of Punjab which is the largest agricultural province of Pakistan. Future wheat yields and WPs were simulated by FAO developed AquaCrop model v 5.0. The model was run using the bias-correction climate change projections up to 2080 under two representative concentration pathways (RCP) scenarios: 4.5 and 8.5. Wheat yield and WPs decreased without considering the $CO_2$ enrichment effects owing to the elevated irrigation demands and accelerated evapotranspiration rates. The results suggested that $CO_2$ enrichment could help maintain the current yield and WPs levels during the 2030s (2021-2050); however, it might not withhold the negative climate warming impacts during the 2060s (2051-2080). Furthermore, 10 - 20 day backward shift in sowing dates could also help ease the constraints imposed by climate warming over wheat yields and WPs. Although, $CO_2$ enrichment showed promises to counteract the adverse climate warming impacts but the interactions between climate warming and $CO_2$ concentrations were quite uncertain and required further examination.

• Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
• /
• v.17 no.2
• /
• pp.127-137
• /
• 2019

Zr electrorefining is demonstrated herein using Zirlo tubes in a chloride-fluoride mixed molten salt in the presence of $AlF_3$. Cyclic voltammetry reveals a monotonic shift in the onset of metal reduction kinetics towards positive potential and an increase in intensity of the additional peaks associated with Zr-Al alloy formation with increasing $AlF_3$ concentration. Unlike the galvanostatic deposition mode, a radial plate-type Zr growth is evident at the top surface of the salt during Zr electrorefining at a constant potential of -1.2 V. The diameter of the plate-type Zr deposit gradually increases with increasing $AlF_3$ concentration. Scanning electron microscopy-energy-dispersive X-ray spectroscopy (SEM-EDX) and X-ray photoelectron spectroscopy (XPS) analyses for the plate-type Zr deposit show that trace amount of Al is incorporated as Zr-Al alloys with different chemical compositions between the top and bottom surface of the deposit. Addition of $AlF_3$ is effective in lowering the residual salt content in the deposit and in improving the current efficiency for Zr recovery.

• KIPS Transactions on Computer and Communication Systems
• /
• v.8 no.6
• /
• pp.127-138
• /
• 2019

The data response speed is a critical issue of cloud services because it directly related to the user experience. As such, the in-memory database is widely adopted in many cloud-based applications for achieving fast data response. However, the current implementation of the in-memory database is mostly based on the linked list-based hash table which cannot guarantee the constant data response time. Thus, cuckoo hashing was introduced as an alternative solution, however, there is a disadvantage that only half of the allocated memory can be used for storing data. Subsequently, bucketized cuckoo hashing (BCH) improved the performance of cuckoo hashing in terms of memory efficiency but still cannot overcome the limitation that the insert overhead. In this paper, we propose a data management solution called Wall Cuckoo which aims to improve not only the insert performance but also lookup performance of BCH. The key idea of Wall Cuckoo is that separates the data among a bucket according to the different hash function be used. By doing so, the searching range among the bucket is narrowed down, thereby the amount of slot accesses required for the data lookup can be reduced. At the same time, the insert performance will be improved because the insert is following up the operation of the lookup. According to analysis, the expected value of slot access required for our Wall Cuckoo is less than that of BCH. We conducted experiments to show that Wall Cuckoo outperforms the BCH and Sorting Cuckoo in terms of the amount of slot access in lookup and insert operations and in different load factor (i.e., 10%-95%).

• Korean Chemical Engineering Research
• /
• v.57 no.1
• /
• pp.118-123
• /
• 2019

In this study, the electrochemical characteristics of Graphite/Silicon/Pitch anode composites were analyzed to improve the low theoretical capacity of graphite as a lithium ion battery. The Graphite/Silica composites were synthesized by bonding silica onto polyvinylpyrrolidone coated graphite. The surface of used silica was treated with (3-Aminopropyl)triethoxysilane(APTES). Graphite/Silicon/Pitch composites were prepared by carbonization of petroleum pitch, the fabrication processes including the magnesiothermic reduction of nano silica to obtain silicon and varying the mass ratio of silica. The Graphite/Silicon/Pitch composites were analysed by XRD, SEM and XRD. Also the electrochemical performances of Graphite/Silicon/Pitch composite as the anode of lithium ion battery were investigated by constant current charge/discharge, rate performance, cyclic voltammetry and electrochemical impedance tests in the electrolyte of $LiPF_6$ dissolved in organic solvents (EC:DMC:EMC=1:1:1 vol%). The Graphite/Silicon/Pitch anode composite (silica 28.5 in weight) has better capacity (537 mAh/g). The cycle performance has an excellent capacity retention to 30th cycle of 95% and the retention rate capability of 98% in 0.1 C/0.2 C.

• Journal of the Korean Data Analysis Society
• /
• v.20 no.6
• /
• pp.3087-3099
• /
• 2018

Due to the constant changes of companies' global networks, the expansion of global e-commerce as well as the market-oriented global supply chain management, global enterprises are strategically selecting and entering into viable countries able to become global footholds. Therefore, this study aims to scrutinize the trend of changes in the global networks of Korean companies by analyzing the current overseas countries over the past decade. From the analysis, it has been found that there is a significant difference in the priorities of targeting countries among shipping, manufacturing and logistics companies. Logistics companies preferred to enter Germany first while they attached to a lower priority to Singapore. Manufacturing companies had a lower priority to advance to India, while they preferred to advance to Mexico; however, shipping companies were analyzed to prefer to enter the US. In addition, all of these companies identified the importance of securing volume and network by entering overseas markets to achieve economies of scale and scope and to maintain global competitiveness. Joint overseas expansion of manufacturers with shipping and logistics companies can be recommended to facilitate the entry and thus, enhance global competitiveness and service capabilities and also secure new growth engines.

• Food Science and Industry
• /
• v.52 no.3
• /
• pp.261-271
• /
• 2019

Gut microbiome have recently provided evidence that the gut microbiota are capable of greatly influencing all aspects of physiology and immunology. Although a number of recent studies have shown that probiotics can modulate gut microbiota structure, the mechanism underlying this effect remains to be elucidated. In a disease state, the relative abundances of beneficial gut bacteria are generally reduced, which is restored by constant probiotic supplementation. Oral administration of probiotics improved the disease state by (1) inducing differentiation and function of regulatory T cells, (2) reducing inflammatory response, (3) modulating the gut environment, and (4) increasing the proportions of short-chain fatty acid- or beneficial metabolite-producing gut microbiota including the genera Bifidobacterium, Faecalibacterium, Akkermansia, etc. In this review, current knowledge on how probiotics can influence host's health by altering gut microbiota structure and on how probiotics and beneficial gut bacteria can be applied as next-generation probiotics will be discussed.

• The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
• /
• v.24 no.2
• /
• pp.187-207
• /
• 2019

In order to develop a high performance ocean model, we used Julia, a Just-In-Time compile language, and to obtain the solution of the momentum equation, we made the code to solve the Poisson equation by the Successive Over-Relaxation method. And then we made two models to test Julia calculation codes. First, a simple channel form is modeled to test constant source/sink conditions. Second, the simplified Yellow Sea was modeled to test tidal forcing, Coriolis forces, and the effect of vertical eddy diffusivity coefficients. The model has been tested with a total of eight cases in the two scenarios. As a result of the test, the depth-averaged current speed of the three cases in Scenario 1 converged perfectly to the theoretical value, and that showed well a vertical flow velocity gradient due to the bottom friction. Also, the result of Scenario 2 represented well the amphidromic points of Yellow Sea and the tidal characteristics of mid-western and southwestern coast of Korea. Therefore, it is considered that the ocean model using Julia language has developed successfully, this suggests that the ocean model has come to the stage of successful transition from a classical compile language to a Just-In-Time compile language.

• Journal of the Microelectronics and Packaging Society
• /
• v.25 no.4
• /
• pp.53-58
• /
• 2018

Since the scaling-down of IC devices has been reached to their physical limitations, several innovative packaging technologies such as 3D packaging, embedded packaging, and fan-out wafer level packaging (FOWLP) are actively studied. In this study the fabrication of organic-inorganic dielectric material was evaluated for the use of multi-structured redistribution layers (RDL) in FOWLP. Compared to current organic dielectrics such as PI or PBO an organic-inorganic hybrid dielectric called polysilsesquioxane (PSSQ) can improve mechanical, thermal, and electrical stabilities. polysilsesquioxane has also an excellent advantage of simultaneous curing and patterning through UV exposure. The polysilsesquioxane samples were fabricated by spin-coating on 6-inch Si wafer followed by pre-baking and UV exposure. With the 10 minutes of UV exposure polysilsesquioxane was fully cured and showed $2{\mu}m$ line-pattern formation. And the dielectric constant of cured polysilsesquioxane dielectrics was ranged from 2.0 to 2.4. It has been demonstrated that polysilsesquioxane dielectric can be patterned and cured by UV exposure alone without a high temperature curing process.

• Korean Chemical Engineering Research
• /
• v.57 no.3
• /
• pp.344-350
• /
• 2019

Durability is very important for the commercialization of membranes and electrode assemblies (MEA) developed for proton exchange membrane fuel cells (PEMFC). Durability evaluation of stationary PEMFC MEA has a problem that the voltage change rate should be measured for a long time over 1000 hours under constant current conditions. In this study, the electrochemical durability evaluation protocol of membranes (OCV holding method) using to vehicle MEAs was applied to the stationary MEA for the purpose of shortening the durability evaluation time. After operation of the stationary and automobile MEA for 168 hours under conditions of OCV, cathode oxygen, $90^{\circ}C$ and relative humidity of 30%, I-V, LSV, CV, impedance and FER were measured and compared. When the hydrogen permeability, OCV change, ionic conductivity, and fluorine flow rate, which represent the durability of the membrane after degradation, were all examined, it was shown that durability of stationary MEA membrane was better than that of vehicles MEA membrane. In addition, the electrode degradation of stationary MEA was smaller than that of vehicles MEA after degradation operation. It was possible to evaluate in a short time using automotive protocol that the durability of stationary MEA was superior that of vehicle MEA in terms of membrane and the electrode.