• KIPS Transactions on Software and Data Engineering
• /
• v.10 no.4
• /
• pp.143-152
• /
• 2021

It is very important to learn behavioral policies that allow multiple agents to work together organically for common goals in various real-world applications. In this multi-agent reinforcement learning (MARL) environment, most existing studies have adopted centralized training with decentralized execution (CTDE) methods as in effect standard frameworks. However, this multi-agent reinforcement learning method is difficult to effectively cope with in a dynamic environment in which new environmental changes that are not experienced during training time may constantly occur in real life situations. In order to effectively cope with this dynamic environment, this paper proposes a novel multi-agent reinforcement learning system, C-COMA. C-COMA is a continual learning model that assumes actual situations from the beginning and continuously learns the cooperative behavior policies of agents without dividing the training time and execution time of the agents separately. In this paper, we demonstrate the effectiveness and excellence of the proposed model C-COMA by implementing a dynamic mini-game based on Starcraft II, a representative real-time strategy game, and conducting various experiments using this environment.

• Economic and Environmental Geology
• /
• v.6 no.1
• /
• pp.29-64
• /
• 1973

A land resources survey in the semi-arid area, Mula in S. E. Spain, of $400km^2$ is compiled. The basic aim of the project is to investigate the intrinsic qualities of the land resources of the area by means of applying an integrated method of natural resources survey mainly concerning with analysis and synthesis of land complexes, each of them represents an area or a group of areas with similar patterns of landforms, soils and vegetation, based on a geomorphological approach. The area is characterized by a linear arrangement of relief pattern with an asymmetric homoclinal repetition of slope attitudes elongating WSW-ENE, dipping steeply on the NW sides and gently on the SE sides, which have been resulted from the post-Alpine folding of the Triassic to Cretaceous limestone, the Eocene limestone, the Oligocene sandstone and the lower Miocene limestone and marl, and the post-lower Miocene faulting, tilting and subsequent differential erosion of the Miocene sedimentary formations. An integrated body of information in geology, landforms, soils and vegetation, which are significantry interrelated as an environmental complex, has been obtained. Using this data, 26 land complexes developing on the various situations of landforms, such as folded mountain ranges, tilted tablelands, bevelled cuestas, degraded hill-lands associating with enormous foots lopes, undulating terrains and terraced or flat plains, have been differentiated, mapped and described. The soils of the area are mostly light colored calcic lithosols which have been derived dominantly from the marly parent materials and developed into remarkable slope catenas in some places depending on the relief conditions. The land uses of the area are mainly characterized by the perennially irrigated cultivation of citrus orchards along the terraced alluvial deposits fringing the Segura and Mula River, and the dry-land cereal cultivation on gentler slopes. Pioneer dry-land cultivations within the shrubs on steeper slopes are restricted to the unchannelled tributary drainage floors. The availability of water is a fundamental controlling factor for existence of native and cultivated vegetation as a whole, and a number of active processes including sheet wash and gully erosion, especially on the scarp slopes, are the other important factors to be considered in conservation and management of the land in the area.

• Computers and Concrete
• /
• v.10 no.5
• /
• pp.457-467
• /
• 2012

Using appropriate raw materials for cement is crucial for providing the required products. Monitoring relationships and analyzing distributions in a cement material quarry are important stages in the process. CaO, one of the substantial chemical components, is included in some raw materials such as limestone and marl; furthermore, appraising spatial assessment of this chemical component is also very critical. In this study, spatial evaluation and monitoring of CaO concentrations in a cement site are considered. For this purpose, two effective regression-based models were applied to a cement quarry located in Turkey. For the assessment, some spatial models were developed and performance comparisons were carried out. The results show that the regression-based spatial modelling is an efficient methodology and it can be employed to evaluate spatially varying relationships in a cement quarry.

• Proceedings of the Korean Geotechical Society Conference
• /
• 2010.03a
• /
• pp.435-441
• /
• 2010

In this study, numerical simulations were carried out to investigate the effect of verification core hole on the shaft tip capacity. The verification core extreted at shaft tip may deteriorate the shaft tip capacity when the clay shales (Taylor Marl) surrounding the shaft degrades and the empty core hole remains unfilled. Series of finite element analyses were conducted using Mohr-Coulomb model with total stress material parameters that were obtained from laboratory testing. The numerical analyses indicate that the shaft tip capacity does not decrease for most cases, and the maximum reduction does not exceed 5%.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.45 no.1
• /
• pp.74-82
• /
• 2003

In this paper, an experimental program was undertaken to test the analysis on Component and mechanical characteristics for crushed stone of excavated Rocks from Sandstone, Shale, Mudstone, for use as a new source of aggregate. Physical and mechanical properties, required for aggregate materials, of major constituents of rock wastes including Sandstone, Shale, Mudstone, Felsite, Basalt, Marl were measured in the laboratory Test results showed that the Shale, Felsite, Basalt tested in this study might possibly be used for construction aggregates. In case of Sandstone and Mudstone, some physical properties such as rock strength were generally adoptable but the aggregate characteristics were lower than required.

• Geomechanics and Engineering
• /
• v.21 no.1
• /
• pp.53-62
• /
• 2020

Rheological processes in the rock mass for the stress-strain analysis are quite important when considering the construction of underground structures in soft rock masses, particularly in case of construction in several stages. In the analysis, it can be assumed that the reinforced concrete structure is slightly deformable in relation to the rock mass, and the rheological stress redistribution happens at the expense of the elements of rock mass. The basic elements of rheological models for certain types of rock mass and analysis of these models are presented in the first part of this paper. The second part is dedicated to the analysis of rheological processes in marl rock mass and the influence of these processes on the reinforced-concrete tunnel structure.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2020.11a
• /
• pp.988-991
• /
• 2020

다양한 실세계 응용 분야들에서 공동의 목표를 위해 여러 에이전트들이 상호 유기적으로 협력할 수 있는 행동 정책을 배우는 것은 매우 중요하다. 이러한 다중 에이전트 강화 학습(MARL) 환경에서 기존의 연구들은 대부분 중앙-집중형 훈련과 분산형 실행(CTDE) 방식을 사실상 표준 프레임워크로 채택해왔다. 하지만 이러한 다중 에이전트 강화 학습 방식은 훈련 시간 동안에는 경험하지 못한 새로운 환경 변화가 실전 상황에서 끊임없이 발생할 수 있는 동적 환경에서는 효과적으로 대처하기 어렵다. 이러한 동적 환경에 효과적으로 대응하기 위해, 본 논문에서는 새로운 다중 에이전트 강화 학습 체계인 C-COMA를 제안한다. C-COMA는 에이전트들의 훈련 시간과 실행 시간을 따로 나누지 않고, 처음부터 실전 상황을 가정하고 지속적으로 에이전트들의 협력적 행동 정책을 학습해나가는 지속 학습 모델이다. 본 논문에서는 대표적인 실시간 전략게임인 StarcraftII를 토대로 동적 미니게임을 구현하고 이 환경을 이용한 다양한 실험들을 수행함으로써, 제안 모델인 C-COMA의 효과와 우수성을 입증한다.

• Electronics and Telecommunications Trends
• /
• v.38 no.4
• /
• pp.95-103
• /
• 2023

The importance of the decentralized training with decentralized execution (DTDE) framework is well-known in the study of multiagent reinforcement learning. In many real-world environments, agents cannot share information. Hence, they must be trained in a decentralized manner. However, the DTDE framework has been less studied than the centralized training with decentralized execution framework. One of the main reasons is that many problems arise when training agents in a decentralized manner. For example, DTDE algorithms are often computationally demanding or can encounter problems with non-stationarity. Another reason is the lack of simulation environments that can properly handle the DTDE framework. We discuss current research trends in the DTDE framework.

• ETRI Journal
• /
• v.45 no.5
• /
• pp.735-745
• /
• 2023

This paper surveys recent multiagent reinforcement learning and neural Myerson auction deep learning efforts to improve mobility control and resource management in autonomous ground and aerial vehicles. The multiagent reinforcement learning communication network (CommNet) was introduced to enable multiple agents to perform actions in a distributed manner to achieve shared goals by training all agents' states and actions in a single neural network. Additionally, the Myerson auction method guarantees trustworthiness among multiple agents to optimize rewards in highly dynamic systems. Our findings suggest that the integration of MARL CommNet and Myerson techniques is very much needed for improved efficiency and trustworthiness.

• Geomechanics and Engineering
• /
• v.9 no.4
• /
• pp.483-498
• /
• 2015

This article describes a new in-situ load test called the Hydraulic Cylinder Test (HCT) and its application to determine the geotechnical properties of soil-rock mixtures. The main advantages of the test are its easy implementation, speed of execution and low-cost. This article provides a detailed description of the equipment and the test procedure, and examines a case study of its application to determine the geotechnical properties of an earth-filled dam for a tailings pond. The containment dams of the ponds are made from blocks of gypsum and marl, obtained from the excavation of the ponds, mixed in a matrix of sands and clays. The size of the rocks varies between 1 and 30 cm. The HCT is particularly useful for determining the geotechnical properties of this type of soil-rock mixture. Nine HCTs were carried out to determine its strength (c, ${\phi}$) and deformation (B, G) properties. The results obtained were validated using the Bim strength criterion, recently proposed, and some pressure meter tests carried out beforehand. The properties obtained are used to analyze the stability of the dam using computer simulations and a modification to its design is proposed.