• Title/Summary/Keyword: rewards

Search Result 479, Processing Time 0.028 seconds

Comparison of learning performance of character controller based on deep reinforcement learning according to state representation (상태 표현 방식에 따른 심층 강화 학습 기반 캐릭터 제어기의 학습 성능 비교)

  • Sohn, Chaejun;Kwon, Taesoo;Lee, Yoonsang
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.5
    • /
    • pp.55-61
    • /
    • 2021
  • The character motion control based on physics simulation using reinforcement learning continue to being carried out. In order to solve a problem using reinforcement learning, the network structure, hyperparameter, state, action and reward must be properly set according to the problem. In many studies, various combinations of states, action and rewards have been defined and successfully applied to problems. Since there are various combinations in defining state, action and reward, many studies are conducted to analyze the effect of each element to find the optimal combination that improves learning performance. In this work, we analyzed the effect on reinforcement learning performance according to the state representation, which has not been so far. First we defined three coordinate systems: root attached frame, root aligned frame, and projected aligned frame. and then we analyze the effect of state representation by three coordinate systems on reinforcement learning. Second, we analyzed how it affects learning performance when various combinations of joint positions and angles for state.

QLGR: A Q-learning-based Geographic FANET Routing Algorithm Based on Multi-agent Reinforcement Learning

  • Qiu, Xiulin;Xie, Yongsheng;Wang, Yinyin;Ye, Lei;Yang, Yuwang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.11
    • /
    • pp.4244-4274
    • /
    • 2021
  • The utilization of UAVs in various fields has led to the development of flying ad hoc network (FANET) technology. In a network environment with highly dynamic topology and frequent link changes, the traditional routing technology of FANET cannot satisfy the new communication demands. Traditional routing algorithm, based on geographic location, can "fall" into a routing hole. In view of this problem, we propose a geolocation routing protocol based on multi-agent reinforcement learning, which decreases the packet loss rate and routing cost of the routing protocol. The protocol views each node as an intelligent agent and evaluates the value of its neighbor nodes through the local information. In the value function, nodes consider information such as link quality, residual energy and queue length, which reduces the possibility of a routing hole. The protocol uses global rewards to enable individual nodes to collaborate in transmitting data. The performance of the protocol is experimentally analyzed for UAVs under extreme conditions such as topology changes and energy constraints. Simulation results show that our proposed QLGR-S protocol has advantages in performance parameters such as throughput, end-to-end delay, and energy consumption compared with the traditional GPSR protocol. QLGR-S provides more reliable connectivity for UAV networking technology, safeguards the communication requirements between UAVs, and further promotes the development of UAV technology.

Case Study Plan for Information Security SLA Performance System in Public Sector (공공부문 정보보안 SLA 성과체계 사례연구)

  • Jeong, Jae Ho;Kim, Huy Kang
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.31 no.4
    • /
    • pp.763-777
    • /
    • 2021
  • Information security started as an IT operation process and is now recognized as an important issue of information technology, and each international organization is newly defining the concept. Information security itself is a new combination of IT technologies, a set of technologies and a technology area. As IT outsourcing becomes common in many public sectors, SLAs are introduced to evaluate the level of IT services. In the area of information security, many studies have been conducted on the derivation and selection of SLA performance indicators, but it is difficult to find a way to apply the performance indicators to service level evaluation and performance systems. This thesis conducted a study on the application of a service evaluation system for information security performance indicators based on the public sector and a performance system including compensation regulations. It presents standards and rewards(incentive and penalty) that define expectation and targets of performance indicators that take into account the environment and characteristics of a specific public sector, and defines appropriate SLA costs. It proposes a change plan for the organizational structure for practical SLA application and service level improvement.

Effect of GGBS and fly ash on mechanical strength of self-compacting concrete containing glass fibers

  • Kumar, Ashish;Singh, Abhinav;Bhutani, Kapil
    • Advances in concrete construction
    • /
    • v.12 no.5
    • /
    • pp.429-437
    • /
    • 2021
  • In the era of building engineering the intensification of Self Compacting Concrete (SCC) is world-shattering magnetism. It has lot of rewards over ordinary concrete i.e., enrichment in production, cutback in manpower, brilliant retort to load and vibration along with improved durability. In the present study, the mechanical strength of CM-2 (SCC containing 10% of rice husk ash (RHA) as cement replacement and 600 grams of glass fibers per cubic meter) was investigated at various dosages of cement replacement by fly ash (FA) and GGBS. A total of 17 SCC mixtures including two control SCC mixtures (CM-1 and CM-2) were developed for investigating fresh and hardened properties in which, ten ternary cementitious blends of SCC by blending OPC+RHA+FA, OPC+RHA+GGBS and five quaternary cementitious blends (OPC+RHA+FA+GGBS) at different replacement dosages of FA and GGBS were developed with reference to CM-2. For constant water-cement ratio (0.42) and dosage of SP (2.5%), the addition of glass fibers (600 grams/m3) in CM-1 i.e., CM-2 shows lower workability but higher mechanical strength. While fly ash based ternary blends (OPC+RHA+FA) show better workability but lower mechanical strength as FA content increases in comparison to GGBS based ternary blends (OPC+RHA+GGBS) on increasing GGBS content. The pattern for mixtures appeared to exhibit higher workablity as that of the concentration of FA+GGBS rises in quaternary blends (OPC+RHA+FA+GGBS). A decrease in compressive strength at 7-days was noticed with an increase in the percentage of FA and GGBS as cement replacement in ternary and quaternary blended mixtures with respect to CM-2. The highest 28-days compressive strength (41.92 MPa) was observed for mix QM-3 and the lowest (33.18 MPa) for mix QM-5.

How to use Board Games in the Early Childhood Education Field - Based on the 2019 Revised Nuri-curriculum (개정 누리과정에 기초한 유아교육현장의 보드게임 활용 가능성)

  • Kim, Tae-Yeon
    • Journal of Korea Entertainment Industry Association
    • /
    • v.14 no.5
    • /
    • pp.147-158
    • /
    • 2020
  • The aims of this study were to examine the grounds for the appropriateness of board games in daycare centers and kindergartens based on the child-centered, play-centerd activities of revised Nuri-curriculum and provide basic resources by the case studies of board game activities in each area of the Nuri-curriculum. For these aims, it suggested the rationale of board game use in early childhood education field: first, the value as an activity with concrete objects based on developmentally appropriate practice (DAP), second, children's voluntary participation and immersion due to the competition and rewards in gamification, third, integrated experience across all areas of the Nuri-curriculum. Also, it provided various samples of the integrated board game activities for children, and reviewed the precaution, pros and cons that emerged during the play. This study discussed the possibility and direction of board game activities in early childhood education and provided implications for organizing board game activities in the education field and developing new board game contents.

Suggestion of Guidelines for Separation System According to Recycling Separate Discharge (재활용 분리배출에 따른 분리 체계 가이드라인 제안)

  • Moon, Seon-Young;Kim, Seung-In
    • Journal of Digital Convergence
    • /
    • v.20 no.2
    • /
    • pp.399-405
    • /
    • 2022
  • This study suggests focused in user-centered design which are new separate discharge system that must recycle in paper materials. I searched cases in Korea's current law and regulation in recycling disposal guidelines and already succeed cases in each city that are Asia, Europe, and North America. Suggesting focused in user-centered design of ID(Identification) separate discharge system due to user's good participations, feedbacks of participation's results, and well-organized in awarding. This system consists of visual individual's ID(Identification) that are stickered in only used bag. User must recycle in separate discharge system only used bags, and results must visualized in each user and rewards to user. This separate discharge system is meaning to stimulate user's good participations.

A Study on Employee Reward in Construction Companies Using Activity-Based Costing (활동기준원가계산을 이용한 건설기업의 직원 보상에 관한 연구)

  • Cho, Jin-Ho;Kim, Byung-Soo
    • Land and Housing Review
    • /
    • v.13 no.2
    • /
    • pp.125-139
    • /
    • 2022
  • For construction companies to become competitive innovative, cost management as well as process improvement are required. Activity-based costing (ABC), which uses cost information to support long-term decision-making, is a tool that enhances a company's competitiveness. In this study, we compare and analyze tradition-based costing (TBC) and ABC to confirm the adequacy of performance-based costing. In addition, we will empirically examine the relationship between the impact of the reward system using ABC on employee satisfaction and involvement. In research results, the influence of the reward system on employee involvement appeared in the order of intrinsic reward (𝛽 = 0.338) and extrinsic reward (𝛽 = 0.308). In addition, the reward system showed positive (+) effects on employee satisfaction, with influence appearing in the order of intrinsic reward (𝛽 = 0.360) and extrinsic reward (𝛽 = 0.337). And employee satisfaction (𝛽 = 0.225) had a positive effect on involvement. We were able to confirm that it is necessary to build a reward system consisting of intrinsic and extrinsic rewards to increase employee satisfaction and involvement.

Q-Learning Policy Design to Speed Up Agent Training (에이전트 학습 속도 향상을 위한 Q-Learning 정책 설계)

  • Yong, Sung-jung;Park, Hyo-gyeong;You, Yeon-hwi;Moon, Il-young
    • Journal of Practical Engineering Education
    • /
    • v.14 no.1
    • /
    • pp.219-224
    • /
    • 2022
  • Q-Learning is a technique widely used as a basic algorithm for reinforcement learning. Q-Learning trains the agent in the direction of maximizing the reward through the greedy action that selects the largest value among the rewards of the actions that can be taken in the current state. In this paper, we studied a policy that can speed up agent training using Q-Learning in Frozen Lake 8×8 grid environment. In addition, the training results of the existing algorithm of Q-learning and the algorithm that gave the attribute 'direction' to agent movement were compared. As a result, it was analyzed that the Q-Learning policy proposed in this paper can significantly increase both the accuracy and training speed compared to the general algorithm.

Suggestions for Utilization of Supporters To Promote Public Libraries (공공도서관 홍보를 위한 서포터즈 활용에 대한 제언)

  • Lee, Seongsin;Beack, Sumin
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.33 no.3
    • /
    • pp.103-122
    • /
    • 2022
  • The purpose of this study is to suggest for utilization of supporters to promote public libraries. To achieve the study purpose, in-depth interview with nine public library supporters of two public libraries was conducted. The data were analyzed using a qualitative method. The order in which the data analyzed is as follows: segmenting, first coding, in-depth coding, and theme discovery. According to the study results, the followings were suggested for the operation of public library supporters: 1) needed to assign roles based on supporters' capabilities and personal characteristic, 2) needed proactive role by the librarian in charge, 3) needed proactive role by the public library, 4) needed adequate rewards, 5) needed prior education about the public library.

Current status of interprofessional education learning activities in wards provided by tertiary hospitals and secondary general hospitals and barriers

  • Kang, Joonsung;Sin, Hye Yeon
    • Korean Journal of Clinical Pharmacy
    • /
    • v.32 no.2
    • /
    • pp.106-115
    • /
    • 2022
  • Background: The World Health Organization (WHO) has focused on the need for interprofessional education (IPE) to improve interprofessional collaboration competency and patient health outcomes. Accordingly, most European and North American medical colleges have established IPE for students. However, IPE learning activity in medical wards for the clinical experience of pharmacy students has not been fully reviewed in Korea. Therefore, this study aims to examine the current status of IPE learning activities in wards at tertiary and secondary hospitals in order to identify ways to improve the program. Methods: The official document of cooperation consists of six self-administered questions regarding IPE learning activities in wards. The preceptor's response in each hospital was evaluated. Results: Of the 22 hospitals, 9 tertiary hospitals and 12 secondary general hospitals responded. For the introductory pharmacy practice experience (IPPE), participating in intensive care (IC) was provided at one secondary general hospital (8.3%) and no tertiary hospital. Ward rounds with medical staff members were provided at two tertiary hospitals (22.2%) and one (8.3%) secondary general hospital. A major barrier to executing IPE was lack of rewards and incentives for the faculty and preceptors who participated in the program. Conclusion: In both tertiary hospitals and secondary general hospitals, pharmacy students have limited exposure to IPE learning activities in wards at hospital, and IPPE at most hospitals was carried out in pharmacy settings only. This study suggests that it is necessary for the hospitals to improve and support IPE learning activities in wards in order to improve learners' competency.