• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 2005년도 추계학술대회 학술발표 논문집 제15권 제2호
• /
• pp.234-237
• /
• 2005

강화학습을 위한 많은 방법 중 정책 반복을 이용한 actor-critic 학습 방법이 많은 적용 사례를 통해서 그 가능성을 인정받고 있다. Actor-critic 학습 방법은 제어입력 선택 전략을 위한 actor 학습과 가치 함수 근사를 위한 critic 학습이 필요하다. 본 논문은 critic의 학습을 위해 빠른 수렴성을 보장하는 RLS(recursive least square)를 사용하고, actor의 학습을 위해 정책의 기울기(policy gradient)를 이용하는 새로운 알고리즘을 제안하였다. 그리고 이를 실험적으로 확인하여 제안한 논문의 성능을 확인해 보았다.

• 대한간호학회지
• /
• 제47권4호
• /
• pp.467-475
• /
• 2017

Purpose: This study aimed to identify the actor and partner effects of self-efficacy, marital adjustment, and social support on the health promoting behavior of Korean pregnant couples. Methods: Participants were 132 couples who met the eligibility criteria. Data were collected from June to November, 2016 at a community health center. The Actor-Partner Interdependence Model was used for analyzing the actor and partner effects of self-efficacy, marital adjustment, and social support on health promoting behavior. Results: The fitness indices for the model were GFI=0.90, NFI=0.92, CFI=0.91, TLI=0.90, and RMSEA=0.04, which satisfied the criteria. Self-efficacy had actor and partner effect on health promoting behavior of wives, but had only actor effect of on health promoting behavior of husbands. Marital adjustment showed actor and partner effect on the health promoting behavior of pregnant couples. Social support only had an actor effect on the health promoting behavior of wives. And, marital adjustment and social support had a mutual effect. Conclusion: This study indicates that the partner involvement is needed to develop health promotion programs for pregnant couples.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제11권4호
• /
• pp.267-274
• /
• 2011

Recently, actor-critic methods have drawn significant interests in the area of reinforcement learning, and several algorithms have been studied along the line of the actor-critic strategy. In this paper, we consider a new type of actor-critic algorithms employing the kernel methods, which have recently shown to be very effective tools in the various fields of machine learning, and have performed investigations on combining the actor-critic strategy together with kernel methods. More specifically, this paper studies actor-critic algorithms utilizing the kernel-based least-squares estimation and policy gradient, and in its critic's part, the study uses a sliding-window-based kernel least-squares method, which leads to a fast and efficient value-function-estimation in a nonparametric setting. The applicability of the considered algorithms is illustrated via a robot locomotion problem and a tunnel ventilation control problem.

• 대한간호학회지
• /
• 제48권2호
• /
• pp.154-166
• /
• 2018

Purpose: This study aimed to identify the actor and partner effects of health status, marital satisfaction, and self efficacy on retirement preparation in middle aged couples using the Actor-Partner Interdependence Model. Methods: Participants were 121 middle aged couples living in Seoul, Gyeonggi-do and Daegu City, Korea. All measures were self-administered. The collected data were analyzed using SPSS 20.0 and AMOS 20.0. Results: 1) Wife's self efficacy and marital satisfaction showed direct actor and partner effects on retirement preparation in middle aged couples. Wife's health status showed an indirect actor effect through wife's self efficacy and marital satisfaction on wife's retirement preparation, and showed an indirect partner effect through husband's self efficacy on husband's retirement preparation. 2) Husband's self efficacy and marital satisfaction showed only direct actor effect on retirement preparation. Health status among the husbands showed an indirect actor effect on husband's retirement preparation through their self efficacy and marital satisfaction, and an indirect partner effect through wife's marital satisfaction on wife's retirement preparation. 3) The actor effect size of health status on self efficacy and marital satisfaction was larger among husband's than wife's. Additionally, the partner effect size of health status on self efficacy and marital satisfaction was different between the two groups; however, the actor and partner effect size of self efficacy and marital satisfaction on retirement preparation was the same for husband and wife. Conclusion: The results of this study indicate that nursing intervention strategies for improving self efficacy and marital satisfaction are strongly needed to enhance retirement preparation of middle aged couples in Korean community.

• 한국지역사회생활과학회지
• /
• 제27권spc호
• /
• pp.557-571
• /
• 2016

This study examined the effects of the actor and partner according to the activity immersion conflict perceived by rural multicultural couples in terms of the self-esteem and happiness using Actor-Partner Interdependence Model (APIM). For this purpose, the data of 482 persons from 241 husband-immigrant women dyads were analyzed. As results of the analysis, only the effect of the actor among the actor and partner effect according to the activity immersion conflict affected the self-esteem significantly in both husband and immigrant women. Conflict, namely the actor and partner effect, affected the happiness in both the husband and immigrant women significantly. Second, the difference in the actor conflict level on activity immersion perceived by the couple according to the women's native country was significant in both husband and immigrant women. The level of actor conflict was highest in Vietnamese husbands and the Philippine women. On the other hand, the difference in the partner conflict level on the activity immersion according to the women's native country was significant only in the women, and the level of Vietnamese women was highest. Therefore, the characteristics in the level of actor and partner conflict on activity immersion was caused by the difference in the number of activity organizations participating between the husband and women. Based on the results, this study suggests some measures to reduce the conflict of couples through activity. In addition, some plans for a follow-up study using APIM are suggested.

• 아동학회지
• /
• 제38권2호
• /
• pp.37-50
• /
• 2017

Objective: The purpose of this study was to assess actor and partner effects of mothers' and fathers' parenting stress and family cohesion and flexibility on warm parenting behavior. Methods: The sample consisted of 1,471 couples from the Panel Study of Korean Children. The sample was drawn from the sixth wave of data collection, including mothers and fathers of children aged 60-66 months. Data were analyzed via actor-partner interdependence models. Results: The findings illustrated that the actor effect of parenting stress on warm parenting behavior was significant in mothers and fathers, but there was no partner effect. They also revealed that actor and partner effects were significant in relation to mothers' and father's parenting stress and family cohesion and flexibility. Moreover, there was an actor effect of family cohesion on warm parenting behavior for mothers and fathers, but its partner effect was significant only in mothers. Finally, the mediating effects of family cohesion and flexibility between parenting stress and warm parenting behavior was verified. Conclusion: The results highlight not only the need for dyadic data analysis for mothers and fathers but also the need to consider in depth the fathers' role in parenting. Additional implications are discussed.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제16권4호
• /
• pp.270-275
• /
• 2016

We present an approach for acceleration actor-critic algorithm for reinforcement learning with continuous action space. Actor-critic algorithm has already proved its robustness to the infinitely large action spaces in various high dimensional environments. Despite that success, the main problem of the actor-critic algorithm remains the same-speed of convergence to the optimal policy. In high dimensional state and action space, a searching for the correct action in each state takes enormously long time. Therefore, in this paper we suggest a search accelerating function that allows to leverage speed of algorithm convergence and reach optimal policy faster. In our method, we assume that actions may have their own distribution of preference, that independent on the state. Since in the beginning of learning agent act randomly in the environment, it would be more efficient if actions were taken according to the some heuristic function. We demonstrate that heuristically-accelerated actor-critic algorithm learns optimal policy faster, using Educational Process Mining dataset with records of students' course learning process and their grades.

• 전기전자학회논문지
• /
• 제25권4호
• /
• pp.644-649
• /
• 2021

Self-Imitation Learning은 간단한 비활성 정책 actor-critic 알고리즘으로써 에이전트가 과거의 좋은 경험을 활용하여 최적의 정책을 찾을 수 있도록 해준다. 그리고 actor-critic 구조를 갖는 강화학습 알고리즘에 결합되어 다양한 환경들에서 알고리즘의 상당한 개선을 보여주었다. 하지만 Self-Imitation Learning이 강화학습에 큰 도움을 준다고 하더라도 그 적용 분야는 actor-critic architecture를 가지는 강화학습 알고리즘으로 제한되어 있다. 본 논문에서 Self-Imitation Learning의 알고리즘을 가치 기반 강화학습 알고리즘인 DQN에 적용하는 방법을 제안하고, Self-Imitation Learning이 적용된 DQN 알고리즘의 학습을 다양한 환경에서 진행한다. 아울러 그 결과를 기존의 결과와 비교함으로써 Self-Imitation Leaning이 DQN에도 적용될 수 있으며 DQN의 성능을 개선할 수 있음을 보인다.

• 한국지능시스템학회논문지
• /
• 제15권7호
• /
• pp.893-898
• /
• 2005

강화학습 방법론 중 하나의 부류인 액터-크리틱 알고리즘은 제어압력 선택 문제에 있어서 최소한의 계산만을 필요로 하고, 확률적 정책을 명시정으로 다룰 수 있는 장점 때문에 최근에 인공지능 분야에서 많은 관심을 끌고 있다. 액터-크리틱 네트워크는 제어압력 선택 전략을 위한 액터 네트워크와 가치 함수 근사를 위한 크리틱 네트워크로 구성되며, 우수한 제어입력의 서택과 정화한 가치 함수 관사를 최대한 신속하게 달성하기 위하여, 학습 과정 동안 액터와 크리틱은 자신들의 파라미터 백터를 적응적으로 변화시키는 전략을 구사한다. 본 논문은 크리틱의 학습을 위해 빠른 수렴성을 보장하는 RLS (Recursive Least Square)를 사용하고, 액터의 학습을 위해 정책의 기울기(Policy Gradient)를 이용하는 새로운 종류의 알고리즘을 고려한다. 고려된 알고리즘의 적용 가능성은 두개의 링크를 갖는 로봇에 대한 실험을 통하여 예시된다.

• 한국지능시스템학회논문지
• /
• 제19권4호
• /
• pp.519-524
• /
• 2009

최근에 강화학습 기법은 기계학습 분야에서 많은 관심을 끌어왔다. 강화학습 관련 연구에서 가장 유력하게 사용되어 온 방법들로는 가치함수를 활용하는 기법, 제어규칙(policy) 탐색 기법 및 액터-크리틱 기법 등이 있는데, 본 논문에서는 이들 중 연속 상태 및 연속 입력을 갖는 문제를 위하여 액터-크리틱 기법의 틀에서 제안된 알고리즘들과 관련된 내용을 다룬다. 특히 본 논문은 퍼지 이론에 기반을 둔 액터-크리틱 계열 강화학습 기법인 ACFRL 알고리즘과, RLS 필터와 NAC(natural actor-critic) 기법에 기반을 둔 RLS-NAC 기법을 접목하는 방안을 집중적으로 고찰한다. 고찰된 방법론은 기는 로봇의 제어문제에 적용되고, 학습 성능의 비교로부터 얻어진 몇 가지 결과가 보고된다.