• Title/Summary/Keyword: collaborative multi-task learning

Search Result 6, Processing Time 0.016 seconds

Avoiding collaborative paradox in multi-agent reinforcement learning

  • Kim, Hyunseok;Kim, Hyunseok;Lee, Donghun;Jang, Ingook
    • ETRI Journal
    • /
    • v.43 no.6
    • /
    • pp.1004-1012
    • /
    • 2021
  • The collaboration productively interacting between multi-agents has become an emerging issue in real-world applications. In reinforcement learning, multi-agent environments present challenges beyond tractable issues in single-agent settings. This collaborative environment has the following highly complex attributes: sparse rewards for task completion, limited communications between each other, and only partial observations. In particular, adjustments in an agent's action policy result in a nonstationary environment from the other agent's perspective, which causes high variance in the learned policies and prevents the direct use of reinforcement learning approaches. Unexpected social loafing caused by high dispersion makes it difficult for all agents to succeed in collaborative tasks. Therefore, we address a paradox caused by the social loafing to significantly reduce total returns after a certain timestep of multi-agent reinforcement learning. We further demonstrate that the collaborative paradox in multi-agent environments can be avoided by our proposed effective early stop method leveraging a metric for social loafing.

Human Action Recognition Using Pyramid Histograms of Oriented Gradients and Collaborative Multi-task Learning

  • Gao, Zan;Zhang, Hua;Liu, An-An;Xue, Yan-Bing;Xu, Guang-Ping
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.2
    • /
    • pp.483-503
    • /
    • 2014
  • In this paper, human action recognition using pyramid histograms of oriented gradients and collaborative multi-task learning is proposed. First, we accumulate global activities and construct motion history image (MHI) for both RGB and depth channels respectively to encode the dynamics of one action in different modalities, and then different action descriptors are extracted from depth and RGB MHI to represent global textual and structural characteristics of these actions. Specially, average value in hierarchical block, GIST and pyramid histograms of oriented gradients descriptors are employed to represent human motion. To demonstrate the superiority of the proposed method, we evaluate them by KNN, SVM with linear and RBF kernels, SRC and CRC models on DHA dataset, the well-known dataset for human action recognition. Large scale experimental results show our descriptors are robust, stable and efficient, and outperform the state-of-the-art methods. In addition, we investigate the performance of our descriptors further by combining these descriptors on DHA dataset, and observe that the performances of combined descriptors are much better than just using only sole descriptor. With multimodal features, we also propose a collaborative multi-task learning method for model learning and inference based on transfer learning theory. The main contributions lie in four aspects: 1) the proposed encoding the scheme can filter the stationary part of human body and reduce noise interference; 2) different kind of features and models are assessed, and the neighbor gradients information and pyramid layers are very helpful for representing these actions; 3) The proposed model can fuse the features from different modalities regardless of the sensor types, the ranges of the value, and the dimensions of different features; 4) The latent common knowledge among different modalities can be discovered by transfer learning to boost the performance.

Saliency-Assisted Collaborative Learning Network for Road Scene Semantic Segmentation

  • Haifeng Sima;Yushuang Xu;Minmin Du;Meng Gao;Jing Wang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.3
    • /
    • pp.861-880
    • /
    • 2023
  • Semantic segmentation of road scene is the key technology of autonomous driving, and the improvement of convolutional neural network architecture promotes the improvement of model segmentation performance. The existing convolutional neural network has the simplification of learning knowledge and the complexity of the model. To address this issue, we proposed a road scene semantic segmentation algorithm based on multi-task collaborative learning. Firstly, a depthwise separable convolution atrous spatial pyramid pooling is proposed to reduce model complexity. Secondly, a collaborative learning framework is proposed involved with saliency detection, and the joint loss function is defined using homoscedastic uncertainty to meet the new learning model. Experiments are conducted on the road and nature scenes datasets. The proposed method achieves 70.94% and 64.90% mIoU on Cityscapes and PASCAL VOC 2012 datasets, respectively. Qualitatively, Compared to methods with excellent performance, the method proposed in this paper has significant advantages in the segmentation of fine targets and boundaries.

A study on the optimal task-based instructional model: Focused on Korean EFL classroom practice (효율적인 과업중심 교수.학습모형 연구: EFL 교실 상황을 중심으로)

  • Jeon, In-Jae
    • English Language & Literature Teaching
    • /
    • v.11 no.4
    • /
    • pp.365-389
    • /
    • 2005
  • The purpose of this study is to present the task model that is the most effective in English language methodology based on the investigation of task-based performance in Korean EFL classroom practice. The subjects were 538 high school students and 126 high school teachers, each of whom had common experiences using the materials of task-based activities for more than one year. To analyze the data, the program SPSS WIN 11.0 including frequency distribution and chi-square analysis was used. The results of the questionnaire analysis showed that both teachers and students had a comparatively high level of satisfaction in task rationale, but that they had some mixed responses in the fields of input data, settings, and activity types. To conclude, a few suggestions are made to provide some meaningful considerations for the EFL teachers and material developers: a) task goals and rationale that encourage the learner's positive motivation; b) authenticity of input data based on the real-world context; c) collaborative learning environment that enhances communicative interaction; d) proportional representation of the creative problem-solving activities related to discussions and decision-making processes; e) systematic introduction of integrated language skills. It also suggests that the multi-lateral task model, which has some positive assets compared to previous task models, be newly introduced and applied to the second language learning classrooms.

  • PDF

The Study about Agent to Agent Communication Data Model for e-Learning (협력학습 지원을 위한 에이전트 간의 의사소통 데이터 모델에 관한 연구)

  • Han, Tae-In
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.48 no.3
    • /
    • pp.36-45
    • /
    • 2011
  • An agent in collaborative e-learning has independent function for learners in any circumstance, status and task by the reasonable and general means for social learning. In order to perform it well, communication among agents requires standardized and regular information technology method. This study suggests data model as a communication tool for various agents. Therefore this study shows various agents types for collaborative learning, designation of rule for data model that enable to communicate among agents and data element of agent communication data model. A multi-agent e-learning system using like this standardized data model should able to exchange the message that is needed for communication among agents who can take charge of their independent tasks. This study should contribute to perform collaborative e-learning successfully by the application of communication data model among agents for social learning.

Wiki Usage of LIS Undergraduates for Collaborative Learning (문헌정보학과 학생들의 위키를 활용한 협력학습에 대한 연구)

  • Park, Sung Jae
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.23 no.4
    • /
    • pp.93-108
    • /
    • 2012
  • The purpose of this study is to find any contradictions which arise with the use of Wiki in the classroom, and to address such contradictions in order to promote learning among LIS students. This study employed a multi-methodology, including Wiki usage analysis, and interviews with 12 students who participated in an LIS class. Observations revealed that group projects are common in academic classes. Interviewees agreed that their performance through collaborative efforts was higher than that through individually performed activities. However, there were no pre-experiences with Wiki in learning and task-oriented cooperation which gave rise to a controversy. In addition, even though a new technology, as a more advanced form, was suggested, students cooperated with their peers according to their tradition without using the recommended new technology. Therefore, students should be taught about Wiki usage and experience the effective learning which is available to them through collaboration with their peers. Additionally, LIS curriculum should incorporate relationship-oriented activities using Web 2.0 applications with the expectation of enhanced learning among students.