• Title/Summary/Keyword: multi-agent learning

Search Result 114, Processing Time 0.02 seconds

Collision Avoidance Path Control of Multi-AGV Using Multi-Agent Reinforcement Learning (다중 에이전트 강화학습을 이용한 다중 AGV의 충돌 회피 경로 제어)

  • Choi, Ho-Bin;Kim, Ju-Bong;Han, Youn-Hee;Oh, Se-Won;Kim, Kwi-Hoon
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.11 no.9
    • /
    • pp.281-288
    • /
    • 2022
  • AGVs are often used in industrial applications to transport heavy materials around a large industrial building, such as factories or warehouses. In particular, in fulfillment centers their usefulness is maximized for automation. To increase productivity in warehouses such as fulfillment centers, sophisticated path planning of AGVs is required. We propose a scheme that can be applied to QMIX, a popular cooperative MARL algorithm. The performance was measured with three metrics in several fulfillment center layouts, and the results are presented through comparison with the performance of the existing QMIX. Additionally, we visualize the transport paths of trained AGVs for a visible analysis of the behavior patterns of the AGVs as heat maps.

Multi-task Deep Neural Network Model for T1CE Image Synthesis and Tumor Region Segmentation in Glioblastoma Patients (교모세포종 환자의 T1CE 영상 생성 및 암 영역분할을 위한 멀티 태스크 심층신경망 모델)

  • Kim, Eunjin;Park, Hyunjin
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.474-476
    • /
    • 2021
  • Glioblastoma is the most common brain malignancies arising from glial cells. Early diagnosis and treatment plan establishment are important, and cancer is diagnosed mainly through T1CE imaging through injection of a contrast agent. However, the risk of injection of gadolinium-based contrast agents is increasing recently. Region segmentation that marks cancer regions in medical images plays a key role in CAD systems, and deep neural network models for synthesizing new images are also being studied. In this study, we propose a model that simultaneously learns the generation of T1CE images and segmentation of cancer regions. The performance of the proposed model is evaluated using similarity measurements including mean square error and peak signal-to-noise ratio, and shows average result values of 21 and 39 dB.

  • PDF

A Study on Teaching-Learning and Evaluation Methods of Environmental Studies in the Middle School (중학교 "환경" 교과의 교수.학습 및 평가 방법 연구)

  • 남상준
    • Hwankyungkyoyuk
    • /
    • v.7 no.1
    • /
    • pp.1-17
    • /
    • 1994
  • This study was performed to determine appropriate teaching-learning and evaluation methods for Environmental Studies. To promote the relevance of our study to the needs of the schools and concerned educational communities of environmental education, we reviewed related literature, conducted questionnaire surveys, interviewed related teachers and administrator, held meetings with experts, and field-tested our findings. For selecting and developing teaching-learning methods of Environmental Studies, findings of educational research in general are considered. moreover, principles of environmental education, general aim of environmental education, orientations of environmental education, and developmental stages of middle school students in educational psychology were attended. In addition, relevance to the purpose of the Environmental Studies curriculum, appropriateness for value inquiry as well as knowledge inquiry, small group centered class organization, social interaction centered teaching-learning process, regional environmental situation, significance of personal environment, evaluation methods of Environmental Studies, multi- and inter-disciplinary contents of the Environmental Studies textbook, suitability to the evaluation methods of Environmental Studies, and emphasis on the social interaction in teaching-learning process were regarded. It was learned the Environmental Studies can be taught most effectively in via of holding discussion sessions, conducting actual investigation, doing experiment-practice, doing games and plate, role-playing and carrying out simulation activities, and doing inquiry. These teaching-learning methods were field-tested and proved appropriate methods for the subject. For selecting and developing evaluation method of Environmental Studies, such principles and characteristics of Environmental Studies as objective domains stated in the Environmental Studies curriculum, diversity of teaching-learning organization, were appreciated. We categorized nine evaluation methods: the teacher may conduct questionnaire surveys, testings, interviews, non-participatory observations; they may evaluate student's experiment-practice performances, reports preparation ability, ability to establish a research project, the teacher may ask the students to conduct a self-evaluation, or reciprocal evaluation. To maximize the effect of these methods, we further developed an application system. It considered three variables, that is, evaluates, evaluation objectives domains, and evaluation agent, and showed how to choose the most appropriate methods and, when necessary, how to combine uses of different methods depending on these variables. A sample evaluation instrument made on the basis of this application system was developed and tested in the classes. The system proved effective. Pilot applications of the teaching-learning methods and evaluation method were made simultaneously; and the results and their implications are as follows. Discussion program was applied in a lesson dealing with the problems of waste disposal, in which students showed active participation and creative thinking. The evaluation method used in this lesson was a multiple-choice written test for knowledge and skills. It was shown that this evaluation method and device are effective in helping students' revision of the lesson and in stimulating their creative interpretations and responces. Pupils showed great interests in the actual investigation program, and this programme was proved to be effective in enhancing students' participation. However, it was also turned out that there must be pre-arranged plans for the objects, contents and procedures of survey if this program is to effective. In this lesson, non-participatory observation methods were used with a focus on the attitudes of students. A scaled reported in general description rather than in grade. Experiment-practice programme was adopted in a lesson for purifying contaminated water and in this lesson, instruction objectives were properly established, the teaching-learning process was clearly specified and students were highly motivated. On the other hand, however, it was difficult to control the class when some groups of students require more times to complete their experiment, and sometimes different results. As regards to evaluation, performance observation test were used for assessing skills and attitudes. If teachers use well-prepared Likert scale, evaluation of all groups within a reasonablely short period of time will be possible. The most effective and successful programme in therms of students' participation and enjoyment, was the 'ah-nah-bah-dah-market' program, which is kind of game of the flea market. For better organized program of this kind, however, are essential, In this program, students appraise their own attitudes and behavior by responding to a written questionnaire. In addition, students were asked to record any anecdotes relating to self-appraisal of changes on one's own attitudes and behaviours. Even after the lesson, students keep recording those changes on letters to herself. Role-playing and simulation game programme was applied to a case of 'NIMBY', in which students should decide where to located a refuse dumping ground. For this kind of programme to e successful, concepts and words used in the script should be appropriate for students' intellectual levels, and students should by adequately introduced into the objective and the procedures of the lessons. Written questionnaire was used to assess individual students' attitudes after the lesson, but in order to acquire information on the changes of students' attitudes and skills, pre-test may have to be made. Doing inquiry programme, in which advantages in which students actually investigated the environmental influence of the areas where school os located, had advantages in developing students' ability to study the environmental problems and to present the results of their studies. For this programme to be more efficient, areas of investigation should be clearly divided and alloted to each group so that repetition or overlap in areas of study and presentation be avoided, and complementary wok between groups bee enhanced. In this programme, teacher assessed students' knowledge and attitudes on the basis of reports prepared by each group. However, there were found some difficults in assessing students' attitudes and behaviours solely on the grounds of written report. Perhaps, using a scaled checklist assessing students' attitudes while their presentation could help to relieve the difficulties.

  • PDF

Development of CCTV Cooperation Tracking System for Real-Time Crime Monitoring (실시간 범죄 모니터링을 위한 CCTV 협업 추적시스템 개발 연구)

  • Choi, Woo-Chul;Na, Joon-Yeop
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.12
    • /
    • pp.546-554
    • /
    • 2019
  • Typically, closed-circuit television (CCTV) monitoring is mainly used for post-processes (i.e. to provide evidence after an incident has occurred), but by using a streaming video feed, machine-based learning, and advanced image recognition techniques, current technology can be extended to respond to crimes or reports of missing persons in real time. The multi-CCTV cooperation technique developed in this study is a program model that delivers similarity information about a suspect (or moving object) extracted via CCTV at one location and sent to a monitoring agent to track the selected suspect or object when he, she, or it moves out of range to another CCTV camera. To improve the operating efficiency of local government CCTV control centers, we describe here the partial automation of a CCTV control system that currently relies upon monitoring by human agents. We envisage an integrated crime prevention service, which incorporates the cooperative CCTV network suggested in this study and that can easily be experienced by citizens in ways such as determining a precise individual location in real time and providing a crime prevention service linked to smartphones and/or crime prevention/safety information.