• Title/Summary/Keyword: vision plan

Search Result 283, Processing Time 0.022 seconds

Video Analysis System for Action and Emotion Detection by Object with Hierarchical Clustering based Re-ID (계층적 군집화 기반 Re-ID를 활용한 객체별 행동 및 표정 검출용 영상 분석 시스템)

  • Lee, Sang-Hyun;Yang, Seong-Hun;Oh, Seung-Jin;Kang, Jinbeom
    • Journal of Intelligence and Information Systems
    • /
    • v.28 no.1
    • /
    • pp.89-106
    • /
    • 2022
  • Recently, the amount of video data collected from smartphones, CCTVs, black boxes, and high-definition cameras has increased rapidly. According to the increasing video data, the requirements for analysis and utilization are increasing. Due to the lack of skilled manpower to analyze videos in many industries, machine learning and artificial intelligence are actively used to assist manpower. In this situation, the demand for various computer vision technologies such as object detection and tracking, action detection, emotion detection, and Re-ID also increased rapidly. However, the object detection and tracking technology has many difficulties that degrade performance, such as re-appearance after the object's departure from the video recording location, and occlusion. Accordingly, action and emotion detection models based on object detection and tracking models also have difficulties in extracting data for each object. In addition, deep learning architectures consist of various models suffer from performance degradation due to bottlenects and lack of optimization. In this study, we propose an video analysis system consists of YOLOv5 based DeepSORT object tracking model, SlowFast based action recognition model, Torchreid based Re-ID model, and AWS Rekognition which is emotion recognition service. Proposed model uses single-linkage hierarchical clustering based Re-ID and some processing method which maximize hardware throughput. It has higher accuracy than the performance of the re-identification model using simple metrics, near real-time processing performance, and prevents tracking failure due to object departure and re-emergence, occlusion, etc. By continuously linking the action and facial emotion detection results of each object to the same object, it is possible to efficiently analyze videos. The re-identification model extracts a feature vector from the bounding box of object image detected by the object tracking model for each frame, and applies the single-linkage hierarchical clustering from the past frame using the extracted feature vectors to identify the same object that failed to track. Through the above process, it is possible to re-track the same object that has failed to tracking in the case of re-appearance or occlusion after leaving the video location. As a result, action and facial emotion detection results of the newly recognized object due to the tracking fails can be linked to those of the object that appeared in the past. On the other hand, as a way to improve processing performance, we introduce Bounding Box Queue by Object and Feature Queue method that can reduce RAM memory requirements while maximizing GPU memory throughput. Also we introduce the IoF(Intersection over Face) algorithm that allows facial emotion recognized through AWS Rekognition to be linked with object tracking information. The academic significance of this study is that the two-stage re-identification model can have real-time performance even in a high-cost environment that performs action and facial emotion detection according to processing techniques without reducing the accuracy by using simple metrics to achieve real-time performance. The practical implication of this study is that in various industrial fields that require action and facial emotion detection but have many difficulties due to the fails in object tracking can analyze videos effectively through proposed model. Proposed model which has high accuracy of retrace and processing performance can be used in various fields such as intelligent monitoring, observation services and behavioral or psychological analysis services where the integration of tracking information and extracted metadata creates greate industrial and business value. In the future, in order to measure the object tracking performance more precisely, there is a need to conduct an experiment using the MOT Challenge dataset, which is data used by many international conferences. We will investigate the problem that the IoF algorithm cannot solve to develop an additional complementary algorithm. In addition, we plan to conduct additional research to apply this model to various fields' dataset related to intelligent video analysis.

Science Teachers' Awareness of the Criteria for Minimum Achievement Standards in Science to Support Basic Skills (기초학력 보장을 위한 과학과 최소한의 성취기준에 대한 과학 교사들의 인식)

  • Eun-Jeong Yu;Taegyoung Lee
    • Journal of The Korean Association For Science Education
    • /
    • v.43 no.3
    • /
    • pp.265-276
    • /
    • 2023
  • The purpose of this study was to develop a plan to ensure that students lacking basic science skills acquire the minimum needed science learning ability while completing the common curriculum. We surveyed 27 elementary and secondary science teachers with experience in research and teaching related to basic skills support to investigate their perceptions of the criteria for minimum achievement standards using Consensual Qualitative Research (CQR) and Analytic Hierarchy Process (AHP). The results indicated that the science teachers tended to describe low achievers as lacking science learning competency, accumulating a science learning deficit, and lacking prerequisite knowledge. However, there were some differences in the characteristics that the elementary and secondary teachers paid attention to in students with insufficient science and basic academic skills. Specifically, the secondary teachers demonstrated greater sensitivity towards low learning motivation and difficulties in using scientific symbols, whereas the elementary teachers were more sensitive towards students' attitudes towards science or lack of experience. Furthermore, it has been observed that the prioritization of items, categorized by school level, differs in terms of setting minimum achievement standards to ensure basic skill support. This implies the need to develop minimum achievement standards considering various variables based on the school level. As there are diverse opinions among science teachers, depending on their expertise, regarding the factors to be considered when developing these standards to guarantee science and basic skill support. Based on the findings of the study, policy support is required to enhance teachers' professionalism in developing students' basic skills while considering the individual context and diversity of low achievers. Additionally, it is crucial to establish a shared vision for students lacking basic skills to reduce the gap between national policy and the practices of science teachers in ensuring support for basic skills.

Research for Space Activities of Korea Air Force - Political and Legal Perspective (우리나라 공군의 우주력 건설을 위한 정책적.법적고찰)

  • Shin, Sung-Hwan
    • The Korean Journal of Air & Space Law and Policy
    • /
    • v.18
    • /
    • pp.135-183
    • /
    • 2003
  • Aerospace force is a determining factor in a modem war. The combat field is expanding to space. Thus, the legitimacy of establishing aerospace force is no longer an debating issue, but "how should we establish aerospace force" has become an issue to the military. The standard limiting on the military use of space should be non-aggressive use as asserted by the U.S., rather than non-military use as asserted by the former Soviet Union. The former Soviet Union's argument is not even strongly supported by the current Russia government, and realistically is hard to be applied. Thus, the multi-purpose satellite used for military surveillance or a commercial satellite employed for military communication are allowed under the U.S. principle of peaceful use of space. In this regard, Air Force may be free to develop a military surveillance satellite and a communication satellite with civilian research institute. Although MTCR, entered into with the U.S., restricts the development of space-launching vehicle for the export purpose, the development of space-launching vehicle by the Korea Air Force or Korea Aerospace Research Institute is beyond the scope of application of MTCR, and Air Force may just operate a satellite in the orbit for the military purpose. The primary task for multi-purpose satellite is a remote sensing; SAR sensor with high resolution is mainly employed for military use. Therefore, a system that enables Air Force, the Korea Aerospace Research Institute, and Agency for Defense Development to conduct joint-research and development should be instituted. U.S. Air Force has dismantled its own space-launching vehicle step by step, and, instead, has increased using private space launching vehicle. In addition, Military communication has been operated separately from civil communication services or broadcasting services due to the special circumstances unique to the military setting. However, joint-operation of communication facility by the military and civil users is preferred because this reduces financial burden resulting from separate operation of military satellite. During the Gulf War, U.S. armed forces employed commercial satellites for its military communication. Korea's participation in space technology research is a little bit behind in time, considering its economic scale. In terms of budget, Korea is to spend 5 trillion won for 15 years for the space activities. However, Japan has 2 trillion won annul budget for the same activities. Because the development of space industry during initial fostering period does not apply to profit-making business, government supports are inevitable. All space development programs of other foreign countries are entirely supported by each government, and, only recently, private industry started participating in limited area such as a communication satellite and broadcasting satellite, Particularly, Korea's space industry is in an infant stage, which largely demands government supports. Government support should be in the form of investment or financial contribution, rather than in the form of loan or borrowing. Compared to other advanced countries in space industry, Korea needs more budget and professional research staff. Naturally, for the efficient and systemic space development and for the prevention of overlapping and distraction of power, it is necessary to enact space-related statutes, which would provide dear vision for the Korea space development. Furthermore, the fact that a variety of departments are running their own space development program requires a centralized and single space-industry development system. Prior to discussing how to coordinate or integrate space programs between Agency for Defense Development and the Korea Aerospace Research Institute, it is a prerequisite to establish, namely, "Space Operations Center"in the Air Force, which would determine policy and strategy in operating space forces. For the establishment of "Space Operations Center," policy determinations by the Ministry of National Defense and the Joint Chief of Staff are required. Especially, space surveillance system through using a military surveillance satellite and communication satellite, which would lay foundation for independent defense, shall be established with reference to Japan's space force plan. In order to resolve issues related to MTCR, Air Force would use space-launching vehicle of the Korea Aerospace Research Institute. Moreover, defense budge should be appropriated for using multi-purpose satellite and communication satellite. The Ministry of National Defense needs to appropriate 2.5 trillion won budget for space operations, which amounts to Japan's surveillance satellite operating budges.

  • PDF