• Title/Summary/Keyword: feature value

Search Result 1,184, Processing Time 0.023 seconds

Video Analysis System for Action and Emotion Detection by Object with Hierarchical Clustering based Re-ID (계층적 군집화 기반 Re-ID를 활용한 객체별 행동 및 표정 검출용 영상 분석 시스템)

  • Lee, Sang-Hyun;Yang, Seong-Hun;Oh, Seung-Jin;Kang, Jinbeom
    • Journal of Intelligence and Information Systems
    • /
    • v.28 no.1
    • /
    • pp.89-106
    • /
    • 2022
  • Recently, the amount of video data collected from smartphones, CCTVs, black boxes, and high-definition cameras has increased rapidly. According to the increasing video data, the requirements for analysis and utilization are increasing. Due to the lack of skilled manpower to analyze videos in many industries, machine learning and artificial intelligence are actively used to assist manpower. In this situation, the demand for various computer vision technologies such as object detection and tracking, action detection, emotion detection, and Re-ID also increased rapidly. However, the object detection and tracking technology has many difficulties that degrade performance, such as re-appearance after the object's departure from the video recording location, and occlusion. Accordingly, action and emotion detection models based on object detection and tracking models also have difficulties in extracting data for each object. In addition, deep learning architectures consist of various models suffer from performance degradation due to bottlenects and lack of optimization. In this study, we propose an video analysis system consists of YOLOv5 based DeepSORT object tracking model, SlowFast based action recognition model, Torchreid based Re-ID model, and AWS Rekognition which is emotion recognition service. Proposed model uses single-linkage hierarchical clustering based Re-ID and some processing method which maximize hardware throughput. It has higher accuracy than the performance of the re-identification model using simple metrics, near real-time processing performance, and prevents tracking failure due to object departure and re-emergence, occlusion, etc. By continuously linking the action and facial emotion detection results of each object to the same object, it is possible to efficiently analyze videos. The re-identification model extracts a feature vector from the bounding box of object image detected by the object tracking model for each frame, and applies the single-linkage hierarchical clustering from the past frame using the extracted feature vectors to identify the same object that failed to track. Through the above process, it is possible to re-track the same object that has failed to tracking in the case of re-appearance or occlusion after leaving the video location. As a result, action and facial emotion detection results of the newly recognized object due to the tracking fails can be linked to those of the object that appeared in the past. On the other hand, as a way to improve processing performance, we introduce Bounding Box Queue by Object and Feature Queue method that can reduce RAM memory requirements while maximizing GPU memory throughput. Also we introduce the IoF(Intersection over Face) algorithm that allows facial emotion recognized through AWS Rekognition to be linked with object tracking information. The academic significance of this study is that the two-stage re-identification model can have real-time performance even in a high-cost environment that performs action and facial emotion detection according to processing techniques without reducing the accuracy by using simple metrics to achieve real-time performance. The practical implication of this study is that in various industrial fields that require action and facial emotion detection but have many difficulties due to the fails in object tracking can analyze videos effectively through proposed model. Proposed model which has high accuracy of retrace and processing performance can be used in various fields such as intelligent monitoring, observation services and behavioral or psychological analysis services where the integration of tracking information and extracted metadata creates greate industrial and business value. In the future, in order to measure the object tracking performance more precisely, there is a need to conduct an experiment using the MOT Challenge dataset, which is data used by many international conferences. We will investigate the problem that the IoF algorithm cannot solve to develop an additional complementary algorithm. In addition, we plan to conduct additional research to apply this model to various fields' dataset related to intelligent video analysis.

The morphological and chemical composition characteristics of Opuntia ficus-indica and Opuntia humifusa fruits (손바닥선인장(백년초, 천년초) 열매의 외관 및 성분특성 연구)

  • Kim, Mi-Hyun;Kim, Hee Jung;Jang, Mi;Lim, Tae-Gyu;Hong, Hee-Do;Rhee, Young Kyoung;Kim, Kyung-Tack;Cho, Chang-Won
    • Food Science and Preservation
    • /
    • v.23 no.5
    • /
    • pp.711-717
    • /
    • 2016
  • Opuntia humifusa fruits were investigated. The length of minor and major axis, and weight of O. ficus-indica and O. humifusa fruits were compared as the morphological features. The characteristics of components such as color, moisture, crude protein, ash, fat, dietary fiber, mineral, and amino acids were evaluated. The values of O. ficus-indica fruits were higher than those of O. humifusa fruits in each morphological feature such as minor axis, major axis, and weight. According to the Hunter color index results, O. humifusa fruits showed higher values of L (lightness) and b (yellowness), whereas O. ficus-indica fruits showed higher value of a (redness). The ${\Delta}E$ value between two samples was 19.80. The O. ficus-indica fruits had higher carbohydrate content and lower content of crude ash than those of O. humifusa fruits. Both samples showed very high dietary fiber contents, and the major minerals were K and Ca. Glutamic acid was the major amino acids in both samples. In free amino acids contents, O. ficus-indica had higher tyrosine and lower glutamic acid level than those of O. humifusa fruits. ${\gamma}$-aminobutyric acid was found in both samples, whereas taurine was found in O. ficus-indica fruits only. Taken together, the morphological features and chemical quality of O. ficus-indica and O. humifusa fruits showed difference although both of them were originated from the same genus.

Efficient Conservation and Management of Waterside Parks by Promoting Ecology Awareness of Visitors (이용객 생태 인식 증진을 통한 수변공원의 효율적인 보전 및 관리)

  • Choi, Jong Yun;Kim, Seong-Ki;Kim, Jeong-Cheol;Yun, Hak Jong
    • Korean Journal of Environment and Ecology
    • /
    • v.33 no.2
    • /
    • pp.237-251
    • /
    • 2019
  • This study evaluated the ecological value of waterside parks by investigating the animal distribution and ecological feature in 92 waterside parks and analyzed the change of ecological awareness by users and non-users of waterside parks through ecological education and promotion based on the investigation results. The result confirmed inhabitation of various animals including 9 endangered species (Pernis ptilorhynchus orientalis, Accipiter soloensis, Falco subbuteo, Charadrius placidus, Felis bengalensis euptilura, Lutra lutra, Kaloula borealis, Polyphylla laticollis manchurica, and Leptalina unicolor) in waterside parks. Although waterside parks were constructed to be hydrophilic areas for human use, some of them with high natural characteristics are valued as biological habitat. We investigated user status in 5 areas (Daejeon, Sejong, Cheongju, Kongju, and Buyeo) located at Guem river basin to evaluate people's perception of waterside parks and carried out the ecological education and promotion based on the investigation result. The survey of 200 people showed that there were more users of waterside parks than non-users and that people in their 40's showed the highest use rate. The use frequency of waterside parks located in Daejeon and Cheongju was lower than in other areas (Sejong, Kongju, and Buyeo). We considered it was because Daejeon and Cheongju were urban areas and had relatively more leisure areas such as sports facilities and cafe than other areas, and thus the residents had a lower reliance on waterside parks. Moreover, users used waterside parks more frequently when they were nearer to users' residence. It is because most users perceived waterside parks as the leisure sports facility and thus preferred them to be within walking distance. The users' perception of waterside parks as the ecological space "to be preserved" increased after the ecological education and promotion. The change of the perception was higher among users (80%) than non-users (38%). Therefore, ecological education and promotion were potentially more effective to people who user waterside parks and thus had a higher understanding of the characteristics and specification. In conclusion, 1) although waterside parks were constructed for human use, some parts had high ecological value for the distribution of endangered species and outstanding natural beauty, and 2) it is necessary to change the perception of waterside parks from the hydrophilic attribute to the conservation attribute. Such change of perception would contribute to establishing waterside parks that feature both hydrophilic and conservation attributes in the management or upgrading plan of waterside parks in the future.

Natural Heritage Values and Diversity of Geoheritages on Udo Island, Jeju Province (제주도 우도 지역 내 지질유산의 다양성과 가치)

  • Woo, Kyung Sik;Yoon, Seok Hoon;Sohn, Young Kwan;Kim, Ryeon;Lee, Kwang Choon;Lim, Jong Deock
    • Korean Journal of Heritage: History & Science
    • /
    • v.46 no.1
    • /
    • pp.290-317
    • /
    • 2013
  • The objectives of this study are to investigate the natural heritage and scientific value of various geosites on Udo Island, and to evaluate the sites as natural monuments and as world natural heritage properties. Udo Island includes a variety of geoheritage sites. Various land forms formed during the formation of the Someori Oreum formed by phreatomagmatic eruptions. The essential elements for the formation of Udo Island are the tuff cone, overflowing lava and overlying redeposited tuff sediments. Various coastal land forms are also present. About 6,000 years B.C., when sea-level rose close to its present level due to deglaciation since the Last Glacial Maximum, carbonate sediments have been formed and deposited in shallow marine environment surrounding Udo Island. In particular, the very shallow broad shelf between Udo Island and Jeju Island, less than 20 m in water depth, has provided perfect conditions for the formation of rhodoids. Significant amounts of rhodoids are now forming in this area. Occasional transport of these rhodoids by typhoons has produced unique beach deposits which are entirely composed of rhodoids. Additional features are the Hagosudong Beach with its white carbonate sands, the Geommeole Beach with its black tuffaceous sands and Tolkani Beach with its basalt cobbles and boulders. Near Hagosudong Beach, wind-blown sands in the past produced carbonate sand dunes. On the northern part of the island, special carbonate sediments are present, due to their formation by composite processes such as beach-forming process and transportation by typhoons. The development of several sea caves is another feature of Udo Island, formed by waves and typhoon erosion within tuffaceous sedimentary rocks. In particular, one sea cave found at a depth of 10 m is very special because it indicates past sea-level fluctuations. Shell mounds in Udo Island may well represent the mixed heritage feature on this island. The most valuable geoheritage sites investigated around Udo Isalnd are rhodoid depostis on beaches and in shallow seas, and Someori Oreum composed of volcanoclastic deposits and basalt lava. Beach and shallow marine sediments, composed only of rhodoids, appear to be very rare in the world. Also, the natural heritage value of the Someori Oreum is outstanding, together with other phreatomagmatic tuff cones such as Suwolbong, Songaksan and Yongmeori. Consequently, the rhodoid deposits and the Someori Oreum are worth being nominated for UNESCO World Natural Heritage status. The designation of Someori Oreum as a Natural Monument should be a prerequisite for this procedure.

Prediction of Key Variables Affecting NBA Playoffs Advancement: Focusing on 3 Points and Turnover Features (미국 프로농구(NBA)의 플레이오프 진출에 영향을 미치는 주요 변수 예측: 3점과 턴오버 속성을 중심으로)

  • An, Sehwan;Kim, Youngmin
    • Journal of Intelligence and Information Systems
    • /
    • v.28 no.1
    • /
    • pp.263-286
    • /
    • 2022
  • This study acquires NBA statistical information for a total of 32 years from 1990 to 2022 using web crawling, observes variables of interest through exploratory data analysis, and generates related derived variables. Unused variables were removed through a purification process on the input data, and correlation analysis, t-test, and ANOVA were performed on the remaining variables. For the variable of interest, the difference in the mean between the groups that advanced to the playoffs and did not advance to the playoffs was tested, and then to compensate for this, the average difference between the three groups (higher/middle/lower) based on ranking was reconfirmed. Of the input data, only this year's season data was used as a test set, and 5-fold cross-validation was performed by dividing the training set and the validation set for model training. The overfitting problem was solved by comparing the cross-validation result and the final analysis result using the test set to confirm that there was no difference in the performance matrix. Because the quality level of the raw data is high and the statistical assumptions are satisfied, most of the models showed good results despite the small data set. This study not only predicts NBA game results or classifies whether or not to advance to the playoffs using machine learning, but also examines whether the variables of interest are included in the major variables with high importance by understanding the importance of input attribute. Through the visualization of SHAP value, it was possible to overcome the limitation that could not be interpreted only with the result of feature importance, and to compensate for the lack of consistency in the importance calculation in the process of entering/removing variables. It was found that a number of variables related to three points and errors classified as subjects of interest in this study were included in the major variables affecting advancing to the playoffs in the NBA. Although this study is similar in that it includes topics such as match results, playoffs, and championship predictions, which have been dealt with in the existing sports data analysis field, and comparatively analyzed several machine learning models for analysis, there is a difference in that the interest features are set in advance and statistically verified, so that it is compared with the machine learning analysis result. Also, it was differentiated from existing studies by presenting explanatory visualization results using SHAP, one of the XAI models.

Performance Evaluation of Workstation System within ATM Integrated Service Switching System using Mean Value Analysis Algorithm (MVA 알고리즘을 이용한 ATM 기반 통합 서비스 교환기 내 워크스테이션의 성능 평가)

  • Jang, Seung-Ju;Kim, Gil-Yong;Lee, Jae-Hum;Park, Ho-Jin
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.6 no.4
    • /
    • pp.421-429
    • /
    • 2000
  • In present, ATM integrated switching system has been developed to a mixed modules that complexed switching system including maintenance, operation based on B-ISDN/LAN service and plug-in module, , which runs on workstation computer system. Meanwhile, workstation has HMI operation system feature including file system management, time management, graphic processing, TMN agent function. The workstation has communicated with between ATM switching module and clients. This computer system architecture has much burden messages communication among processes or processor. These messages communication consume system resources which are socket, message queue, IO device files, regular files, and so on. Therefore, in this paper we proposed new performance modeling with this system architecture. We will analyze the system bottleneck and improve system performance. In addition, in the future, the system has many additional features should be migrated to workstation system, we need previously to evaluate system bottleneck and redesign it. In performance model, we use queueing network model and the simulation package is used PDQ and C-program.

  • PDF

Habitat and Distribution Feature of Endangered Species Leontice microrhyncha S. Moore (멸종위기종 한계령풀(Leontice microrhyncha S. Moore)의 서식지 및 분포 특성)

  • Lee, Sang-Hoon;Yeon, Myung-Hun;Shim, Jae-Kuk
    • Korean Journal of Environment and Ecology
    • /
    • v.25 no.6
    • /
    • pp.819-827
    • /
    • 2011
  • Climate change is recognised as the best serious environmental problem in recent time, and high alpine or high latitudinal organisms especially endangered by its change. Leontice microrhyncha is recorded one of the endangered species by the Ministry of Environment Korea. We surveyed ten L. microrhyncha populations distributed at Taebaek Mountains, high mountain area in Kangwon province. L. microrhyncha is distributed 940m~1350m high altitude which equivalent of Warmth Index $53^{\circ}C{\cdot}month$ to $75^{\circ}C{\cdot}month$, the range of conspicuous cool temperate forest zone. The plant species distributed at slope of $5^{\circ}{\sim}23^{\circ}$ on northeast slopes. The vegetation structure at tree layer of L. microrhyncha distribution area is dominated by Quercus mongolica, Betula costata, Cornus controversa, Acer mono in tree layer, and by Staphylea bumalda, Deutzia glabrata, Stephanandra incisa in shrub layer. The species diversity of herb layer of each L. microrhyncha population showed from 0.21 to 0.98, and the importance value of L. microrhyncha in each population was the highest at blooming time of L. microrhyncha. These results will provide the basic information for the development of conservation strategies for this endangered species.

Recognition of Partially Occluded Binary Objects using Elastic Deformation Energy Measure (탄성변형에너지 측도를 이용한 부분적으로 가려진 이진 객체의 인식)

  • Moon, Young-In;Koo, Ja-Young
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.10
    • /
    • pp.63-70
    • /
    • 2014
  • Process of recognizing objects in binary images consists of image segmentation and pattern matching. If binary objects in the image are assumed to be separated, global features such as area, length of perimeter, or the ratio of the two can be used to recognize the objects in the image. However, if such an assumption is not valid, the global features can not be used but local features such as points or line segments should be used to recognize the objects. In this paper points with large curvature along the perimeter are chosen to be the feature points, and pairs of points selected from them are used as local features. Similarity of two local features are defined using elastic deformation energy for making the lengths and angles between gradient vectors at the end points same. Neighbour support value is defined and used for robust recognition of partially occluded binary objects. An experiment on Kimia-25 data showed that the proposed algorithm runs 4.5 times faster than the maximum clique algorithm with same recognition rate.

Application of Computer-Aided Diagnosis for the Differential Diagnosis of Fatty Liver in Computed Tomography Image (전산화단층촬영 영상에서 지방간의 감별진단을 위한 컴퓨터보조진단의 응용)

  • Park, Hyong-Hu;Lee, Jin-Soo
    • Journal of the Korean Society of Radiology
    • /
    • v.10 no.6
    • /
    • pp.443-450
    • /
    • 2016
  • In this study, we are using a computer tomography image of the abdomen, as an experimental linear research for the image of the fatty liver patients texture features analysis and computer-aided diagnosis system of implementation using the ROC curve analysis, from the computer tomography image. We tried to provide an objective and reliable diagnostic information of fatty liver to the doctor. Experiments are usually a fatty liver, via the wavelet transform of the abdominal computed tomography images are configured with the experimental image section, shows the results of statistical analysis on six parameters indicating a feature value of the texture. As a result, the entropy, average luminance, strain rate is shown a relatively high recognition rate of 90% or more, the control also, flatness, uniformity showed relatively low recognition rate of about 70%. ROC curve analysis of six parameters are all shown to 0.900 (p = 0.0001) or more, showed meaningful results in the recognition of the disease. Also, to determine the cut-off value for the prediction of disease six parameters. These results are applicable from future abdominal computed tomography images as a preliminary diagnostic article of diseases automatic detection and eventual diagnosis.

Classification and Stand Characteristics of Subalpine Forest Vegetation at Hyangjeukbong and Jungbong in Mt. Deogyusan (덕유산 향적봉 및 중봉 아고산대의 산림식생유형분류와 임분 특성)

  • Han, Sang Hak;Han, Sim Hee;Yun, Chung Weon
    • Journal of Korean Society of Forest Science
    • /
    • v.105 no.1
    • /
    • pp.48-62
    • /
    • 2016
  • This study was conducted to classify forest vegetation structure and stand feature of Mt. Deogyusan National Park from Hyangjeukbong to Jungbong, 48 plots were surveyed. The type classification of the vegetation structure was performed with Z-M phytosociological method. As a result, Quercus mongolica community group was classified into the Picea jezoensis community, Carpinus cordata community and Tilia amurensis community in community unit. P. jezoensis community was subdivided into Deutzia glabrata group and Viburnum opulus var. calvescens group in group unit. D. glabrata group was subdivided into Acer mandshuricum subgroup and Ribes mandshuricum subgroup and V. opulus var. calvescens group was subdivided into Hemerocallis dumortieri subgroup and Prunus padus subgroup in subgroup unit. In the result of estimating the importance value, it constituted Q. mongolica (23.9%), Abies koreana (14.7%), Taxus cuspidata (10.2%), P. jezoensis (8.2%) and Betula ermanii (7.4%) in tree layer. It constituted Acer komarovii (18.6%), Acer pseudosieboldianum (18.4%) and Q. mongolica (8.9%) in subtree layer. It constituted Rhododendron schlippenbachii (20.7%), A. pseudosieboldianum (17.4%) and Symplocos chinensis (8.5%) in shrub layer. Indicator species analysis of vegetation unit 1 was consisted of Hydrangea serrata, Fraxinus mandshurica and D. glabrata that species prefer moist valley in subalpine or rocks. In the results of analyzing the species diversity, vegetation unit 1, 4 and 5 represented that there were different and complex local distributions. As in the similarity between the vegetation units, the vegetation units 1, 2, 3 and 4 represented high with 0.5 or above. It represented that there wasn't no differences on composition species in vegetation units.