• Title/Summary/Keyword: Visual Tracking

Search Result 528, Processing Time 0.03 seconds

Development of a structural inspection system with marking damage information at onsite based on an augmented reality technique

  • Junyeon Chung;Kiyoung Kim;Hoon Sohn
    • Smart Structures and Systems
    • /
    • v.31 no.6
    • /
    • pp.573-583
    • /
    • 2023
  • Although unmanned aerial vehicles have been used to overcome the limited accessibility of human-based visual inspection, unresolved issues still remain. Onsite inspectors face difficulty finding previously detected damage locations and tracking their status onsite. For example, an inspector still marks the damage location on a target structure with chalk or drawings while comparing the current status of existing damages to their previous status, as documented onsite. In this study, an augmented-reality-based structural inspection system with onsite damage information marking was developed to enhance the convenience of inspectors. The developed system detects structural damage, creates a holographic marker with damage information on the actual physical damage, and displays the marker onsite via an augmented reality headset. Because inspectors can view a marker with damage information in real time on the display, they can easily identify where the previous damage has occurred and whether the size of the damage is increasing. The performance of the developed system was validated through a field test, demonstrating that the system can enhance convenience by accelerating the inspector's essential tasks such as detecting damages, measuring their size, manually recording their information, and locating previous damages.

Routing optimization algorithm for logistics virtual monitoring based on VNF dynamic deployment

  • Qiao, Qiujuan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.5
    • /
    • pp.1708-1734
    • /
    • 2022
  • In the development of logistics system, the breakthrough of important technologies such as technology platform for logistics information management and control is the key content of the study. Based on Javascript and JQuery, the logistics system realizes real-time monitoring, collection of historical status data, statistical analysis and display, intelligent recommendation and other functions. In order to strengthen the cooperation of warehouse storage, enhance the utilization rate of resources, and achieve the purpose of real-time and visual supervision of transportation equipment and cargo tracking, this paper studies the VNF dynamic deployment and SFC routing problem in the network load change scenario based on the logistics system. The BIP model is used to model the VNF dynamic deployment and routing problem. The optimization objective is to minimize the total cost overhead generated by each SFCR. Furthermore, the application of the SFC mapping algorithm in the routing topology solving problem is proposed. Based on the concept of relative cost and the idea of topology transformation, the SFC-map algorithm can efficiently complete the dynamic deployment of VNF and the routing calculation of SFC by using multi-layer graph. In the simulation platform based on the logistics system, the proposed algorithm is compared with VNF-DRA algorithm and Provision Traffic algorithm in the network receiving rate, throughput, path end-to-end delay, deployment number, running time and utilization rate. According to the test results, it is verified that the test results of the optimization algorithm in this paper are obviously improved compared with the comparison method, and it has higher practical application and promotion value.

A Study on the Characteristics of Observation seen in the Process of Perception and Recognition of Space (공간의 지각과 인지과정에 나타난 주시메커니즘 특성 연구)

  • Kim, Jong-Ha
    • Korean Institute of Interior Design Journal
    • /
    • v.22 no.6
    • /
    • pp.108-118
    • /
    • 2013
  • This study has analyzed the process of space information perceived and recognized through the estimation of observation frequency and number according to the time range of observation data acquired from observation experiment with the object of hospital lobby. The followings are the results analyzed at this study. First, the continual observation of 3 and 6 times was attentive and conscious for probing to find an object rather than for acquiring exact information and that of 9 times could be regarded as the time for acquiring visual appreciation. However, the repetitive occurrence of high and low frequencies can be thought of repetitive acts for visual appreciation. Second, the continual observation of 3 and 6 times had the highest observation frequency of II, while that of 9 times had the highest observation frequency of III. In case of 3 and 6 times, the observation frequency had the tendency to become a little higher after being low since V, and in case of 9 times it had the repetition of becoming low and high and from IX it characteristically got higher. This feature can be thought to be the process that the subject repeats the fixation and movement of observation at a visual activity for perception and recognition. In the process of first observation, the observation frequency was the highest after 20 seconds or so, but since then, it gets lower and repeatedly gets higher and lower as time passes. After 90 seconds, the frequency showed the tendency of getting higher continuously. Third, the examination of changing features of frequency may show the characteristics of exploration for and attention to space but if the observation frequency is not associated with observation times for analysis there will a limitation that the features of observation frequency cannot be clarified. Accordingly, the simultaneous analysis of both is very effective for estimating the observation characteristics seen at the processes of perception and recognition. Fourth, the general analysis of the both revealed: with the progress of observation time the discontinuous space exploration decreased, and as the observation time got longer the fixed attention to a specific spot increased. Fifth, in order to estimate the observation characteristics by the change of time range the observation frequency and times by trend line was analyzed, which approach seems to be an appropriate technique that can comprehensively show the overall flow of time series data.

Scanning Determination & Observation Features by Sex shown in the Process of Acquiring Visual Information - With the Object of Subway Station Hall Space - (시각정보획득과정에 나타난 주사판정과 성별 주시특성 - 지하철 홀 공간을 대상으로 -)

  • Kim, Jong-Ha;Choi, Gae-Young
    • Korean Institute of Interior Design Journal
    • /
    • v.23 no.6
    • /
    • pp.115-124
    • /
    • 2014
  • This study has carried out scanning tests in order to figure out the features of scanning search by sex of space users, with the result of which the validity of data has been estimated. In this research, the scanning patterns were set up for verifying the typology of scanning paths and then the reason for determining scanning paths and the validity of estimation method were reviewed. Since the observation features depends on sex, the analysis of visual activities for acquiring any information in a space will reveal the intention and purpose of space users. The findings by analyzing the features of scanning pattern by sex which were found at the determination of scanning patterns can be defined as the followings. First, for estimating the process of space-information search, the movement distance at each point of continuative-observation data from the angle of eye-movement has been extracted, on the ground of which the fixation and movement of eye have been defined for the establishment of scanning-cut characteristics. Second, the scanning times were estimated for the extraction of effective observation data that would be used for comparative analysis, which showed that men had more data (3,398.2/64.4%) than women (2,998.2/55.6%). This enables the acknowledgment that the scanning cut of men was relatively less, which indicates that men will acquire more information on space than women in the process of observing any space. Third, men's scanning times (58.0 times/2.02 seconds) were less than those of women (71.9 times/1.39 seconds) while the scanning time of the former was longer than that of the latter, which shows the feature that it takes longer for men than women in scanning while the scanning times of the former is less than those of the latter. Fourth, the observation features can be determined that the combination of this result with the predominance character by sex for a general viewpoint to be employed indicates that while men employ mixed-scanning for observation activities to acquire space-information spending for longer time, women, by concentrated-scanning, focus on a single point for shorter time or stay at one location for a considerably long time for space-information acquirement.

Difference in visual attention during the assessment of facial attractiveness and trustworthiness (얼굴 매력도와 신뢰성 평가에서 시각적 주의의 차이)

  • Sung, Young-Shin;Cho, Kyung-Jin;Kim, Do-Yeon;Kim, Hack-Jin
    • Science of Emotion and Sensibility
    • /
    • v.13 no.3
    • /
    • pp.533-540
    • /
    • 2010
  • This study was designed to examine the difference in visual attention between the evaluations of facial attractiveness and facial trustworthiness, both of which may be the two most fundamental social evaluation for forming first impressions under various types of social interactions. In study 1, participants were asked to evaluate the attractiveness and trustworthiness of 40 new faces while their gaze directions being recorded using an eye-tracker. The analysis revealed that participants spent significantly longer gaze fixation time while examining certain facial features such as eyes and nose during the evaluation of facial trustworthiness, as compared to facial attractiveness. In study 2, participants performed the same face evaluation tasks, except that a word was briefly displayed on a certain facial feature in each face trial, which were then followed by unexpected recall tests of the previously viewed words. The analysis demonstrated that the recognition rate of the words that had been presented on the nose was significantly higher for the task of facial trustworthiness vs. facial attractiveness evaluation. These findings suggest that the evaluation of facial trustworthiness may be distinguished by that of facial attractiveness in terms of the allocation of attentional resources.

  • PDF

Analysis of the Visual Attention to the 'Arrows' and the Affordance of Eye-movement of the 'Arrows' that Appear during the Course of Learning Science Textbooks of Pre-service Teachers: Focusing on the 'Weather and Our Life' Unit (예비교사의 과학교과서 학습 과정 중에 나타나는 '화살표'에 대한 시각적 주의 및 '화살표'의 시선 행동 유도성 분석: '날씨와 우리 생활' 단원을 중심으로)

  • Lim, Sung-man
    • Journal of the Korean Society of Earth Science Education
    • /
    • v.13 no.3
    • /
    • pp.211-225
    • /
    • 2020
  • The purpose of this study was to investigate and analyze pre-service teachers' eye-movement in science textbooks in the learning process, whether they perceived "arrow" presented in textbooks, and changes in eye-movement by arrows. For the study, an eye-tracker, a eye-movement tracking device, was used, and 10 pre-service teachers attending a teacher training college were selected and conducted. The science textbook unit used in the research was the "Weather and Our Life" unit, one of the areas of earth science. As a result of the study, first, it was investigated that pre-service teachers devote more time to texts rather than illustrations in the learning process of science textbooks. Second, it was analyzed that pre-service teachers did not pay attention to the "arrow" presented in science textbooks. Third, it was confirmed that in order for "affordance of the eye-movement by arrow" to occur, sufficient concentration on "arrow" should be made. These findings suggest the importance of the learner's visual attention to learning elements in science textbooks such as "arrow". In addition, it suggests the importance of developing a textbook editing design that can induce visual attention to learning elements in textbooks through eye-movement research data for effective learning.

Exploring Mask Appeal: Vertical vs. Horizontal Fold Flat Masks Using Eye-Tracking (마스크 매력 탐구: 아이트래킹을 활용한 수직 접이형 대 수평 접이형 마스크 비교 분석)

  • Junsik Lee;Nan-Hee Jeong;Ji-Chan Yun;Do-Hyung Park;Se-Bum Park
    • Journal of Intelligence and Information Systems
    • /
    • v.29 no.4
    • /
    • pp.271-286
    • /
    • 2023
  • The global COVID-19 pandemic has transformed face masks from situational accessories to indispensable items in daily life, prompting a shift in public perception and behavior. While the relaxation of mandatory mask-wearing regulations is underway, a significant number of individuals continue to embrace face masks, turning them into a form of personal expression and identity. This phenomenon has given rise to the Fashion Mask industry, characterized by unique designs and colors, experiencing rapid growth in the market. However, existing research on masks is predominantly focused on their efficacy in preventing infection or exploring attitudes during the pandemic, leaving a gap in understanding consumer preferences for mask design. We address this gap by investigating consumer perceptions and preferences for two prevalent mask designs-horizontal fold flat masks and vertical fold flat masks. Through a comprehensive approach involving surveys and eye-tracking experiments, we aim to unravel the subtle differences in how consumers perceive these designs. Our research questions focus on determining which design is more appealing and exploring the reasons behind any observed differences. The study's findings reveal a clear preference for vertical fold flat masks, which are not only preferred but also perceived as unique, sophisticated, three-dimensional, and lively. The eye-tracking analysis provides insights into the visual attention patterns associated with mask designs, highlighting the pivotal role of the fold line in influencing these patterns. This research contributes to the evolving understanding of masks as a fashion statement and provides valuable insights for manufacturers and marketers in the Fashion Mask industry. The results have implications beyond the pandemic, emphasizing the importance of design elements in sustaining consumer interest in face masks.

Spatial Information Search Features Shown in Eye Fixations and Saccades (시선의 고정과 도약에 나타난 공간정보 탐색 특성)

  • Kim, Jong-Ha
    • Korean Institute of Interior Design Journal
    • /
    • v.26 no.2
    • /
    • pp.22-32
    • /
    • 2017
  • This research is to analyze the spatial information search features which shown by Eye fixation and movement and conducted eye tracking experiment for targeting sports shop spatial images which it are same but looks different. This is able to find out the eye movement feature according to placement of goods from the eye movement and movement distance of spatial visitor, and the result can be defined as following. First, the whole original-reverse left / right images have a higher number of observations in the [IN] area than in the [OUT] area. This is because after eye taking high observations in LA area of [IN] have been jump-over [OUT], performed search activities in low eye fixation without high eye fixation. Second, there was a difference in the frequency of the observation data as the composition of the images changed. The original image has been often fixed the eyes in LA area, and the one that has been observed for a long time is reverse left / right image. Also, fixation point was shown higher at the reverse left / right image as jump-over from [OUT] area to [IN] area. If LA area seen as reverse left / right image, it is located in right-hand side. The case where the dominant area is on the right side has a characteristic that the eye fixation is longer. This can be understand that the arrangement of products for attract the customer's attention in the commercial space might be more effective when it is on the right side. Third, the moving distance(IN ${\rightarrow}$ OUT) of the sight pointed to external from LA area was long in the both original-reverse left / right images, but it is no relation with search direction([IN${\rightarrow}$OUT] [IN${\rightarrow}$OUT]) of the sight. In other words, the sight that entered in LA area can be seen as visual perception activity for re-searching after big jump-over, in the case go in to outward (OUT area) after searching for more than certain time. The fact that the moving distance of eye is relatively short in the [IN ${\rightarrow}$ OUT] process considered as that the gaze that stays outside the LA area naturally enters in to LA area.

Method for Extracting Features of Conscious Eye Moving for Exploring Space Information (공간정보 탐색을 위한 의식적 시선 이동특성 추출 방법)

  • Kim, Jong-Ha;Jung, Jae-Young
    • Korean Institute of Interior Design Journal
    • /
    • v.25 no.2
    • /
    • pp.21-29
    • /
    • 2016
  • This study has estimated the traits of conscious eye moving with the objects of the halls of subway stations. For that estimation, the observation data from eye-tracking were matched with the experiment images, while an independent program was produced and utilized for the analysis of the eye moving in the selected sections, which could provide the ground for clarifying the traits of space-users' eye moving. The outcomes can be defines as the followings. First, The application of the independently produced program provides the method for coding the great amount of observation data, which cut down a lot of analysis time for finding out the traits of conscious eye moving. Accordingly, the inclusion of eye's intentionality in the method for extracting the characteristics of eye moving enabled the features of entrance and exit of particular objects with the course of observing time to be organized. Second, The examination of eye moving at each area surrounding the object factors showed that [out]${\rightarrow}$[in], which the line of sight is from the surround area to the objects, characteristically moved from the left-top (Area I) of the selected object to the object while [in]${\rightarrow}$[out], which is from the inside of the object to the outside, also moved to the left-top (Area I). Overall, there were much eye moving from the tops of right and left (Area I, II) to the object, but the eye moving to the outside was found to move to the left-top (Area I), the right-middle (Area IV) and the right-top (Area II). Third, In order to find if there was any intense eye-moving toward a particular factor, the dominant standards were presented for analysis, which showed that there was much eye-moving from the tops (Area I, II) to the sections of 1 and 2. While the eye-moving of [in] was [I $I{\rightarrow}A$](23.0%), [$I{\rightarrow}B$](16.1%) and [$II{\rightarrow}B$](13.8%), that of [out] was [$A{\rightarrow}I$](14.8%), [$B{\rightarrow}I$](13.6%), [$A{\rightarrow}II$](11.4%), [$B{\rightarrow}IV$](11.4%) and [$B{\rightarrow}II$](10.2%). Though the eye-moving toward objects took place in specific directions (areas), that (out) from the objects to the outside was found to be dispersed widely to different areas.

Context-Dependent Video Data Augmentation for Human Instance Segmentation (인물 개체 분할을 위한 맥락-의존적 비디오 데이터 보강)

  • HyunJin Chun;JongHun Lee;InCheol Kim
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.5
    • /
    • pp.217-228
    • /
    • 2023
  • Video instance segmentation is an intelligent visual task with high complexity because it not only requires object instance segmentation for each image frame constituting a video, but also requires accurate tracking of instances throughout the frame sequence of the video. In special, human instance segmentation in drama videos has an unique characteristic that requires accurate tracking of several main characters interacting in various places and times. Also, it is also characterized by a kind of the class imbalance problem because there is a significant difference between the frequency of main characters and that of supporting or auxiliary characters in drama videos. In this paper, we introduce a new human instance datatset called MHIS, which is built upon drama videos, Miseang, and then propose a novel video data augmentation method, CDVA, in order to overcome the data imbalance problem between character classes. Different from the previous video data augmentation methods, the proposed CDVA generates more realistic augmented videos by deciding the optimal location within the background clip for a target human instance to be inserted with taking rich spatio-temporal context embedded in videos into account. Therefore, the proposed augmentation method, CDVA, can improve the performance of a deep neural network model for video instance segmentation. Conducting both quantitative and qualitative experiments using the MHIS dataset, we prove the usefulness and effectiveness of the proposed video data augmentation method.