• Title/Summary/Keyword: multi-temporal

Search Result 669, Processing Time 0.023 seconds

Face Detection Using Multi-level Features for Privacy Protection in Large-scale Surveillance Video (대규모 비디오 감시 환경에서 프라이버시 보호를 위한 다중 레벨 특징 기반 얼굴검출 방법에 관한 연구)

  • Lee, Seung Ho;Moon, Jung Ik;Kim, Hyung-Il;Ro, Yong Man
    • Journal of Korea Multimedia Society
    • /
    • v.18 no.11
    • /
    • pp.1268-1280
    • /
    • 2015
  • In video surveillance system, the exposure of a person's face is a serious threat to personal privacy. To protect the personal privacy in large amount of videos, an automatic face detection method is required to locate and mask the person's face. However, in real-world surveillance videos, the effectiveness of existing face detection methods could deteriorate due to large variations in facial appearance (e.g., facial pose, illumination etc.) or degraded face (e.g., occluded face, low-resolution face etc.). This paper proposes a new face detection method based on multi-level facial features. In a video frame, different kinds of spatial features are independently extracted, and analyzed, which could complement each other in the aforementioned challenges. Temporal domain analysis is also exploited to consolidate the proposed method. Experimental results show that, compared to competing methods, the proposed method is able to achieve very high recall rates while maintaining acceptable precision rates.

Wind Prediction with a Short-range Multi-Model Ensemble System (단시간 다중모델 앙상블 바람 예측)

  • Yoon, Ji Won;Lee, Yong Hee;Lee, Hee Choon;Ha, Jong-Chul;Lee, Hee Sang;Chang, Dong-Eon
    • Atmosphere
    • /
    • v.17 no.4
    • /
    • pp.327-337
    • /
    • 2007
  • In this study, we examined the new ensemble training approach to reduce the systematic error and improve prediction skill of wind by using the Short-range Ensemble prediction system (SENSE), which is the mesoscale multi-model ensemble prediction system. The SENSE has 16 ensemble members based on the MM5, WRF ARW, and WRF NMM. We evaluated the skill of surface wind prediction compared with AWS (Automatic Weather Station) observation during the summer season (June - August, 2006). At first stage, the correction of initial state for each member was performed with respect to the observed values, and the corrected members get the training stage to find out an adaptive weight function, which is formulated by Root Mean Square Vector Error (RMSVE). It was found that the optimal training period was 1-day through the experiments of sensitivity to the training interval. We obtained the weighted ensemble average which reveals smaller errors of the spatial and temporal pattern of wind speed than those of the simple ensemble average.

Multi-resolution Motion Estimation Algorithm Using Adaptive Search Region (적응적 탐색영역을 이용한 다중해상도 움직임 추정 방법)

  • 최정현;이경환;이법기;정원식;정태연;김덕규
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.24 no.8B
    • /
    • pp.1540-1548
    • /
    • 1999
  • We propose a multi-resolution motion estimation algorithm using adaptive search region. It is constructed in wavelet domain that a binary plane which represents the potential motion areas(PMA's) based on the temporal redundancy between video frames, and motion estimation is processed in the PMA's. We reduce the PMA's gradually as the resolution level is higher, considering the distribution of the energy in subband layers and the complexity. As compared with EMRME(enhanced multi-resolution motion estimation) method[7], simulation results show that computational amount and bit rate reduced to about 33 ~46 % and 10 ~l8% respectively in active image with similar PSNR, and computational amount reduced to about 37 ~65 % in small notion image with similar PSNR and bit rate.

  • PDF

Initial Second Harmonic Generation in Narrowband Surface Waves by Multi-Line Laser Beams for Two Kinds of Spatial Energy Profile Models: Gaussian and Square-Like

  • Choi, Sungho;Jhang, Kyung-Young
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.33 no.3
    • /
    • pp.257-263
    • /
    • 2013
  • Acoustic nonlinearity of surface waves is an effective method to evaluate the micro damage on the surface of materials. In this method, the $A_1$ (magnitude of the fundamental wave) and $A_2$ (magnitude of the second-order harmonic wave) are measured for evaluation of acoustic nonlinearity. However, if there is another source of second-order harmonic wave other than the material itself, the linear relationship between $A_1{^2}$ and $A_2$ will not be guaranteed. Therefore, the second-order harmonic generation by another source should be fully suppressed. In this paper, we investigated the initial second-order harmonic generation in narrowband surface waves by multi-line laser beams. The spatial profile of laser beam was considered in the cases of Gaussian and square-like. The temporal profile was assumed to be Gaussian. In case of Gaussian spatial profile, the generation of the initial second-order harmonic wave was inevitable. However, when the spatial profile was square-like, the generation of the initial second-order harmonic wave was able to be fully suppressed at specific duty ratio. These results mean that the multi-line laser beams of square-like profile with a proper duty ratio are useful to evaluate the acoustic nonlinearity of the generated surface waves.

Multiscale features and information extraction of online strain for long-span bridges

  • Wu, Baijian;Li, Zhaoxia;Chan, Tommy H.T.;Wang, Ying
    • Smart Structures and Systems
    • /
    • v.14 no.4
    • /
    • pp.679-697
    • /
    • 2014
  • The strain data acquired from structural health monitoring (SHM) systems play an important role in the state monitoring and damage identification of bridges. Due to the environmental complexity of civil structures, a better understanding of the actual strain data will help filling the gap between theoretical/laboratorial results and practical application. In the study, the multi-scale features of strain response are first revealed after abundant investigations on the actual data from two typical long-span bridges. Results show that, strain types at the three typical temporal scales of $10^5$, $10^2$ and $10^0$ sec are caused by temperature change, trains and heavy trucks, and have their respective cut-off frequency in the order of $10^{-2}$, $10^{-1}$ and $10^0$ Hz. Multi-resolution analysis and wavelet shrinkage are applied for separating and extracting these strain types. During the above process, two methods for determining thresholds are introduced. The excellent ability of wavelet transform on simultaneously time-frequency analysis leads to an effective information extraction. After extraction, the strain data will be compressed at an attractive ratio. This research may contribute to a further understanding of actual strain data of long-span bridges; also, the proposed extracting methodology is applicable on actual SHM systems.

Multi-Frame Face Classification with Decision-Level Fusion based on Photon-Counting Linear Discriminant Analysis

  • Yeom, Seokwon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.14 no.4
    • /
    • pp.332-339
    • /
    • 2014
  • Face classification has wide applications in security and surveillance. However, this technique presents various challenges caused by pose, illumination, and expression changes. Face recognition with long-distance images involves additional challenges, owing to focusing problems and motion blurring. Multiple frames under varying spatial or temporal settings can acquire additional information, which can be used to achieve improved classification performance. This study investigates the effectiveness of multi-frame decision-level fusion with photon-counting linear discriminant analysis. Multiple frames generate multiple scores for each class. The fusion process comprises three stages: score normalization, score validation, and score combination. Candidate scores are selected during the score validation process, after the scores are normalized. The score validation process removes bad scores that can degrade the final output. The selected candidate scores are combined using one of the following fusion rules: maximum, averaging, and majority voting. Degraded facial images are employed to demonstrate the robustness of multi-frame decision-level fusion in harsh environments. Out-of-focus and motion blurring point-spread functions are applied to the test images, to simulate long-distance acquisition. Experimental results with three facial data sets indicate the efficiency of the proposed decision-level fusion scheme.

A Video Expression Recognition Method Based on Multi-mode Convolution Neural Network and Multiplicative Feature Fusion

  • Ren, Qun
    • Journal of Information Processing Systems
    • /
    • v.17 no.3
    • /
    • pp.556-570
    • /
    • 2021
  • The existing video expression recognition methods mainly focus on the spatial feature extraction of video expression images, but tend to ignore the dynamic features of video sequences. To solve this problem, a multi-mode convolution neural network method is proposed to effectively improve the performance of facial expression recognition in video. Firstly, OpenFace 2.0 is used to detect face images in video, and two deep convolution neural networks are used to extract spatiotemporal expression features. Furthermore, spatial convolution neural network is used to extract the spatial information features of each static expression image, and the dynamic information feature is extracted from the optical flow information of multiple expression images based on temporal convolution neural network. Then, the spatiotemporal features learned by the two deep convolution neural networks are fused by multiplication. Finally, the fused features are input into support vector machine to realize the facial expression classification. Experimental results show that the recognition accuracy of the proposed method can reach 64.57% and 60.89%, respectively on RML and Baum-ls datasets. It is better than that of other contrast methods.

A Multi-category Task for Bitrate Interval Prediction with the Target Perceptual Quality

  • Yang, Zhenwei;Shen, Liquan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.12
    • /
    • pp.4476-4491
    • /
    • 2021
  • Video service providers tend to face user network problems in the process of transmitting video streams. They strive to provide user with superior video quality in a limited bitrate environment. It is necessary to accurately determine the target bitrate range of the video under different quality requirements. Recently, several schemes have been proposed to meet this requirement. However, they do not take the impact of visual influence into account. In this paper, we propose a new multi-category model to accurately predict the target bitrate range with target visual quality by machine learning. Firstly, a dataset is constructed to generate multi-category models by machine learning. The quality score ladders and the corresponding bitrate-interval categories are defined in the dataset. Secondly, several types of spatial-temporal features related to VMAF evaluation metrics and visual factors are extracted and processed statistically for classification. Finally, bitrate prediction models trained on the dataset by RandomForest classifier can be used to accurately predict the target bitrate of the input videos with target video quality. The classification prediction accuracy of the model reaches 0.705 and the encoded video which is compressed by the bitrate predicted by the model can achieve the target perceptual quality.

Pasture Vegetation Changes in Mongolia

  • Erdenetuya, M.
    • The Korean Journal of Quaternary Research
    • /
    • v.18 no.2 s.23
    • /
    • pp.105-106
    • /
    • 2004
  • The NDVI(normalized difference vegetation index) dataset is unique or main tool to assess the global, multi seasonal, multi annual, and multi spectral changes over the World. These features are useful for environmental studies in particular, for the vegetation coverage monitoring of the country as Mongolia, where are large pastureland and pastoral animal husbandry, which dependent on natural conditions. Pasture vegetation cover is changing accordingly with both of global climate change and anthropogenic effect or human impacts. Using past 20 years (1982-2001) NDVI derived from NOAA satellite, its dynamical trend has been decreased in all natural zones differently. Also applied the method named "Two Years Differences" which could calculate the number of years with increased or decreased NDVI values at the same place. From May to September have occurred the 9 years maximum decreases of NDVI over Mongolia, but it obtained differently in spatial and temporal scale. In 24.4 ? 32.7% of all territory occurred one year decrease of NDVI and in 18% occurred more than 3 years frequent decrease of NDVI. According to the linear trend of NDVI and in 18% occurred more than 3 years frequent decrease of NDVI dynamics over 69% of whole territory of Mongolia NDVI values had been decreased due to both natural and human induced impacts to the pasture condition. In this paper also included some results of the integrated analyses of NOAA/NDVI and ground truth data over Monglia separately by natural zones.

  • PDF

Numerical Study on the Effect of Exhaust Flow Pattern under Real Running Condition on the Performance and Reliability of Closed-Coupled Catalyst (실 운전조건에서의 배기유동패턴이 근접장착 촉매변환기의 성능 및 신뢰성에 미치는 영향에 관한 수치적 연구)

  • 정수진;김우승
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.12 no.2
    • /
    • pp.54-61
    • /
    • 2004
  • The engine-out flow is highly transient and hot, and may place tremendous thermal and inertial loads on a closed-coupled catalyst. Therefore, time-dependent and detailed flow and thermal field simulation may be crucial. The aim of this study is to develop combined chemical reaction and multi-dimensional fluid dynamic mathematical model and to study the effect of unsteady pulsating thermal and flow characteristics on thermal reliability of closed-coupled catalyst. The effect of cell density on the conversion performance under real running condition is also investigated. Unlike previous studies, the present study focuses on coupling between the problems of pulsating flow pattern and catalyst thermal response and conversion efficiency. The results are expressed in terms of temporal evolution of flow, pollutant and temperature distribution as well as transient characteristics of conversion efficiency. Fundamental understanding of the flow and thermal phenomena of closed-coupled catalyst under real running condition is presented. It is shown that instants of significantly low values of flow uniformity and conversion efficiency exist during exhaust blowdown and the temporal varaition of flow uniformity is very similar in pattern to one of conversion efficiency. It is also found that the location of hot spot in monolith is directly affected by transient flow pattern in closed-coupled catalyst.