• Title/Summary/Keyword: Spatio-temporal Fusion

Search Result 17, Processing Time 0.022 seconds

Development of Hybrid Spatial Information Model for National Base Map (국가기본도용 Hybrid 공간정보 모델 개발)

  • Hwang, Jin Sang;Yun, Hong Sik;Yoo, Jae Yong;Cho, Seong Hwan;Kang, Seong Chan
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.32 no.4_1
    • /
    • pp.335-341
    • /
    • 2014
  • The main goal of this study is on developing a proper brand-new data of national base map and Data Based(DB) model for new information technology environments. To achieve this goal, we generated a brand-new Hybrid spatial information model which is specialized in the spatio-temporal map structure, the framework map for information integration, and the multiple-layered topology structure. The DB structure was designed to reflect the change of objections by adding a new dimension of 'time' in the spartial information, while the infrastructure was able to connect/converge with other information by giving the unique ID and multi-scale fusion map structure. Furthermore, the topology and multi visualization structure, including indoor and basement information, were designed to overcome limitations of expressing in 2 dimension map. The result from the performance test, which was based on the Hybrid spatial information model, confirms the possibility in advanced national base map and conducted DB model through implementing various information and spatiotemporal connections.

Secured Authentication through Integration of Gait and Footprint for Human Identification

  • Murukesh, C.;Thanushkodi, K.;Padmanabhan, Preethi;Feroze, Naina Mohamed D.
    • Journal of Electrical Engineering and Technology
    • /
    • v.9 no.6
    • /
    • pp.2118-2125
    • /
    • 2014
  • Gait Recognition is a new technique to identify the people by the way they walk. Human gait is a spatio-temporal phenomenon that typifies the motion characteristics of an individual. The proposed method makes a simple but efficient attempt to gait recognition. For each video file, spatial silhouettes of a walker are extracted by an improved background subtraction procedure using Gaussian Mixture Model (GMM). Here GMM is used as a parametric probability density function represented as a weighted sum of Gaussian component densities. Then, the relevant features are extracted from the silhouette tracked from the given video file using the Principal Component Analysis (PCA) method. The Fisher Linear Discriminant Analysis (FLDA) classifier is used in the classification of dimensional reduced image derived by the PCA method for gait recognition. Although gait images can be easily acquired, the gait recognition is affected by clothes, shoes, carrying status and specific physical condition of an individual. To overcome this problem, it is combined with footprint as a multimodal biometric system. The minutiae is extracted from the footprint and then fused with silhouette image using the Discrete Stationary Wavelet Transform (DSWT). The experimental result shows that the efficiency of proposed fusion algorithm works well and attains better result while comparing with other fusion schemes.

Impact Assessment of Forest Development on Net Primary Production using Satellite Image Spatial-temporal Fusion and CASA-Model (위성영상 시공간 융합과 CASA 모형을 활용한 산지 개발사업의 식생 순일차생산량에 대한 영향 평가)

  • Jin, Yi-Hua;Zhu, Jing-Rong;Sung, Sun-Yong;Lee, Dong-Ku
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.20 no.4
    • /
    • pp.29-42
    • /
    • 2017
  • As the "Guidelines for GHG Environmental Assessment" was revised, it pointed out that the developers should evaluate GHG sequestration and storage of the developing site. However, the current guidelines only taking into account the quantitative reduction lost within the development site, and did not consider the qualitative decrease in the carbon sequestration capacity of forest edge produced by developments. In order to assess the quantitative and qualitative effects of vegetation carbon uptake, the CASA-NPP model and satellite image spatial-temporal fusion were used to estimate the annual net primary production in 2005 and 2015. The development projects between 2006 and 2014 were examined for evaluate quantitative changes in development site and qualitative changes in surroundings by development types. The RMSE value of the satellite image fusion results is less than 0.1 and approaches 0, and the correlation coefficient is more than 0.6, which shows relatively high prediction accuracy. The NPP estimation results range from 0 to $1335.53g\;C/m^2$ year before development and from 0 to $1333.77g\;C/m^2$ year after development. As a result of analyzing NPP reduction amount within the development area by type of forest development, the difference is not significant by type of development but it shows the lowest change in the sports facilities development. It was also found that the vegetation was most affected by the edge vegetation of industrial development. This suggests that the industrial development causes additional development in the surrounding area and indirectly influences the carbon sequestration function of edge vegetaion due to the increase of the edge and influx of disturbed species. The NPP calculation method and results presented in this study can be applied to quantitative and qualitative impact assessment of before and after development, and it can be applied to policies related to greenhouse gas in environmental impact assessment.

Human Activity Recognition Based on 3D Residual Dense Network

  • Park, Jin-Ho;Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.12
    • /
    • pp.1540-1551
    • /
    • 2020
  • Aiming at the problem that the existing human behavior recognition algorithm cannot fully utilize the multi-level spatio-temporal information of the network, a human behavior recognition algorithm based on a dense three-dimensional residual network is proposed. First, the proposed algorithm uses a dense block of three-dimensional residuals as the basic module of the network. The module extracts the hierarchical features of human behavior through densely connected convolutional layers; Secondly, the local feature aggregation adaptive method is used to learn the local dense features of human behavior; Then, the residual connection module is applied to promote the flow of feature information and reduced the difficulty of training; Finally, the multi-layer local feature extraction of the network is realized by cascading multiple three-dimensional residual dense blocks, and use the global feature aggregation adaptive method to learn the features of all network layers to realize human behavior recognition. A large number of experimental results on benchmark datasets KTH show that the recognition rate (top-l accuracy) of the proposed algorithm reaches 93.52%. Compared with the three-dimensional convolutional neural network (C3D) algorithm, it has improved by 3.93 percentage points. The proposed algorithm framework has good robustness and transfer learning ability, and can effectively handle a variety of video behavior recognition tasks.

Multi-modal Emotion Recognition using Semi-supervised Learning and Multiple Neural Networks in the Wild (준 지도학습과 여러 개의 딥 뉴럴 네트워크를 사용한 멀티 모달 기반 감정 인식 알고리즘)

  • Kim, Dae Ha;Song, Byung Cheol
    • Journal of Broadcast Engineering
    • /
    • v.23 no.3
    • /
    • pp.351-360
    • /
    • 2018
  • Human emotion recognition is a research topic that is receiving continuous attention in computer vision and artificial intelligence domains. This paper proposes a method for classifying human emotions through multiple neural networks based on multi-modal signals which consist of image, landmark, and audio in a wild environment. The proposed method has the following features. First, the learning performance of the image-based network is greatly improved by employing both multi-task learning and semi-supervised learning using the spatio-temporal characteristic of videos. Second, a model for converting 1-dimensional (1D) landmark information of face into two-dimensional (2D) images, is newly proposed, and a CNN-LSTM network based on the model is proposed for better emotion recognition. Third, based on an observation that audio signals are often very effective for specific emotions, we propose an audio deep learning mechanism robust to the specific emotions. Finally, so-called emotion adaptive fusion is applied to enable synergy of multiple networks. The proposed network improves emotion classification performance by appropriately integrating existing supervised learning and semi-supervised learning networks. In the fifth attempt on the given test set in the EmotiW2017 challenge, the proposed method achieved a classification accuracy of 57.12%.

Generation of Land Surface Temperature Orthophoto and Temperature Accuracy Analysis by Land Covers Based on Thermal Infrared Sensor Mounted on Unmanned Aerial Vehicle (무인항공기에 탑재된 열적외선 센서 기반의 지표면 온도 정사영상 제작 및 피복별 온도 정확도 분석)

  • Park, Jin Hwan;Lee, Ki Rim;Lee, Won Hee;Han, You Kyung
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.36 no.4
    • /
    • pp.263-270
    • /
    • 2018
  • Land surface temperature is known to be an important factor in understanding the interactions of the ground-atmosphere. However, because of the large spatio-temporal variability, regular observation is rarely made. The existing land surface temperature is observed using satellite images, but due to the nature of satellite, it has the limit of long revisit period and low accuracy. In this study, in order to confirm the possibility of replacing land surface temperature observation using satellite imagery, images acquired by TIR (Thermal Infrared) sensor mounted on UAV (Unmanned Aerial Vehicle) are used. The acquired images were transformed from JPEG (Joint Photographic Experts Group) to TIFF (Tagged Image File Format) format and orthophoto was then generated. The DN (Digital Number) value of orthophoto was used to calculate the actual land surface temperature. In order to evaluate the accuracy of the calculated land surface temperature, the land surface temperature was compared with the land surface temperature directly observed with an infrared thermometer at the same time. When comparing the observed land surface temperatures in two ways, the accuracy of all the land covers was below the measure accuracy of the TIR sensor. Therefore, the possibility of replacing the satellite image, which is a conventional land surface temperature observation method, is confirmed by using the TIR sensor mounted on UAV.

Distinct Spatio-temporal Expression Patterns of Patatin Promoter-GUS Gene Fusion in Transgenic Potato Microtubers (형질전환 감자 소괴경의 발달단계에 따른 Patatin Promoter-GUS 유전자의 발현 분석)

  • Youm, Jung-Won;Kim, Mi-Sun;Lee, Byoung-Chan;Kang, Won-Jin;Jeon, Jae-Heung;Joung, Hyouk;Kim, Hyun-Soon
    • Journal of Plant Biotechnology
    • /
    • v.30 no.1
    • /
    • pp.13-18
    • /
    • 2003
  • This study was carried out to investigate the expression patterns of foreign gene that controlled by tuber-specific patatin promoter in transgenic potatoes. Potato leaf disc cultured in vitro were transformed by the Agrobacterium strain LBA4404 containing pBl121 or pATGUS from potato cv. Desiree. In order to select the transgenic lines, gene-specific primers deduced from the NPTII were synthesized and used for polymerase chain reaction. The down part of the putative transgenic potatoes was transplanted weekly onto sucrose-enriched medium to accelerate the microtuber formation. RNA gel blot analysis was performed on the total RNAs obtained from tuber that had been harvested at a week interval. Also, histochemical assay was observed in the explants transformed with either pBI121 or pATGUS. Results showed that the transgenic plant containing pATGUS expressed GUS transcripts mainly at the tuber, not in stem, with the highest expression level in 5 weeks-grown microtubers. In contrast to pATGUS plants, the transformed plants with pBI121 showed an equal expression pattern throughout the whole developing stages. Consistent with RNA gel blot analysis, histochemical GUS staining and enzyme activity exhibited pATGUS transcripts were at the highest level in 5 weeks cultures. From these results, we suggest that the best stage to analyze the foreign gene introduced by patatin promoter into potato plants is at 5 weeks cultures after tuber formation.