• Title/Summary/Keyword: Spatiotemporal Image

Search Result 47, Processing Time 0.023 seconds

Motion Estimation-based Human Fall Detection for Visual Surveillance

  • Kim, Heegwang;Park, Jinho;Park, Hasil;Paik, Joonki
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.5 no.5
    • /
    • pp.327-330
    • /
    • 2016
  • Currently, the world's elderly population continues to grow at a dramatic rate. As the number of senior citizens increases, detection of someone falling has attracted increasing attention for visual surveillance systems. This paper presents a novel fall-detection algorithm using motion estimation and an integrated spatiotemporal energy map of the object region. The proposed method first extracts a human region using a background subtraction method. Next, we applied an optical flow algorithm to estimate motion vectors, and an energy map is generated by accumulating the detected human region for a certain period of time. We can then detect a fall using k-nearest neighbor (kNN) classification with the previously estimated motion information and energy map. The experimental results show that the proposed algorithm can effectively detect someone falling in any direction, including at an angle parallel to the camera's optical axis.

Virtual Reality Community Gait Training Using a 360° Image Improves Gait Ability in Chronic Stroke Patients

  • Kim, Myung-Joon
    • The Journal of Korean Physical Therapy
    • /
    • v.32 no.3
    • /
    • pp.185-190
    • /
    • 2020
  • Purpose: Gait and cognitive impairment in stroke patients exacerbate fall risk and mobility difficulties during multi-task walking. Virtual reality can provide interesting and challenging training in a community setting. This study evaluated the effect of community-based virtual reality gait training (VRGT) using a 360-degree image on the gait ability of chronic stroke patients. Methods: Forty-five chronic stroke patients who were admitted to a rehabilitation hospital participated in this study. Patients meeting the selection criteria were randomly divided into a VRGT group (n=23) and a control group (n=22). Both these groups received general rehabilitation. The VRGT group was evaluated using a 360-degree image that was recorded for 50 minutes a day, 5 days per week for a total of 6 weeks after their training. The control group received general treadmill training for the same amount of time as that of the VRGT group. The improvement in the spatiotemporal parameters of gait was evaluated using a gait analyzer system before and after training. Results: The spatiotemporal gait parameters showed significant improvements in both groups compare with the baseline measurements (p<0.05), and the VRGT group showed more improvement than the control group (p<0.05). Conclusion: Community-based VRGT has been shown to improve the walking ability of chronic stroke patients and is expected to be used in rehabilitation of stroke patients in the future.

Application of Satellite Data Spatiotemporal Fusion in Predicting Seasonal NDVI (위성영상 시공간 융합기법의 계절별 NDVI 예측에서의 응용)

  • Jin, Yihua;Zhu, Jingrong;Sung, Sunyong;Lee, Dong Kun
    • Korean Journal of Remote Sensing
    • /
    • v.33 no.2
    • /
    • pp.149-158
    • /
    • 2017
  • Fine temporal and spatial resolution of image data are necessary to monitor the phenology of vegetation. However, there is no single sensor provides fine temporal and spatial resolution. For solve this limitation, researches on spatiotemporal data fusion methods are being conducted. Among them, FSDAF (Flexible spatiotemporal data fusion) can fuse each band in high accuracy.In thisstudy, we applied MODIS NDVI and Landsat NDVI to enhance time resolution of NDVI based on FSDAF algorithm. Then we proposed the possibility of utilization in vegetation phenology monitoring. As a result of FSDAF method, the predicted NDVI from January to December well reflect the seasonal characteristics of broadleaf forest, evergreen forest and farmland. The RMSE values between predicted NDVI and actual NDVI (Landsat NDVI) of August and October were 0.049 and 0.085, and the correlation coefficients were 0.765 and 0.642 respectively. Spatiotemporal data fusion method is a pixel-based fusion technique that can be applied to variousspatial resolution images, and expected to be applied to various vegetation-related studies.

Fast Real-Time Cardiac MRI: a Review of Current Techniques and Future Directions

  • Wang, Xiaoqing;Uecker, Martin;Feng, Li
    • Investigative Magnetic Resonance Imaging
    • /
    • v.25 no.4
    • /
    • pp.252-265
    • /
    • 2021
  • Cardiac magnetic resonance imaging (MRI) serves as a clinical gold-standard non-invasive imaging technique for the assessment of global and regional cardiac function. Conventional cardiac MRI is limited by the long acquisition time, the need for ECG gating and/or long breathhold, and insufficient spatiotemporal resolution. Real-time cardiac cine MRI refers to high spatiotemporal cardiac imaging using data acquired continuously without synchronization or binning, and therefore of potential interest in overcoming the limitations of conventional cardiac MRI. Novel acquisition and reconstruction techniques must be employed to facilitate real-time cardiac MRI. The goal of this study is to discuss methods that have been developed for real-time cardiac MRI. In particular, we classified existing techniques into two categories based on the use of non-iterative and iterative reconstruction. In addition, we present several research trends in this direction, including deep learning-based image reconstruction and other advanced real-time cardiac MRI strategies that reconstruct images acquired from real-time free-breathing techniques.

Land Cover Classifier Using Coordinate Hash Encoder (좌표 해시 인코더를 활용한 토지피복 분류 모델)

  • Yongsun Yoon;Dongjae Kwon
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.6_3
    • /
    • pp.1771-1777
    • /
    • 2023
  • With the advancements of deep learning, many semantic segmentation-based methods for land cover classification have been proposed. However, existing deep learning-based models only use image information and cannot guarantee spatiotemporal consistency. In this study, we propose a land cover classification model using geographical coordinates. First, the coordinate features are extracted through the Coordinate Hash Encoder, which is an extension of the Multi-resolution Hash Encoder, an implicit neural representation technique, to the longitude-latitude coordinate system. Next, we propose an architecture that combines the extracted coordinate features with different levels of U-net decoder. Experimental results show that the proposed method improves the mean intersection over union by about 32% and improves the spatiotemporal consistency.

The MPEG-7 based Video Database (MPEG-7에 기반한 동영상 데이터베이스)

  • Lee, Soon-Hee
    • Journal of the Korea Computer Industry Society
    • /
    • v.8 no.2
    • /
    • pp.103-106
    • /
    • 2007
  • In order to construct a Video Database, shot change detection should be made first. But, because these processes are not automated perfectly, we need a lot of time and efforts now. And, there are many shot change detection algorithms, which can't always insure the perfect result because of the editing effects such as cut, wipe, and dissolves used in film production. Therefore, in order to receive the exact shot change, It needs the verification and correction by manual processing at any cost. Spatiotemporal slice is a simple image condensing method for the content changes of video. The editing effects are expressed on the Spatiotemporal slice in the visually noticed form of vertical line, diagonal line, curved line and gradual color changes, etc. Accordingly the parts doubted as a shot change can be easily detected by the change of the Spatiotemporal slice without replaying the video. The system proposed in this study makes it possible to delete the false detected key frames, and create the undetected key frames on the Spatiotemporal slice.

  • PDF

A General Representation of Motion Silhouette Image: Generic Motion Silhouette Image(GMSI) (움직임 실루엣 영상의 일반적인 표현 방식에 대한 연구)

  • Hong, Sung-Jun;Lee, Hee-Sung;Kim, Eun-Tai
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.8
    • /
    • pp.749-753
    • /
    • 2007
  • In this paper, a generalized version of the Motion Silhouette Image(MSI) called the Generic Motion Silhouette Image (GMSI) is proposed for gait recognition. The GMSI is a gray-level image and involves the spatiotemporal information of individual motion. The GMSI not only generalizes the MSI but also reflects a flexible feature of a gait sequence. Along with the GMSI, we use the Principal Component Analysis(PCA) to reduce the dimensionality of the GMSI and the Nearest Neighbor(NN) for classification. We apply the proposed feature to NLPR database and compare it with the conventional MSI. Experimental results show the effectiveness of the GMSI.

Vision Sensing for the Ego-Lane Detection of a Vehicle (자동차의 자기 주행차선 검출을 위한 시각 센싱)

  • Kim, Dong-Uk;Do, Yongtae
    • Journal of Sensor Science and Technology
    • /
    • v.27 no.2
    • /
    • pp.137-141
    • /
    • 2018
  • Detecting the ego-lane of a vehicle (the lane on which the vehicle is currently running) is one of the basic techniques for a smart car. Vision sensing is a widely-used method for the ego-lane detection. Existing studies usually find road lane lines by detecting edge pixels in the image from a vehicle camera, and then connecting the edge pixels using Hough Transform. However, this approach takes rather long processing time, and too many straight lines are often detected resulting in false detections in various road conditions. In this paper, we find the lane lines by scanning only a limited number of horizontal lines within a small image region of interest. The horizontal image line scan replaces the edge detection process of existing methods. Automatic thresholding and spatiotemporal filtering procedures are also proposed in order to make our method reliable. In the experiments using real road images of different conditions, the proposed method resulted in high success rate.

Human Activity Recognition Using Spatiotemporal 3-D Body Joint Features with Hidden Markov Models

  • Uddin, Md. Zia;Kim, Jaehyoun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.6
    • /
    • pp.2767-2780
    • /
    • 2016
  • Video-based human-activity recognition has become increasingly popular due to the prominent corresponding applications in a variety of fields such as computer vision, image processing, smart-home healthcare, and human-computer interactions. The essential goals of a video-based activity-recognition system include the provision of behavior-based information to enable functionality that proactively assists a person with his/her tasks. The target of this work is the development of a novel approach for human-activity recognition, whereby human-body-joint features that are extracted from depth videos are used. From silhouette images taken at every depth, the direction and magnitude features are first obtained from each connected body-joint pair so that they can be augmented later with motion direction, as well as with the magnitude features of each joint in the next frame. A generalized discriminant analysis (GDA) is applied to make the spatiotemporal features more robust, followed by the feeding of the time-sequence features into a Hidden Markov Model (HMM) for the training of each activity. Lastly, all of the trained-activity HMMs are used for depth-video activity recognition.

A historical Extension for SDE Data Model (SDE 공간 모델의 이력지원 확장)

  • Lee, Jong-Yun;Ahn, Byoung-Ik;Ryu, Keun-Ho
    • The Transactions of the Korea Information Processing Society
    • /
    • v.5 no.9
    • /
    • pp.2281-2293
    • /
    • 1998
  • Spatial objects in the space II odd hale been changed bl eitber non-spiltial operations or spatial operations. For example, their states arc changed by the following operation: changing their owners, changing their owner's address, installing new constructions, changing precincts, splitting, and merging, The conventional geographic information system(GIS), however, did not also manage their histoncal information cecause it handles the snapshot image of spatial ohjects in the world. In this paper we therelore propose a spatiotemporal data model which is ahle to not un]y manage the historical information of spatial objects but also, support their historical intemlgation by extending a time dimension and a historical pointer for SDE(Spatial Database Engine) spatial data model. Finally, the proposed spatiotemporal data model using a layered time extension are going to contribute to manage the history of spatial objects in the world and retrieve them.

  • PDF