• Title/Summary/Keyword: Multi-Sensor Image

Search Result 286, Processing Time 0.026 seconds

A Study on Green Algae Monitoring in Watershed Using Fixed Wing UAV (고정익 무인비행기를 이용한 수계 내 녹조 모니터링 연구)

  • Park, Jung-Il;Choi, Seung-Young;Park, Min-Ho
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.27 no.2
    • /
    • pp.164-169
    • /
    • 2017
  • The primary purpose of this study is to determine NDVI analysis methodologies for green algae monitoring system. A fixed wing UAV integrated with multi-spectral sensor has been adopted to capture the images along the watershed in Gumgang River. The study area was near the Baekje water reservoir and the images was captured on July 2016. Pix4D Mapper Pro was used to process the captured images. Through the comparison actual chlorophyll measurement values with NDVI output image, empirical formula was suggested and geo-locational conversion was carried out. As a result of this study chlorophyll image set applied to actual measurement values was able to extracted. For the efficient management of green algae, its monitoring and prevention in terms of disaster management, gathering chlorophyll information using UAV is very beneficial.

Detection of Crosswalk for the Walking Guide of the Blind People (시각장애인 보행 안내를 위한 횡단보도 검출 및 방향 판단)

  • Kim, Seon-il;Jeong, Yu-Jin;Lee, Dong-Hee;Jung, Kyeong-Hoon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2019.05a
    • /
    • pp.45-48
    • /
    • 2019
  • Detection of crosswalk is an important issue for the blind to walk without the help of others. There is a braille block on the sidewalk, which helps the blind to walk. On the other hand, crosswalk is more dangerous due to the moving vehicles. However, there is no appropriate means to induce the blind. In this paper, we propose a method to detect crosswalk in front of a blind and estimate its direction using an image sensor. We adopt multi-ROIs and make their binary versions. In order to determine whether it is a crosswalk, two features are extracted; one is the number of crossing in the binary image and the other is the ratio of white area. We can also estimate the direction of the crosswalk through the slope of the projection data. We evaluated the performance using experimental dataset and the proposed algorithm showed 80% accuracy of detection.

  • PDF

CNN based data anomaly detection using multi-channel imagery for structural health monitoring

  • Shajihan, Shaik Althaf V.;Wang, Shuo;Zhai, Guanghao;Spencer, Billie F. Jr.
    • Smart Structures and Systems
    • /
    • v.29 no.1
    • /
    • pp.181-193
    • /
    • 2022
  • Data-driven structural health monitoring (SHM) of civil infrastructure can be used to continuously assess the state of a structure, allowing preemptive safety measures to be carried out. Long-term monitoring of large-scale civil infrastructure often involves data-collection using a network of numerous sensors of various types. Malfunctioning sensors in the network are common, which can disrupt the condition assessment and even lead to false-negative indications of damage. The overwhelming size of the data collected renders manual approaches to ensure data quality intractable. The task of detecting and classifying an anomaly in the raw data is non-trivial. We propose an approach to automate this task, improving upon the previously developed technique of image-based pre-processing on one-dimensional (1D) data by enriching the features of the neural network input data with multiple channels. In particular, feature engineering is employed to convert the measured time histories into a 3-channel image comprised of (i) the time history, (ii) the spectrogram, and (iii) the probability density function representation of the signal. To demonstrate this approach, a CNN model is designed and trained on a dataset consisting of acceleration records of sensors installed on a long-span bridge, with the goal of fault detection and classification. The effect of imbalance in anomaly patterns observed is studied to better account for unseen test cases. The proposed framework achieves high overall accuracy and recall even when tested on an unseen dataset that is much larger than the samples used for training, offering a viable solution for implementation on full-scale structures where limited labeled-training data is available.

A grid-line suppression technique based on the nonsubsampled contourlet transform in digital radiography

  • Namwoo Kim;Taeyoung Um;Hyun Tae Leem;Bon Tack Koo;Kyuseok Kim;Kyu Bom Kim
    • Nuclear Engineering and Technology
    • /
    • v.55 no.2
    • /
    • pp.655-668
    • /
    • 2023
  • In radiography, an antiscatter grid is a well-known device for eliminating unexpected x-ray scatter. We investigate a new stationary grid artifact suppression method based on a nonsubsampled contourlet transform (NSCT) incorporated with Gaussian band-pass filtering. The proposed method has an advantage that extracts the Moiré components while minimizing the loss of image information and apply the prior information of Moiré component positions in multi-decomposition sub-band images. We implemented the proposed algorithm and performed a simulation and an experiment to demonstrate its viability. We did this experiment using an x-ray tube (M-113T, Varian, focal spot size: 0.1 mm), a flat-panel detector (ROSE-M Sensor, Aspenstate, pixel dimension: 3032 × 3800 pixels, pixel size: 0.076 mm), and carbon graphite-interspaced grids (JPI Healthcare, 18 cm × 24 cm, line density: 103 LP/inch and 150 LP/inch, ratio: 5:1, focal distance: 65 cm). Our results indicate that the proposed method successfully suppressed grid artifacts by reducing them without either reducing the spatial resolution or causing negative side effects. Consequently, we anticipate that the proposed method can improve image acquisition in a stationary grid x-ray system as well as in extended x-ray imaging.

Analysis of UAV-based Multispectral Reflectance Variability for Agriculture Monitoring (농업관측을 위한 다중분광 무인기 반사율 변동성 분석)

  • Ahn, Ho-yong;Na, Sang-il;Park, Chan-won;Hong, Suk-young;So, Kyu-ho;Lee, Kyung-do
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.6_1
    • /
    • pp.1379-1391
    • /
    • 2020
  • UAV in the agricultural application are capable of collecting ultra-high resolution image. It is possible to obtain timeliness images for phenological phases of the crop. However, the UAV uses a variety of sensors and multi-temporal images according to the environment. Therefore, it is essential to use normalized image data for time series image application for crop monitoring. This study analyzed the variability of UAV reflectance and vegetation index according to Aviation Image Making Environment to utilize the UAV multispectral image for agricultural monitoring time series. The variability of the reflectance according to environmental factors such as altitude, direction, time, and cloud was very large, ranging from 8% to 11%, but the vegetation index variability was stable, ranging from 1% to 5%. This phenomenon is believed to have various causes such as the characteristics of the UAV multispectral sensor and the normalization of the post-processing program. In order to utilize the time series of unmanned aerial vehicles, it is recommended to use the same ratio function as the vegetation index, and it is recommended to minimize the variability of time series images by setting the same time, altitude and direction as possible.

A Study on People Counting in Public Metro Service using Hybrid CNN-LSTM Algorithm (Hybrid CNN-LSTM 알고리즘을 활용한 도시철도 내 피플 카운팅 연구)

  • Choi, Ji-Hye;Kim, Min-Seung;Lee, Chan-Ho;Choi, Jung-Hwan;Lee, Jeong-Hee;Sung, Tae-Eung
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.2
    • /
    • pp.131-145
    • /
    • 2020
  • In line with the trend of industrial innovation, IoT technology utilized in a variety of fields is emerging as a key element in creation of new business models and the provision of user-friendly services through the combination of big data. The accumulated data from devices with the Internet-of-Things (IoT) is being used in many ways to build a convenience-based smart system as it can provide customized intelligent systems through user environment and pattern analysis. Recently, it has been applied to innovation in the public domain and has been using it for smart city and smart transportation, such as solving traffic and crime problems using CCTV. In particular, it is necessary to comprehensively consider the easiness of securing real-time service data and the stability of security when planning underground services or establishing movement amount control information system to enhance citizens' or commuters' convenience in circumstances with the congestion of public transportation such as subways, urban railways, etc. However, previous studies that utilize image data have limitations in reducing the performance of object detection under private issue and abnormal conditions. The IoT device-based sensor data used in this study is free from private issue because it does not require identification for individuals, and can be effectively utilized to build intelligent public services for unspecified people. Especially, sensor data stored by the IoT device need not be identified to an individual, and can be effectively utilized for constructing intelligent public services for many and unspecified people as data free form private issue. We utilize the IoT-based infrared sensor devices for an intelligent pedestrian tracking system in metro service which many people use on a daily basis and temperature data measured by sensors are therein transmitted in real time. The experimental environment for collecting data detected in real time from sensors was established for the equally-spaced midpoints of 4×4 upper parts in the ceiling of subway entrances where the actual movement amount of passengers is high, and it measured the temperature change for objects entering and leaving the detection spots. The measured data have gone through a preprocessing in which the reference values for 16 different areas are set and the difference values between the temperatures in 16 distinct areas and their reference values per unit of time are calculated. This corresponds to the methodology that maximizes movement within the detection area. In addition, the size of the data was increased by 10 times in order to more sensitively reflect the difference in temperature by area. For example, if the temperature data collected from the sensor at a given time were 28.5℃, the data analysis was conducted by changing the value to 285. As above, the data collected from sensors have the characteristics of time series data and image data with 4×4 resolution. Reflecting the characteristics of the measured, preprocessed data, we finally propose a hybrid algorithm that combines CNN in superior performance for image classification and LSTM, especially suitable for analyzing time series data, as referred to CNN-LSTM (Convolutional Neural Network-Long Short Term Memory). In the study, the CNN-LSTM algorithm is used to predict the number of passing persons in one of 4×4 detection areas. We verified the validation of the proposed model by taking performance comparison with other artificial intelligence algorithms such as Multi-Layer Perceptron (MLP), Long Short Term Memory (LSTM) and RNN-LSTM (Recurrent Neural Network-Long Short Term Memory). As a result of the experiment, proposed CNN-LSTM hybrid model compared to MLP, LSTM and RNN-LSTM has the best predictive performance. By utilizing the proposed devices and models, it is expected various metro services will be provided with no illegal issue about the personal information such as real-time monitoring of public transport facilities and emergency situation response services on the basis of congestion. However, the data have been collected by selecting one side of the entrances as the subject of analysis, and the data collected for a short period of time have been applied to the prediction. There exists the limitation that the verification of application in other environments needs to be carried out. In the future, it is expected that more reliability will be provided for the proposed model if experimental data is sufficiently collected in various environments or if learning data is further configured by measuring data in other sensors.

A Study of Tasseled Cap Transformation Coefficient for the Geostationary Ocean Color Imager (GOCI) (정지궤도 천리안위성 해양관측센서 GOCI의 Tasseled Cap 변환계수 산출연구)

  • Shin, Ji-Sun;Park, Wook;Won, Joong-Sun
    • Korean Journal of Remote Sensing
    • /
    • v.30 no.2
    • /
    • pp.275-292
    • /
    • 2014
  • The objective of this study is to determine Tasseled Cap Transformation (TCT) coefficients for the Geostationary Ocean Color Imager (GOCI). TCT is traditional method of analyzing the characteristics of the land area from multi spectral sensor data. TCT coefficients for a new sensor must be estimated individually because of different sensor characteristics of each sensor. Although the primary objective of the GOCI is for ocean color study, one half of the scene covers land area with typical land observing channels in Visible-Near InfraRed (VNIR). The GOCI has a unique capability to acquire eight scenes per day. This advantage of high temporal resolution can be utilized for detecting daily variation of land surface. The GOCI TCT offers a great potential for application in near-real time analysis and interpretation of land cover characteristics. TCT generally represents information of "Brightness", "Greenness" and "Wetness". However, in the case of the GOCI is not able to provide "Wetness" due to lack of ShortWave InfraRed (SWIR) band. To maximize the utilization of high temporal resolution, "Wetness" should be provided. In order to obtain "Wetness", the linear regression method was used to align the GOCI Principal Component Analysis (PCA) space with the MODIS TCT space. The GOCI TCT coefficients obtained by this method have different values according to observation time due to the characteristics of geostationary earth orbit. To examine these differences, the correlation between the GOCI TCT and the MODIS TCT were compared. As a result, while the GOCI TCT coefficients of "Brightness" and "Greenness" were selected at 4h, the GOCI TCT coefficient of "Wetness" was selected at 2h. To assess the adequacy of the resulting GOCI TCT coefficients, the GOCI TCT data were compared to the MODIS TCT image and several land parameters. The land cover classification of the GOCI TCT image was expressed more precisely than the MODIS TCT image. The distribution of land cover classification of the GOCI TCT space showed meaningful results. Also, "Brightness", "Greenness", and "Wetness" of the GOCI TCT data showed a relatively high correlation with Albedo ($R^2$ = 0.75), Normalized Difference Vegetation Index (NDVI) ($R^2$ = 0.97), and Normalized Difference Moisture Index (NDMI) ($R^2$ = 0.77), respectively. These results indicate the suitability of the GOCI TCT coefficients.

Secure Disjointed Multipath Routing Scheme for Multimedia Data Transmission in Wireless Sensor Networks (무선 센서 네트워크 환경에서 멀티미디어 데이터 전송을 위한 보안성 있는 비-중첩 다중 경로 라우팅 기법)

  • Lee, Sang-Kyu;Kim, Dong-Joo;Park, Jun-Ho;Seong, Dong-Ook;Yoo, Jae-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.4
    • /
    • pp.60-68
    • /
    • 2012
  • In recent years, the requirements on the high quality environment monitoring by using the sensor nodes which can handle the multimedia data in WSN have been increased. However, because the volume of multimedia data is tremendous, the limited bandwidth of a wireless channel may incur the bottleneck of a system. To solve such a problem, most of the existing distributed multi-path routing protocols based on multimedia data just focused on overcoming the limited bandwidth in order to enhance the energy efficiency and the transmission rate. However, because the existing methods can not apply a key-based technique to encrypt the multimedia data, they are very weak for the security. In this paper, we propose a secure disjointed multipath routing scheme for multimedia data transmission. Since our proposed scheme divides multimedia data(eg. image) into pixels and sends them through disjointed multipath routing, it can provide security to the whole network without using the key-based method. Our experimental results show that our proposed scheme reduces about 10% the amount of the energy consumption and about 65% the amount of the missed data packets caused by malicious nodes over the existing methods on average.

Measurement of two-dimensional vibration and calibration using the low-cost machine vision camera (저가의 머신 비전 카메라를 이용한 2차원 진동의 측정 및 교정)

  • Kim, Seo Woo;Ih, Jeong-Guon
    • The Journal of the Acoustical Society of Korea
    • /
    • v.37 no.2
    • /
    • pp.99-109
    • /
    • 2018
  • The precision of the vibration-sensors, contact or non-contact types, is usually satisfactory for the practical measurement applications, but a sensor is confined to the measurement of a point or a direction. Although the precision and frequency span of the low-cost camera are inferior to these sensors, it has the merits in the cost and in the capability of simultaneous measurement of a large vibrating area. Furthermore, a camera can measure multi-degrees-of-freedom of a vibrating object simultaneously. In this study, the calibration method and the dynamic characteristics of the low-cost machine vision camera as a sensor are studied with a demonstrating example of the two-dimensional vibration of a cantilever beam. The planar image of the camera shot reveals two rectilinear and one rotational motion. The rectilinear vibration motion of a single point is first measured using a camera and the camera is experimentally calibrated by calculating error referencing the LDV (Laser Doppler Vibrometer) measurement. Then, by measuring the motion of multiple points at once, the rotational vibration motion and the whole vibration motion of the cantilever beam are measured. The whole vibration motion of the cantilever beam is analyzed both in time and frequency domain.

Application of Multi-satellite Sensors to Estimate the Green-tide Area (황해 부유 녹조 면적 산출을 위한 멀티 위성센서 활용)

  • Kim, Keunyong;Shin, Jisun;Ryu, Joo-Hyung
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.2_2
    • /
    • pp.339-349
    • /
    • 2018
  • The massive green tide occurred every summer in the Yellow Sea since 2008, and many studies are being actively conducted to estimate the coverage of green tide through analysis of satellite imagery. However, there is no satellite images selection criterion for accurate coverage calculation of green tide. Therefore, this study aimed to find a suitable satellite image from for the comparison of the green tide coverage according to the spatial resolution of satellite image. In this study, Landsat ETM+, MODIS and GOCI images were used to coverage estimation and its spatial resolution is 30, 250 and 500 m, respectively. Green tide pixels were classified based on the NDVI algorithm, the difference of the green tide coverage was compared with threshold value. In addition, we estimate the proportion of the green tide in one pixel through the Linear Spectral Unmixing (LSU) method, and the effect of the difference of green tide ratio on the coverage calculation were evaluated. The result of green tide coverage from the calculation of the NDVI value, coverage of green tide usually overestimate with decreasing spatial resolution, maximum difference shows 1.5 times. In addition, most of the pixels were included in the group with less than 0.1 (10%) LSU value, and above 0.5 (50%) LSU value accounted for about 2% in all of three images. Even though classified as green tide from the NDVI result, it is considered to be overestimated because it is regarded as the same coverage even if green tide is not 100% filled in one pixel. Mixed-pixel problem seems to be more severe with spatial resolution decreases.