• Title/Summary/Keyword: Hyperspectral image (HSI)

Search Result 13, Processing Time 0.019 seconds

An Adaptive Weighted Regression and Guided Filter Hybrid Method for Hyperspectral Pansharpening

  • Dong, Wenqian;Xiao, Song
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.1
    • /
    • pp.327-346
    • /
    • 2019
  • The goal of hyperspectral pansharpening is to combine a hyperspectral image (HSI) with a panchromatic image (PANI) derived from the same scene to obtain a single fused image. In this paper, a new hyperspectral pansharpening approach using adaptive weighted regression and guided filter is proposed. First, the intensity information (INT) of the HSI is obtained by the adaptive weighted regression algorithm. Especially, the optimization formula is solved to obtain the closed solution to reduce the calculation amount. Then, the proposed method proposes a new way to obtain the sufficient spatial information from the PANI and INT by guided filtering. Finally, the fused HSI is obtained by adding the extracted spatial information to the interpolated HSI. Experimental results demonstrate that the proposed approach achieves better property in preserving the spectral information as well as enhancing the spatial detail compared with other excellent approaches in visual interpretation and objective fusion metrics.

A Novel RGB Channel Assimilation for Hyperspectral Image Classification using 3D-Convolutional Neural Network with Bi-Long Short-Term Memory

  • M. Preethi;C. Velayutham;S. Arumugaperumal
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.3
    • /
    • pp.177-186
    • /
    • 2023
  • Hyperspectral imaging technology is one of the most efficient and fast-growing technologies in recent years. Hyperspectral image (HSI) comprises contiguous spectral bands for every pixel that is used to detect the object with significant accuracy and details. HSI contains high dimensionality of spectral information which is not easy to classify every pixel. To confront the problem, we propose a novel RGB channel Assimilation for classification methods. The color features are extracted by using chromaticity computation. Additionally, this work discusses the classification of hyperspectral image based on Domain Transform Interpolated Convolution Filter (DTICF) and 3D-CNN with Bi-directional-Long Short Term Memory (Bi-LSTM). There are three steps for the proposed techniques: First, HSI data is converted to RGB images with spatial features. Before using the DTICF, the RGB images of HSI and patch of the input image from raw HSI are integrated. Afterward, the pair features of spectral and spatial are excerpted using DTICF from integrated HSI. Those obtained spatial and spectral features are finally given into the designed 3D-CNN with Bi-LSTM framework. In the second step, the excerpted color features are classified by 2D-CNN. The probabilistic classification map of 3D-CNN-Bi-LSTM, and 2D-CNN are fused. In the last step, additionally, Markov Random Field (MRF) is utilized for improving the fused probabilistic classification map efficiently. Based on the experimental results, two different hyperspectral images prove that novel RGB channel assimilation of DTICF-3D-CNN-Bi-LSTM approach is more important and provides good classification results compared to other classification approaches.

Scientific Examination of Kim Jeong-hee's "Buliseonrando" by Using Hyperspectral Image Analysis (초분광영상 분석을 활용한 김정희 필 불이선란도(不二禪蘭圖)의 과학적 조사)

  • Ko Soorin;Park Jinho;Lee Sujin
    • Conservation Science in Museum
    • /
    • v.30
    • /
    • pp.127-144
    • /
    • 2023
  • "Buliseonrando," meaning "Buddhist virtues and the orchid are one and the same," was painted by Chusa Kim Jeong-hee. Four appreciation sentences are written in various fonts around the orchid drawn in the center of the painting, along with a total of 15 seals stamped. Hyperspectral image analysis(HSI), microscopy, and X-ray fluorescence (XRF) were conducted with a focus on the seals and the parts of the painting that have been applied with a conservation treatment. As a result of the analyses, the seals were classified into two types-seals with or without barium content. Stamp shade was identified only in five of themstamps, which allows the assumption that the composition and material characteristics of the stamp inks varied depending on the period. In particular, hyperspectral image analysis confirms traces of conservation treatment on the seals and the lost parts identified in addition to the 15 seals, which also demonstrates the utility of hyperspectral image analysis.

Efflorescence assessment using hyperspectral imaging for concrete structures

  • Kim, Byunghyun;Cho, Soojin
    • Smart Structures and Systems
    • /
    • v.22 no.2
    • /
    • pp.209-221
    • /
    • 2018
  • Efflorescence is a phenomenon primarily caused by a carbonation process in concrete structures. Efflorescence can cause concrete degradation in the long term; therefore, it must be accurately assessed by proper inspection. Currently, the assessment is performed on the basis of visual inspection or image-based inspection, which may result in the subjective assessment by the inspectors. In this paper, a novel approach is proposed for the objective and quantitative assessment of concrete efflorescence using hyperspectral imaging (HSI). HSI acquires the full electromagnetic spectrum of light reflected from a material, which enables the identification of materials in the image on the basis of spectrum. Spectral angle mapper (SAM) that calculates the similarity of a test spectrum in the hyperspectral image to a reference spectrum is used to assess efflorescence, and the reference spectral profiles of efflorescence are obtained from theUSGS spectral library. Field tests were carried out in a real building and a bridge. For each experiment, efflorescence assessed by the proposed approach was compared with that assessed by image-based approach mimicking conventional visual inspection. Performance measures such as accuracy, precision, and recall were calculated to check the performance of the proposed approach. Performance-related issues are discussed for further enhancement of the proposed approach.

Prediction of moisture contents in green peppers using hyperspectral imaging based on a polarized lighting system

  • Faqeerzada, Mohammad Akbar;Rahman, Anisur;Kim, Geonwoo;Park, Eunsoo;Joshi, Rahul;Lohumi, Santosh;Cho, Byoung-Kwan
    • Korean Journal of Agricultural Science
    • /
    • v.47 no.4
    • /
    • pp.995-1010
    • /
    • 2020
  • In this study, a multivariate analysis model of partial least square regression (PLSR) was developed to predict the moisture content of green peppers using hyperspectral imaging (HSI). In HSI, illumination is essential for high-quality image acquisition and directly affects the analytical performance of the visible near-infrared hyperspectral imaging (VIS/NIR-HSI) system. When green pepper images were acquired using a direct lighting system, the specular reflection from the surface of the objects and their intensities fluctuated with time. The images include artifacts on the surface of the materials, thereby increasing the variability of data and affecting the obtained accuracy by generating false-positive results. Therefore, images without glare on the surface of the green peppers were created using a polarization filter at the front of the camera lens and by exposing the polarizer sheet at the front of the lighting systems simultaneously. The results obtained from the PLSR analysis yielded a high determination coefficient of 0.89 value. The regression coefficients yielded by the best PLSR model were further developed for moisture content mapping in green peppers based on the selected wavelengths. Accordingly, the polarization filter helped achieve an uniform illumination and the removal of gloss and artifact glare from the green pepper images. These results demonstrate that the HSI technique with a polarized lighting system combined with chemometrics can be effectively used for high-throughput prediction of moisture content and image-based visualization.

Hyperspectral imaging technique to evaluate the firmness and the sweetness index of tomatoes

  • Rahman, Anisur;Park, Eunsoo;Bae, Hyungjin;Cho, Byoung-Kwan
    • Korean Journal of Agricultural Science
    • /
    • v.45 no.4
    • /
    • pp.823-837
    • /
    • 2018
  • The objective of this study was to evaluate the firmness and the sweetness index (SI) of tomatoes with a hyperspectral imaging (HSI) technique within the wavelength range of 1000 - 1550 nm. The hyperspectral images of 95 tomatoes were acquired with a push-broom hyperspectral reflectance imaging system, from which the mean spectra of each tomato were extracted from the regions of interest. The reference firmness and sweetness index of the same sample was measured and calibrated with their corresponding spectral data by partial least squares (PLS) regression with different preprocessing methods. The calibration model developed by PLS regression based on the Savitzky-Golay second-derivative preprocessed spectra resulted in a better performance for both the firmness and the SI of the tomatoes compared to models developed by other preprocessing methods. The correlation coefficients ($R_{pred}$) were 0.82, and 0.74 with a standard error of prediction of 0.86 N, and 0.63, respectively. Then, the feature wavelengths were identified using a model-based variable selection method, i.e., variable importance in projection, from the PLS regression analyses. Finally, chemical images were derived by applying the respective regression coefficients on the spectral image in a pixel-wise manner. The resulting chemical images provided detailed information on the firmness and the SI of the tomatoes. The results show that the proposed HSI technique has potential for rapid and non-destructive evaluation of firmness and the sweetness index of tomatoes.

Vicarious Calibration-based Robust Spectrum Measurement for Spectral Libraries Using a Hyperspectral Imaging System

  • Chi, Junhwa
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.4
    • /
    • pp.649-659
    • /
    • 2018
  • The aim of this study is to develop a protocol for obtaining spectral signals that are robust to varying lighting conditions, which are often found in the Polar regions, for creating a spectral library specific to those regions. Because hyperspectral image (HSI)-derived spectra are collected on the same scale as images, they can be directly associated with image data. However, it is challenging to find precise and robust spectra that can be used for a spectral library from images taken under different lighting conditions. Hence, this study proposes a new radiometric calibration protocol that incorporates radiometric targets with a traditional vicarious calibration approach to solve issues in image-based spectrum measurements. HSIs obtained by the proposed method under different illumination levels are visually uniform and do not include any artifacts such as stripes or random noise. The extracted spectra capture spectral characteristics such as reflectance curve shapes and absorption features better than those that have not been calibrated. The results are also validated quantitatively. The calibrated spectra are shown to be very robust to varying lighting conditions and hence are suitable for a spectral library specific to the Polar regions.

Hyperspectral Image Classification via Joint Sparse representation of Multi-layer Superpixles

  • Sima, Haifeng;Mi, Aizhong;Han, Xue;Du, Shouheng;Wang, Zhiheng;Wang, Jianfang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.10
    • /
    • pp.5015-5038
    • /
    • 2018
  • In this paper, a novel spectral-spatial joint sparse representation algorithm for hyperspectral image classification is proposed based on multi-layer superpixels in various scales. Superpixels of various scales can provide complete yet redundant correlated information of the class attribute for test pixels. Therefore, we design a joint sparse model for a test pixel by sampling similar pixels from its corresponding superpixels combinations. Firstly, multi-layer superpixels are extracted on the false color image of the HSI data by principal components analysis model. Secondly, a group of discriminative sampling pixels are exploited as reconstruction matrix of test pixel which can be jointly represented by the structured dictionary and recovered sparse coefficients. Thirdly, the orthogonal matching pursuit strategy is employed for estimating sparse vector for the test pixel. In each iteration, the approximation can be computed from the dictionary and corresponding sparse vector. Finally, the class label of test pixel can be directly determined with minimum reconstruction error between the reconstruction matrix and its approximation. The advantages of this algorithm lie in the development of complete neighborhood and homogeneous pixels to share a common sparsity pattern, and it is able to achieve more flexible joint sparse coding of spectral-spatial information. Experimental results on three real hyperspectral datasets show that the proposed joint sparse model can achieve better performance than a series of excellent sparse classification methods and superpixels-based classification methods.

Development of Non-Destructive Sorting Technique for Viability of Watermelon Seed by Using Hyperspectral Image Processing (초분광 영상기술을 이용한 수박종자 발아여부 비파괴 선별기술 개발)

  • Bae, Hyungjin;Seo, Young-Wook;Kim, Dae-Yong;Lohumi, Santosh;Park, Eunsoo;Cho, Byoung-Kwan
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.36 no.1
    • /
    • pp.35-44
    • /
    • 2016
  • Seed viability is one of the most important parameters that is directly related with seed germination performance and seedling emergence. In this study, a hyperspectral imaging (HSI) system having a range of 1000-2500 nm was used to classify viable watermelon seeds from nonviable seeds. In order to obtain nonviable watermelon seeds, a total of 96 seeds were artificially aged by immersing the seeds in hot water ($25^{\circ}C$) for 15 days. Further, hyperspectral images for 192 seeds (96 normal and 96 aged) were acquired using the developed HSI system. A germination test was performed for all the 192 seeds in order to confirm their viability. Spectral data from the hyperspectral images of the seeds were extracted by selecting pixels from the region of interest. Each seed spectrum was averaged and preprocessed to develop a classification model of partial least square discriminant analysis (PLS-DA). The developed PLS-DA model showed a classification accuracy of 94.7% for the calibration set, and 84.2% for the validation set. The results demonstrate that the proposed technique can classify viable and nonviable watermelon seeds with a reasonable accuracy, and can be further converted into an online sorting system for rapid and nondestructive classification of watermelon seeds with regard to viability.

Evaluation of Firmness and Sweetness Index of Tomatoes using Hyperspectral Imaging

  • Rahman, Anisur;Faqeerzada, Mohammad Akbar;Joshi, Rahul;Cho, Byoung-Kwan
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2017.04a
    • /
    • pp.44-44
    • /
    • 2017
  • The objective of this study was to evaluate firmness, and sweetness index (SI) of tomatoes (Lycopersicum esculentum) by using hyperspectral imaging (HSI) in the range of 1000-1400 nm. The mean spectra of the 95 matured tomato samples were extracted from the hyperspectral images, and the reference firmness and sweetness index of the same sample were measured and calibrated with their corresponding spectral data by partial least squares (PLS) regression with different preprocessing method. The results showed that the regression model developed by PLS regression based on Savitzky-Golay (S-G) second-derivative preprocessed spectra resulted in better performance for firmness, and SI of tomatoes compared to models developed by other preprocessing methods, with correlation coefficients (rpred) of 0.82, and 0.74 with standard error of prediction (SEP) of 0.86 N, and 0.63 respectively. Then, the feature wavelengths were identified using model-based variable selection method, i.e., variable important in projection (VIP), resulting from the PLS regression analyses and finally chemical images were derived by applying the respective regression coefficient on the spectral image in a pixel-wise manner. The resulting chemical images provided detailed information on firmness, and sweetness index (SI) of tomatoes. Therefore, these research demonstrated that HIS technique has a potential for rapid and non-destructive evaluation of the firmness and sweetness index of tomatoes.

  • PDF