• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제17권10호
• /
• pp.2768-2787
• /
• 2023

As an important research direction of the application of computer science in the medical field, the automatic generation technology of radiology report has attracted wide attention in the academic community. Because the proportion of normal regions in radiology images is much larger than that of abnormal regions, words describing diseases are often masked by other words, resulting in significant feature loss during the calculation process, which affects the quality of generated reports. In addition, the huge difference between visual features and semantic features causes traditional multi-modal fusion method to fail to generate long narrative structures consisting of multiple sentences, which are required for medical reports. To address these challenges, we propose a multi-feature optimization Transformer (MFOT) for generating radiology reports. In detail, a multi-dimensional mapping attention (MDMA) module is designed to encode the visual grid features from different dimensions to reduce the loss of primary features in the encoding process; a feature pre-fusion (FP) module is constructed to enhance the interaction ability between multi-modal features, so as to generate a reasonably structured radiology report; a detail enhanced attention (DEA) module is proposed to enhance the extraction and utilization of key features and reduce the loss of key features. In conclusion, we evaluate the performance of our proposed model against prevailing mainstream models by utilizing widely-recognized radiology report datasets, namely IU X-Ray and MIMIC-CXR. The experimental outcomes demonstrate that our model achieves SOTA performance on both datasets, compared with the base model, the average improvement of six key indicators is 19.9% and 18.0% respectively. These findings substantiate the efficacy of our model in the domain of automated radiology report generation.

• 전자공학회논문지CI
• /
• 제38권1호
• /
• pp.19-25
• /
• 2001

공간 필터링 신경회로망을 이용한 필기체 문자 인식의 특징 추출 방법을 제안한다. 필기체 문자의 특징 추출을 위한 신경망은 먼저, 불규칙한 화소를 제거하는 전처리를 수행한다. 그 후, 윤곽선 검출 및 제거를 통해 외곽선 정보들을 소거한다. 그리고 문자의 특징에 해당하는 정보를 추출한 후 잡음을 제거한다. 제안된 시스템은 시각영역에서 나타나는 여러 가지 세포들의 수용 영역에 대응하는 공간 필터를 활용한 것이다. 제안된 시스템의 타당성을 확인하기 위한 실험은 PE2 데이터를 사용하였다. 실험을 통해 공간필터링 신경회로망을 이용한 필기체 문자의 특징 추출 시스템은 곡선이나 원, 사각형이 포함된 형태의 필기 문자에서도 특징 추출이 용이하다는 것을 확인할 수 있다.

• 한국측량학회지
• /
• 제35권6호
• /
• pp.485-494
• /
• 2017

본 연구는 단순 전처리 방법과 수정된 지역적 피쳐 추출기법을 이용하여 특성이 다른 적외선영상 자동 기하보정에 초점을 맞추고 있다. 입력영상은 히스토그램 평활화를 통해 중앙값과 절댓값을 이용하여 전처리를 수행하였으며, 추출 피쳐의 유사도를 거리가 아닌 각 개념으로 변경하여 적용함으로써, 영상간 밝기값 차이를 줄이는데 효과적으로 적용할 수 있도록 하였다. 기하보정 결과는 시각적인 방법과 Inverse RMSE 방식을 사용하여 평가하였으며, 영상의 특성 차이로 인해 기존의 지역적 피쳐 추출기법 적용으로 해결될 수 없었던 자동 기하보정이 본 알고리즘을 적용함으로써 높은 정합 신뢰도와 적용 편의성을 보임을 확인할 수 있었다. 이를 통해, 제안 방법이 특정 조건의 다중 센서 영상간 자동 기하보정 기법 중 하나로 사용될 수 있을 것으로 기대한다.

• 방송공학회논문지
• /
• 제22권1호
• /
• pp.51-61
• /
• 2017

본 논문은 수평을 유지하여 촬영해야 한다는 기존 이미지 스티칭을 이용한 영상 정합 과정의 단점을 극복하기 위하여, 스마트폰의 가속도 센서와 자기장 센서 데이터를 사용하여 3가지 자유도(3 DoF)에 강인한 이미지 스티칭 방법을 제안한다. 이미지를 붙이는 작업인 이미지 스티칭은 크게 이미지 특징점 추출, 추출된 특징점에서 매칭에 필요한 참인 점(inlier)을 선별, 참인 점을 호모그래피(homography) 행렬로 변환, 호모그래피 행렬을 사용하여 이미지를 왜곡(warping), 왜곡된 이미지와 다른 이미지를 합하는 과정으로 이루어져 있다. 본 논문에서는 일반적으로 사용하는 SIFT, SURF 등의 알고리즘뿐만 아니라 MPEG에서 표준화한 MPEG-7 CDVS(Compact Descriptor for Visual Search) 표준의 특징점 추출 알고리즘을 사용하여 이미지의 특징점을 추출한다. 또한 각 알고리즘의 특징점 추출시간, 추출된 특징점 개수, 선별된 참인 점의 개수를 비교하고, 스티칭 정확도를 판단하여 본 연구에서 활용한 데이터에 어느 알고리즘이 효율적인지 살펴본다.

• 한국멀티미디어학회논문지
• /
• 제17권8호
• /
• pp.968-976
• /
• 2014

Authentication methods on smartphone are demanded to be implicit to users with minimum users' interaction. Existing authentication methods (e.g. PINs, passwords, visual patterns, etc.) are not effectively considering remembrance and privacy issues. Behavioral biometrics such as keystroke dynamics and gait biometrics can be acquired easily and implicitly by using integrated sensors on smartphone. We propose a biometric model involving keystroke dynamics for implicit authentication on smartphone. We first design a feature extraction method for keystroke dynamics. And then, we build a fusion model of keystroke dynamics and gait to improve the authentication performance of single behavioral biometric on smartphone. We operate the fusion at both feature extraction level and matching score level. Experiment using linear Support Vector Machines (SVM) classifier reveals that the best results are achieved with score fusion: a recognition rate approximately 97.86% under identification mode and an error rate approximately 1.11% under authentication mode.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2004년도 ICCAS
• /
• pp.2059-2064
• /
• 2004

Texture analysis is an important role for automatic visual insfection. This paper presents an application of wavelet extension and Gray level co-occurrence matrix (GLCM) for detection of defect encountered in textured images. Texture characteristic in low quality images is not to easy task to perform caused by noise, low frequency and small dimension. In order to solve this problem, we have developed a procedure called wavelet image extension. Wavelet extension procedure is used to determine the frequency bands carrying the most information about the texture by decomposing images into multiple frequency bands and to form an image approximation with higher resolution. Thus, wavelet extension procedure offers the ability to robust feature extraction in images. Then the features are extracted from the co-occurrence matrices computed from the sub-bands which performed by partitioning the texture image into sub-window. In the detection part, Mahalanobis distance classifier is used to decide whether the test image is defective or non defective.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권3호
• /
• pp.1595-1613
• /
• 2017

The IR camera and laser-based IR projector provide an effective solution for real-time collection of moving targets in RGB-D videos. Different from the traditional RGB videos, the captured depth videos are not affected by the illumination variation. In this paper, we propose a novel feature extraction framework to describe human activities based on the above optical video capturing method, namely spatial-temporal texture features for 3D human activity recognition. Spatial-temporal texture feature with depth information is insensitive to illumination and occlusions, and efficient for fine-motion description. The framework of our proposed algorithm begins with video acquisition based on laser projection, video preprocessing with visual background extraction and obtains spatial-temporal key images. Then, the texture features encoded from key images are used to generate discriminative features for human activity information. The experimental results based on the different databases and practical scenarios demonstrate the effectiveness of our proposed algorithm for the large-scale data sets.

• 대한원격탐사학회지
• /
• 제28권6호
• /
• pp.623-632
• /
• 2012

In this paper, we analyzed the effect of wavelet decomposition levels in feature extraction for anomaly detection from hyperspectral imagery. After wavelet analysis, anomaly detection was experimentally performed using the RX detector algorithm to analyze the detecting capabilities. From the experiment for anomaly detection using CASI imagery, the characteristics of extracted features and the changes of their patterns showed that radiance curves were simplified as wavelet transform progresses and H bands did not show significant differences between target anomaly and background in the previous levels. The results of anomaly detection and their ROC curves showed the best performance when using the appropriate sub-band decided from the visual interpretation of wavelet analysis which was L band at the decomposition level where the overall shape of profile was preserved. The results of this study would be used as fundamental information or guidelines when applying wavelet transform to feature extraction and selection from hyperspectral imagery. However, further researches for various anomaly targets and the quantitative selection of optimal decomposition levels are needed for generalization.

• 대한의용생체공학회:의공학회지
• /
• 제30권3호
• /
• pp.191-198
• /
• 2009

Phlegm smear testing for acid-fast bacilli (AFB) requires careful examination of tubercle bacilli under a microscope to distinguish between positive and negative findings. The biggest weakness of this method is the visual limitations of the examiners. It is also time-consuming, and mistakes may easily occur. This paper proposes a method of identifying tubercle bacilli that uses a computer instead of a human. To address the challenges of AFB testing, this study designs and investigates image systems that can be used to identify tubercle bacilli. The proposed system uses an electronic microscope to capture digital images that are then processed through feature extraction, image segmentation, image recognition, and neural networks to analyze tubercle bacilli. The proposed system can detect the amount of tubercle bacilli and find their locations. This paper analyzes 184 tubercle bacilli images. Fifty images are used to train the artificial neural network, and the rest are used for testing. The proposed system has a 95.6% successful identification rate, and only takes 0.8 seconds to identify an image.

• ETRI Journal
• /
• 제23권2호
• /
• pp.41-51
• /
• 2001

MPEG-7 standardization work has started with the aims of providing fundamental tools for describing multimedia contents. MPEG-7 defines the syntax and semantics of descriptors and description schemes so that they may be used as fundamental tools for multimedia content description. In this paper, we introduce a texture based image description and retrieval method, which is adopted as the homogeneous texture descriptor in the visual part of the MPEG-7 final committee draft. The current MPEG-7 homogeneous texture descriptor consists of the mean, the standard deviation value of an image, energy, and energy deviation values of Fourier transform of the image. These are extracted from partitioned frequency channels based on the human visual system (HVS). For reliable extraction of the texture descriptor, Radon transformation is employed. This is suitable for HVS behavior. We also introduce various matching methods; for example, intensity-invariant, rotation-invariant and/or scale-invariant matching. This technique retrieves relevant texture images when the user gives a querying texture image. In order to show the promising performance of the texture descriptor, we take the experimental results with the MPEG-7 test sets. Experimental results show that the MPEG-7 texture descriptor gives an efficient and effective retrieval rate. Furthermore, it gives fast feature extraction time for constructing the texture descriptor.