• Journal of the Korean Data and Information Science Society
• /
• 제16권4호
• /
• pp.879-888
• /
• 2005

Fashion is hard to expect owing to the rapid change in accordance with consumer taste and environment, and has a tendency toward variety and individuality. Especially street fashion of 21st century is not being regarded as one of the subcultures but is playing an important role as a fountainhead of fashion trend. Therefore, Searching and analyzing street fashions helps us to understand the popular fashions of the next season and also it is important in understanding the consumer fashion sense and commercial area. So, we need to understand fashion styles quantitatively and qualitatively by providing visual data and dividing images. There are many kinds of data in street fashion information. The purpose of this study is to design and implementation for street fashion information analysis system using data fusion. We can show visual information of customer's viewpoint because the system can analyze the fused data for image data and survey data.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제16권2호
• /
• pp.544-564
• /
• 2022

Underwater images often suffer from color distortion, blurring and low contrast, which is caused by the propagation of light in the underwater environment being affected by the two processes: absorption and scattering. To cope with the poor quality of underwater images, this paper proposes a multiscale fusion underwater image enhancement method based on channel attention mechanism and local binary pattern (LBP). The network consists of three modules: feature aggregation, image reconstruction and LBP enhancement. The feature aggregation module aggregates feature information at different scales of the image, and the image reconstruction module restores the output features to high-quality underwater images. The network also introduces channel attention mechanism to make the network pay more attention to the channels containing important information. The detail information is protected by real-time superposition with feature information. Experimental results demonstrate that the method in this paper produces results with correct colors and complete details, and outperforms existing methods in quantitative metrics.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제17권4호
• /
• pp.1234-1257
• /
• 2023

In this paper, we propose a framework for multi-focus image fusion called PATN. In our approach, by aggregating deep features extracted based on the U-type Transformer mechanism and shallow features extracted using the PSA module, we make PATN feed both long-range image texture information and focus on local detail information of the image. Meanwhile, the edge-preserving information value of the fused image is enhanced using a dense residual block containing the Sobel gradient operator, and three loss functions are introduced to retain more source image texture information. PATN is compared with 17 more advanced MFIF methods on three datasets to verify the effectiveness and robustness of PATN.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제15권5호
• /
• pp.1761-1777
• /
• 2021

An image with infrared features and visible details is obtained by processing infrared and visible images. In this paper, a fusion method based on Laplacian pyramid and generative adversarial network is proposed to obtain high quality fusion images, termed as Laplacian-GAN. Firstly, the base and detail layers are obtained by decomposing the source images. Secondly, we utilize the Laplacian pyramid-based method to fuse these base layers to obtain more information of the base layer. Thirdly, the detail part is fused by a generative adversarial network. In addition, generative adversarial network avoids the manual design complicated fusion rules. Finally, the fused base layer and fused detail layer are reconstructed to obtain the fused image. Experimental results demonstrate that the proposed method can obtain state-of-the-art fusion performance in both visual quality and objective assessment. In terms of visual observation, the fusion image obtained by Laplacian-GAN algorithm in this paper is clearer in detail. At the same time, in the six metrics of MI, AG, EI, MS_SSIM, Q_abf and SCD, the algorithm presented in this paper has improved by 0.62%, 7.10%, 14.53%, 12.18%, 34.33% and 12.23%, respectively, compared with the best of the other three algorithms.

• 제어로봇시스템학회논문지
• /
• 제19권2호
• /
• pp.158-163
• /
• 2013

The fusion of the GPS (Global Positioning System) and DR (Dead Reckoning) is widely used for position and latitude estimation of vehicles such as a mobile robot, aerial vehicle and marine vehicle. Among the many types of aerial vehicles, grater focus is given on the quad-rotor and accuracy of the position information is becoming more important. In order to exactly estimate the position information, we propose the fusion method of GPS and Gyroscope sensor using the DEKF (Dual Extended Kalman Filter). The DEKF has an advantage of simultaneously estimating state value and a parameter of dynamical system. It can also be used even if state value is not available. In order to analyze the performance of DEKF, the computer simulation for estimating the position, the velocity and the angle in a circle trajectory of quad-rotor was done. As it can be seen from the simulation results using own proposed DEKF instead of EKF on own fusion method in the navigation of a quad-rotor gave better performance values.

• Journal of Information Processing Systems
• /
• 제17권3호
• /
• pp.462-472
• /
• 2021

With an increase in the scale of recommender systems, users' rating data tend to be extremely sparse. Some methods have been utilized to alleviate this problem; nevertheless, it has not been satisfactorily solved yet. Therefore, we propose an effective pre-rating method based on users' dichotomous preferences and average ratings fusion. First, based on a user-item ratings matrix, a new user-item preference matrix was constructed to analyze and model user preferences. The items were then divided into two categories based on a parameterized dynamic threshold. The missing ratings for items that the user was not interested in were directly filled with the lowest user rating; otherwise, fusion ratings were utilized to fill the missing ratings. Further, an optimized parameter λ was introduced to adjust their weights. Finally, we verified our method on a standard dataset. The experimental results show that our method can effectively reduce the prediction error and improve the recommendation quality. As for its application, our method is effective, but not complicated.

• Asia pacific journal of information systems
• /
• 제33권3호
• /
• pp.737-767
• /
• 2023

With the availability of big customer data and advances in machine learning techniques, the prediction of customer behavior at the session-level has attracted considerable attention from marketing practitioners and scholars. This study aims to predict customer purchase conversion at the session-level by employing customer profile, transaction, and clickstream data. For this purpose, we develop a multimodal deep learning fusion model with dynamic and static features (i.e., DS-fusion). Specifically, we base page views within focal visist and recency, frequency, monetary value, and clumpiness (RFMC) for dynamic and static features, respectively, to comprehensively capture customer characteristics for buying behaviors. Our model with deep learning architectures combines these features for conversion prediction. We validate the proposed model using real-world e-commerce data. The experimental results reveal that our model outperforms unimodal classifiers with each feature and the classical machine learning models with dynamic and static features, including random forest and logistic regression. In this regard, this study sheds light on the promise of the machine learning approach with the complementary method for different modalities in predicting customer behaviors.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제18권8호
• /
• pp.2103-2118
• /
• 2024

Chinese herbal slices (CHS) automated recognition based on computer vision plays a critical role in the practical application of intelligent Chinese medicine. Due to the complexity and similarity of herbal images, identifying Chinese herbal slices is still a challenging task. Especially, easily-confused CHS have higher inter-class and intra-class complexity and similarity issues, the existing deep learning models are less adaptable to identify them efficiently. To comprehensively address these problems, a novel tiny easily-confused CHS dataset has been built firstly, which includes six pairs of twelve categories with about 2395 samples. Furthermore, we propose a ResNeSt-CHS model that combines multilevel perception fusion (MPF) and perceptive sparse fusion (PSF) blocks for efficiently recognizing easilyconfused CHS images. To verify the superiority of the ResNeSt-CHS and the effectiveness of our dataset, experiments have been employed, validating that the ResNeSt-CHS is optimal for easily-confused CHS recognition, with 2.1% improvement of the original ResNeSt model. Additionally, the results indicate that ResNeSt-CHS is applied on a relatively small-scale dataset yet high accuracy. This model has obtained state-of-the-art easily-confused CHS classification performance, with accuracy of 90.8%, far beyond other models (EfficientNet, Transformer, and ResNeSt, etc) in terms of evaluation criteria.

• 한국항행학회논문지
• /
• 제26권5호
• /
• pp.325-330
• /
• 2022

항공기에 탑재된 센서들은 임무 수행에 필수 요소이며 센서들을 통해 얻어진 데이터의 융합은 임무 효율을 높이고 조종사의 부담을 줄이기 위해 적용되고 있다. 센서들로부터 얻어진 데이터를 특정 대상에 대해 일관되고 보다 정리된 형태로 조종사에게 제공하기 위해 데이터 융합이 적용되어 발전하고 있다. 현재 운용되고 있는 군용 항공기는 Link-16 과 같은 전술데이터링크에 연동하여 향상된 전술 상황을 조종사에게 전시하여 임무 효율을 높이고 있다. 항공기에 탑재된 센서가 고성능화 되면서 얻어진 정확도가 향상된 센서 데이터와 전술데이터링크를 통해 수신한 전술상황정보를 융합하여 조종사에게 고신뢰성의 전술상황 및 임무 환경을 제공하고 효율적인 임무 수행과 높은 생존성을 기대할 수 있다. 본 논문에서는 항공기 실시간 센서 데이터와 전술데이터링크를 통해 얻어지는 데이터를 종합된 정보 형태로 제공하기 위한 융합 구조를 보인다.

• 제어로봇시스템학회논문지
• /
• 제6권2호
• /
• pp.173-180
• /
• 2000

During the last decade many researches have been working on multiple target tracking problem in the area of radar application, Various approaches have been proposed to solve the tracking problem and the concept of sensor fusion was established as an effort. In this paper utilization of geographic information for ground target tracking is investigated and performance comparison with the results of applying sensor fusion is described. Geographic information is used in three aspects: association masking target measurement and re-striction of removing true target. Simulation results indicate that using two sensors shows better performance with respect to tracking but a single with geographic information is a winner in reducing the number of false tracks.