• Title/Summary/Keyword: 가중치 필터

Search Result 365, Processing Time 0.035 seconds

Genetic algorithm for personalized information filtering agent (개인화된 정보 필터링 에이전트를 위한 유전 알고리즘)

  • 손윤희;박상호
    • Proceedings of the Korea Multimedia Society Conference
    • /
    • 2001.11a
    • /
    • pp.423-428
    • /
    • 2001
  • 유전 알고리즘을 이용한 정보 필터링 에이전트는 기존의 검색엔진에서 찾고자 하는 문서에 대해 검색된 문서의 유사도가 낮은 문제점을 해결한다. 본 논문에서는 HTML 태그의 중요도 가중치와 HTML 태그 안의 위치에 대한 가중치를 유전 알고리즘을 이용하여 학습한다. 여기서 학습된 가중치가 높은 태그와 태그 안의 위치 그리고 출현하는 빈도수에 대한 중요도 가중치를 다시 유전 알고리즘을 이용하여 학습하고 여기서 학습된 가중치로 검색된 문서를 필터링하여 정보 검색 성능을 향상시킬 수 있는 방법을 제안한다. 이 때 태그의 중요도 가중치 값을 학습하는 방법으로 하나의 태그를 유전자로 매핑하고 일련의 태그 집합을 염색체로 표현한 유전 알고리즘을 이용한다. 태그 안의 위치에 대한 중요도 가중치 값도 같은 방법을 이용한다. 여기서 나온 태그와 위치 그리고 빈도 수에 대한 중요도 가중치 값을 다시 유전자 알고리즘 이용하여 계산하다. 이 값으로 검색된 문서를 필터링하여 기존의 정보검색보다 검색자가 원하는 검색문서에 상당한 정확율을 제공하는 방법을 제안한다.

  • PDF

Dual SMS SPAM Filtering: A Graph-based Feature Weighting Method (듀얼 SMS 스팸 필터링: 그래프 기반 자질 가중치 기법)

  • Hwang, Jae-Won;Ko, Young-Joong
    • Annual Conference on Human and Language Technology
    • /
    • 2014.10a
    • /
    • pp.95-99
    • /
    • 2014
  • 본 논문에서는 최근 급속히 증가하여 사회적 이슈가 되고 있는 SMS 스팸 필터링을 위한 듀얼 SMS 스팸필터링 기법을 제안한다. 지속적으로 증가하고 새롭게 변형되는 SMS 문자 필터링을 위해서는 패턴 및 스팸 단어 사전을 통한 필터링은 많은 수작업을 요구하여 부적합하다. 그리하여 기계 학습을 이용한 자동화 시스템 구축이 요구되고 있으며, 효과적인 기계 학습을 위해서는 자질 선택과 자질의 가중치 책정 방법이 중요하다. 하지만 SMS 문자 특성상 문장들이 짧기 때문에 출현하는 자질의 수가 적어 분류의 어려움을 겪게 된다. 이 같은 문제를 개선하기 위하여 본 논문에서는 슬라이딩 윈도우 기반 N-gram 확장을 통해 자질을 확장하고, 확장된 자질로 그래프를 구축하여 얕은 구조적 특징을 표현한다. 학습 데이터에 출현한 N-gram 자질을 정점(Vertex)으로, 자질의 출현 빈도를 그래프의 간선(Edge)의 가중치로 설정하여 햄(HAM)과 스팸(SPAM) 그래프를 각각 구성한다. 이렇게 구성된 그래프를 바탕으로 노드의 중요도와 간선의 가중치를 활용하여 최종적인 자질의 가중치를 결정한다. 입력 문자가 도착하면 스팸과 햄의 그래프를 각각 이용하여 입력 문자의 2개의 자질 벡터(Vector)를 생성한다. 생성된 자질 벡터를 지지 벡터 기계(Support Vector Machine)를 이용하여 각 SVM 확률 값(Probability Score)을 얻어 스팸 여부를 결정한다. 3가지의 실험환경에서 바이그램 자질과 이진 가중치를 사용한 기본 시스템보다 F1-Score의 약 최대 2.7%, 최소 0.5%까지 향상되었으며, 결과적으로 평균 약 1.35%의 성능 향상을 얻을 수 있었다.

  • PDF

Weighted TR prefilter for Minimum ISI in indoor wireless Communication System (실내 무선 통신 환경에서 심볼 간 간섭 최소화를 위해 가중치를 적용한 시역전 필터)

  • Yoon, Mi-Sun;Lee, Chung-Yong
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.49 no.8
    • /
    • pp.52-57
    • /
    • 2012
  • We propose a weighted time-reversal prefilter for indoor wireless communication systems. In the indoor wireless communication environments, the bit error rate (BER) performance is significantly degraded by the delay spread. The conventional schemes have complex receivers to recover deterioration of the BER. The proposed time-reversal prefilter simplifies the structure of receivers, minimizes the inter-symbol interference (ISI) and maintains the peak power level of the received signal. The simulation results show that the weighted time-reversal prefilter improves the BER performance in comparison with the conventional time-reversal prefilter.

Determining of Weighting Factor for Two-Point Interpolation Filters (2-점 보간법 필터에서의 가중치 결정)

  • Ha, Mi Ryeong;Yoo, Hoon
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2013.11a
    • /
    • pp.217-219
    • /
    • 2013
  • 본 논문은 다양한 값의 가중치간 적용한 두 포인트 보간 필터를 제안한다. 기존 방법은 선행 보간 필터에 변형 함수와 가중치를 적용한 일반선행 보간 공식을 이용해 영상의 화질을 향상시켰지만 제안된 보간법은 일반 선형 보간 공식에 가중치 값을 다양하게 적용하여 2 점 보간법에서 실질적인 가중치 결정을 제공한다. 실험 결과에서는 제안된 방법이 기존 보간법보다 더 우수한 성능을 보여주는 것을 알 수 있다.

  • PDF

Nonlinear Composite Filter for Gaussian and Impulse Noise Removal (가우시안 및 임펄스 잡음 제거를 위한 비선형 합성 필터)

  • Kwon, Se-Ik;Kim, Nam-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.3
    • /
    • pp.629-635
    • /
    • 2017
  • In this paper, we proposed a nonlinear synthesis filter for noise reduction to reduce the effects of Gaussian noise and impulse noise. When the centralization of the local mask is judged to be Gaussian noise by the noise judgment, the weight value of the weight filter are applied differently according to the spatial weight filter and the pixel change by using the sample variance in the local mask. And if it is determined as the impulse noise, we proposed an algorithm that applies different weights of local histogram weight filter and standard median filter according to noise density of mask. In order to evaluate the performance of the proposed filter algorithm, we used PSNR(peak signal to noise ratio) and compared existing methods and proposed filter algorithm in the mixed noise environment with Gaussian noise, impulsive noise, and two noises mixed.

Noise Removal Filter Algorithm using Spatial Weight in AWGN Environment (AWGN 환경에서 공간 가중치를 이용한 잡음 제거 필터 알고리즘)

  • Cheon, Bong-Won;Kim, Nam-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.207-209
    • /
    • 2021
  • In recent years, with the development of artificial intelligence and IoT technology, automation and unmanned technology are in progress in various fields, and the importance of image processing such as object tracking, medical images and object recognition, which are the basis of this, is increasing. In particular, in systems requiring detailed data processing, noise reduction is used as a pre-processing step, but the existing algorithm has a disadvantage that blurring occurs in the filtering process. Therefore, in this paper, we propose a filter algorithm using modified spatial weights to minimize information loss in the filtering process. The proposed algorithm uses mask matching to remove AWGN, and obtains the output of the filter by adding or subtracting the output of the modified spatial weight. The proposed algorithm has superior noise reduction characteristics compared to the existing method and reconstructs the image while minimizing the blurring phenomenon.

  • PDF

Digital Switching Filter Algorithm using Modified Fuzzy Weights and Combined Weights in Mixed Image Noise Environment (복합 영상 잡음 환경에서 변형된 퍼지가중치 및 결합가중치를 사용한 디지털 스위칭 필터 알고리즘)

  • Cheon, Bong-Won;Kim, Nam-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.5
    • /
    • pp.645-651
    • /
    • 2021
  • With the advent of the Fourth Industrial Revolution, modern society uses a diverse pool of devices. In this context, there is increasing interest in removing various kinds of noise arising in data transmission. However, it is difficult to restore image that damaged by mixed noise, and a digital filter that effectively restores an image according to the characteristics of the noise is required. In this paper, we propose a digital switching filter algorithm to remove mixed noise generated during digital image transmission. The proposed algorithm switches the filtering process through noise judgment and reconstructs the image using fuzzy weights and combined weights based on the pixel values inside the mask. To evaluate the proposed algorithm, we compared it with existing filter algorithms through simulation. Filtering results were expanded and compared for visual evaluation, and PSNR comparison was used for quantitative evaluation.

Image Restoration Filter using Combined Weight in Mixed Noise Environment (복합잡음 환경에서 결합가중치를 이용한 영상복원 필터)

  • Cheon, Bong-Won;Kim, Nam-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.210-212
    • /
    • 2021
  • In modern society, various digital equipment are being distributed due to the influence of the 4th industrial revolution, and they are used in a wide range of fields such as automated processes, intelligent CCTV, medical industry, robots, and drones. Accordingly, the importance of the preprocessing process in a system operating based on an image is increasing, and an algorithm for effectively reconstructing an image is drawing attention. In this paper, we propose a filter algorithm based on a combined weight value to reconstruct an image in a complex noise environment. The proposed algorithm calculates the weight according to the spatial distance and the weight according to the difference between the pixel values for the input image and the pixel values inside the filtering mask, respectively. The final output was filtered by applying the join weights calculated based on the two weights to the mask. In order to verify the performance of the proposed algorithm, we simulated it by comparing it with the existing filter algorithm.

  • PDF

An Improved Weighted Filter for AWGN Removal (AWGN 제거를 위한 개선된 가중치 필터)

  • Long, Xu;Kim, Nam-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.5
    • /
    • pp.1227-1232
    • /
    • 2013
  • Recently, the expectation of quality about images over the increasing demand of digital devices is increasing with the development of the technology of the digital. But the images are degraded by a variety of causes, and the main reason is the noises. Therefore, the necessity of denoising comes to the fore, and the research for denoising is progressing dynamically. The images are mainly degraded by AWGN(additive white Gaussian noise), and the characteristics of denoising of existing methods such as mean filter are insufficient. In this paper, an algorithm combined by the spatial weighted filter and the modified adaptive weighted filter is proposed in order to effectively remove the AWGN. In the simulation result, the proposed algorithm showed excellent denoising capabilities.

Distance Weighted Filter based on Standard Deviation Distribution for AWGN Removal (AWGN 제거를 위한 표준편차 기반의 거리가중치 필터)

  • Park, Hwa-Jung;Kim, Nam-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.118-120
    • /
    • 2021
  • In modern society, with the development of IoT technology, various digital equipment is being distributed in a wide range of fields such as CCTV and exploration robots. Accordingly, the importance of data processing is increasing, and various studies are being conducted to remove noise generated in the process of receiving data in the imaging field. Representative noise includes additive white Gaussian noise (AWGN), and existing filters for removing noise include an average filter (AF), an alpha trimmed average filter (A-TAF), and a median filter (MF). However, existing filters have a disadvantage in that they show somewhat insufficient performance in noise removal characteristics in high frequency areas. Therefore, in this paper, in order to effectively remove AWGN existing in the high frequency region, a weight filter according to a distance based on the standard deviation is proposed.

  • PDF