• Title/Summary/Keyword: 데이터 필터링

Search Result 983, Processing Time 0.03 seconds

An Efficient Skyline Computation using Data Filtering in a MapReduce Environment (맵리듀스 환경에서 데이터 필터링을 이용한 효율적인 스카이라인 계산)

  • Kim, Jihyun;Kim, Myung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.04a
    • /
    • pp.582-584
    • /
    • 2016
  • 데이터의 다차원 특성을 고려한 스카이라인 계산은 의사결정 시스템이나 추천 시스템 등에 활용도가 높은 질의 처리이다. 최근 들어 빅데이터의 분석에도 스카이라인 질의가 유용하게 사용됨에 따라, 맵리듀스 환경에서 스카이라인 질의를 효율적으로 계산하는 데에 많은 관심이 집중되고 있다. 본 연구에서는 데이터 필터링을 적용하여 기존의 기법들과는 달리 하나의 잡(job)으로 스카이라인을 신속하게 계산하는 알고리즘을 소개한다. 제안하는 기법은 기존의 기법들에 비해 효율적이다.

An Authentication Scheme for Filtering Injected Bogus Data in Sensor Networks (센서 네트워크 내의 위조된 데이터 삽입 공격 방지를 위한 인증 방법)

  • Cho, Kwan-Tae;Kim, Young-Ho;Lee, Dong-Hoon
    • The KIPS Transactions:PartC
    • /
    • v.14C no.5
    • /
    • pp.389-394
    • /
    • 2007
  • Recently, a location-based threshold-endorsement(LTE) scheme is proposed to thwart bogus data injection attacks. The scheme exhibits much greater filtering power than earlier symmetric schemes and results in enhanced energy savings. In this paper, we show that LTE has fatal vulnerabilities. We also propose an improved scheme that mitigates the weakness and thereby achieves the original claims without lessening remarkable filtering power intended in LTE.

Music information and musical propensity analysis, and music recommendation system using collaborative filtering (음악정보와 음악적 성향 분석 및 협업 필터링을 이용한 음악추천시스템)

  • Gong, Minseo;Hong, Jinju;Choi, Jaehyun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2015.05a
    • /
    • pp.533-536
    • /
    • 2015
  • Mobile music market is growing. However, services what are applied recently are inaccurate to recommend music that a user is worth to prefer. So, this paper suggests music recommend system. This system recommend music that users prefer analyzing music information and user's musical propensity and using collaborative filtering. This system classify genre and extract factors what can be get using STFT's ZCR, Spectral roll-off, Spectral flux. So similar musics are clustered by these factors. And then, after divide mood of music's lyric, it finally recommend music automatically using collaborative filtering.

  • PDF

A Bloom filter-based Sentiment-aware Web Crawling Algorithm (블룸 필터를 이용한 감성 웹 문서 크롤링 알고리즘)

  • Na, Chul-Won;On, Byung-Won
    • Annual Conference on Human and Language Technology
    • /
    • 2018.10a
    • /
    • pp.69-74
    • /
    • 2018
  • 최근 빅 데이터와 인공지능의 발달과 함께 감성 분석에 대한 연구가 활발해지고 있다. 더불어 감성 분석을 위한 긍/부정 어휘가 풍부한 텍스트 문서들에 대한 수집의 필요성도 높아지고 있다. 본 논문은 긍/부정어휘가 풍부한 텍스트 문서들을 수집하는 기존의 수집 방법에 대한 문제점에 대하여 해결방안을 제시한다. 기존의 수집 방법으로 일단 모든 URL들을 저장하고 필터링 과정을 거쳐 긍/부정 어휘가 풍부한 텍스트 문서들을 수집하고자 한다면 불필요한 텍스트 문서 저장과 필터링 과정에서 메모리와 시간을 낭비하게 된다. 기존의 수집 방법에 블룸 필터라는 자료구조를 적용시켜 메모리와 시간을 낭비하게 되는 문제점을 해결하고자 한다.

  • PDF

An Efficient Filtering Method for Processing Continuous Skyline Queries on Sensor Data (센서데이터의 연속적인 스카이라인 질의 처리를 위한 효율적인 필터링기법)

  • Jang, Su-Min;Kang, Gwang-Goo;Yoo, Jae-Soo
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.15 no.12
    • /
    • pp.938-942
    • /
    • 2009
  • In this paper, we propose a novel filtering method for processing continuous skyline queries on wireless sensor network environments. The existing filtering methods use the filter based on router paths. However, because these filters are applied not to a whole area but to a partial area, these methods send almost data of sensor nodes to transmit to the base station and have no sufficient effect in terms of energy efficiency. Therefore, we propose an efficient method to dramatically reduce the transmission data of sensors through applying a low-cost and effective filter to all sensor nodes. The proposed effective filter is generated by using characteristics such as the data locality and the clustering of sensors. An extensive performance study verifies the merits of our new method.

Pain Nursing Intervention Supporting Method using Collaborative Filtering in Health Industry (보건산업에서 협력적 필터링을 이용한 통증 간호중재 지원 방법)

  • Yoo, Hyun;Jo, Sun-Moon;Chung, Kyung-Yong
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.7
    • /
    • pp.1-8
    • /
    • 2011
  • In modern society, the amount of information has been significantly increased according to the development of Internet and IT convergence technology and that leads to develop information obtaining and searching technologies from lots of data. Although the system integration for medicare has been largely established and that accumulates large amounts of information, there is a lack of providing and supporting information for nursing activities using such established database. In particular, the judgement for the intervention of pains depends on the experience of individual nurses and that leads to make subjective decisions in usual. In this paper, a pain nursing supporting method that uses the existing medical data and performs collaborative filtering is proposed. The proposed collaborative filtering is a method that extracts some items, which represent a high relativeness level, based on similar preferences. A preference estimation method using a user based collaborative filtering method calculates user similarities through Pearson correlation coefficients in which a neighbor selection method is used based on the user preference.

User and Item based Collaborative Filtering Using Classification Property Naive Bayesian (분류 속성과 Naive Bayesian을 이용한 사용자와 아이템 기반의 협력적 필터링)

  • Kim, Jong-Hun;Kim, Yong-Jip;Rim, Kee-Wook;Lee, Jung-Hyun;Chung, Kyung-Yong
    • The Journal of the Korea Contents Association
    • /
    • v.7 no.11
    • /
    • pp.23-33
    • /
    • 2007
  • The collaborative filtering has used the nearest neighborhood method based on the preference and the similarity using the Pearson correlation coefficient. Therefore, it does not reflect content of the items and has the problems of the sparsity and scalability as well. the item-based collaborative filtering has been practically used to improve these defects, but it still does not reflect attributes of the item. In this paper, we propose the user and item based collaborative filtering using the classification property and Naive Bayesian to supplement the defects in the existing recommendation system. The proposed method complexity refers to the item similarity based on explicit data and the user similarity based on implicit data for handing the sparse problem. It applies to the Naive Bayesian to the result of reference. Also, it can enhance the accuracy as computation of the item similarity reflects on the correlative rank among the classification property to reflect attributes.

Real-Time 2-D Median Filter (실시간 2차원 메디안 필터)

  • Jeong, Jae-Gil
    • The Journal of Engineering Research
    • /
    • v.3 no.1
    • /
    • pp.57-64
    • /
    • 1998
  • This paper presents an architecture of a real-time two-dimensional median filter. The architecture has appropriate characteristics for the VLSI implementation such as small memory requirements, regular computations, and local data transfers. For the efficient two-dimensional median filter, a separable two-dimensional median filtering structure and a bit-sliced pipelined median searching algorithm are used. A behavioral simulator is implemented with C language and used for the analysis of the presented architecture.

  • PDF

The Analysis and Design of EMS Component for RFID Middleware (RFID 미들웨어를 위한 EMS 컴포넌트의 분석 및 설계)

  • Ahn Sungwoo;Park Jaekwan;Seok Suwook;Hong Bonghee
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2005.07a
    • /
    • pp.271-273
    • /
    • 2005
  • 많은 글로벌 기업들이 비용절감 및 효율성 증대를 위하여 RFID 시스템을 도입하거나 도입을 적극 검토 중에 있다. RFID 시스템으로부터 획득된 수많은 정보들이 기업의 업무효율을 증대시킬 수 있도록 하기 위해서는 상위 응용 서비스에서 RFID 데이터를 효율적으로 사용할 수 있도록 리더와 응용 서비스 간의 중계 역할을 할 수 있는 RFID 미들웨어의 역할이 매우 중요하다. 이러한 요구사항에 맞춰 최근 EPCglobal에서는 RFID 미들웨어인 ALE(Application Level Event)를 제시하고 있다. ALE는 RFID 리더에 의해 읽혀진 EPC 이벤트 데이터를 실시간으로 수집하여 원본 데이터의 오류를 보정한 후에 사용자와 응용 서비스의 요구에 따라 특정 이벤트 데이터를 필터링하여 보고하는 역할을 한다. 본 논문에서는 ALE의 실시간 EPC 이벤트 데이터 처리를 위한 EMS(Event Management System) 컴포넌트를 제시하며 EMS에 대한 요구사항을 분석하고 설계하였다. EMS 컴포넌트는 RFID 리더를 통해서 끊임없이 들어오는 스트링 형태의 EPC 이벤트 데이터를 블록킹 없이 수집하는 역할을 한다. 또한, RFID 리더에서 수집한 데이터의 보정 및 필요 데이터 추출을 위한 다양한 필터링 기능을 제공함으로써 수집된 데이터의 정확성을 높이며 신속한 데이터 제공을 가능하게 한다.

  • PDF

Reservoir Tank Wireless Integrated Management using Information Filtering (정보 필터링을 이용한 저수조 무선 통합 관리)

  • Yu, Ki-Youp;Kouh, Hoon-Joon;Chung, Kyung-Yong;Rim, Kee-Wook;Lee, Jung-Hyun
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.787-791
    • /
    • 2009
  • In this paper, we proposed the reservoir tank wireless integrated management using information filtering for improving the water quality and on-line managing efforts of reservoir tanks. Reservoir tank level sensor works the pump sending the data from reservoir tank control to the wireless control on sensing water level. At this time, every kind data which happens in the water tank transmits the line transmission modem. The data to be received from the line transmission modem is stored at the database after we record the logs by each hour. The proposed method defined the context and environment of the reservoir tank and predicted the profited service according to the pump motion, the solar battery, the chemicals, the water level, the line, and the modem using information filtering. we plan to conduct the proposed method to verify the adequacy and the validity of reservoir tank wireless integrated management using the information filtering.

  • PDF