• Title/Summary/Keyword: Fast search

Search Result 932, Processing Time 0.026 seconds

A Novel Algorithm for Fast Node-search and Redundancy Reduction in Gossip-based P2P Network (빠른 노드 검색과 부하감소를 위한 새로운 가쉽기반 P2P 네트워크 알고리즘)

  • Zhu, Xiao-Wei;Jang, Kyung-Sik
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.05a
    • /
    • pp.619-622
    • /
    • 2009
  • P2P networks are undergoing rapid progress and inspiring numerous developments by gossip-based protocol. Gossip-based protocols for group communication have attractive scalability and reliability properties. We propose a self-organizing algorithm in the sense that the size of neighbor list achieved without any node knowing the group size. We also propose an efficient mechanism to reduce the redundancy of the system by backing up the nodes in the neighbor list. We present the design, theoretical analysis, and a detailed evaluation of the proposed algorithm and its refinements.

  • PDF

Efficient method of Searching PI Code on RDS System (RDS System 에서의 효율적인 PI code 검출 기법에 관한 연구)

  • Cho, Chung-bum;Kim, Yound-cil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.112-115
    • /
    • 2009
  • PI code searching method of RDS(Radio Data System) are unique method of maintain desired channel on moving machine like vehicle. Efficient and fast PI code search method are researching on the all of RDS related systems for both find more better channel before Original channel signal go to bad and find desired good signal quickly when get out of Weak signal Area. But Embedded system has limited environment like memory size, so It is very difficult to apply many well known PI code searching method. This thesis suggests simple and effective method of searching PI code, considering a Embedded System Environment.

  • PDF

A Cloud-Edge Collaborative Computing Task Scheduling and Resource Allocation Algorithm for Energy Internet Environment

  • Song, Xin;Wang, Yue;Xie, Zhigang;Xia, Lin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.6
    • /
    • pp.2282-2303
    • /
    • 2021
  • To solve the problems of heavy computing load and system transmission pressure in energy internet (EI), we establish a three-tier cloud-edge integrated EI network based on a cloud-edge collaborative computing to achieve the tradeoff between energy consumption and the system delay. A joint optimization problem for resource allocation and task offloading in the threetier cloud-edge integrated EI network is formulated to minimize the total system cost under the constraints of the task scheduling binary variables of each sensor node, the maximum uplink transmit power of each sensor node, the limited computation capability of the sensor node and the maximum computation resource of each edge server, which is a Mixed Integer Non-linear Programming (MINLP) problem. To solve the problem, we propose a joint task offloading and resource allocation algorithm (JTOARA), which is decomposed into three subproblems including the uplink transmission power allocation sub-problem, the computation resource allocation sub-problem, and the offloading scheme selection subproblem. Then, the power allocation of each sensor node is achieved by bisection search algorithm, which has a fast convergence. While the computation resource allocation is derived by line optimization method and convex optimization theory. Finally, to achieve the optimal task offloading, we propose a cloud-edge collaborative computation offloading schemes based on game theory and prove the existence of Nash Equilibrium. The simulation results demonstrate that our proposed algorithm can improve output performance as comparing with the conventional algorithms, and its performance is close to the that of the enumerative algorithm.

Fast offline transformer-based end-to-end automatic speech recognition for real-world applications

  • Oh, Yoo Rhee;Park, Kiyoung;Park, Jeon Gue
    • ETRI Journal
    • /
    • v.44 no.3
    • /
    • pp.476-490
    • /
    • 2022
  • With the recent advances in technology, automatic speech recognition (ASR) has been widely used in real-world applications. The efficiency of converting large amounts of speech into text accurately with limited resources has become more vital than ever. In this study, we propose a method to rapidly recognize a large speech database via a transformer-based end-to-end model. Transformers have improved the state-of-the-art performance in many fields. However, they are not easy to use for long sequences. In this study, various techniques to accelerate the recognition of real-world speeches are proposed and tested, including decoding via multiple-utterance-batched beam search, detecting end of speech based on a connectionist temporal classification (CTC), restricting the CTC-prefix score, and splitting long speeches into short segments. Experiments are conducted with the Librispeech dataset and the real-world Korean ASR tasks to verify the proposed methods. From the experiments, the proposed system can convert 8 h of speeches spoken at real-world meetings into text in less than 3 min with a 10.73% character error rate, which is 27.1% relatively lower than that of conventional systems.

Efficient Illegal Contents Detection and Attacker Profiling in Real Environments

  • Kim, Jin-gang;Lim, Sueng-bum;Lee, Tae-jin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.6
    • /
    • pp.2115-2130
    • /
    • 2022
  • With the development of over-the-top (OTT) services, the demand for content is increasing, and you can easily and conveniently acquire various content in the online environment. As a result, copyrighted content can be easily copied and distributed, resulting in serious copyright infringement. Some special forms of online service providers (OSP) use filtering-based technologies to protect copyrights, but illegal uploaders use methods that bypass traditional filters. Uploading with a title that bypasses the filter cannot use a similar search method to detect illegal content. In this paper, we propose a technique for profiling the Heavy Uploader by normalizing the bypassed content title and efficiently detecting illegal content. First, the word is extracted from the normalized title and converted into a bit-array to detect illegal works. This Bloom Filter method has a characteristic that there are false positives but no false negatives. The false positive rate has a trade-off relationship with processing performance. As the false positive rate increases, the processing performance increases, and when the false positive rate decreases, the processing performance increases. We increased the detection rate by directly comparing the word to the result of increasing the false positive rate of the Bloom Filter. The processing time was also as fast as when the false positive rate was increased. Afterwards, we create a function that includes information about overall piracy and identify clustering-based heavy uploaders. Analyze the behavior of heavy uploaders to find the first uploader and detect the source site.

A New Flash TPR-tree for Indexing Moving Objects with Frequent Updates

  • Lim, Seong-Chae
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.1
    • /
    • pp.95-104
    • /
    • 2022
  • A TPR-tree is a well-known indexing structure that is developed to answer queries about the current or future time locations of moving objects. For the purpose of space efficiency, the TPR-tree employs the notion of VBR (velocity bounding rectangle)so that a regionalrectangle presents varying positions of a group of moving objects. Since the rectangle computed from a VBR always encloses the possible maximum range of an indexed object group, a search process only has to follow VBR-based rectangles overlapped with a given query range, while searching toward candidate leaf nodes. Although the TPR-tree index shows up its space efficiency, it easily suffers from the problem of dead space that results from fast and constant expansions of VBR-based rectangles. Against this, the TPR-tree index is enforced to update leaf nodes for reducing dead spaces within them. Such an update-prone feature of the TPR-tree becomes more problematic when the tree is saved in flash storage. This is because flash storage has very expensive update costs. To solve this problem, we propose a new Bloom filter based caching scheme that is useful for reducing updates in a flash TPR-tree. Since the proposed scheme can efficiently control the frequency of updates on a leaf node, it can offer good performance for indexing moving objects in modern flash storage.

A Study on Prescription Similarity Analysis for Efficiency Improvement (처방 유사도 분석의 효율성 향상에 관한 연구)

  • Hwang, SuKyung;Woo, DongHyeon;Kim, KiWook;Lee, ByungWook
    • Journal of Korean Medical classics
    • /
    • v.35 no.4
    • /
    • pp.1-9
    • /
    • 2022
  • Objectives : This study aims to increase efficiency of the prescription similarity analysis method that uses drug composition ratio. Methods : The controlled experiment compared result generation time, generated data quantity, and accuracy of results between previous and new analysis method on the 12,598 formulas and 61 prescription groups. Results : The control group took 346 seconds on average and generated 768,478 results, while the test group took 24 seconds and generated 241,739 results. The test group adopted a selective calculation method that only used overlapping data between two formulas instead of analyzing all number of cases. It simplified the data processing process, reducing the quantity of data that is required to be processed, leading to better system speed, as fast as 14.47 times more than previous analysis method with equal results. Conclusions : Efficiency for similarity analysis could be improved by reducing data span and simplifying the calculation processes.

A method of Fast motion estimation using Motion characteristics of Macro-blocks in Search range (탐색 영역내 매크로 블록 움직임 특성을 이용한 고속 움직임 예측 방법)

  • Jeong, Yong-Jae;Moon, Kwang-Seok;Kim, Jong-Nam
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.04a
    • /
    • pp.157-158
    • /
    • 2009
  • 본 논문에서는 움직임 추정을 위한 탐색 영역내의 스캔 방법을 움직임 벡터가 나올 확률에 근거하여 가변적으로 적용하여 불필요한 후보 블록을 제거하는 PDE(patial distortion elimination) 기반의 고속 블록 매칭 알고리즘을 제안한다. 제안한 방법은 기존의 방법보다 불필요한 계수를 효율적으로 제거하기 위하여 탐색 영역 안에서 움직임 벡터가 존재 할 확률이 가장 높은 영역은 전영역 탐색을 적용하고, 움직임 벡터가 존재할 확률이 낮은 영역은 한 픽셀 건너 뛰어서 블록 정합하여 계산 비용을 효율적으로 감소시켯다. 제안한 알고리즘은 극히 낮은 화질 저하를 가지며, 기존의 H.264에서 사용되고 있는 전역 탐색 알고리즘에 비해 P프레임의 경우 85% 이상의 계산 비용 감소가 있어 H.264를 이용하는 비디오 압축 응용 분야에 유용하게 사용될 수 있을 것이다.

Internet-based Information System for Agricultural Weather and Disease and Insect fast management for rice growers in Gyeonggi-do, Korea

  • S.D. Hong;W.S. Kang;S.I. Cho;Kim, J.Y.;Park, K.Y;Y.K. Han;Park, E.W.
    • Proceedings of the Korean Society of Plant Pathology Conference
    • /
    • 2003.10a
    • /
    • pp.108.2-109
    • /
    • 2003
  • The Gyeonggi-do Agricultural Research and Extension Services has developed a web-site (www.epilove.com) in collaboration with EPINET to provide information on agricultural weather and rice disease and insect pest management in Gyeonggi-do. Weather information includes near real-time weather data monitored by automated weather stations (AWS) installed at rice paddy fields of 11 Agricultural Technology Centers (ATC) in Gyeonggi-do, and weekly weather forecast by Korea Meteorological Administration (KMA). Map images of hourly air temperature and rainfall are also generated at 309m x 309m resolution using hourly data obtained from AWS installed at 191 locations by KMA. Based on near real-time weather data from 11 ATC, hourly infection risks of rice blast, sheath blight, and bacterial grain rot for individual districts are estimated by disease forecasting models, BLAST, SHBLIGHT, and GRAINROT. Users can diagnose various diseases and insects of rice and find their information in detail by browsing thumbnail images of them. A database on agrochemicals is linked to the system for disease and insect diagnosis to help users search for appropriate agrochemicals to control diseases and insect pests.

  • PDF

Transmit Power-aware Routing Path Selection in AODV (Ad Hoc On Demand Distance Vector Routing) (AODV(Ad Hoc On Demand Distance Vector Routing)에서 전송 전력을 고려한 라우팅 경로 설정)

  • Lee, Jang-Su;Kim, Sung-Chun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2007.05a
    • /
    • pp.1205-1208
    • /
    • 2007
  • 모바일 애드혹 네트워크는 기존의 셀룰러 네트워크와는 달리 고정된 기지국이 존재하지 않고 모바일 노드들만으로 구성된 네트워크이다. 모바일 애드혹 네트워크의 각각의 노드들은 제한된 자원과 한정된 용량을 가진 배터리로 동작한다. 만일 이 배터리를 모두 소모하게 된다면 중간 노드들이 다운이 되고, 결과적으로 전체 네트워크가 단절되는 문제가 발생할 수 있다. 기존의 전송 전력을 고려하여 경로를 설정하는 기법인 CLUSTERPOW는 노드 간에 연결되는 전송 전력을 최소화함으로써 데이터 전송 시 소비되는 전력을 줄이고자 하였다. 그러나 이 기법은 proactive 방식의 라우팅 프로토콜에는 적합하나 reactive 방식의 라우팅 프로토콜에는 적합하지 않다. 따라서 본 논문에서는 reactive 방식의 특성에 맞는 전송 전력 설정 기법인 FSRS(Fast Search Reverse Setting) 기법을 제안하였다. FSRS 기법은 reactive 방식에서 사용하는 컨트롤 패킷 플라딩을 사용한 경로 설정에서의 오버헤드를 줄이고자 클러스터 간 플라딩을 통해 목적지 노드를 빠르게 찾고 한정된 클러스터 간 경로를 통해 전송 전력을 고려한 세부적인 경로를 설정한다. FSRS 기법은 기존의 CLUSTERPOW 기법과 마찬가지로 효율적인 전송 전력으로 경로를 설정하였으며 또한 네트워크 생존 시간을 CLUSTERPOW보다 평균 43% 연장시켰다.