• Title/Summary/Keyword: Large Size data Processing

Search Result 246, Processing Time 0.024 seconds

An Index-Based Search Method for Performance Improvement of Set-Based Similar Sequence Matching (집합 유사 시퀀스 매칭의 성능 향상을 위한 인덱스 기반 검색 방법)

  • Lee, Juwon;Lim, Hyo-Sang
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.11
    • /
    • pp.507-520
    • /
    • 2017
  • The set-based similar sequence matching method measures similarity not for an individual data item but for a set grouping multiple data items. In the method, the similarity of two sets is represented as the size of intersection between them. However, there is a critical performances issue for the method in twofold: 1) calculating intersection size is a time consuming process, and 2) the number of set pairs that should be calculated the intersection size is quite large. In this paper, we propose an index-based search method for improving performance of set-based similar sequence matching in order to solve these performance issues. Our method consists of two parts. In the first part, we convert the set similarity problem into the intersection size comparison problem, and then, provide an index structure that accelerates the intersection size calculation. Second, we propose an efficient set-based similar sequence matching method which exploits the proposed index structure. Through experiments, we show that the proposed method reduces the execution time by 30 to 50 times then the existing methods. We also show that the proposed method has scalability since the performance gap becomes larger as the number of data sequences increases.

The Gender Observation Time Characteristics from Sight Fixation and the Leap of Pupil Index (시선의 고정과 도약 동공지표에 나타난 성별 주시시간 특성)

  • Lee, Jeong Ho;Kim, Jong-Ha
    • Korean Institute of Interior Design Journal
    • /
    • v.27 no.1
    • /
    • pp.29-38
    • /
    • 2018
  • This research is to analyze the change of pupil size in gender through the eye-tracking experiment in large complex cultural space. It is meaningful that figured out the common characteristics and differences from gender observation characteristics. Through this research, the analyzed results of the observation time measurement that appeared from the fixation and saccades pupil indicator able to define as follows. Firstly, it was suggested that there were differences between each gender and participants through extract pupil size that can be the standard examples for the case from male and female and the process of extracting the relative pupil size change on the hourly range. From the specific time range, it was possible to indicate bending characteristics and reversal phenomena of Fixation and Saccades. Second, the result was found equally from both male and female group that the rapid increment of pupil size at initial time range immediately after the eye-tracking experiment has been initiated. This can be considered to actively accepting the stress given by the subject through the extended pupil after 10 seconds that compare to indicated very low pupil size between 0 to 10 seconds after starting the experiment. Third, meanwhile 0 to 10 seconds after initial observation are the time of sudden change in the pupil size, therefore these time range data cannot be regarded as observed in the appropriate condition. Thus, it able to define the highest times of emotional processing for male as 10 to 80 seconds, and for female as 10 to 70 seconds. There was no definition of the time range data for observation experiment from previous research, this data can be considered to stable time to observation through the pupil extension. Therefore, it is possible to set suitable time of observation experiment to be around 70 to 80 seconds exclude initial experiment time.

A Space-Efficient Inverted Index Technique using Data Rearrangement for String Similarity Searches (유사도 검색을 위한 데이터 재배열을 이용한 공간 효율적인 역 색인 기법)

  • Im, Manu;Kim, Jongik
    • Journal of KIISE
    • /
    • v.42 no.10
    • /
    • pp.1247-1253
    • /
    • 2015
  • An inverted index structure is widely used for efficient string similarity search. One of the main requirements of similarity search is a fast response time; to this end, most techniques use an in-memory index structure. Since the size of an inverted index structure usually very large, however, it is not practical to assume that an index structure will fit into the main memory. To alleviate this problem, we propose a novel technique that reduces the size of an inverted index. In order to reduce the size of an index, the proposed technique rearranges data strings so that the data strings containing the same q-grams can be placed close to one other. Then, the technique encodes those multiple strings into a range. Through an experimental study using real data sets, we show that our technique significantly reduces the size of an inverted index without sacrificing query processing time.

Development Can Air Leak Detector System For Single Compression Head-Line Type Using Pressure Sensor (압력 센서를 이용한 씽글 헤드라인 타입의 캔 에어 리크 검출씨스템 개발)

  • Lee, Jong-Woon
    • Proceedings of the KIEE Conference
    • /
    • 1992.07a
    • /
    • pp.506-507
    • /
    • 1992
  • When it comes to the 'Leak Detector System' generally, our country has a large income 'Rotary Type Leak Detector' of foreign goods. The completed development of the 'Line Type Leak-Detector' system was produced to check Whether the containers for small and large on the filling line are auto defective. This system is applied to the filling package Processing during the production and contributed to inproving competiveness of domestic containers manufactures of all society of Industry. Also, high precision and realiablity, very compact size, low cost and Easy set-up etc. by checking the experimental data directly plan, Design and making for '1 Compression Head Control Leak Detector System'. This flexcible system can be equipped with multiple Compression heads depending on the requested prodution test rate and test precision.

  • PDF

The Effect of Resource Depletion on Deciding on Product Assortments Size (소비자의 자원고갈이 제품구색간 의사결정에 미치는 효과)

  • Cho, Yeon-Jin;Park, Cheong-Kyu;Lim, Hyun-Woo
    • Journal of Distribution Science
    • /
    • v.14 no.3
    • /
    • pp.85-91
    • /
    • 2016
  • Purpose - Prior research has suggested that consumers typically prefer to have a larger number of options. However, preference of assortment size may depend on how depleted resources in consumers' mind are. Reduced capacity for self-regulation by resource depletion makes people rely on more intuitive and less effortful decision processing. When they are mentally depleted, people are likely to focus on the choice difficulty from large assortment, which leads to preference for the small assortment when they make a decision. It could be an important question potentially how being in a depleted mode through effortful self-regulation will influence on the evaluation of assortment size. To answer this questioner, we hypothesized that being engaged in self-regulation, as compared with not being engaged in self-regulation, will influence on the evaluation of product assortment size such as attractiveness, difficulty of choice, and anticipated regret. Research design, data, and methodology - In this study, we first manipulated self-regulatory resource availability using a self-regulation task (i.e., instructing participants to solve Sudoku puzzle vs. to solve diagram cube by filling any diagrams that they prefer into cube instead of number) and asked to indicate the difficulty of the tasks available to them ("How much difficulty did you feel when you complete the task?") Next, participants were asked to imagine that they were planning to buy a laptop at one of the two stores (small assortment: 6 options vs. large assortment: 30 options), both offering good quality of products. After reading the product descriptions, participants were instructed to consider all the information and choose a store that they would like to shop. Finally we measured the choice difficulty, evaluation of product assortments, and anticipated regret on a 7-point scale. We conducted two-way ANOVA in testing the main hypothesis that depleted consumers will show poorer subsequent self-control than non-depleted consumers when they make a decision in large assortment. Results - Compared with non-depleted participants, depleted participants showed the bigger difference from the degree of choice difficulty and product attractiveness between large and small assortments, but the result revealed only a significant interaction effect of resource depletion and assortment size on choice difficulty. Also depleted participants showed the smaller difference from the degree of anticipated regret between large and small assortments than non-depleted participants. Conclusion - Depleted individuals by a prior task are relatively effortless and intuitive form of choosing products so that they try to avoid making effortful trade-offs among choice difficulty such as large assortment, compare with non-depleted individuals. However, for anticipated regret, non-depleted individuals in small assortment anticipate more regret by excluding or at least restricting the possibility of buying attractive items or another kind of potential items than depleted individuals, regardless less choice difficulty in small option. To sum up, it is important to note that individuals are influenced by self-regulatory resources and their self-regulatory conditions contribute to the overall positive or negative impact of product assortment on choice.

Feature Extraction Method of 2D-DCT for Facial Expression Recognition (얼굴 표정인식을 위한 2D-DCT 특징추출 방법)

  • Kim, Dong-Ju;Lee, Sang-Heon;Sohn, Myoung-Kyu
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.3
    • /
    • pp.135-138
    • /
    • 2014
  • This paper devices a facial expression recognition method robust to overfitting using 2D-DCT and EHMM algorithm. In particular, this paper achieves enhanced recognition performance by setting up a large window size for 2D-DCT feature extraction and extracting the observation vectors of EHMM. The experimental results on the CK facial expression database and the JAFFE facial expression database showed that the facial expression recognition accuracy was improved according as window size is large. Also, the proposed method revealed the recognition accuracy of 87.79% and showed enhanced recognition performance ranging from 46.01% to 50.05% in comparison to previous approaches based on histogram feature, when CK database is employed for training and JAFFE database is used to test the recognition accuracy.

An Implementation of High Speed Rendering to Process Touch Screen Multiple Inputs based on FPGA (FPGA 기반의 터치스크린 다중입력처리를 위한 고속 렌더링 구현)

  • Yoon, Junhan;Kim, Jin Heon
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.11
    • /
    • pp.1803-1810
    • /
    • 2017
  • A large amount of processing time is required if the process of detecting the touch position on the touch screen and displaying it on the display panel is performed only by software. In this paper, we propose a method to output information touched on the screen using H/W method in order to improve the response speed delay. In the FPGA module designed for the HDMI signal output to the display module, the touch information is input to the serial data signal including touch coordinate information, point size, and color information. Then the module render the image using HDMI signal input to the module and the touch information. This method has a pipeline structure so it has effect of reducing the delay time that occurs in outputting the touch information compared with the conventional software processing method.

A Study on VLSI-Oriented 2-D Systolic Array Processor Design for APP (Algebraic Path Problem) (VLSI 지향적인 APP용 2-D SYSTOLIC ARRAY PROCESSOR 설계에 관한 연구)

  • 이현수;방정희
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.30B no.7
    • /
    • pp.1-13
    • /
    • 1993
  • In this paper, the problems of the conventional special-purpose array processor such as the deficiency of flexibility have been investigated. Then, a new modified methodology has been suggested and applied to obtain the common solution of the three typical App algorithms like SP(Shortest Path), TC(Transitive Closure), and MST(Minimun Spanning Tree) among the various APP algorithms using the similar method to obtain the solution. In the newly proposed APP parallel algorithm, real-time Processing is possible, without the structure enhancement and the functional restriction. In addition, we design 2-demensional bit-parallel low-triangular systolic array processor and the 1-PE in detail. For its evaluation, we consider its computational complexity according to bit-processing method and describe relationship of total chip size and execution time. Therefore, the proposed processor obtains, on which a large data inputs in real-time, 3n-4 execution time which is optimal o(n) time complexity, o(n$^{2}$) space complexity which is the number of total gate and pipeline period rate is one.

  • PDF

Feature Extraction System for Land Cover Changes Based on Segmentation

  • Jung, Myung-Hee;Yun, Eui-Jung
    • Korean Journal of Remote Sensing
    • /
    • v.20 no.3
    • /
    • pp.207-214
    • /
    • 2004
  • This study focused on providing a methodology to utilize temporal information obtained from remotely sensed data for monitoring a wide variety of targets on the earth's surface. Generally, a methodology in understanding of global changes is composed of mapping, quantifying, and monitoring changes in the physical characteristics of land cover. The selected processing and analysis technique affects the quality of the obtained information. In this research, feature extraction methodology is proposed based on segmentation. It requires a series of processing of multitempotal images: preprocessing of geometric and radiometric correction, image subtraction/thresholding technique, and segmentation/thresholding. It results in the mapping of the change-detected areas. Here, the appropriate methods are studied for each step and especially, in segmentation process, a method to delineate the exact boundaries of features is investigated in multiresolution framework to reduce computational complexity for multitemporal images of large size.

An Analysis of the Performance of Collective I/Os and the Subgroup Method (집합 I/O와 부분군 기법의 성능 분석)

  • Cha, Kwangho;Cho, Hyeyoung;Kim, Sungho
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2007.11a
    • /
    • pp.513-516
    • /
    • 2007
  • Because many scientific applications require large data processing, the importance of parallel I/O has been increasingly recognized. Collective I/O is one of the considerable features of parallel I/O and enables application programmers to easily handle their large data volume. In this paper we measure and analyze the performance of original collective I/Os and the subgroup method, the way of using collective I/O of MPI effectively. From the experimental results, we found that the two kinds of subgroup method showed different performance. In terms of collective write operation, the subgroup method caused the performance degradation. However, the subgroup method for collective read showed good performance with small data size.

  • PDF