• Title/Summary/Keyword: I/O data

Search Result 1,264, Processing Time 0.029 seconds

Development and Application of HDD I/O Measurement Utility Blockwrite (하드디스크 데이터 I/O 속도 측정용 유틸리티 blockwrite 개발과 응용)

  • Kim, Hyo-Ryoung;Song, Min-Gyu
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.15 no.6
    • /
    • pp.1151-1158
    • /
    • 2020
  • In order to investigate the speed profile of data I/O of HDD, we have developed an utility program. The application to HDD reveals the detail properties of the speed profile of HDD and the relation between the cylinder structure of HDD and the velocity profile. For the extent application, the experiment of the large volume storage was performed, and the profile of SSD media, which is known as the new rapid media, was measured. The new M.2 NVME SSD, which has the ability of over 10Gbps, we can compare the velocities between cp under linux O/S and the utility, and shows that the performance of the utility can be reliable.

Using a Greedy Algorithm for the Improvement of a MapReduce, Theta join, M-Bucket-I Heuristic (그리디 알고리즘을 이용한 맵리듀스 세타조인 M-Bucket-I 휴리스틱의 개선)

  • Kim, Wooyeol;Shim, Kyuseok
    • Journal of KIISE
    • /
    • v.43 no.2
    • /
    • pp.229-236
    • /
    • 2016
  • Theta join is one of the essential and important types of queries in database systems. As the amount of data needs to be processed increases, processing theta joins with a single machine becomes impractical. Therefore, theta join algorithms using distributed computing frameworks have been studied widely. Although one of the state-of-the-art theta-join algorithms uses M-Bucket-I heuristic, it is hard to use since running time of M-Bucket-I heuristic, which computes a mapping from a record to a reducer (i.e., reducer mapping), is O(n) where n is the size of input data. In this paper, we propose MBI-I algorithm which reduces the running time of M-Bucket-I heuristic to $O(r_{max}log\;n)$ and gives the same result as M-Bucket-I heuristic does. We also conducted several experiments to show algorithm and confirmed that our algorithm can improve the performance of a theta join by 10%.

Stochastic Modelling of Monthly flows for Somjin river (섬진강 월유출량의 추계학적 모형)

  • 이종남;이홍근
    • Water for future
    • /
    • v.17 no.4
    • /
    • pp.281-291
    • /
    • 1984
  • In our Koreans river basins there are many of monthly rainfall data, but unfortrnately streamflow data needed are rare. Analysing monthly rainfall data of Somjin river basin, the stochastic theory model for calculation of monthly streamflow series of that region is determined. The model is composed of Box & Jenkins stansfer function plus ARIMA residual models. This linear stochastic differenced time series equation models can adapt themselves to the structure and variety of rainfall, streamflow data on the assumption of the stationary covarience. The fiexibility of Box-Jenkins method consists mainly in the iterative technique of building an AIRMA model from observations and by the use of autocorrelation functions. The best models for Somjin river basin belong to the general calss: $Y_t=($\omega$o-$\omega$_1B) C_iX_t+$\varepsilon$t$ $Y_t$ monthly streamflow, $X_t$ : monthly rainfall, $C_i$ :monthly run-off, $$\omega$o-$\omega$_1$ : transfer parameter, $$\varepsilon$_t$ : residual The streamflow series resulted from the proposed model is satisfactory comparing with the exsting streamflow data of Somjin gauging station site.

  • PDF

Policy for Selective Flushing of Smartphone Buffer Cache using Persistent Memory (영속 메모리를 이용한 스마트폰 버퍼 캐시의 선별적 플러시 정책)

  • Lim, Soojung;Bahn, Hyokyung
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.1
    • /
    • pp.71-76
    • /
    • 2022
  • Buffer cache bridges the performance gap between memory and storage, but its effectiveness is limited due to periodic flush, performed to prevent data loss in smartphones. This paper shows that selective flushing technique with small persistent memory can reduce the flushing overhead of smartphone buffer cache significantly. This is due to our I/O analysis of smartphone applications in that a certain hot data account for most of file writes, while a large proportion of file data incurs single-writes. The proposed selective flushing policy performs flushing to persistent memory for frequently updated data, and storage flushing is performed only for single-write data. This eliminates storage write traffic and also improves the space efficiency of persistent memory. Simulations with popular smartphone application I/O traces show that the proposed policy reduces write traffic to storage by 24.8% on average and up to 37.8%.

A Study on the Spatial Indexing Scheme in Geographic Information System (지리정보시스템에서 공간 색인기법에 관한 연구)

  • 황병연
    • Spatial Information Research
    • /
    • v.6 no.2
    • /
    • pp.125-132
    • /
    • 1998
  • The I/O performance for spatial queries is extremely important since the handling of huge amount of multidimensional data is required in spatial databases for geographic information systems. Therefore, we describe representative spatial access methods handling complex spatial objects, z-transform B tree, KDB tree, R tree, MAX tree, to increase I/O performance. In addition, we measure the performance of spatial indexing schemes by testing against various realistic data and query sets. Results from the benchmark test indicates that MAX outperforms other indexing schemes on insertion, range query, spatial join. MAX tree is expected to use as index scheme organizing storage system of GIS in the future.

  • PDF

Sim-Hadoop : Leveraging Hadoop Distributed File System and Parallel I/O for Reliable and Efficient N-body Simulations (Sim-Hadoop : 신뢰성 있고 효율적인 N-body 시뮬레이션을 위한 Hadoop 분산 파일 시스템과 병렬 I / O)

  • Awan, Ammar Ahmad;Lee, Sungyoung;Chung, Tae Choong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2013.05a
    • /
    • pp.476-477
    • /
    • 2013
  • Gadget-2 is a scientific simulation code has been used for many different types of simulations like, Colliding Galaxies, Cluster Formation and the popular Millennium Simulation. The code is parallelized with Message Passing Interface (MPI) and is written in C language. There is also a Java adaptation of the original code written using MPJ Express called Java Gadget. Java Gadget writes a lot of checkpoint data which may or may not use the HDF-5 file format. Since, HDF-5 is MPI-IO compliant, we can use our MPJ-IO library to perform parallel reading and writing of the checkpoint files and improve I/O performance. Additionally, to add reliability to the code execution, we propose the usage of Hadoop Distributed File System (HDFS) for writing the intermediate (checkpoint files) and final data (output files). The current code writes and reads the input, output and checkpoint files sequentially which can easily become bottleneck for large scale simulations. In this paper, we propose Sim-Hadoop, a framework to leverage HDFS and MPJ-IO for improving the I/O performance of Java Gadget code.

A Study on the Method of Energy Saving in a Marine Cooling System (선박 냉각시스템의 에너지 절감기법에 관한 연구)

  • Oh Jin-Seok;Lim Myoung-Kyu
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.29 no.5
    • /
    • pp.587-592
    • /
    • 2005
  • The ESS(Energy Saving System) is designed to have functions of controlling. monitoring for cooling system. etc. ESS consists of the I/O module, CPU module and Display module I/O module detects various ESS data on local area and treats signals via I/O interface system. The interface system receives various status data and outputs control signals. ESS is tested with dummy signal to verify proposed functions and is shown good results. For future study ESS will be tested under real condition in the ship.

A Global Buffer Manager for a Shared Disk File System in SAN Clusters (SAN 환경에서 공유 디스크 파일 시스템을 위한 전역 버퍼 관리자)

  • 박선영;손덕주;신범주;김학영;김명준
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.10 no.2
    • /
    • pp.134-145
    • /
    • 2004
  • With rapid growth in the amount of data transferred on the Internet, traditional storage systems have reached the limits of their capacity and performance. SAN (Storage Area Network), which connects hosts to disk with the Fibre Channel switches, provides one of the powerful solutions to scale the data storage and servers. In this environment, the maintenance of data consistency among hosts is an important issue because multiple hosts share the files on disks attached to the SAN. To preserve data consistency, each host can execute the disk I/O whenever disk read and write operations are requested. However, frequent disk I/O requests cause the deterioration of the overall performance of a SAN cluster. In this paper, we introduce a SANtopia global buffer manager to improve the performance of a SAN cluster reducing the number of disk I/Os. We describe the design and algorithms of the SANtopia global buffer manager, which provides a buffer cache sharing mechanism among the hosts in the SAN cluster. Micro-benchmark results to measure the performance of block I/O operations show that the global buffer manager achieves speed-up by the factor of 1.8-12.8 compared with the existing method using disk I/O operations. Also, File system micro-benchmark results show that SANtopia file system with the global buffer manager improves performance by the factor of 1.06 in case of directories and 1.14 in case of files compared with the file system without a global buffer manager.

GripLaunch: a Novel Sensor-Based Mobile User Interface with Touch Sensing Housing

  • Chang, Wook;Park, Joon-Ah;Lee, Hyun-Jeong;Cho, Joon-Kee;Soh, Byung-Seok;Shim, Jung-Hyun;Yang, Gyung-Hye;Cho, Sung-Jung
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.6 no.4
    • /
    • pp.304-313
    • /
    • 2006
  • This paper describes a novel way of applying capacitive sensing technology to a mobile user interface. The key idea is to use grip-pattern, which is naturally produced when a user tries to use the mobile device, as a clue to determine an application to be launched. To this end, a capacitive touch sensing system is carefully designed and installed underneath the housing of the mobile device to capture the information of the user's grip-pattern. The captured data is then recognized by dedicated recognition algorithms. The feasibility of the proposed user interface system is thoroughly evaluated with various recognition tests.

Factors Influencing the Continuous Watching and Paid Sponsorship Intentions of YouTube Real-Time Broadcast Viewers: Based on the S-O-R Framework (유튜브 실시간 방송 시청자의 지속시청 및 유료후원 의도에 영향을 미치는 요인: S-O-R 프레임워크를 기반으로)

  • Kwon, Ji Yoon;Yang, Seon Uk;Yang, Sung-Byung
    • Knowledge Management Research
    • /
    • v.23 no.3
    • /
    • pp.285-311
    • /
    • 2022
  • In this study, based on the S-O-R framework, how individual's stimuli (i.e., video characteristics, YouTuber characteristics, real-time broadcasting characteristics of YouTube channel) form organisms (i.e., perceived usefulness, perceived pleasure, social presence), leading to viewers' responses (i.e., continuous watching intention, paid sponsorship intention) on real-time YouTube channels. For this purpose, a research model and hypotheses were constructed, and 369 questionnaire data collected from users of real-time broadcasting channel services on the YouTube platform were analyzed. Result findings confirmed that some video/YouTuber/real-time broadcasting characteristics significantly affect viewers' perceived usefulness/perceived pleasure/social presence, and further influence continuous watching/paid sponsorship intentions. Theoretical and practical implications of the findings are discussed in conclusion.