• Title/Summary/Keyword: File Storage

Search Result 453, Processing Time 0.026 seconds

Eliminating Redundant Data for Storage Efficiency on Distributed File Systems (저장 공간의 효율성을 위한 분산 파일 시스템의 중복 데이터 제거 기법)

  • Kim, Jung Hoon;Lim, ByoungHong;Eom, Young Ik
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.11a
    • /
    • pp.111-112
    • /
    • 2009
  • 최근 IT 분야의 키워드 중 하나인 클라우드 컴퓨팅에서, 분산 파일 시스템의 선택은 대용량의 데이터를 관리하기 위해 매우 중요하다. 오픈소스 분산 파일 시스템 중 하나인 HDFS는 데이터의 효율적인 저장과 검색의 장점을 통해 최근 널리 사용되고 있다. HDFS는 데이터를 3단계 중복저장을 통해 신뢰성을 보장한다. 그러나 이러한 중복저장은 데이터 저장의 효율성 저하의 문제점을 갖고 있다. 따라서 본 논문에서는 MD5 해쉬 기술을 적용한 중복 데이터 제거 기법을 제안한다. 본 기법은 시뮬레이션을 통해 저장 공간의 효율성을 향상의 결과를 확인하였다.

Real - Time Applications of Video Compression in the Field of Medical Environments

  • K. Siva Kumar;P. Bindhu Madhavi;K. Janaki
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.11
    • /
    • pp.73-76
    • /
    • 2023
  • We introduce DCNN and DRAE appraoches for compression of medical videos, in order to decrease file size and storage requirements, there is an increasing need for medical video compression nowadays. Using a lossy compression technique, a higher compression ratio can be attained, but information will be lost and possible diagnostic mistakes may follow. The requirement to store medical video in lossless format results from this. The aim of utilizing a lossless compression tool is to maximize compression because the traditional lossless compression technique yields a poor compression ratio. The temporal and spatial redundancy seen in video sequences can be successfully utilized by the proposed DCNN and DRAE encoding. This paper describes the lossless encoding mode and shows how a compression ratio greater than 2 (2:1) can be achieved.

Design of Distributed Cloud System for Managing large-scale Genomic Data

  • Seine Jang;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.119-126
    • /
    • 2024
  • The volume of genomic data is constantly increasing in various modern industries and research fields. This growth presents new challenges and opportunities in terms of the quantity and diversity of genetic data. In this paper, we propose a distributed cloud system for integrating and managing large-scale gene databases. By introducing a distributed data storage and processing system based on the Hadoop Distributed File System (HDFS), various formats and sizes of genomic data can be efficiently integrated. Furthermore, by leveraging Spark on YARN, efficient management of distributed cloud computing tasks and optimal resource allocation are achieved. This establishes a foundation for the rapid processing and analysis of large-scale genomic data. Additionally, by utilizing BigQuery ML, machine learning models are developed to support genetic search and prediction, enabling researchers to more effectively utilize data. It is expected that this will contribute to driving innovative advancements in genetic research and applications.

Changes in the Microflora of Marine Fishes during Storage by Partial Freezing (해산어(海産魚)의 부분동결(部分凍結)에 의한 Microflora의 변화(變化))

  • Park, Chan-Sung;Choi, Kyoung-Ho
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.15 no.1
    • /
    • pp.56-62
    • /
    • 1986
  • Marine fishes, sardine(Sardinops melanosticta), scad kingfish(Caranx equula), horse mackerel(Trachurus japonicus) and file fish(Navodon modestus), were stored for fifty days with partial freezing at$-3.5^{\circ}C$. During the storage, the changes in microflora and volatile nitrogen content was investigated. The fishes exhibited $10^4\;to\;10^6$ of bacterial cells per square centimeter of their skin just before they were submitted to the storage. The bacterial cell number was increased as $10^6\;to\;10^8$ cells as the storage time passed over twenty-two days. Offensive odor which is typical in the spoilage of fishes became strong as increase the bacterial cell numbe. The major isolates among the three hundred strains of bacteria isolated from the fish skins were identified as Pseudomonas I/II, III/IV-H, Vibrio and Moraxella. The same was found in the spoiled fishes, however, Pseudomonas I/II, was predominant on contrast to that of fresh fishes. Pseudomonas III/IV-NH, Flavobacterium, Cytophaga and Micrococcus were also found in early period of storage, but they disappeared as the progress of storage. Nine per cent of isolates were unidentified.

  • PDF

Study on Windows Event Log-Based Corporate Security Audit and Malware Detection (윈도우 이벤트 로그 기반 기업 보안 감사 및 악성코드 행위 탐지 연구)

  • Kang, Serim;Kim, Soram;Park, Myungseo;Kim, Jongsung
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.28 no.3
    • /
    • pp.591-603
    • /
    • 2018
  • Windows Event Log is a format that records system log in Windows operating system and methodically manages information about system operation. An event can be caused by system itself or by user's specific actions, and some event logs can be used for corporate security audits, malware detection and so on. In this paper, we choose actions related to corporate security audit and malware detection (External storage connection, Application install, Shared folder usage, Printer usage, Remote connection/disconnection, File/Registry manipulation, Process creation, DNS query, Windows service, PC startup/shutdown, Log on/off, Power saving mode, Network connection/disconnection, Event log deletion and System time change), which can be detected through event log analysis and classify event IDs that occur in each situation. Also, the existing event log tools only include functions related to the EVTX file parse and it is difficult to track user's behavior when used in a forensic investigation. So we implemented new analysis tool in this study which parses EVTX files and user behaviors.

A Study on Multiple Sensorial Media Application Format (다중 감각 미디어 응용 포맷의 구성 방법 연구)

  • Jung, Yup Oh;Kim, Sang-Kyun
    • Journal of Broadcast Engineering
    • /
    • v.21 no.3
    • /
    • pp.330-340
    • /
    • 2016
  • This paper explains about the structure of multiple sensorial media application format (ISO/IEC 23000-17), which is newly standardized as a project of MPEG-A. This format facilitates effective storage, playing, and management of media with multiple sensorial effects. The ISO base media file format from MPEG-4 Part 12 and sensory effect metadata (SEM) from MPEG-V Part 3 are used to composed the multiple sensorial media application format. In this paper, a fragmentation method to break a SEM XML document into valid SEM samples is presented. Several binarization methods to compress the SEM samples are compared and evaluated as well. The compression ratio and processing time using the MPEG-V binary representation and the Binary MPEG format for XML (BiM) are superior to the gzip compression.

A Methodology for exchanging Business Process Model using XMI (XMI를 활용한 비즈니스 프로세스 모델 호환 방법론)

  • Lim, Tae-Soo
    • The Journal of Society for e-Business Studies
    • /
    • v.11 no.3
    • /
    • pp.73-88
    • /
    • 2006
  • As a computerized application for controlling enterprise processes, BPM(Business Process Management) has been received such concerns that many solution vendors developed their own process definition and storage methods. The fact causes the needs of process modeling standards for process model exchange and at the same time, requires the appropriate methodology for adopting the global standards. In this paper, we propose a transformation methodology of BPMN-based file into XMI(XML Metadata Interchange)-based neutral file format. We devised translation templates for 21 workflow patterns, and compared the results with BPEL4WS(Business Process Execution Language for Web Services) translation. As a result, our XMI transformation model enables more complete translation of process model in comparison with existing model, and thus can be practically utilized to the BPM vendors adopting BPMN standards.

  • PDF

A Car Black Box Video Data Integrity Assurance Scheme Using Cyclic Data Block Chaining (순환형 데이터 블록 체이닝을 이용한 차량용 블랙박스의 영상 데이터 무결성 보장 기법)

  • Yi, Kang;Kim, Kyung-Mi;Cho, Yong Jun
    • Journal of KIISE
    • /
    • v.41 no.11
    • /
    • pp.982-991
    • /
    • 2014
  • The integrity assurance of recorded video by car black boxes are necessary as the car black box is becoming more popular. In this paper, we propose a video data integrity assurance scheme reflecting the features of car black box. The proposed method can detect any kind of deletion, insertion, modification of frames by cyclic chaining using inter block relation. And, it provides the integrity assurance function consistently even in cases of file overwriting because of no more free space in storage, partial file data lost. And non-repudiation is supported. Experimental results with a car black box embedded system with A8 application processor show that our method has a feasible computational overhead to process full HD resolution video at 30 frames per second in a real time.

A Developing MAYA Plug-In for Data Backup Solution (MAYA 데이터 백업저장을 위한 플러그인 개발에 관한 연구)

  • Kim, Hag-Hee;Yun, Han-Kyung
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.1 no.1
    • /
    • pp.13-19
    • /
    • 2008
  • This study considers the development of plug-in, which enables backup save using Maya SDK, API and MEL technologies. It also considers its realization in Maya program and the other various application programs. The various ways of backup save have been found by analyzing the difficulties of file management and storage when using many kinds of plug-in of Maya. An objective has been set as to increase the efficiency of the developer preventing the unintentional modification of the existing and overlapping file by using backup save plug-in. Based on a such objective, this study considers if a backup save is helpful to a graphic developer to use Maya program in more efficient way and if it improves the data maintenance. Currently, it can function as a backup save only within the Maya Program, but such plug-ins to be applied within various application programs are developed for giving more freedom to computer graphic designers.

  • PDF

Optimum Image Compression Rate Maintaining Diagnostic Image Quality of Digital Intraoral Radiographs

  • Song Ju-Seop;Koh Kwang-Joon
    • Imaging Science in Dentistry
    • /
    • v.30 no.4
    • /
    • pp.265-274
    • /
    • 2000
  • Purpose: The aims of the present study are to determine the optimum compression rate in terms of file size reduction and diagnostic quality of the images after compression and evaluate the transmission speed of original or each compressed image. Materials and Methods: The material consisted of 24 extracted human premolars and molars. The occlusal surfaces and proximal surfaces of the teeth had a clinical disease spectrum that ranged from sound to varying degrees of fissure discoloration and cavitation. The images from Digora system were exported in TIFF and the images from conventional intraoral film were scanned and digitalized in TIFF by Nikon SF-200 scanner (Nikon, Japan). And six compression factors were chosen and applied on the basis of the results from a pilot study. The total number of images to be assessed were 336. Three radiologists assessed the occlusal and proximal surfaces of the teeth with 5-rank scale. Finally diagnosed as either sound or carious lesion by one expert oral pathologist. And sensitivity, specificity and k value for diagnostic agreement was calculated. Also the area (Az) values under the ROC curve were calculated and paired t-test and oneway ANOVA test was performed. Thereafter, transmission time of the image files of the each compression level was compared with that of the original image files. Results: No significant difference was found between original and the corresponding images up to 7% (1 : 14) compression ratio for both the occlusal and proximal caries (p<0.05). JPEG3 (1 : 14) image files are transmitted fast more than 10 times, maintained diagnostic information in image, compared with original image files. Conclusion: 1 : 14 compressed image file may be used instead of the original image and reduce storage needs and transmission time.

  • PDF