• Title/Summary/Keyword: Multi-Cloud Environment

Search Result 118, Processing Time 0.029 seconds

Job-aware Network Scheduling for Hadoop Cluster

  • Liu, Wen;Wang, Zhigang;Shen, Yanming
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.1
    • /
    • pp.237-252
    • /
    • 2017
  • In recent years, data centers have become the core infrastructure to deal with big data processing. For these big data applications, network transmission has become one of the most important factors affecting the performance. In order to improve network utilization and reduce job completion time, in this paper, by real-time monitoring from the application layer, we propose job-aware priority scheduling. Our approach takes the correlations of flows in the same job into account, and flows in the same job are assigned the same priority. Therefore, we expect that flows in the same job finish their transmissions at about the same time, avoiding lagging flows. To achieve load balancing, two approaches (Flow-based and Spray) using ECMP (Equal-Cost multi-path routing) are presented. We implemented our scheme using NS-2 simulator. In our evaluations, we emulate real network environment by setting background traffic, scheduling delay and link failures. The experimental results show that our approach can enhance the Hadoop job execution efficiency of the shuffle stage, significantly reduce the network transmission time of the highest priority job.

A Study on Access Control System with Multi-Authority and Hierarchical Attribute-Based Encryption in Cloud Environment (클라우드 환경에서 다중 인가자와 계층적 속성기반 암호화를 활용한 접근제어 시스템에 대한 연구)

  • Lee, Jin-A;Jung, Jun-Kwon;Jung, Sung-Min;Chung, Tai-Myoung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2013.05a
    • /
    • pp.648-651
    • /
    • 2013
  • 클라우드 시스템에서는 데이터 소유자가 아닌 클라우드 서비스 제공자가 각 개인의 데이터에 대한 저장과 관리를 책임진다. 따라서 클라우드 서버 상의 사용자 데이터에 대한 보안을 보장해 주는 것이 가장 중요한 이슈이다. 데이터 보안 문제는 안전하고 효율적인 접근제어 기술을 통해 해결 할 수 있다. 기존 시스템에서 많이 이용되고 있는 RBAC(Role based access control)은 접근제어의 형태가 주로 수직적이고, 데이터 접근가능 여부를 역할이라는 고정적인 값에 따라 결정하기 때문에 동적인 클라우드 환경에 적합하지 않다. 반면 HASBE(Hierarchical attribute set based encryption) 모델은 ABAC(Attribute based access control)를 통해 유연하고 탄력적인 접근제어를 제공한다. 또한 HASBE 는 인가자(Authority)와 사용자의 관계 모델이 계층적인 구조를 갖고 있기 때문에 큰 조직에서 수많은 사용자들의 데이터 관리와 키 분배를 좀더 효율적으로 할 수 있다. 본 논문에서는 위의 계층적인 모델에서 더 나아가서, 실제 클라우드 환경에서 데이터가 가질 수 있는 복잡한 속성과 인가자의 관계를 고려해 다중 인가자의 개념이 더해진 모델을 제안한다.

Performance Analysis of NVMe SSDs and Design of Direct Access Engine on Virtualized Environment (가상화 환경에서 NVMe SSD 성능 분석 및 직접 접근 엔진 개발)

  • Kim, Sewoog;Choi, Jongmoo
    • KIISE Transactions on Computing Practices
    • /
    • v.24 no.3
    • /
    • pp.129-137
    • /
    • 2018
  • NVMe(Non-Volatile Memory Express) SSD(Solid State Drive) is a high-performance storage that makes use of flash memory as a storage cell, PCIe as an interface and NVMe as a protocol on the interface. It supports multiple I/O queues which makes it feasible to process parallel-I/Os on multi-core environments and to provide higher bandwidth than SATA SSDs. Hence, NVMe SSD is considered as a next generation-storage for data-center and cloud computing system. However, in the virtualization system, the performance of NVMe SSD is not fully utilized due to the bottleneck of the software I/O stack. Especially, when it uses I/O stack of the hypervisor or the host operating system like Xen and KVM, I/O performance degrades seriously due to doubled-I/O stack between host and virtual machine. In this paper, we propose a new I/O engine, called Direct-AIO (Direct-Asynchronous I/O) engine, that can access NVMe SSD directly for I/O performance improvements on QEMU emulator. We develop our proposed I/O engine and analyze I/O performance differences between the existed I/O engine and Direct-AIO engine.

Registration Technique of Partial 3D Point Clouds Acquired from a Multi-view Camera for Indoor Scene Reconstruction (실내환경 복원을 위한 다시점 카메라로 획득된 부분적 3차원 점군의 정합 기법)

  • Kim Sehwan;Woo Woontack
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.42 no.3 s.303
    • /
    • pp.39-52
    • /
    • 2005
  • In this paper, a registration method is presented to register partial 3D point clouds, acquired from a multi-view camera, for 3D reconstruction of an indoor environment. In general, conventional registration methods require a high computational complexity and much time for registration. Moreover, these methods are not robust for 3D point cloud which has comparatively low precision. To overcome these drawbacks, a projection-based registration method is proposed. First, depth images are refined based on temporal property by excluding 3D points with a large variation, and spatial property by filling up holes referring neighboring 3D points. Second, 3D point clouds acquired from two views are projected onto the same image plane, and two-step integer mapping is applied to enable modified KLT (Kanade-Lucas-Tomasi) to find correspondences. Then, fine registration is carried out through minimizing distance errors based on adaptive search range. Finally, we calculate a final color referring colors of corresponding points and reconstruct an indoor environment by applying the above procedure to consecutive scenes. The proposed method not only reduces computational complexity by searching for correspondences on a 2D image plane, but also enables effective registration even for 3D points which have low precision. Furthermore, only a few color and depth images are needed to reconstruct an indoor environment.

The Study on the Design and Optimization of Storage for the Recording of High Speed Astronomical Data (초고속 관측 데이터 수신 및 저장을 위한 기록 시스템 설계 및 성능 최적화 연구)

  • Song, Min-Gyu;Kang, Yong-Woo;Kim, Hyo-Ryoung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.12 no.1
    • /
    • pp.75-84
    • /
    • 2017
  • It becomes more and more more important for the storage that supports high speed recording and stable access from network environment. As one field of basic science which produces massive astronomical data, VLBI(: Very Long Baseline Interferometer) is now demanding more data writing performance and which is directly related to astronomical observation with high resolution and sensitivity. But most of existing storage are cloud model based for the high throughput of general IT, finance, and administrative service, and therefore it not the best choice for recording of big stream data. Therefore, in this study, we design storage system optimized for high performance of I/O and concurrency. To solve this problem, we implement packet read and writing module through the use of libpcap and pf_ring API on the multi core CPU environment, and build a scalable storage based on software RAID(: Redundant Array of Inexpensive Disks) for the efficient process of incoming data from external network.

Design Development for Fashion Cultural Product Using Traditional Patterns by Tessellation

  • Park, Youshin
    • Journal of Fashion Business
    • /
    • v.20 no.6
    • /
    • pp.79-93
    • /
    • 2016
  • Since the development of patterns using tessellation is applied to a wide range of fields such as clothing, architecture, environment, and products, etc. and its expression principle is also found in various fields such as mathematics and science, etc. However, this pattern is mostly used as a math material with little studies on fashion and culture. In addition, it is thought that Korean traditional culture products need more various and modern design development methods and pattern through preliminary investigation which is simple copy of traditional items, simple copy of Korean Alphabet, Chinese character, and folk paintings. Therefore, it will present the method to make more design cases using Tessellation. Tessellation that combines mathematics and art will be the infinite form of designing of designers as well as creative training way to understand the composition principles of old culture and to raise sense of modern design. Tessellation of regular triangle, regular square, and regular hexagon was performed on the patterns which have meaning of wealth and prosperity of Korean traditional patterns. As the concrete method, first, each side of the regular triangle is developed symmetrically with patterns of fish, turtle, and cicadas. Second, rotational movement after symmetry movement about middle point of one side ${\times}$ 1 symmetry movement about middle point ${\times}$ 1 using crane and cloud, of the regular triangle was performed. Third, the regular square was tessellated parallel movement ${\times}$ 2 with "Da(multi)" and dragon pattern as the source image. Fourth, the sitting tiger was tessellated with symmetry movement about middle point ${\times}$ 2 and parallel movement ${\times}$ 1. Fifth, three bat patterns are tessellated by again rotational movement of two sides after rotational movement of one side and rotational movement of the other side. In addition, It developed traditional culture product design of the scarf, umbrella, aprons, neckties.

FUNS - Filaments, the Universal Nursery of Stars. I. Physical Properties of Filaments and Dense Cores in L1478

  • Chung, Eun Jung;Kim, Shinyoung;Soam, Archana;Lee, Chang Won
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.43 no.1
    • /
    • pp.45.1-45.1
    • /
    • 2018
  • Formation of filaments and subsequent dense cores in ISM is one of the essential questions to address in star formation. To investigate this scenario in detail, we recently started a molecular line survey namely 'Filaments, the Universal Nursery of Stars (FUNS)' toward nearby filamentary clouds in Gould Belt using TRAO 14m single dish telescope equipped with a 16 multi-beam array. In the present work, we report the first look results of kinematics of a low mass star forming region L1478 of California molecular cloud. This region is found to be consisting of long filaments with a hub-filament structure. We performed On-The-Fly mapping observations covering ~1.1 square degree area of this region using C18O(1-0) as a low density tracer and 0.13 square degree area using N2H+(1-0) as a high density tracer, respectively. CS (2-1) and SO (32-21) were also used simultaneously to map ~290 square arcminute area of this region. We identified 10 filaments applying Dendrogram technique to C18O data-cube and 13 dense cores using FellWalker and N2H+ data set. Basic physical properties of filaments such as mass, length, width, velocity field, and velocity dispersion are derived. It is found that filaments in L~1478 are velocity coherent and supercritical. Especially the filaments which are highly supercritical are found to have dense cores detected in N2H+. Non-thermal velocity dispersions derived from C18O and N2H+ suggest that most of the dense cores are subsonic or transonic while the surrounding filaments are transonic or supersonic. We concluded that filaments in L~1478 are gravitationally unstable which might collapse to form dense cores and stars. We also suggest that formation mechanism can be different in individual filament depending on its morphology and environment.

  • PDF

EPAR V2.0: AUTOMATED MONITORING AND VISUALIZATION OF POTENTIAL AREAS FOR BUILDING RETROFIT USING THERMAL CAMERAS AND COMPUTATIONAL FLUID DYNAMICS (CFD) MODELS

  • Youngjib Ham;Mani Golparvar-Fard
    • International conference on construction engineering and project management
    • /
    • 2013.01a
    • /
    • pp.279-286
    • /
    • 2013
  • This paper introduces a new method for identification of building energy performance problems. The presented method is based on automated analysis and visualization of deviations between actual and expected energy performance of the building using EPAR (Energy Performance Augmented Reality) models. For generating EPAR models, during building inspections, energy auditors collect a large number of digital and thermal imagery using a consumer-level single thermal camera that has a built-in digital lens. Based on a pipeline of image-based 3D reconstruction algorithms built on GPU and multi-core CPU architecture, 3D geometrical and thermal point cloud models of the building under inspection are automatically generated and integrated. Then, the resulting actual 3D spatio-thermal model and the expected energy performance model simulated using computational fluid dynamics (CFD) analysis are superimposed within an augmented reality environment. Based on the resulting EPAR models which jointly visualize the actual and expected energy performance of the building under inspection, two new algorithms are introduced for quick and reliable identification of potential performance problems: 1) 3D thermal mesh modeling using k-d trees and nearest neighbor searching to automate calculation of temperature deviations; and 2) automated visualization of performance deviations using a metaphor based on traffic light colors. The proposed EPAR v2.0 modeling method is validated on several interior locations of a residential building and an instructional facility. Our empirical observations show that the automated energy performance analysis using EPAR models enables performance deviations to be rapidly and accurately identified. The visualization of performance deviations in 3D enables auditors to easily identify potential building performance problems. Rather than manually analyzing thermal imagery, auditors can focus on other important tasks such as evaluating possible remedial alternatives.

  • PDF

A STUDY FOR THE DETERMINATION OF KOMPSAT I CROSSING TIME OVER KOREA (I): EXAMINATION OF SOLAR AND ATMOSPHERIC VARIABLES (다목적 실용위성 1호의 한반도 통과시각 결정을 위한 연구 (I): 태양 및 대기 변수 조사)

  • 권태영;이성훈;오성남;이동한
    • Journal of Astronomy and Space Sciences
    • /
    • v.14 no.2
    • /
    • pp.330-346
    • /
    • 1997
  • Korea Multi-Purpose Satellite I (KOMPSAT-I, the first multi-purpose Korean satellite) will be launched in the third quarter of 1999, which is operated on the sun-synchronous orbit for cartography, ocean color monitoring, and space environment monitoring. The main mission of Electro-Optical Camera(EOC) which is one of KOMPSAT-I sensors is to provide images for the production of scale maps of Korea. EOC collects panchromatic imagery with the ground sample distance of 6.6m at nadir through visible spectral band of 510~730nm. For determining KOMPSAT-I crossing time over Korea, this study examines the diurnal variation of solar and atmospheric variables that can exert a great influence on the EOC imagery. The results are as follows: 1) After 10:30 a.m. at the winter solstice, solar zenith angle is less than $70^{\circ}$ and expected flux of EOC spectral band over land for clear sky is greater than about $2.4mW/cm^2$. 2) For daytime the distribution of cloud cover (clear sky) shows minimum (maximum) at about 11:00 a.m. Although the occurrence frequency of poor visibility by fog decreases from early morning toward noon, its effect on the distribution of clear sky is negligible. From the above examination it is concluded that determining KOMPSAT-I crossing time over Korea between 10:30 and 11:30 a.m. is adequate.

  • PDF

Efficient QoS Policy Implementation Using DSCP Redefinition: Towards Network Load Balancing (DSCP 재정의를 통한 효율적인 QoS 정책 구현: 네트워크 부하 분산을 위해)

  • Hanwoo Lee;Suhwan Kim;Gunwoo Park
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.3
    • /
    • pp.715-720
    • /
    • 2023
  • The military is driving innovative changes such as AI, cloud computing, and drone operation through the Fourth Industrial Revolution. It is expected that such changes will lead to a rapid increase in the demand for information exchange requirements, reaching all lower-ranking soldiers, as networking based on IoT occurs. The flow of such information must ensure efficient information distribution through various infrastructures such as ground networks, stationary satellites, and low-earth orbit small communication satellites, and the demand for information exchange that is distributed through them must be appropriately dispersed. In this study, we redefined the DSCP, which is closely related to QoS (Quality of Service) in information dissemination, into 11 categories and performed research to map each cluster group identified by cluster analysis to the defense "information exchange requirement list" on a one-to-one basis. The purpose of the research is to ensure efficient information dissemination within a multi-layer integrated network (ground network, stationary satellite network, low-earth orbit small communication satellite network) with limited bandwidth by re-establishing QoS policies that prioritize important information exchange requirements so that they are routed in priority. In this paper, we evaluated how well the information exchange requirement lists classified by cluster analysis were assigned to DSCP through M&S, and confirmed that reclassifying DSCP can lead to more efficient information distribution in a network environment with limited bandwidth.