• Title/Summary/Keyword: Processing map

Search Result 1,459, Processing Time 0.051 seconds

Performance Evaluation of Energy Management Algorithms for MapReduce System (MapReduce 시스템을 위한 에너지 관리 알고리즘의 성능평가)

  • Kim, Min-Ki;Cho, Haengrae
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.9 no.2
    • /
    • pp.109-115
    • /
    • 2014
  • Analyzing large scale data has become an important activity for many organizations. Since MapReduce is a promising tool for processing the massive data sets, there are increasing studies to evaluate the performance of various algorithms related to MapReduce. In this paper, we first develop a simulation framework that includes MapReduce workload model, data center model, and the model of data access pattern. Then we propose two algorithms that can reduce the energy consumption of MapReduce systems. Using the simulation framework, we evaluate the performance of the proposed algorithms under different application characteristics and configurations of data centers.

Selective Encryption Algorithm Using Hybrid Transform for GIS Vector Map

  • Van, Bang Nguyen;Lee, Suk-Hwan;Kwon, Ki-Ryong
    • Journal of Information Processing Systems
    • /
    • v.13 no.1
    • /
    • pp.68-82
    • /
    • 2017
  • Nowadays, geographic information system (GIS) is developed and implemented in many areas. A huge volume of vector map data has been accessed unlawfully by hackers, pirates, or unauthorized users. For this reason, we need the methods that help to protect GIS data for storage, multimedia applications, and transmission. In our paper, a selective encryption method is presented based on vertex randomization and hybrid transform in the GIS vector map. In the proposed algorithm, polylines and polygons are focused as the targets for encryption. Objects are classified in each layer, and all coordinates of the significant objects are encrypted by the key sets generated by using chaotic map before changing them in DWT, DFT domain. Experimental results verify the high efficiency visualization by low complexity, high security performance by random processes.

Reduction of Inter-MAP Handoff Rate Based on 2-Layers in Hierarchical Mobile IPv6 (계층적 모바일 IP 네트워크에서 2 계층에 기반한 Inter-MAP Handoff Rate의 감소기법)

  • Jeong, Jong-Pil;Chung, Min-Young;Choo, Hyun-Seung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2008.05a
    • /
    • pp.999-1002
    • /
    • 2008
  • Many schemes to reduce the inter-MAP handoff delay in hierarchical mobile IPv6 have been proposed but the previous schemes waste relatively large network resources to decrease the path rerouting delay. In this paper, we propose the 2-layered MAP concept, where the seamless inter-MAP handoff can be supported regardless of path rerouting time. As a result, the waste of wired resources and the rate of the inter-MAP handoff can be reduced. From the performance analysis and simulation, the inter-MAP handoff rate for non-real-time traffic is only about 1/3 of the conventional result. Such advantageous features of the proposed scheme neither incur any increase of the total handoff rate nor require additional MAPs.

Implement of MapReduce-based Big Data Processing Scheme for Reducing Big Data Processing Delay Time and Store Data (빅데이터 처리시간 감소와 저장 효율성이 향상을 위한 맵리듀스 기반 빅데이터 처리 기법 구현)

  • Lee, Hyeopgeon;Kim, Young-Woon;Kim, Ki-Young
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.10
    • /
    • pp.13-19
    • /
    • 2018
  • MapReduce, the Hadoop's essential core technology, is most commonly used to process big data based on the Hadoop distributed file system. However, the existing MapReduce-based big data processing techniques have a feature of dividing and storing files in blocks predefined in the Hadoop distributed file system, thus wasting huge infrastructure resources. Therefore, in this paper, we propose an efficient MapReduce-based big data processing scheme. The proposed method enhances the storage efficiency of a big data infrastructure environment by converting and compressing the data to be processed into a data format in advance suitable for processing by MapReduce. In addition, the proposed method solves the problem of the data processing time delay arising from when implementing with focus on the storage efficiency.

Grid-based Index Generation and k-nearest-neighbor Join Query-processing Algorithm using MapReduce (맵리듀스를 이용한 그리드 기반 인덱스 생성 및 k-NN 조인 질의 처리 알고리즘)

  • Jang, Miyoung;Chang, Jae Woo
    • Journal of KIISE
    • /
    • v.42 no.11
    • /
    • pp.1303-1313
    • /
    • 2015
  • MapReduce provides high levels of system scalability and fault tolerance for large-size data processing. A MapReduce-based k-nearest-neighbor(k-NN) join algorithm seeks to produce the k nearest-neighbors of each point of a dataset from another dataset. The algorithm has been considered important in bigdata analysis. However, the existing k-NN join query-processing algorithm suffers from a high index-construction cost that makes it unsuitable for the processing of bigdata. To solve the corresponding problems, we propose a new grid-based, k-NN join query-processing algorithm. Our algorithm retrieves only the neighboring data from a query cell and sends them to each MapReduce task, making it possible to improve the overhead data transmission and computation. Our performance analysis shows that our algorithm outperforms the existing scheme by up to seven-fold in terms of the query-processing time, while also achieving high extent of query-result accuracy.

Implementation and Operation of Network Interface Module based on Mini- MAP Environment (Mini-MAP 환경에서 네트워크 접속장치의 구현과 시험 운영)

  • Lee, Min-Nam;Kim, Jeong-Ho;Lee, Sang-Beom
    • The Transactions of the Korea Information Processing Society
    • /
    • v.1 no.2
    • /
    • pp.263-271
    • /
    • 1994
  • Automation of production in modern manufacturing is based on the integration of the various stage of production process by means of processing system. Information processing and network interface are of fundamental importance in programmable device in industrial automation, as they essential in order to active integration in production lines. In this paper, TBC(token bus controller) in the Mini-MAP board performs the function of the MAC sublayer, The LLC sublayer is implemented according to the specification of Class 3 that includes Type 1 and 3. And the MMS services are designed within the scope of implementation MAP 3.0 All the softwares are implemented under the real time executive for real time application of the Mini-MAP and they are loaded into PROMs at the network board. We tested the LLC functions to make use of a protocol analyzer for the token bus protocol. Also the MMS conformance test was carried out by exchanging primitives between a model system(including NIU) and a MMS product that had already passed the conformance the conformance test based on measurement method of network analysis.

  • PDF

Prediction of Microstructure during Hot-working of AZ31 Mg Alloy (AZ31 Mg 합금의 고온 성형 시 미세조직 예측)

  • Lee, Byoung-Ho;Lee, Chong-Soo
    • Transactions of Materials Processing
    • /
    • v.17 no.2
    • /
    • pp.117-123
    • /
    • 2008
  • In this study, optimum processing condition of rolled AZ31 Mg alloy was investigated by utilizing processing map and constitutive equation considering microstructure evolution(dynamic recrystallization) occurring during hot-working. A series of mechanical tests were conducted at various temperatures and strain rates to construct a processing map and to formulate the recrystallization kinetics in terms of grain size. Dynamic recrystallization(DRX) was observed to occur at a domain of $250^{\circ}C$ and 1/s(maximum dissipation-efficiency region). The effect of DRX kinetics on microstructure evolution was implemented in a commercial FEM code followed by remapping of the state variables. The volume fraction and grain size of deformed part were predicted using a modified FEM code and were compared with those of actual hot forged part. A good agreement was observed between the experimented results and predicted ones.

User-Oriented Digital Maps for Supporting Decision Making (의사결정 지원을 위한 사용자 중심의 수치지도)

  • Lee, Dong-Cheon;Lee, Young-Wook;Park, Ki-Surk
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.27 no.2
    • /
    • pp.235-247
    • /
    • 2009
  • Map is information media for human life. Recently, innovative map making technology has been developed and most updated various data are provided to map users. In consequence, use of maps is rapidly increasing in various applications. One of the examples is car navigation map because navigation maps provide reliable and necessary information with convenient way. Therefore, maps are to be changed to user-oriented from map making-oriented design. The main goal of spatial data infrastructure is to allow various users to access the real world information easily for decision making. However, most of the digital maps are focused on map making aspect such as providing up-to-date data, acquisition of accurate data with state-of-the-art technology, and addition of layers (For example, ortho-images and DEMs). If map data processing tools are to be provided with the digital maps, users could utilize maps for decision making without professional software or knowledge. Therefore, objective of this paper is to propose scheme of the digital map data processing service with application examples.

Hand Gesture Recognition Using Curvature Scale Space Map of Depth Edges (깊이 에지 기반의 Curvature Scale Space Map을 이용한 손 제스처 인식)

  • Yi, Chang-Ju;Yi, June-Ho
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2007.05a
    • /
    • pp.731-734
    • /
    • 2007
  • 본 연구는 구조광 기반의 깊이 에지를 이용하여 조명의 변화와 복잡한 배경에 상관없이 손 제스처의 외곽선 영상을 안정적으로 획득하였고, 제스처 영상을 표현하기 위하여 Curvature Scale Space(CSS) map을 이용하였다. 기존의 CSS map은 외곽선 영상의 깊은 굴곡과 완만한 굴곡을 잘 구분하지 못하는 문제점이 있었으나, 본 연구에서는 이러한 문제점을 분석하고, 이를 개선하기 위해서 각도 좌표를 이용한 CSS map 생성 방법을 제안하였다. 실험을 통해서 제안한 방법이 기존의 CSS map보다 우수한 인식 성능이 있음을 보였다.

  • PDF

A Study on the Automatic Generation of Digital Elevation Map based on Contour Map (등고선 지도를 기반으로 한 수치 지형도 자동생성에 관한 연구)

  • Kim, Hae-Jung;Kim, Joon-Seek
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.2
    • /
    • pp.558-568
    • /
    • 2000
  • In the paper, we propose the automatic generation method of digital elevation map based on contour map. The proposed method classifies contour data and non-contour data by thinning and labelling process of the contour line and then connects smoothly broken contour line by Bezier curve. Finally, the digital devation map is generated by the interpolation using the height data of the contour line. The proposed method can reduce vest effort, time and expense which is spend to make digital elevation map.

  • PDF