• Title/Summary/Keyword: 내부 파티션

Search Result 12, Processing Time 0.022 seconds

Performance Optimization Strategies for Fully Utilizing Apache Spark (아파치 스파크 활용 극대화를 위한 성능 최적화 기법)

  • Myung, Rohyoung;Yu, Heonchang;Choi, Sukyong
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.7 no.1
    • /
    • pp.9-18
    • /
    • 2018
  • Enhancing performance of big data analytics in distributed environment has been issued because most of the big data related applications such as machine learning techniques and streaming services generally utilize distributed computing frameworks. Thus, optimizing performance of those applications at Spark has been actively researched. Since optimizing performance of the applications at distributed environment is challenging because it not only needs optimizing the applications themselves but also requires tuning of the distributed system configuration parameters. Although prior researches made a huge effort to improve execution performance, most of them only focused on one of three performance optimization aspect: application design, system tuning, hardware utilization. Thus, they couldn't handle an orchestration of those aspects. In this paper, we deeply analyze and model the application processing procedure of the Spark. Through the analyzed results, we propose performance optimization schemes for each step of the procedure: inner stage and outer stage. We also propose appropriate partitioning mechanism by analyzing relationship between partitioning parallelism and performance of the applications. We applied those three performance optimization schemes to WordCount, Pagerank, and Kmeans which are basic big data analytics and found nearly 50% performance improvement when all of those schemes are applied.

A Survey on the Consumer Preferences for Korean Rice Cake Packaging in the Seoul Metropolitan Area (떡 포장 개선을 위한 국내 수도권 지역 소비자의 기호도 조사)

  • Choi, Woo-Suk;Park, Sang-Kyu;Lee, Youn-Suk
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.41 no.3
    • /
    • pp.418-429
    • /
    • 2012
  • In this study we surveyed the packaging preferences of consumers for Korean rice cakes as current commercial products in Korea. The questionnaire was developed from a preliminary investigation of typical rice cake packaging patterns and sent to 2332 residents in Korea by random sampling mail. The questionnaire contained questions on the preferences of interior design in packaging, opening methods, individually separated types, printing position, packaging methods, and packaging materials such as paper and plastic. There were responses from 304 residents. The collected data was analyzed by an SPSS package program. Most of the packaging used for Korean rice cakes was plastic (58.9%) which was used for packaging materials and stretch wrap (42.9%) as packing methods. The results showed the preference was the perforated line type used by hand for opening a packaging and interior packaging design with 2~3 partitions. Most respondents expressed an interest in using individual packaging and having printing directly on the packaging. Also, the respondents preferred the packaging design that let them see the contents of a package. Based on the results of the questionnaire, this paper suggested that most consumers would prefer to choose a packaging system with a partition design in a plastic container, individually separated products, and a transparent container for Korean rice cakes. The results of packaging preferences could provide important information for suitable packaging development for Korean rice cakes. Further research should be conducted to improve the shelf life of Korean rice cakes with functional packaging systems such as modified atmosphere packaging or anti-microbial packaging.