• Title/Summary/Keyword: Large Scale Data

Search Result 2,773, Processing Time 0.028 seconds

FAST Design for Large-Scale Satellite Image Processing (대용량 위성영상 처리를 위한 FAST 시스템 설계)

  • Lee, Youngrim;Park, Wanyong;Park, Hyunchun;Shin, Daesik
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.25 no.4
    • /
    • pp.372-380
    • /
    • 2022
  • This study proposes a distributed parallel processing system, called the Fast Analysis System for remote sensing daTa(FAST), for large-scale satellite image processing and analysis. FAST is a system that designs jobs in vertices and sequences, and distributes and processes them simultaneously. FAST manages data based on the Hadoop Distributed File System, controls entire jobs based on Apache Spark, and performs tasks in parallel in multiple slave nodes based on a docker container design. FAST enables the high-performance processing of progressively accumulated large-volume satellite images. Because the unit task is performed based on Docker, it is possible to reuse existing source codes for designing and implementing unit tasks. Additionally, the system is robust against software/hardware faults. To prove the capability of the proposed system, we performed an experiment to generate the original satellite images as ortho-images, which is a pre-processing step for all image analyses. In the experiment, when FAST was configured with eight slave nodes, it was found that the processing of a satellite image took less than 30 sec. Through these results, we proved the suitability and practical applicability of the FAST design.

A Study on the Cost Hierarchical System of Nuclaer Power Plant Construction Project for Introcusting Earned Vaule Management System (성과관리시스템(EVMS) 도입을 위한 원전 건설사업비 관리체계 세분화 방안에 관한 연구)

  • Lee, Sang-Hyun;Kim, Woo-Joong
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2019.05a
    • /
    • pp.230-231
    • /
    • 2019
  • The nuclear power plant construction project is large-scale, has various stakeholders and computer system, and is produced and managed a large amount of information. The domestic nuclear power plant construction project has accumulated data based on many years of experience in the system. It has the competitiveness to suggeest alternatives that meet the requirement of the client in the overseas nuclear power plant project. Earned value management, which integrates schedule and cost, is possible to risk management. It was developed the earned value management system considering the the actual data properties and types of the preceding nuclear power plant construction projects. It will be able to increase the nuclaer power plant export competieiveness. Therefore, it was palned to carry out future stuies so that it be able to complement the measure to integrate cost and schedule in consideration of actual data(quantity of activity, etc.).

  • PDF

VotingRank: A Case Study of e-Commerce Recommender Application Using MapReduce

  • Ren, Jian-Ji;Lee, Jae-Kee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.04a
    • /
    • pp.834-837
    • /
    • 2009
  • There is a growing need for ad-hoc analysis of extremely large data sets, especially at e-Commerce companies which depend on recommender application. Nowadays, as the number of e-Commerce web pages grow to a tremendous proportion; vertical recommender services can help customers to find what they need. Recommender application is one of the reasons for e-Commerce success in today's world. Compared with general e-Commerce recommender application, obviously, general e-Commerce recommender application's processing scope is greatly narrowed down. MapReduce is emerging as an important programming model for large-scale data-parallel applications such as web indexing, data mining, and scientific simulation. The objective of this paper is to explore MapReduce framework for the e-Commerce recommender application on major general and dedicated link analysis for e-Commerce recommender application, and thus the responding time has been decreased and the recommender application's accuracy has been improved.

The Effect of Loyalty Factors Perceived by Consumers on General Super Market (대형마트에 대한 소비자들이 지각하는 충성요인이 재방문 결정에 미치는 영향 : 목포권 소비자를 중심으로)

  • Kim, Pan-Jin;Kim, Hwa-Kyung
    • The Journal of Industrial Distribution & Business
    • /
    • v.8 no.4
    • /
    • pp.37-46
    • /
    • 2017
  • Purpose - The purpose of this study is to investigate the factors that cause consumers to frequently visit large - Super Store and goods for large - scale retailers using Super Store. Research design, data, and methodology - The purpose of this study is to present the empirical analysis of 53 adult males and females living in the Mokpo area on the relationship between perceived level of satisfaction and loyalty of the large - scale marts. The results were analyzed. The statistical data of the questionnaire were verified by the SPSS. Results - In the empirical analysis of this study, four variables were found to be the main loyalty factors, which were found to affect the satisfaction of Super Store and the decision to return again. Therefore, in this study, the quality of goods, price, diversity, and image were analyzed as loyalty factors, and it was analyzed as factors influencing satisfaction. It was confirmed that loyalty factors were important. In particular, consumers' perception of behaviors such as local specialties and community service that can be distinctly differentiated from other distribution agencies was very low. Conclusions - It is necessary to construct a comprehensive systematic system to analyze the detailed factors influencing the satisfaction and loyalty of users of Mokpo ticket consumers and to systematically manage and evaluate them. In order to raise awareness of consumer loyalty factors, consumer satisfaction and loyalty survey should be regularly conducted. Consumers should look for ways to improve them and develop improvement plans. The various direct and indirect services provided by Super Store to consumers include price, quality, assortment, customer service, accessibility, and feelings for large marts. However, since the services provided by the Super Store are different from those of the consumers, the loyalty factors for the different factors can be different. Therefore, in order to differentiate them from traditional markets or other distribution centers, it It should be used as a weapon of competition. In this study, it is generally recognized that the services provided by Super Store are very simple and inexpensive, so that consumers are not aware of the difference of particular stores.

Product Recommendation System on VLDB using k-means Clustering and Sequential Pattern Technique (k-means 클러스터링과 순차 패턴 기법을 이용한 VLDB 기반의 상품 추천시스템)

  • Shim, Jang-Sup;Woo, Seon-Mi;Lee, Dong-Ha;Kim, Yong-Sung;Chung, Soon-Key
    • The KIPS Transactions:PartD
    • /
    • v.13D no.7 s.110
    • /
    • pp.1027-1038
    • /
    • 2006
  • There are many technical problems in the recommendation system based on very large database(VLDB). So, it is necessary to study the recommendation system' structure and the data-mining technique suitable for the large scale Internet shopping mail. Thus we design and implement the product recommendation system using k-means clustering algorithm and sequential pattern technique which can be used in large scale Internet shopping mall. This paper processes user information by batch processing, defines the various categories by hierarchical structure, and uses a sequential pattern mining technique for the search engine. For predictive modeling and experiment, we use the real data(user's interest and preference of given category) extracted from log file of the major Internet shopping mall in Korea during 30 days. And we define PRP(Predictive Recommend Precision), PRR(Predictive Recommend Recall), and PF1(Predictive Factor One-measure) for evaluation. In the result of experiments, the best recommendation time and the best learning time of our system are much as O(N) and the values of measures are very excellent.

Implementation of External Memory Expansion Device for Large Image Processing (대규모 영상처리를 위한 외장 메모리 확장장치의 구현)

  • Choi, Yongseok;Lee, Hyejin
    • Journal of Broadcast Engineering
    • /
    • v.23 no.5
    • /
    • pp.606-613
    • /
    • 2018
  • This study is concerned with implementing an external memory expansion device for large-scale image processing. It consists of an external memory adapter card with a PCI(Peripheral Component Interconnect) Express Gen3 x8 interface mounted on a graphics workstation for image processing and an external memory board with external DDR(Dual Data Rate) memory. The connection between the memory adapter card and the external memory board is made through the optical interface. In order to access the external memory, both Programmable I/O and DMA(Direct Memory Access) methods can be used to efficiently transmit and receive image data. We implemented the result of this study using the boards equipped with Altera Stratix V FPGA(Field Programmable Gate Array) and 40G optical transceiver and the test result shows 1.6GB/s bandwidth performance.. It can handle one channel of 4K UHD(Ultra High Density) image. We will continue our study in the future for showing bandwidth of 3GB/s or more.

Full Scale Measurement Data Analysis of Large Container Carrier with Hydroelastic Response, Part II - Fatigue Damage Estimation (대형 컨테이너 선박의 유탄성 실선 계측 데이터 분석 Part II - 피로 손상도 추정)

  • Kim, Byounghoon;Choi, Byungki;Park, Junseok;Park, Sunggun;Ki, Hyeokgeun;Kim, Yooil
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.55 no.1
    • /
    • pp.45-55
    • /
    • 2018
  • Concerns are emerging in marine industry on the additional fatigue damages induced by hydroelasticity, and large container carriers, among others, are considered to be susceptible to this hydroelastic response due to its large size, deck openings and high speed. This study focuses on the fatigue damage estimation of 9,400TEU container carrier based on the full scale measurement data via long-base strain gage installed on the ship. Some correlation analyses have been also done to check whether there was significant torsional response during the voyage. Direct cycle counting method was used to derive stress histogram and the long-term fatigue damage was estimated based upon that analyzed data. It turned out that the fatigue damage of this particular ship during the measurement period increased by more than 60% due to the hydroelastic response of the hull, and main contribution is considered to come from vertical bending mode.

Endwall Heat (Mass) Transfer in a Turbine Cascade Under Combustor-Level High Free-Stream Turbulence (연소기 출구 난류 상태에서의 터빈 익열 끝벽 열(물질)전달 특성)

  • Jun, Sang-Bae;Lee, Sang-Woo;Park, Byung-Kyu
    • Proceedings of the KSME Conference
    • /
    • 2001.06d
    • /
    • pp.759-764
    • /
    • 2001
  • Heat (mass) transfer characteristics have been investigated on the endwall of a large-scale linear turbine cascade passage under a combustor-level high free-stream turbulence with a large length scale. Local heat (mass) transfer coefficients are measured by using the naphthalene sublimation technique. The result shows that local heat (mass) transfer on the endwall is greatly enhanced in the central region of the turbine passage, but there is no noticeable change in the local heat (mass) transfer in the region suffering severe heat load. Under the high free-stream turbulence, the local heat (mass) transfer coefficient shows more uniform distribution and its average value across the whole endwall region is increased by 26% of that at low turbulence condition. The heat (mass) transfer data on the endwall strongly supports that well-organized vortices near the endwall tends to suffer an suppression by the high free-stream turbulence.

  • PDF

Relationship of motor ability evaluation by using MAS and each items of MAS in stroke patient (Stroke 환자에 있어서 MAS(Motor Assessment Scale)를 이용한 운동 능력평가와 각각의 평가 항목과의 상관관계)

  • Kim, Kwang-Soo
    • Journal of Korean Physical Therapy Science
    • /
    • v.4 no.4
    • /
    • pp.519-528
    • /
    • 1997
  • The purpose of this research were to evaluate the overall capacity of activity in hemiplegic patients caused by stroke, to learn the relationship of the overall capacity of activity with 8 out of 9 subtest of the Motor Assessment Scale (MAS) excluding general tonus subtest, and to use in creation of more efficient rehabilitation program by using Motor Assessment Scale (MAS). Twenty-four stroke patients (14 men and 10 women) were the subjects in this study. Their average age was 59.5 and they received average of 17.88 month of therapy. Collected data analysis was completed by using Statistic Analysis System (SAS). The results were as follows: 1) There was no difference in capacity of activity between right hemiplegia and left hemiplegia. 2) There was no difference in capacity of activity compared therapeutic period and age. 3) In comparing the relationship of the each subtest with the overall capacity of activity, upper arm function showed the highest relation (pearson's r = 0.914), and balance sitting (pearson's r= 0.812) and supine to sitting overside of bed (pearson'sr = 0.746) also showed large relationship. 4) Hand movement (pearson's r = -0.45) and advanced hand activity (pearson's r = -0.401) revealed relationship of general tonus with each subtest. 5) Supine to sitting over side of bed (pearson's r = 0.74), balanced sitting(pearson's r = 0.523), and sitting to standing (pearson's r = 0.723) showed large relationship with walking.

  • PDF

A Study on the Quantitative Evaluation Method of Small-Scale Environmental Impact Assessment

  • Dong-Myung CHO;Ju-Yeon LEE;Woo-Taeg KWON
    • Journal of Wellbeing Management and Applied Psychology
    • /
    • v.6 no.2
    • /
    • pp.39-46
    • /
    • 2023
  • Purpose: The small-scale environmental impact assessment system in Korea was introduced and implemented in August 2000, but it has a problem that it cannot guarantee implementation due to the large proportion of qualitative reduction measures for each evaluation item. Therefore, when preparing a small-scale environmental impact assessment, research was conducted on how to improve the existing simple listing-type reduction measures and qualitative evaluation standards to quantitative reduction measures and evaluation standards reflecting regional characteristics. Research design, data and methodology: The small-scale environmental impact assessment system in Korea was introduced and implemented in August 2000, but it has a problem that it cannot guarantee implementation due to the large proportion of qualitative reduction measures for each evaluation item. Therefore, when preparing a small-scale environmental impact assessment, research was conducted on how to improve the existing simple listing-type reduction measures and qualitative evaluation standards to quantitative reduction measures and evaluation standards reflecting regional characteristics. Results: As a result of the analysis of qualitative and quantitative factors, the arithmetic sum of the qualitative factors of the total six projects is 160, accounting for 80% of the total number of reduction measures, and the quantitative factors are 40, accounting for 20%. Among them, the number of qualitative reduction measures reached 97.4% for animal and plant items, and more than 90% for air quality, noise and vibration, and eco-friendly resource circulation items. Conclusions: Therefore, it is necessary to avoid establishing qualitative reduction measures and set quantitative measures as the basis, but to specify the specifications, size, and installation location related to the reduction measures, and to calculate the numerical reduction efficiency.