Design and Implementation of MongoDB-based Unstructured Log Processing System over Cloud Computing Environment (클라우드 환경에서 MongoDB 기반의 비정형 로그 처리 시스템 설계 및 구현)
-
- Journal of Internet Computing and Services
- /
- v.14 no.6
- /
- pp.71-84
- /
- 2013
Log data, which record the multitude of information created when operating computer systems, are utilized in many processes, from carrying out computer system inspection and process optimization to providing customized user optimization. In this paper, we propose a MongoDB-based unstructured log processing system in a cloud environment for processing the massive amount of log data of banks. Most of the log data generated during banking operations come from handling a client's business. Therefore, in order to gather, store, categorize, and analyze the log data generated while processing the client's business, a separate log data processing system needs to be established. However, the realization of flexible storage expansion functions for processing a massive amount of unstructured log data and executing a considerable number of functions to categorize and analyze the stored unstructured log data is difficult in existing computer environments. Thus, in this study, we use cloud computing technology to realize a cloud-based log data processing system for processing unstructured log data that are difficult to process using the existing computing infrastructure's analysis tools and management system. The proposed system uses the IaaS (Infrastructure as a Service) cloud environment to provide a flexible expansion of computing resources and includes the ability to flexibly expand resources such as storage space and memory under conditions such as extended storage or rapid increase in log data. Moreover, to overcome the processing limits of the existing analysis tool when a real-time analysis of the aggregated unstructured log data is required, the proposed system includes a Hadoop-based analysis module for quick and reliable parallel-distributed processing of the massive amount of log data. Furthermore, because the HDFS (Hadoop Distributed File System) stores data by generating copies of the block units of the aggregated log data, the proposed system offers automatic restore functions for the system to continually operate after it recovers from a malfunction. Finally, by establishing a distributed database using the NoSQL-based Mongo DB, the proposed system provides methods of effectively processing unstructured log data. Relational databases such as the MySQL databases have complex schemas that are inappropriate for processing unstructured log data. Further, strict schemas like those of relational databases cannot expand nodes in the case wherein the stored data are distributed to various nodes when the amount of data rapidly increases. NoSQL does not provide the complex computations that relational databases may provide but can easily expand the database through node dispersion when the amount of data increases rapidly; it is a non-relational database with an appropriate structure for processing unstructured data. The data models of the NoSQL are usually classified as Key-Value, column-oriented, and document-oriented types. Of these, the representative document-oriented data model, MongoDB, which has a free schema structure, is used in the proposed system. MongoDB is introduced to the proposed system because it makes it easy to process unstructured log data through a flexible schema structure, facilitates flexible node expansion when the amount of data is rapidly increasing, and provides an Auto-Sharding function that automatically expands storage. The proposed system is composed of a log collector module, a log graph generator module, a MongoDB module, a Hadoop-based analysis module, and a MySQL module. When the log data generated over the entire client business process of each bank are sent to the cloud server, the log collector module collects and classifies data according to the type of log data and distributes it to the MongoDB module and the MySQL module. The log graph generator module generates the results of the log analysis of the MongoDB module, Hadoop-based analysis module, and the MySQL module per analysis time and type of the aggregated log data, and provides them to the user through a web interface. Log data that require a real-time log data analysis are stored in the MySQL module and provided real-time by the log graph generator module. The aggregated log data per unit time are stored in the MongoDB module and plotted in a graph according to the user's various analysis conditions. The aggregated log data in the MongoDB module are parallel-distributed and processed by the Hadoop-based analysis module. A comparative evaluation is carried out against a log data processing system that uses only MySQL for inserting log data and estimating query performance; this evaluation proves the proposed system's superiority. Moreover, an optimal chunk size is confirmed through the log data insert performance evaluation of MongoDB for various chunk sizes.
1. Research Purpose Consumers rely on various clues to evaluate their decision to patronize a retail store, and store brand is one of them (Dodds 1991; Grewal et al. 1998). As consumers find ever increasing variety of contact points connecting them to specific store, the value of experiential shopping as a means of increasing store's brand equity warrants greater attention from scholars of retail management. Retail shopping values are credited for creating not only cognitive experiences like brand knowledge but also emotional experiences such as shopping pleasure and pride (Schmitt 1999). This may be because today's consumers place emphasis on emotional values associated with shopping pleasure, lifestyle brought to life, brand relationship, and store atmosphere more than utilitarian values such as product quality and price. Many previous literature found this to be true (Ahn and Lee 2011; Mathwick et al. 2001). This brings forth important research issues and questions regarding the roles of shopping experiential values and brand equity with regard to consumer's retail patronage choice. However, despite this importance, research on this area remains quite inadequate (Hwang 2010). For this reason, this study aims to verify the relationships among experiential shopping values, retail store brand equity and tries to link that with customer loyalty by surveying large-scale discount store shoppers in Korea and China. 2. Research Contents In order to carry out the research objective, this study conducted comprehensive literature survey on previous literature by discussing major findings and implications with regard to shopping values and retail brand equity and store loyalty. For data collection, researcher employed survey-based research method where data were collected in two major cities of Korea (Seoul) and China (Bejing) and sampling frame was based on patrons of large discount stores in both countries. Specific research questions raised in this study are as follows; RQ1: How do Korean and Chinese consumers differently perceive of shopping values regarding shopping at large-sclae discount stores? RQ2: Are there differences in consumers' emotional consumption propensities? RQ3: Do Korean and Chinese consumers display different perceptions of brand equity towards large-scale discount stores? RQ4: Are there differences in relationships between shopping values and brand equity for Korean and Chinese consumers? For statistical analysis, SPSS17.0, AMOS17.0 and SmartPLS were employed. 3. Research Results The data collected through face-to-face survey conducted in Seoul and Bejing revealed appropriate data validity and reliability as a result of exploratory/confirmatory factor analysis and reliability tests, andh SEM model yielding satisfactory model fitness. The result of the study may be summarized by three main points. First, as a result of testing differences in consumption dispositions, Chinese consumers showed higher scores in aesthetic and symbolic dispositions, whereas Korean consumers scored higher in hedonic disposition. Second, testing on perceptions toward brand equity of large discount stores showed that Korean consumers exhibited more positive perceptions of brand awareness and brand image than Chinese counterparts. Third, the result of exploratory factor analysis on the experiential shopping values revealed different factors for each country. On Korean side, consumer interest value, aesthetic value, and hedonic value were prominent, whereas on Chinese side, hedonic value, aesthetic value, consumer interest value, and service excellence value were found salient. 4. Research Implications While many previous studies on inter-country differences in retailing area mainly focused on cultural dispositions or orientations to explain the differences, this study sets itself apart by specifically targeting individual consumer's shopping values from an experiential viewpoint. The study result provides important theoretical as well as practical implications for large-scale discount store, especially the impotance of fully exploring the linkage between shopping values and brand equity, which has significant influence on loyalty. Therefore, the specific implications deriving from the result shed some important insights upon the consumption values based on shopping experiences and brand equity. The differences found in store shoppers between the two countries may also provide useful insights for Korean and Chinese retailers who plan to expand their operations globally. Related strategic implications derived from this study is the importance of localizing retail strategy which is based on the differences found in experiential shopping values between the two country groups. Especially the finding that Chinese consumers value consumer interest and service excellence, whereas Koreans place importance on hedonic or aesthetic values indicates the need to differentiate the consumer's psychographical profiles when it comes to expanding retail operations globally. Particularly important will be to pursue price-orienated strategy in China in consideration of the high emphasis on consumer interests and service excellence, but to emphasize the symbolic aspects of brand equity in Korea by maximizing the brand equity associated with aesthetic values and hedonic orientations. 5. Recommendations This study focused on generic retail branded discount stores in both countries, thus making it difficult to tease out store-specific strategies based on specific retail brands. Future studies may benefit fro employing actual brand names in survey questionnaire to verify relationship between shopping values and brand-based store strategy. As with other studies of this nature, this study needs to strengthen the result's generalizability by selecting respondents from a wider spectrum of respondents.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70