Design of Client-Server Model For Effective Processing and Utilization of Bigdata (빅데이터의 효과적인 처리 및 활용을 위한 클라이언트-서버 모델 설계)
-
- Journal of Intelligence and Information Systems
- /
- 제22권4호
- /
- pp.109-122
- /
- 2016
Recently, big data analysis has developed into a field of interest to individuals and non-experts as well as companies and professionals. Accordingly, it is utilized for marketing and social problem solving by analyzing the data currently opened or collected directly. In Korea, various companies and individuals are challenging big data analysis, but it is difficult from the initial stage of analysis due to limitation of big data disclosure and collection difficulties. Nowadays, the system improvement for big data activation and big data disclosure services are variously carried out in Korea and abroad, and services for opening public data such as domestic government 3.0 (data.go.kr) are mainly implemented. In addition to the efforts made by the government, services that share data held by corporations or individuals are running, but it is difficult to find useful data because of the lack of shared data. In addition, big data traffic problems can occur because it is necessary to download and examine the entire data in order to grasp the attributes and simple information about the shared data. Therefore, We need for a new system for big data processing and utilization. First, big data pre-analysis technology is needed as a way to solve big data sharing problem. Pre-analysis is a concept proposed in this paper in order to solve the problem of sharing big data, and it means to provide users with the results generated by pre-analyzing the data in advance. Through preliminary analysis, it is possible to improve the usability of big data by providing information that can grasp the properties and characteristics of big data when the data user searches for big data. In addition, by sharing the summary data or sample data generated through the pre-analysis, it is possible to solve the security problem that may occur when the original data is disclosed, thereby enabling the big data sharing between the data provider and the data user. Second, it is necessary to quickly generate appropriate preprocessing results according to the level of disclosure or network status of raw data and to provide the results to users through big data distribution processing using spark. Third, in order to solve the problem of big traffic, the system monitors the traffic of the network in real time. When preprocessing the data requested by the user, preprocessing to a size available in the current network and transmitting it to the user is required so that no big traffic occurs. In this paper, we present various data sizes according to the level of disclosure through pre - analysis. This method is expected to show a low traffic volume when compared with the conventional method of sharing only raw data in a large number of systems. In this paper, we describe how to solve problems that occur when big data is released and used, and to help facilitate sharing and analysis. The client-server model uses SPARK for fast analysis and processing of user requests. Server Agent and a Client Agent, each of which is deployed on the Server and Client side. The Server Agent is a necessary agent for the data provider and performs preliminary analysis of big data to generate Data Descriptor with information of Sample Data, Summary Data, and Raw Data. In addition, it performs fast and efficient big data preprocessing through big data distribution processing and continuously monitors network traffic. The Client Agent is an agent placed on the data user side. It can search the big data through the Data Descriptor which is the result of the pre-analysis and can quickly search the data. The desired data can be requested from the server to download the big data according to the level of disclosure. It separates the Server Agent and the client agent when the data provider publishes the data for data to be used by the user. In particular, we focus on the Big Data Sharing, Distributed Big Data Processing, Big Traffic problem, and construct the detailed module of the client - server model and present the design method of each module. The system designed on the basis of the proposed model, the user who acquires the data analyzes the data in the desired direction or preprocesses the new data. By analyzing the newly processed data through the server agent, the data user changes its role as the data provider. The data provider can also obtain useful statistical information from the Data Descriptor of the data it discloses and become a data user to perform new analysis using the sample data. In this way, raw data is processed and processed big data is utilized by the user, thereby forming a natural shared environment. The role of data provider and data user is not distinguished, and provides an ideal shared service that enables everyone to be a provider and a user. The client-server model solves the problem of sharing big data and provides a free sharing environment to securely big data disclosure and provides an ideal shared service to easily find big data.
Objectives : This study aimed to compare the psychosocial characteristics among patients with functional gastrointestinal disorder (FGID), adults with functional gastrointestinal symptoms, and normal control group and investigate factors related to quality of life (QoL) of FGID patients. Methods : 65 patients diagnosed with FGID were selected. 79 adults were selected as normal control group based on the Rome III diagnostic criteria, and 88 adults who showed functional gastrointestinal symptoms were selected as "FGID positive group". Demographic factors were investigated. Psychosocial factors were evaluated using the Korean-Beck Depression Inventory-II, Korean-Beck Anxiety Inventory, Korean-Childhood Trauma Questionnaire, Multi-dimensional Scale of Perceived Social Support, Connor-Davidson Resilience Scale and WHO Quality of Life Assessment Instrument Brief Form. A one-way ANOVA was used to compare differences among groups. Pearson correlation test was used to analyze correlations between QoL and psychosocial factors in patients with FGID. Results : There were group differences in the education level. Depression (F=29.012, p<0.001), anxiety (F=27.954, p<0.001) and Childhood trauma (F=7.748, p<0.001) were significantly higher in FGID patient group than in both FGID-positive and normal control group. Social support (F=5,123, p<0.001), Resilience (F=9.623, p<0.001) and QoL (F=35.991, p<0.001) were significantly lower in the FGID patient group than in others. QoL of FGID patients showed a positive correlation with resilience (r=0.475, p<0.01), and showed a negative correlation with depression (r=-0.641, p<0.01), anxiety (r=-0.641, p<0.01), and childhood trauma (r=-0.278, p<0.05). Conclusions : FGID patients have distinctive psychosocial factors compared to the both FGID-positive and normal control group. Therefore, the active interventions for psychosocial factors are required in the treatment of patients with FGID.
Aerospace force is a determining factor in a modem war. The combat field is expanding to space. Thus, the legitimacy of establishing aerospace force is no longer an debating issue, but "how should we establish aerospace force" has become an issue to the military. The standard limiting on the military use of space should be non-aggressive use as asserted by the U.S., rather than non-military use as asserted by the former Soviet Union. The former Soviet Union's argument is not even strongly supported by the current Russia government, and realistically is hard to be applied. Thus, the multi-purpose satellite used for military surveillance or a commercial satellite employed for military communication are allowed under the U.S. principle of peaceful use of space. In this regard, Air Force may be free to develop a military surveillance satellite and a communication satellite with civilian research institute. Although MTCR, entered into with the U.S., restricts the development of space-launching vehicle for the export purpose, the development of space-launching vehicle by the Korea Air Force or Korea Aerospace Research Institute is beyond the scope of application of MTCR, and Air Force may just operate a satellite in the orbit for the military purpose. The primary task for multi-purpose satellite is a remote sensing; SAR sensor with high resolution is mainly employed for military use. Therefore, a system that enables Air Force, the Korea Aerospace Research Institute, and Agency for Defense Development to conduct joint-research and development should be instituted. U.S. Air Force has dismantled its own space-launching vehicle step by step, and, instead, has increased using private space launching vehicle. In addition, Military communication has been operated separately from civil communication services or broadcasting services due to the special circumstances unique to the military setting. However, joint-operation of communication facility by the military and civil users is preferred because this reduces financial burden resulting from separate operation of military satellite. During the Gulf War, U.S. armed forces employed commercial satellites for its military communication. Korea's participation in space technology research is a little bit behind in time, considering its economic scale. In terms of budget, Korea is to spend 5 trillion won for 15 years for the space activities. However, Japan has 2 trillion won annul budget for the same activities. Because the development of space industry during initial fostering period does not apply to profit-making business, government supports are inevitable. All space development programs of other foreign countries are entirely supported by each government, and, only recently, private industry started participating in limited area such as a communication satellite and broadcasting satellite, Particularly, Korea's space industry is in an infant stage, which largely demands government supports. Government support should be in the form of investment or financial contribution, rather than in the form of loan or borrowing. Compared to other advanced countries in space industry, Korea needs more budget and professional research staff. Naturally, for the efficient and systemic space development and for the prevention of overlapping and distraction of power, it is necessary to enact space-related statutes, which would provide dear vision for the Korea space development. Furthermore, the fact that a variety of departments are running their own space development program requires a centralized and single space-industry development system. Prior to discussing how to coordinate or integrate space programs between Agency for Defense Development and the Korea Aerospace Research Institute, it is a prerequisite to establish, namely, "Space Operations Center"in the Air Force, which would determine policy and strategy in operating space forces. For the establishment of "Space Operations Center," policy determinations by the Ministry of National Defense and the Joint Chief of Staff are required. Especially, space surveillance system through using a military surveillance satellite and communication satellite, which would lay foundation for independent defense, shall be established with reference to Japan's space force plan. In order to resolve issues related to MTCR, Air Force would use space-launching vehicle of the Korea Aerospace Research Institute. Moreover, defense budge should be appropriated for using multi-purpose satellite and communication satellite. The Ministry of National Defense needs to appropriate 2.5 trillion won budget for space operations, which amounts to Japan's surveillance satellite operating budges.
The eastern coastal area having variability of climate is located within Taebaek mountain range and the east coast of Korea. It is therefore ease to cause the wind damages in paddy field during rice growing season. The wind damages to rice plant in this area were mainly caused by the Fohn wind (dry and hot wind) blowing over the Taebaek mountain range and the cold humid wind from the coast. The dry wind cause such as the white head, broken leaves, cut-leaves, dried leaves, shattering of grain, glume discolouration and lodging, On the other hand the cold humid wind derived from Ootsuku air mass in summer cause such symptom as the poor rice growth, degeneration of rachis brenches and poor ripening. To minimize the wind damages and utilize as a preparatory data for wind injury of rice in future, several experiments such as the selection of wind resistant variety to wind damage, determination of optimum transplanting date, improvement of fertilizer application methods, improvement of soils and effect of wind break net were carried out for 8 years from 1982 to 1989 in the eastern coastal area. The results obtained are summarized as follows. 1. According to available statisical data from Korean meteorological services (1954-1989) it is apperent that cold humid winds frequently cause damage to rice fields from August 10th to September 10th, it is therefore advisable to plan rice cultivation in such a way that the heading date should not be later than August 10th. 2. During the rice production season, two winds cause severe damage to the rice fields in eastern coastal area of Korea. One is the Fohn winds blowing over the Taebaek mountain range and the other is the cold humid wind form the coast. The frequency of occurrence of each wind was 25%. 3. To avoid damage caused by typhoon winds three different varieties of rice were planted at various areas. 4. In the eastern coastal area of Korea, the optimum ripening temperature for rice was about 22.2
These studies were made at Suwon in 1972 and at Suwon, Iri, and Kwangju in 1973 to investigate grain filling process and variation of grain quality of NB 68513 and Caprock as hard red winter wheat, Suke ＃169 as soft red winter wheat variety and Yungkwang as semi-hard winter variety, grown under-three different fertilizer levels and seeding dates. Other experiments were conducted to find the effects of temperature, humidity and light intensity on the grain filling process and grain quality of Yungkwang and NB 68513 wheat varieties. These, experiments were conducted at Suwon in 1973 and 1974. 1. Grain filling process of wheat cultivars: 1) The frequency distribution of a grain weight shows that wider distribution of grain weight was associated with large grain groups rather than small grain group. In the large grain groups, the frequency was mostly concentrated near mean value, while the frequency was dispersed over the values in the small grain group. 2) The grain weight was more affected by the grain thickness and width than by grain length. 3) The grain weight during the ripening period was rapidly increased from 14 days after flowering to 35 days in Yungkwang and from 14 days after flowering to 28 days in NB 68513. The large grain group, Yungkwang was rather slowly increased and took a longer period in increase of endosperm ratio of grain than the small grain group, NB 68513. 4) In general, the 1, 000 grain weight was reduced under high temperature, low humidity, while it was increased under low temperature and high humidity condition, and under high temperature and humidity condition. The effect of shading on grain weight was greater in high temperature than in low temperature condition and no definite tendency was found in high humidity condition. 5) The effects of temperature, humidity and shading on 1, 000 grain weight were greater in large-grain group, Yungkwang than in small grain group, NB 68513. Highly significant positive correlation was found between 1, 000 grain weight and days to ripening. 6) The 1, 000 grain weight and test weight were increased more or less as the fertilizer levels applied were increased. However, the rate of increasing 1, 000 grain weight was low when fertilizer levels were increased from standard to double. The 1, 000 grain weight was high when planted early. Such tendency was greater in Suwon than in Kwangju or Iri area. 2. Milling quality: 7) The milling rate in a same group of varieties was higher under the condition of low temperature, high humidity and early maturing culture which were responsible for increasing 1, 000 grain weight. No definite relations were found along with locations. 8) In the varieties tested, the higher milling rate was found in large grain variety, Yungkwang, and the lowest milling rate was obtained from Suke ＃ 169, the small grain variety. But the small grained hard wheat variety such as Caprock and NB 68513 showed higher milling rate compared with the soft wheat variety, Suke ＃ 169. 9) There were no great differences of ash content due to location, fertilizer level and seeding date while remarkable differences due to variety were found. The ash content was high in the hard wheat varieties such as NB 68513, Caprock and low in soft wheat varieties such as Yungkwang and Suke ＃ 169. 3. Protein content: 10) The protein content was increased under the condition of high temperature, low humidity and shading, which were responsible for reduction of 1, 000 grain weight. The varietal differences of protein content due to high temperature, low humidity and shading conditions were greater in Yungkwang than in NB 68513. 11) The high content of protein in grain within one to two weeks after flowering might be due to the high ratio of pericarp and embryo to endosperm. As grains ripen, the effects of embryo and pericarp on protein content were decreased, reducing protein content. However, the protein content was getting increased from three or four weeks after flowering, and maximized at seven weeks after flowering. The protein content of grain at three to four weeks after flowering increased as the increase of 1, 000 grain weight. But the protein content of matured grain appeared to be affected by daily temperature on calender rather than by duration of ripening period. 12) Highly significant positive correlation value was found between the grain protein content and flour protein content. 13) The protein content was increased under the high level of fertilizers and late seeding. The local differences of protein content were greater in Suwon than in Kwangju and Iri. 14) Protein content in the varieties tested were high in Yungkwang, NB 68513 and Caprock, and low in Suke ＃ 169. However, variation in protein content due to the cultural methods was low in Suke ＃ 169. 15) Protein yield per unit area was increased in accordance with increase of fertilizer levels and early maturing culture. However, nitrogen fertilizer was utilized rather effectively in early maturing culture and Yungkwang was the highest in protein yield per unit area. 4. Physio-chemical properties of wheat flour: 16) Sedimentation value was higher under the conditions of high temperature, low humidity and high levels of fertilizers than under the conditions of low temperature, high moisture and low levels of fertilizers. Such differences of sedimentation values were more apparent in NB 68513 and Caprock than Yungkwang and Suke ＃ 169. The local difference of sedimentation value was greater in Suwon than in Kwangju and Iri. Even though the sedimentation value was highly correlated with protein content of grain, the high humidity was considered one of the factors affecting sedimentation value. 17) Changes of Pelshenke values due to the differences of cultural practices and locations were generally coincident with sedimentation values. 18) The mixing time required for mixogram was four to six minutes in NB 68513, five to seven minutes in Cap rock. The great variation of mixing time for Yungkwang and Suke ＃ 169 due to location and planting conditions was found. The mixing height and area were high in hard wheat than in soft wheat. Variation of protein content due to cultural methods were inconsistent. However, the pattern of mixogram were very much same regardless the treatments applied. With this regard, it could be concluded that the mixogram is a kind of method expressing the specific character of the variety. 19) Even though the milling property of NB 68513 and Caprock was deteriorated under either high temperature and low humidity of high fertilizer levels and late seeding conditions, baking quality was better due to improved physio-chemical properties of flour. In contrast, early maturing culture deteriorated physio-chemical properties, milling property of grain and grain protein yield per unit area was increased. However, it might be concluded that the hard wheat production of NB 68513 and Caprock for baking purpose could be done better in Suwon than in Iri or Kwangju area. 5. Interrelationships between the physio-chemical characters of wheat flour: 20) Physio-chemical properties of flour didn't have direct relationship with milling rate and ash content. Low grain weight produced high protein content and better physio-chemical flour properties. 21) In hard wheat varieties like NB 68513 and Caprock, protein content was significantly correlated with sedimentation value, Pelshenke value and mixing height. However, gluten strength and baking quality were improved by the increased protein content. In Yungkwang and Suk ＃ 169, protein content was correlated with sedimentation value, but no correlations were found with Pelshenke value and mixing height. Consequently, increase of protein content didn't improve the gluten strength in soft wheat. 22) The highly significant relationships between protein content and gluten strength and sedimentation . value, and between Pelshenke value, mixogram and gluten strength indicated that the determination of mixogram and Pelshenke value are useful for de terming soft and hard type of varieties. Determination of sedimentation value is considered useful method for quality evaluation of wheat grain under different cultural practices.