Development of a complex failure prediction system using Hierarchical Attention Network (Hierarchical Attention Network를 이용한 복합 장애 발생 예측 시스템 개발)
-
- Journal of Intelligence and Information Systems
- /
- v.26 no.4
- /
- pp.127-148
- /
- 2020
The data center is a physical environment facility for accommodating computer systems and related components, and is an essential foundation technology for next-generation core industries such as big data, smart factories, wearables, and smart homes. In particular, with the growth of cloud computing, the proportional expansion of the data center infrastructure is inevitable. Monitoring the health of these data center facilities is a way to maintain and manage the system and prevent failure. If a failure occurs in some elements of the facility, it may affect not only the relevant equipment but also other connected equipment, and may cause enormous damage. In particular, IT facilities are irregular due to interdependence and it is difficult to know the cause. In the previous study predicting failure in data center, failure was predicted by looking at a single server as a single state without assuming that the devices were mixed. Therefore, in this study, data center failures were classified into failures occurring inside the server (Outage A) and failures occurring outside the server (Outage B), and focused on analyzing complex failures occurring within the server. Server external failures include power, cooling, user errors, etc. Since such failures can be prevented in the early stages of data center facility construction, various solutions are being developed. On the other hand, the cause of the failure occurring in the server is difficult to determine, and adequate prevention has not yet been achieved. In particular, this is the reason why server failures do not occur singularly, cause other server failures, or receive something that causes failures from other servers. In other words, while the existing studies assumed that it was a single server that did not affect the servers and analyzed the failure, in this study, the failure occurred on the assumption that it had an effect between servers. In order to define the complex failure situation in the data center, failure history data for each equipment existing in the data center was used. There are four major failures considered in this study: Network Node Down, Server Down, Windows Activation Services Down, and Database Management System Service Down. The failures that occur for each device are sorted in chronological order, and when a failure occurs in a specific equipment, if a failure occurs in a specific equipment within 5 minutes from the time of occurrence, it is defined that the failure occurs simultaneously. After configuring the sequence for the devices that have failed at the same time, 5 devices that frequently occur simultaneously within the configured sequence were selected, and the case where the selected devices failed at the same time was confirmed through visualization. Since the server resource information collected for failure analysis is in units of time series and has flow, we used Long Short-term Memory (LSTM), a deep learning algorithm that can predict the next state through the previous state. In addition, unlike a single server, the Hierarchical Attention Network deep learning model structure was used in consideration of the fact that the level of multiple failures for each server is different. This algorithm is a method of increasing the prediction accuracy by giving weight to the server as the impact on the failure increases. The study began with defining the type of failure and selecting the analysis target. In the first experiment, the same collected data was assumed as a single server state and a multiple server state, and compared and analyzed. The second experiment improved the prediction accuracy in the case of a complex server by optimizing each server threshold. In the first experiment, which assumed each of a single server and multiple servers, in the case of a single server, it was predicted that three of the five servers did not have a failure even though the actual failure occurred. However, assuming multiple servers, all five servers were predicted to have failed. As a result of the experiment, the hypothesis that there is an effect between servers is proven. As a result of this study, it was confirmed that the prediction performance was superior when the multiple servers were assumed than when the single server was assumed. In particular, applying the Hierarchical Attention Network algorithm, assuming that the effects of each server will be different, played a role in improving the analysis effect. In addition, by applying a different threshold for each server, the prediction accuracy could be improved. This study showed that failures that are difficult to determine the cause can be predicted through historical data, and a model that can predict failures occurring in servers in data centers is presented. It is expected that the occurrence of disability can be prevented in advance using the results of this study.
To train the manpower to meet the requirements of the industrial field, the introduction of the National Qualification Frameworks(hereinafter referred to as NQF) was determined in 2001 by National Competency Standards(hereinafter referred to as NCS) centrally of the Office for Government Policy Coordination. Also, for landscape architecture in the construction field, the "NCS -Landscape Architecture" pilot was developed in 2008 to be test operated for 3 years starting in 2009. Especially, as the 'realization of a competence-based society, not by educational background' was adopted as one of the major government projects in the Park Geun-Hye government(inaugurated in 2013) the NCS system was constructed on a nationwide scale as a detailed method for practicing this. However, in the case of the NCS developed by the nation, the ideal job performing abilities are specified, therefore there are weaknesses of not being able to reflect the actual operational problem differences in the student level between universities, problems of securing equipment and professors, and problems in the number of current curricula. For soft landing to practical curriculum, the process of clearly analyzing the gap between the current curriculum and the NCS must be preceded. Gap analysis is the initial stage methodology to reorganize the existing curriculum into NCS based curriculum, and based on the ability unit elements and performance standards for each NCS ability unit, the discrepancy between the existing curriculum within the department or the level of coincidence used a Likert scale of 1 to 5 to fill in and analyze. Thus, the universities wishing to operate NCS in the future measuring the level of coincidence and the gap between the current university curriculum and NCS can secure the basic tool to verify the applicability of NCS and the effectiveness of further development and operation. The advantages of reorganizing the curriculum through gap analysis are, first, that the government financial support project can be connected to provide quantitative index of the NCS adoption rate for each qualitative department, and, second, an objective standard is provided on the insufficiency or sufficiency when reorganizing to NCS based curriculum. In other words, when introducing in the subdivisions of the relevant NCS, the insufficient ability units and the ability unit elements can be extracted, and the supplementary matters for each ability unit element per existing subject can be extracted at the same time. There is an advantage providing directions for detailed class program and basic subject opening. The Ministry of Education and the Ministry of Employment and Labor must gather people from the industry to actively develop and supply the NCS standard a practical level to systematically reflect the requirements of the industrial field the educational training and qualification, and the universities wishing to apply NCS must reorganize the curriculum connecting work and qualification based on NCS. To enable this, the universities must consider the relevant industrial prospect and the relation between the faculty resources within the university and the local industry to clearly select the NCS subdivision to be applied. Afterwards, gap analysis must be used for the NCS based curriculum reorganization to establish the direction of the reorganization more objectively and rationally in order to participate in the process evaluation type qualification system efficiently.
After withdrawal of military troops of Chinese Tang dynasty in the 18th year of King Moon-moo's reign(678), the Silla Kingdom had actually unified the Korean peninsula and had divided the territory into 9 states benchmarking the China's local administrations adjustment system. He had established local administrative units by deploying secondary capitals, counties and prefectures in the nine states. The so-called "9 Provinces and 5 Secondary capitals" are what constitutes the local administrations system. The provinces can be compared to current provinces of the Republic of Korea(hereinafter Korea), and secondary capitals to megalopolises. According to a chapter of the Samkuksaki(三?史記) which had recorded the achievements of king Kyoungdeok in December in his 16th year on the throne(757), the local administrative units had amounted to 5 secondary capitals, 117 counties and 293 prefectures. There are still lots of ambiguous points since there have never been any consultation on locations of provinces and secondary capitals' castles, and on structures of cities because the researches for local cities inside the 9 Provinces and 5 Secondary capitals in the Unified Silla Kingdom has been conducted centering on the historic literatures only. The research for restoring structures of cities seen from an archeological perspective are limited to the studies of Taewoo Park("A study on the local cities in the Unified Kingdom Age" 1987) and that of the author("A study on the restoration of planned cities for the Unified Silla Kingdom in terms of the structures and realities of the castles in the 9 Provinces and 5 Secondary capitals" 2009). The Gangneung city of Gangwon province was originally called Haseoryang(河西良) of the Gogureo Kingdom as an ancient nation of Ye(濊). According to "Samkuksaki", it had evolved from Haseoju(河西州) to a secondary capitals in the 8th year of King Seonduk(639). Afterwards, it had been renamed as Myeongju(溟洲) in the 16th year of King Kyoungduk(757), and then several other names were given to it after Goryo dynasty. Taewoo Park claims that it is being defined as a sanctuary remaining in Myoungjudong because of the vestige of bare castle, and this cannot be ascertained due to the on-going urbanization processes. Also, the Kwandong university authority is suggesting an opinion of regarding Myeongju mountain castle located 3 Kms southwest of the center of Gangwon city as commanding post for the pertinent state. The author has restored the pertinent area into a city composed of villages within a lattice framework like Silla Keumkyoung and many other cities. The structure is depicted next. The downtown of Gangneung is situated on a flat terrain at the west bank of Namdaecheon stream flowing southwest to northeast along the inner area of the city. Though there isn't any hill comparatively higher than others in the vicinity, hills are continuously linked east to west along the northern area of the downtown, and the maximum width of flat terrain is about 1 Km and is not so large. Currently, urbanization is being proceeded into the inner portion of Gangneung city, the lands in all directions from the hub of Gangneung station have been readjusted, and thus previous land-zoning program is almost nullified. However, referring to the topographic chart drawn at the time of Japanese colonial rule, it can be validated that land-zoning program to accord the lattice framework with the length of its one side equaling to 190m leaves its vestige about 0.8Km northwest to southeast and about 1.7Km northeast to southwest of the vicinity of Okcheondong, Imdangdong, Geumhakdong, Myeongjudong, and etcetera which comprize the hub of the downtown. The land-zoning vestige within the lattice framework, compared to other cases related with the '9 states and 5 secondary capitals', is very much likely to be that of the Unified Silla Kingdom. That the length of a side of a lattice framework is 190m as opposed to that of Silla Geumkyoung and other cities with their 140m or 160m long sides is a single survey item in the future. The baseline direction for zoning the lands is tilting approximately 37.5 degrees west of northwest to southeast axis in accordance with the topographic features. It seems that this phenomenon takes place because of the direction of Namdaecheon and the geographic constraints of the hills in the north. Reviewing minimally, a rectangular size of zoned land by 4 Pangs(坊) on the northwest to southeast side multiplied by 7 Pangs(坊) on the northeast to southwest side had been restored within a lattice framework. Otherwise, considering the extent of expansion of the existing zoned lands in the lattice framework and one more Pang(坊) being added to each side, it is likely that the size could have been with 5 Pangs(坊) on the northwest to southeast side multiplied by 8 Pangs(坊) on the northeast to southwest side(950 M on the northwest to southeast side multiplied by 1,520m on the northeast to southwest side). The overall shape is rectangle, but land-zoning programs reminiscent of rebuilt roads(red phoenix road) like Jang-an castle(長安城) of Chinese Tang dynasty or Pyoungseong castle(平城城) in Japan is not to be validated. There are some historic items among the roof tiles and earthen wares excavated at local administrative office sites or Gangneung's town castle in Joseon dynasty inside the area assumed to be containing municipal vestiges even though archeological survey for the vestige of Myeongju has not been made yet, and these items deserve dating back to the Unified Silla Kingdom age. Also, all of the construction sites at local administrative authorities of the Joseon dynasty are showing large degrees of slant in the azimuth. This is a circumstantial evidence indicating the fact that the inherited land-zoning programs to be seen in Gangneung in terms of the lattice framework had ever existed in the past. Also, the author does not decline that Myeongju mountain castle had once been the commanding post when reviewing the roof tiles at the edge of eaves in this stronghold. The ancient municipal castles in the Korean peninsula are composed of castles on the flat terrain as well as hilly areas and the cluster of strongholds like Myounghwal, Namhan, Seohyoung mountain castles built around municipal castle of Geumkyoung based on a lattice framework program. Considering that mountain castles are spread in the vicinity of municipal vestiges in other cities other than the 9 states and 5 secondary capitals, it is estimated that Myeongju was assuming the function of commanding post incorporating cities on the flat terrain and castles on the hills.