A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.163-177
- /
- 2019
As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.
This discussion is focused on Donghaeanbyulsingut's 'gutchum-pan to pray'. 'Gutchum-pan to pray' is repeated in almost all of the geori in Byulsingut, so it is a crucial chum-pan that can never be disregarded in understanding Byulsingutchum. Meanwhile, it supposes that Donghaeanbyulsingut is grounded on the activity of producing 'praying (words) and dance (motions)' within its relationship with the structure of capitalistic society along with the context of traditional rituals. The motion that is newly generated as a response to the concrete expression of 'praying' conducted by a mudang (a shaman), that is, the expression coming from the inside associated with the praying is seen as gutchum. This dance is bound to be in competition and interest among shaman groups, and they tend to influence one another. If praying leads to dance, a mudang can gain profits from capital as well as the value of labor. When the mudang succeeds in forming a bigger bond of sympathy with her praying, the object of praying gets more eager to select byulbi and dances a heoteunchum (impromptu dance) more vigorously. This means that a mudang's ability to perform a ritual is associated with the object of praying's consumption. With his impromptu motions, the object of praying comes to go into 'the field of consumption' within the structure of capitalistic competition before he is aware of it. Behind the communication that praying leads to dance, a lot of things are associated with one another organically. 'Gutchum-pan to pray' is generated by the continuous movement of diversity and unity that the time has within the ritual of the mudang and the object of praying. It continues to create the future 'self' that is different from the present 'self', and it means that he expects variability from the present 'self' through 'gutchum-pan to pray'. The mudang also prays for him arranging the variability of the other (the object of praying) inside her labor. In a big picture, of course, the mudang expects the variability of herself, too, which is connected to the value of her labor. The variability that they expect forms a crucial axis that determines where the flow of time and space that the 'gutchum-pan to pray' has is directed to. The contents of praying are directly related with the villagers' lives, and what leads to dance is mostly related with their jobs. This implies that what the mudang experiences in her everyday consuming activity is directly associated with the villagers' activity for earning money. In other words, the contents of that praying change constantly according to the flow of capitalistic economy. Also, those striving to respond to it before anyone else also expect better life for them by substituting their self to the 'gutchum-pan to pray' eagerly. If so, who are the ones that generate 'gutchum-pan to pray'? This can be understood through relationship among mudangs, relationship between the mudang and villagers, and also relationship among villagers. Their relationships can never be free from the concepts like labor in capitalistic society, consumption and expenditure, or time; therefore, they come to compete with the other, the present self, or the better self within the diverse relationships. This gets to be expressed in any ways, words or motions. And the range that covers the creation of either group or individual 'gutchum-pan to pray' in the village is the village community. Outside the range, it is upsized to the competition of the village unit, so individual praying may become diminished more easily. Although mudangs pray in each geori, it does not mean all praying leads to dance. Within various relationships between mudangs and villagers, 'gutchum-pan to pray' comes to be generated, repeated, and extinct. As it is mitigated to more positive competition, it does not lead to gutchum any longer. In other words, repeating 'gutchum-pan to pray' previously created has turned the object of praying into the state different from the former. Also, the two groups both have experienced the last step of Byulsingut, and at that point, praying does no longer lead to dance. In other words, from the position of the shaman group, it is the finish of their labor time and ritual performance, and from the perspective of the villagers, it means the finish of consuming activity and participation in a ritual. The characteristics of 'gutchum-pan to pray' can be summarized as follows. First, it goes through the following process: competition in the village group → competition in the group → competition among individuals. Second, repeated praying does not lead to 'gutchum'. Third, in the cases of praying for each of the occupation groups, the mudang can induce a bond of sympathy from the objects of praying directly, and this lead to dance. Fourth, the group that fails in being included in the category of praying gets to be alienated from 'gutchum-pan to pray' repeatedly.
Attempts to search infection period, infection speed in the tissue of neck blast of rice plant, location of inoculum source and effects of several conditions about the leaf sheath of rice plants for neck blast incidence have been made. 1. The most infectious period for neck blast incidence was the booting stage just before heading date, and most of necks have been infected during the booting stage and on heading date. But
Purpose Precocious Puberty is defined as the development of secondary sexual characteristics in girls younger than 8 years, and boys 9 years. Cause premature closure of the epiphysis is a disease that eventually decreases the final adult height. In this study, we retrospectively analyzed to evaluate the diagnostic difference the GnRH (Gonado-tropin-releasing Hormone) stimulation test results with medical records of precocious puberty in girls. Materials and Methods From February 2015 to December 2015 it was enrolled in the girls 118 people who visited the Seoul National University Bundang Hospital, Pediatrics, Endocrinology Internal Medicine. True precocious puberty group (n=57), early puberty group (n=39), were divided into Premature thelarche (n=22) group. A Tanner stage, chronological age, bone age, height, body weight for each group was determined by examining the mean
For regulating the depth of midwater trawl nets towed at the optimum constant speed, the changes in the shape of warps caused by adding a weight on an arbitrary point of the warp of catenary shape is studied. The shape of a warp may be approximated by a catenary. The resultant inferences under this assumption were experimented. Accordingly feasibilities for the application of the result of this study to the midwater trawl nets were also discussed. A series of experiments for basic midwater trawl gear models in water tank and a couple of experiments of a commercial scale gears at sea which involve the properly designed depth control devices having a variable attitude horizontal wing were carried out. The results are summarized as follows: 1. According to the dimension analysis the depth y of a midwater trawl net is introduced by
After withdrawal of military troops of Chinese Tang dynasty in the 18th year of King Moon-moo's reign(678), the Silla Kingdom had actually unified the Korean peninsula and had divided the territory into 9 states benchmarking the China's local administrations adjustment system. He had established local administrative units by deploying secondary capitals, counties and prefectures in the nine states. The so-called "9 Provinces and 5 Secondary capitals" are what constitutes the local administrations system. The provinces can be compared to current provinces of the Republic of Korea(hereinafter Korea), and secondary capitals to megalopolises. According to a chapter of the Samkuksaki(三?史記) which had recorded the achievements of king Kyoungdeok in December in his 16th year on the throne(757), the local administrative units had amounted to 5 secondary capitals, 117 counties and 293 prefectures. There are still lots of ambiguous points since there have never been any consultation on locations of provinces and secondary capitals' castles, and on structures of cities because the researches for local cities inside the 9 Provinces and 5 Secondary capitals in the Unified Silla Kingdom has been conducted centering on the historic literatures only. The research for restoring structures of cities seen from an archeological perspective are limited to the studies of Taewoo Park("A study on the local cities in the Unified Kingdom Age" 1987) and that of the author("A study on the restoration of planned cities for the Unified Silla Kingdom in terms of the structures and realities of the castles in the 9 Provinces and 5 Secondary capitals" 2009). The Gangneung city of Gangwon province was originally called Haseoryang(河西良) of the Gogureo Kingdom as an ancient nation of Ye(濊). According to "Samkuksaki", it had evolved from Haseoju(河西州) to a secondary capitals in the 8th year of King Seonduk(639). Afterwards, it had been renamed as Myeongju(溟洲) in the 16th year of King Kyoungduk(757), and then several other names were given to it after Goryo dynasty. Taewoo Park claims that it is being defined as a sanctuary remaining in Myoungjudong because of the vestige of bare castle, and this cannot be ascertained due to the on-going urbanization processes. Also, the Kwandong university authority is suggesting an opinion of regarding Myeongju mountain castle located 3 Kms southwest of the center of Gangwon city as commanding post for the pertinent state. The author has restored the pertinent area into a city composed of villages within a lattice framework like Silla Keumkyoung and many other cities. The structure is depicted next. The downtown of Gangneung is situated on a flat terrain at the west bank of Namdaecheon stream flowing southwest to northeast along the inner area of the city. Though there isn't any hill comparatively higher than others in the vicinity, hills are continuously linked east to west along the northern area of the downtown, and the maximum width of flat terrain is about 1 Km and is not so large. Currently, urbanization is being proceeded into the inner portion of Gangneung city, the lands in all directions from the hub of Gangneung station have been readjusted, and thus previous land-zoning program is almost nullified. However, referring to the topographic chart drawn at the time of Japanese colonial rule, it can be validated that land-zoning program to accord the lattice framework with the length of its one side equaling to 190m leaves its vestige about 0.8Km northwest to southeast and about 1.7Km northeast to southwest of the vicinity of Okcheondong, Imdangdong, Geumhakdong, Myeongjudong, and etcetera which comprize the hub of the downtown. The land-zoning vestige within the lattice framework, compared to other cases related with the '9 states and 5 secondary capitals', is very much likely to be that of the Unified Silla Kingdom. That the length of a side of a lattice framework is 190m as opposed to that of Silla Geumkyoung and other cities with their 140m or 160m long sides is a single survey item in the future. The baseline direction for zoning the lands is tilting approximately 37.5 degrees west of northwest to southeast axis in accordance with the topographic features. It seems that this phenomenon takes place because of the direction of Namdaecheon and the geographic constraints of the hills in the north. Reviewing minimally, a rectangular size of zoned land by 4 Pangs(坊) on the northwest to southeast side multiplied by 7 Pangs(坊) on the northeast to southwest side had been restored within a lattice framework. Otherwise, considering the extent of expansion of the existing zoned lands in the lattice framework and one more Pang(坊) being added to each side, it is likely that the size could have been with 5 Pangs(坊) on the northwest to southeast side multiplied by 8 Pangs(坊) on the northeast to southwest side(950 M on the northwest to southeast side multiplied by 1,520m on the northeast to southwest side). The overall shape is rectangle, but land-zoning programs reminiscent of rebuilt roads(red phoenix road) like Jang-an castle(長安城) of Chinese Tang dynasty or Pyoungseong castle(平城城) in Japan is not to be validated. There are some historic items among the roof tiles and earthen wares excavated at local administrative office sites or Gangneung's town castle in Joseon dynasty inside the area assumed to be containing municipal vestiges even though archeological survey for the vestige of Myeongju has not been made yet, and these items deserve dating back to the Unified Silla Kingdom age. Also, all of the construction sites at local administrative authorities of the Joseon dynasty are showing large degrees of slant in the azimuth. This is a circumstantial evidence indicating the fact that the inherited land-zoning programs to be seen in Gangneung in terms of the lattice framework had ever existed in the past. Also, the author does not decline that Myeongju mountain castle had once been the commanding post when reviewing the roof tiles at the edge of eaves in this stronghold. The ancient municipal castles in the Korean peninsula are composed of castles on the flat terrain as well as hilly areas and the cluster of strongholds like Myounghwal, Namhan, Seohyoung mountain castles built around municipal castle of Geumkyoung based on a lattice framework program. Considering that mountain castles are spread in the vicinity of municipal vestiges in other cities other than the 9 states and 5 secondary capitals, it is estimated that Myeongju was assuming the function of commanding post incorporating cities on the flat terrain and castles on the hills.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70