A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.163-177
- /
- 2019
As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.
The view of life and death in Daesoonjinrihoe includes all the gods of Heaven and Earth, and the human heart is taken as the foundational key. Practitioners can realize their value according to how much they have cultivated themselves. This is regarded as the mythical use of a singularly focused mind (full dedication of one's heart). In other words, it focuses on the potentiality of humans who are able to enter a transcendental area of divinity through their self-cultivation. This view of life and death in Daesoonjinrihoe was established by the religious mission known as "Samgye Gongsa (the Reordering of Three Realms of Heaven, Earth, and Humanity)." Samgye Gongsa indicated a new opening of the Three Realms of Heaven, Earth, and Humanity. This new opening is a return to the original principle of Heavenly operation and also a new order for the universe. Heaven and Earth have their own underlying principle by which they operate. This act was directly initiated and manifested from Dao. Daesoonjinrihoe diagnoses that the underlying principle by which Heaven operates was damaged by human misconduct, and as a result, the human observance of that principle fell out of common usage. Therefore, Daesoonjinrihoe gives priority to the reestablishment of Dao as it existed originally and tries to bring about reconciliation between Heaven and Earth and Humanity. In short, it resolves the grievances accrued since time immemorial by correcting the order of Sindo (Divine Law). Furthermore, it shows that the Dao of Sangsaeng (mutual beneficence) was created by reordering the arrangement of Heaven and Earth so that human beings and divine beings could reach a state of perfection through self-realization. Humans not only communicate with Heaven and Earth, but also communicate with divine beings. Divine beings are transcendent living beings capable of communicating with humans through their heart-minds. In Daesoon thought, human beings are not swayed by the power of divine beings, but instead are able to control divine beings through the transcendent power of their heart-minds. Given this view, the aim of Daesoonjinrihoe lies in participating in the harmony of Heaven and Earth through the cultivation of the human heart. Also, it sees that the human heart-mind can be united with the universal Dao, and thus it is able to be united with the deities of Heaven and Earth. In order to actualize this, one does not rely on exterior rituals or magic but has to focus instead on cultivating the moral ethics of the heart-mind to reach perfection. In other words, one can reach a transcendent level in one's heart-mind through the cultivation of a singularly focused mind and be free from the contradiction of life and death and other such torments. Life and death is an inevitable process for humans. So they do not have to be happy for life and sad for death. They can rather be free from the fear of death by fulfilling the energetic zenith of the human heart-mind via training themselves to transcend their physical bodies. No aging and no death is not a pursuit of radical longevity or immortality for the physical body, but rather a pursuit of the essence of life and the realization of eternity on a spiritual level. Daesoonjinrihoe pursues the state of being unified with Dao by developing "Jeong·Gi·Sin (精·氣·神 the internal energies of essence, pneuma, and spirit)" and trying to reach the transcendent state of non-aging and radical longevity by spurring the practice of self-realization and the discovery one's own innate nature. Through the practice of human ethics, they can access the creative functions of Heaven and Earth and become one with Heavenly Dao thereby achieving harmony between temporal existence and eternity. In this way, humans transcend the life and death of their physical bodies. When "Doins (trainees of Dao)" reach the true state of unification with Dao through singularly focused cultivation, they not only realize self perfection as human beings, but also enable themselves the means to do away with all disasters and forms of suffering. They thereby attain ultimate happiness in their lives.
A comparison study for understanding a stratigraphic response to tectonic evolution of sedimentary basins in the Yellow Sea and adjacent areas was carried out by using an integrated stratigraphic technology. As an interim result, we propose a stratigraphic framework that allows temporal and spatial correlation of the sedimentary successions in the basins. This stratigraphic framework will use as a new stratigraphic paradigm for hydrocarbon exploration in the Yellow Sea and adjacent areas. Integrated stratigraphic analysis in conjunction with sequence-keyed biostratigraphy allows us to define nine stratigraphic units in the basins: Cambro-Ordovician, Carboniferous-Triassic, early to middle Jurassic, late Jurassic-early Cretaceous, late Cretaceous, Paleocene-Eocene, Oligocene, early Miocene, and middle Miocene-Pliocene. They are tectono-stratigraphic units that provide time-sliced information on basin-forming tectonics, sedimentation, and basin-modifying tectonics of sedimentary basins in the Yellow Sea and adjacent area. In the Paleozoic, the South Yellow Sea basin was initiated as a marginal sag basin in the northern margin of the South China Block. Siliciclastic and carbonate sediments were deposited in the basin, showing cyclic fashions due to relative sea-level fluctuations. During the Devonian, however, the basin was once uplifted and deformed due to the Caledonian Orogeny, which resulted in an unconformity between the Cambro-Ordovician and the Carboniferous-Triassic units. The second orogenic event, Indosinian Orogeny, occurred in the late Permian-late Triassic, when the North China block began to collide with the South China block. Collision of the North and South China blocks produced the Qinling-Dabie-Sulu-Imjin foldbelts and led to the uplift and deformation of the Paleozoic strata. Subsequent rapid subsidence of the foreland parallel to the foldbelts formed the Bohai and the West Korean Bay basins where infilled with the early to middle Jurassic molasse sediments. Also Piggyback basins locally developed along the thrust. The later intensive Yanshanian (first) Orogeny modified these foreland and Piggyback basins in the late Jurassic. The South Yellow Sea basin, however, was likely to be a continental interior sag basin during the early to middle Jurassic. The early to middle Jurassic unit in the South Yellow Sea basin is characterized by fluvial to lacustrine sandstone and shale with a thick basal quartz conglomerate that contains well-sorted and well-rounded gravels. Meanwhile, the Tan-Lu fault system underwent a sinistrai strike-slip wrench movement in the late Triassic and continued into the Jurassic and Cretaceous until the early Tertiary. In the late Jurassic, development of second- or third-order wrench faults along the Tan-Lu fault system probably initiated a series of small-scale strike-slip extensional basins. Continued sinistral movement of the Tan-Lu fault until the late Eocene caused a megashear in the South Yellow Sea basin, forming a large-scale pull-apart basin. However, the Bohai basin was uplifted and severely modified during this period. h pronounced Yanshanian Orogeny (second and third) was marked by the unconformity between the early Cretaceous and late Eocene in the Bohai basin. In the late Eocene, the Indian Plate began to collide with the Eurasian Plate, forming a megasuture zone. This orogenic event, namely the Himalayan Orogeny, was probably responsible for the change of motion of the Tan-Lu fault system from left-lateral to right-lateral. The right-lateral strike-slip movement of the Tan-Lu fault caused the tectonic inversion of the South Yellow Sea basin and the pull-apart opening of the Bohai basin. Thus, the Oligocene was the main period of sedimentation in the Bohai basin as well as severe tectonic modification of the South Yellow Sea basin. After the Oligocene, the Yellow Sea and Bohai basins have maintained thermal subsidence up to the present with short periods of marine transgressions extending into the land part of the present basins.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70