A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.163-177
- /
- 2019
As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
Since 2000, the employment rate of small and medium enterprises (SMEs) has dwindled while the creation of new jobs and the emergence of healthy SMEs have been stagnant. The fundamental reason for these symptoms is that the economic structure is disadvantageous to SMEs. In particular, the greater gap between SMEs and large enterprises has resulted in polarization, and the resulting imbalance has become the largest obstacle to improving SMEs' competitiveness. For example, the total productivity has continued to drop, and the average productivity of SMEs is now merely 30% of that of large enterprises, and the average wage of SMEs' employees is only 53% of that of large enterprises. Along with polarization, rapid industrialization has also caused anti-enterprise consensus, the collapse of the middle class, hostility towards establishments, and other aftereffects. The general consensus is that unless these problems are solved, South Korea will not become an advanced country. Especially, South Korea is now facing issues that need urgent measures, such as the decline of its economic growth, the worsening distribution of profits, and the increased external volatility. Recognizing such negative trends, the MB administration proposed a win-win growth policy and recently introduced a new national value called "ecosystemic development." As the terms in such policy agenda are similar, however, the conceptual differences among such terms must first be fully understood. Therefore, in this study, the concepts of win-win growth policy and ecosystemic development, and the need for them, were surveyed, and their differences from and similarities with other policy concepts like win-win cooperation and symbiotic development were examined. Based on the results of the survey and examination, the study introduced a South Korean model of win-win growth, targeting the promotion of a sound balance between large enterprises and SMEs and an innovative ecosystem, and finally, proposing future policy tasks. Win-win growth is not an academic term but a policy term. Thus, it is less advisable to give a theoretical definition of it than to understand its concept based on its objective and method as a policy. The core of the MB administration's win-win growth policy is the creation of a partnership between key economic subjects such as large enterprises and SMEs based on each subject's differentiated capacity, and such economic subjects' joint promotion of growth opportunities. Its objective is to contribute to the establishment of an advanced capitalistic system by securing the sustainability of the South Korean economy. Such win-win growth policy includes three core concepts. The first concept, ecosystem, is that win-win growth should be understood from the viewpoint of an industrial ecosystem and should be pursued by overcoming the issues of specific enterprises. An enterprise is not an independent entity but a social entity, meaning it exists in relationship with the society (Drucker, 2011). The second concept, balance, points to the fact that an effort should be made to establish a systemic and social infrastructure for a healthy balance in the industry. The social system and infrastructure should be established in such a way as to create a balance between short- term needs and long-term sustainability, between freedom and responsibility, and between profitability and social obligations. Finally, the third concept is the behavioral change of economic entities. The win-win growth policy is not merely about simple transactional relationships or determining reasonable prices but more about the need for a behavior change on the part of economic entities, without which the objectives of the policy cannot be achieved. Various advanced countries have developed different win-win growth models based on their respective cultures and economic-development stages. Japan, whose culture is characterized by a relatively high level of group-centered trust, has developed a productivity improvement model based on such culture, whereas the U.S., which has a highly developed system of market capitalism, has developed a system that instigates or promotes market-oriented technological innovation. Unlike Japan or the U.S., Europe, a late starter, has not fully developed a trust-based culture or market capitalism and thus often uses a policy-led model based on which the government leads the improvement of productivity and promotes technological innovation. By modeling successful cases from these advanced countries, South Korea can establish its unique win-win growth system. For this, it needs to determine the method and tasks that suit its circumstances by examining the prerequisites for its success as well as the strengths and weaknesses of each advanced country. This paper proposes a South Korean model of win-win growth, whose objective is to upgrade the country's low-trust-level-based industrial structure, in which large enterprises and SMEs depend only on independent survival strategies, to a high-trust-level-based social ecosystem, in which large enterprises and SMEs develop a cooperative relationship as partners. Based on this objective, the model proposes the establishment of a sound balance of systems and infrastructure between large enterprises and SMEs, and to form a crenovative social ecosystem. The South Korean model of win-win growth consists of three axes: utilization of the South Koreans' potential, which creates community-oriented energy; fusion-style improvement of various control and self-regulated systems for establishing a high-trust-level-oriented social infrastructure; and behavioral change on the part of enterprises in terms of putting an end to their unfair business activities and promoting future-oriented cooperative relationships. This system will establish a dynamic industrial ecosystem that will generate creative energy and will thus contribute to the realization of a sustainable economy in the 21st century. The South Korean model of win-win growth should pursue community-based self-regulation, which promotes the power of efficiency and competition that is fundamentally being pursued by capitalism while at the same time seeking the value of society and community. Already existing in Korea's traditional roots, such objectives have become the bases of the Shinbaram culture, characterized by the South Koreans' spontaneity, creativity, and optimism. In the process of a community's gradual improvement of its rules and procedures, the trust among the community members increases, and the "social capital" that guarantees the successful control of shared resources can be established (Ostrom, 2010). This basic ideal can help reduce the gap between large enterprises and SMEs, alleviating the South Koreans' victim mentality in the face of competition and the open-door policy, and creating crenovative corporate competitiveness. The win-win growth policy emerged for the purpose of addressing the polarization and imbalance structure resulting from the evolution of 21st-century capitalism. It simultaneously pursues efficiency and fairness on one hand and economic and community values on the other, and aims to foster efficient interaction between the market and the government. This policy, however, is also evolving. The win-win growth policy can be considered an extension of the win-win cooperation that the past 'Participatory Government' promoted at the enterprise management level to the level of systems and culture. Also, the ecosystemic development agendum that has recently emerged is a further extension that has been presented as a national ideal of "a new development model that promotes the co-advancement of environmental conservation, growth, economic development, social integration, and national and individual development."