A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.1
- /
- pp.163-177
- /
- 2019
As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.
Purpose: To find out the dosimetric usefulness, setup reproducibility and efficiency of applying 3D Bolus by comparing two treatment plans in which Commercial Bolus and 3D Bolus produced by 3D Printing Technology were applied to the neck during VMAT treatment of Hypopahrynx Cancer to evaluate the clinical applicability. Materials and Methods: Based on the CT image of the RANDO phantom to which CB was applied, 3D Bolus were fabricated in the same form. 3D Bolus was printed with a polyurethane acrylate resin with a density of 1.2g/㎤ through the SLA technique using OMG SLA 660 Printer and MaterializeMagics software. Based on two CT images using CB and 3D Bolus, a treatment plan was established assuming VMAT treatment of Hypopharynx Cancer. CBCT images were obtained for each of the two established treatment plans 18 times, and the treatment efficiency was evaluated by measuring the setup time each time. Based on the obtained CBCT image, the adaptive plan was performed through Pinnacle, a computerized treatment planning system, to evaluate target, normal organ dose evaluation, and changes in bolus volume. Results: The setup time for each treatment plan was reduced by an average of 28 sec in the 3D Bolus treatment plan compared to the CB treatment plan. The Bolus Volume change during the pretreatment period was 86.1±2.70㎤ in 83.9㎤ of CB Initial Plan and 99.8±0.46㎤ in 92.2㎤ of 3D Bolus Initial Plan. The change in CTV Min Value was 167.4±19.38cGy in CB Initial Plan 191.6cGy and 149.5±18.27cGy in 3D Bolus Initial Plan 167.3cGy. The change in CTV Mean Value was 228.3±0.38cGy in CB Initial Plan 227.1cGy and 227.7±0.30cGy in 3D Bolus Initial Plan 225.9cGy. The change in PTV Min Value was 74.9±19.47cGy in CB Initial Plan 128.5cGy and 83.2±12.92cGy in 3D Bolus Initial Plan 139.9cGy. The change in PTV Mean Value was 226.2±0.83cGy in CB Initial Plan 225.4cGy and 225.8±0.33cGy in 3D Bolus Initial Plan 224.1cGy. The maximum value for the normal organ spinal cord was the same as 135.6cGy on average each time. Conclusion: From the experimental results of this paper, it was found that the application of 3D Bolus to the irregular body surface is more dosimetrically useful than the application of Commercial Bolus, and the setup reproducibility and efficiency are excellent. If further case studies along with research on the diversity of 3D printing materials are conducted in the future, the application of 3D Bolus in the field of radiation therapy is expected to proceed more actively.
Endoplasmic reticulum (ER) stress responses are markedly induced during toxic responses caused by various chemical substances, including difenoconazole, but no research has been conducted on 1,2,3-trichloropropane (TCP), a chemical that is generally used in agriculture and industry, which induces hepatotoxicity. Therefore, in this study, the changes in indicators for hepatotoxicity, apoptosis, and ER stress were analyzed in TCP-treated Sprague Dawley (SD) rats to study the regulatory mechanism of ER stress during the hepatotoxicity. The TCP-treated group decreased in body weight and dietary intake compared to the vehicle-treated group, and necrosis and vacuolation increased significantly in liver histology. In addition, the expression of apoptosis-related factors, including Bax/Bcl-2 and cleaved caspase (Cas)-3/Cas-3 increased significantly in the TCP-treated group compared to the vehicle-treated group. In the analysis of ER stress response indicators, the expression of C/EBP homologous protein (CHOP), phospho-eukaryotic translation initiation factor 2 alpha subunit (eIF2α), and phospho-inositol-requiring enzyme 1α (IRE1α) increased only in the TCP100-treated group and decreased in the TCP200-treated group. However, the transcriptions of growth arrest and DNA damage-34 (GADD34) increased in the TCP200-treated group, while Spliced X-box binding protein-1 (XBP1s) and unspliced XBP1(XBP1u) decreased in the same group. These results suggest that the ER stress response is successfully triggered during the hepatotoxicity induced by TCP treatment through the alternative regulation of the unfolded-protein response (UPR) pathway.
Limnological study on the physico-chemical properties and biological characteristics of the Lake Ok-Jeong was made from May 1980 to August 1981. For the planktonic organisms in the lake, species composition, seasonal change and diurnal vertical distribution based on the monthly plankton samples were investigated in conjunction with the physico-chemical properties of the body of water in the lake. Analysis of temperature revealed that there were three distinctive periods in terms of vertical mixing of the water column. During the winter season (November-March) the vertical column was completely mixed, and no temperature gradient was observed. In February temperature of the whole column from the surface to the bottom was
This study was carried out to investigate the toxicity of food Red No.2 in the Sprague-Dawley (SD) female rat for 4 weeks. SD rats were orally administered for 28 days, with dosage of 500, 1,000, 2,000 mg/kg/day. Animals treated with food Red No.2 did not cause any death and show any clinical signs. They did not show any significant changes of body weight, feed uptake and water consumption. There were not significantly different from the control group in urinalysis, hematological, serum biochemical value and histopathological examination. In conclusion, 4 weeks of the repetitive oral medication of food Red No.2 has resulted no alteration of toxicity according to the test materials in the group of female rats with injection of 2,000 mg/kg. Therefore, food Red No.2 was not indicated to have any toxic effect in the SD rats, when it was orally administered below the dosage 2,000 mg/kg/day for 4 weeks.
Background: National survey was performed to estimate the incidence of sarcoidosis in Korea. The clinical data of confirmed cases were analysed for the practice of primary care physicians and pulmonary specialists. Methods: The period of study was from January 1991 to December 1992. Data were retrospectively collected by correspondence with physicians in departments of internal medicine, dermatology, ophthalmology and neurology of the hospitals having more than 100 beds using returning postcards. In confirmed and suspicious cases of sardoidosis, case record chart for clinical and laboratory findings were obtained in detail. Results: 1) Postcards were sent to 523 departments in 213 hospitals. Internal medicine composed 41%, dermatology 20%, ophthalmology 20% and neurology 19%. 2) Postcards were returned from 241 departments (replying rates was 48%). 3) There were 113 confirmed cases from 50 departments and 10 cases. The cases were composed from internal medicine (81%), dermatology (13%), ophthalmology (3%) and neurology (3%). 78 confirmed cases were analysed, which were composed from department of internal medicine (92%), dermatology (5%), and neurology (3%). 4) The time span for analysed cases was 1980 to 1992. one case was analysed in 1980 and the number gradually increased to 18 cases in 1991. 5) The majority of patients (84.4%) were in the age group of 20 to 49 years. 6) The ratio of male to female was 1 : 1.5. 7) The most common chief complains were respiratory symptoms, dermatologic symptoms, generalized discomforts, visual changes, arthralgia, abdominal pains, and swallowing difficulties in order. 16% of the patients were asymptomatic. 8) Mean duration between symptom onset and diagnosis was 2 months. 9) The most common symptoms were respiratory, general, dermatologic, ophthalmologic, neurologic and cardiac origin in order. 10) Hemoglobin, hematocrits and platelet were in normal range. 58% of the patients had lymphopenia measuring less than 30% of white cell count. The ratio of CD4 to CD8 lymphocytes was
Hexagram Bi (比 ䷇ 8) is one of the hexagrams comprised of one-unbroken line and five-broken lines. The hexagrams of one-unbroken and five-broken lines symbolize the relationship and dynamics between one yang-consciousness and the five-yin unconsciousness. The hexagram of one-unbroken line and five-broken lines has six different images depending on the position of the one unbroken line from the beginning line to the top line. In terms of psychology, this means that the position change of one yang line in relation to five yin lines may symbolize the function of consciousness which clarifies and determines the content of the psyche. In addition, the flow of psychic energy can be examined through the process of one unbroken line's movement. In other words, the psychic contents of the beginning line of hexagram Bok (復 ䷗ 24), which is the beginning of the hexagram of one-unbroken line and five-broken lines, proceed sequentially, and then arrive at the process of the last sixth, hexagram Bak (剝 ䷖ 23) through the fifth, the hexagram Bi (8). That is, it can be said that the content of the hexagram and the line determined according to the position of one unbroken line show a certain psychic flow. As a result, the first hexagram Bok (復 ䷗ 24), after recovering and starting newly, means the beginning of consciousness. After that the process of proceeding with the second, third, and fourth lines represents the flow of consciousness. And in the fifth place, the fifth line of hexagram Bi, it reaches its peak and is placed in the optimal state of consciousness because of its right and centered position at this hexagram Bi. Like nature, the psyche gradually enters the path of decline from the highest state, which leads to the last sixth, the top line of hexagram Bak. However, the top line of the hexagram Bak, where everything falls off, contains the content of starting again in its top line. It is the beginning line of hexagram Bok to inherit this. This means the circumambulation of the psyche that changes from a psychologically difficult state of depression to a stage of recovery. There is a stage that must be passed in this circulation process, and that is the hexagram Gon (坤 ䷁ 2). October(tenth month)'s hexagram Gon is placed between hexagram Bak, the ninth month of the lunar calendar, and hexagram Bok, the eleventh month of the lunar calendar. This represents that the flow of recovery must go through a maternal process of hexagram Gon. The retreat to the psychological uterus is inevitable in regenerating the psyche. This process flows from the hexagram Bak and through hexagram Gon to the hexagram Bok. At this situation the hexagram Gon acts the absolutely necessary role. In addition, the main body of the hexagrams of one-unbroken and five-broken lines, including the Bi hexagram, is also the Gon hexagram composed of six-broken lines. In other words, all six hexagrams of one-unbroken and five-broken lines have a certain relationship with the Gon hexagram, and it would be meaningful to look at the correlation between the unbroken lines of the hexagrams of one-unbroken and five-broken lines and the corresponding broken lines of the hexagram Gon. This can be said to be the dynamics of the maternal unconscious connected to the state of consciousness in six forms. Therefore, each hexagram of one-unbroken and five-broken lines symbolizes the expression of the integration the mother archetype with the consciousness. Revealing this well is the meaning of the hexagram of one-unbroken and five-broken lines. Its hexagram image consists of a combination of Gon (☷), which symbolizes the mother, and the thunder (☳) the eldest son, the water (☵) the middle son and the mountain (☶) the third son. As a result, the hexagram Bok (復 ䷗ 24), Sa (師 ䷆ 7), Gyeom (謙 ䷠ 15), Ye (豫 ䷏ 16), Bi (比 ䷇ 8) and Bak (剝 ䷖ 23) are sequentially created in the order of the unbroken line. This is symbolically the evolutionary process of consciousness. In this way, the hexagrams of one-unbroken and five-broken lines, which mean the conjunction of mother and son, represent the advancing relationship between the maternal unconscious and consciousness. In addition, the relationship with the mother according to the position of the son is related to the dynamics of mother archetype to the attitude of consciousness. The psychological meaning can be deduced from the flow of six lines of hexagrams of one-unbroken and five-broken lines. And the state in which the activation of the consciousness is at its peak is the fifth line of the hexagram Bi, and comparing it with the contents of the corresponding fifth line of hexagram Gon not only can find the state and meaning of the conjunction of consciousness and the maternal unconscious, but the entire flow can be compared to the individuation process.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70