• Title/Summary/Keyword: Engineering Framework

Search Result 4,820, Processing Time 0.044 seconds

Work Environment Measurement Results for Research Workers and Directions for System Improvement (연구활동종사자 작업환경측정 결과 및 제도개선 방향)

  • Hwang, Je-Gyu;Byun, Hun-Soo
    • Journal of Korean Society of Occupational and Environmental Hygiene
    • /
    • v.30 no.4
    • /
    • pp.342-352
    • /
    • 2020
  • Objectives: The characteristics of research workers are different from those working in the manufacturing industry. Furthermore, the reagents used change according to the research due to the characteristics of the laboratory, and the amounts used vary. In addition, since the working time changes almost every day, it is difficult to adjust the time according to exposure standards. There are also difficulties in setting standards as in the manufacturing industry since laboratory environments and the types of experiments performed are all different. For these reasons, the measurement of the working environment of research workers is not realistically carried out within the legal framework, there is a concern that the accuracy of measurement results may be degraded, and there are difficulties in securing data. The exposure evaluation based on an eight-hour time-weighted average used for measuring the working environment to be studied in this study may not be appropriate, but it was judged and consequently applied as the most suitable method among the recognized test methods. Methods: The investigation of the use of chemical substances in the research laboratory, which is the subject of this study, was conducted in the order of carrying out work environment measurement, sample analysis, and result analysis. In the case of the use of chemical substances, after organizing the substances to be measured in the working environment, the research workers were asked to write down the status, frequency, and period of use. Work environment measurement and sample analysis were conducted by a recognized test method, and the results were compared with the exposure standards (TWA: time weighted average value) for chemical substances and physical factors. Results: For the substances subject to work environment measurement, the department of chemical engineering was the most exposed, followed by the department of chemistry. This can lead to exposure to a variety of chemicals in departmental laboratories that primarily deal with chemicals, including acetone, hydrogen peroxide, nitric acid, sodium hydroxide, and normal hexane. Hydrogen chloride was measured higher than the average level of domestic work environment measurements. This can suggest that researchers in research activities should also be managed within the work environment measurement system. As a result of a comparison between the professional science and technology service industry and the education service industry, which are the most similar business types to university research laboratories among the domestic work environment measurements provided by the Korea Safety and Health Agency, acetone, dichloromethane, hydrogen peroxide, sodium hydroxide, nitric acid, normal hexane, and hydrogen chloride are items that appear higher than the average level. This can also be expressed as a basis for supporting management within the work environment measurement system. Conclusions: In the case of research activity workers' work environment measurement and management, specific details can be presented as follows. When changing projects and research, work environment measurement is carried out, and work environment measurement targets and methods are determined by the measurement and analysis method determined by the Ministry of Employment and Labor. The measurement results and exposure standards apply exposure standards for chemical substances and physical factors by the Ministry of Employment and Labor. Implementation costs include safety management expenses and submission of improvement plans when exposure standards are exceeded. The results of this study were presented only for the measurement of the working environment among the minimum health management measures for research workers, but it is necessary to prepare a system to improve the level of safety and health.

A Study on Training Dataset Configuration for Deep Learning Based Image Matching of Multi-sensor VHR Satellite Images (다중센서 고해상도 위성영상의 딥러닝 기반 영상매칭을 위한 학습자료 구성에 관한 연구)

  • Kang, Wonbin;Jung, Minyoung;Kim, Yongil
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1505-1514
    • /
    • 2022
  • Image matching is a crucial preprocessing step for effective utilization of multi-temporal and multi-sensor very high resolution (VHR) satellite images. Deep learning (DL) method which is attracting widespread interest has proven to be an efficient approach to measure the similarity between image pairs in quick and accurate manner by extracting complex and detailed features from satellite images. However, Image matching of VHR satellite images remains challenging due to limitations of DL models in which the results are depending on the quantity and quality of training dataset, as well as the difficulty of creating training dataset with VHR satellite images. Therefore, this study examines the feasibility of DL-based method in matching pair extraction which is the most time-consuming process during image registration. This paper also aims to analyze factors that affect the accuracy based on the configuration of training dataset, when developing training dataset from existing multi-sensor VHR image database with bias for DL-based image matching. For this purpose, the generated training dataset were composed of correct matching pairs and incorrect matching pairs by assigning true and false labels to image pairs extracted using a grid-based Scale Invariant Feature Transform (SIFT) algorithm for a total of 12 multi-temporal and multi-sensor VHR images. The Siamese convolutional neural network (SCNN), proposed for matching pair extraction on constructed training dataset, proceeds with model learning and measures similarities by passing two images in parallel to the two identical convolutional neural network structures. The results from this study confirm that data acquired from VHR satellite image database can be used as DL training dataset and indicate the potential to improve efficiency of the matching process by appropriate configuration of multi-sensor images. DL-based image matching techniques using multi-sensor VHR satellite images are expected to replace existing manual-based feature extraction methods based on its stable performance, thus further develop into an integrated DL-based image registration framework.

A Study on Public Interest-based Technology Valuation Models in Water Resources Field (수자원 분야 공익형 기술가치평가 시스템에 대한 연구)

  • Ryu, Seung-Mi;Sung, Tae-Eung
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.3
    • /
    • pp.177-198
    • /
    • 2018
  • Recently, as economic property it has become necessary to acquire and utilize the framework for water resource measurement and performance management as the property of water resources changes to hold "public property". To date, the evaluation of water technology has been carried out by feasibility study analysis or technology assessment based on net present value (NPV) or benefit-to-cost (B/C) effect, however it is not yet systemized in terms of valuation models to objectively assess an economic value of technology-based business to receive diffusion and feedback of research outcomes. Therefore, K-water (known as a government-supported public company in Korea) company feels the necessity to establish a technology valuation framework suitable for technical characteristics of water resources fields in charge and verify an exemplified case applied to the technology. The K-water evaluation technology applied to this study, as a public interest goods, can be used as a tool to measure the value and achievement contributed to society and to manage them. Therefore, by calculating the value in which the subject technology contributed to the entire society as a public resource, we make use of it as a basis information for the advertising medium of performance on the influence effect of the benefits or the necessity of cost input, and then secure the legitimacy for large-scale R&D cost input in terms of the characteristics of public technology. Hence, K-water company, one of the public corporation in Korea which deals with public goods of 'water resources', will be able to establish a commercialization strategy for business operation and prepare for a basis for the performance calculation of input R&D cost. In this study, K-water has developed a web-based technology valuation model for public interest type water resources based on the technology evaluation system that is suitable for the characteristics of a technology in water resources fields. In particular, by utilizing the evaluation methodology of the Institute of Advanced Industrial Science and Technology (AIST) in Japan to match the expense items to the expense accounts based on the related benefit items, we proposed the so-called 'K-water's proprietary model' which involves the 'cost-benefit' approach and the FCF (Free Cash Flow), and ultimately led to build a pipeline on the K-water research performance management system and then verify the practical case of a technology related to "desalination". We analyze the embedded design logic and evaluation process of web-based valuation system that reflects characteristics of water resources technology, reference information and database(D/B)-associated logic for each model to calculate public interest-based and profit-based technology values in technology integrated management system. We review the hybrid evaluation module that reflects the quantitative index of the qualitative evaluation indices reflecting the unique characteristics of water resources and the visualized user-interface (UI) of the actual web-based evaluation, which both are appended for calculating the business value based on financial data to the existing web-based technology valuation systems in other fields. K-water's technology valuation model is evaluated by distinguishing between public-interest type and profitable-type water technology. First, evaluation modules in profit-type technology valuation model are designed based on 'profitability of technology'. For example, the technology inventory K-water holds has a number of profit-oriented technologies such as water treatment membranes. On the other hand, the public interest-type technology valuation is designed to evaluate the public-interest oriented technology such as the dam, which reflects the characteristics of public benefits and costs. In order to examine the appropriateness of the cost-benefit based public utility valuation model (i.e. K-water specific technology valuation model) presented in this study, we applied to practical cases from calculation of benefit-to-cost analysis on water resource technology with 20 years of lifetime. In future we will additionally conduct verifying the K-water public utility-based valuation model by each business model which reflects various business environmental characteristics.

Retail Product Development and Brand Management Collaboration between Industry and University Student Teams (산업여대학학생단대지간적령수산품개발화품패관리협작(产业与大学学生团队之间的零售产品开发和品牌管理协作))

  • Carroll, Katherine Emma
    • Journal of Global Scholars of Marketing Science
    • /
    • v.20 no.3
    • /
    • pp.239-248
    • /
    • 2010
  • This paper describes a collaborative project between academia and industry which focused on improving the marketing and product development strategies for two private label apparel brands of a large regional department store chain in the southeastern United States. The goal of the project was to revitalize product lines of the two brands by incorporating student ideas for new solutions, thereby giving the students practical experience with a real-life industry situation. There were a number of key players involved in the project. A privately-owned department store chain based in the southeastern United States which was seeking an academic partner had recognized a need to update two existing private label brands. They targeted middle-aged consumers looking for casual, moderately priced merchandise. The company was seeking to change direction with both packaging and presentation, and possibly product design. The branding and product development divisions of the company contacted professors in an academic department of a large southeastern state university. Two of the professors agreed that the task would be a good fit for their classes - one was a junior-level Intermediate Brand Management class; the other was a senior-level Fashion Product Development class. The professors felt that by working collaboratively on the project, students would be exposed to a real world scenario, within the security of an academic learning environment. Collaboration within an interdisciplinary team has the advantage of providing experiences and resources beyond the capabilities of a single student and adds "brainpower" to problem-solving processes (Lowman 2000). This goal of improving the capabilities of students directed the instructors in each class to form interdisciplinary teams between the Branding and Product Development classes. In addition, many universities are employing industry partnerships in research and teaching, where collaboration within temporal (semester) and physical (classroom/lab) constraints help to increase students' knowledge and experience of a real-world situation. At the University of Tennessee, the Center of Industrial Services and UT-Knoxville's College of Engineering worked with a company to develop design improvements in its U.S. operations. In this study, Because should be lower case b with a private label retail brand, Wickett, Gaskill and Damhorst's (1999) revised Retail Apparel Product Development Model was used by the product development and brand management teams. This framework was chosen because it addresses apparel product development from the concept to the retail stage. Two classes were involved in this project: a junior level Brand Management class and a senior level Fashion Product Development class. Seven teams were formed which included four students from Brand Management and two students from Product Development. The classes were taught the same semester, but not at the same time. At the beginning of the semester, each class was introduced to the industry partner and given the problem. Half the teams were assigned to the men's brand and half to the women's brand. The teams were responsible for devising approaches to the problem, formulating a timeline for their work, staying in touch with industry representatives and making sure that each member of the team contributed in a positive way. The objective for the teams was to plan, develop, and present a product line using merchandising processes (following the Wickett, Gaskill and Damhorst model) and develop new branding strategies for the proposed lines. The teams performed trend, color, fabrication and target market research; developed sketches for a line; edited the sketches and presented their line plans; wrote specifications; fitted prototypes on fit models, and developed final production samples for presentation to industry. The branding students developed a SWOT analysis, a Brand Measurement report, a mind-map for the brands and a fully integrated Marketing Report which was presented alongside the ideas for the new lines. In future if the opportunity arises to work in this collaborative way with an existing company who wishes to look both at branding and product development strategies, classes will be scheduled at the same time so that students have more time to meet and discuss timelines and assigned tasks. As it was, student groups had to meet outside of each class time and this proved to be a challenging though not uncommon part of teamwork (Pfaff and Huddleston, 2003). Although the logistics of this exercise were time-consuming to set up and administer, professors felt that the benefits to students were multiple. The most important benefit, according to student feedback from both classes, was the opportunity to work with industry professionals, follow their process, and see the results of their work evaluated by the people who made the decisions at the company level. Faculty members were grateful to have a "real-world" case to work with in the classroom to provide focus. Creative ideas and strategies were traded as plans were made, extending and strengthening the departmental links be tween the branding and product development areas. By working not only with students coming from a different knowledge base, but also having to keep in contact with the industry partner and follow the framework and timeline of industry practice, student teams were challenged to produce excellent and innovative work under new circumstances. Working on the product development and branding for "real-life" brands that are struggling gave students an opportunity to see how closely their coursework ties in with the real-world and how creativity, collaboration and flexibility are necessary components of both the design and business aspects of company operations. Industry personnel were impressed by (a) the level and depth of knowledge and execution in the student projects, and (b) the creativity of new ideas for the brands.

Development of Intelligent Job Classification System based on Job Posting on Job Sites (구인구직사이트의 구인정보 기반 지능형 직무분류체계의 구축)

  • Lee, Jung Seung
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.4
    • /
    • pp.123-139
    • /
    • 2019
  • The job classification system of major job sites differs from site to site and is different from the job classification system of the 'SQF(Sectoral Qualifications Framework)' proposed by the SW field. Therefore, a new job classification system is needed for SW companies, SW job seekers, and job sites to understand. The purpose of this study is to establish a standard job classification system that reflects market demand by analyzing SQF based on job offer information of major job sites and the NCS(National Competency Standards). For this purpose, the association analysis between occupations of major job sites is conducted and the association rule between SQF and occupation is conducted to derive the association rule between occupations. Using this association rule, we proposed an intelligent job classification system based on data mapping the job classification system of major job sites and SQF and job classification system. First, major job sites are selected to obtain information on the job classification system of the SW market. Then We identify ways to collect job information from each site and collect data through open API. Focusing on the relationship between the data, filtering only the job information posted on each job site at the same time, other job information is deleted. Next, we will map the job classification system between job sites using the association rules derived from the association analysis. We will complete the mapping between these market segments, discuss with the experts, further map the SQF, and finally propose a new job classification system. As a result, more than 30,000 job listings were collected in XML format using open API in 'WORKNET,' 'JOBKOREA,' and 'saramin', which are the main job sites in Korea. After filtering out about 900 job postings simultaneously posted on multiple job sites, 800 association rules were derived by applying the Apriori algorithm, which is a frequent pattern mining. Based on 800 related rules, the job classification system of WORKNET, JOBKOREA, and saramin and the SQF job classification system were mapped and classified into 1st and 4th stages. In the new job taxonomy, the first primary class, IT consulting, computer system, network, and security related job system, consisted of three secondary classifications, five tertiary classifications, and five fourth classifications. The second primary classification, the database and the job system related to system operation, consisted of three secondary classifications, three tertiary classifications, and four fourth classifications. The third primary category, Web Planning, Web Programming, Web Design, and Game, was composed of four secondary classifications, nine tertiary classifications, and two fourth classifications. The last primary classification, job systems related to ICT management, computer and communication engineering technology, consisted of three secondary classifications and six tertiary classifications. In particular, the new job classification system has a relatively flexible stage of classification, unlike other existing classification systems. WORKNET divides jobs into third categories, JOBKOREA divides jobs into second categories, and the subdivided jobs into keywords. saramin divided the job into the second classification, and the subdivided the job into keyword form. The newly proposed standard job classification system accepts some keyword-based jobs, and treats some product names as jobs. In the classification system, not only are jobs suspended in the second classification, but there are also jobs that are subdivided into the fourth classification. This reflected the idea that not all jobs could be broken down into the same steps. We also proposed a combination of rules and experts' opinions from market data collected and conducted associative analysis. Therefore, the newly proposed job classification system can be regarded as a data-based intelligent job classification system that reflects the market demand, unlike the existing job classification system. This study is meaningful in that it suggests a new job classification system that reflects market demand by attempting mapping between occupations based on data through the association analysis between occupations rather than intuition of some experts. However, this study has a limitation in that it cannot fully reflect the market demand that changes over time because the data collection point is temporary. As market demands change over time, including seasonal factors and major corporate public recruitment timings, continuous data monitoring and repeated experiments are needed to achieve more accurate matching. The results of this study can be used to suggest the direction of improvement of SQF in the SW industry in the future, and it is expected to be transferred to other industries with the experience of success in the SW industry.

Assessing the Benefits of Incorporating Rainfall Forecasts into Monthly Flow Forecast System of Tampa Bay Water, Florida (하천 유량 예측 시스템 개선을 위한 강우 예측 자료의 적용성 평가: 플로리다 템파 지역 사례를 중심으로)

  • Hwang, Sye-Woon;Martinez, Chris;Asefa, Tirusew
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.54 no.4
    • /
    • pp.127-135
    • /
    • 2012
  • This paper introduced the flow forecast modeling system that a water management agency in west central Florida, Tampa Bay Water has been operated to forecast monthly rainfall and streamflow in the Tampa Bay region, Florida. We evaluated current 1-year monthly rainfall forecasts and flow forecasts and actual observations to investigate the benefits of incorporating rainfall forecasts into monthly flow forecast. Results for rainfall forecasts showed that the observed annual cycle of monthly rainfall was accurately reproduced by the $50^{th}$ percentile of forecasts. While observed monthly rainfall was within the $25^{th}$ and $75^{th}$ percentile of forecasts for most months, several outliers were found during the dry months especially in the dry year of 2007. The flow forecast results for the three streamflow stations (HRD, MB, and BS) indicated that while the 90 % confidence interval mostly covers the observed monthly streamflow, the $50^{th}$ percentile forecast generally overestimated observed streamflow. Especially for HRD station, observed streamflow was reproduced within $5^{th}$ and $25^{th}$ percentile of forecasts while monthly rainfall observations closely followed the $50^{th}$ percentile of rainfall forecasts. This was due to the historical variability at the station was significantly high and it resulted in a wide range of forecasts. Additionally, it was found that the forecasts for each station tend to converge after several months as the influence of the initial condition diminished. The forecast period to converge to simulation bounds was estimated by comparing the forecast results for 2006 and 2007. We found that initial conditions have influence on forecasts during the first 4-6 months, indicating that FMS forecasts should be updated at least every 4-6 months. That is, knowledge of initial condition (i.e., monthly flow observation in the last-recent month) provided no foreknowledge of the flows after 4-6 months of simulation. Based on the experimental flow forecasts using the observed rainfall data, we found that the 90 % confidence interval band for flow predictions was significantly reduced for all stations. This result evidently shows that accurate short-term rainfall forecasts could reduce the range of streamflow forecasts and improve forecast skill compared to employing the stochastic rainfall forecasts. We expect that the framework employed in this study using available observations could be used to investigate the applicability of existing hydrological and water management modeling system for use of stateof-the-art climate forecasts.

Application Plan of Goods Information in the Public Procurement Service for Enhancing U-City Plans (U-City계획 고도화를 위한 조달청 물품정보 활용 방안 : CCTV 사례를 중심으로)

  • PARK, Jun-Ho;PARK, Jeong-Woo;NAM, Kwang-Woo
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.18 no.3
    • /
    • pp.21-34
    • /
    • 2015
  • In this study, a reference model is constructed that provides architects or designers with sufficient information on the intelligent service facility that is essential for U-City space configuration, and for the support of enhanced design, as well as for planning activities. At the core of the reference model is comprehensive information about the intelligent service facility that plans the content of services, and the latest related information that is regularly updated. A plan is presented to take advantage of the database of list information systems in the Public Procurement Service that handles intelligent service facilities. We suggest a number of improvements by analyzing the current status of, and issues with, the goods information in the Public Procurement Service, and by conducting a simulation for the proper placement of CCTV. As the design of U-City plan has evolved from IT technology-based to smart space-based, reviews of limitations such as the lack of standards, information about the installation, and the placement of the intelligent service facility that provides U-service have been carried out. Due to the absence of relevant legislation and guidelines, however, planning activities, such as the appropriate placement of the intelligent service facility are difficult when considering efficient service provision. In addition, with the lack of information about IT technology and intelligent service facilities that can be provided to U-City planners and designers, there are a number of difficulties when establishing an optimal plan with respect to service level and budget. To solve these problems, this study presents a plan in conjunction with the goods information from the Public Procurement Service. The Public Procurement Service has already built an industry-related database of around 260,000 cases, which has been continually updated. It can be a very useful source of information about the intelligent service facility, the ever-changing U-City industry's core, and the relevant technologies. However, since providing this information is insufficient in the application process and, due to the constraints in the information disclosure process, there have been some issues in its application. Therefore, this study, by presenting an improvement plan for the linkage and application of the goods information in the Public Procurement Service, has significance for the provision of the basic framework for future U-City enhancement plans, and multi-departments' common utilization of the goods information in the Public Procurement Service.

Construction and Validation of a Data Synchronization Server supporting OMA DS Standards (OMA DS 표준을 지원하는 자료동기화 서버 구축 및 적합성 검증)

  • Pak, Ju-Geon;Park, Kee-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.5
    • /
    • pp.79-91
    • /
    • 2011
  • In this paper, a DS (Data Synchronization) server for mobile communication environments is constructed and the suitability and the performance of its operations are validated. The DS server provides a way to update the newest data and keep data consistency for clients (mobile devices). In addition, the DS server constructed in this paper supports various synchronization types, and detects all changes and conflicts. In case of data conflicts, the DS server resolves the conflicts according to the several policies implemented in this work. The DS server conforms to the OMA(Open Mobile Alliance) DS standard protocol for interoperability with other mobile devices and servers. In addition to the transmission-by record scheme proposed by the OMA DS standard protocol, the DS server constructed in this paper also provides the transmission-by field scheme for the enhancement transmission performance between the server and clients. In order to validate its operations, data synchronization between the DS server and the SCTS (SyncML Conformance Test Suit), the suitability validation tool provided by the OMA, is performed. The validation results show that the DS server constructed in this paper satisfies all of the test cases except the Large Object function. The Large Object function will be implemented later because the function is not needed for the personal information synchronization process which this paper aims for. Also, synchronization times of the DS server are measured while increasing the number of data and clients. The results of the performance evaluations demonstrate that the DS server is scalable, in the sense that it has not suffered from any serious bottlenecks with respect to the number of data and clients. We expect that this work will provide a framework for various studies in the future for improving mobile DS operations.

A Study on the Performance Certification System of Inspection and Diagnostic Equipment for Infrastructure using Advanced Technologies (첨단기술을 이용한 시설물 점검 및 진단장비 성능인증체계에 대한 연구)

  • Hong, Sung-Ho;Kim, Jung-Gon;Cho, Jae-Young;Kim, Do-Hyoung;Kim, Jung-Yeol;Kim, Young-Min;Lee, Dong-Wook
    • Journal of the Society of Disaster Information
    • /
    • v.17 no.1
    • /
    • pp.97-111
    • /
    • 2021
  • Purpose: It is expected that various infrastructures diagnosis equipment will be needed as infrastructures management is strengthened to implement the Framework Act on Sustainable Infrastructure Management. It is necessary for a certification system to supply certified products of a reasonable level in accordance with market requirements for various convergence equipment. This paper deals with the introduction of certification system of inspection and diagnosis equipment for infrastructure using advanced technologies. Method: The basic elements, systems and procedures of certification system were reviewed through analyzing and comparing the existing similar certification system in Korea. In addition, a survey was conducted on a catalog method and the minimum performance criterion (sampling survey and complete enumeration survey) to equipment developers (manufacturers), clients and equipment users. Result: This survey showed that clients preferred complete enumeration method on the basis of minimum performance, and equipment users also preferred complete enumeration survey and sample survey, for minimum performance, at a similar rate. On the other hand, equipment developers preferred the catalog method. Conclusion: Clients and users who are the users of the diagnostic equipment preferred the minimum performance criterion because their trust in quality is important. On the other hand, developers(manufacturers) preferred the catalog method which adopts self certification because it is regulated in developing various products. There is no specific plan for the minimum performance standards required for the introduction of the method which users demand, at present. In addition, it is not desirable to force to introduce a certification system because it requires a considerable period of study to prepare the specific standards. Therefore, it is appropriate to operate the system for a certain period of time centering around the catalog method for the stable and continuous development of the infrastructure diagnosis and test equipment market in Korea. Also, it is effective to expand and develop the certification system to the extent that it minimizes the impact on the market when specific plans for the standards are prepared in the future.

A Deep Learning Based Approach to Recognizing Accompanying Status of Smartphone Users Using Multimodal Data (스마트폰 다종 데이터를 활용한 딥러닝 기반의 사용자 동행 상태 인식)

  • Kim, Kilho;Choi, Sangwoo;Chae, Moon-jung;Park, Heewoong;Lee, Jaehong;Park, Jonghun
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.1
    • /
    • pp.163-177
    • /
    • 2019
  • As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.