• Journal of Intelligence and Information Systems
• /
• v.17 no.1
• /
• pp.53-69
• /
• 2011

Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

• Journal of Intelligence and Information Systems
• /
• v.26 no.4
• /
• pp.27-65
• /
• 2020

Many companies on information and communication technology make public their own developed AI technology, for example, Google's TensorFlow, Facebook's PyTorch, Microsoft's CNTK. By releasing deep learning open source software to the public, the relationship with the developer community and the artificial intelligence (AI) ecosystem can be strengthened, and users can perform experiment, implementation and improvement of it. Accordingly, the field of machine learning is growing rapidly, and developers are using and reproducing various learning algorithms in each field. Although various analysis of open source software has been made, there is a lack of studies to help develop or use deep learning open source software in the industry. This study thus attempts to derive a strategy for adopting the framework through case studies of a deep learning open source framework. Based on the technology-organization-environment (TOE) framework and literature review related to the adoption of open source software, we employed the case study framework that includes technological factors as perceived relative advantage, perceived compatibility, perceived complexity, and perceived trialability, organizational factors as management support and knowledge & expertise, and environmental factors as availability of technology skills and services, and platform long term viability. We conducted a case study analysis of three companies' adoption cases (two cases of success and one case of failure) and revealed that seven out of eight TOE factors and several factors regarding company, team and resource are significant for the adoption of deep learning open source framework. By organizing the case study analysis results, we provided five important success factors for adopting deep learning framework: the knowledge and expertise of developers in the team, hardware (GPU) environment, data enterprise cooperation system, deep learning framework platform, deep learning framework work tool service. In order for an organization to successfully adopt a deep learning open source framework, at the stage of using the framework, first, the hardware (GPU) environment for AI R&D group must support the knowledge and expertise of the developers in the team. Second, it is necessary to support the use of deep learning frameworks by research developers through collecting and managing data inside and outside the company with a data enterprise cooperation system. Third, deep learning research expertise must be supplemented through cooperation with researchers from academic institutions such as universities and research institutes. Satisfying three procedures in the stage of using the deep learning framework, companies will increase the number of deep learning research developers, the ability to use the deep learning framework, and the support of GPU resource. In the proliferation stage of the deep learning framework, fourth, a company makes the deep learning framework platform that improves the research efficiency and effectiveness of the developers, for example, the optimization of the hardware (GPU) environment automatically. Fifth, the deep learning framework tool service team complements the developers' expertise through sharing the information of the external deep learning open source framework community to the in-house community and activating developer retraining and seminars. To implement the identified five success factors, a step-by-step enterprise procedure for adoption of the deep learning framework was proposed: defining the project problem, confirming whether the deep learning methodology is the right method, confirming whether the deep learning framework is the right tool, using the deep learning framework by the enterprise, spreading the framework of the enterprise. The first three steps (i.e. defining the project problem, confirming whether the deep learning methodology is the right method, and confirming whether the deep learning framework is the right tool) are pre-considerations to adopt a deep learning open source framework. After the three pre-considerations steps are clear, next two steps (i.e. using the deep learning framework by the enterprise and spreading the framework of the enterprise) can be processed. In the fourth step, the knowledge and expertise of developers in the team are important in addition to hardware (GPU) environment and data enterprise cooperation system. In final step, five important factors are realized for a successful adoption of the deep learning open source framework. This study provides strategic implications for companies adopting or using deep learning framework according to the needs of each industry and business.

• Korean small business review
• /
• v.31 no.2
• /
• pp.19-37
• /
• 2009

The purpose of this research is to explore differences between small and medium-sized companies and large-sized companies in the impact of human resource innovativeness(HRI), learning orientation(LO), and HRI-LO interaction on innovation effect and business performance. Although learning orientation has long been considered as a key factor influencing good performance of a business, little research was devoted to exploring the effect of HRI-LO interaction on innovation effect and business performance. In this study, it is investigated whether there is a synergy effect between innovative human workforce and learning orientation corporate culture, in addition to each by itself, to generate good business performance as well as a success of new innovations in the market. Research hypotheses were as follows, including H1) human resource innovativeness(HRI), learning orientation(LO), and interactions of HRI and LO(HRI-LO interaction) positively affect innovation effect, H2) there is a difference of the effect of HRI, LO, and HRI-LO interaction on innovation effect between large-sized and small-sized companies, H3) HRI, LO, HRI-LO interaction, innovation effect positively affect business performance, and H4) there is a difference of the effect of HRI, LO, HRI-LO interaction, and innovation effect on business performance between large-sized and small-sized companies. Data were obtained from 479 practitioners through a web survey since the web survey is an efficient method to collect a national data at a variety of fields. A single respondent from a company was allowed to participate in the study after checking whether they have more than 5-year work experiences in the company. To check whether a common source bias is existed in the sample, additional data from a convenient sample of 97 companies were gathered through the traditional survey method, and were used to confirm correlations between research variables of the original sample and the additional sample. Data were divided into two groups according to company size, such as 352 small and medium-sized companies with less than 300 employees and 127 large-sized companies with 300 or more employees. Data were analyzed through t-test and regression analyses. HRI which is the innovativeness of human resources in the company was measured with 9 items assessing the innovativenss of practitioners in staff, manager, and executive-level positions. LO is the company's effort to encourage employees' development, sharing, and utilizing of knowledge through consistent learning. LO was measured by 18 items assessing commitment to learning, vision sharing, and open-mindedness. Innovation effect which assesses a success of new products/services in the market, was measured with 3 items. Business performance was measured by respondents' evaluations on profitability, sales increase, market share, and general business performance, compared to other companies in the same field. All items were measured by using 6-point Likert scales. Means of multiple items measuring a construct were used as variables based on acceptable reliability and validity. To reduce multi-collinearity problems generated on the regression analysis of interaction terms, centered data were used for HRI, LO, and Innovation effect on regression analyses. In group comparison, large-sized companies were superior on annual sales, annual net profit, the number of new products/services in the last 3 years, the number of new processes advanced in the last 3 years, and the number of R&D personnel, compared to small and medium-sized companies. Also, large-sized companies indicated a higher level of HRI, LO, HRI-LO interaction, innovation effect and business performance than did small and medium-sized companies. The results indicate that large-sized companies tend to have more innovative human resources and invest more on learning orientation than did small-sized companies, therefore, large-sized companies tend to have more success of a new product/service in the market, generating better business performance. In order to test research hypotheses, a series of multiple-regression analysis was conducted. In the regression analysis examining the impact on innovation effect, important results were generated as : 1) HRI, LO, and HRI-LO affected innovation effect, and 2) company size indicated a moderating effect. Based on the result, the impact of HRI on innovation effect would be greater in small and medium-sized companies than in large-sized companies whereas the impact of LO on innovation effect would be greater in large-sized companies than in small and medium-sized companies. In other words, innovative workforce would be more important in making new products/services that would be successful in the market for small and medium-sized companies than for large-sized companies. Otherwise, learning orientation culture would be more effective in making successful products/services for large-sized companies than for small and medium-sized companies. Based on these results, research hypotheses 1 and 2 were supported. In the analysis of a regression examining the impact on business performance, important results were generated as : 1) innovation effect, LO, and HRI-LO affected business performance, 2) HRI by itself did not have a direct effect on business performance regardless of company size, and 3) company size indicated a moderating effect. Specifically, an effect of the HRI-LO interaction on business performance was stronger in large-sized companies than in small and medium-sized companies. It means that the synergy effect of innovative human resources and learning orientation culture tends to be stronger as company is larger. Referring to these result, research hypothesis 3 was partially supported whereas hypothesis 4 was supported. Based on research results, implications for companies were generated. Regardless of company size, companies need to develop the learning orientation corporate culture as well as human resources' innovativeness together in order to achieve successful development of innovative products and services as well as to improve sales and profits. However, the effectiveness of the HRI-LO interaction would be varied by company size. Specifically, the synergy effect of HRI-LO was stronger to make a success of new products/services in small and medium-sized companies than in large-sized companies. However, the synergy effect of HRI-LO was more effective to increase business performance of large-sized companies than that of small and medium-sized companies. In the case of small and medium-sized companies, business performance was achieved more through the success of new products/services than much directly affected by HRI-LO. The most meaningful result of this study is that the effect of HRI-LO interaction on innovation effect and business performance was confirmed. It was often ignored in the previous research. Also, it was found that the innovativeness of human workforce would not directly influence in generating good business performance, however, innovative human resources would indirectly affect making good business performance by contributing to achieving the development of new products/services that would be successful in the market. These findings would provide valuable managerial implications specifically in regard to the development of corporate culture and education program of small and medium-sized as well as large-sized companies in a variety of fields.