• Journal of Korean Library and Information Science Society
• /
• v.53 no.3
• /
• pp.455-477
• /
• 2022

This study aimed to compare and analyze librarian teacher evaluation index from evaluation of teachers' competency development with the the topics of information utilization education. To this end, LDA topic modeling was conducted by collecting papers related to information utilization education published in four major journals in the field of literature and information from 1995 to May 2022. As a result of topic modeling, it can be seen that information utilization education (T10) was the most actively discussed at 12.0% of the 20 topics, followed by library utilization classes (T2) 10.4% and user service (T3) 8.8%.On the other hand, 3.3% of reading discussion (T7), 2.9% of reading education (T19), 2.1% of manpower management (T13), and 2.1% of librarian teacher job satisfaction (T17) showed the lowest distributions 3.3%, 2.9%, 2.1%, and 2.1%, respectively. In addition, although librarian teacher's class model development (T1) and curriculum development (T20) are essential processes for collaborative classes and information utilization education, they were not reflected in the current teacher competency development evaluation index. Therefore, this study proposed that 'instructional model and curriculum development' indicator should be added on 'training and support classes' factors in the Librarian Teacher Evaluation Index in Teachers' Competency Development Evaluation for further evaluation.

• Journal of Korean Society of Archives and Records Management
• /
• v.22 no.4
• /
• pp.25-43
• /
• 2022

The ultimate record management's purpose is preservation and utilization. However, the National Archives of Korea (NAK)s Portal has problems such as search system aging and search tools dualization. As a result, the users' search satisfaction is not satisfied, and the improvement demand increases. This study aimed to evaluate the NAK's search quality as a preliminary study for NAK search system advancement. To this end, we analyzed the current status of CAMS and NAK's Portal. Then, we established the test sets and evaluated the NAK's Portal quality from the user's point of view. Evaluation results were analyzed using Precision, Recall, F-score, and MRR. The analysis results showed that the overall search performance was low, particularly in the "advanced subject search," which showed low performance in Precision, Recall, and MRR. Thus, improvement is urgently needed. The test sets established for this study are expected to be used as a basis for objectively measuring the improvement of the search performance after the NAK search system advancement.

• The KIPS Transactions:PartA
• /
• v.19A no.3
• /
• pp.147-154
• /
• 2012

The higher thinking skills, such as creativity and problem-solving about a given problem, are difficult to assess and diagnose. For an accurate diagnosis of these higher thinking abilities, we need to fully observe learner's problem-solving process or learner's individual reports. However, in an online learning or virtual class environments, evaluation of learner's problem-solving process becomes more difficult to diagnose. The best way to solve this problem is through reporting by tracking learner's actions when he tries to solve a problem. In this study, we developed a module which can evaluate and diagnose student's problem-solving ability by tracking actions in MS-Office suite, which is used by students to solve a given problem. This module performs based on the learner's job history through user tracking. To evaluate the effectiveness of this diagnostic module, we conducted satisfaction survey from students who were preparing the actual MOS exams. As a result, eighty-one (81) of the participants were positive on the effectiveness of the learning system with the use of this module.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.2
• /
• pp.405-414
• /
• 2017

In this study, a survey for a satisfaction evaluation of the Test Report Information Service (TRIS) was conducted. A survey questionnaire on modified Information System Success Model(ISSM) of Delone and Mclean was carried out by 183 users in three groups, such as munition quality assurance agency, munition corporation, and test institute. As a survey result, training on the TRIS was in strong demand in all three groups. An understanding and proficiency of the overall system were different from the work process of each user group. In addition, the munition quality assurance agency needs to enhance the system function with its characteristics. Test institute has necessity of the linkage method with the TRIS depending on the authentication system. User groups are different in the operational method of TRIS between the contractor and cooperation. Accordingly, cooperation needs to be educated continually. This study can help in the construction of a Military Quality Integration Information System to secure the reliability of munitions.

• Journal of Intelligence and Information Systems
• /
• v.25 no.3
• /
• pp.117-140
• /
• 2019

As the aging phenomenon accelerates and various social problems related to the elderly of the vulnerable are raised, the need for effective elderly care solutions to protect the health and safety of the elderly generation is growing. Recently, more and more people are using Smart Toys equipped with ICT technology for care for elderly. In particular, log data collected through smart toys is highly valuable to be used as a quantitative and objective indicator in areas such as policy-making and service planning. However, research related to smart toys is limited, such as the development of smart toys and the validation of smart toy effectiveness. In other words, there is a dearth of research to derive insights based on log data collected through smart toys and to use them for decision making. This study will analyze log data collected from smart toy and derive effective insights to improve the quality of life for elderly users. Specifically, the user profiling-based analysis and elicitation of a change in quality of life mechanism based on behavior were performed. First, in the user profiling analysis, two important dimensions of classifying the type of elderly group from five factors of elderly user's living management were derived: 'Routine Activities' and 'Work-out Activities'. Based on the dimensions derived, a hierarchical cluster analysis and K-Means clustering were performed to classify the entire elderly user into three groups. Through a profiling analysis, the demographic characteristics of each group of elderlies and the behavior of using smart toy were identified. Second, stepwise regression was performed in eliciting the mechanism of change in quality of life. The effects of interaction, content usage, and indoor activity have been identified on the improvement of depression and lifestyle for the elderly. In addition, it identified the role of user performance evaluation and satisfaction with smart toy as a parameter that mediated the relationship between usage behavior and quality of life change. Specific mechanisms are as follows. First, the interaction between smart toy and elderly was found to have an effect of improving the depression by mediating attitudes to smart toy. The 'Satisfaction toward Smart Toy,' a variable that affects the improvement of the elderly's depression, changes how users evaluate smart toy performance. At this time, it has been identified that it is the interaction with smart toy that has a positive effect on smart toy These results can be interpreted as an elderly with a desire to meet emotional stability interact actively with smart toy, and a positive assessment of smart toy, greatly appreciating the effectiveness of smart toy. Second, the content usage has been confirmed to have a direct effect on improving lifestyle without going through other variables. Elderly who use a lot of the content provided by smart toy have improved their lifestyle. However, this effect has occurred regardless of the attitude the user has toward smart toy. Third, log data show that a high degree of indoor activity improves both the lifestyle and depression of the elderly. The more indoor activity, the better the lifestyle of the elderly, and these effects occur regardless of the user's attitude toward smart toy. In addition, elderly with a high degree of indoor activity are satisfied with smart toys, which cause improvement in the elderly's depression. However, it can be interpreted that elderly who prefer outdoor activities than indoor activities, or those who are less active due to health problems, are hard to satisfied with smart toys, and are not able to get the effects of improving depression. In summary, based on the activities of the elderly, three groups of elderly were identified and the important characteristics of each type were identified. In addition, this study sought to identify the mechanism by which the behavior of the elderly on smart toy affects the lives of the actual elderly, and to derive user needs and insights.

• Information Systems Review
• /
• v.11 no.1
• /
• pp.19-47
• /
• 2009

Many products today tend to adopt a convergence approach by adding new features or functionalities to the existing products. The convergence, however, results in both positive and negative effects on usage of products, and thus demonstrates the characteristics called "paradox of technology." On the one hand, the added functionalities or features will increase the usefulness of the products. On the other hand, the convergence increases complexity of learning and usage of products and may decrease satisfaction or user evaluations. This study provides an empirical evidence of this paradox through investigation of telematics, one of the exemplary products of convergence services. Our research model is designed to test the existence of the "paradox of technology" and includes variables such as variety of functions, complexity of usage, perceived usefulness, service evaluation, and service fit. The proposed research model and subsequent hypotheses are empirically tested using 149 survey responses from telematics users. We have found that the variety of functions is positively associated with perceived usefulness, but is negatively associated with the complexity of usage. The data analysis reveals that the perceived usefulness has more significant impacts on service evaluation than the complexity of usage does. Furthermore, the strength of causal relationships among these variables is partially moderated by the degree of service fit. This study thus highlights the paradox of technology in explaining user attitudes and beliefs associated with convergence services.

• Journal of agricultural medicine and community health
• /
• v.42 no.3
• /
• pp.132-144
• /
• 2017

Objectives: The purpose of this study was to identify the association between satisfaction with assistive technology devices and psychosocial impact among some mentally or physically disabled children. Methods: The study subjects were 120 disabled children and their primary caregivers who were using rental assistive technology devices in Gwangju and Jeollanam-Do. Data were collected by structured questionnaire composed of general characteristics of subjects, characteristics related with using assistive devices. Quebec User Evaluation of Satisfaction with assistive Technology 2.0 (QUEST 2.0) and Psychosocial Impact of Assistive Device Scale (PIADS). The statistical analysis were performed by descriptive statistics, t-test, ANOVA and Pearson's correlational analysis. Results: The total mean score for QUEST 2.0 was $4.08{\pm}0.66$ (satisfaction with devices, $4.01{\pm}0.70$; satisfaction with the assistive devices service, $4.14{\pm}0.90$) and the mean of PIADS was $1.00{\pm}0.75$ (ability, $0.99{\pm}0.78$; adaptability, $1.04{\pm}0.86$; self-respect, $0.99{\pm}0.74$). The scores of PIADS was statistically significant difference according to usage time of assistive devices. The PIADS was significantly positive correlated with QUEST 2.0 Conclusions: The mentally or physically disabled children reported that the higher level of satisfaction and the more positive impact of psychosocial aspect with assistive technology devices. It would be necessary to perform further studies for addressing the effects of assistive technology devices.

• Knowledge Management Research
• /
• v.21 no.1
• /
• pp.197-210
• /
• 2020

The smart speaker includes an AI assistant function in the existing portable speaker, which enables a person to give various commands using a voice and provides various offline services associated with control of a connected device. The speed of domestic distribution is also increasing, and the functions and linked services available through smart speakers are expanding to shopping and food orders. Through text mining-based customer review analysis, there have been many proposals for identifying the impact on customer attitudes, sentiment analysis, and product evaluation of product functions and attributes. Emotional investigation has been performed by extracting words corresponding to characteristics or features from product reviews and analyzing the impact on assessment. After obtaining the topic from the review, the effect on the evaluation was analyzed. And the market competition of similar products was visualized. Also, a study was conducted to analyze the reviews of smart speaker users through text mining and to identify the main attributes, emotional sensitivity analysis, and the effects of artificial intelligence attributes on product satisfaction. The purpose of this study is to collect blog posts about the user's experiences of smart speakers released in Korea and to analyze the attitudes of customers according to their attributes. Through this, customers' attitudes can be identified and visualized by each smart speaker product, and the positioning map of the product was derived based on customer recognition of smart speaker products by collecting the information identified by each property.

• Journal of the Korea Society of Computer and Information
• /
• v.18 no.4
• /
• pp.57-64
• /
• 2013

During the past 10 years, serious game industry has been growing steadily. But the system which could stably and reliably provide metadata information and quality information related to serious game remained unexploited. Existing systems only support the basic management functions of metadata search centered. Therefore, we have developed an integrated system to manage the quality information of serious game as well as to improve the inconvenient details of the existing systems. And we designed quality evaluation elements and quality information supply-methods, and linked up them to the system. Furthermore, we conducted user's satisfaction assessment survey on the use of the system. The advantage of the system is that the system provide a lot of useful information for general users and developers, and support a tool to manage all information related to serious game by easy and convenient method for managers.

• Journal of Korean Society of Archives and Records Management
• /
• v.23 no.2
• /
• pp.117-135
• /
• 2023

The National Archives of Korea (NAK) operates the NAK Portal as a record search system. However, user search satisfaction is too low, and the number of visitors to the portal is gradually decreasing. This study identifies the portal's issues, proposes feasible improvements, and constructs a pilot system to validate the solutions. The preliminary assessment revealed six major issues, such as poor search tool performance and the lack of consistency in search results. After clarifying the improvement measures, a pilot system was established and compared with the National Records Portal. The evaluation showed significant performance improvements in the pilot system, such as Precision, Recall, and Mean Reciprocal Rank (MRR).