• Journal of Information Science Theory and Practice
• /
• v.3 no.4
• /
• pp.19-34
• /
• 2015

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

• Journal of Information Technology Services
• /
• v.14 no.4
• /
• pp.105-120
• /
• 2015

Enterprise should determine the adoption and utilization of information systems would be a great help to increase management performance. So, it maintains continually the budget and the investment for informatization. However, there is a limit to clarify whether the investment in informatization is contributed to create business opportunities through corporate competitiveness certainty or not. We tend to recognize the information system as a simple means to support common business rather than being used to achieve the company's business performance and to remain competitive. It is not an easy problem for the quantitative evaluation and analysis on the effect of intangible, such as management performance measurement by introducing computerization project. Informatization level evaluation model for the harsh business environment, specifically the Small and Medium Enterprise is lacking. In this paper, we proposed the audit evaluation model of an Small and Medium Enterprise informatization level based on system quality, information quality, user satisfaction, and IT business contribution. The proposed audit evaluation model was evaluated in the information system users, and verified the suitability throughout the survey of the audit professionals.

• Korean Journal of Health Education and Promotion
• /
• v.22 no.3
• /
• pp.83-95
• /
• 2005

Objectives: The aim of this study was to assess the quality of the information and characteristics associated with information packaging, and develop suggestions for how this web site might be improved. Methods: The 50 sites were selected for evaluation. Inclusion criteria for evaluation were the purpose and the popularity of the sites. Two kinds of evaluation tool were employed for the analysis: one that evaluate the quality of information and the design of the web sites, and another that evaluate the covered contents. A scoring system allowed the sites point on yes/no basis on the evaluation items. The association between quality of the web sites on sexuality education and their site characteristics were assessed using ANOVA. Conclusions: Major conclusions were as follows. First, the scope and currency of the selected web sites were found to be appropriate. Second, the authority of the information was found to be the most serious problem of the selected sites. Third, the category of sexual behavior found to be the most frequently mentioned and sexual health was the second. The least mentioned category was personal skills. Finally, sites operated by private organization were found to have more accurate information and better design feature than those operated by public organization and/or individual.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.457-460
• /
• 2014

As to the rapid development of mobile technology, the era of 1-person 1-smart phone has come. Also, the application of smart phone became the part of our life. Especially mobile RPG(Role Playing Game) has the biggest market and the largest number of users. There could be no precise quality assessment result, if quality evaluation model of PC RPG game were applied to the mobile RPG. Thus, it is time to focus on new quality evaluation model for mobile RPG with the great reflection of smart phone attributes. In this paper, based on ISO/IEC 9126, the international standard of software quality, quality evaluation elements for mobile RPG were deducted. Then metrics for validation of elements were redefined and new quality evaluation model was proposed.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.4
• /
• pp.1820-1840
• /
• 2017

Aiming at the phenomenon of false information issued by service providers in cloud computing environment, a method for service evaluation based on fuzzy theory is put forward in this paper. According to the quality of services provided by cloud service providers and their behavior during interactions, a trust relationship between cloud service providers and cloud service consumers is established, which can be quantified by using fuzzy theory. The quality of services is evaluated by drawing on the trust relationship. In our method, the recommendation credibility of a cloud service consumer is determined through behavior similarity with evaluators and a praise factor. The introduction of the praise factor better suits the phenomenon of a high-quality service getting more repeat customers. The negative impact of dishonest customers is reduced, and the accuracy of trust and cloud service quality evaluation is improved by introducing a confidence factor that can be dynamically adjusted. The experimental results show that our method can effectively and accurately evaluate the trust value and service quality of providers, while weakening the influence of dishonest consumers, and quickly detect dishonest service providers. This is beneficial for consumers trying to find high quality service providers for similar services.

• The International Journal of Costume Culture
• /
• v.3 no.2
• /
• pp.136-146
• /
• 2000

The purpose of this study was to investigate the effect of demographic characteristics and general buying characteristics of knitwear consumers on evaluation criteria and information source searching. In this study, a self-administered questionnaire was distributed to young career women and female undergraduate students. Of 580 questionnaires, 496 were used in the following analysis. The data was analyzed with the SPSS package. The research method used factor and reliability analysis to segment consumers by their knitwear evaluation criteria. T-test, one-way ANOVA and χ²were used to characterize the impact of characteristics of the consumer on knitwear evaluation criteria and information source searching in buying knitwear. The results of this study were as follows. First, the information sources of consumers were significantly different depending on their demographic characteristics(age). According to the difference in relationship between the age of consumers and information sources, the younger the consumer, the more information in fashion magazine, the older, in fashion advertisement on catalog. Second, the knitwear evaluation criteria of consumers was classified according to six characteristics - quality, price, aesthetic, situation, self-expression and external. Their knitwear evaluation criteria were significantly different depending on demographic characteristics(job, age, education, marital status) and the general buying characteristics of knitwear(annual knitwear/clothing buying expense and frequency). Career women and married women placed significant importance on practical aspects like quality and price characteristics, while undergraduate students and single women placed significant importance on practical aspects like quality and price characteristics, while undergraduate students and single women placed significant importance on aesthetic and self-expression characteristics. Also, a group with higher annual knitwear/clothing buying expense and frequency considered aesthetic and self-expression characteristics more important. The lower the annual knitwear/clothing buying expense and frequency, the higher a group considered quality and price characteristics more important.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.4
• /
• pp.173-184
• /
• 2012

As a result of the compulsory of information system audit and a rise in audit demand, the quality improvement of information system audit is being emphasized. However, since the current information system audit heavily depends on the auditor's experience, skill, and subjective judgments, it incurs distrust in the objectivity and reliability of audit results from audit interest person. Furthermore, so far research activities aimed at securing the objectivity and reliability of audits have not been adequately carried out. Therefore, this paper presents a quantitative method for information system audit evaluation in order to contribute to the quality improvement of overall information system audit through securing compliance, objectivity, and reliability of information system audit. The quantitative method is largely composed of two sectors, such as evaluation areas and items, scores calculation for evaluation items, and can generally apply the information system audit standard to information system audit evaluation.

• Proceedings of the Korea Institutes of Information Security and Cryptology Conference
• /
• 1995.11a
• /
• pp.41-47
• /
• 1995

This research suggests a criterion, security quality, which is a unifying principle in computer network security that has the lack of a unifying principle. The security quality includes secrecy, integrity, recording, and availability among the factors that represent the security evaluation of the computer system. So, we defined the security quality, which is a basis for determining the security level, as the grand total of evaluation about each factor.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.25 no.1
• /
• pp.343-361
• /
• 2014

This research was conducted to measure the satisfaction level of users and the service quality of specialized libraries in the digital environment. 289 users of 24 government-funded institutes were divided into humanity/social science area and science/technology area for comparison. Using seven hypotheses, the tests were conducted between three independent variables, service quality, space quality, and information quality and one dependent variable, user satisfaction. It was concluded that the competence and quality of the librarian, library homepage, and quality of information are most critical for user satisfaction. Suggestions are made: an improvement in the service quality and specialization of the librarian's skills, a need for librarian's courtesy education, a provision of differentiated and specialized quality of information, an easy access to the library homepage, and supports on the contents and information search.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.28 no.4
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.