• Korean Medical Education Review
• /
• v.22 no.3
• /
• pp.198-206
• /
• 2020

This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce 'eye fatigue' and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject's body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.

• Journal of Korean Society of Rural Planning
• /
• v.23 no.3
• /
• pp.133-145
• /
• 2017

The purpose of this study is to assess residents' perception of the revitalization projects of the rural center and to evaluate their views of the projects' importance and their levels of satisfaction with how they have been carried out. In this study, we measured the residents' perceptions and preferences regarding these projects by using Importance-Performance Analysis (IPA). Results showed that residents' perceptions and satisfaction were the highest for the projects providing welfare facilities, even though this project has little relevance to the overall project goal. Residents were dissatisfied with construction projects such as the building of cultural facilities and urban parks, even while recognizing their importance. It is necessary to establish what problem the people perceive and to manage them appropriately. Next, the residents did not appreciate the community empowerment projects, nor did they evaluate the contents of the program positively. It can therefore be seen that the community empowerment projects have not been carried out well. Finally, the street landscape improvement project was not successfully implemented compared to other projects. The residents have negatively perceived the installation of facilities that they do not want, rarely use, or are poorly operated. this shows that the evaluation of residents is significant. They become the users of the revitalization project for the rural center. It is necessary to overcome problems such as project items chosen by professionals without local consultation and obvious design in the revitalization project of the local center. There is a need to ascertain the residents' opinion of each project and to encourage them to participate directly in the management operation.

• Journal of Convergence for Information Technology
• /
• v.7 no.4
• /
• pp.151-157
• /
• 2017

Recently, the expertise of workers in residential facilities for the disabled has been emphasized and the need for education has increased. Therefore, this study analyzed cognition of job importance and educational needs according to workers of the disabled residential. Data were collected from 162 workers of the residential facilities for the disabled in Gyeonggi and were analyzed using t-test and IPA analysis. As results of this study, case management practice (basic), case management practice (advanced), life support for disabled persons (basic), program development (basic), business planning and evaluation (basic), business planning and evaluation (advanced) were both job importance and education needs high. The results of this study can be used as a basic reference for the direction of the education system of the residents of the disabled.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.431-435
• /
• 2022

The fields of STEM (Science, Technology, Engineering and Medicine) are changing rapidly. Recently, with the remarkable development of Internet and Web technologies, an environment that can be accessed worldwide has been created, thereby lowering the barriers to share STEM knowledge and information. The purpose of this study is to derive improvements by evaluating users' satisfaction with the information system developed by applying the open access model in the STEM field. Through an online survey using a structured questionnaire, a total of 204 users participated from January to February. The collected data were analyzed using quantitative statistical techniques. IPA (Importance Performance Analysis) technique was used. By identifying the importance and satisfaction (performance) between variables, areas with relatively low satisfaction compared to importance were derived. Users' overall satisfaction with the open access information system was 81.2 points and social reliability was 85.9 points, which were relatively high, respectively. What should be paid attention to in this study is the satisfaction with the system use environment, which is the most vulnerable area.

• Journal of Digital Convergence
• /
• v.6 no.3
• /
• pp.1-12
• /
• 2008

This research aims at developing and distributing models and indexes that can evaluate ubiquitous information projects in order to enhance the objectivity and validity of their evaluation. The research adopts a BSC(Balanced Score Card) concept with four views, economic, policy, social, and technical views. The research induces a model of pre-evaluation and a model of post-evaluation according to each view. In order to secure the validity of the models, they are revised and complemented by obtaining advice through interviews with five experts in related fields, and the validity and application possibility of the indexes are verified by surveying ten people working in those fields. Finally, investigating their weights according to the importance of each view and index, they are evaluated using an AHP (Analytic Hierarchy Process) method.

• The Journal of Society for e-Business Studies
• /
• v.9 no.1
• /
• pp.123-137
• /
• 2004

Despite the increasing interest in web contents and the rapid growth of CMS(Content Management System) market, the studies on the evaluation criteria for determining the purchase of the CMS solution are very rare. We introduce previous researches on the evaluation models of IT solution, and develop new criteria for evaluating CMS solutions. We calculate the relative importance of the evaluation criteria using scores from the IT experts based on the "Pair-wise Comparison" using the AHP. Based on the analyses of IT specialists′ responses, the results of the study show that, among the ten criteria, "the function of content management", "the contribution to the company′s business process" and "the fit with Information Strategic Plan" are the three most important ones over the remaining others. The developed model and criteria for the evaluation of the CMS solutions are expected to contribute on effective purchasing decision of the solutions and their successful implementation.

• Journal of The Korea Institute of Healthcare Architecture
• /
• v.17 no.4
• /
• pp.25-37
• /
• 2011

As International considerations about the Barrier-Free environment increase, Korean Barrier-Free Environment Certification System has operated since 2008 in Korea. The purpose of this study is to find way to improve evaluation items, so this study analyzed the result of examination certified facilities and investigated the importance of the evaluation item for conducted a questionair survey with the BF experts. As a result, a lower scored and high important item should assign a higher score or lower the difficulty level, so induces applicants to be certified. Second, a higher scored and lower important item should assign a lower score or increase the difficulty of evaluating. The results suggested are expected the use in the improvement direction of BF certification evaluation items.

• Korean Management Science Review
• /
• v.14 no.1
• /
• pp.177-203
• /
• 1997

This study concerns performance evaluation of the research-funding agencies focused on Korea Science and Engineering Foundation(KOSEF). On the basis of the constituents approach and the systems approach of organizational effectiveness theory, the evaluation items are derived reflecting generic characteristics of the research-funding agencies, and their priorities are determined using analytic hierarchy process(AHP). Three groups of constituents with differing interest and expections are identified, and their perceptions on the importance of the evaluation items are measured through questionnaire survey. Analyses show that the evaluation items perceived important by each constituency are significant different from one another. The implications of the result to the Government and KOSEF are discussed.

• Journal of environmental and Sanitary engineering
• /
• v.15 no.2
• /
• pp.85-94
• /
• 2000

The comparative evaluation is the most effective method for site selection because the selection of waste treatment facility is to determine the optimum site out of limited candidate sites. This study adopted the ordinal scale evaluation, one of methods of comparative evaluation. The ordinal scale evaluation aims to determine the investigating items referring to the character of sites, to determine the importance factors for investigating items, and to determine the optimum site according to the quantitative evaluation. This study has focussed on reflecting the opinion of residents to the maximum extent with a weight on social and economic aspects, considering the state of confrontation against each other between the autonomous government organization and local residents, which is being emerged as a social issue relating to the evaluation rating on each item of site selection of an optimum site. Therefore, rational, and clear validity investigations and proper reduction of both time and expenses in site selection as well through this a study.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.14 no.1
• /
• pp.177-177
• /
• 1989

This study concerns performance evaluation of the research-funding agencies focused on Korea Science and Engineering Foundation(KOSEF). On the basis of the constituents approach and the systems approach of organizational effectiveness theory, the evaluation items are derived reflecting generic characteristics of the research-funding agencies, and their priorities are determined using analytic hierarchy process(AHP). Three groups of constituents with differing interest and expections are identified, and their perceptions on the importance of the evaluation items are measured through questionnaire survey. Analyses show that the evaluation items perceived important by each constituency are significant different from one another. The implications of the result to the Government and KOSEF are discussed.