• Journal of Distribution Science
• /
• v.13 no.1
• /
• pp.57-70
• /
• 2015

Purpose - Open source software has high utilization in most of the server market. The utilization of open source software is a global trend. Particularly, Internet infrastructure and platform software open source software development has increased rapidly. Since 2003, the Korean government has published open source software promotion policies and a supply promotion policy. The dynamism of the open source software market, the lack of relevant expertise, and the market transformation due to reasons such as changes in the relevant technology occur slowly in relation to adoption. Therefore, this study proposes an assessment model of services provided in an open source software service company. In this study, the service level of open source software companies is classified into an enterprise-level assessment area, the service level assessment area, and service area. The assessment model is developed from an on-site driven evaluation index and proposed evaluation framework; the evaluation procedures and evaluation methods are used to achieve the research objective, involving an impartial evaluation model implemented after pilot testing and validation. Research Design, data, and methodology - This study adopted an iteration development model to accommodate various requirements, and presented and validated the assessment model to address the situation of the open source software service company. Phase 1 - Theoretical background and literature review Phase 2 - Research on an evaluation index based on the open source software service company Phase 3 - Index improvement through expert validation Phase 4 - Finalizing an evaluation model reflecting additional requirements Based on the open source software adoption case study and latest technology trends, we developed an open source software service concept definition and classification of public service activities for open source software service companies. We also presented open source software service company service level measures by developing a service level factor analysis assessment. The Behavior-Structure-Evolution Evaluation Model (BSEM) proposed in this study consisted of a rating methodology for calculating the level that can be granted through the assessment and evaluation of an enterprise-level data model. An open source software service company's service comprises the service area and service domain, while the technology acceptance model comprises the service area, technical domain, technical sub-domain, and open source software name. Finally, the evaluation index comprises the evaluation group, category, and items. Results - Utilization of an open source software service level evaluation model For the development of an open source software service level evaluation model, common service providers need to standardize the quality of the service, so that surveys and expert workshops performed in open source software service companies can establish the evaluation criteria according to their qualitative differences. Conclusion - Based on this evaluation model's systematic evaluation process and monitoring, an open source software service adoption company can acquire reliable information for open source software adoption. Inducing the growth of open source software service companies will facilitate the development of the open source software industry.

• Journal of Applied Reliability
• /
• v.16 no.2
• /
• pp.134-146
• /
• 2016

Purpose: Many domestic companies have to make out quantitative evaluation table in their proposal when they conduct the software R&D project. However, most of companies have a difficulty to select the evaluation items and criteria, also to derive a quantitative results. Therefore, we propose a method to derive the quantitative evaluation index by utilizing the ISO/IEC 9126-2. Methods: Analyzing ISO/IEC 9126-2, and we classify the quality metrics as high-classification and sub-classification for Web/App software, Embedded software and Installation software. Next, Conduct the metrics selection survey depending on importance and necessity. Then, carry out the case study. Verify the correspondence between evaluation items and criteria from original suggestion of company and from outcome by utilizing the ISO/IEC 9126-2 quality metrics. Results: It is possible to classify into two metrics, one for common software or one another for only special software. Furthermore, there is quality metrics that is more important and more necessary depending upon characteristics of the software. Conclusion: ISO/IEC 9126-2 quality metrics can be used to make an evaluation items and criteria for quantitative evaluation table of software product.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.6
• /
• pp.657-664
• /
• 2014

In this paper, we described evaluation software that can propose rating scale and evaluate automatically on SDR(Software-Defined Radio) transmitter system. To deduct suitable rating scale, we extracted requirements based on the operating environment, operating application and operating method because SDR operating software is subordinative to the hardware. And we implementation evaluation software to automatically quality evaluation using rating scale draw from the requirements. The implemented evaluation software has automatically evaluation functions using script, can update the evaluation factor and show visual evaluation result. The implemented evaluation software is used to useful the high quality SDR operating software development.

• Journal of Information Technology Services
• /
• v.17 no.1
• /
• pp.59-77
• /
• 2018

Software process (SP) authentication is a certification system designed in order to improve software process and ensure software reliability of the Korean small and medium enterprises (SMEs). It is composed of 3 grades, 17 evaluation items and 70 detailed evaluation items (software process). In order to certificate grade 2, 42 detailed evaluation items must be satisfied. In order to certificate grade 3, all 70 detailed evaluation items must be satisfied. SMEs are more vulnerable to manpower and material resources than the major company. Therefore, it is difficult for SMEs to invest in the long term to improve the software process. If we can provide the core evaluation items to SMEs, SMEs will be able to improve software quality more efficiently and effectively. It can be used as a short way to acquire SP authentication. The evaluation items of SP are defined as influencing each other. Therefore, the core evaluation items might be established using related techniques. Although we searched for previous researches and related informations, the associated study was insufficient. In this study, ANP (Analytic Network Process) technique was applied, and the core evaluation items of SP authentication were established. SMEs will be able to acquire SP authentication more easily using the core evaluation items. Finally, we expect that this study will be used as a basis material for creating the SP 2.0 version.

• Advanced Industrial SCIence
• /
• v.1 no.1
• /
• pp.28-34
• /
• 2022

Many studies have been conducted on software quality evaluation. Recently, as artificial intelligence-related software has been developed a lot, research on methods for evaluating artificial intelligence functions in existing software is being conducted. Software evaluation has been based on eight quality characteristics: functional suitability, reliability, usability, maintainability, performance efficiency, portability, compatibility, and security. Research on the part that needs to be confirmed through evaluation of the function of the intelligence part is in progress. This study intends to introduce the contents of the evaluation method in this part. We are going to propose a quality evaluation method for artificial intelligence software by presenting the existing software quality evaluation method and the part to be considered in the AI part.

• Journal of the military operations research society of Korea
• /
• v.11 no.1
• /
• pp.47-54
• /
• 1985

In this paper, for the systematic software evaluation and selection objective, we first discussed the systems software which is distinctly different from applications oriented software in source, concept and use. We suggested the systematic procedures for the effective software evaluation and selection by analyzing categories of commercially available proprietary software, sources of information for software selection, request for information, request for proposal, user surveys as an aid to evaluation and evaluation of responses to the RFP.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.5 no.4
• /
• pp.263-272
• /
• 2009

Nowadays, lots of software that have similar functions is being produced. Hence it is getting more important to select the best and suitable software for each individual or company. Moreover, there are few trustworthy materials regarding to the objective procedure and criteria for the best evaluation of the software quality. To overcome these problems, benchmarking has been carried out. However, benchmarking is also confronting the limit of quality evaluation verification due to the difficult of the objectification of the major test items. To solve these problems, some others try to evaluate the quality of software using objective criteria of evaluation based on ISO/IEC standards. Nevertheless, this method using these defined evaluation items and criteria may result in not very reliable outcome. Therefore, this paper offers the evaluation items reflected in the characteristics of each software in order to prove the validity of the proposed method. Moreover, the objective and quantitative criterion which analyzes and reflects the organization characteristics using AHP methodology is applied to the experiment and performance evaluation. Hence we expect that the proposed method provides the needs of the re-establishment of software quality evaluation criteria and the improvement of process in terms of management.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.8 no.3
• /
• pp.601-614
• /
• 2007

Lately, as importance of biometric is recognized, domestic and foreign biometric software market is soaring and the requests of high reliability and quality of biometric software are inclosed. Evaluation items and criteria must be established for the biometric software quality certification. In this paper, we development the evaluation module for biometric software test based on ISO/IEC 12119 that is the standard about package software quality requirement and test, and ISO/IEC 9126 that is the standard about evaluation of software product, and ISO/IEC 14598-6 that is the standard for construction of the evaluation module. We think that this study can be used in establishing the software quality evaluation method of bio information processing software and constructing the basis for quality improvement.

• Journal of Korean Society for Quality Management
• /
• v.27 no.3
• /
• pp.94-112
• /
• 1999

It is booming to use computer and information owing to the information society. As software applications have grown, so too has the importance of software quality. Therefore, software quality measurement and evaluation are necessary to satisfy the users who are using computers. The ISO/IEC 9126 defines six quality characteristics and twenty-one subcharacteristics including forty inter quality characteristics. We developed software measurement and evaluation technique using the check list in accordance with the ISO/IEC 9126 in design phase. We applied idea and concept of Total Quality Management in order to evaluate and measure the quality of software. Namely, it is the concept such as "you should do it right the first time." or "you have to build quality in the process." We executed the quantitative evaluation of software, also had shown the distinctive result in order that users and developers can find the errors easily. We evaluated the quality of academic softwares in order to verify developing technique at S college. As a result of the evaluation, this college has found it necessary to maintain the software as soon as possible because academic systems are not adequate for users at this present time.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.25 no.3
• /
• pp.109-124
• /
• 2000

For rational human value judgement and evaluation, provision of clear evaluation data, objective value judgement criteria, and properly generalized methods are required. For instance, this is true for software quality evaluation, and the measure of software quality and the weighting method of evaluation target directly affect final decisions. However it is not easy to find a generalized method for the software quality evaluation or product selection, because of its complex characteristics. In this paper, we apply the qualitative preference method based on quantitative belief functions to find a general weighing method for the software quality evaluation. In particular, the qualitative preference method, in which the differentiated preference expression is possible, is conceptually expanded for general applications in future. For this purpose, we hierarchically differentiate the strong preference relation from the weak preference relation, and show an example of quantification of software quality evaluation on different applications, by comparing the qualitative preference method with AHP. We believe that the application domain of this method is not limited to the software quality evaluation and it is very useful to apply this results to other SE areas, e.g., metric selection with different views and riority determination of practices to be assessed in the SPICE.