• Title/Summary/Keyword: evaluation frameworks

Search Result 134, Processing Time 0.029 seconds

Comparative Study of Evaluating the Trustworthiness of Data Based on Data Provenance

  • Gurjar, Kuldeep;Moon, Yang-Sae
    • Journal of Information Processing Systems
    • /
    • v.12 no.2
    • /
    • pp.234-248
    • /
    • 2016
  • Due to the proliferation of data being exchanged and the increase of dependency on this data for critical decision-making, it has become imperative to ensure the trustworthiness of the data at the receiving end in order to obtain reliable results. Data provenance, the derivation history of data, is a useful tool for evaluating the trustworthiness of data. Various frameworks have been proposed to evaluate the trustworthiness of data based on data provenance. In this paper, we briefly review a history of these frameworks for evaluating the trustworthiness of data and present an overview of some prominent state-of-the-art evaluation frameworks. Moreover, we provide a comparative analysis of two key frameworks by evaluating various aspects in an executional environment. Our analysis points to various open research issues and provides an understanding of the functionalities of the frameworks that are used to evaluate the trustworthiness of data.

Benchmarking of Design Optimization Frameworks In View of Excel Interface (엑셀 인터페이스 관점에서의 최적설계 프레임웍의 벤치마크)

  • Yum Keun-Chul;Lee Se Jung
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.29 no.3 s.234
    • /
    • pp.403-410
    • /
    • 2005
  • This study presents the benchmark results of several design frameworks for the purpose of developing an efficient design framework in view of Excel interface. For the benchmark, three optimum design problems are chosen and solved by using the design frameworks. In order to compare the frameworks with each other, the evaluation criteria are specified and modified to fit the problems with Excel interface. Three example cases are solved and compared. The evaluation report is summarized in terms of efficiency, ease of use, internal structure, API, etc. However, the optimization result itself is not focused because the specific optimization algorithm is not our concern. Finally, some suggestions of how to develop an efficient design framework with Excel interface are presented.

Role of span length in the adaptation of implant-supported cobalt chromium frameworks fabricated by three techniques

  • Zhou, Ying;Li, Yong;Ma, Xiao;Huang, Yiqing;Wang, Jiawei
    • The Journal of Advanced Prosthodontics
    • /
    • v.9 no.2
    • /
    • pp.124-129
    • /
    • 2017
  • PURPOSE. This study evaluated the effect of span length on the adaptation of implant-supported cobalt chromium frameworks fabricated by three techniques. MATERIALS AND METHODS. Models with two solid abutment analogs at different inter-abutment distances were digitized using a laboratory scanner. Frameworks of two-, three-, and four-unit fixed prostheses were designed by a computer. Six dots with a diameter of 0.2 mm were preset on the surface of each framework. A total of 54 implant-supported cobalt chromium frameworks were fabricated by milling, selective laser melting (SLM), and cast techniques. The frameworks were scanned and exported as Stereolithography files. Distances between two dots in X, Y, and Z coordinates were measured in both the designed and fabricated frameworks. Marginal gaps between the framework and the abutments were also evaluated by impression replica method. RESULTS. In terms of distance measurement, significant differences were found between three- and four-unit frameworks, as well as between two- and four-unit frameworks prepared by milling technique (P<.05). Significant differences were also noted between two- and three-unit frameworks, as well as between two- and four-unit frameworks prepared by cast technique (P<.05). The milling technique presented smaller differences than the SLM technique, and the SLM technique showed smaller differences than the cast technique at any unit prostheses (P<.05). Evaluation with the impression replica method indicated significant differences among the span lengths for any fabrication method (P<.05), as well as among the fabrication methods at any unit prostheses (P<.05). CONCLUSION. The adaptation of implant-supported cobalt chromium frameworks was affected by the span length and fabrication method.

The Development of an IT Evaluation Framework: A Case Study on Firm K (정보기술의 평가모형 개발 : K기업의 사례연구)

  • 김효석;오재인
    • Korean Management Science Review
    • /
    • v.13 no.1
    • /
    • pp.29-46
    • /
    • 1996
  • In the past decade, considerable effort has been devoted unsuccessfully to the development of information technology (IT) evaluation frameworks in the information systems area. Based on the literature review in this area and the decision analysis field, two competing evaluation frameworks are developed in this study: the direct evaluation framework and the indirect evaluation framework. A case study on Firm K shows that the latter is more practically efficient and theoretically appropriate but requires the adequate training for practitioners in order not to get confused the weight of an evaluation variable with the product of this weight and the score of the variable. Another finding is that Weill's conversion effectiveness is neither possible nor necessary to measure in the process of evaluating an IT although it is in theory an important concept.

  • PDF

SECURITY FRAMEWORK FOR VANET: SURVEY AND EVALUATION

  • Felemban, Emad;Albogamind, Salem M.;Naseer, Atif;Sinky, Hassan H.
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.8
    • /
    • pp.55-64
    • /
    • 2021
  • In the last few years, the massive development in wireless networks, high internet speeds and improvement in car manufacturing has shifted research focus to Vehicular Ad-HOC Networks (VANETs). Consequently, many related frameworks are explored, and it is found that security is the primary issue for VANETs. Despite that, a small number of research studies have taken into consideration the identification of performance standards and parameters. In this paper, VANET security frameworks are explored, studied and analysed which resulted in the identification of a list of performance evaluation parameters. These parameters are defined and categorized based on the nature of parameter (security or general context). These parameters are identified to be used by future researchers to evaluate their proposed VANET security frameworks. The implementation paradigms of security frameworks are also identified, which revealed that almost all research studies used simulation for implementation and testing. The simulators used in the simulation processes are also analysed. The results of this study showed that most of the surveyed studies used NS-2 simulator with a percentage of 54.4%. The type of scenario (urban, highway, rural) is also evaluated and it is found that 50% studies used highway urban scenario in simulation.

Case Study on Science Classroom Analysis (과학과 수업 분석에 대한 사례 연구)

  • Kwak, Young-Sun
    • Journal of The Korean Association For Science Education
    • /
    • v.23 no.5
    • /
    • pp.484-493
    • /
    • 2003
  • This case study exemplifies science classroom observation and analysis. Data from two-day classroom observation, pre- and post-instruction interviews with the teacher and instructional materials were used to analyse the features of a science classroom. A teacher's classroom practices were examined in terms of the following six categories: (1)curriculum and science content, (2)teaching and learning methods, (3) teacher' s knowledge about learners, (4)classroom environment, (5)assessment, and (6)teacher's efforts for professional development. The teacher in this case study not only improved his own classroom practices, but also took an active role in teachers' in-service education to share his practical knowledge with others. Implications that valid evaluation(or observation) frameworks of classroom practices have on teacher education and teachers' inservice education are also discussed. These evaluation frameworks should provide teachers with a vision of highly accomplished practices.

The Development of an IT Evaluation Framework: A Case Study on Firm K (정보기술의 평가모형 개발 : K기업의 사례연구)

  • 김효석;오재인
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.13 no.1
    • /
    • pp.29-29
    • /
    • 1988
  • In the past decade, considerable effort has been devoted unsuccessfully to the development of information technology (IT) evaluation frameworks in the information systems area. Based on the literature review in this area and the decision analysis field, two competing evaluation frameworks are developed in this study: the direct evaluation framework and the indirect evaluation framework. A case study on Firm K shows that the latter is more practically efficient and theoretically appropriate but requires the adequate training for practitioners in order not to get confused the weight of an evaluation variable with the product of this weight and the score of the variable. Another finding is that Weill's conversion effectiveness is neither possible nor necessary to measure in the process of evaluating an IT although it is in theory an important concept.

An Evaluation Study on Artificial Intelligence Data Validation Methods and Open-source Frameworks (인공지능 데이터 품질검증 기술 및 오픈소스 프레임워크 분석 연구)

  • Yun, Changhee;Shin, Hokyung;Choo, Seung-Yeon;Kim, Jaeil
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.10
    • /
    • pp.1403-1413
    • /
    • 2021
  • In this paper, we investigate automated data validation techniques for artificial intelligence training, and also disclose open-source frameworks, such as Google's TensorFlow Data Validation (TFDV), that support automated data validation in the AI model development process. We also introduce an experimental study using public data sets to demonstrate the effectiveness of the open-source data validation framework. In particular, we presents experimental results of the data validation functions for schema testing and discuss the limitations of the current open-source frameworks for semantic data. Last, we introduce the latest studies for the semantic data validation using machine learning techniques.

Evaluation of marginal adaptation in three-unit frameworks fabricated with conventional and powder-free digital impression techniques

  • Kocaagaoglu, Hasan;Albayrak, Haydar;Sahin, Sezgi Cinel;Gurbulak, Aysegul Guleryuz
    • The Journal of Advanced Prosthodontics
    • /
    • v.11 no.5
    • /
    • pp.262-270
    • /
    • 2019
  • PURPOSE. The purpose of this in vitro study was to evaluate the marginal misfits of three-unit frameworks fabricated with conventional and digital impressions techniques. MATERIALS AND METHODS. Thirty brass canine and second premolar abutment preparations were fabricated by using a computer numerical control machine and were randomly divided into 3 groups (n=10) as follows: conventional impression group (Group Ci), Cerec Omnicam (Group Cdi), and 3shape TRIOS-3 (Group Tdi) digital impression groups. The laser-sintered metal frameworks were designed and fabricated with conventional and digital impressions. The marginal adaptation was assessed with a stereomicroscope at ${\times}30$ magnification. The data were analyzed with 1-way analysis of variances (ANOVAs) and the independent simple t tests. RESULTS. A statistically significant difference was found between the frameworks fabricated by conventional methods and those fabricated by digital impression methods. Multiple comparison results revealed that the frameworks in Group Ci (average, $98.8{\pm}16.43{\mu}m$; canine, $93.59{\pm}16.82{\mu}m$; premolar, $104.10{\pm}15.02{\mu}m$) had larger marginal misfit values than those in Group Cdi (average, $63.78{\pm}14.05{\mu}m$; canine, $62.73{\pm}13.71{\mu}m$; premolar, $64.84{\pm}15.06{\mu}m$) and Group Tdi (average, $65.14{\pm}18.05{\mu}m$; canine, $70.64{\pm}19.02{\mu}m$; premolar, $59.64{\pm}16.10{\mu}m$) (P=.000 for average; P=.001 for canine; P<.001 for premolar). No statistical difference was found between the marginal misfits of canine and premolar abutment teeth within the same groups (P>.05). CONCLUSION. The three-unit frameworks fabricated with digital impression techniques showed better marginal fit compared to conventional impression techniques. All marginal misfit values were clinically acceptable.