• Title/Summary/Keyword: Performance-Evaluation-Centered Test

Search Result 26, Processing Time 0.029 seconds

Design and Evaluation of Hierarchical Menu Structure Related to Human Association Structure: Spreading Activation Model Approach (인간의 연상 구조에 적합한 메뉴의 설계 및 평가: 활성화 확산 모델 접근 방법)

  • Park, Sangsoo;Myung, Rohae
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.30 no.1
    • /
    • pp.17-26
    • /
    • 2004
  • In this study, the usability evaluation of a menu-structure was performed using spreading activation model with respect to human's memory retrieval. Spreading Activation Model is effectively used to understand the process of information retrieval, so it can be used as a theoretical background for modeling of the process of human's information retrieval. For spreading activation test (SAT), subjects were presented with 67 pairs of menu titles, which consist of a menu title in the high level menu item and a menu title for the next lower level menu item, from Korea University's web site. For performance tests, three scenarios were developed with longer reaction times and ambiguous associations found in the SAT to reflect the existing problems of the website. As a result, the SAT was found to bean effective tool to enhance the website usability because the SAT could bea substitute for the performance test with a high correlation $({\rho}=0.735,\;{\alpha}=0.05)$. After remaining menu titles with slow reaction times and ambiguous associations found in SAT, the website usability was significantly improved with faster reaction times and less ambiguous associations proven with smaller number of web-page visits. Therefore, the SAT could be used as a methodology to design and evaluate the user-centered menu structure related to human's association structure.

Performance analysis of tunnel scanning system based on Japanese performance evaluation system (일본 성능평가 제도기반 터널 스캐닝 시스템 성능 분석)

  • Chulhee Lee;Jaemo Kang;Donggyou Kim
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.25 no.4
    • /
    • pp.331-344
    • /
    • 2023
  • The performance of the existing tunnel scanning system was analyzed through the post-evaluation of NETIS (New Technology Information System) and Inspection Support Technology Performance Catalog. Suggestions for improvement and development direction of the tunnel scanning system were deduced. As new technology of Japan gave priority to providing user-centered information, it was possible to objectively compare and analyze the characteristics of various tunnel scan systems through post-evaluation of NETIS and standard test methods in the Inspection Support Technology Performance Catalog. Construction New Technology of Korea was centered on suppliers of technology certification, making it impossible to objectively compare the performance of tunnel scanning systems. The performance was compared and evaluated indirectly by comparing the specifications of the camera, which is a core device of Japan's tunnel scanning system. For the future development of tunnel scanning systems, high-resolution and fast exposure performance of cameras and corresponding high-intensity lighting devices are required. For this purpose, it is necessary to make an experimental environment in which the performance of the camera and lighting can be analyzed indoors.

A Study on the Evaluation of Lighting Performance in an Office Space (사무공간의 조명성능 평가에 관한 연구)

  • 김한성;김영민;김강수
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.17 no.6
    • /
    • pp.16-22
    • /
    • 2003
  • The purpose of this study was to provide visual evaluation data in a workstation space when different lighting types were applied. For the performance evaluation, Radiance program was used for simulations, and the mock-up room(15.0x11.6x3m) was used for the actual test. The results of this study were as follows; 1) When the inidirect lighting simulation data using Radiance was compared with the actual data in a small workstation space, there was a 6.5% difference. Therefore, Radiance program was proved to be useful for the evaluation of lighting performance. 2) Higher light levels (higher light ratio (%)) were recorded in the straddled layout and lower light levels (lower light ratio (%)) were recorded in the centered layout condition in most cases. 3) Also, the results show that the indirect luminaires and the straddled layouts provide higher uniformity, whereas the direct luminaires and the centered layouts have lower uniformity.

Case Study for Test of Practical Competency in ICT (정보통신 실무역량 평가에 대한 사례연구)

  • Shim, Jang-sup;Jeong, Jea-hun;Ihm, Seung-ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2015.05a
    • /
    • pp.67-70
    • /
    • 2015
  • This paper describes a one of HRD Program focus on ICT technology called TOPCIT as that companies and higher education providers voiced the need for a standardized, objective competency index that can reinforce the on-site competency of college students majoring in ICT/SW. And reduce the gap between the viewpoints of industrial and academic circles regarding the qualifications of a competent specialist in ICT field. For this reason, T.OPCIT developed and evaluated a performance-evaluation-centered test designed to diagnose and assess the competency of ICT specialists and SW developers critically needed to perform jobs on the professional frontier. This TOPCIT concept has been promoted not just in KOREA but in many ASEAN countries, e.g Thailand, Nepal, Bhutan, Philippines, Mongolia and Cambodia during the ICTD-USO Forum organised by ITU-ASP.

  • PDF

Performance Verification Process for Introduction of Open Source Software -centered on introduction of Linux into the NEIS-

  • Kim Doo-Yeon;Kim Jong-Bae;Rhew Sung-Yul
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.11 no.3
    • /
    • pp.59-68
    • /
    • 2006
  • Recently, introduction of Open Source Software into informatization of the government and public sector has been actively examined, however, Open Source Software is being rarely adopted due to the lack of verified and reliable data with regard to the criteria, process, performance and stability for introduction of Open Source Software. In this paper, the process, method and plan for performance verification for introduction of Open Source Software into mission critical systems of the government and public sector are suggested in order to solve the aforesaid problem Specially, a test system to judge whether or not to adopt Open Source Software in school affairs system of the NEIS(National Education Information System) of the Korean government was set up, and the method and process of performance verification by stage in addition to feasibility study were applied to the test system for verification. Based on the result of performance evaluation in the test system, the application of Linux to school affairs system of the NEIS is being successfully practiced. It is expected that this study will be a guideline to technical review process and performance verification method as necessary to introduce Open Source Software into the mission critical systems of government and public agencies.

  • PDF

A Study on the Agile Approach in Battlefield Management Information System R&D Project in Korea Military (국방 전장관리정보체계 연구개발사업의 애자일 적용 방안 연구)

  • Yun, SungHyun;Lim, GyooGun
    • Journal of Information Technology Services
    • /
    • v.20 no.1
    • /
    • pp.41-54
    • /
    • 2021
  • The SW-centered battlefield management information system R&D project takes a long period of 5-10 years or more by applying a complex and rigid batch acquisition strategy. In order to solve this problem, it is necessary to institutionalize a rapid and flexible battlefield management information system R&D project management procedure applying agile development methodology, and a government project management organization and contract management method to support it In this study, we analyzed the case of applying the Agile development method centered on Scrum to the US SW-centered weapon system R&D project and the characteristics and problems of the battlefield management information system R&D project in Korea, and suggested improvement measures as follows. First, the battlefield management information system R&D model applies the hybrid development method, and the system requirements analysis and system structure design use the existing waterfall development procedure, and the agile method is applied from the SW requirements analysis to the system integration stage. Second, flexible adjustment of performance, schedule, and cost by organizing an Agile IPT in which military (requirements) - DAPA (project management) - developer - functional specialized organizations (test and evaluation, quality, government research institutes, etc.) participate. Third, improving the Basic Order Agreement so that it can be applied to agile R&D.

Toward Real-world Adoption of Autonomous Driving Vehicle on Public Roadways: Human-Centered Performance Evaluation with Safety Critical Scenarios (자율주행 차량의 실도로 주행을 위한 안전 시나리오 기반 인간중심 시스템 성능평가)

  • Yunyoung Kook;Kyongsu Yi
    • Journal of Auto-vehicle Safety Association
    • /
    • v.15 no.2
    • /
    • pp.6-12
    • /
    • 2023
  • For the commercialization and standardization of autonomous vehicles, demand for rigorous safety criteria has been increased over the world. In Korea, the number of extraordinary service permission for automated vehicles has risen since Hyundai Motor Company got its initial license in March 2016. Nevertheless, licensing standards and evaluation factors are still insufficient for operating on public roadways. To assure driving safety, it is significant to verify whether or not the vehicle's decision is similar to human driving. This paper validates the safety of the autonomous vehicle by drawing scenario-based comparisons between manual driving and autonomous driving. In consideration of real traffic situations and safety priority, seven scenarios were chosen and classified into basic and advanced scenarios. All scenarios and safety factors are constructed based on existing ADAS requirements and investigated via a computer simulation and actual experiment. The input data was collected by an experimental vehicle test on the SNU FMTC test track located at Siheung. Then the offline simulation was conducted to verify the output was appropriate and comparable to the manual driving data.

Usability Test by Integrated Analysis Model - With Emphasis on Eyegaze Analysis of Mobile Interface Design (통합 해석 모델을 활용한 사용성 평가 -모바일 인터페이스 디자인의 시선추적 분석을 중심으로-)

  • 성기원;이건표
    • Archives of design research
    • /
    • v.17 no.3
    • /
    • pp.245-254
    • /
    • 2004
  • In Accordance with the change of design paradigm, the design process has changed into user-centered workflow from designer-centered workflow. Since the purpose of the past research methods is quantitative analysis or the understanding of the present situation, it doesn't fit in practical design that expressed the user's needs. Therefore, the real data about what they see and how they feel will be useful for the user-centered design. This paper's objective is to analyze eye-movement recordings and pupil size of user for mobile interface design. For this objective, it was experimented on that the user's eyegaze data of using a mobile phone by the Eyegaze Interface System, and analyzed three levels of user's task performance. The results provided evaluation of new developed and old existing interface design of mobile phone by the experiment of eye-movement recordings and pupil size. The benefit of results is compliment of the limitation of current usability test through visual characteristics of design and qualitative data of user.

  • PDF

Methods of Subjective Image Quality Evaluation in Pictorial Images (사진의 주관적 화질 평가 방법; 요인 분석을 통한 평가 항목 선정을 중심으로)

  • Noh, Yeon-Sook;Har, Dong-Hwan
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.8
    • /
    • pp.186-197
    • /
    • 2010
  • Recent changes show that the goals of reproduction devices have changed from accurately reproducing scenes to improving user preference. It implies that the directions in developing cameras, the most common reproduction devices, are moving from performance-centered to quality-centered, from developers to users. Accepting such changes demand new standards in evaluating reproduction devices. This paper suggests a new method to evaluate the quality of images, based on cognitive properties of users. The quality of an image is a result oriented from the interaction of various attributes, therefore some functional tests are not enough to evaluate total quality of an image. In this respect, an evaluation model which integrates various physical attributes of an image is needed, that enables a third observer to subjectively evaluate the total quality of an image. In this paper, the experiment was carried out to 127 subjects, with the 84 test stimuli and 11 evaluation factors, followed by an factor analysis. The evaluation factors to assess the quality of images in this paper includes the results by cognitions of users and the properties of reproduction, the factors not only evaluate the quality but suggest how to improve them.

A Study on Test Method for Performance Evaluation of Rockfall Protection Fence (Post) (낙석방지울타리(지주) 성능평가를 위한 시험방법 연구)

  • Jin, Hyunwoo;Hwang, Youngcheol
    • Journal of the Korean GEO-environmental Society
    • /
    • v.23 no.2
    • /
    • pp.5-12
    • /
    • 2022
  • In this study, a field test was conducted to present a test method for performance evaluation of a rock fall prevention fence, centering on the vertical drop test among the existing test methods of the rock fall prevention fence. A test to determine the support capacity of a rockfall prevention fence in Korea is usually conducted using a combination of wire mesh, poles, and wire rope, and the location of the impact of falling rocks has been conducted centered on the center of the wire mesh. However, in the case of domestic papers and test data, there is no data on direct hit of post. Therefore, the amount of displacement and weak section were analyzed when the impact on 100kJ class rock energy was hit on the post, centering on the Rockfall Protection fence (highway type No. 2).