• The Korean Journal of Archival Studies
• /
• no.25
• /
• pp.3-46
• /
• 2010

Digital records management is one whole system in which many social and technical elements are interacting. To maintain the trustworthiness, the repository needs periodical audit and certification. Thus, individual electronic records management agency needs toolkit that can be used to self-evaluate their trustworthiness continuously, and self-assess their atmosphere and system to recognize deficiencies. The purpose of this study is development of self-certification toolkit for repositories, which synthesized and analysed such four international standard and best practices as OAIS Reference Model(ISO 14721), TRAC, DRAMBORA, and the assessment report conducted and published by TNA/UKDA, as well as MoRe2 and current national laws and standards. As this paper describes and demonstrate the development process and the framework of this self-certification toolkit, other electronic records management agencies could follow the process and develop their own toolkit reflecting their situation, and utilize the self-assessment results in-house. As a result of this research, 12 areas for assessment were set, which include (organizational) operation management, classification system and master data management, acquisition, registration and description, storage and preservation, disposal, services, providing finding aids, system management, access control and security, monitoring/audit trail/statistics, and risk management. In each 12 area, the process map or functional charts were drawn and business functions were analyzed, and 54 'evaluation criteria', consisted of main business functional unit in each area were drawn. Under each 'evaluation criteria', 208 'specific evaluation criteria', which supposed to be implementable, measurable, and provable for self-evaluation in each area, were drawn. The audit and certification toolkit developed by this research could be used by digital repositories to conduct periodical self-assessment of the organization, which would be used to supplement any found deficiencies and be used to reflect the organizational development strategy.

• Journal of Korean Society of Archives and Records Management
• /
• v.21 no.3
• /
• pp.187-215
• /
• 2021

Archives should provide a web-based archival information service with good usability based on the understanding of users' needs. Thus, this study analyzed the usability of the National Archives of Korea (NAK) website's search service through expert and usability evaluations for various users and suggested improvement plans. A literature review, heuristic evaluation, one of the usability expert evaluation methods, and usability evaluation for users were performed. As a result of expert evaluation, the severity rating for the usability problem was highest regarding a match between the system and real world and the lowest in error prevention. In the usability evaluation, it was assumed that the user's background and whether the website's help was provided is associated with usability. Usability evaluation was conducted for 22 participants, including those majoring in records management, web/application developers, and people without such backgrounds. Furthermore, a presurvey, a five-second test, and search tasks were conducted in a row. The analysis based on usability components in ISO 9241-11: 2018, i.e., effectiveness, efficiency, and satisfaction, showed that web/application developers had the highest search effectiveness, and those majoring in records management showed high effectiveness only in the search for archival content services. Background factors did not affect efficiency, and the more familiar with the finding aids, the better the efficiency. Moreover, providing the website's help was found to be positively associated with effectiveness and satisfaction. This study suggests that the NAK website will offer a user-friendly interface and search function, expand help support, and display a consistent web interface.

• Journal of Korean Society of Archives and Records Management
• /
• v.23 no.2
• /
• pp.117-135
• /
• 2023

The National Archives of Korea (NAK) operates the NAK Portal as a record search system. However, user search satisfaction is too low, and the number of visitors to the portal is gradually decreasing. This study identifies the portal's issues, proposes feasible improvements, and constructs a pilot system to validate the solutions. The preliminary assessment revealed six major issues, such as poor search tool performance and the lack of consistency in search results. After clarifying the improvement measures, a pilot system was established and compared with the National Records Portal. The evaluation showed significant performance improvements in the pilot system, such as Precision, Recall, and Mean Reciprocal Rank (MRR).

• Journal of the Korean Society for information Management
• /
• v.26 no.4
• /
• pp.277-298
• /
• 2009

This study discussed on production, procedures of collection, accessibility, copyright of archival records for designing oral history archive information system, and aimed to suggest practical standards by developing guidelines for evaluation and building of web oral history archives. For this, based on evaluation framework, guidelines for evaluation designed by researchers were applied to five domestic and foreign web oral history archives as case study analysis. Base on the results of the analysis, some possible suggestions were made for building successful web oral history archive information system in Korea.

• Journal of Korean Society of Archives and Records Management
• /
• v.17 no.1
• /
• pp.217-244
• /
• 2017

With the development of information technology, users can freely search records and archives without the involvement of archivists. However, existing records retrieval systems show only partial search results, which do not consider the users' intention. To overcome this problem, semantic web technology is being developed, and the International Council on Archives (ICA) is working to develop RIC (Records In Context), a new archival description standard, which reflects the trend. The conceptual model for archival description and its ontology of RIC are the basis for implementing semantic-based retrieval. In other words, it is necessary to consider the viewpoint of the users on how the records retrieval based on meaning should be designed and provided. Therefore, this study selected three cases of systems, which are built as semantic web technology, and conducted interviews of the users for the evaluation of the systems based on user experience. This study proposes the kind of interface that can be implemented for the ontology-based record retrieval system.

• Journal of Korean Society of Archives and Records Management
• /
• v.23 no.4
• /
• pp.137-157
• /
• 2023

The scale of research and development (R&D) investment is increasing to strengthen national competitiveness through technological innovation, leading to an increased interest in investment efficiency. In records management, the National Archives of Korea has been leading the national research and development project since 2008. Accordingly, this study analyzed R&D projects in records management regarding implementing organization, performance or outcomes, and subjects, targeting 111 National Archives of Korea contract research projects from 2008 to 2022. The analysis showed that small and medium-sized enterprises (SMEs) were the most likely to conduct research, the majority of the research outcomes were academic publications, and there were some discrepancies between the reported performance in research and the actual performance. In terms of research subjects, the most common type of records are paper or print documents, establishing an electronic management system among the National Archives' works. In terms of the frequency of keywords in the records management process and research projects, it was found that research was mainly conducted on "preservation." Meanwhile, only 10 cases, or 9% of the 111 projects, were found to be relevant in terms of utilizing big data and developing intelligent technologies related to digital transformation. Therefore, the effectiveness of the R&D project must be improved through follow-up management of the results even after the research project is completed. In addition, in terms of research topics, it was identified that aside from "preservation," studies focusing on "transfer," "classification," "evaluation," and "collection," as well as research that responds to digital transformation, are needed.

• Health Policy and Management
• /
• v.16 no.1
• /
• pp.17-40
• /
• 2006

With the prospect of rapidly growing health insurance expenditures, particularly spending for ambulatory care, the introduction of a case-based payment method is discussed as an alternative to the current fee-for-service based method. A system to measure case mixes of providers is a core component of such payment systems. The objective of this study were to develop a classification system for ambulatory care, Korean Ambulatory Patient Group (KAPG) based on the U.S. APG version 2.0 and to evaluate the classification accuracy of the system. A database of 64,258,386 records was constructed from insurance claims submitted to the Health Insurance Review Agency (HIRA) during three months from August 2002. A total of 41,347,307 records with a single visit was used for the development and 7% random sample of the database was used for the evaluation. Additional groups were defined to include both physician and hospital fees in the classification, age splits were added to classify the entire population as well as the population older than 65, and the definition of medical groups used by the HIRA was adopted. The variance reduction in charges achieved by KAPGs was computed to evaluate the accuracy of classification. A total of 474 KAPGs was defined compare to 290 groups in the U.S. APG. The variance reduction for charges of all visits ranged from 20% to 37% depending on the type of provider, and ranged from 22% to 42% for non-outliers, that were better than those achieved by the system currently used by the .HIRA for its internal review purpose. Although further study is required to improve the classification for complicated care in larger hospitals, the results indicated that KAPGs could be used for better management of costs for ambulatory care.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.18 no.2
• /
• pp.39-59
• /
• 2007

With the rapid spread of the practice of collecting and treating data by using a data base system, it's increasingly more critical to approach data sets in the same manner as general records in the collection, evaluation, preservation, and utilization process. Despite the importance, however, the interest level in data sets in Korea's records management is very low. In order to suggest basic items to regard data sets as records and manage them systematically, this study examined the descriptive elements of data set records. descriptive elements of data set records were suggested by comparing and analyzing those ones adopted by the agencies that regarded data sets as records and provided the concerned service as well as the descriptive rules of electronic records set by the advanced nations in records management based on the descriptive areas of ISAD(G).

• Radiation Oncology Journal
• /
• v.30 no.1
• /
• pp.43-48
• /
• 2012

Purpose: To develop the dose volume histogram (DVH) management software which guides the evaluation of radiotherapy (RT) plan of a new case according to the biological consequences of the DVHs from the previously treated patients. Materials and Methods: We determined the radiation pneumonitis (RP) as an biological response parameter in order to develop DVH management software. We retrospectively reviewed the medical records of lung cancer patients treated with curative 3-dimensional conformal radiation therapy (3D-CRT). The biological event was defined as RP of the Radiation Therapy Oncology Group (RTOG) grade III or more. Results: The DVH management software consisted of three parts (pre-existing DVH database, graphical tool, and $Pinnacle^3$ script). The pre-existing DVH data were retrieved from 128 patients. RP events were tagged to the specific DVH data through retrospective review of patients' medical records. The graphical tool was developed to present the complication histogram derived from the preexisting database (DVH and RP) and was implemented into the radiation treatment planning (RTP) system, $Pinnacle^3$ v8.0 (Phillips Healthcare). The software was designed for the pre-existing database to be updated easily by tagging the specific DVH data with the new incidence of RP events at the time of patients' follow-up. Conclusion: We developed the DVH management software as an effective tool to incorporate the phenomenological consequences derived from the pre-existing database in the evaluation of a new RT plan. It can be used not only for lung cancer patients but also for the other disease site with different toxicity parameters.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.13 no.3
• /
• pp.235-242
• /
• 2020

This paper proposes a system that can manage and verify personal career information through a block chain to solve the problem of getting a job by forging an individual's career when hiring employees. Blockchain network uses private network, and inside the block, the user's academic and career information is kept. The functions of the block chain perform the functions of block creation, block internal data retrieval, career and academic verification, which works through chain code. As a result of the performance evaluation of the proposed system, the processing time per transaction was measured at approximately 110 ms and the search time was measured at 10 ms, and it was applied to the actual system to confirm that it was available.