• Title/Summary/Keyword: policy directions

Search Result 1,130, Processing Time 0.03 seconds

Developing National Science Assessment System:Scientific Knowledge Domain (국가 수준의 과학 지식 평가 체제 개발)

  • Kwon, Jae-Sool;Choi, Byung-Soon;Kim, Chan-Jong
    • Journal of The Korean Association For Science Education
    • /
    • v.18 no.4
    • /
    • pp.601-615
    • /
    • 1998
  • Establishing and evaluating science education policies and revising and monitoring the effectiveness of science curriculum should be based upon the results of systematic and scientific research studies. Advanced nations have already been administering and developing national level science assessments for these purposes. The science assessments administered in Korea have been reported having many limitations and problems, and not succeeded in providing data for science education policy making and curriculum reform. The major purpose of the study is developing national level science knowledge assessment system in order to identify longitudinal trends of elementary and secondary school students science knowledge achievements. The research team consisted of science education experts and teachers from various school levels, decided the directions and major elements of national level science knowledge assessment with the consultation of educational evaluation experts. Item developing ability of the researchers was improved by seminars? and workshops on national assessment in advanced nations and developing skills of writing science items. Nearly 500 items were developed and revised. Pilot test was administered with 958 students at various school levels. 380 items were selected and tested with 8766 students, and the characteristics were analyzed in terms of item response theory. The target populations for national level science knowledge assessment are 5th-grade of elementary school, 2nd-grade of middle school, 1st and 2nd-grade of high school students. The proper period for the assessment is February every year. Multi-stage clustered sampling method is desirable and rotated forms are recommendable for the test format. Bridge items should be introduced to compare the results of multiple tests, and various grades. Anchor items should also be used for longitudinal interpretations of the results. The items for elementary school require low to medium abilities, for middle school and first grade of high school require medium to high abilities and for 2nd-grade of high school high abilities. The discrimination ability of the items developed is high.

  • PDF

Development of Evaluation Indicators of the Records Management Condition of Public Organizations (공공기관의 기록관리현황 평가지표 개발)

  • Jeon, Soo-Jin
    • The Korean Journal of Archival Studies
    • /
    • no.18
    • /
    • pp.3-36
    • /
    • 2008
  • Despite the institutional, organizational, and technological advances in the level of national records management that has occurred during the past several years, there has been no significant change in the condition of records management within individual public institutions, which may be an outset for records management. In order to begin the advance in national records management with overall innovation in records management by public institutions, it is necessary to distinctly set up the direction of innovation and a project to carry out. Also, a person in charge of records management, who is supposed to lead records management in each institution, should share the directions and projects. Against this backdrop, this study aims to define "the evaluation of records management" as a vehicle to establish a common goal for the innovation of records management and the role of a person in charge of records management as well as to develop evaluation indicators that might be applicable to all public institutions. With this aim, the study drew requirements of records management from domestic and overseas cases in the evaluation of records management conditions as well as the laws and standards of records management, and a roadmap for national records management innovation. Then, the study developed evaluation indicators by classifying the requirements according to three areas involving an organizational environment, records management job, and records management in the offices that create and file their own documents. The organizational environment area is concerned with the evaluation of the records management policy and the responsibility of an institution, and the evaluation of human resources and physical environment. The records management business area includes the measurement of the level of jobs, such as the records creation control conducted by the records management authority of each institution, the management of records schedules, the accession, preservation, and appraisal of records and their service, and the monitoring of records management. The area of records management in the offices is composed of the creation, registration, arrangement, and transfer of records as they are intended to be used during the monitoring of records management conditions. The study made it possible to measure all evaluation indicators with a quantitative evaluation method by clearly proposing the standard for objective and accurate evaluation.

A Study on the Paleotopographic and Structural Analyses of Cherwon Castle in Taebong (태봉 철원도성의 고지형과 구조 분석 연구)

  • HEO, Uihaeng;YANG, Jeongseok
    • Korean Journal of Heritage: History & Science
    • /
    • v.54 no.2
    • /
    • pp.38-55
    • /
    • 2021
  • Cherwon Castle is located in Pungcheonwon, Cherwon, in the center of the Korean Peninsula. Currently, it is split across the Demilitarized Zone (DMZ) between the two Koreas. It attracts attention as a symbol of inter-Korean reconciliation and as cultural heritage that serves as data in making important policy decisions on the DMZ. Despite its importance, however, there has not been sufficient investigation and research done on Cherwon Castle. This is due to the difficulty involved in investigation and research and is caused by the site's inaccessibility. As a solution, the current investigative methods in satellite and aerial archeology can be applied to interpret and analyze the structure of Cherwon Castle and the features of its inner space zoning. Cherwon Castle was built on the five flat hills that begin in the northern mountainous hills and stretch to the southwest. The inner and outer walls were built mainly on the hilly ridges, and the palace wall was built surrounding a flat site that was created on the middle hill. For each wall, the sites of the old gates, which were erected in various directions , have been identified. They seem to have been built to fit the direction of buildings in the castle and the features of the terrain. The castle was built in a diamond shape. The old sites of the palace and related buildings and landforms related to water drainage were identified. It was verified that the roads and the gates were built to run from east to west in the palace. In the spaces of the palace and the inner castle, flat sites were created to fit different landforms, and building sites were arranged there. Moreover, the contour of a reservoir that is believed to be the old site of a pond has been found; it lies on the vertical extension of the center line that connects the palace and the inner castle. Between the inner castle and the outer castle, few vestiges of old buildings were found, although many flat sites were discovered. Structurally, Cherwon Castle is rotated about nine degrees to the northeast, forming a planar rectangle. The planar structure derives from the castle design that mimics the hilly landform, and the bending of the southwestern wall also attests to the intention of the architects to avoid the wetland. For now, it is impossible to clearly describe the functions and characters of the building sites inside the castle. However, it is believed that the inner castle was marked out for space for the palace and government offices, while the space between the outer and inner castle was reserved as the living space for ordinary people. The presence of the hilly landform diminishes the possibility that a bangri (grid) zoning system existed. For some of the landforms, orderly zoning cannot be ruled out, as flat areas are commonly seen. As surveys have yet to be conducted on the different castles, the time when the walls were built and how they were constructed cannot be known. Still, the claim to that the castle construction and the structuring of inner spaces were inspired by the surrounding landforms is quite compelling.

Landscape Object Classification and Attribute Information System for Standardizing Landscape BIM Library (조경 BIM 라이브러리 표준화를 위한 조경객체 및 속성정보 분류체계)

  • Kim, Bok-Young
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.51 no.2
    • /
    • pp.103-119
    • /
    • 2023
  • Since the Korean government has decided to apply the policy of BIM (Building Information Modeling) to the entire construction industry, it has experienced a positive trend in adoption and utilization. BIM can reduce workloads by building model objects into libraries that conform to standards and enable consistent quality, data integrity, and compatibility. In the domestic architecture, civil engineering, and the overseas landscape architecture sectors, many BIM library standardization studies have been conducted, and guidelines have been established based on them. Currently, basic research and attempts to introduce BIM are being made in Korean landscape architecture field, but the diffusion has been delayed due to difficulties in application. This can be addressed by enhancing the efficiency of BIM work using standardized libraries. Therefore, this study aims to provide a starting point for discussions and present a classification system for objects and attribute information that can be referred to when creating landscape libraries in practice. The standardization of landscape BIM library was explored from two directions: object classification and attribute information items. First, the Korean construction information classification system, product inventory classification system, landscape design and construction standards, and BIM object classification of the NLA (Norwegian Association of Landscape Architects) were referred to classify landscape objects. As a result, the objects were divided into 12 subcategories, including 'trees', 'shrubs', 'ground cover and others', 'outdoor installation', 'outdoor lighting facility', 'stairs and ramp', 'outdoor wall', 'outdoor structure', 'pavement', 'curb', 'irrigation', and 'drainage' under five major categories: 'landscape plant', 'landscape facility', 'landscape structure', 'landscape pavement', and 'irrigation and drainage'. Next, the attribute information for the objects was extracted and structured. To do this, the common attribute information items of the KBIMS (Korean BIM Standard) were included, and the object attribute information items that vary according to the type of objects were included by referring to the PDT (Product Data Template) of the LI (UK Landscape Institute). As a result, the common attributes included information on 'identification', 'distribution', 'classification', and 'manufacture and supply' information, while the object attributes included information on 'naming', 'specifications', 'installation or construction', 'performance', 'sustainability', and 'operations and maintenance'. The significance of this study lies in establishing the foundation for the introduction of landscape BIM through the standardization of library objects, which will enhance the efficiency of modeling tasks and improve the data consistency of BIM models across various disciplines in the construction industry.

Comparative Study on the Carbon Stock Changes Measurement Methodologies of Perennial Woody Crops-focusing on Overseas Cases (다년생 목본작물의 탄소축적 변화량 산정방법론 비교 연구-해외사례를 중심으로)

  • Hae-In Lee;Yong-Ju Lee;Kyeong-Hak Lee;Chang-Bae Lee
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.25 no.4
    • /
    • pp.258-266
    • /
    • 2023
  • This study analyzed methodologies for estimating carbon stocks of perennial woody crops and the research cases in overseas countries. As a result, we found that Australia, Bulgaria, Canada, and Japan are using the stock-difference method, while Austria, Denmark, and Germany are estimating the change in the carbon stock based on the gain-loss method. In some overseas countries, the researches were conducted on estimating the carbon stock change using image data as tier 3 phase beyond the research developing country-specific factors as tier 2 phase. In South Korea, convergence studies as the third stage were conducted in forestry field, but advanced research in the agricultural field is at the beginning stage. Based on these results, we suggest directions for the following four future researches: 1) securing national-specific factors related to emissions and removals in the agricultural field through the development of allometric equation and carbon conversion factors for perennial woody crops to improve the completeness of emission and removals statistics, 2) implementing policy studies on the cultivation area calculation refinement with fruit tree-biomass-based maturity, 3) developing a more advanced estimation technique for perennial woody crops in the agricultural sector using allometric equation and remote sensing techniques based on the agricultural and forestry satellite scheduled to be launched in 2025, and to establish a matrix and monitoring system for perennial woody crop cultivation areas in the agricultural sector, Lastly, 4) estimating soil carbon stocks change, which is currently estimated by treating all agricultural areas as one, by sub-land classification to implement a dynamic carbon cycle model. This study suggests a detailed guideline and advanced methods of carbon stock change calculation for perennial woody crops, which supports 2050 Carbon Neutral Strategy of Ministry of Agriculture, Food, and Rural Affairs and activate related research in agricultural sector.

Effect of Organizational Support Perception on Intrinsic Job Motivation : Verification of the Causal Effects of Work-Family Conflict and Work-Family Balance (조직지원인식이 내재적 직무동기에 미치는 영향 : 일-가정 갈등 및 일-가정 균형의 인과관계 효과 검증)

  • Yoo, Joon-soo;Kang, Chang-wan
    • Journal of Venture Innovation
    • /
    • v.6 no.1
    • /
    • pp.181-198
    • /
    • 2023
  • This study aims to analyze the influence of organizational support perception of workers in medical institutions on intrinsic job motivation, and to check whether there is significance in the mediating effect of work-family conflict and work-family balance factors in this process. The results of empirical analysis through the questionnaire are as follows. First, it was confirmed that organizational support recognition had a significant positive effect on work-family balance as well as intrinsic job motivation, and work-family balance had a significant positive effect on intrinsic job motivation. Second, it was confirmed that organizational support recognition had a significant negative effect on work-family conflict, but work-family conflict had no significant influence on intrinsic job motivation. Third, in order to reduce job stress for medical institution workers, it is necessary to reduce job intensity, assign appropriate workload for ability. And in order to improve manpower operation and job efficiency, Job training and staffing in the right place are needed. Fourth, in order to improve positive organizational support perception and intrinsic job motivation, It is necessary to induce long-term service by providing support and institutional devices to increase attachment to the current job and recognize organizational problems as their own problems with various incentive systems. The limitations of this study and future research directions are as follows. First, it is believed that an expanded analysis of medical institution workers nationwide by region, gender, medical institution, academic, and income will not only provide more valuable results, but also evaluate the quality of medical services. Second, it is necessary to reflect the impact of the work-life balance support system on each employee depending on the environmental uncertainty or degree of competition in the hospital to which medical institution workers belong. Third, organizational support perception will be recognized differently depending on organizational culture and organizational type, and organizational size and work characteristics, working years, and work types, so it is necessary to reflect this. Fourth, it is necessary to analyze various new personnel management techniques such as hospital's organizational structure, job design, organizational support method, motivational approach, and personnel evaluation method in line with the recent change in the government's medical institution policy and the global business environment. It is also considered important to analyze by reflecting recent and near future medical trends.

Development and Validation of Career Barrier Scale for Career Interruption Women (경력단절여성 진로장벽 척도 개발 및 타당화)

  • Ae Ri Kim;Jin Kook Tak
    • The Korean Journal of Coaching Psychology
    • /
    • v.8 no.1
    • /
    • pp.1-50
    • /
    • 2024
  • The purpose of this study is to identify career barrier factors experienced by career interruption women, develop a tool to measure career barrier, and verify their validity. To this end, preliminary questions were developed by reviewing literature, conducting one-on-one in-depth interviews with 10 women on career interruption, and conducting an open questionnaire with 100 women on career interruption. The subjects of the study were married women aged 20 to 54 who had past employment experience, wanted to be re-employed, and experienced retirement due to marriage, pregnancy, childbirth, childcare, and family care, and the period of career interruption was selected for more than one year. After that, 63 questions were selected for 7 factors. A preliminary survey was conducted on 300 women with career interruption in Korea, and as a result, 63 questions of 6 factors were derived through exploratory factor analysis. The main survey was conducted with 44 questions of 6 factors by partially modifying the questions reflecting the important concepts in each factor. In this survey of 600 people, in order to verify the validity of the constituent concept of this test, the entire sample was divided into two groups, and group 1 (G1, N=309) conducted exploratory factor analysis and group 2 (G2, N=291) conducted confirmatory factor analysis. As a result of exploratory factor analysis for Group 1, 34 questions of 6 factors were finally derived, and a confirmatory factor analysis of Group 2(G2) was conducted to confirm the model fit of the derived factors, and it was confirmed that the model fit criteria were met. In order to verify the convergence validity of the developed career barrier scale, a correlation analysis was conducted with the career barrier test for female college students, and as a result of the analysis, the career barrier scale for women with career interruption and the career barrier test for female college students showed statistically significant correlation. In order to verify the validity of the criterion, the results of a correlation analysis with variables of job preparation behavior, job stress, state anxiety, and life satisfaction were all found to be statistically significant. Finally, the academic, practical, and policy significance and limitations of this study and future research directions were presented.

An Analysis of the Moderating Effects of User Ability on the Acceptance of an Internet Shopping Mall (인터넷 쇼핑몰 수용에 있어 사용자 능력의 조절효과 분석)

  • Suh, Kun-Soo
    • Asia pacific journal of information systems
    • /
    • v.18 no.4
    • /
    • pp.27-55
    • /
    • 2008
  • Due to the increasing and intensifying competition in the Internet shopping market, it has been recognized as very important to develop an effective policy and strategy for acquiring loyal customers. For this reason, web site designers need to know if a new Internet shopping mall(ISM) will be accepted. Researchers have been working on identifying factors for explaining and predicting user acceptance of an ISM. Some studies, however, revealed inconsistent findings on the antecedents of user acceptance of a website. Lack of consideration for individual differences in user ability is believed to be one of the key reasons for the mixed findings. The elaboration likelihood model (ELM) and several studies have suggested that individual differences in ability plays an moderating role on the relationship between the antecedents and user acceptance. Despite the critical role of user ability, little research has examined the role of user ability in the Internet shopping mall context. The purpose of this study is to develop a user acceptance model that consider the moderating role of user ability in the context of Internet shopping. This study was initiated to see the ability of the technology acceptance model(TAM) to explain the acceptance of a specific ISM. According to TAM. which is one of the most influential models for explaining user acceptance of IT, an intention to use IT is determined by usefulness and ease of use. Given that interaction between user and website takes place through web interface, the decisions to accept and continue using an ISM depend on these beliefs. However, TAM neglects to consider the fact that many users would not stick to an ISM until they trust it although they may think it useful and easy to use. The importance of trust for user acceptance of ISM has been raised by the relational views. The relational view emphasizes the trust-building process between the user and ISM, and user's trust on the website is a major determinant of user acceptance. The proposed model extends and integrates the TAM and relational views on user acceptance of ISM by incorporating usefulness, ease of use, and trust. User acceptance is defined as a user's intention to reuse a specific ISM. And user ability is introduced into the model as moderating variable. Here, the user ability is defined as a degree of experiences, knowledge and skills regarding Internet shopping sites. The research model proposes that the ease of use, usefulness and trust of ISM are key determinants of user acceptance. In addition, this paper hypothesizes that the effects of the antecedents(i.e., ease of use, usefulness, and trust) on user acceptance may differ among users. In particular, this paper proposes a moderating effect of a user's ability on the relationship between antecedents with user's intention to reuse. The research model with eleven hypotheses was derived and tested through a survey that involved 470 university students. For each research variable, this paper used measurement items recognized for reliability and widely used in previous research. We slightly modified some items proper to the research context. The reliability and validity of the research variables were tested using the Crobnach's alpha and internal consistency reliability (ICR) values, standard factor loadings of the confirmative factor analysis, and average variance extracted (AVE) values. A LISREL method was used to test the suitability of the research model and its relating six hypotheses. Key findings of the results are summarized in the following. First, TAM's two constructs, ease of use and usefulness directly affect user acceptance. In addition, ease of use indirectly influences user acceptance by affecting trust. This implies that users tend to trust a shopping site and visit repeatedly when they perceive a specific ISM easy to use. Accordingly, designing a shopping site that allows users to navigate with heuristic and minimal clicks for finding information and products within the site is important for improving the site's trust and acceptance. Usefulness, however, was not found to influence trust. Second, among the three belief constructs(ease of use, usefulness, and trust), trust was empirically supported as the most important determinants of user acceptance. This implies that users require trustworthiness from an Internet shopping site to be repeat visitors of an ISM. Providing a sense of safety and eliminating the anxiety of online shoppers in relation to privacy, security, delivery, and product returns are critically important conditions for acquiring repeat visitors. Hence, in addition to usefulness and ease of use as in TAM, trust should be a fundamental determinants of user acceptance in the context of internet shopping. Third, the user's ability on using an Internet shopping site played a moderating role. For users with low ability, ease of use was found to be a more important factors in deciding to reuse the shopping mall, whereas usefulness and trust had more effects on users with high ability. Applying the EML theory to these findings, we can suggest that experienced and knowledgeable ISM users tend to elaborate on such usefulness aspects as efficient and effective shopping performance and trust factors as ability, benevolence, integrity, and predictability of a shopping site before they become repeat visitors of the site. In contrast, novice users tend to rely on the low elaborating features, such as the perceived ease of use. The existence of moderating effects suggests the fact that different individuals evaluate an ISM from different perspectives. The expert users are more interested in the outcome of the visit(usefulness) and trustworthiness(trust) than those novice visitors. The latter evaluate the ISM in a more superficial manner focusing on the novelty of the site and on other instrumental beliefs(ease of use). This is consistent with the insights proposed by the Heuristic-Systematic model. According to the Heuristic-Systematic model. a users act on the principle of minimum effort. Thus, the user considers an ISM heuristically, focusing on those aspects that are easy to process and evaluate(ease of use). When the user has sufficient experience and skills, the user will change to systematic processing, where they will evaluate more complex aspects of the site(its usefulness and trustworthiness). This implies that an ISM has to provide a minimum level of ease of use to make it possible for a user to evaluate its usefulness and trustworthiness. Ease of use is a necessary but not sufficient condition for the acceptance and use of an ISM. Overall, the empirical results generally support the proposed model and identify the moderating effect of the effects of user ability. More detailed interpretations and implications of the findings are discussed. The limitations of this study are also discussed to provide directions for future research.

A Methodology to Develop a Curriculum based on National Competency Standards - Focused on Methodology for Gap Analysis - (국가직무능력표준(NCS)에 근거한 조경분야 교육과정 개발 방법론 - 갭분석을 중심으로 -)

  • Byeon, Jae-Sang;Ahn, Seong-Ro;Shin, Sang-Hyun
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.43 no.1
    • /
    • pp.40-53
    • /
    • 2015
  • To train the manpower to meet the requirements of the industrial field, the introduction of the National Qualification Frameworks(hereinafter referred to as NQF) was determined in 2001 by National Competency Standards(hereinafter referred to as NCS) centrally of the Office for Government Policy Coordination. Also, for landscape architecture in the construction field, the "NCS -Landscape Architecture" pilot was developed in 2008 to be test operated for 3 years starting in 2009. Especially, as the 'realization of a competence-based society, not by educational background' was adopted as one of the major government projects in the Park Geun-Hye government(inaugurated in 2013) the NCS system was constructed on a nationwide scale as a detailed method for practicing this. However, in the case of the NCS developed by the nation, the ideal job performing abilities are specified, therefore there are weaknesses of not being able to reflect the actual operational problem differences in the student level between universities, problems of securing equipment and professors, and problems in the number of current curricula. For soft landing to practical curriculum, the process of clearly analyzing the gap between the current curriculum and the NCS must be preceded. Gap analysis is the initial stage methodology to reorganize the existing curriculum into NCS based curriculum, and based on the ability unit elements and performance standards for each NCS ability unit, the discrepancy between the existing curriculum within the department or the level of coincidence used a Likert scale of 1 to 5 to fill in and analyze. Thus, the universities wishing to operate NCS in the future measuring the level of coincidence and the gap between the current university curriculum and NCS can secure the basic tool to verify the applicability of NCS and the effectiveness of further development and operation. The advantages of reorganizing the curriculum through gap analysis are, first, that the government financial support project can be connected to provide quantitative index of the NCS adoption rate for each qualitative department, and, second, an objective standard is provided on the insufficiency or sufficiency when reorganizing to NCS based curriculum. In other words, when introducing in the subdivisions of the relevant NCS, the insufficient ability units and the ability unit elements can be extracted, and the supplementary matters for each ability unit element per existing subject can be extracted at the same time. There is an advantage providing directions for detailed class program and basic subject opening. The Ministry of Education and the Ministry of Employment and Labor must gather people from the industry to actively develop and supply the NCS standard a practical level to systematically reflect the requirements of the industrial field the educational training and qualification, and the universities wishing to apply NCS must reorganize the curriculum connecting work and qualification based on NCS. To enable this, the universities must consider the relevant industrial prospect and the relation between the faculty resources within the university and the local industry to clearly select the NCS subdivision to be applied. Afterwards, gap analysis must be used for the NCS based curriculum reorganization to establish the direction of the reorganization more objectively and rationally in order to participate in the process evaluation type qualification system efficiently.

Development of Information Extraction System from Multi Source Unstructured Documents for Knowledge Base Expansion (지식베이스 확장을 위한 멀티소스 비정형 문서에서의 정보 추출 시스템의 개발)

  • Choi, Hyunseung;Kim, Mintae;Kim, Wooju;Shin, Dongwook;Lee, Yong Hun
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.4
    • /
    • pp.111-136
    • /
    • 2018
  • In this paper, we propose a methodology to extract answer information about queries from various types of unstructured documents collected from multi-sources existing on web in order to expand knowledge base. The proposed methodology is divided into the following steps. 1) Collect relevant documents from Wikipedia, Naver encyclopedia, and Naver news sources for "subject-predicate" separated queries and classify the proper documents. 2) Determine whether the sentence is suitable for extracting information and derive the confidence. 3) Based on the predicate feature, extract the information in the proper sentence and derive the overall confidence of the information extraction result. In order to evaluate the performance of the information extraction system, we selected 400 queries from the artificial intelligence speaker of SK-Telecom. Compared with the baseline model, it is confirmed that it shows higher performance index than the existing model. The contribution of this study is that we develop a sequence tagging model based on bi-directional LSTM-CRF using the predicate feature of the query, with this we developed a robust model that can maintain high recall performance even in various types of unstructured documents collected from multiple sources. The problem of information extraction for knowledge base extension should take into account heterogeneous characteristics of source-specific document types. The proposed methodology proved to extract information effectively from various types of unstructured documents compared to the baseline model. There is a limitation in previous research that the performance is poor when extracting information about the document type that is different from the training data. In addition, this study can prevent unnecessary information extraction attempts from the documents that do not include the answer information through the process for predicting the suitability of information extraction of documents and sentences before the information extraction step. It is meaningful that we provided a method that precision performance can be maintained even in actual web environment. The information extraction problem for the knowledge base expansion has the characteristic that it can not guarantee whether the document includes the correct answer because it is aimed at the unstructured document existing in the real web. When the question answering is performed on a real web, previous machine reading comprehension studies has a limitation that it shows a low level of precision because it frequently attempts to extract an answer even in a document in which there is no correct answer. The policy that predicts the suitability of document and sentence information extraction is meaningful in that it contributes to maintaining the performance of information extraction even in real web environment. The limitations of this study and future research directions are as follows. First, it is a problem related to data preprocessing. In this study, the unit of knowledge extraction is classified through the morphological analysis based on the open source Konlpy python package, and the information extraction result can be improperly performed because morphological analysis is not performed properly. To enhance the performance of information extraction results, it is necessary to develop an advanced morpheme analyzer. Second, it is a problem of entity ambiguity. The information extraction system of this study can not distinguish the same name that has different intention. If several people with the same name appear in the news, the system may not extract information about the intended query. In future research, it is necessary to take measures to identify the person with the same name. Third, it is a problem of evaluation query data. In this study, we selected 400 of user queries collected from SK Telecom 's interactive artificial intelligent speaker to evaluate the performance of the information extraction system. n this study, we developed evaluation data set using 800 documents (400 questions * 7 articles per question (1 Wikipedia, 3 Naver encyclopedia, 3 Naver news) by judging whether a correct answer is included or not. To ensure the external validity of the study, it is desirable to use more queries to determine the performance of the system. This is a costly activity that must be done manually. Future research needs to evaluate the system for more queries. It is also necessary to develop a Korean benchmark data set of information extraction system for queries from multi-source web documents to build an environment that can evaluate the results more objectively.