• Journal of Intelligence and Information Systems
• /
• v.29 no.2
• /
• pp.189-217
• /
• 2023

The metaverse is a virtual world where individuals engage in social, economic, and cultural activities using avatars, which represent an alternate version of oneself within the virtual realm. While the metaverse has garnered global attention recently, research exploring the identity manifested through avatars within the metaverse remains limited. This study investigates the influence of four IT artifact characteristics related to avatar usage in the metaverse-avatar representation, avatar copresence, avatar profiling, and avatar-space interaction-on perceived avatar identity verification. A survey was conducted with 196 experienced users of the Zepeto platform, and hypotheses were tested using structural equation modeling. The analysis results indicate that the use of IT artifacts enabling avatar representation, avatar copresence, and avatar-space interaction has a positive impact on perceived avatar identity verification. This achieved self-verification indirectly influences the satisfaction and subsequent intention to continue using the metaverse. This study contributes to the academic field by empirically verifying the metaverse technological factors that influence the projected identity onto avatars within the metaverse. Furthermore, it is expected to provide effective guidelines for metaverse platform companies in designing and implementing the metaverse.

• Information Systems Review
• /
• v.23 no.4
• /
• pp.23-43
• /
• 2021

Due to the recent transition to a non-face-to-face society, many organizations are quickly adapting to foster a smart work environment. The introduction of smart work does not simply end with incorporating ICT systems or solutions into business models since fundamental factors such as forms of employment and work styles need to be in line with the progression of technological advances. However, previous studies regarding smart work focus on improvements in productivity and efficiency from a technology acceptance perspective. Therefore, there is a lack of discussion on innovation resistance from employees and management control when ICT systems are introduced into the workplace. This study empirically analyzes the moderating effects of the organizational control method for employees and innovation resistance within a smart work environment. Additionally, this study aims to identify the structural characteristics that employees resist from an innovation resistance perspective when organizational innovation occurs. The empirical analysis of this study suggests that when smart work such as ICT technology is introduced into the workplace the level of innovation resistance decreases when there is a high level of relative advantage and self-efficacy, whereas the level of innovation resistance increases when there is a high level of use complexity. Moreover, this study revealed that the level of innovation resistance increases when the employees' behaviors were controlled. The results of this study intend to contribute to improving business management by suggesting factors worth considering when incorporating smart work into work places through a thorough case analysis.

• Asia pacific journal of information systems
• /
• v.23 no.3
• /
• pp.131-154
• /
• 2013

New internet technologies have created a revolutionary new platform which allows consumers to make decision about product price and quality quickly and provides information about themselves through the transcript of online reviews. By expressing their feelings toward products or services on virtual opinion platforms, users extend their influence into cyberspace as electronic word-of-mouth (e-WOM). Existing research indicates that an impact of eWOM on the consumer decision process is influential. For both academic researchers and practitioners, investigating this phenomenon of information sharing in online website is essential given the increasing number of consumers using them as sources of purchase decisions. It is worthwhile to examine the extent to which opinion seekers are willing to accept and adopt online reviews and which factors encourage adoption. Discerning the most motivating aspects of information adoption in particular, could help electronic marketers better promote their brand and presence on the internet. The objectives of this study are to investigate how online WOM influences a persons' purchase decision by discovering which factors encourage information adoption. Especially focused on the self-efficacy, this research investigates how self-efficacy affects on information usefulness and adoption of online information. Although people are exposed to same review or comment about product or service, some accept the reviews while others do not. We notice that accepting online reviews mainly depends on the person's preference or personal characteristics. This study empirically examines this issue by using cognitive dissonance theory. Specifically, in the movie industry, we address few questions-is always positive WOM generating positive effect? What if the movie isn't the person's favorite genre? What if the person who is very self-assertive so doesn't take other's opinion easily? In these cases of cognitive dissonance, is always WOM generating same result? While many studies have focused on one direct of WOM which indicates positive (or negative) informative reviews or comments generate positive (or negative) results and more (or less) profits, this study investigates not only directional properties of WOM but also how people change their opinion towards product or service positive to negative, negative to positive through the online WOM. An experiment was conducted quantitatively by using a sample of 168 users who have experience within the online movie review site, 'Naver Movie'. Users were required to complete a survey regarding reviews and comments taken from the real movie page. The data reflected user's perceptions of online WOM information that determined users' adoption level. Analysis results provide empirical support for the proposed theoretical perspective. When user can't agree with the opinion of online WOM information, in other words, when cognitive dissonance between online WOM information and users' preference occurs, perceived self-efficacy significantly decreases customers' perception of usefulness. And this perception of usefulness plays an important role in determining users' intention to adopt online WOM information. Most of researches have been concentrated on characteristics of online WOM itself such as quality or vividness of information, credibility of source and direction of online WOM, etc. for describing effect of online WOM, but our results suggest that users' personal character (e.g., self-efficacy) plays decisive role for acceptance of online WOM information. Higher self-efficacy means lower possibility to accept the information that represents counter opinion because of cognitive dissonance, whereas the people that have lower self-efficacy are willing to accept the online WOM information as true and refer to purchase decision. This study suggests a model for understanding role of direction of online WOM information. Also, our result implicates the importance of online review supervision and personalized information service by confirming switching opinion negative to positive is more difficult than positive to negative through the online WOM information. This implication would help marketers to manage online reviews of their products or services.

• Journal of Global Scholars of Marketing Science
• /
• v.18 no.1
• /
• pp.59-80
• /
• 2008

Recently, e-sports are growing with potentiality as a new industry with conspicuous profit model. But studies that dealing with e-sports are not enough. Hence, proposes of this paper are both to establish basic model that is for the design of e-sport marketing strategy and to contribute toward future studies which are related to e-sports. Recently, the researches to explain sports-sponsorship through the identification theory have been discovered. Many researches say that somewhat proper identification is a requirement for most sponsors to improve the their images which is essential to sponsorship activity. Consequently, the research for sponsorship associated with identification in the e-sports, not in the physical sports is the core sector of this study. We extracted the variables from online's major characteristics and existing sport sponsorship researches. First, because e-sports mean the tournaments or leagues in the use of online game, the main event of the game is likely to call it online game. Online media's attributes are distinguished from those of offline. Especially, interactivity, anonymity, and expandibility as a e-sport game attributes are able to be mentioned. So, these inherent online attributes are examined on the relationship with flow. Second, in physical sports games, Fisher(1998) revealed that team similarity and team attractivity were positively related to team identification. Wann(1996) said that the result of former game influenced the evaluation of the next game, then in turn has an effect on the identification of team supporters. Considering these results in the e-sports side, e-sports gamer' attractivity, similarity, and match result seem to be important precedent variables of the identification with a gamer. So, these e-sport gamer attributes are examined on the relationship with both flow and identification with a gamer. Csikszentmihalyi(1988) defined the term flow as feeling status for him to be making current positive experience optimally. Hoffman and Novak(1996) also said that if a user experienced the flow he would visit a website without any reward. Therefore flow might be positively associated with user's identification with a gamer. And, Swanson(2003) disclosed that team identification influenced the positive results of sponsorship, which included attitude toward sponsors, sponsor patronage, and satisfaction with sponsors. That is, identification with a gamer expect to be connected with corporation identification significantly. According to the above, we can design the following research model. All variables used in this study(interactivity, anonymity, expandibility, attractivity, similarity, match result, flow, identification with a gamer, and identification with a sponsor) definitely were defined operationally underlying precedent researches. Sample collection was carried out to the person who has an experience to have enjoyed e-sports during June 2006. Much portion of samples is men because much more men than women enjoy e-sports in general. Two-step approach was used to test the hypotheses. First, confirmatory factor analysis was committed to guarantee the validity and reliability of variables. The results showed that all variables had not only intensive and discriminant validity, but also reliability. Then, research model was examined with fully structural equation using LISREL 8.3 version. The fitness of the suggested model mostly was at the acceptable level. Shortly speaking about the results, first of all, in e-sports game attributes, only interactivity which is called a basic feature in online situation affected flow positively. Secondly, in e-sports gamer's attributes, similarity with a gamer and match result influenced flow positively, but there was no significant effect in the relationship between the attractivity of a gamer and flow. And as expected, similarity had an effect on identification with a gamer significantly. But unexpectedly attractivity and match result did not influence identification with a gamer significantly. Just the same as the fact verified in the many precedent researches, flow greatly influenced identification with a gamer, and identification with a gamer continually had an influence on the identification with a sponsor significantly. There are some implications in these results. If the sponsor of e-sports supports the pro-game player who absolutely should have the superior ability to others and is similar to the user enjoying e-sports, many amateur gamers will feel much of the flow and identification with a pro-gamer, and then after all, feel the identification with a sponsor. Such identification with a sponsor leads people enjoying e-sports to have purchasing intention for products produced by the sponsor and to make a positive word-of-mouth for those products or the sponsor. For the future studies, we recommend a few ideas. Based on the results of this study, it is necessary to find new variables relating to the e-sports, which is not mentioned in this study. For this work to be possible, qualitative research seems to be needed to consider the inherent e-sport attributes. Finally, to generalize the results related to e-sports, a wide range of generations not a specific generation should be researched.

• Journal of Korea Entertainment Industry Association
• /
• v.15 no.8
• /
• pp.19-31
• /
• 2021

This study tried to identify the characteristics of college students' entrepreneurial intentions in the entertainment industry, focusing on existing literature studies. Based on this, it was intended to suggest realistic educational alternatives for university student start-ups and implications for start-up management to university start-up officials and those in charge of national start-up support policy. Therefore, the implications of this study are as follows. First, technology(item) for idea creation education, which is an essential element in the entertainment industry, how to connect ideas and products, technology methods that can increase content value, and user characteristics education within the entertainment industry will need to be continued. In addition, along with the idea education, it is necessary to increase the understanding of start-up business management such as financing, human resource management, marketing, and operation management, and furthermore, confidence education should be provided so that the possibility of success in an entertainment start-up and a sense of adventure in a new job can be developed. Second, the space and equipment necessary for start-up (club room, student start-up room, entertainment-related equipment, etc.) should be provided centering on the opinion survey of students who are interested in starting a business, and various regulations of universities and government for student start-up should be relaxed. will have to In addition, education for the formation of entrepreneurial knowledge inside and outside of the school, special lectures and consultations by experts, and on-the-spot education, etc., should be made to create more practical entrepreneurial knowledge. something to do. Third, for students wishing to start a business in the entertainment industry, it is necessary to inform their families about the field situation of the entertainment industry accurately so that their children can develop a positive perception rather than a negative perception when choosing a business field. In addition, by promoting various successful cases of college students to their families after starting a business, families should be encouraged so that their children can develop a challenging spirit about starting a business. Fourth, it should be possible to form continuous clubs or gatherings with friends who wish to start a business in the entertainment industry, and furthermore, an opportunity to listen to the opinions of friends who actually started a business through these meetings should be provided. In addition, the meeting and the formation of friends should create a place for discussion about writing a business plan, how to succeed in starting a business, and management of startups, and psychological stimulation activities should be conducted so that each other's will to start a business arises. Fifth, various knowledge related to start-up (methods for securing funds, management of start-up organizations, grasping information about the market in which they want to start a business, etc.) should be cultivated, and how to write a business plan for the various entertainment industry fields they want to start up. You will also need to train them to be practical. Also, based on this knowledge formation, students themselves should be able to respond to risks and changes that may occur in entrepreneurship. Lastly, it is necessary to increase the understanding of business start-up management, and various psychological stimulation activities are needed to make the confidence and fear of starting a business disappear.

• Journal of Intelligence and Information Systems
• /
• v.17 no.3
• /
• pp.115-130
• /
• 2011

Many online stores bring features that can build trust in their customers. More so, the number of products or content services on online stores has been increasing rapidly. Hence, personalization on online stores is considered to be an important technology to companies and customers. Recommender systems that provide favorable products and customer product reviews to users are the most commonly used features in this purpose. There are many studies to that investigated the relationship between social presence as an antecedent of trust and provision of recommender systems or customer product reviews. Many online stores have made efforts to increase perceived social presence of their customers through customer reviews, recommender systems, and analyzing associations among products. Primarily because social presence can increase customer trust or reuse intention for online stores. However, there were few studies that investigated the interactions between recommendation type, product type and provision of customer product reviews on social presence. Therefore, one of the purposes of this study is to identify the effects of personalized recommender systems and compare the role of customer reviews with product types. This study performed an experiment to see these interactions. Experimental web pages were developed with $2{\times}2$ factorial setting based on how to provide social presence to users with customer reviews and two product types such as hedonic and utilitarian. The hedonic type was a ringtone chosen from Nate.com while the utilitarian was a TOEIC study aid book selected from Yes24.com. To conduct the experiment, web based experiments were conducted for the participants who have been shopping on the online stores. Participants were a total of 240 and 30% of the participants had the chance of getting the presents. We found out that social presence increased for hedonic products when personalized recommendations were given compared to non.personalized recommendations. Although providing customer reviews for two product types did not significantly increase social presence, provision of customer product reviews for hedonic (ringtone) increased perceived social presence. Otherwise, provision of customer product reviews could not increase social presence when the systems recommend utilitarian products (TOEIC study.aid books). Therefore, it appears that the effects of increasing perceived social presence with customer reviews have a difference for product types. In short, the role of customer reviews could be different based on which product types were considered by customers when they are making a decision related to purchasing on the online stores. Additionally, there were no differences for increasing perceived social presence when providing customer reviews. Our participants might have focused on how recommendations had been provided and what products were recommended because our developed systems were providing recommendations after participants rating their preferences. Thus, the effects of customer reviews could appear more clearly if our participants had actual purchase opportunity for the recommendations. Personalized recommender systems can increase social presence of customers more than nonpersonalized recommender systems by using user preference. Online stores could find out how they can increase perceived social presence and satisfaction of their customers when customers want to find the proper products with recommender systems and customer reviews. In addition, the role of customer reviews of the personalized recommendations can be different based on types of the recommended products. Even if this study conducted two product types such as hedonic and utilitarian, the results revealed that customer reviews for hedonic increased social presence of customers more than customer reviews for utilitarian. Thus, online stores need to consider the role of providing customer reviews with highly personalized information based on their product types when they develop the personalized recommender systems.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.16 no.4
• /
• pp.195-209
• /
• 2021

According to the 2019-2020 social media usage survey conducted by the Seoul e-commerce center, 5 out of 10 consumers have experienced shopping through social media. The cost of traditional advertising media has been reduced and advertising spending on social media has risen by 74%, indicating that social media is becoming a more important marketing element. While the number of users of social media has increased and corporate marketing activities have increased accordingly, research has been conducted in various aspects of marketing such as user motivation for social media, satisfaction, and purchase intention. There was no subdivided study on the differences in the social media usage frequency of consumers in actual purchasing behavior. This study attempted to identify differences in consumer characteristics by cluster in the agrifood purchase situation by grouping them by type according to the frequency of use of social media for consumers who purchase agri-food online. Product involvement, product need, and online purchase channel Consumer characteristics such as demographic distribution, perceived risk, and eating and lifestyle in each cluster were checked for the three agrifood purchase situations including choice, and types for each cluster were presented. To this end, questionnaire data on the frequency of social media use and online agrifood purchase behavior were collected from 245 consumers, and the validity of the measurement variables was secured through factor analysis and reliability analysis. As a result of cluster analysis according to the frequency of social media use, it was divided into three clusters. The first cluster was a group that mainly used open social media, and the second cluster was a group that used both open and closed social media and online shopping malls; The third cluster was a group with low online media usage overall, and the characteristics of each cluster appeared. Through regression analysis, the effect on product involvement, product need, and purchase channel selection when purchasing agri-food online through each of the three clusters was confirmed through regression analysis. As a result of the regression analysis, the characteristic of cluster 1 in the situation of purchasing agri-food online is a male in his 30s living in a rural area who has no reluctance to purchase agri-food on social media or online shopping malls. The characteristics of cluster 2 are mainly consumers who are interested in purchasing health food, and the consumer characteristics are represented. In the case of cluster 3, when purchasing products online, they purchase after considering quality and price a lot, and the consumer characteristics are represented as people who are more confident in purchasing offline than online. Through this study, it is judged that by identifying the differences in consumer characteristics that appear in the agri-food purchase situation according to the frequency of social media use, it can be helpful in strategic judgments in marketing practice on social media customer targeting and customer segmentation.

• Journal of the Korean Institute of Traditional Landscape Architecture
• /
• v.29 no.4
• /
• pp.124-136
• /
• 2011

In landscape architecture, plants play an important role in realizing the intention of the architect and user- behavior as well as an ecology and appearance of the space for them. However, it is true that many researches have focused on ecological characteristics of plants, their cultivation environment and symbolic meanings in traditional terms, while relatively few for the analysis of the aspects of each period through plants. For this, cherry trees that we often see around are selected and their introduction, propagation, development and symbolism from the view of chronicle are studied and the results are followings; Firstly, three-year seedlings of 1,500 pieces of cherry tree from Osaka and Tokyo were planted for the first time in Oieseongdae, Namsan Park, Seoul. Since then, they had been widely planted at traditional sites, modern parks, newly-constructed roads for street trees, and for this, the Japanese Government-General of Chosun had actively supported by its direct cultivation and selling of cherry trees. The spread of cherry trees planted raised the question of whether or not Prunus yedoensis is originated from Jeju Island. Secondly, such massive and artificial planting of them had become attractions over the time and mass media at that time also had actively promoted it. And such trend made the day and night picnic under the cherry blossoms one of the most representative cultures of enjoying spring in Seoul. Thirdly, although general people enjoyed cherry blossoms, but they had dual view and attitude for cherry trees, which were well expressed in their use of them: for example, cherry blossoms, aeng and sakura were used altogether for same meaning, but night aeng or night picnic under cherry blossoms were especially used instead of yojakura when mentioning just pleasure, which meant some saw night enjoying cherry blossoms a low culture. Fourth, symbolic space of Chosun had been transformed into the space for enjoyment and consumption. Anyone who paid entrance fee could enjoy performance of revugirl, cinema and entertainment along with enjoying cherry blossoms. The still-existing strict differentiation of enjoyment culture by social status, class and ethnicity was dismantled from that trend and brought about a kind of disorder. From this, we could find that cherry blossoms had made a great contribution to the change of traditional enjoyment culture over the Japanese colonial period and become a popular spring enjoyment.

• Journal of Global Scholars of Marketing Science
• /
• v.18 no.4
• /
• pp.157-194
• /
• 2008

The popularity of communities on the internet has captured the attention of marketing scholars and practitioners. By adapting to the culture of the internet, however, and providing consumer with the ability to interact with one another in addition to the company, businesses can build new and deeper relationships with customers. The economic potential of online communities has been discussed with much hope in the many popular papers. In contrast to this enthusiastic prognostications, empirical and practical evidence regarding the economic potential of the online community has shown a little different conclusion. To date, even communities with high levels of membership and vibrant social arenas have failed to build financial viability. In this perspective, this study investigates the role of various kinds of influencing factors to online community loyalty and basically suggests the framework that explains the process of building purchase loyalty. Even though the importance of building loyalty in an online environment has been emphasized from the marketing theorists and practitioners, there is no sufficient research conclusion about what is the process of building purchase loyalty and the most powerful factors that influence to it. In this study, the process of building purchase loyalty is divided into three levels; characteristics of community site such as content superiority, site vividness, navigation easiness, and customerization, the mediating variables such as self congruency, consumer experience, and consumer to consumer interactivity, and finally various factors about online community loyalty such as visit loyalty, affect, trust, and purchase loyalty are those things. And the findings of this research are as follows. First, consumer-to-consumer interactivity is an important factor to online community purchase loyalty and other loyalty factors. This means, in order to interact with other people more actively, many participants in online community have the willingness to buy some kinds of products such as music, content, avatar, and etc. From this perspective, marketers of online community have to create some online environments in order that consumers can easily interact with other consumers and make some site environments in order that consumer can feel experience in this site is interesting and self congruency is higher than at other community sites. It has been argued that giving consumers a good experience is vital in cyber space, and websites create an active (rather than passive) customer by their nature. Some researchers have tried to pin down the positive experience, with limited success and less empirical support. Web sites can provide a cognitively stimulating experience for the user. We define the online community experience as playfulness based on the past studies. Playfulness is created by the excitement generated through a website's content and measured using three descriptors Marketers can promote using and visiting online communities, which deliver a superior web experience, to influence their customers' attitudes and actions, encouraging high involvement with those communities. Specially, we suggest that transcendent customer experiences(TCEs) which have aspects of flow and/or peak experience, can generate lasting shifts in beliefs and attitudes including subjective self-transformation and facilitate strong consumer's ties to a online community. And we find that website success is closely related to positive website experiences: consumers will spend more time on the site, interacting with other users. As we can see figure 2, visit loyalty and consumer affect toward the online community site didn't directly influence to purchase loyalty. This implies that there may be a little different situations here in online community site compared to online shopping mall studies that shows close relations between revisit intention and purchase intention. There are so many alternative sites on web, consumers do not want to spend money to buy content and etc. In this sense, marketers of community websites must know consumers' affect toward online community site is not a last goal and important factor to influnece consumers' purchase. Third, building good content environment can be a really important marketing tool to create a competitive advantage in cyberspace. For example, Cyworld, Korea's number one community site shows distinctive superiority in the consumer evaluations of content characteristics such as content superiority, site vividness, and customerization. Particularly, comsumer evaluation about customerization was remarkably higher than the other sites. In this point, we can conclude that providing comsumers with good, unique and highly customized content will be urgent and important task directly and indirectly impacting to self congruency, consumer experience, c-to-c interactivity, and various loyalty factors of online community. By creating enjoyable, useful, and unique online community environments, online community portals such as Daum, Naver, and Cyworld are able to build customer loyalty to a degree that many of today's online marketer can only dream of these loyalty, in turn, generates strong economic returns. Another way to build good online community site is to provide consumers with an interactive, fun, experience-oriented or experiential Web site. Elements that can make a dot.com's Web site experiential include graphics, 3-D images, animation, video and audio capabilities. In addition, chat rooms and real-time customer service applications (which link site visitors directly to other visitors, or with company support personnel, respectively) are also being used to make web sites more interactive. Researchers note that online communities are increasingly incorporating such applications in their Web sites, in order to make consumers' online shopping experience more similar to that of an offline store. That is, if consumers are able to experience sensory stimulation (e.g. via 3-D images and audio sound), interact with other consumers (e.g., via chat rooms), and interact with sales or support people (e.g. via a real-time chat interface or e-mail), then they are likely to have a more positive dot.com experience, and develop a more positive image toward the online company itself). Analysts caution, however, that, while high quality graphics, animation and the like may create a fun experience for consumers, when heavily used, they can slow site navigation, resulting in frustrated consumers, who may never return to a site. Consequently, some analysts suggest that, at least with current technology, the rule-of-thumb is that less is more. That is, while graphics etc. can draw consumers to a site, they should be kept to a minimum, so as not to impact negatively on consumers' overall site experience.

• Journal of Intelligence and Information Systems
• /
• v.24 no.4
• /
• pp.111-136
• /
• 2018

In this paper, we propose a methodology to extract answer information about queries from various types of unstructured documents collected from multi-sources existing on web in order to expand knowledge base. The proposed methodology is divided into the following steps. 1) Collect relevant documents from Wikipedia, Naver encyclopedia, and Naver news sources for "subject-predicate" separated queries and classify the proper documents. 2) Determine whether the sentence is suitable for extracting information and derive the confidence. 3) Based on the predicate feature, extract the information in the proper sentence and derive the overall confidence of the information extraction result. In order to evaluate the performance of the information extraction system, we selected 400 queries from the artificial intelligence speaker of SK-Telecom. Compared with the baseline model, it is confirmed that it shows higher performance index than the existing model. The contribution of this study is that we develop a sequence tagging model based on bi-directional LSTM-CRF using the predicate feature of the query, with this we developed a robust model that can maintain high recall performance even in various types of unstructured documents collected from multiple sources. The problem of information extraction for knowledge base extension should take into account heterogeneous characteristics of source-specific document types. The proposed methodology proved to extract information effectively from various types of unstructured documents compared to the baseline model. There is a limitation in previous research that the performance is poor when extracting information about the document type that is different from the training data. In addition, this study can prevent unnecessary information extraction attempts from the documents that do not include the answer information through the process for predicting the suitability of information extraction of documents and sentences before the information extraction step. It is meaningful that we provided a method that precision performance can be maintained even in actual web environment. The information extraction problem for the knowledge base expansion has the characteristic that it can not guarantee whether the document includes the correct answer because it is aimed at the unstructured document existing in the real web. When the question answering is performed on a real web, previous machine reading comprehension studies has a limitation that it shows a low level of precision because it frequently attempts to extract an answer even in a document in which there is no correct answer. The policy that predicts the suitability of document and sentence information extraction is meaningful in that it contributes to maintaining the performance of information extraction even in real web environment. The limitations of this study and future research directions are as follows. First, it is a problem related to data preprocessing. In this study, the unit of knowledge extraction is classified through the morphological analysis based on the open source Konlpy python package, and the information extraction result can be improperly performed because morphological analysis is not performed properly. To enhance the performance of information extraction results, it is necessary to develop an advanced morpheme analyzer. Second, it is a problem of entity ambiguity. The information extraction system of this study can not distinguish the same name that has different intention. If several people with the same name appear in the news, the system may not extract information about the intended query. In future research, it is necessary to take measures to identify the person with the same name. Third, it is a problem of evaluation query data. In this study, we selected 400 of user queries collected from SK Telecom 's interactive artificial intelligent speaker to evaluate the performance of the information extraction system. n this study, we developed evaluation data set using 800 documents (400 questions * 7 articles per question (1 Wikipedia, 3 Naver encyclopedia, 3 Naver news) by judging whether a correct answer is included or not. To ensure the external validity of the study, it is desirable to use more queries to determine the performance of the system. This is a costly activity that must be done manually. Future research needs to evaluate the system for more queries. It is also necessary to develop a Korean benchmark data set of information extraction system for queries from multi-source web documents to build an environment that can evaluate the results more objectively.