DOI QR코드

DOI QR Code

Comparing Nanotechnology Web Portal Requirements Using a Kano Method

  • Bae, Seounghun (National Nanotechnology Policy Center, Korea Institute of Science and Technology Information) ;
  • Kim, Junhyun (National Nanotechnology Policy Center, Korea Institute of Science and Technology Information) ;
  • Kim, JaeSin (National Nanotechnology Policy Center, Korea Institute of Science and Technology Information) ;
  • Kim, Myung Shin (Institute of Public Affairs, Yonsei University) ;
  • Ju, Yonghwan (Korea Local Information Research & Development Institute) ;
  • Seo, Seung Hyun (Department of Public Administration, Kwangwoon University) ;
  • Han, In-Kyu (Department of Public Administration, Kwangwoon University) ;
  • Choi, Younghoon (Department of Public Administration, Kwangwoon University)
  • Received : 2017.01.11
  • Accepted : 2017.04.18
  • Published : 2017.05.31

Abstract

We compared nanotechnology web portal requirements using a Kano method, to identify similarities and dissimilarities in Kano-categorizations of features and functions required of nanotechnology among users in universities, government research institutes, and industry. Based upon data obtained from 130 user members of the National Nanotechnology Policy Centre, this study analyzed assessed asymmetries in web users' feelings based on hypothesized provision and non-provision of web portal requirements. In doing this, this study utilized measures and procedures suggested in the literature such as the most frequent-response categorization, customer satisfaction (dissatisfaction) coefficient, category strength and total strength, and Fong test. This study found that overall, sectors were an important factor in explaining the relationships between web portal requirements and user satisfaction/expectations. When these requirements were classified, users' perceptions of information contents requirements were consistent across the sectors, but the other functional requirements including communication and collaborations considerably varied.

Keywords

1. INTRODUCTION

The Korean government has made it clear in its strategic plans (Ministry of Knowledge Economy, 2011/2012; National Science & Technology Council [NSTC], 2001/2005/2011/2016) that nanotechnology, characterized as a general purpose technology (Helpman, 1998; Shea, Gride, & Elmslle, 2011), is a pivotal driver of economic growth (Mazzola, 2003), that Korea is a globally leading performer in fundamental nanotechnology research, and that the country is having difficulty in converting these research results into commercial applications (Kim et al., 2014). The strategic plans have identified and addressed serious barriers to the commercialization of nanotechnology, which include a weak information sharing infrastructure, a gap between research and industry, and difficulties obtaining commercialization-related information (NSTC, 2009/2016; McNeil & Lowe et al., 2007; Kim et al., 2014). Policy recommendations were developed to address these barriers to nanotechnology commercialization (NSTC, 2009/2016; President’s Council of Advisors on Science and Technology, 2014). One recommendation was to refurbish a web-based nanotechnology portal, which facilitates information flow and interactions among enterprises, universities, and government research institutes. 

Government concern with web portals in science and technology policy is not new. In Korea information networking in nanotechnology is an ongoing effort that has been carried forward within the framework of the nanotechnology and nanotechnology industry development 5-year plans since 2001, and which is now 
in its fourth plan period. These efforts have contributed considerably to the development of nanotechnology and its industry by facilitating the collection, connecion, and integration of nanotechnology-related information. However, the problems of information overoad, unavailability, and location that were addressed 
by the strategic plans remain unsolved and reoccur repeatedly. A re-examination is needed to ensure that a web portal can be an effective solution to the recurring problems.

Information and communications technology (ICT) including web portals is a major contributor to technological innovations and the commercialization of technologies (Geisler & Kassicieh, 1997). General-purpose technologies, such as nanotechnology (Shea et al., 2011) are pivotal to economic growth (Helpman, 1998), and ICT becomes much more important in facilitating innovations and commercialization of nanotechnology. ICT can be used to facilitate the distribution, access, sharing, collaboration, transfer, or commercialization (Czarnitzki & Rammer, 2003; Risdon, 1994) of technological knowledge and innovations. In this sense, the building-up of databases and web portals is certainly a good start to get relevant innovation actors connected by means of information networking in order to facilitate collaboration among them and commercialization in nanotechnology. 

However, information networking is as much a social process (Wellman, 2001) as innovation and commercialization are (Tornatzky, Fregus, & Avellar, 2013). Web portals are a place where individuals with differing needs access and interact. To build an effective web portal, we need to know what differing needs are presented by the actors— universities, government research institutes, and industry—, and what web portal features or functions are required to meet these needs. In doing this, we also need to set priorities among portal features or functions. Little research on web portal development in Korea has so far addressed distinct needs of sectoral actors in the national systems of innovation in nanotechnology. More importantly, the existing studies in nanotechnology networking have not addressed the non-linearity relationships between meeting users’ needs and meeting users’ satisfaction. The purpose of this study is to compare web portal requirements— features and functions— among universities, industry, and government research institutes in Korea using a Kano method. In other words, this study aims to identify similarities and dissimilarities in Kano-categorizations of features and functions required of nanotechnology among actors in universities, government research institutes, and industry. In using the Kano method, our focus is on the identification of policy-relevant features and functions of a new web portal in nanotechnology, not on the assessment and sophistication of the Kano model. 

 

2. LITERATURE REVIEW

2.1. Web Portals: User Features and Functions

There are multiple and differing meanings of a web portal. For our purposes, a web portal is defined as a package of information services and tools to facilitate the collection, management, and dissemination of resources in domain fields (Tatnall, 2005). For example, nanotechnology web portals serve as a point of access to an “integrated and structured body” (Tatnall, 2005) of information and functions in the domain field of nanotechnology. The features and functions of a web portal are determined by various factors. Many studies have discussed the features and functions of a web portal (Tatnall, 2005). An important point is that the features and functions of web ports are in constant change. A web portal can evolve from a single-functional information system to a multi-functional one, which provides a practical framework for inter-sector communication and collaboration (Tatnall, 2005). In an extensive review of nanotechnology innovations, Chen and Roco (2009) anticipated the emergence and importance of nanotechnology web portals of various special sorts. 

Nowadays, web portals include increasingly innovative features and functions of portals as an interactive mechanism and place (Stollberg et al., 2004). These features and functions include information and contents (e.g., papers, people, technology, laws), search and navigation, communication (e.g., chat, conferencing, Q&A), collaborative working, learning resources (e.g., webinar) and newsfeeds to mention a few. They allow members of a targeted community to contribute information contents and other resources, either by submitting information directly to the portal (via some editing or reviewing process), by posting the information on some associated web bulletin board, or to other collaboration tools (Reynolds, Shabajee, & Cayzer, 2004). As technology (including semantic web technologies) advances, web information portals improve in terms of structure, extensibility, customization, and sustainability compared to traditional portals (Reynolds et al., 2004). Big data analytics is touted to have a potential to overcome barriers to effective technology commercialization (Park & Roh et al., 2014; Szlezak et al., 2014). The advent of big data analytics shows a potential to transform the traditional Q&A functions of web portals, raising reasonable interest in the introduction of digital curation of data or contents from publications (Gaheen et al., 2013). Big data analytics and curation require both significant time and domain expertise (Kim, Warga, & Moen, 2013), and once well analyzed and curated, will be made available for re-use by other researchers and practitioners. Further, web portals are increasingly becoming an online place where collaboration as well as communication takes place within and between the communities of interest. Online communication and collaboration is not a newly emerged phenomenon. For example, e-Science has been a buzz-word around the early 2000s in the Korean science technology information policy community. New features and functions of web portals are increasingly demanded due to the continuous advancement in ICT, as well as government policy particularly towards information networking in the public sector. 

However, a web portal tends to be understood and defined differently from the perspective of the parties concerned. Stein and Hawking (2005) found that the term portal takes a different meaning depending on the viewpoint of the stakeholder: “to the business user it is all about information access and navigation, to the organization it is about adding value, to the marketplace it is about new business models, and to the technologies a portal is about integration.” The literature on government-university-industry interaction has documented barriers and facilitators to technology transfer and commercialization between and among them (Link & Tassey, 1989; Choi & Lee, 1999; Kim et al., 2014). While a recent study revealed that there is a global convergence among actors in the systems of innovation over time in terms of incentives and other factors (Perkmanna, Tartari, & McKelvey et al., 2013), disparities prevail among government-university-industry actors in terms of incentives and disincentives to technology development and commercialization. In other words, to be an effective framework of inter-sector communication and collaboration, a web portal will be designed and built in order to take into consideration not only similarities but also dissimilarities among different sectoral actors.

 

2.2. Kano Model

The Kano model is used to better understand the relationship between performance criteria and customer satisfaction, and to resolve trade-off dilemmas in multiple-criteria optimization by identifying the key criteria in customer satisfaction (Kano et al., 1984; Chen & Chuang, 2008; Hsieh, 2009). The Kano model of customer satisfaction as a function of need fulfilment refines Herzberg’s identification of hygiene and motivator factors by dividing system outcomes, products, or service (Von Dran, Zhang, & Small, 1999). The Kano model defines the relationship between product attributes and user satisfaction/expectation. There are five types of product attributes, three main attributes, and two potential attributes. Three main categories are basic needs, performance needs, and excitement needs. Each category corresponds to each of the three attributes: must-be, one-dimensional, and attractive attributes. The remaining potential attributes are questionable and reverse. The meanings of these five attributes as outlined by Rashid, Tamaki, Ullah, and Kubo (2011) are as follows. Mustbe attributes are those whose absence produces absolute dissatisfaction and whose presence does not increase the satisfaction. Attractive attributes are not expected to be in the product, but if provided, users will be surprised and their satisfaction will increase greatly. One-dimensional attributes enhance satisfaction and vice versa. Indifferent attributes do not result in satisfaction or dissatisfaction, whether provided or not. Reverse attributes lead to absolute dissatisfaction. And questionable attributes mean that there may be errors made in asking or answering questions.

In Figure 1, the upward vertical axis represents satisfaction and the downward vertical axis represents dissatisfaction of users. The leftward horizontal axis represents absence of performance (the attribute is not working/not present), which is the dysfunctional side. The rightward horizontal axis represents presence of performance (the attribute is working/present), which is the functional side. A respondent needs to answer one state out of Like, Must-be, Neutral, Live-with, and Dislike from the functional side (Rashid et al., 2011). The respondent needs to do the same for the dysfunctional side. The combination of answers determines how and what the respondent considers the underlying attribute.

 

3. DATA

3.1. Data Descriptions

Data for this study were obtained from a list of individuals who had signed up for information user membership of the National Nanotechnology Policy Centre. As of December 2015, the membership list contained valid email addresses of 5,251 individual members. The list was used as the population for an Internet survey. All 5,251 individuals were e-mailed an invitation letter containing a URL link into our questionnaire with Google or Naver forms. 

A total of 130 questionnaires were completed and returned after two email reminders. The adjusted response rate was 2.5%. Even though a nanotechnology webbased portal as a scientific information network serves a relatively small size of target audience (Schön, Hellmers, & Thomaschewski, 2014), this level of response rate may be well short of what should be a reasonable response rate in empirical studies of professionals and practitioners in science, technology, and industrial fields. What caused this low response level is still yet to be explained, though low response rate is frequently reported in internet surveys fielded to professionals and indicated as one of the fatal limitations of Internet surveys by experienced traditional and Internet survey researchers in Korea (Choi, Myeong, & Lee, 2008).

 

3.2. Sample Descriptions 

The questionnaire for this study included certain items related to demographic characteristics, institutional affiliation, frequently accessed web-based portals, and the purposes of access to web portals, 

 

Fig. 1 Conceptual relationships between product attributes and customer satisfaction

 

as well as those items suitable for the Kano model. Demographically, the sample of this study was composed of 118 male respondents (90.8%) and 12 female respondents (9.2%). In terms of institutional affiliation, the study sample consisted of 47 university respondents (36.2%), 31 government research institute (GRI) respondents (23.8%), and 52 business respondents (40.0%). There were five major occupational groups: professors (n=29, 22.3%), GRI researchers (n=28, 21.5%), private firm researchers (n=20, 15.4%), executives (n=18, 13.8%), employees (n=13, 10.0%), and others (n=21, 14.6%). Among the 130 respondents in our sample, 35.4% reported they frequently accessed special nanotechnology web portals, 26.2% Google Scholar, 36.2% more horizontal web portals, and the remaining reported that they had never accessed any web-based portals. Finally, of 127 respondents who reported they accessed any web sites, 59.1% reported that they accessed web portals for the purpose of performing research and development, 23.6% for the purpose of commercialization, and the remainder for other purposes such as collecting information or materials for policy research, learning about nanotechnology, and personal interest.

 

Table 1. Characteristics of Respondents

 

4. METHODS OF ANALYSIS

 

Table 2 shows a 22-item set of features and functions required of a nanotechnology web portal drawn from the existing body of literature (Fernandes, Raja, & Austin, 2005; Titnall et al., 2005; Gaheen et al., 2014). This includes the information content requirement (10 items), community communication requirement (six items), collaborative requirement (five items), and news feeding requirement (one item). 

To analyze the Kano questionnaire, we used the Kano method (provision/non-provision-based mode) (Table 3), which is designed to assess asymmetries in web users’ feelings based on hypothesized provision and non-provision of web portal features and functions (Mikulić & Prebežac, 2011). In doing this, this study utilized measures and procedures suggested by Plehn, Floker, Meissner, and Plehn (2016)—the most frequent-response categorization, customer satisfaction (dissatisfaction) coefficient, category strength and total strength, and Fong test (Kano, 1984; Timko, 1993; F 1996 L & Nb 1997) 

The most frequent-response categorization is the hallmark of the original Kano model, in which individual requirements of web portal users are classified into one of the six categories of Must-be, One-dimensional, Attractive, Indifference, Reverse, or Questionable (Table 4) on the basis of the highest frequency response. In the standard Kano model, the dominant view of web portal users is represented by the most frequent response (Plehn et al., 2016).

The customer satisfaction (dissatisfaction) coefficient (Timko, 1993) is introduced as another alternative measure to the standard Kano method to make possible a better understanding of service or product needs. The satisfaction (dissatisfaction) coefficient indicates the extent to which the provision (non-provision) of a requirement in a web portal increases users’ satisfaction (dissatisfaction). Using this customer satisfaction measure, the Kano model can help establish the selection criteria for the web portal features and functions that have the greatest influence on user satisfaction (Shanin, Pourhmidi, Antony, & Park, 2013). 
The customer satisfaction (CS) coefficient ranges from 
0 to 1, and the customer dissatisfaction (CD) coefficient ranges from -1 to 0. As suggested in Plehn et al. (2016), we set a cutoff value of 0.5; values above 0.5 or below -0.5 indicate a relevant degree of satisfaction or dissatisfaction, respectively, as calculated below. 

 

Table 2. Required Features and Functions of Nanotechnology Web Portal

 

Table 3. Examples of Functional and Dysfunctional Questions in the Kano Model

 

Table 4. Kano Evaluation Table Based on Responses to Functional and Dysfunctional Questions

 

Customer satisfaction (CS) coefficient. \(\mathsf {\frac{A+O}{A+O+M+I}}\, , [0 \sim 1]\)

customer dissatisfaction (CD) coefficient. \(\mathsf (-1) {\frac{O+M}{A+O+M+I}}\, , [-1 \sim 0]\)

 

The strength of the classification of a portal requirement into one of the six categories was defined as the category strength and total strength as used in Lee and Newcomb (1997). Category strength is used to measure the extent to which a web portal feature is closely classified to a Kano category. It is operationalized as the percentage difference of highest category above the next-highest category. Web portal requirements with category strength below 6 percent are considered to 
belong to the mixed (Plehn et al., 2016) or combination(Lee & Newcomb, 1997, p. 103) category. 

The total strength measure is used to classify features with a category strength above 6 percent. Total strength is defined as “the total percentage of attractive, one-dimensional, and must-be responses” for a web portal requirement (Lee & Newcomb 1997). If the total strength is high, the feature with a high percentage on the total strength can be considered to be required, even though the item (feature) fails to meet the 6% condition with a 90% confidence level for category strength.

The Fong test (Fong, 1996) is utilized to supplement classification based upon the category strength measure. This test checks whether an assignment of a web portal requirement to individual Kano categories is statistically significant or not (Plehn et al., 2016). The test value is calculated to determine the statistical significance of Kano responses at a 90% confidence level. This value is compared with the absolute values of the difference between the two most frequent responses, a and b. An assignment is considered to statistically significant if the absolute value of the difference of a and b is greater than the test value, as calculated below.

\(\mathsf {\mid a-b\mid < \,1.65 \times {\sqrt{(a+b)\blacktriangleright(2n-a-b)} \over 2\blacktriangleright n}}\)

 

5. RESULTS

Table 5 summarizes the Kano-categorizations of web portal requirements and related evaluations and statistics for university respondents, and Figure 2 displays the CS-coefficient matrix for university respondents.

The Kano-categorization for university users indicates that most web portal requirements are considered largely as either of one-dimensional or indifferent attributes. Only nine of 23 web portal requirements were categorized as one-dimensional attributes; these included legal, technical, financial, human, academic, statistical, R&D project, and commercial information. These requirements increase satisfaction if provided and decrease satisfaction if not provided. All communication-related requirements and collaboration-related requirements, together with the news requirement, were classified as indifferent. These communicationand collaboration-related features do not influence satisfaction and dissatisfaction. Facility information (e.g., nanotechnology equipment and facilities) was categorized as a must-be attribute, meaning its non-provision causes absolute dissatisfaction.

The Fong-test results revealed that the assignments of these requirements into individual attribute-categories were mostly not statistically significant. Only six of 23 requirements were statistically significant, all of which were communication- or collaboration-related requirements. This means that while the assignment of information-content-related features was not conclusive, the classification of communication- and collaboration-related features was significantly distinct in statistical terms. Meanwhile, the test-based category strength values suggested by Lee and Newcomb (1997) revealed quite different results from the Fong test. All requirements except for financial, academic, and facility information had six or higher values in terms of category strength, whereas those requirements that were significant in the Fong test still proved to be factors with six or higher category strength values. Despite the inconsistent test results, it is clear that indifferent attribute-categorization will be quite conclusive and considered not necessary as seen in the size of total strength values on these features.

The CS-coefficient matrix for university respondents indicates that features were relatively unevenly dispersed across the four quadrants. As shown in the indifferent attribute classification in Figure 2, most communication- and collaboration-related features were allocated in quadrant 1, having less influence on either dissatisfaction or satisfaction. Contrarily, big data analytics and article reviews, and human and financial information will increase satisfaction if provided 
(quadrant 3). Commercial and academic information (quadrant 2) has the potential to cause dissatisfaction if not provided. Legal, statistical, market, R&D project, and facility information (quadrant 4) can increase satisfaction if provided. 

Table 5 summarizes the Kano-categorizations of web portal requirements and related evaluations and statistics for government research institute respondents, and Figure 3 displays the related CS-coefficient matrix.

The Kano-categorization for government research nstitute respondents (Table 6) shows that web portal requirements were classified mostly as one-dimenional, attractive, or indifferent attributes. Facility information was classified as a must-be attribute. Legal, echnical, market, statistical, R&D project information, and sharing were considered to be one-dimensional attributes, and curation and Q&A to be attractive. However, many of the information content features, uch as financial, human, academic information, and communication- and collaboration-related features ncluding chat rooms, article reviews, collaborative, co-authoring, and testbeds were still considered indifferent attributes. Additionally, there were four requirements (commercial information, linkage, simulation, and big data analytics) that could not be assigned to any one Kano-category. 

The Fong-test results indicated that the assignments of these requirements into individual attribute-categories were mostly not statistically significant. There were only two of 23 requirements that were statistically significant. These two requirements, chat rooms and co-authoring, are indifferent attributes. As seen for the university respondents, the Kano-categorization in this study turned out to be inconclusive for the majority of the features shown in Table 5. The results of the Fong test were quite different from the category strength test suggested in Lee and Newcomb (1997).

The CS-coefficient matrix for university respondents indicated that communication- and collaboration-related requirements were mainly allocated to quadrant 4, meaning that these features have the potential to improve satisfaction if provided. It also revealed that certain features, such as market, R&D project, and technical information, will considerably decrease satisfaction if not provided (quadrant 3). In addition, facility and academic information has the potential to cause dissatisfaction, even though the impact size is relatively small (quadrant 2). 

 

Table 5. Evaluation of the Kano-Categorizations for University Respondents

 

Fig. 2 CS-coefficient matrix for university respondents

 

Table 6. Evaluation of the Kano Categorizations for Government Research Institute Respondents

 

Fig. 3 CS-coefficient matrix for government research institute respondents

 

Finally, according to the perceptions of industry respondents, 18 of 23 requirements were allocated to one of the three attributes of must-be, one-dimensional, or attractive. Two requirements were considered as must-be, 11 as one-dimensional, and two as attractive attributes, with the two remaining requirements allocated to two categories for each. Almost one-dimensional-attribute categories are those features related to communication and collaboration requirements. Technical, market, academic, and facility are considered as must-be attributes. Human and translated information are considered to be attractive attributes. Financial information, chat rooms, co-authoring, and testbeds are perceived as indifferent attributes.

The Fong-test results indicate that the Kano-categorization was not statistically significant for most requirements in Table 6. Only four requirements—academic info, chat rooms, sharing, and co-authoring—were statistically significant, leaving the Kano-categorization inconclusive for the majority of the features shown in Table 6. The results of Fong testing are largely consistent with results of the category strength test (Lee & Newcomb, 1997).

The CS-coefficient matrix for industry respondents shown in Figure 4 reveals that most information content requirements were allocated at lower quadrants and almost all communication- and collaboration-related requirements were allocated to upper quadrants in Table 7. Almost all communication- and collaboration-related requirements were located in quadrant 4. Among these requirements, translated information had a greater impact on satisfaction of industry users, if provided. Statistical, commercial, legal, and R&D project information located in quadrant 3 is considered to have decreasing effect on satisfaction, if not provided. Academic, technical, market and facility information, categorized as must-be attributes, is located at quadrant 2. These features will have considerable potential to cause dissatisfaction if not provided. 

 

6. DISCUSSION AND CONCLUSIONS

The sector was an important factor in explaining the relationships between web portal requirements and user satisfaction/expectations. It is desirable to have a comprehensive “one-stop shopping” (Chau et al., 2006) web portal to support web portal requirements for current and potential users in all sectors. In doing this, the bottom line is meeting at least basic and performance requirements of a web portal (i.e., must-be and one-dimensional). The preceding description of results presents some interesting findings. First, there are differences in perceptions of nanotechnology web portal requirements among users in the national systems of innovation. Second, despite these disparities among three groups of users, there are similarities that deserve attention when developing web portals. 

As for web portal requirements, university users’ perceptions were predominantly information-contents centered. Industrial users considered almost all web portal features necessary, whether they were related to information content, communication, or collaboration. Government research institute users were in between. There are several possible explanations for the tendency of industrial users to be more concerned about communication- and collaboration-related features. First, successful commercialization needs consistent exploratory R&D (Lee et al., 2013), which can be further facilitated with research facilities or equipment, whether offline or online, to bridge inter-sectoral boundaries (Anderegger, Zoller, & Boutellier, 2013). From the perspective of firms that have outdated facilities (Ministry of Knowledge Economy, 2011; NSTC, 2016), online communication and collaboration will be an efficient way to perform R&D and collect related information.

Second, despite these disparities among three groups of users, there are similarities among them which deserve due attention when developing web portals. While their impact size will vary, collaboration and communication-related features have the potential to entertain users in the university, government research institute, and industry sectors. Academic, market, and facility information features are considered basic features. Chat rooms are not considered as necessary for any of the sectoral actors. This is because ‘chat-rooms’ or ‘chatting’ conveys a negative connotation in Korea.

In this study, we tried to identify similarities and dissimilarities in Kano-categorizations of features and functions required of nanotechnology among actors 
in universities, government research institutes, and industry. We found that there are sheer differences and commonalities in perceptions of nanotechnology web portal requirements among actors in the national systems of innovation
 

Table 7. Evaluation of the Kano-Categorizations for Industry Respondents

 

Fig. 4 CS-coefficient matrix for industry respondents

 

This study has some limitations, and therefore the results should be cautiously interpreted. The small sample size hinders generalizations in time and space. Inconsistent test results will make correct assignment of individual Kano attributes unstable and untenable. This is possibly because of the sample size problem or the problem of respondents’ familiarity with Kano-questionnaires. Finally, our study provides no explanations of why respondents felt the way they reported. 

References

  1. Anderegger, S., Zoller, F. A., & Boutellier, R. (2013). Sharing research equipment to bridge intraorganizational boundaries: The cases of Novartis and ETH Zurich. Research-Technology Management, 56, 49-57. doi:10.5437/08956308x5601082.
  2. Bhushan, B. (2015). Governance, policy, and legislation of nanotechnology: A perspective. Microsystem Technology, 21, 1137-1155. doi:10.1007/s00542-015-2511-x.
  3. Chau, M., Huang, Z., Qin, J., Zhou, Y., & Chen, H. (2006). Building a scientific knowledge web portal: The NanoPort experience, Decision Support System, 42, 1216-1238. doi:10.1016/j.dss.2006.01.004.
  4. Chen, C. C., & Chuang, M. C. (2008). Integrating the Kano model into a robust design approach to enhance customer satisfaction with product design. International Journal of Production Economics, 114, 667-681. doi:10.1016/j.ijpe.2008.02.015.
  5. Chen, H., & Roco, M. C. (2009). Mapping nanontechnology innovations and knowledge: Global and longitudinal patent and literature analysis. New York. Springer.
  6. Cho, H., Jang, B., Chung, J., & Hong, J. (2005). Innovating scientific and technological informatisation. KISDI. (in Korean)
  7. Choi, Y., & Lee, J. (1999). Success factors for transferring technology to spin-off applications: The case of the technology property rights concession program in Korea. Journal of Technology Transfer, 25, 237-46. doi:10.1023/A:1007889010655.
  8. Choi, Y., Myeong, S., & Lee, K. (2008). Possibility and issues of Internet survey II: 2001 and 2006 survey results. Korean Review of Public Administration, 42, 423-440. (in Korean)
  9. Czarnitzki, D., & Rammer, C. (2003). Technology transfer via the Internet: A way to link public science and enterprises? Journal of Technology Transfer, 28, 131-147. doi:10.1023/A:1022990415301.
  10. Fernandes, K. J., Raja, V., & Austin, S. (2005). Portals as a knowledge repository and transfer tool- VIZCon case study. Technovation, 25, 1281-1289. doi:10.1016/j.technovation.2004.01.005.
  11. Fong, D. (1996). Using the self-stated importance questionnaire to interpret Kano questionnaire results. Center for Quality Management Journal, 5, 21-24. Retrieved from http://www.walden-family.com/public/cqm-journal/2-4-Whole-Issue.pdf.
  12. Gaheen, S., Hinkal, G. W., Morris, S. A., Lijowski, M., Heiskanen, M., & Klemm, J. D. (2013). caNanoLab: Data sharing to expedite the use of nanotechnology in biomedicine. Computer Science & Discovery, 6, doi:10.1088/1749-4699/6/1/014010.
  13. Geisler, E., & Kassicieh, S. K. (1997). Information technologies and technology commercialization: The research agenda. IEEE Transactions on Engineering Management, 44, 339-346. doi:10.1109/17.64986.
  14. Helpman, E. (Ed.). (1998). General purpose technologies and economic growth. Cambridge and London: The MIT Press.
  15. Hu, K. C., & Hsiao, M. W. (2016). Quality risk assessment model for airline services concerning Taiwanese airlines. Journal of Air Transport Management, 53, 177-185. doi:10.1016/j.jairtraman.2016.03.006.
  16. Huiskonen, J., & Pirttila, T. (1998). Sharpening logistics customer service strategy planning by applying Kano's quality element classification. International Journal of Production Economics, 56, 253-260. doi:10.1016/S0925-5273(97)00065-0.
  17. Kim, J., Warga, E., & Moen, W. E. (2013). Competencies required for digital curation: An analysis of job advertisements. International Journal of Digital Curation, 8, 66-83. doi:10.2218/ijde.v8il.242.
  18. Kim, S., et al. (2014). Perspective and challenges for commercializing nano-technology. Korea Institute of Science and Technology Evaluation and Planning. (in Korean).
  19. Kultanan, C., Crostack, H., & Refflinghust, R. (2006). Implementation of Kano methodology through various stakeholder requirements. Proceedings of the 7th Asia Pacific Industrial Engineering and Management Systems Conference 2006. 17-20 December 2006. Bankok, Thailand.
  20. Lee, C., Lee, S., Jhon, M. S., & Shin, J. (2013). Factors influencing nanotechnology commercialization: an empirical analysis of nanotechnology firms in South Korea. Journal of Nanoparticle Research, 15(1), 1-17. doi:10.1007/s11051-013-1444-5.
  21. Mazzola, L. (2003). Commercializing nanotechnology. Nature Biotechnology, 21(10), 1137-1143. doi:10.1038/nbt1003-1137.
  22. McNeil, R. D., Lowe, J., Mastroianni, T., Cronin, J., & Ferk, D. (2007). Barriers to nanotechnology commercialization. Final report. Prepared for U.S. Department Of Commerce Technology Administration. Washington D.C. Retrieved from http://www.wimb.fink.rs/docs/Report-BarriersNanotechnologyCommercialization.pdf.
  23. Mikulic, J., & Prebežac, D. (2011). A critical review of techniques for classifying quality attributes in the Kano model. Managing Service Quality: An International Journal, 21, 46-66. doi:10.1108/09604521111100243f.
  24. Ministry of Knowledge Economy (MKE). (2012). Nano convergence diffusion strategy: Nano Plus 2020. December 2012 (in Korean).
  25. Ministry of Knowledge Economy (MKE). (2011). Nano Convergence 2020 New Industry Development Strategy. (in Korean).
  26. National Science and Technology Council. (2001, 2005, 2011, 2016). The Master Plan of Nanotechnology Development. (in Korean).
  27. National Science and Technology Council. (2009). Nano Convergence Industry Development Strategy. (in Korean).
  28. National Science and Technology Council. (2015). 2015 Nanotechnology Development Annual Plan.
  29. National Science and Technology Council. (2015). Nano Convergence Industry Development Strategy. (in Korean).
  30. Park, C., Roh, H., Choi, Y., Kim, H., & Lee, J. (2014). A study on the application methods of big data in the technology commercialization process. Journal of Society for e-Business Studies, 19, 73-99. (in Korean) https://doi.org/10.7838/jsebs.2014.19.4.073
  31. Perkmanna, M., Tartari, V., & McKelvey, M. et al. (2013). Academic engagement and commercialisation: A review of the literature on university-industry relations. Research Policy, 42, 423-442. https://doi.org/10.1016/j.respol.2012.09.007
  32. President's Council of Advisors on Science and Technology. (2014). Report to the President and Congress on the fifth assessment of the National Nanotechnology Initiative. Retrieved from https://www.whitehouse.gov/sites/default/files/microsites/ostp/PCAST/pcast_fifth_nni_review_oct2014_final.pdf.
  33. Rashid, M. M., Tamaki, J., Ullah, A. M., & Kubo, A. (2011). A Kano model based linguistic application for customer needs analysis. International Journal of Engineering Business Management, 3(2), 29-35. doi:10.5772/50934.
  34. Reynolds, D., Shabajee, P., & Cayzer, S. (2004). Semantic information portals, WWW Alt. '04 Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters (pp. 290-291). Retrieved from http://www.hpl.hp.com/techreports/2004/HPL-2004-67.pdf.
  35. Risdon, P. (1994). Transferring technology through the internet channel. Journal of Extension, 32(1), Retrieved from http://www.joe.org/joe/1994june/a1.php.
  36. Sahu, A. K., Goswami, N. G., & Choudhury, B. K. (2014). Information needs of scientists and engineers: A case study of government, public and private sector RDLICs relating to metallurgy & materials science. SRELS Journal of Information Management, 51(1), doi:10.17821/srels/2014/v51i1/47202
  37. Schon, E., Hellmers, J., & Thomaschewski, J. (2014). Usability evaluation methods for special interest internet information services. International Journal of Artificial Intelligence and Interactive Multimedia, 2, 26-32. doi:10.9781/ijimai.2014.263.
  38. Shahin, S., Pourhamidi, M., Antony, J., & Park, S. H. (2013). Typology of Kano models: A critical review of literature and proposition of a revised model. International Journal of Quality & Reliability Management, 30, 341-358. doi:10.1108/02656711311299863.
  39. Shea, C. M., Crinde, R., & Elmslle, B. (2011). Nanotechnology as general-purpose technology: Empirical evidence and implications. Technology Analysis & Strategic Management, 23, 175-192. doi:10.1080/09537325.2011.543336.
  40. Stein, A., & Hawking, P. (2005). Employee portals: Just the next step in the journey. In A. Tatnall (Ed.), Web portals: The new gateways to internet information and services (pp. 172-184). London: IDEA Group Publishing.
  41. Stollberg, M., Lausen, H., Lara, R., Ding, Y., Han, S., Fensel, D., & Reynolds, D. (2004). Towards semantic web portals, WWW Alt. '04 Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters. Retrieved from http://info.slis.indiana.edu/-dingying/Publication/TowardsSWPortals.pdf.
  42. Szlezak, N., Evers, M., Wang, J., & Perez, L. (2014). The role of big data and advanced analytics in drug discovery, development, and commercialization. Clinical Pharmacology and Therapeutics, 95, 492-495, doi:10.1038/clpt.2014.29.
  43. Tatnall, A. (2005). Web portals: The new gateways to internet information and services. London: IDEA Group Publishing.
  44. Tassey, G. (Ed.). (1989). Cooperative research and development: The industry-university-government relationship. Boston: Kluwer Academic Publishers.
  45. Timko, M. (1993). An experiment in continuous analysis. In D. Walden (Ed.), Kano's methods for understanding customer-defined quality. Center for Quality of Management Journal, 2, 17-20. Retrieved from http://www.walden-family.com/public/cqm-journal/2-4-Whole-Issue.pdf.
  46. Tornatzky, L. G., Fregus, E. O., & Avellar, J. W. (2013). Innovation and social process: A national experiment in implementing social technology. New York: Pergamon Press.
  47. Wellman, B. (2001). Computer networks as social networks. Science, 293 (5537), 2031-2034. doi:10.1126/science.1065547.