• Title/Summary/Keyword: task-based

Search Result 4,663, Processing Time 0.027 seconds

Transfer Learning using Multiple ConvNet Layers Activation Features with Principal Component Analysis for Image Classification (전이학습 기반 다중 컨볼류션 신경망 레이어의 활성화 특징과 주성분 분석을 이용한 이미지 분류 방법)

  • Byambajav, Batkhuu;Alikhanov, Jumabek;Fang, Yang;Ko, Seunghyun;Jo, Geun Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.205-225
    • /
    • 2018
  • Convolutional Neural Network (ConvNet) is one class of the powerful Deep Neural Network that can analyze and learn hierarchies of visual features. Originally, first neural network (Neocognitron) was introduced in the 80s. At that time, the neural network was not broadly used in both industry and academic field by cause of large-scale dataset shortage and low computational power. However, after a few decades later in 2012, Krizhevsky made a breakthrough on ILSVRC-12 visual recognition competition using Convolutional Neural Network. That breakthrough revived people interest in the neural network. The success of Convolutional Neural Network is achieved with two main factors. First of them is the emergence of advanced hardware (GPUs) for sufficient parallel computation. Second is the availability of large-scale datasets such as ImageNet (ILSVRC) dataset for training. Unfortunately, many new domains are bottlenecked by these factors. For most domains, it is difficult and requires lots of effort to gather large-scale dataset to train a ConvNet. Moreover, even if we have a large-scale dataset, training ConvNet from scratch is required expensive resource and time-consuming. These two obstacles can be solved by using transfer learning. Transfer learning is a method for transferring the knowledge from a source domain to new domain. There are two major Transfer learning cases. First one is ConvNet as fixed feature extractor, and the second one is Fine-tune the ConvNet on a new dataset. In the first case, using pre-trained ConvNet (such as on ImageNet) to compute feed-forward activations of the image into the ConvNet and extract activation features from specific layers. In the second case, replacing and retraining the ConvNet classifier on the new dataset, then fine-tune the weights of the pre-trained network with the backpropagation. In this paper, we focus on using multiple ConvNet layers as a fixed feature extractor only. However, applying features with high dimensional complexity that is directly extracted from multiple ConvNet layers is still a challenging problem. We observe that features extracted from multiple ConvNet layers address the different characteristics of the image which means better representation could be obtained by finding the optimal combination of multiple ConvNet layers. Based on that observation, we propose to employ multiple ConvNet layer representations for transfer learning instead of a single ConvNet layer representation. Overall, our primary pipeline has three steps. Firstly, images from target task are given as input to ConvNet, then that image will be feed-forwarded into pre-trained AlexNet, and the activation features from three fully connected convolutional layers are extracted. Secondly, activation features of three ConvNet layers are concatenated to obtain multiple ConvNet layers representation because it will gain more information about an image. When three fully connected layer features concatenated, the occurring image representation would have 9192 (4096+4096+1000) dimension features. However, features extracted from multiple ConvNet layers are redundant and noisy since they are extracted from the same ConvNet. Thus, a third step, we will use Principal Component Analysis (PCA) to select salient features before the training phase. When salient features are obtained, the classifier can classify image more accurately, and the performance of transfer learning can be improved. To evaluate proposed method, experiments are conducted in three standard datasets (Caltech-256, VOC07, and SUN397) to compare multiple ConvNet layer representations against single ConvNet layer representation by using PCA for feature selection and dimension reduction. Our experiments demonstrated the importance of feature selection for multiple ConvNet layer representation. Moreover, our proposed approach achieved 75.6% accuracy compared to 73.9% accuracy achieved by FC7 layer on the Caltech-256 dataset, 73.1% accuracy compared to 69.2% accuracy achieved by FC8 layer on the VOC07 dataset, 52.2% accuracy compared to 48.7% accuracy achieved by FC7 layer on the SUN397 dataset. We also showed that our proposed approach achieved superior performance, 2.8%, 2.1% and 3.1% accuracy improvement on Caltech-256, VOC07, and SUN397 dataset respectively compare to existing work.

A Study on the Relationship Between Online Community Characteristics and Loyalty : Focused on Mediating Roles of Self-Congruency, Consumer Experience, and Consumer to Consumer Interactivity (온라인 커뮤니티 특성과 충성도 간의 관계에 대한 연구: 자아일치성, 소비자 체험, 상호작용성의 매개적 역할을 중심으로)

  • Kim, Moon-Tae;Ock, Jung-Won
    • Journal of Global Scholars of Marketing Science
    • /
    • v.18 no.4
    • /
    • pp.157-194
    • /
    • 2008
  • The popularity of communities on the internet has captured the attention of marketing scholars and practitioners. By adapting to the culture of the internet, however, and providing consumer with the ability to interact with one another in addition to the company, businesses can build new and deeper relationships with customers. The economic potential of online communities has been discussed with much hope in the many popular papers. In contrast to this enthusiastic prognostications, empirical and practical evidence regarding the economic potential of the online community has shown a little different conclusion. To date, even communities with high levels of membership and vibrant social arenas have failed to build financial viability. In this perspective, this study investigates the role of various kinds of influencing factors to online community loyalty and basically suggests the framework that explains the process of building purchase loyalty. Even though the importance of building loyalty in an online environment has been emphasized from the marketing theorists and practitioners, there is no sufficient research conclusion about what is the process of building purchase loyalty and the most powerful factors that influence to it. In this study, the process of building purchase loyalty is divided into three levels; characteristics of community site such as content superiority, site vividness, navigation easiness, and customerization, the mediating variables such as self congruency, consumer experience, and consumer to consumer interactivity, and finally various factors about online community loyalty such as visit loyalty, affect, trust, and purchase loyalty are those things. And the findings of this research are as follows. First, consumer-to-consumer interactivity is an important factor to online community purchase loyalty and other loyalty factors. This means, in order to interact with other people more actively, many participants in online community have the willingness to buy some kinds of products such as music, content, avatar, and etc. From this perspective, marketers of online community have to create some online environments in order that consumers can easily interact with other consumers and make some site environments in order that consumer can feel experience in this site is interesting and self congruency is higher than at other community sites. It has been argued that giving consumers a good experience is vital in cyber space, and websites create an active (rather than passive) customer by their nature. Some researchers have tried to pin down the positive experience, with limited success and less empirical support. Web sites can provide a cognitively stimulating experience for the user. We define the online community experience as playfulness based on the past studies. Playfulness is created by the excitement generated through a website's content and measured using three descriptors Marketers can promote using and visiting online communities, which deliver a superior web experience, to influence their customers' attitudes and actions, encouraging high involvement with those communities. Specially, we suggest that transcendent customer experiences(TCEs) which have aspects of flow and/or peak experience, can generate lasting shifts in beliefs and attitudes including subjective self-transformation and facilitate strong consumer's ties to a online community. And we find that website success is closely related to positive website experiences: consumers will spend more time on the site, interacting with other users. As we can see figure 2, visit loyalty and consumer affect toward the online community site didn't directly influence to purchase loyalty. This implies that there may be a little different situations here in online community site compared to online shopping mall studies that shows close relations between revisit intention and purchase intention. There are so many alternative sites on web, consumers do not want to spend money to buy content and etc. In this sense, marketers of community websites must know consumers' affect toward online community site is not a last goal and important factor to influnece consumers' purchase. Third, building good content environment can be a really important marketing tool to create a competitive advantage in cyberspace. For example, Cyworld, Korea's number one community site shows distinctive superiority in the consumer evaluations of content characteristics such as content superiority, site vividness, and customerization. Particularly, comsumer evaluation about customerization was remarkably higher than the other sites. In this point, we can conclude that providing comsumers with good, unique and highly customized content will be urgent and important task directly and indirectly impacting to self congruency, consumer experience, c-to-c interactivity, and various loyalty factors of online community. By creating enjoyable, useful, and unique online community environments, online community portals such as Daum, Naver, and Cyworld are able to build customer loyalty to a degree that many of today's online marketer can only dream of these loyalty, in turn, generates strong economic returns. Another way to build good online community site is to provide consumers with an interactive, fun, experience-oriented or experiential Web site. Elements that can make a dot.com's Web site experiential include graphics, 3-D images, animation, video and audio capabilities. In addition, chat rooms and real-time customer service applications (which link site visitors directly to other visitors, or with company support personnel, respectively) are also being used to make web sites more interactive. Researchers note that online communities are increasingly incorporating such applications in their Web sites, in order to make consumers' online shopping experience more similar to that of an offline store. That is, if consumers are able to experience sensory stimulation (e.g. via 3-D images and audio sound), interact with other consumers (e.g., via chat rooms), and interact with sales or support people (e.g. via a real-time chat interface or e-mail), then they are likely to have a more positive dot.com experience, and develop a more positive image toward the online company itself). Analysts caution, however, that, while high quality graphics, animation and the like may create a fun experience for consumers, when heavily used, they can slow site navigation, resulting in frustrated consumers, who may never return to a site. Consequently, some analysts suggest that, at least with current technology, the rule-of-thumb is that less is more. That is, while graphics etc. can draw consumers to a site, they should be kept to a minimum, so as not to impact negatively on consumers' overall site experience.

  • PDF

Clustering Method based on Genre Interest for Cold-Start Problem in Movie Recommendation (영화 추천 시스템의 초기 사용자 문제를 위한 장르 선호 기반의 클러스터링 기법)

  • You, Tithrottanak;Rosli, Ahmad Nurzid;Ha, Inay;Jo, Geun-Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.1
    • /
    • pp.57-77
    • /
    • 2013
  • Social media has become one of the most popular media in web and mobile application. In 2011, social networks and blogs are still the top destination of online users, according to a study from Nielsen Company. In their studies, nearly 4 in 5active users visit social network and blog. Social Networks and Blogs sites rule Americans' Internet time, accounting to 23 percent of time spent online. Facebook is the main social network that the U.S internet users spend time more than the other social network services such as Yahoo, Google, AOL Media Network, Twitter, Linked In and so on. In recent trend, most of the companies promote their products in the Facebook by creating the "Facebook Page" that refers to specific product. The "Like" option allows user to subscribed and received updates their interested on from the page. The film makers which produce a lot of films around the world also take part to market and promote their films by exploiting the advantages of using the "Facebook Page". In addition, a great number of streaming service providers allows users to subscribe their service to watch and enjoy movies and TV program. They can instantly watch movies and TV program over the internet to PCs, Macs and TVs. Netflix alone as the world's leading subscription service have more than 30 million streaming members in the United States, Latin America, the United Kingdom and the Nordics. As the matter of facts, a million of movies and TV program with different of genres are offered to the subscriber. In contrast, users need spend a lot time to find the right movies which are related to their interest genre. Recent years there are many researchers who have been propose a method to improve prediction the rating or preference that would give the most related items such as books, music or movies to the garget user or the group of users that have the same interest in the particular items. One of the most popular methods to build recommendation system is traditional Collaborative Filtering (CF). The method compute the similarity of the target user and other users, which then are cluster in the same interest on items according which items that users have been rated. The method then predicts other items from the same group of users to recommend to a group of users. Moreover, There are many items that need to study for suggesting to users such as books, music, movies, news, videos and so on. However, in this paper we only focus on movie as item to recommend to users. In addition, there are many challenges for CF task. Firstly, the "sparsity problem"; it occurs when user information preference is not enough. The recommendation accuracies result is lower compared to the neighbor who composed with a large amount of ratings. The second problem is "cold-start problem"; it occurs whenever new users or items are added into the system, which each has norating or a few rating. For instance, no personalized predictions can be made for a new user without any ratings on the record. In this research we propose a clustering method according to the users' genre interest extracted from social network service (SNS) and user's movies rating information system to solve the "cold-start problem." Our proposed method will clusters the target user together with the other users by combining the user genre interest and the rating information. It is important to realize a huge amount of interesting and useful user's information from Facebook Graph, we can extract information from the "Facebook Page" which "Like" by them. Moreover, we use the Internet Movie Database(IMDb) as the main dataset. The IMDbis online databases that consist of a large amount of information related to movies, TV programs and including actors. This dataset not only used to provide movie information in our Movie Rating Systems, but also as resources to provide movie genre information which extracted from the "Facebook Page". Formerly, the user must login with their Facebook account to login to the Movie Rating System, at the same time our system will collect the genre interest from the "Facebook Page". We conduct many experiments with other methods to see how our method performs and we also compare to the other methods. First, we compared our proposed method in the case of the normal recommendation to see how our system improves the recommendation result. Then we experiment method in case of cold-start problem. Our experiment show that our method is outperform than the other methods. In these two cases of our experimentation, we see that our proposed method produces better result in case both cases.