Deep Learning Architectures and Applications (딥러닝의 모형과 응용사례)
-
- Journal of Intelligence and Information Systems
- /
- v.22 no.2
- /
- pp.127-142
- /
- 2016
Deep learning model is a kind of neural networks that allows multiple hidden layers. There are various deep learning architectures such as convolutional neural networks, deep belief networks and recurrent neural networks. Those have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. Among those architectures, convolutional neural networks and recurrent neural networks are classified as the supervised learning model. And in recent years, those supervised learning models have gained more popularity than unsupervised learning models such as deep belief networks, because supervised learning models have shown fashionable applications in such fields mentioned above. Deep learning models can be trained with backpropagation algorithm. Backpropagation is an abbreviation for "backward propagation of errors" and a common method of training artificial neural networks used in conjunction with an optimization method such as gradient descent. The method calculates the gradient of an error function with respect to all the weights in the network. The gradient is fed to the optimization method which in turn uses it to update the weights, in an attempt to minimize the error function. Convolutional neural networks use a special architecture which is particularly well-adapted to classify images. Using this architecture makes convolutional networks fast to train. This, in turn, helps us train deep, muti-layer networks, which are very good at classifying images. These days, deep convolutional networks are used in most neural networks for image recognition. Convolutional neural networks use three basic ideas: local receptive fields, shared weights, and pooling. By local receptive fields, we mean that each neuron in the first(or any) hidden layer will be connected to a small region of the input(or previous layer's) neurons. Shared weights mean that we're going to use the same weights and bias for each of the local receptive field. This means that all the neurons in the hidden layer detect exactly the same feature, just at different locations in the input image. In addition to the convolutional layers just described, convolutional neural networks also contain pooling layers. Pooling layers are usually used immediately after convolutional layers. What the pooling layers do is to simplify the information in the output from the convolutional layer. Recent convolutional network architectures have 10 to 20 hidden layers and billions of connections between units. Training deep learning networks has taken weeks several years ago, but thanks to progress in GPU and algorithm enhancement, training time has reduced to several hours. Neural networks with time-varying behavior are known as recurrent neural networks or RNNs. A recurrent neural network is a class of artificial neural network where connections between units form a directed cycle. This creates an internal state of the network which allows it to exhibit dynamic temporal behavior. Unlike feedforward neural networks, RNNs can use their internal memory to process arbitrary sequences of inputs. Early RNN models turned out to be very difficult to train, harder even than deep feedforward networks. The reason is the unstable gradient problem such as vanishing gradient and exploding gradient. The gradient can get smaller and smaller as it is propagated back through layers. This makes learning in early layers extremely slow. The problem actually gets worse in RNNs, since gradients aren't just propagated backward through layers, they're propagated backward through time. If the network runs for a long time, that can make the gradient extremely unstable and hard to learn from. It has been possible to incorporate an idea known as long short-term memory units (LSTMs) into RNNs. LSTMs make it much easier to get good results when training RNNs, and many recent papers make use of LSTMs or related ideas.
Marketing financial services used to be easier. Today, the competition in financial services is fierce. Not only has the competition become more intense, financial services have also changed structurally. In an environment with various customer needs and severe competitions, the marketing in financial services industry is getting more difficult and more important than before. However, there are still not enough studies on financial services marketing in Korea whereas lots of research papers have been published frequently in some international journals. The purpose of this paper is (1)to review the literature on financial services marketing, (2)to investigate current marketing activities based on in-depth interview with financial marketing managers in Korea, and (3)to suggest some implications for future research on the financial services marketing. Financial products are not consumer products. In fact, they are not products at all in the way product marketing is usually described. Nor are they altogether like services. The financial industry operates in a unique way, and its marketing tasks are correspondingly complex. However, the literature review shows that there has been a lack of basic studies which dealt with inherent characteristics of financial services marketing compared to the research on marketing in other industries. Many studies in domestic marketing journals have so far focused only on the general customer behaviors and the special issues in some financial industries. However, for more effective financial services marketing, we have to answer following questions. Is there any difference between financial service marketing and consumer packaged goods marketing? What are the differences between the financial services marketing and other services marketing such as education and health services? Are there different ways of marketing among banks, securities firms, insurance firms, and credit card companies? In other words, we need more detailed research as well as basic studies about the financial services marketing. For example, we need concrete definitions of financial services marketing, bank marketing, securities firm marketing, and etc. It is also required to compare the characteristics of each marketing within the financial services industry. The products sold in each market have different characteristics such as duration and degree of risk-taking. It means that there are sub-categories in financial services marketing. We have to consider them in the future research on the financial services marketing. It is also necessary to study customer decision making process in the financial markets. There have been little research on how customers search and process information, compare alternatives, make final decision, and repeat their choices. Because financial services have some unique characteristics, we need different understandings in the customer behaviors compared to the behaviors in other service markets. And also considering the rapid growth in financial markets and upcoming severe competition between domestic and global financial companies, it is time to start more systematic and detailed research on financial services marketing in Korea. In the second part of this paper, I analyzed the results of in-depth interview with 20 marketing managers of financial services companies in Korea. As a result, I found that the role of marketing departments in Korean financial companies are mainly focused on the short-term activities such as sales support, promotion, and CRM data analysis although the size and history of marketing departments to some extent show a sign of maturity. Most companies established official marketing departments before 2001. Average number of employees in a marketing department is about 58. However, marketing managers in eight companies(40% of the sample) still think that the purpose of marketing is only to support and manage general sales activities. It shows that some companies have sales-oriented concept rather than marketing-oriented concept. I also found three key words which marketing managers think importantly in financial services markets. They are (1)Trust in customer relationship, (2)Brand differentiation, and (3)Rapid response to customer needs. 50% of the sample support that "Trust" is the most important key word in the financial services marketing. It is interesting that 80% of banks and securities companies think that "Trust" is the most important thing, whereas managers in credit card companies consider "Rapid response to customer needs" as the most important key word in their market. In addition, there are different problems recognition of marketing managers depending on the types of financial industries they belong to. For example, in the case of banks and insurance companies, marketing managers consider "a lack of communication with other departments" as the most serious problem. On the other hand, in the case of securities firms, "a lack of utilization of customer data" is the most serious problem. These results imply that there are different important factors for the customer satisfaction depending on the types of financial industries, and managers have to consider them when marketing financial products in more effective ways. For example, It will be necessary for marketing managers to study different important factors which affect customer satisfaction, repeat purchase, degree of risk-taking, and possibility of cross-selling according to the types of financial industries. I also suggested six hypothetical propositions for the future research.