• Title/Summary/Keyword: PROCESS VISION

Search Result 1,205, Processing Time 0.039 seconds

The Changes of System Design Premises and the Structural Reforms of Korean Government S&T Development Management System (시스템 설계전제의 변화와 공공부문 과학기술발전관리시스템 구조의 개혁)

  • 노화준
    • Journal of Technology Innovation
    • /
    • v.5 no.2
    • /
    • pp.1-21
    • /
    • 1997
  • The objective of this paper is to think about what structural reforms of the Korean government S&T development management system might be. Korean society is currently experiencing a drastic socio-economic transformation. The results of this transformation should be reflected on the determining process of the directions and breadths of structural reforms of government S&T development management system. Because the government system design will be based on the premises of socio-economic conditions under which administrative activities perform and also this socio-economic changes can influence on changes of the premises of government management system design. Moreover, S&T development management system is a subsystem of government system so that the directions of structural reform of those subsystems should be considered in the broad framework changes in the development management system of the government. For the last forty years, the Korean government S&T development management system has been based on the premises including transformation from an agrarian society to an industrial society, authoritarianism and centrally controlled institutions, and exteremely small portions of private investments for science and thechonology R & D of the total. Recently, however, the premises of Korean government S&T development management system have rapidly changed. the characteristics of these changes are including tranformation from an industrial society to a knowledge and information intensive society, globalization, localization, and relatively large portion of private investments for science and technology R & C of the total. The basis of government reforms in Korea was the realization of the performances and values through the enhancement of national competitive capacity, attainment of lean government, decentralization and autonomy. However, the Korean government has attached a symbolic value of strategic organizations representing strong policy intentions of government for the science and technology based development. Most problems associated with the Korean government S&T development management system have grown worse during 1990s. Many people perceive that considerable part of this problem was generated because the government could not properly adapt itself to new administrative environment and the paradigm shift in its role. First of all, the Korean government S&T development management system as a whole failed to develop an integrated vision under which processes in formulating science and thechology development goals and developing consistent government plans concerning science and technology development are guided. Second, most of the local governments have little organizational capacity and manpowers to handle localized activities to promote science and technology in their regions. Third, the measure to coordinate and set priorities to invest resources for the development of science and technology was not effective. Fourth, the Most has been losing its reputation as the symbol of ideological commitment of the top policy maker to promote science and technology. Various ideas to reform government S&T development management system have been suggested recently. Most frequently cited ideas are as follow : (ⅰ)strengthen the functions of MoST by supplementing the strong incentive and regulatory measures; (ⅱ)create a new Ministry of Education, Science & Technology and Research by merging the Ministry of Education and the MoST; (ⅲ)create a new Ministry of Science & Technology and Industry ; and(ⅳ)create a National Science and Technology Policy Council under the chairmanship of the President. Four alternatives suggested have been widely discussed among the interested parties and they each have merits as well as weaknesses. The first alternative could be seen as an alternative which cannot resolve current conflicts among various ministries concerning priority setting and resource allocation. However, this alternatives can be seen as a way of showing the top policymaker's strong intention to emphasize science and technology based development. Second alternative is giving a strategic to emphasize on the training and supplying qualified manpower to meet knowledge and information intensive future society. This alternative is considered to be consistent with the new administrative paradigm emphasizing lean government and decentralization. However, opponents are worrying about the linkages and cooperative research between university and industry could be weakening. The third alternative has been adopted mostly in nations which have strong basic science research but weak industrial innovation traditions. Main weakness of this alternative for Korea is that Korean science and technology development system has no strong basic science and technology research traditions. The fourth alternative is consistent with new administrative paradigms and government reform bases. However, opponents to this alternative are worried that the intensive development of science and technology because of Korea's low potential research capabilities in science and technology development. Considerning the present Korean socio-economic situation which demands highly qualified human resources and development strategies which emphasizes the accumulations of knowledge-based stocks, I would like to suggest the route of creating a new Ministry of Education, Science & Technology and Research by intergrating education administration functions and science & technology development function into one ministry.

  • PDF

Geographical Structure of View Point in the Landscape Experience on Mountain in Yangsan City (경관체함이 발생하는 조망점의 지리구조에 관한 연구;양산시 소재 산지를 대상으로)

  • Kang, Young-Jo;Cha, Young-Chae;Cha, Myeong-Sook
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.36 no.3
    • /
    • pp.75-84
    • /
    • 2008
  • The purpose of this research is to find the visual characteristics and geographic structure in a landscape of mountains in Yangsan City. In order to carry out this study, 40 view points of 6 mountains in Yangsan City were selected to experience the mountainscape. The results are as follows. The mountainscape of Yangsan City was confirmed from the view point to the object of view as ranging in middle distance reverse, the angle of elevation 11${\sim}13^{\circ}$ which give the impression of confronted to the mountain, and the horizontal angle 50${\sim}90^{\circ}$ which gives the impression of vastness. This shows that mountainscapes are perceived impressively when seeing the mountain with the meaning to feel the texture of the mountain as a confrontational relationship rather than a pictorial relationship. The geographic structure of the view point which occurs in scenes of impressive experience is classified into eight types and its characteristics are investigated. The first type is corridor, and it emerges in a long narrow linear structure made from the surrounding environment with buildings or street trees. The second is tunnel in which a vision and light hidden while passing underneath a bridge, high-level road, or inside a tunnel can be seen. Third, the maze is formed by the mountain shape. The hill spur emerges when the direction of traffic changes after turning the coner of a building or mountain edge. The hill ground emerges at the top of a hill slope. Next, parallel emerges when the observer and the mountain are in the same direction of process. Confrontation occurs when confronting an isolated mountain. Finally, the view point emerges when passing through major points such as a bridge or square and the boundary of a village or city. This research arranged visual conditions that create impressive mountainscapes. Geographic characteristics in terms of Types that make possible to experience mountainscapes were described. The results of this research will be basic data collected for the management and preservation of mountainscapes and for landscape effect evaluation. Furthermore, this research suggests theoretical evidence to preserve and manage geographic structures that create view experiences as well as to preserve the landscape in terms of view points.

Characteristics of Park Program Operation of Seoul Metropolitan Government (서울시의 공원 프로그램 운영 특성)

  • Cho, Yun Joo;Chae, Young;Wee, Man-Gyu;Jung, Sang Hak;Song, Hyeong Nam;Kim, Yun-Geum
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.48 no.2
    • /
    • pp.10-19
    • /
    • 2020
  • The park program can adeptly cope with the diversification of leisure needs in accordance with the changing times. The program also makes the relationship between the users and the park itself closer. For this reason, the Seoul Metropolitan Government has operated a variety of programs, beginning with the Botanical Class Program at the Namsan Outdoor Botanical Garden in 1997. The government additionally began to organize park programs by establishing the Park and Leisure Department and three Park Greenery Offices. However, research on park programs is mainly focused on park users. Therefore, this study intends to reveal the structure of the programs by studying the program operation. The specific purposes of this study are '1. Review the institutional characteristics that underlie the operation of the Park Program in Seoul by examining the relevant laws, the operation organizations, and the personnel composition, 2. Analyze the operation methods, such as procurement and the execution of the program, operation costs, and public-private cooperation methods, etc. 3. Analyze the composition and contents of the program from 2015 to 2017, and process and identify the relationship between the structure of the program operation and the program itself.' Summarizing the results obtained from the study, as far as the structure of the first program operation, the support laws were not systematic, but the operating organization was working to establish a system. The second characteristic of the operation is that most of the budget was funded by local governments, but the level of citizen involvement was low. Third, when we looked at the characteristics of the program, the number of programs increased, but they were focused on a specific theme and few programs actively used the park facilities. Based on the results, three tasks can be proposed. The first is that the 'Act on Parks and Green Spaces' should include the concepts and support for park programs. Second, there is a need to change from the ideas of the quantitative increase of programs to qualitative improvements. Lastly, it is necessary to reorganize the Green Seoul Bureau of the Seoul Metropolitan Government into a citizen-led and leisure-oriented organization to promote the park leisure culture. This study has significance, as it was conducted with a service provider, not a program user, unlike many previous park program-related studies. The results of this study will be able to contribute not only to the Seoul Metropolitan Government, but also to other local governments to suggest the direction of the management and the operation of the park for the consumer, and consequently, it will help prepare the long-term vision of parks as the closest leisure location for most citizens.

A Study on the Comparative Art theory in the Arts and Crafts Movement and Post-impressionism (미술 공예 운동과 후기 인상주의 비교 예술론 연구)

  • 박연실
    • Archives of design research
    • /
    • v.20
    • /
    • pp.279-291
    • /
    • 1997
  • The history of modern design begins with the arts and crafts movement(1860). The importance of the movement which decorated the outset gave birth to all the trends of thought which would occur under the circumstances within it, and is deemed that the ideas of the figures who played an active part in the movement might be ceaselessly continued through the works and ideas of their outstanding juniors or purpils as a doctrine of the philosophy of design. Therefore, it might be a prerequisite that the significance and spirit of the movement, and its developing process should be addressed in detail in the first place, but for the limited space of this paper, it was intended to desvribe only the part which can be interpreted in duplicate, linked with post-impressionism. The subject of this thesis is about a theory of art in which both ideas of the movement(1860) and the post-impressionism(1910) are comparatively reviewed. The genre, strictly speaking, is classified into the history of painting, and there is a gap fo about an half century between the issues which are comparatively discussed here. Both the movements began in a same environmental place of England, specially the movement at Milieu in England, and since there is a common point that the representative runners of each movement, William Morries(1834-1896) and Roger Fry(1866-1934), belong to a same race of Engol-Saxon, their ideas coincide with an aesthetic scholar, H. Tanie's aesthetic interpretation method and the more important is, as being elucidated in the comment and aesthetic theory for which Roger Fry gave effort and activity in his later life, that when he read intensively Ruskin's books, $\ulcorner$Modern Painters$\lrcorner$and$\ulcorner$Stones of Venice$\lrcorner$he had solidified his idea of post-impressionism while giving approval and criticism on them. After all, as in a co-painter, Windyham Lewis's reference of 'Roger Fry's Too Late Morris Movement', he, inspired by the actual activities of Morris, played activities similar to that of Morris in which exhibiting and selling some of his decorative art works signed by him and the works of post-impressionism through (1913-1920). Herein, that is wished to add a remark by this author is a point that the author of$\ulcorner$Vision and Design$\lrcorner$, Roger Fry, has not be made a subject of discussion specially in the Korean world of design. So, with this case of a thesis, it's wished that many latent awakened, design persons in korea give efforts to researching into Roger Fry so that their findings could be officially announced in the would. By the way, what is tried to describe in this paper from now on is to analyse and review the origin of post-impressionism which idea was first coined in the art world through the 1st and 2nd exhibitions of 'Manet and Post-impressionism' which were opened each at the Grafton Gallery in 1910 and 1913 by him. And also, it is intended to review it through the art journals and some references by critics of the day in which favorable criticism or severe criticism were ready to comment through the opinions and influences of the coworkers of Roger Fry, say, Clive Bell, Desmond Maccarthy, etc. and of himself as a main axis, on the art ideas of Gauguin, Gogh, Matisse, and Cezanne whose works were the typical ones participated and exhibited in those 1st and 2nd exhibitions.

  • PDF

The Value of Entrepreneurial Orientation and Social Capital for Enhancing Collective Performance in R&D Collaborations of Korean Ventures (벤처기업의 R&D협력에서 사회적 자본과 기업가적 지향성이 협력성과에 미치는 영향)

  • Seo, Ribin
    • Journal of Korea Technology Innovation Society
    • /
    • v.20 no.1
    • /
    • pp.1-33
    • /
    • 2017
  • In the last decades, technology-oriented small firms, i.e. venture businesses, have been increasingly engaged in R&D collaborations with external parties as strategic means for technological innovation. Despite ample evidence on the benefit of such collaborations for the firms, there has been less attention to examining whether and how the firms' social interactions with cooperating partners and their managerial characteristics contribute to that benefit. Drawing on the theories of social capital and entrepreneurial orientation, this study is to remedy this gap. The theory of social capital, referring to a sum of the value and potential resources embedded in social relationships of collectives, provides an integrated view of social factors among cooperating partners, e.g. strong ties, network stability, trust, reciprocity, shared vision and value. It categorizes these factors into structural, relational, and cognitive dimensions of social capital. Entrepreneurial orientation theory captures firms' managerial characteristics as a combination of innovativeness, proactiveness, and risk-taking. This addresses firms' managerial process to utilize and combine internal and external resources for wealth creation and opportunity realization. Against this background, this study investigates what roles social capital among cooperating R&D partners and entrepreneurial orientation of the collaborating firms play for collective performance improvement in R&D collaborations. In terms of the collective performance, this study adopts two indicators: technological competitiveness and business performance. Technological competitiveness refers to the contribution of a technology developed by a cooperative R&D project to competitive advantage of a firm while business performance is defined as the financial and economic outcome of a collaboration. Using a sample of 218 Korean ventures engaging in R&D collaboration with external parties, the author finds the significant effects of social capital (i.e. structural, relational, and cognitive dimensions) and entrepreneurial orientation (i.e. innovativeness, proactiveness, and risk-taking) on both of the technological competitiveness and the business performance. Further, the higher the social capital among R&D partners, the more likely it is to foster the entrepreneurial orientation at firm-level. Most importantly, the entrepreneurial orientation at firm-level is an significant mediator of the relationship between social capital and collective performance. Beyond these novel empirical findings, this study contributes to the literature on R&D collaboration. The findings' implications for management and policy are deeply discussed in the conclusion.

True Orthoimage Generation from LiDAR Intensity Using Deep Learning (딥러닝에 의한 라이다 반사강도로부터 엄밀정사영상 생성)

  • Shin, Young Ha;Hyung, Sung Woong;Lee, Dong-Cheon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.38 no.4
    • /
    • pp.363-373
    • /
    • 2020
  • During last decades numerous studies generating orthoimage have been carried out. Traditional methods require exterior orientation parameters of aerial images and precise 3D object modeling data and DTM (Digital Terrain Model) to detect and recover occlusion areas. Furthermore, it is challenging task to automate the complicated process. In this paper, we proposed a new concept of true orthoimage generation using DL (Deep Learning). DL is rapidly used in wide range of fields. In particular, GAN (Generative Adversarial Network) is one of the DL models for various tasks in imaging processing and computer vision. The generator tries to produce results similar to the real images, while discriminator judges fake and real images until the results are satisfied. Such mutually adversarial mechanism improves quality of the results. Experiments were performed using GAN-based Pix2Pix model by utilizing IR (Infrared) orthoimages, intensity from LiDAR data provided by the German Society for Photogrammetry, Remote Sensing and Geoinformation (DGPF) through the ISPRS (International Society for Photogrammetry and Remote Sensing). Two approaches were implemented: (1) One-step training with intensity data and high resolution orthoimages, (2) Recursive training with intensity data and color-coded low resolution intensity images for progressive enhancement of the results. Two methods provided similar quality based on FID (Fréchet Inception Distance) measures. However, if quality of the input data is close to the target image, better results could be obtained by increasing epoch. This paper is an early experimental study for feasibility of DL-based true orthoimage generation and further improvement would be necessary.

A Study on the Dental Service Statifation of Cityizens in Deajeon (대전시 시민의 치과의료서비스에 관한 만족도 조사연구)

  • Sung, Bo-Kyun
    • Journal of Korean society of Dental Hygiene
    • /
    • v.8 no.4
    • /
    • pp.19-30
    • /
    • 2008
  • This study reached the following conclusions as a result of carrying out the questionnaire survey of self-descriptions for the satisfaction after the citizens of Daejon uses the dental clinics, in order to identify the factors of satisfaction to the medical services of such dental clinics to be utilized in the patient management by dental hygienists, provide the basic data to provide the medical services desired by patients. 1. 43.9% men responded to the facilities and 56.1% women to the atmosphere for the standards of selection of dental clinics by general characteristic, and the college graduates or more to the kindness (38.2%), high-school graduates (43.2%) and middle-school graduates (25.9%) or less to the close distance for the level of educational attainment (p=0.009), which was meant to have a statistical significance. 2. The execution of reservation system for the dental clinics showed 54.7%, the reserved time was observed upon the execution of such reservation system, the dental clinics where they practice such system were 40.6%, and the confirmation methods was done through the telephone with 62.5%. 3. The experience of fear upon the dental treatment showed 74.6%. The type of fear showed the machine sound (48.7%) for men and cry of others for women (70.8%) at the highest. 70% of those under 30 at the age responded to the sharp instruments at the highest. 83.3% of Yousung-gu showed the highest by responding to the cry of others for the residential areas. The statistically significant difference was shown in both the age and residential area (p=0.000). 4. Women showed higher in the distribution of gender for the sterilization of instruments for the external satisfaction of dental clinics(p=0.000) and those under 30 at the age showed the highest with 2.98${\pm}$0.95(p=0.001). Seo-gu (3.48${\pm}$0.77) was the highest for the residential area (p=0.000), and there was statistically significant differences in the gender, age and residential area. 5. Men showed higher satisfaction than women in the clean state and the statistically significant differences were shown (p=0.000) at the age as the high satisfaction was shown for those under 30 at the age (2.35${\pm}$0.79), those having the income not less than 10 million won and not more than 20 million won (2.43${\pm}$0.78), and Seo-gu (2.63 ${\pm}$0.69) for the residential area. 6. For the internal satisfaction of dental clinic by users for the medical services in the dental clinics, 61.1% women responded to no in the ability of solving the inconvenience in the service process, and showed low ability of solving the inconvenience from 30 at the age (26.2%) and by responding to Dong-gu (22.1%) for the residential area, showing statically significant differences(p=0.000). For the re-use of dental clinics, 46.6% men (p=0.043) for the gender, 24.3% under 30 at the age and 22.9% of Dong-gu for the residential area responded to the re-use, showing statistically significant differences for the gender and residential area (p=0.000). 7. The dissatisfaction showed a high rate of 69.5% for the satisfaction to the medical services of dental clinics. 46.2% men responded to the pain and women to the feeling of foreign substance for the reason of dissatisfaction while those under 30 at the age showed 55.6% for others, those between 50 and 59 41.7% for the feeling of foreign substance. 86.3% carried out the education for cautions after the treatments and most people turned out that they do not carry out the continuous health management of mouth as 20.5% responded to that they carry out such health management.

  • PDF

A Study on design management of the design industry and 10 strategic industries in Busan Metropolitan City (부산광역시 10대전략산업과 디자인산업의 디자인경영에 관한 연구)

  • Park, Kwang-Cheol;Cho, Kyoung-Seop
    • Management & Information Systems Review
    • /
    • v.30 no.4
    • /
    • pp.293-314
    • /
    • 2011
  • The current study investigated the position of future strategy analyzed from the perspective of design management in relation to 10 strategic industries implemented through 3 steps based on promising growth and advancement of Busan industries and evidence provided from a study on the development program of design industry in Busan. It elucidated the role of design industry as a key role from the perspective of design management in an age of creative revolution of futures values. It analyzed the associations between composition of future strategy and design industry in 10 strategic industries of Busan, and explained the relationships with the strategic industries. The perspective of design management involves that design as a ground of values is an industry of the future values, which performs a key strategic function and role, and a theoretical investigation examined the relationships between main functions of design management and business management. Chapter 3 organized items proposed in the design development program in Busan and examined goals and systems which become basic formation of establishment of design strategy in Busan and conditions for design industry in the associations with strategic industry. Chapter 4 described priorities of practicability by step through analyzing and grouping top 30 projects in Busan industry including meanings as key strategy, position relations, and policy priorities by analyzing elements of design management of strategic industry and describing and analyzing the concept of promoting Busan design. The theme of the present study is to change perception of design management as a key value and a condition to decide creativity industry into future industry and to evaluate vision of Busan design industry and meanings proposed as proceeding strategy. The early 21st century is an age when agrarian society has changed into industrial society is dominated by knowledge economy of the information revolution and one should prepare for the growth phase of creative innovation based on creative revolution of the 4th wave of creative society by design management which has become a center in 2000s on the whole. With the advent of creative paradigm and based on the function and role of the current creative economy age new innovation DNA of design management will be created. Design process has changed through information and knowledge-oriented trends of digital through convergence between industries from industrial design to convergence of industries, and it is expected that integrated design of value creation using information and technology will play a key role in Busan design industry development and top 10 strategic industries.

  • PDF

Tendency of 'a Cartoon Image' Appearing in Korean Modern Fine Arts - Ocusing on 'Atomouse' of Lee Dong-gi - (한국 현대 미술에 나타나는 '만화 이미지'의 경향성 -이동기의 <아토마우스>를 중심으로-)

  • Jeon, Young Je
    • Cartoon and Animation Studies
    • /
    • s.36
    • /
    • pp.669-702
    • /
    • 2014
  • Today, in Korean modern fine arts, 'cartoon images' are utilized for their roles of the 'personas' of the artists, and as the 'texts' for the artistic discourses, while they play a role as a bridgehead between the public and art. In this study, we made a study, focusing on 'Atomouse' of Lee Dong-gi, in order to examine how the borrowing of the 'cartoon images' was made in the Korean modern fine arts, and what its period context is. 'Atomouse' of Lee Dong-gi is the first cartoon character that appeared in Korean modern fine arts, and it has acquired a symbolism of a subculture being acknowledged as art. In this study, we tried to find out what period contexts the changes of 'Atomouse' have, focusing on the private exhibitions of Lee Dong-gi, such as 'Smoking' Exhibition (2006), 'Bubble' Exhibition (2008), 'Double Vision' Exhibition (2008), 'The Garden of Uncertainty' Exhibition (2012) and 'Do Not Look Back with Angry Face' Exhibition (2013). Atomouse was born in the era of 'lack of pop' a change was attempted of it in the era of 'excess of pop' and its proceeding ended along with the 'settlement of the neo-pop'. From Atomouse started from the unconsciousness of the artist, we can find the 'identity' of the Republic of Korea, which was being influenced by the 'American and Japanese' culture, as well as the symbolism of a subculture being acknowledged as art, while it emerged as an icon to represent the Korean pop art of the time. Then, as the agony and self-examination of the artist was contained in it, its use was changed into the role as a persona and it was utilized as a tool to connect the and figurative worlds. In the end, the artist put an end to the proceeding of the 'Atomouse' at the boundaries of a persona and an alter ego, removing the creation with his own hands. In the process in which Lee Dong-gi created and changed 'Atomouse', the start-up and growth of the pop art are included in the history of the Korean modern fine arts, apart from a study of an artist. 'Atomouse' was not only painted on the walls of the subway stations in the form of public art, but it tried to closely communicate with the public through the collaboration with diverse media. It made the best use of the 'marketability' which a 'cartoon character' had at first, so that pure art was made a step closer to the public. So 'Atomouse' of Lee Dong-gi not only raised a subculture into the realm of high art, but lowered the door sill to high art. Through the study we could confirm what position 'Atomouse' of Lee Dong-gi, which started absurdly between parody and Hommage, takes in Korean modern art of today.

Deep Learning Architectures and Applications (딥러닝의 모형과 응용사례)

  • Ahn, SungMahn
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.2
    • /
    • pp.127-142
    • /
    • 2016
  • Deep learning model is a kind of neural networks that allows multiple hidden layers. There are various deep learning architectures such as convolutional neural networks, deep belief networks and recurrent neural networks. Those have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. Among those architectures, convolutional neural networks and recurrent neural networks are classified as the supervised learning model. And in recent years, those supervised learning models have gained more popularity than unsupervised learning models such as deep belief networks, because supervised learning models have shown fashionable applications in such fields mentioned above. Deep learning models can be trained with backpropagation algorithm. Backpropagation is an abbreviation for "backward propagation of errors" and a common method of training artificial neural networks used in conjunction with an optimization method such as gradient descent. The method calculates the gradient of an error function with respect to all the weights in the network. The gradient is fed to the optimization method which in turn uses it to update the weights, in an attempt to minimize the error function. Convolutional neural networks use a special architecture which is particularly well-adapted to classify images. Using this architecture makes convolutional networks fast to train. This, in turn, helps us train deep, muti-layer networks, which are very good at classifying images. These days, deep convolutional networks are used in most neural networks for image recognition. Convolutional neural networks use three basic ideas: local receptive fields, shared weights, and pooling. By local receptive fields, we mean that each neuron in the first(or any) hidden layer will be connected to a small region of the input(or previous layer's) neurons. Shared weights mean that we're going to use the same weights and bias for each of the local receptive field. This means that all the neurons in the hidden layer detect exactly the same feature, just at different locations in the input image. In addition to the convolutional layers just described, convolutional neural networks also contain pooling layers. Pooling layers are usually used immediately after convolutional layers. What the pooling layers do is to simplify the information in the output from the convolutional layer. Recent convolutional network architectures have 10 to 20 hidden layers and billions of connections between units. Training deep learning networks has taken weeks several years ago, but thanks to progress in GPU and algorithm enhancement, training time has reduced to several hours. Neural networks with time-varying behavior are known as recurrent neural networks or RNNs. A recurrent neural network is a class of artificial neural network where connections between units form a directed cycle. This creates an internal state of the network which allows it to exhibit dynamic temporal behavior. Unlike feedforward neural networks, RNNs can use their internal memory to process arbitrary sequences of inputs. Early RNN models turned out to be very difficult to train, harder even than deep feedforward networks. The reason is the unstable gradient problem such as vanishing gradient and exploding gradient. The gradient can get smaller and smaller as it is propagated back through layers. This makes learning in early layers extremely slow. The problem actually gets worse in RNNs, since gradients aren't just propagated backward through layers, they're propagated backward through time. If the network runs for a long time, that can make the gradient extremely unstable and hard to learn from. It has been possible to incorporate an idea known as long short-term memory units (LSTMs) into RNNs. LSTMs make it much easier to get good results when training RNNs, and many recent papers make use of LSTMs or related ideas.