• Title/Summary/Keyword: Human Visual System

Search Result 873, Processing Time 0.026 seconds

Dual CNN Structured Sound Event Detection Algorithm Based on Real Life Acoustic Dataset (실생활 음향 데이터 기반 이중 CNN 구조를 특징으로 하는 음향 이벤트 인식 알고리즘)

  • Suh, Sangwon;Lim, Wootaek;Jeong, Youngho;Lee, Taejin;Kim, Hui Yong
    • Journal of Broadcast Engineering
    • /
    • v.23 no.6
    • /
    • pp.855-865
    • /
    • 2018
  • Sound event detection is one of the research areas to model human auditory cognitive characteristics by recognizing events in an environment with multiple acoustic events and determining the onset and offset time for each event. DCASE, a research group on acoustic scene classification and sound event detection, is proceeding challenges to encourage participation of researchers and to activate sound event detection research. However, the size of the dataset provided by the DCASE Challenge is relatively small compared to ImageNet, which is a representative dataset for visual object recognition, and there are not many open sources for the acoustic dataset. In this study, the sound events that can occur in indoor and outdoor are collected on a larger scale and annotated for dataset construction. Furthermore, to improve the performance of the sound event detection task, we developed a dual CNN structured sound event detection system by adding a supplementary neural network to a convolutional neural network to determine the presence of sound events. Finally, we conducted a comparative experiment with both baseline systems of the DCASE 2016 and 2017.

Sound Visualization based on Emotional Analysis of Musical Parameters (음악 구성요소의 감정 구조 분석에 기반 한 시각화 연구)

  • Kim, Hey-Ran;Song, Eun-Sung
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.6
    • /
    • pp.104-112
    • /
    • 2021
  • In this study, emotional analysis was conducted based on the basic attribute data of music and the emotional model in psychology, and the result was applied to the visualization rules in the formative arts. In the existing studies using musical parameter, there were many cases with more practical purposes to classify, search, and recommend music for people. In this study, the focus was on enabling sound data to be used as a material for creating artworks and used for aesthetic expression. In order to study the music visualization as an art form, a method that can include human emotions should be designed, which is the characteristics of the arts itself. Therefore, a well-structured basic classification of musical attributes and a classification system on emotions were provided. Also, through the shape, color, and animation of the visual elements, the visualization of the musical elements was performed by reflecting the subdivided input parameters based on emotions. This study can be used as basic data for artists who explore a field of music visualization, and the analysis method and work results for matching emotion-based music components and visualizations will be the basis for automated visualization by artificial intelligence in the future.

A Comparative Study on the Different Usage of the Grids between Leonardo da Vinci and J.N.L. Durand (레오나르도 다 빈치와 J.N.L. 뒤랑의 그리드 사용법에 관한 비교 연구)

  • Hwang, Minhye
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.7 no.8
    • /
    • pp.189-199
    • /
    • 2017
  • The purpose of this study is to compare the grid usage that is common to Leonardo da Vinci and J.N.L. Durand in the process of designing the architectural plan. In the days when there was no proper measurement tool, auxiliary lines relied entirely on the architect's personal mindset and design convenience. Therefore, it is considered that studying the auxiliary lines drawn by the architects will be useful for studying the human perception system. Among auxiliary lines, the grid has been used by many architects. Leonardo da Vinci and J.N.L. Durand are famous. However, these two show a significant different grid usage. As auxiliary grid and space ares added the center of the Leonardo da Vinci grid continues to move, and the grid in his sketch is becoming a building space itself. So I call it 'conceptual grid'. In the case of J.N.L. Durand, the one center of the grid is always at the center of the drawing. That is, all the positions of the grid can be determined in phase around a common point, and all of the same specifications are assumed. The grid is a kind of filter. That's why his grid is a visual abstraction of the process of thinking. In this paper, I will call the grid of J.N.L. Durand as 'abstract grid'.

Application of Support Vector Regression for Improving the Performance of the Emotion Prediction Model (감정예측모형의 성과개선을 위한 Support Vector Regression 응용)

  • Kim, Seongjin;Ryoo, Eunchung;Jung, Min Kyu;Kim, Jae Kyeong;Ahn, Hyunchul
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.185-202
    • /
    • 2012
  • .Since the value of information has been realized in the information society, the usage and collection of information has become important. A facial expression that contains thousands of information as an artistic painting can be described in thousands of words. Followed by the idea, there has recently been a number of attempts to provide customers and companies with an intelligent service, which enables the perception of human emotions through one's facial expressions. For example, MIT Media Lab, the leading organization in this research area, has developed the human emotion prediction model, and has applied their studies to the commercial business. In the academic area, a number of the conventional methods such as Multiple Regression Analysis (MRA) or Artificial Neural Networks (ANN) have been applied to predict human emotion in prior studies. However, MRA is generally criticized because of its low prediction accuracy. This is inevitable since MRA can only explain the linear relationship between the dependent variables and the independent variable. To mitigate the limitations of MRA, some studies like Jung and Kim (2012) have used ANN as the alternative, and they reported that ANN generated more accurate prediction than the statistical methods like MRA. However, it has also been criticized due to over fitting and the difficulty of the network design (e.g. setting the number of the layers and the number of the nodes in the hidden layers). Under this background, we propose a novel model using Support Vector Regression (SVR) in order to increase the prediction accuracy. SVR is an extensive version of Support Vector Machine (SVM) designated to solve the regression problems. The model produced by SVR only depends on a subset of the training data, because the cost function for building the model ignores any training data that is close (within a threshold ${\varepsilon}$) to the model prediction. Using SVR, we tried to build a model that can measure the level of arousal and valence from the facial features. To validate the usefulness of the proposed model, we collected the data of facial reactions when providing appropriate visual stimulating contents, and extracted the features from the data. Next, the steps of the preprocessing were taken to choose statistically significant variables. In total, 297 cases were used for the experiment. As the comparative models, we also applied MRA and ANN to the same data set. For SVR, we adopted '${\varepsilon}$-insensitive loss function', and 'grid search' technique to find the optimal values of the parameters like C, d, ${\sigma}^2$, and ${\varepsilon}$. In the case of ANN, we adopted a standard three-layer backpropagation network, which has a single hidden layer. The learning rate and momentum rate of ANN were set to 10%, and we used sigmoid function as the transfer function of hidden and output nodes. We performed the experiments repeatedly by varying the number of nodes in the hidden layer to n/2, n, 3n/2, and 2n, where n is the number of the input variables. The stopping condition for ANN was set to 50,000 learning events. And, we used MAE (Mean Absolute Error) as the measure for performance comparison. From the experiment, we found that SVR achieved the highest prediction accuracy for the hold-out data set compared to MRA and ANN. Regardless of the target variables (the level of arousal, or the level of positive / negative valence), SVR showed the best performance for the hold-out data set. ANN also outperformed MRA, however, it showed the considerably lower prediction accuracy than SVR for both target variables. The findings of our research are expected to be useful to the researchers or practitioners who are willing to build the models for recognizing human emotions.

Review of Policy Direction and Coupled Model Development between Groundwater Recharge Quantity and Climate Change (기후변화 연동 지하수 함양량 산정 모델 개발 및 정책방향 고찰)

  • Lee, Moung-Jin;Lee, Joung-Ho;Jeon, Seong-Woo;Houng, Hyun-Jung
    • Journal of Environmental Policy
    • /
    • v.9 no.2
    • /
    • pp.157-184
    • /
    • 2010
  • Global climate change is destroying the water circulation balance by changing rates of precipitation, recharge and discharge, and evapotranspiration. The Intergovernmental Panel on Climate Change (IPCC 2007) makes "changes in rainfall pattern due to climate system changes and consequent shortage of available water resource" a high priority as the weakest part among the effects of human environment caused by future climate changes. Groundwater, which occupies a considerable portion of the world's water resources, is related to climate change via surface water such as rivers, lakes, and marshes, and "direct" interactions, being indirectly affected through recharge. Therefore, in order to quantify the effects of climate change on groundwater resources, it is necessary to not only predict the main variables of climate change but to also accurately predict the underground rainfall recharge quantity. In this paper, the authors selected a relevant climate change scenario, In this context, the authors selected A1B from the Special Report on Emission Scenario (SRES) which is distributed at Korea Meteorological Administration. By using data on temperature, rainfall, soil, and land use, the groundwater recharge rate for the research area was estimated by period and embodied as geographic information system (GIS). In order to calculate the groundwater recharge quantity, Visual HELP3 was used as main model for groundwater recharge, and the physical properties of weather, temperature, and soil layers were used as main input data. General changes to water circulation due to climate change have already been predicted. In order to systematically solve problems associated with how the groundwater resource circulation system should be reflected in future policies pertaining to groundwater resources, it may be urgent to recalculate the groundwater recharge quantity and consequent quantity for using via prediction of climate change in Korea in the future and then reflection of the results. The space-time calculation of changes to the groundwater recharge quantity in the study area may serve as a foundation to present additional measures for the improved management of domestic groundwater resources.

  • PDF

A Study on Lyricism Expression of Color & Realistic Expression reflected in Oriental Painting of flower & birds (전통화조화의 사실적(寫實的) 표현과 시정적(詩情的) 색채표현)

  • Ha, Yeon-Su
    • Journal of Science of Art and Design
    • /
    • v.10
    • /
    • pp.183-218
    • /
    • 2006
  • Colors change in time corresponding with the value system and aesthetic consciousness of the time. The roles that colors play in painting can be divided into the formative role based on the contrast and harmony of color planes and the aesthetic role expressed by colors to represent the objects. The aesthetic consciousness of the orient starts with the Civility(禮) and Pleasure(樂), which is closely related with restrained or tempered human feelings. In the art world of the orient including poem, painting, and music, what are seen and felt from the objects are not represented in all. Added by the sentiment laid background, the beauty of the orient emphasizes the beauty of restraint and temperance, which has long been the essential aesthetic emotion of the orient. From the very inception of oriental painting, colors had become a symbolic system in which the five colors associated with the philosophy of Yin and Yang and Five Forces were symbolically connected with the four sacred animals of Red Peacock, Black Turtle, Blue Dragon, and White Tiger. In this color system the use of colors was not free from ideological matters, and was further constrained by the limited color production and distribution. Therefore, development in color expression seemed to have been very much limited because of the unavailability and unreadiness of various colors. Studies into the flow in oriental painting show that color expression in oriental painting have changed from symbolic color expression to poetic expression, and then to emotional color expression as the mode of painting changes in time. As oriental painting transformed from the art of religious or ceremonial purpose to one of appreciation, the mast visible change in color expression is the one of realism(simulation). Rooted on the naturalistic color expression of the orient where the fundamental properties of objects were considered mast critical, this realistic color expression depicts the genuine color properties that the objects posses, with many examples in the Flower & Bird Painting prior to the North Sung dynasty. This realistic expression of colors changed as poetic sentiments were fused with painting in later years of the North Sung dynasty, in which a conversion to light ink and light coloring in the use of ink and colors was witnessed, and subjective emotion was intervened and represented. This mode of color expression had established as free and creative coloring with vivid expression of individuality. The fusion of coloring and lyricism was borrowed from the trend in painting after the North Sung dynasty which was mentioned earlier, and from the trend in which painting was fused with poetic sentiments to express the emotion of artists, accompanied with such features as light coloring and compositional change. Here, the lyricism refers to the artist's subjective perspective of the world and expression of it in refined words with certain rhythm, the essence of which is the integration of the artist's ego and the world. The poetic ego projects the emotion and sentiment toward the external objects or assimilates them in order to express the emotion and sentiment of one's own ego in depth and most efficiently. This is closely related with the rationale behind the long-standing tradition of continuous representation of same objects in oriental painting from ancient times to contemporary days. According to the thoughts of the orient, nature was not just an object of expression, but recognized as a personified body, to which the artist projects his or her emotions. The result is the rebirth of meaning in painting, completely different from what the same objects previously represented. This process helps achieve the integration and unity between the objects and the ego. Therefore, this paper discussed the lyrical expression of colors in the works of the author, drawing upon the poetic expression method reflected in the traditional Flower and Bird Painting, one of the painting modes mainly depending on color expression. Based on the related discussion and analysis, it was possible to identify the deep thoughts and the distinctive expression methods of the orient and to address the significance to prioritize the issue of transmission and development of these precious traditions, which will constitute the main identity of the author's future work.

  • PDF

Practical Strategies for Urban Regeneration through an Application of Landscape Urbanism (랜드스케이프 어바니즘 관점에서 본 도시재생 전략 연구)

  • Cho, Se-Hwan
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.38 no.2
    • /
    • pp.109-118
    • /
    • 2010
  • This study aims to propose practical strategies for the new urban ideal of regeneration. A book review highlights the emergence of new trends of urbanization in knowledge-information industrial society beyond the new town Ideal of the industrial society. The meaning of ‘landscape’ in landscape urbanism represents not the visual and decorative pictures, but the dynamic process in the context of changes and evolutions. Also, knowledge-information industrial society and landscape have a meaning in the same context of flow and process with changes of velocity. Finally, these key words convey a meaning with the new urban trends of urbanization in knowledge-information industrial society in the context of value-oriented characteristics of dynamics and process. Urban regeneration is emerging as the new urban ideal in the knowledge-information industrial society, beyond the new town ideal of industrial society. It is in the same context as landscape urbanism with respect to green infrastructure buildings and designs for the transformation of urban surfaces covered with concrete and asphalt into the ecological surface, and of the ecological surfaces into the cultural surface that could be communicated with human beings. This research revealed the six strategies for urban regeneration as follows. The First, the strategies for the transformation of urban surfaces into ecological surfaces, the second, the strategies for the transformation of ecological surfaces into cultural surfaces, the third, the introduction of mixed and convergence land use, the forth, the transformation of former sites(e.g. military and factory) into urban parks, the fifth, the introduction of waterfront park zones that have the function of ecological and park-oriented mixed land use and, the sixth, the building and design of green infrastructure in the residential and commercial complex in CBD. These strategies call for the reforms of development laws and regulations to restrict building coverage ratio, building heights, and the introduction of park-oriented mixed zoning regulations. Another method for implementating the above listed strategies was the introduction of a strategic planning system instead of the traditional master plan system. This system uses a value planning approach and brand making by imagery. It is able to construct the meaning of an image and its creativeness directly.

Dual Codec Based Joint Bit Rate Control Scheme for Terrestrial Stereoscopic 3DTV Broadcast (지상파 스테레오스코픽 3DTV 방송을 위한 이종 부호화기 기반 합동 비트율 제어 연구)

  • Chang, Yong-Jun;Kim, Mun-Churl
    • Journal of Broadcast Engineering
    • /
    • v.16 no.2
    • /
    • pp.216-225
    • /
    • 2011
  • Following the proliferation of three-dimensional video contents and displays, many terrestrial broadcasting companies have been preparing for stereoscopic 3DTV service. In terrestrial stereoscopic broadcast, it is a difficult task to code and transmit two video sequences while sustaining as high quality as 2DTV broadcast due to the limited bandwidth defined by the existing digital TV standards such as ATSC. Thus, a terrestrial 3DTV broadcasting with a heterogeneous video codec system, where the left image and right images are based on MPEG-2 and H.264/AVC, respectively, is considered in order to achieve both high quality broadcasting service and compatibility for the existing 2DTV viewers. Without significant change in the current terrestrial broadcasting systems, we propose a joint rate control scheme for stereoscopic 3DTV service based on the heterogeneous dual codec systems. The proposed joint rate control scheme applies to the MPEG-2 encoder a quadratic rate-quantization model which is adopted in the H.264/AVC. Then the controller is designed for the sum of the left and right bitstreams to meet the bandwidth requirement of broadcasting standards while the sum of image distortions is minimized by adjusting quantization parameter obtained from the proposed optimization scheme. Besides, we consider a condition on maintaining quality difference between the left and right images around a desired level in the optimization in order to mitigate negative effects on human visual system. Experimental results demonstrate that the proposed bit rate control scheme outperforms the rate control method where each video coding standard uses its own bit rate control algorithm independently in terms of the increase in PSNR by 2.02%, the decrease in the average absolute quality difference by 77.6% and the reduction in the variance of the quality difference by 74.38%.

Effect of n-3 Fatty Acid Deficiency on Fatty Acid Composition in Brain, Retina and Liver Using a Novel Artificial Rearing System (인공 사육 동물 모델 시스템을 이용한 n-3 지방산 결핍이 쥐의 뇌, 망막, 간의 지방산 조성에 미치는 영향)

  • Lim, Sun-Young
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.34 no.4
    • /
    • pp.466-475
    • /
    • 2005
  • Docosahexaenoic acid (22:6n-3, DHA) is highly enriched in membrane of brain and retina, and plays an important role in maintaining an optimal function of the central nervous system. We investigated the effect of n-3 fatty acid deficiency on rat brain, retina and liver fatty acyl composition at two different ages (3 wks and 15 wks) under DHA deficient condition. Rat pups born to dams fed a diet with $3.1\%$ of total fatty acids as $\alpha-linolenic$ acid (LNA) were fed using an artificial rearing system either an n-3 deficient (n-3 Def) or n-3 adequate (n-3 Adq) diet. Both diets contained $17.1\%$ linoleic acid (LA) but the n-3 Adq diet also contained $3.1\%$ LNA. Rats consuming the n-3 Def diet showed a lower brain $(50\%\;in\;13\;wks\;and\;70\%\;in\;15\;wks,\;p<0.05)$ and retinal $(50\%\;in\;13\;wks\;and\;63\%\;in\;15\;wks,\;p<0.05)$ DHA than those on the n-3 Adq diet, which was largely compensated for by an increase in docosapentaenoic acid (22:5n-6, DPAn-6). In the liver of the n-3 Def group, the percentage of DHA decreased by $97\%$ at 3 wks of age with an apparent increase in DPAn-6 relative to the n-3 Adq group (p<0.05), while there was a $65\%$ lower liver DHA in n-3 Def group at 15 wks of age than the n-3 Adq group (p<0.05). Liver arachidonic acid (20:4n-6, AA) was increased at 3 wks of age but decreased at 15 wks of age in the n-3 Def group compared with n-3 Adq group (p<0.05). In conclusion, the replacement of DHA by DPAn-6 in brain and retina fatty acid composition may be related to the suboptimal function in spatial learning, memory and visual acuity. This artificial rearing method presents a first generation model for n-3 deficiency that is similar to the case of human nutrition that commonly employed two generation model.

Individual Thinking Style leads its Emotional Perception: Development of Web-style Design Evaluation Model and Recommendation Algorithm Depending on Consumer Regulatory Focus (사고가 시각을 바꾼다: 조절 초점에 따른 소비자 감성 기반 웹 스타일 평가 모형 및 추천 알고리즘 개발)

  • Kim, Keon-Woo;Park, Do-Hyung
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.4
    • /
    • pp.171-196
    • /
    • 2018
  • With the development of the web, two-way communication and evaluation became possible and marketing paradigms shifted. In order to meet the needs of consumers, web design trends are continuously responding to consumer feedback. As the web becomes more and more important, both academics and businesses are studying consumer emotions and satisfaction on the web. However, some consumer characteristics are not well considered. Demographic characteristics such as age and sex have been studied extensively, but few studies consider psychological characteristics such as regulatory focus (i.e., emotional regulation). In this study, we analyze the effect of web style on consumer emotion. Many studies analyze the relationship between the web and regulatory focus, but most concentrate on the purpose of web use, particularly motivation and information search, rather than on web style and design. The web communicates with users through visual elements. Because the human brain is influenced by all five senses, both design factors and emotional responses are important in the web environment. Therefore, in this study, we examine the relationship between consumer emotion and satisfaction and web style and design. Previous studies have considered the effects of web layout, structure, and color on emotions. In this study, however, we excluded these web components, in contrast to earlier studies, and analyzed the relationship between consumer satisfaction and emotional indexes of web-style only. To perform this analysis, we collected consumer surveys presenting 40 web style themes to 204 consumers. Each consumer evaluated four themes. The emotional adjectives evaluated by consumers were composed of 18 contrast pairs, and the upper emotional indexes were extracted through factor analysis. The emotional indexes were 'softness,' 'modernity,' 'clearness,' and 'jam.' Hypotheses were established based on the assumption that emotional indexes have different effects on consumer satisfaction. After the analysis, hypotheses 1, 2, and 3 were accepted and hypothesis 4 was rejected. While hypothesis 4 was rejected, its effect on consumer satisfaction was negative, not positive. This means that emotional indexes such as 'softness,' 'modernity,' and 'clearness' have a positive effect on consumer satisfaction. In other words, consumers prefer emotions that are soft, emotional, natural, rounded, dynamic, modern, elaborate, unique, bright, pure, and clear. 'Jam' has a negative effect on consumer satisfaction. It means, consumer prefer the emotion which is empty, plain, and simple. Regulatory focus shows differences in motivation and propensity in various domains. It is important to consider organizational behavior and decision making according to the regulatory focus tendency, and it affects not only political, cultural, ethical judgments and behavior but also broad psychological problems. Regulatory focus also differs from emotional response. Promotion focus responds more strongly to positive emotional responses. On the other hand, prevention focus has a strong response to negative emotions. Web style is a type of service, and consumer satisfaction is affected not only by cognitive evaluation but also by emotion. This emotional response depends on whether the consumer will benefit or harm himself. Therefore, it is necessary to confirm the difference of the consumer's emotional response according to the regulatory focus which is one of the characteristics and viewpoint of the consumers about the web style. After MMR analysis result, hypothesis 5.3 was accepted, and hypothesis 5.4 was rejected. But hypothesis 5.4 supported in the opposite direction to the hypothesis. After validation, we confirmed the mechanism of emotional response according to the tendency of regulatory focus. Using the results, we developed the structure of web-style recommendation system and recommend methods through regulatory focus. We classified the regulatory focus group in to three categories that promotion, grey, prevention. Then, we suggest web-style recommend method along the group. If we further develop this study, we expect that the existing regulatory focus theory can be extended not only to the motivational part but also to the emotional behavioral response according to the regulatory focus tendency. Moreover, we believe that it is possible to recommend web-style according to regulatory focus and emotional desire which consumers most prefer.