• Title/Summary/Keyword: Visual Intelligence

Search Result 249, Processing Time 0.029 seconds

Story-based Information Retrieval (스토리 기반의 정보 검색 연구)

  • You, Eun-Soon;Park, Seung-Bo
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.4
    • /
    • pp.81-96
    • /
    • 2013
  • Video information retrieval has become a very important issue because of the explosive increase in video data from Web content development. Meanwhile, content-based video analysis using visual features has been the main source for video information retrieval and browsing. Content in video can be represented with content-based analysis techniques, which can extract various features from audio-visual data such as frames, shots, colors, texture, or shape. Moreover, similarity between videos can be measured through content-based analysis. However, a movie that is one of typical types of video data is organized by story as well as audio-visual data. This causes a semantic gap between significant information recognized by people and information resulting from content-based analysis, when content-based video analysis using only audio-visual data of low level is applied to information retrieval of movie. The reason for this semantic gap is that the story line for a movie is high level information, with relationships in the content that changes as the movie progresses. Information retrieval related to the story line of a movie cannot be executed by only content-based analysis techniques. A formal model is needed, which can determine relationships among movie contents, or track meaning changes, in order to accurately retrieve the story information. Recently, story-based video analysis techniques have emerged using a social network concept for story information retrieval. These approaches represent a story by using the relationships between characters in a movie, but these approaches have problems. First, they do not express dynamic changes in relationships between characters according to story development. Second, they miss profound information, such as emotions indicating the identities and psychological states of the characters. Emotion is essential to understanding a character's motivation, conflict, and resolution. Third, they do not take account of events and background that contribute to the story. As a result, this paper reviews the importance and weaknesses of previous video analysis methods ranging from content-based approaches to story analysis based on social network. Also, we suggest necessary elements, such as character, background, and events, based on narrative structures introduced in the literature. We extract characters' emotional words from the script of the movie Pretty Woman by using the hierarchical attribute of WordNet, which is an extensive English thesaurus. WordNet offers relationships between words (e.g., synonyms, hypernyms, hyponyms, antonyms). We present a method to visualize the emotional pattern of a character over time. Second, a character's inner nature must be predetermined in order to model a character arc that can depict the character's growth and development. To this end, we analyze the amount of the character's dialogue in the script and track the character's inner nature using social network concepts, such as in-degree (incoming links) and out-degree (outgoing links). Additionally, we propose a method that can track a character's inner nature by tracing indices such as degree, in-degree, and out-degree of the character network in a movie through its progression. Finally, the spatial background where characters meet and where events take place is an important element in the story. We take advantage of the movie script to extracting significant spatial background and suggest a scene map describing spatial arrangements and distances in the movie. Important places where main characters first meet or where they stay during long periods of time can be extracted through this scene map. In view of the aforementioned three elements (character, event, background), we extract a variety of information related to the story and evaluate the performance of the proposed method. We can track story information extracted over time and detect a change in the character's emotion or inner nature, spatial movement, and conflicts and resolutions in the story.

Records Management and Archives in Korea : Its Development and Prospects (한국 기록관리행정의 변천과 전망)

  • Nam, Hyo-Chai
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.1 no.1
    • /
    • pp.19-35
    • /
    • 2001
  • After almost one century of discontinuity in the archival tradition of Chosun dynasty, Korea entered the new age of records and archival management by legislating and executing the basic laws (The Records and Archives Management of Public Agencies Ad of 1999). Annals of Chosun dynasty recorded major historical facts of the five hundred years of national affairs. The Annals are major accomplishment in human history and rare in the world. It was possible because the Annals were composed of collected, selected and complied records of primary sources written and compiled by generations of historians, As important public records are needed to be preserved in original forms in modern archives, we had to develop and establish a modern archival system to appraise and select important national records for archival preservation. However, the colonialization of Korea deprived us of the opportunity to do the task, and our fine archival tradition was not succeeded. A centralized archival system began to develop since the establishment of GARS under the Ministry of Government Administration in 1969. GARS built a modem repository in Pusan in 1984 succeeding to the tradition of History Archives of Chosun dynasty. In 1998, GARS moved its headquarter to Taejon Government Complex and acquired state-of-the-art audio visual archives preservation facilities. From 1996, GARS introduced an automated archival management system to remedy the manual registration and management system complementing the preservation microfilming. Digitization of the holdings was the key project to provided the digital images of archives to users. To do this, the GARS purchased new computer/server systems and developed application softwares. Parallel to this direction, GARS drastically renovated its manpower composition toward a high level of professionalization by recruiting more archivists with historical and library science backgrounds. Conservators and computer system operators were also recruited. The new archival laws has been in effect from January 1, 2000. The new laws made following new changes in the field of records and archival administration in Korea. First, the laws regulate the records and archives of all public agencies including the Legislature, the Judiciary, the Administration, the constitutional institutions, Army, Navy, Air Force, and National Intelligence Service. A nation-wide unified records and archives management system became available. Second, public archives and records centers are to be established according to the level of the agency; a central archives at national level, special archives for the National Assembly and the Judiciary, local government archives for metropolitan cities and provinces, records center or special records center for administrative agencies. A records manager will be responsible for the records management of each administrative divisions. Third, the records in the public agencies are registered in the computer system as they are produced. Therefore, the records are traceable and will be searched or retrieved easily through internet or computer network. Fourth, qualified records managers and archivists who are professionally trained in the field of records management and archival science will be assigned mandatorily to guarantee the professional management of records and archives. Fifth, the illegal treatment of public records and archives constitutes a punishable crime. In the future, the public records find archival management will develop along with Korean government's 'Electronic Government Project.' Following changes are in prospect. First, public agencies will digitize paper records, audio-visual records, and publications as well as electronic documents, thus promoting administrative efficiency and productivity. Second, the National Assembly already established its Special Archives. The judiciary and the National Intelligence Service will follow it. More archives will be established at city and provincial levels. Third, the more our society develop into a knowledge-based information society, the more the records management function will become one of the important national government functions. As more universities, academic associations, and civil societies participate in promoting archival awareness and in establishing archival science, and more people realize the importance of the records and archives management up to the level of national public campaign, the records and archival management in Korea will develop significantly distinguishable from present practice.

Visualizing the Results of Opinion Mining from Social Media Contents: Case Study of a Noodle Company (소셜미디어 콘텐츠의 오피니언 마이닝결과 시각화: N라면 사례 분석 연구)

  • Kim, Yoosin;Kwon, Do Young;Jeong, Seung Ryul
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.4
    • /
    • pp.89-105
    • /
    • 2014
  • After emergence of Internet, social media with highly interactive Web 2.0 applications has provided very user friendly means for consumers and companies to communicate with each other. Users have routinely published contents involving their opinions and interests in social media such as blogs, forums, chatting rooms, and discussion boards, and the contents are released real-time in the Internet. For that reason, many researchers and marketers regard social media contents as the source of information for business analytics to develop business insights, and many studies have reported results on mining business intelligence from Social media content. In particular, opinion mining and sentiment analysis, as a technique to extract, classify, understand, and assess the opinions implicit in text contents, are frequently applied into social media content analysis because it emphasizes determining sentiment polarity and extracting authors' opinions. A number of frameworks, methods, techniques and tools have been presented by these researchers. However, we have found some weaknesses from their methods which are often technically complicated and are not sufficiently user-friendly for helping business decisions and planning. In this study, we attempted to formulate a more comprehensive and practical approach to conduct opinion mining with visual deliverables. First, we described the entire cycle of practical opinion mining using Social media content from the initial data gathering stage to the final presentation session. Our proposed approach to opinion mining consists of four phases: collecting, qualifying, analyzing, and visualizing. In the first phase, analysts have to choose target social media. Each target media requires different ways for analysts to gain access. There are open-API, searching tools, DB2DB interface, purchasing contents, and so son. Second phase is pre-processing to generate useful materials for meaningful analysis. If we do not remove garbage data, results of social media analysis will not provide meaningful and useful business insights. To clean social media data, natural language processing techniques should be applied. The next step is the opinion mining phase where the cleansed social media content set is to be analyzed. The qualified data set includes not only user-generated contents but also content identification information such as creation date, author name, user id, content id, hit counts, review or reply, favorite, etc. Depending on the purpose of the analysis, researchers or data analysts can select a suitable mining tool. Topic extraction and buzz analysis are usually related to market trends analysis, while sentiment analysis is utilized to conduct reputation analysis. There are also various applications, such as stock prediction, product recommendation, sales forecasting, and so on. The last phase is visualization and presentation of analysis results. The major focus and purpose of this phase are to explain results of analysis and help users to comprehend its meaning. Therefore, to the extent possible, deliverables from this phase should be made simple, clear and easy to understand, rather than complex and flashy. To illustrate our approach, we conducted a case study on a leading Korean instant noodle company. We targeted the leading company, NS Food, with 66.5% of market share; the firm has kept No. 1 position in the Korean "Ramen" business for several decades. We collected a total of 11,869 pieces of contents including blogs, forum contents and news articles. After collecting social media content data, we generated instant noodle business specific language resources for data manipulation and analysis using natural language processing. In addition, we tried to classify contents in more detail categories such as marketing features, environment, reputation, etc. In those phase, we used free ware software programs such as TM, KoNLP, ggplot2 and plyr packages in R project. As the result, we presented several useful visualization outputs like domain specific lexicons, volume and sentiment graphs, topic word cloud, heat maps, valence tree map, and other visualized images to provide vivid, full-colored examples using open library software packages of the R project. Business actors can quickly detect areas by a swift glance that are weak, strong, positive, negative, quiet or loud. Heat map is able to explain movement of sentiment or volume in categories and time matrix which shows density of color on time periods. Valence tree map, one of the most comprehensive and holistic visualization models, should be very helpful for analysts and decision makers to quickly understand the "big picture" business situation with a hierarchical structure since tree-map can present buzz volume and sentiment with a visualized result in a certain period. This case study offers real-world business insights from market sensing which would demonstrate to practical-minded business users how they can use these types of results for timely decision making in response to on-going changes in the market. We believe our approach can provide practical and reliable guide to opinion mining with visualized results that are immediately useful, not just in food industry but in other industries as well.

The Relationship between Hair Zinc and Lead Levels and Clinical Features of Attention-Deficit Hyperactivity Disorder

  • Shin, Dong-Won;Kim, Eun-Ji;Oh, Kang-Seob;Shin, Young-Chul;Lim, Se-Won
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.25 no.1
    • /
    • pp.28-36
    • /
    • 2014
  • Objectives : The goal of this study was to examine the association between zinc and lead level and symptoms of attention-deficit hyperactivity disorder (ADHD) among Korean children. Methods : A total of 89 clinic-referred children participated in the study (ADHD group=45, control group=44). The participants were 5-15 years old, and were mainly from urban areas of Seoul, Korea. ADHD was diagnosed using the Kiddie-Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version. We excluded children with a comorbid psychiatric disorder, medical illness requiring medication, or a prior history of taking ADHD medication. In order to evaluate the severity of ADHD symptoms, parents' Korean ADHD Rating Scale (K-ARS) was used. The ADHD diagnostic system (ADS) was used for evaluation of the severity of inattention and impulsivity. All participants completed the intelligence test and hair mineral analysis. Multiple regression analysis was used to examine the effect of hair zinc and lead levels on the K-ARS and ADS. We measured the predictive ability of the zinc and lead levels using logistic regression analysis. Results : The lead level explained the score for omission errors, commission errors, and response time SD in visual ADS in the ADHD group (adjusted $R^2$=.243, p<.01, adjusted $R^2$=.362, p<.01, and adjusted $R^2$=.275, p<.01), the score for omission errors of auditory ADS in ADHD group (adjusted $R^2$=.407, p<.01) and the entire group (adjusted $R^2$=.292, p<.01). Zinc was significantly explanatory for the K-ARS scores for the entire group (adjusted $R^2$=.248, p<.001) and the ADHD group (adjusted $R^2$=.247, p<.05). Conclusion : These findings suggest a possible role of zinc and lead in ADHD. Lead concentration in hair samples affected the ADS scores, and this was more prominent in children with ADHD. Children with ADHD had a lower zinc concentration in their hair, and the zinc concentration in hair showed negative correlation with the K-ARS score.

Study on a Methodology for Developing Shanghanlun Ontology (상한론(傷寒論)온톨로지 구축 방법론 연구)

  • Jung, Tae-Young;Kim, Hee-Yeol;Park, Jong-Hyun
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.25 no.5
    • /
    • pp.765-772
    • /
    • 2011
  • Knowledge which is represented by formal logic are widely used in many domains such like artificial intelligence, information retrieval, e-commerce and so on. And for medical field, medical documentary records retrieval, information systems in hospitals, medical data sharing, remote treatment and expert systems need knowledge representation technology. To retrieve information intellectually and provide advanced information services, systematically controlled mechanism is needed to represent and share knowledge. Importantly, medical expert's knowledge should be represented in a form that is understandable to computers and also to humans to be applied to the medical information system supporting decision making. And it should have a suitable and efficient structure for its own purposes including reasoning, extendability of knowledge, management of data, accuracy of expressions, diversity, and so on. we call it ontology which can be processed with machines. We can use the ontology to represent traditional medicine knowledge in structured and systematic way with visualization, then also it can also be used education materials. Hence, the authors developed an Shanghanlun ontology by way of showing an example, so that we suggested a methodology for ontology development and also a model to structure the traditional medical knowledge. And this result can be used for student to learn Shanghanlun by graphical representation of it's knowledge. We analyzed the text of Shanghanlun to construct relational database including it's original text, symptoms and herb formulars. And then we classified the terms following some criterion, confirmed the structure of the ontology to describe semantic relations between the terms, especially we developed the ontology considering visual representation. The ontology developed in this study provides database showing fomulas, herbs, symptoms, the name of diseases and the text written in Shanghanlun. It's easy to retrieve contents by their semantic relations so that it is convenient to search knowledge of Shanghanlun and to learn it. It can display the related concepts by searching terms and provides expanded information with a simple click. It has some limitations such as standardization problems, short coverage of pattern(證), and error in chinese characters input. But we believe this research can be used for basic foundation to make traditional medicine more structural and systematic, to develop application softwares, and also to applied it in Shanghanlun educations.

Difference of Autonomic Nervous System Responses among Boredom, Pain, and Surprise (무료함, 통증, 그리고 놀람 정서 간 자율신경계 반응의 차이)

  • Jang, Eun-Hye;Eum, Yeong-Ji;Park, Byoung-Jun;Kim, Sang-Hyeob;Sohn, Jin-Hun
    • Science of Emotion and Sensibility
    • /
    • v.14 no.4
    • /
    • pp.503-512
    • /
    • 2011
  • Recently in HCI research, emotion recognition is one of the core processes to implement emotional intelligence. There are many studies using bio signals in order to recognize human emotions, but it has been done merely for the basic emotions and very few exists for the other emotions. The purpose of present study is to confirm the difference of autonomic nervous system (ANS) response in three emotions (boredom, pain, and surprise). There were totally 217 of participants (male 96, female 121), we presented audio-visual stimulus to induce boredom and surprise, and pressure by using the sphygmomanometer for pain. During presented emotional stimuli, we measured electrodermal activity (EDA), skin temperature (SKT), electrocardiac activity (ECG) and photoplethysmography (PPG), besides; we required them to classify their present emotion and its intensity according to the emotion assessment scale. As the results of emotional stimulus evaluation, emotional stimulus which we used was shown to mean 92.5% of relevance and 5.43 of efficiency; this inferred that each emotional stimulus caused its own emotion quite effectively. When we analyzed the results of the ANS response which had been measured, we ascertained the significant difference between the baseline and emotional state on skin conductance response, SKT, heart rate, low frequency and blood volume pulse amplitude. In addition, the ANS response caused by each emotion had significant differences among the emotions. These results can probably be able to use to extend the emotion theory and develop the algorithm in recognition of three kinds of emotions (boredom, surprise, and pain) by response measurement indicators and be used to make applications for differentiating various human emotions in computer system.

  • PDF

Development of the Artwork using Music Visualization based on Sentiment Analysis of Lyrics (가사 텍스트의 감성분석에 기반 한 음악 시각화 콘텐츠 개발)

  • Kim, Hye-Ran
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.10
    • /
    • pp.89-99
    • /
    • 2020
  • In this study, we tried to produce moving-image works through sentiment analysis of music. First, Google natural language API was used for the sentiment analysis of lyrics, then the result was applied to the image visualization rules. In prior engineering researches, text-based sentiment analysis has been conducted to understand users' emotions and attitudes by analyzing users' comments and reviews in social media. In this study, the data was used as a material for the creation of artworks so that it could be used for aesthetic expressions. From the machine's point of view, emotions are substituted with numbers, so there is a limit to normalization and standardization. Therefore, we tried to overcome these limitations by linking the results of sentiment analysis of lyrics data with the rules of formative elements in visual arts. This study aims to transform existing traditional art works such as literature, music, painting, and dance to a new form of arts based on the viewpoint of the machine, while reflecting the current era in which artificial intelligence even attempts to create artworks that are advanced mental products of human beings. In addition, it is expected that it will be expanded to an educational platform that facilitates creative activities, psychological analysis, and communication for people with developmental disabilities who have difficulty expressing emotions.

The Philosophical Perspective on Discussion of Human Body in Digital Media Era - focused on new media art cases (디지털 미디어 시대의 신체담론에 관한 철학적 고찰 - 뉴미디어 아트에 나타난 신체담론을 중심으로)

  • Kah, Eun-Young;Kim, Jong-Deok
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02b
    • /
    • pp.109-114
    • /
    • 2008
  • We have long kept our Cartesian tradition in which Mind privileges over Body; the invention of printing technology has accelerated the tradition in which the intelligence and legibility of media were considered as a higher human value. However, the development of media and technology are supporting the multisensory mechanisms of the body as it was in preliterate era when we communicated with our whole bodily experiences. The development and spread of mass-media and new technologies have broaden the boundary of human sensory that are largely dominated by visual information and expanded it to auditory, olfactory and even gustatory sensation. Since 1960's, some philosophers and artists have recognized the human body as a subjective matter, starting the movement in which the body plays a role as an essential factor in study of human perception and cognition, aesthetics in art, and sociology, and the changed perspectives are practiced vigorously in the field of new media art; the theory of Maurice Merleau-Ponty who clarified the body as a general means for the body's possession of world, so that recognize the importance of cognition of one's body and approved the embodiment could be applied and practiced here. Therefore, we discuss how Merleau-Ponty's philosophical theory can be practiced and how McLuhan's perspective could be applied on the notion of body's extension in media by analysing some new media art cases.

  • PDF

The Trends of Emotion Expression in Digital Times (디지털시대의 감성 표현에 관한 연구)

  • Ho Yoon-Jung
    • Journal of Science of Art and Design
    • /
    • v.8
    • /
    • pp.241-266
    • /
    • 2005
  • Current information-oriented society is expanding rapidly with the huge change to our society from the information revolution emerged in mid '50s. Information technique such as computer, communication satellite and cable technology play their in this information-oriented society, and in 1980s, digital technique was adopted to media, inviting new phenomenon in communication of overall society. Expectations and hope for new trends and changes from digital era flourished when we entered into new Millenium, the 21st century. Since then we have gone through changes in years from analogue to digital. Now the word 'digital' is conceived in unified manner in almost every fields and influences overall society, changing our life pattern rapidly. Modern society had demanded some speedy and bidirectional communication tool in shifting digital era, and resulted from that was a new culture, Now the society changes more and more quickly under the speedy information sharing. From that perspective we need to establish the aspects of sensibility expression, which is one feature of the communication. The sensibility-oriented digital was originated from the human nature, which counts emotion and composure much. To satisfy the human nature a new cultural value which transcend a traditional one is needed. And the sensitivity expression to meet the need is one communication tendency in digital era. Digital era has totally different social qualities from that of analogue era. In digital era, prompt respond to rapid change and creativity combined with sensitivity are needed. Therefore a man with sensitivity would be more outstanding than a man of intelligence. The picture of digital and analogue in our society consists of two axis one is analogue axis like retrospective trend, admiration for nature , oriental thought etc. , and the other is the digital axis of internet and information technology. Sensibility can be widely interpreted as analogue thinking. It is surely different from the plain retrospective trend or nostalgia for past. It is a tendency that digital technology is used and cooperated with the emotion in human nature, In this paper we suggest the sensitivity expressions in detail through the study cases including both sides of digital and sensitivity expressions such as 'Bravo your life' advertising campaign of Samsung Insurance, MP3 advertising campaign, and 'Mini-homepage' of Cyworld. Under the circumstances the main direction of communication is oriented to human. This study's purpose is to think the true meaning of this digital era, to overcoming its weaknesses, such as over-dependency on technique and selfish individualism and to harmonize digital and sensitivity expression. The sensitivity-oriented expression than the reason-oriented one is expected to be put forth in whole media, and this is a more efficient tendency under the shifting digital era.

  • PDF

Profiles of Overexcitabilities for Korean High School Gifted Students According to Gender and Domain of Study (한국 고등학교 영재 학생들의 성별과 전공에 따른 과민흥분성에 대한 프로파일)

  • Moon, Jeong-Hwa;Montgomery, Diane
    • Journal of Gifted/Talented Education
    • /
    • v.15 no.1
    • /
    • pp.1-10
    • /
    • 2005
  • Overexcitaility (OE) as a concept that is related to developmental potential, has been shown to differ by intelligence, gender, involvement in school programs and artistic interest in American populations of students. Overexitability, used to describe the five ways that people might experience developmental potential for emotional growth, are emotional, intellectual, imaginational, sensual, and psychomotor. Little is known about the profiles of groups of gifted learners outside of studies conducted in the United States. In order to better understand the emotional needs of Korean students, the purpose of this study was to determine the overexcitability profiles of students enrolled in four high schools, each with a different domain focus: math and sciences, visual and performing arts, and foreign languages. 341 subjects of this study completed the Overexcitability Questionnaire II. Multivariate Analysis of Variance (MANOVA) was conducted to determine statistical differences. The results showed that Mean scores of psychomotor, sensual and imaginational are highest in the Art High School, intellectual is highest in the Science High School and emotional is highest in the Foreign Language High School. There were significant differences among the schools. Each major also showed significant difference. The results showed that mean score of psychomotor is highest in the Dance major, sensual, imaginational and emotional are highest in the Drama majore and intellectual is highest in the Science major. The results showed that the mean scores of psychomotor, imaginational and intellectual are higher in the male students than female students. On the other hand the mean scores of sensual and emotional are higher in the female students than in the male students.