• Title/Summary/Keyword: speech understanding

Search Result 189, Processing Time 0.023 seconds

A general-purpose model capable of image captioning in Korean and Englishand a method to generate text suitable for the purpose (한국어 및 영어 이미지 캡션이 가능한 범용적 모델 및 목적에 맞는 텍스트를 생성해주는 기법)

  • Cho, Su Hyun;Oh, Hayoung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.8
    • /
    • pp.1111-1120
    • /
    • 2022
  • Image Capturing is a matter of viewing images and describing images in language. The problem is an important problem that can be solved by keeping, understanding, and bringing together two areas of image processing and natural language processing. In addition, by automatically recognizing and describing images in text, images can be converted into text and then into speech for visually impaired people to help them understand their surroundings, and important issues such as image search, art therapy, sports commentary, and real-time traffic information commentary. So far, the image captioning research approach focuses solely on recognizing and texturing images. However, various environments in reality must be considered for practical use, as well as being able to provide image descriptions for the intended purpose. In this work, we limit the universally available Korean and English image captioning models and text generation techniques for the purpose of image captioning.

Cortical Deafness Due to Ischaemic Strokes in Both Temporal Lobes

  • Lachowska, Magdalena;Pastuszka, Agnieszka;Sokolowski, Jacek;Szczudlik, Piotr;Niemczyk, Kazimierz
    • Korean Journal of Audiology
    • /
    • v.25 no.3
    • /
    • pp.163-170
    • /
    • 2021
  • Cortical deafness is a clinical rarity whereby a patient is unresponsive to all types of sounds despite the preserved integrity of the peripheral hearing organs. In this study, we present a patient who suddenly lost his hearing following ischaemic infarcts in both temporal lobes with no other neurological deficits. The CT confirmed damage to the primary auditory cortex (Heschl's gyrus) of both hemispheres. Initially, the patient was unresponsive to all sounds, however, he regained some of the auditory abilities during 10 months follow up. Pure tone threshold improvement from complete deafness to the level of moderate hearing loss in the right ear and severe in the left was observed in pure tone audiometry. Otoacoustic emissions, auditory brainstem responses, and acoustic reflex findings showed normal results. The middle and late latency potential results confirmed objectively the improvement of the patient's hearing, however, after 10 months still, they were somewhat compromised on both sides. In speech audiometry, there was no comprehension of spoken words neither at 3 nor at 10 months. The absent mismatch negativity confirmed above mentioned comprehension deficit. The extensive auditory electrophysiological testing presented in this study contributes to the understanding of the neural and functional changes in cortical deafness. It presents the evolution of changes after ischaemic cerebrovascular event expressed as auditory evoked potentials starting from short through middle and long latency and ending with event-related potentials and supported by neuroimaging.

Exploration of Teacher Questions and Discourse Types in Chinese Mathematics Classrooms (중국 수학 교실에서 교사 발문과 담화 유형에 대한 탐색)

  • Liu, Wentin
    • Communications of Mathematical Education
    • /
    • v.36 no.4
    • /
    • pp.487-509
    • /
    • 2022
  • The purpose of this study is to analyze classroom discourse in the math classroom of middle school in China, which has a unique math classroom background of entrance examination for high school. To this end, this study analyzed teacher question statistics and episodes by teacher question type as starting speech in mathematics classroom discourse, and five IRF subtypes were especially identified by class discourse structure analysis. The data were analyzed focusing on a total of 15 transcripts of math classes recorded by three math teachers at H School in Guiyang, Guizhou Province, China, and written interviews of teachers. According to the results of this study, an average of 20 teacher questions were observed for each class, and the teacher question type was classified into confirmation question (understanding confirmation question, explanation request question, and double check question) and information question (information presentation question). In addition, according to classroom discourse analysis, the IRF discourse structure was divided into fragmentary evaluation, evaluation+reason, evidence of explanation, evaluation+student response re-statement, guidance on other thoughts or solutions, and student answer correction or teacher opinion presentation.

Development and Analysis of the Effects of an Intercultural Citizenship Education Program

  • Hyejin Kim;Bong Seok Jang
    • Journal of Practical Engineering Education
    • /
    • v.16 no.3_spc
    • /
    • pp.343-349
    • /
    • 2024
  • Recently, the intercultural approach, which aims to resolve social conflicts in multicultural societies through cultural encounters and dialogue, has been actively discussed. Intercultural education aims to foster smooth relationships and improve communication skills through interactions among various cultural groups. Analysis of previous studies has revealed the need for research on intercultural civic education programs targeted at adults. Therefore, this study was designed to develop an intercultural citizenship education program and to analyze its effects. For the study, previous research on interculturalism, intercultural citizenship education, and intercultural citizenship education programs was comprehensively analyzed. The developed intercultural citizenship education program was categorized into five major themes: understanding oneself and others, racism and hate speech, overcoming conflict and discrimination, breaking away from prejudice and stereotypes, and the future of our country. Subsequently, the program was implemented with 64 total second-year middle school students, 37 in the experimental group, and 27 in the control group, at an accredited lifelong educational institution in M City, South Jeolla Province. To analyze the effects of the education, an intercultural competency scale was used. The results showed that the intercultural citizenship education program for adult students was effective in conflict management, respect, communication, and reflection competencies, all at a statistically significant level. Finally, the authors compared the study results with previous research and discussed the findings. Findings indicated the necessity of enhancing multicultural citizenship awareness among adults and expanding teacher training in intercultural education. The program effectively improved intercultural competence among adult students, highlighting the importance of tailored educational content and active participation in discussions. Future research should ensure a balanced gender ratio among participants.

A Study on the Structure and Characteristics of Presidential Records (대통령기록의 구조와 특징에 관한 연구 e지원시스템 생산기록(기록관리비서관실)을 중심으로)

  • Yang, Inho
    • The Korean Journal of Archival Studies
    • /
    • no.79
    • /
    • pp.231-270
    • /
    • 2024
  • The purpose of this study is to propose a record service based on the characteristics and production context of presidential records. To this end, we first looked at the design direction and characteristics of the e-jiwon system and then analyzed the structure and characteristics of records produced by the e-jiwon system. There are six types of records to be analyzed: e-jiwon document card, memo, schedule, diary, instruction card, and individual business system_speech DB. Next, through analysis of the Presidential Records Portal's records service, it was pointed out that the current records service does not fully reveal the production context and characteristics of records. Accordingly, as a service strategy based on the characteristics and context of presidential records, a service centered on each record card (e-jiwon document card, etc.) and a service that focuses on structural understanding of records and linkage between records were proposed.

MOTHER-CHILD RELATIONSHIP OF CHILDREN WITH REACTIVE ATTACHMENT DISORDER (반응성애착장애아의 어머니-아동 관계)

  • Shin, Yee-Jin;Lee, Kyung-Sook;Park, Sook-Kyung
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.8 no.1
    • /
    • pp.22-33
    • /
    • 1997
  • The objective of this study is to understand disordered parent-child relationships of Reactive Attachment Disorder(RAD) systematically through the mother’ internal working model of child. In this study, RAD mothers’internal representations of the child were compared with mothers’of control group and association between mothers’ representation classifications and children’ attachment classifications was examined. Also individual differences in mother-child interaction by mothers’representation classifications was observed. The subjects of this study were 40 2-5 year-old children and their mothers, 20 attachment disordered dyads and 20 normal dyads of control group. Mothers were interviewed using the Working Model of the Child(Zeanah, Benoit & Barton 1986) to classify internal representations of child. Children’ attachment patterns were assessed by the Strange Situation Procedure. For observation of motherchild interaction, Each dyad was seen in DPICS devised by Eyberg and Robinson(1983). The results of the study were as follows:1) Among RAD group, 55% of mothers were classified as disengaged and 45% classified as distorted, while all mothers of control group were classified as balanced. In rating scales, there were significant differences in all 3 representation classifications in Intensity of involvement and Coherence. In Intensity of involvement disengaged representations had the lowest score and distorted representations had the lowest score in Coherence. 2) Mothers’representation classifications were related to children’ attachment classifications. All mothers of control group whose children were classified as secure were classified as balanced. Among RAD’ mothers, by contrast, 82% of mothers classified as disengaged had children classified as anxious-avoidant, 56% of mothers classified as distorted had children classified as disorganized / disoriented and 33% of mothers classified as distorted had children classified as anxious-resistant. 3) There were individual differences in mother-child interactions by mothers’representation classifications. In the child-centered play, mothers classified as disengaged used discriptive statement, reflective statement and discriptive-reflective question less than balanced mothers. Mothers classified as distorted used direct command and indirect command more than balanced mothers. In the clean-up task, mothers classified as disengaged and distorted used direct command and indirect command more than balanced mothers. The results of this study suggest that parents’working model of the child is an important factor to understand parent-child attachment relationships and their interactions. The understanding of parents’ working model of the child is thought to enrich our understanding of disordered parent-child relationships and to provide useful informations for specific and successful treatments.

  • PDF

Applying Social Strategies for Breakdown Situations of Conversational Agents: A Case Study using Forewarning and Apology (대화형 에이전트의 오류 상황에서 사회적 전략 적용: 사전 양해와 사과를 이용한 사례 연구)

  • Lee, Yoomi;Park, Sunjeong;Suk, Hyeon-Jeong
    • Science of Emotion and Sensibility
    • /
    • v.21 no.1
    • /
    • pp.59-70
    • /
    • 2018
  • With the breakthrough of speech recognition technology, conversational agents have become pervasive through smartphones and smart speakers. The recognition accuracy of speech recognition technology has developed to the level of human beings, but it still shows limitations on understanding the underlying meaning or intention of words, or understanding long conversation. Accordingly, the users experience various errors when interacting with the conversational agents, which may negatively affect the user experience. In addition, in the case of smart speakers with a voice as the main interface, the lack of feedback on system and transparency was reported as the main issue when the users using. Therefore, there is a strong need for research on how users can better understand the capability of the conversational agents and mitigate negative emotions in error situations. In this study, we applied social strategies, "forewarning" and "apology", to conversational agent and investigated how these strategies affect users' perceptions of the agent in breakdown situations. For the study, we created a series of demo videos of a user interacting with a conversational agent. After watching the demo videos, the participants were asked to evaluate how they liked and trusted the agent through an online survey. A total of 104 respondents were analyzed and found to be contrary to our expectation based on the literature study. The result showed that forewarning gave a negative impression to the user, especially the reliability of the agent. Also, apology in a breakdown situation did not affect the users' perceptions. In the following in-depth interviews, participants explained that they perceived the smart speaker as a machine rather than a human-like object, and for this reason, the social strategies did not work. These results show that the social strategies should be applied according to the perceptions that user has toward agents.

Developing an Instrument for Analysing Students' Behavioral Engagement in School Science Classroom (과학수업에서 나타나는 학생들의 행동적 참여 분석을 위한 영상 분석 도구의 개발)

  • Choi, Joonyoung;Na, Jiyeon;Song, Jinwoong
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.2
    • /
    • pp.247-258
    • /
    • 2015
  • Students are engaged in classroom learning, and classroom learning occurs not only through conversation but also through nonverbal behavior. In science classrooms especially, there are meaningful nonverbal behaviors such as practical activities like observation and measurement. But these behaviors have not been properly investigated by existing instruments that try to measure students' engagement. This study aims to develop a new instrument for analyzing students' behavioral engagement especially in science classrooms. The method of developing the instrument was structured along three steps. First, student behaviors have been classified into fourteen categories through literature review and a series of observation of elementary science classroom. Second, based on these, a framework for analyzing student behavioral engagement has been developed. With the framework, every student moment could be labeled as Participatory Speech or Participatory Silence or Non-Participatory Speech or Non-Participatory Silence. Third, an instrument to which the framework is applied has been developed by using Microsoft Excel. As a trial, two fourth-grade students in elementary science class were analyzed with this instrument. The results of the trial analysis shows that the longest period of a science lesson was occupied by Participatory Silence (63% and 72%). Among the participatory silence, 'listening' was the most common (51% and 42% of the trial lesson) and 'observing' which is a specific behavior to science was the fourth position (17% and 17% of the trial lesson). It is expected that the developed instrument could be used in improving our understanding of the patterns of student engagement in science classrooms.

A Study about the Users's Preferred Playing Speeds on Categorized Video Content using WSOLA method (WSOLA를 이용한 동영상 미세배속 재생 서비스에 대한 콘텐츠별 배속 선호도 분석 연구)

  • Kim, I-Gil
    • Journal of Digital Contents Society
    • /
    • v.16 no.2
    • /
    • pp.291-298
    • /
    • 2015
  • In a fast-paced information technology environment, consumption of video content is changing from one-way television viewing to VOD (Video on Demand) playing anywhere, anytime, on any device. This video-watching trend gives additional importance to videos with fine-speed-control, in addition to the strength of the digital video signal. Currently, many video players provide a fine-speed-control function which can speed up the video to skip a boring part, or slow it down to focus on an exciting scene. The audio information is just as important as the visual information for understanding the content of the speed-controlled video. Thus, a number of algorithms for fine-speed-control video-playing technologies have been proposed to solve the pitch distortion in the audio-processing area. In this study, well-known techniques for prosodic modification of speech signals, WSOLA (Waveform-Similarity-Based Overlap-Add), have been applied to analyze users' needs for fine-speed-control video playing. By surveying the users' preferred speeds on categorized video content and analyzing the results, this paper proposes that various fine-speed adjustments are needed to accommodate users' preferred video consumption.

Effectiveness of "Village Image Construction Tool Kit" in the Residents Workshop of a Housing Improvement Area (주거지 정비지역 주민 워크샵을 통한 마을이미지 맵 제작도구의 효용성 연구)

  • Lee, Yeun-Sook;Kim, Ju-Suck;Jung, Eun-Jung
    • Journal of the Korean housing association
    • /
    • v.21 no.1
    • /
    • pp.67-77
    • /
    • 2010
  • Citizen participation in local redevelopment has recently been regarded as essential, since progress in democracy and diversified public interests have contributed to more importance being placed on citizen participation in the implementation of public policies. While the importance of resident participation has been increasingly emphasized in principle, in reality more effort is still required in its application. We need to develop practical strategies of collecting community opinion in order to reflect it in public policy, if we are to achieve a resident and citizen-centered society. The purpose of this study is to develop an image map construction tool that can be applied to the "Maul-Mandulgi" projects as a visualized method to facilitate the exchange of opinions and work toward agreements. The tool is intended to assist public discussion by visualizing policies and plans and reducing the possibility of misunderstanding, so that residents can properly respond to the plans. Second, this study will verify the effectiveness of the tool in the application to local community workshops. The main research method is participant observation method and field study. Major findings are as follows, First, every resident who had participated in previous workshops gathered together, used the tool and represented their opinions unusually more than once. Each resident tried to make sure that other participants appropriately understood his or her opinion. The workshop finished when all participants agreed and produced a consensus. The workshop took much less time, which is in stark contrast to previous workshops in which it took significantly more time to collect opinions. Second, it proved that residents in the redevelopment area can strike a broad agreement by themselves on a method and direction for residential improvement. In previous workshops, conflicts between residents developed over the choice between the two methods, of local improvement and total demolition prior to multi-housing construction. In this study, opinions of residents were not limited to the two methods by finding a winwin solution. Third, the use of the tool kit for image map became efficient for inactive residents to develop their own opinions in regard to the direction and orientations of the residential improvement process. In addition, for those who have either no or a slight understanding of the residential improvement projects, the tool can provide access to information and knowledge. This study concludes that the developed tool for imaging of the redevelopment projection like a design game, rather than using forms of text and speech, can be a useful tool in collecting opinions and forming an agreed opinion for forthcoming residential improvement plans.