• Title/Summary/Keyword: conversational

Search Result 292, Processing Time 0.022 seconds

A Study on the UX-based Ethical AI-Learning Model for Metaverse (UX-기반 메타버스 윤리적 AI 학습 모델 연구)

  • Ahn, Sunghee
    • Journal of Broadcast Engineering
    • /
    • v.27 no.5
    • /
    • pp.694-702
    • /
    • 2022
  • This paper is the UX-based technology strategy research which is a solution to how conversational AI can be ethically evolved in the Metaverse environment. Since conversational AI influences people's on-offline decision-making factors through interaction with people, the Metaverse AI ethics must be reflected. In the machine learning process of conversational AI, cultural codes along with user's personal experience data must be included and considered to reduce the error value of user experience. Through this, the super-personalized Metaverse service can evolve ethically with social values. With above hypothesis as a result of the study, a conceptual model of a forward-looking perspective was developed and proposed by adding user experience data to the machine learning (ML) process for context-based interactive AI in the Metaverse service environment.

Comparison of Speech Rate and Long-Term Average Speech Spectrum between Korean Clear Speech and Conversational Speech

  • Yoo, Jeeun;Oh, Hongyeop;Jeong, Seungyeop;Jin, In-Ki
    • Korean Journal of Audiology
    • /
    • v.23 no.4
    • /
    • pp.187-192
    • /
    • 2019
  • Background and Objectives: Clear speech is an effective communication strategy used in difficult listening situations that draws on techniques such as accurate articulation, a slow speech rate, and the inclusion of pauses. Although too slow speech and improperly amplified spectral information can deteriorate overall speech intelligibility, certain amplitude of increments of the mid-frequency bands (1 to 3 dB) and around 50% slower speech rates of clear speech, when compared to those in conversational speech, were reported as factors that can improve speech intelligibility positively. The purpose of this study was to identify whether amplitude increments of mid-frequency areas and slower speech rates were evident in Korean clear speech as they were in English clear speech. Subjects and Methods: To compare the acoustic characteristics of the two methods of speech production, the voices of 60 participants were recorded during conversational speech and then again during clear speech using a standardized sentence material. Results: The speech rate and longterm average speech spectrum (LTASS) were analyzed and compared. Speech rates for clear speech were slower than those for conversational speech. Increased amplitudes in the mid-frequency bands were evident for the LTASS of clear speech. Conclusions:The observed differences in the acoustic characteristics between the two types of speech production suggest that Korean clear speech can be an effective communication strategy to improve speech intelligibility.

Summarization of Korean Dialogues through Dialogue Restructuring (대화문 재구조화를 통한 한국어 대화문 요약)

  • Eun Hee Kim;Myung Jin Lim;Ju Hyun Shin
    • Smart Media Journal
    • /
    • v.12 no.11
    • /
    • pp.77-85
    • /
    • 2023
  • After COVID-19, communication through online platforms has increased, leading to an accumulation of massive amounts of conversational text data. With the growing importance of summarizing this text data to extract meaningful information, there has been active research on deep learning-based abstractive summarization. However, conversational data, compared to structured texts like news articles, often contains missing or transformed information, necessitating consideration from multiple perspectives due to its unique characteristics. In particular, vocabulary omissions and unrelated expressions in the conversation can hinder effective summarization. Therefore, in this study, we restructured by considering the characteristics of Korean conversational data, fine-tuning a pre-trained text summarization model based on KoBART, and improved conversation data summary perfomance through a refining operation to remove redundant elements from the summary. By restructuring the sentences based on the order of utterances and extracting a central speaker, we combined methods to restructure the conversation around them. As a result, there was about a 4 point improvement in the Rouge-1 score. This study has demonstrated the significance of our conversation restructuring approach, which considers the characteristics of dialogue, in enhancing Korean conversation summarization performance.

Embodied Conversational Agent Using a Virtual Character to Induce Children's Verbal Communication (가상 캐릭터를 활용하여 아동의 구어 대화를 유도하는 대화형 에이전트)

  • Choi, Jiyeong;Jung, Keechul
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.10
    • /
    • pp.1296-1306
    • /
    • 2020
  • Childhood verbal communication impacts children's language skills and has a positive effect as partners use more vocabulary. But reduction in family time, caused by lowered age for private education and so on, has reduced the chance for children to speak with partners who have a proficient language skill. This vacancy was naturally occupied by the media, which has become one of the cornerstones of the growth of kids' contents. Kids contents are making various attempts to expand the breadth of services. But most contents still focus on unilateral visual information delivery yet, so there is a limit to satisfy the vacancy of conversation partners. Therefore this paper suggests an ECA(Embodied conversational agent) to induce children's spoken conversation using a virtual character frequently used in kids contents. This system is implemented by the voice bot and agent model produced using an IBM assistant and Unity. As a result of using ECA for 66 children of 5-9 years old, it showed meaningful results in terms of induction of verbal communication.

Evaluation of Nurses' Competency in Nurse-Patient Communication about Medications: Conversational Analysis Approach (간호사의 투약대화의 구조와 내용에 대한 평가도구 개발 연구: 대화분석적 접근)

  • Son, Haeng-Mi
    • Journal of Korean Academy of Nursing
    • /
    • v.40 no.1
    • /
    • pp.1-13
    • /
    • 2010
  • Purpose: The purpose of this study was to develop evaluation criteria for conversations about medication and to demonstrate conversational analysis with actual dialogues on medication as examples. Methods: This study was a secondary analysis of qualitative research using conversational analysis which showed functional phases and patterns of dialogue about medication (greeting, identifying the patient, medicating, finishing). Nurse-patient conversations were videotaped and transcribed and 75 conversations were used for analysis. Results: Not all functional phases were showed in the conversations about medication. Therefore, conversations about medication can be considered as incomplete dialogues. The evaluation-criteria were represented in terms of the structure and content of the dialogues. Structural evaluation-criteria were the same as the functional phases, as functional stage is the standard for evaluation. The criteria of evaluation for content suggested 3 domains, content, expression, and interaction with 20 items scored on a Likert-type scale of 5-points. Finally, analysis of actual conversations about medication according to the evaluative criteria were provided. Conclusion: The results provide the basic data to develop educational programs and strategies to improve nurses’ competency in conversation about medication.

Prosodic Modifications of the Internal Phonetic Structure of Monosyllabic CVC Words in Conversational Speech

  • Mo, Yoonsook
    • Phonetics and Speech Sciences
    • /
    • v.5 no.1
    • /
    • pp.99-108
    • /
    • 2013
  • Previous laboratory studies have shown that prosodic structures are encoded in the modulations of phonetic patterns of speech including suprasegmental as well as segmental features. In particular, effects of prosodic context on duration and intensity of syllables and words have been widely reported. Drawing on prosodically annotated large-scale speech data from the Buckeye corpus of conversational speech of American English, the current study attempted to examine whether and how prosodic prominence and phrase boundary of everyday conversational speech, as determined by a large group of ordinary listeners, are related to the phonetic realization of duration and intensity. The results showed that the patterns of word durations and intensities are influenced by prosodic structure. Closer examinations revealed, however, that the effects of prosodic prominence are not the same as those of prosodic phrase boundary. With regard to intensity measures, the results revealed the systematic changes in the patterns of overall RMS intensity near prosodic phrase boundary but the prominence effects are restricted to the nucleus. In terms of duration measures, both prosodic prominence and phrase boundary are the most closely related to the lengthening of the nucleus. Yet, prosodic prominence is more closely related to the lengthening of the onset while phrase boundary lengthens the coda duration more. The findings from the current study suggest that the phonetic realizations of prosodic prominence are different from those of prosodic phrase boundary, and speakers signal different prosodic structures through deliberate modulations of the internal phonetic structure of words and listeners attend to such phonetic variations.

Automatic Construction of Hierarchical Bayesian Networks for Topic Inference of Conversational Agent (대화형 에이전트의 주제 추론을 위한 계층적 베이지안 네트워크의 자동 생성)

  • Lim, Sung-Soo;Cho, Sung-Bae
    • Journal of KIISE:Software and Applications
    • /
    • v.33 no.10
    • /
    • pp.877-885
    • /
    • 2006
  • Recently it is proposed that the Bayesian networks used as conversational agent for topic inference is useful but the Bayesian networks require much time to model, and the Bayesian networks also have to be modified when the scripts, the database for conversation, are added or modified and this hinders the scalability of the agent. This paper presents a method to improve the scalability of the agent by constructing the Bayesian network from scripts automatically. The proposed method is to model the structure of Bayesian networks hierarchically and to utilize Noisy-OR gate to form the conditional probability distribution table (CPT). Experimental results with ten subjects confirm the usefulness of the proposed method.

Integration of Multipath Transmission into the IMS Framework

  • Liu, Shaowei;Lei, Weimin;Zhang, Wei;Li, Hao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.8
    • /
    • pp.3904-3917
    • /
    • 2017
  • IP multimedia subsystem (IMS) is an open standardized architecture for delivering multimedia service over IP network in a route-agnostic manner. With the increasing popularity of conversational class service, the delivery of a traffic flow with a certain bandwidth demand over a single network path is either not possible or not cost-effective. Multipath transmission is considered to be a promising solution to provide high-quality delivery service. This paper proposes a software defined service overlay network (SDSON) based multipath transmission framework for IMS, which is complementary to existing network architecture. The framework transforms original two-party session negotiation into three-party session negotiation that supports participants to negotiate multipath transmission capacity and path information by signaling message. Based on existing IETF standards, SIP and SDP are scalable to support these functions. Finally, the proposed framework is fully implemented on open source platform and examined by experiments. Experimental results show that multipath-enabled IMS is an effective way to improve the delivery performance of conversational class service.

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

Over the Rainbow: How to Fly over with ChatGPT in Tourism

  • Taekyung Kim
    • Journal of Smart Tourism
    • /
    • v.3 no.1
    • /
    • pp.41-47
    • /
    • 2023
  • Tourism and hospitality have encountered significant changes in recent years as a result of the rapid development of information technology (IT). Customers now expect more expedient services and customized travel experiences, which has intensified competition among service providers. To meet these demands, businesses have adopted sophisticated IT applications such as ChatGPT, which enables real-time interaction with consumers and provides recommendations based on their preferences. This paper focuses on the AI support-prompt middleware system, which functions as a mediator between generative AI and human users, and discusses two operational rules associated with it. The first rule is the Information Processing Rule, which requires the middleware system to determine appropriate responses based on the context of the conversation using techniques for natural language processing. The second rule is the Information Presentation Rule, which requires the middleware system to choose an appropriate language style and conversational attitude based on the gravity of the topic or the conversational context. These rules are essential for guaranteeing that the middleware system can fathom user intent and respond appropriately in various conversational contexts. This study contributes to the planning and analysis of service design by deriving design rules for middleware systems to incorporate artificial intelligence into tourism services. By comprehending the operation of AI support-prompt middleware systems, service providers can design more effective and efficient AI-driven tourism services, thereby improving the customer experience and obtaining a market advantage.