• Title/Summary/Keyword: Image Feedback

Search Result 285, Processing Time 0.025 seconds

Usability of CPR Training System based on Extended Reality (확장현실 기반의 심폐소생술 교육 시스템의 사용성 평가)

  • Lee, Youngho;Kim, Sun Kyung;Choi, Jongmyung;Park, Gun Woo;Go, Younghye
    • Journal of Internet of Things and Convergence
    • /
    • v.8 no.6
    • /
    • pp.115-122
    • /
    • 2022
  • Recently, the importance of CPR training for the layperson has been emphasized to improve the survival rate of out-of-hospital cardiac arrest patients. An accurate and realistic training strategy is required for the CPR training effect for laypersons. In this study, we develop an extended reality (XR) based CPR training system and evaluate its usability. The XR based CPR training system consisted of three applications. First, a 3D heart anatomy image registered to the manikin is transmitted to the smart glasses to guide the chest compression point. The second application provides visual and auditory information about the CPR process through smart glasses. At the same time, the smartwatch sends a vibration notification to guide the compression rate. The 'Add-on-kit' is a device that detects the depth and speed of chest compression via sensors installed on the manikin and sends immediate feedback to the smartphone. One hundred laypersons who participated in this study agreed that the XR based CPR training system has realism and effectiveness. XR based registration technology will contribute to improving the efficiency of CPR training by enhancing realism, immersion, and self-directed learning.

Artificial Intelligence for Assistance of Facial Expression Practice Using Emotion Classification (감정 분류를 이용한 표정 연습 보조 인공지능)

  • Dong-Kyu, Kim;So Hwa, Lee;Jae Hwan, Bong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.6
    • /
    • pp.1137-1144
    • /
    • 2022
  • In this study, an artificial intelligence(AI) was developed to help with facial expression practice in order to express emotions. The developed AI used multimodal inputs consisting of sentences and facial images for deep neural networks (DNNs). The DNNs calculated similarities between the emotions predicted by the sentences and the emotions predicted by facial images. The user practiced facial expressions based on the situation given by sentences, and the AI provided the user with numerical feedback based on the similarity between the emotion predicted by sentence and the emotion predicted by facial expression. ResNet34 structure was trained on FER2013 public data to predict emotions from facial images. To predict emotions in sentences, KoBERT model was trained in transfer learning manner using the conversational speech dataset for emotion classification opened to the public by AIHub. The DNN that predicts emotions from the facial images demonstrated 65% accuracy, which is comparable to human emotional classification ability. The DNN that predicts emotions from the sentences achieved 90% accuracy. The performance of the developed AI was evaluated through experiments with changing facial expressions in which an ordinary person was participated.

Development of real-time defect detection technology for water distribution and sewerage networks (시나리오 기반 상·하수도 관로의 실시간 결함검출 기술 개발)

  • Park, Dong, Chae;Choi, Young Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.spc1
    • /
    • pp.1177-1185
    • /
    • 2022
  • The water and sewage system is an infrastructure that provides safe and clean water to people. In particular, since the water and sewage pipelines are buried underground, it is very difficult to detect system defects. For this reason, the diagnosis of pipelines is limited to post-defect detection, such as system diagnosis based on the images taken after taking pictures and videos with cameras and drones inside the pipelines. Therefore, real-time detection technology of pipelines is required. Recently, pipeline diagnosis technology using advanced equipment and artificial intelligence techniques is being developed, but AI-based defect detection technology requires a variety of learning data because the types and numbers of defect data affect the detection performance. Therefore, in this study, various defect scenarios are implemented using 3D printing model to improve the detection performance when detecting defects in pipelines. Afterwards, the collected images are performed to pre-processing such as classification according to the degree of risk and labeling of objects, and real-time defect detection is performed. The proposed technique can provide real-time feedback in the pipeline defect detection process, and it would be minimizing the possibility of missing diagnoses and improve the existing water and sewerage pipe diagnosis processing capability.

Basic Study for Selection of Factors Constituents of User Satisfaction for Micro Electric Vehicles (초소형전기차 사용자만족도 구성요인 선정을 위한 기반연구)

  • Jin, Eunju;Seo, Imki;Kim, Jongmin;Park, Jejin
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.41 no.5
    • /
    • pp.581-589
    • /
    • 2021
  • With the recent increase in the introduction of micro-electric vehicles in Korea, interest in micro-electric vehicle user satisfaction is increasing to revitalize related markets. In this paper, a basic study was conducted on the development of public services using micro-electric vehicle based on the constituent factors of user satisfaction. The survey includes: ① 'Analytic Hierarchy Process (AHP) for selecting the priority factors of user satisfaction of micro-electric vehicles', ② 'A survey of micro-electric vehicles image' to collect data in advance for providing users' preferences and transportation services for micro-electric vehicles, ③ In order to investigate the user satisfaction level of users who actually operated micro-electric vehicles, the order of 'user satisfaction survey of micro-electric vehicle drivers' was conducted. In the Analytic Hierarchy Process (AHP) analysis, it was found that users regarded as important in the order of 'user utilization data', 'vehicle movement data', and 'charging service data'. In the micro-electric vehicle image survey, users perceived micro-electric vehicles more positively in terms of "safety", 'durability', 'Ride comfort', 'design', 'MOOE (Maintenance and other operating expense)', and 'environment-friendly' when comparing micro-electric vehicles with electric motorcycles. In the survey on the user satisfaction of micro-electric vehicle drivers, the use of micro-electric vehicle did not directly affect work performance efficiency, and there was an experience of being disadvantaged on the road due to the size of the micro-electric vehicle, and driving in a cluster of micro-electric vehicle for outdoor advertisements. The city's public relations effect was great, but it was concerned about safety. In the future, based on the results of this study, we plan to build a user satisfaction structural equation model, preemptively discover feedback R&D for micro-electric vehicle utilization services in the public field, and actively seek to discover new public mobility support services.

Open Digital Textbook for Smart Education (스마트교육을 위한 오픈 디지털교과서)

  • Koo, Young-Il;Park, Choong-Shik
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.2
    • /
    • pp.177-189
    • /
    • 2013
  • In Smart Education, the roles of digital textbook is very important as face-to-face media to learners. The standardization of digital textbook will promote the industrialization of digital textbook for contents providers and distributers as well as learner and instructors. In this study, the following three objectives-oriented digital textbooks are looking for ways to standardize. (1) digital textbooks should undertake the role of the media for blended learning which supports on-off classes, should be operating on common EPUB viewer without special dedicated viewer, should utilize the existing framework of the e-learning learning contents and learning management. The reason to consider the EPUB as the standard for digital textbooks is that digital textbooks don't need to specify antoher standard for the form of books, and can take advantage od industrial base with EPUB standards-rich content and distribution structure (2) digital textbooks should provide a low-cost open market service that are currently available as the standard open software (3) To provide appropriate learning feedback information to students, digital textbooks should provide a foundation which accumulates and manages all the learning activity information according to standard infrastructure for educational Big Data processing. In this study, the digital textbook in a smart education environment was referred to open digital textbook. The components of open digital textbooks service framework are (1) digital textbook terminals such as smart pad, smart TVs, smart phones, PC, etc., (2) digital textbooks platform to show and perform digital contents on digital textbook terminals, (3) learning contents repository, which exist on the cloud, maintains accredited learning, (4) App Store providing and distributing secondary learning contents and learning tools by learning contents developing companies, and (5) LMS as a learning support/management tool which on-site class teacher use for creating classroom instruction materials. In addition, locating all of the hardware and software implement a smart education service within the cloud must have take advantage of the cloud computing for efficient management and reducing expense. The open digital textbooks of smart education is consdered as providing e-book style interface of LMS to learners. In open digital textbooks, the representation of text, image, audio, video, equations, etc. is basic function. But painting, writing, problem solving, etc are beyond the capabilities of a simple e-book. The Communication of teacher-to-student, learner-to-learnert, tems-to-team is required by using the open digital textbook. To represent student demographics, portfolio information, and class information, the standard used in e-learning is desirable. To process learner tracking information about the activities of the learner for LMS(Learning Management System), open digital textbook must have the recording function and the commnincating function with LMS. DRM is a function for protecting various copyright. Currently DRMs of e-boook are controlled by the corresponding book viewer. If open digital textbook admitt DRM that is used in a variety of different DRM standards of various e-book viewer, the implementation of redundant features can be avoided. Security/privacy functions are required to protect information about the study or instruction from a third party UDL (Universal Design for Learning) is learning support function for those with disabilities have difficulty in learning courses. The open digital textbook, which is based on E-book standard EPUB 3.0, must (1) record the learning activity log information, and (2) communicate with the server to support the learning activity. While the recording function and the communication function, which is not determined on current standards, is implemented as a JavaScript and is utilized in the current EPUB 3.0 viewer, ths strategy of proposing such recording and communication functions as the next generation of e-book standard, or special standard (EPUB 3.0 for education) is needed. Future research in this study will implement open source program with the proposed open digital textbook standard and present a new educational services including Big Data analysis.