• 제목/요약/키워드: Image Learning

Search Result 3,146, Processing Time 0.029 seconds

Spontaneous Speech Emotion Recognition Based On Spectrogram With Convolutional Neural Network (CNN 기반 스펙트로그램을 이용한 자유발화 음성감정인식)

  • Guiyoung Son;Soonil Kwon
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.6
    • /
    • pp.284-290
    • /
    • 2024
  • Speech emotion recognition (SER) is a technique that is used to analyze the speaker's voice patterns, including vibration, intensity, and tone, to determine their emotional state. There has been an increase in interest in artificial intelligence (AI) techniques, which are now widely used in medicine, education, industry, and the military. Nevertheless, existing researchers have attained impressive results by utilizing acted-out speech from skilled actors in a controlled environment for various scenarios. In particular, there is a mismatch between acted and spontaneous speech since acted speech includes more explicit emotional expressions than spontaneous speech. For this reason, spontaneous speech-emotion recognition remains a challenging task. This paper aims to conduct emotion recognition and improve performance using spontaneous speech data. To this end, we implement deep learning-based speech emotion recognition using the VGG (Visual Geometry Group) after converting 1-dimensional audio signals into a 2-dimensional spectrogram image. The experimental evaluations are performed on the Korean spontaneous emotional speech database from AI-Hub, consisting of 7 emotions, i.e., joy, love, anger, fear, sadness, surprise, and neutral. As a result, we achieved an average accuracy of 83.5% and 73.0% for adults and young people using a time-frequency 2-dimension spectrogram, respectively. In conclusion, our findings demonstrated that the suggested framework outperformed current state-of-the-art techniques for spontaneous speech and showed a promising performance despite the difficulty in quantifying spontaneous speech emotional expression.

Detecting high-resolution usage status of individual parcel of land using object detecting deep learning technique (객체 탐지 딥러닝 기법을 활용한 필지별 조사 방안 연구)

  • Jeon, Jeong-Bae
    • Journal of Cadastre & Land InformatiX
    • /
    • v.54 no.1
    • /
    • pp.19-32
    • /
    • 2024
  • This study examined the feasibility of image-based surveys by detecting objects in facilities and agricultural land using the YOLO algorithm based on drone images and comparing them with the land category by law. As a result of detecting objects through the YOLO algorithm, buildings showed a performance of detecting objects corresponding to 96.3% of the buildings provided in the existing digital map. In addition, the YOLO algorithm developed in this study detected 136 additional buildings that were not located in the digital map. Plastic greenhouses detected a total of 297 objects, but the detection rate was low for some plastic greenhouses for fruit trees. Also, agricultural land had the lowest detection rate. This result is because agricultural land has a larger area and irregular shape than buildings, so the accuracy is lower than buildings due to the inconsistency of training data. Therefore, segmentation detection, rather than box-shaped detection, is likely to be more effective for agricultural fields. Comparing the detected objects with the land category by law, it was analyzed that some buildings exist in agricultural and forest areas where it is difficult to locate buildings. It seems that it is necessary to link with administrative information to understand that these buildings are used illegally. Therefore, at the current level, it is possible to objectively determine the existence of buildings in fields where it is difficult to locate buildings.

Quality of Radiomics Research on Brain Metastasis: A Roadmap to Promote Clinical Translation

  • Chae Jung Park;Yae Won Park;Sung Soo Ahn;Dain Kim;Eui Hyun Kim;Seok-Gu Kang;Jong Hee Chang;Se Hoon Kim;Seung-Koo Lee
    • Korean Journal of Radiology
    • /
    • v.23 no.1
    • /
    • pp.77-88
    • /
    • 2022
  • Objective: Our study aimed to evaluate the quality of radiomics studies on brain metastases based on the radiomics quality score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, and the Image Biomarker Standardization Initiative (IBSI) guidelines. Materials and Methods: PubMed MEDLINE, and EMBASE were searched for articles on radiomics for evaluating brain metastases, published until February 2021. Of the 572 articles, 29 relevant original research articles were included and evaluated according to the RQS, TRIPOD checklist, and IBSI guidelines. Results: External validation was performed in only three studies (10.3%). The median RQS was 3.0 (range, -6 to 12), with a low basic adherence rate of 50.0%. The adherence rate was low in comparison to the "gold standard" (10.3%), stating the potential clinical utility (10.3%), performing the cut-off analysis (3.4%), reporting calibration statistics (6.9%), and providing open science and data (3.4%). None of the studies involved test-retest or phantom studies, prospective studies, or cost-effectiveness analyses. The overall rate of adherence to the TRIPOD checklist was 60.3% and low for reporting title (3.4%), blind assessment of outcome (0%), description of the handling of missing data (0%), and presentation of the full prediction model (0%). The majority of studies lacked pre-processing steps, with bias-field correction, isovoxel resampling, skull stripping, and gray-level discretization performed in only six (20.7%), nine (31.0%), four (3.8%), and four (13.8%) studies, respectively. Conclusion: The overall scientific and reporting quality of radiomics studies on brain metastases published during the study period was insufficient. Radiomics studies should adhere to the RQS, TRIPOD, and IBSI guidelines to facilitate the translation of radiomics into the clinical field.

Automatic Detection and Classification of Rib Fractures on Thoracic CT Using Convolutional Neural Network: Accuracy and Feasibility

  • Qing-Qing Zhou;Jiashuo Wang;Wen Tang;Zhang-Chun Hu;Zi-Yi Xia;Xue-Song Li;Rongguo Zhang;Xindao Yin;Bing Zhang;Hong Zhang
    • Korean Journal of Radiology
    • /
    • v.21 no.7
    • /
    • pp.869-879
    • /
    • 2020
  • Objective: To evaluate the performance of a convolutional neural network (CNN) model that can automatically detect and classify rib fractures, and output structured reports from computed tomography (CT) images. Materials and Methods: This study included 1079 patients (median age, 55 years; men, 718) from three hospitals, between January 2011 and January 2019, who were divided into a monocentric training set (n = 876; median age, 55 years; men, 582), five multicenter/multiparameter validation sets (n = 173; median age, 59 years; men, 118) with different slice thicknesses and image pixels, and a normal control set (n = 30; median age, 53 years; men, 18). Three classifications (fresh, healing, and old fracture) combined with fracture location (corresponding CT layers) were detected automatically and delivered in a structured report. Precision, recall, and F1-score were selected as metrics to measure the optimum CNN model. Detection/diagnosis time, precision, and sensitivity were employed to compare the diagnostic efficiency of the structured report and that of experienced radiologists. Results: A total of 25054 annotations (fresh fracture, 10089; healing fracture, 10922; old fracture, 4043) were labelled for training (18584) and validation (6470). The detection efficiency was higher for fresh fractures and healing fractures than for old fractures (F1-scores, 0.849, 0.856, 0.770, respectively, p = 0.023 for each), and the robustness of the model was good in the five multicenter/multiparameter validation sets (all mean F1-scores > 0.8 except validation set 5 [512 x 512 pixels; F1-score = 0.757]). The precision of the five radiologists improved from 80.3% to 91.1%, and the sensitivity increased from 62.4% to 86.3% with artificial intelligence-assisted diagnosis. On average, the diagnosis time of the radiologists was reduced by 73.9 seconds. Conclusion: Our CNN model for automatic rib fracture detection could assist radiologists in improving diagnostic efficiency, reducing diagnosis time and radiologists' workload.

Development of Inquiry Activity Materials for Visualizing Typhoon Track using GK-2A Satellite Images (천리안 위성 2A호 영상을 활용한 태풍 경로 시각화 탐구활동 수업자료 개발)

  • Chae-Young Lim;Kyung-Ae Park
    • Journal of the Korean earth science society
    • /
    • v.45 no.1
    • /
    • pp.48-71
    • /
    • 2024
  • Typhoons are representative oceanic and atmospheric phenomena that cause interactions within the Earth's system with diverse influences. In recent decades, the typhoons have tended to strengthen due to rapidly changing climate. The 2022 revised science curriculum emphasizes the importance of teaching-learning activities using advanced science and technology to cultivate digital literacy as a citizen of the future society. Therefore, it is necessary to solve the temporal and spatial limitations of textbook illustrations and to develop effective instructional materials using global-scale big data covered in the field of earth science. In this study, according to the procedure of the PDIE (Preparation, Development, Implementation, Evaluation) model, the inquiry activity data was developed to visualize the track of the typhoon using the image data of GK-2A. In the preparatory stage, the 2015 and 2022 revised curriculum and the contents of the inquiry activities of the current textbooks were analyzed. In the development stage, inquiry activities were organized into a series of processes that can collect, process, visualize, and analyze observational data, and a GUI (Graphic User Interface)-based visualization program that can derive results with a simple operation was created. In the implementation and evaluation stage, classes were conducted with students, and classes using code and GUI programs were conducted respectively to compare the characteristics of each activity and confirm its applicability in the school field. The class materials presented in this study enable exploratory activities using actual observation data without professional programming knowledge which is expected to contribute to students' understanding and digital literacy in the field of earth science.

Digital Library Interface Research Based on EEG, Eye-Tracking, and Artificial Intelligence Technologies: Focusing on the Utilization of Implicit Relevance Feedback (뇌파, 시선추적 및 인공지능 기술에 기반한 디지털 도서관 인터페이스 연구: 암묵적 적합성 피드백 활용을 중심으로)

  • Hyun-Hee Kim;Yong-Ho Kim
    • Journal of the Korean Society for information Management
    • /
    • v.41 no.1
    • /
    • pp.261-282
    • /
    • 2024
  • This study proposed and evaluated electroencephalography (EEG)-based and eye-tracking-based methods to determine relevance by utilizing users' implicit relevance feedback while navigating content in a digital library. For this, EEG/eye-tracking experiments were conducted on 32 participants using video, image, and text data. To assess the usefulness of the proposed methods, deep learning-based artificial intelligence (AI) techniques were used as a competitive benchmark. The evaluation results showed that EEG component-based methods (av_P600 and f_P3b components) demonstrated high classification accuracy in selecting relevant videos and images (faces/emotions). In contrast, AI-based methods, specifically object recognition and natural language processing, showed high classification accuracy for selecting images (objects) and texts (newspaper articles). Finally, guidelines for implementing a digital library interface based on EEG, eye-tracking, and artificial intelligence technologies have been proposed. Specifically, a system model based on implicit relevance feedback has been presented. Moreover, to enhance classification accuracy, methods suitable for each media type have been suggested, including EEG-based, eye-tracking-based, and AI-based approaches.

Development of a Program for Calculating Typhoon Wind Speed and Data Visualization Based on Satellite RGB Images for Secondary-School Textbooks (인공위성 RGB 영상 기반 중등학교 교과서 태풍 풍속 산출 및 데이터 시각화 프로그램 개발)

  • Chae-Young Lim;Kyung-Ae Park
    • Journal of the Korean earth science society
    • /
    • v.45 no.3
    • /
    • pp.173-191
    • /
    • 2024
  • Typhoons are significant meteorological phenomena that cause interactions among the ocean, atmosphere, and land within Earth's system. In particular, wind speed, a key characteristic of typhoons, is influenced by various factors such as central pressure, trajectory, and sea surface temperature. Therefore, a comprehensive understanding based on actual observational data is essential. In the 2015 revised secondary school textbooks, typhoon wind speed is presented through text and illustrations; hence, exploratory activities that promote a deeper understanding of wind speed are necessary. In this study, we developed a data visualization program with a graphical user interface (GUI) to facilitate the understanding of typhoon wind speeds with simple operations during the teaching-learning process. The program utilizes red-green-blue (RGB) image data of Typhoons Mawar, Guchol, and Bolaven -which occurred in 2023- from the Korean geostationary satellite GEO-KOMPSAT-2A (GK-2A) as the input data. The program is designed to calculate typhoon wind speeds by inputting cloud movement coordinates around the typhoon and visualizes the wind speed distribution by inputting parameters such as central pressure, storm radius, and maximum wind speed. The GUI-based program developed in this study can be applied to typhoons observed by GK-2A without errors and enables scientific exploration based on actual observations beyond the limitations of textbooks. This allows students and teachers to collect, process, analyze, and visualize real observational data without needing a paid program or professional coding knowledge. This approach is expected to foster digital literacy, an essential competency for the future.

Real-Time 3D Volume Deformation and Visualization by Integrating NeRF, PBD, and Parallel Resampling (NeRF, PBD 및 병렬 리샘플링을 결합한 실시간 3D 볼륨 변형체 시각화)

  • Sangmin Kwon;Sojin Jeon;Juni Park;Dasol Kim;Heewon Kye
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.189-198
    • /
    • 2024
  • Research combining deep learning-based models and physical simulations is making important advances in the medical field. This extracts the necessary information from medical image data and enables fast and accurate prediction of deformation of the skeleton and soft tissue based on physical laws. This study proposes a system that integrates Neural Radiance Fields (NeRF), Position-Based Dynamics (PBD), and Parallel Resampling to generate 3D volume data, and deform and visualize them in real-time. NeRF uses 2D images and camera coordinates to produce high-resolution 3D volume data, while PBD enables real-time deformation and interaction through physics-based simulation. Parallel Resampling improves rendering efficiency by dividing the volume into tetrahedral meshes and utilizing GPU parallel processing. This system renders the deformed volume data using ray casting, leveraging GPU parallel processing for fast real-time visualization. Experimental results show that this system can generate and deform 3D data without expensive equipment, demonstrating potential applications in engineering, education, and medicine.

Exploring the Direction of Christian Unification Education through the Tasks of Peace Unification Education (평화통일교육의 과제를 통해 본 기독교통일교육의 방향 탐구)

  • Duk-Lyoul Oh
    • Journal of Christian Education in Korea
    • /
    • v.75
    • /
    • pp.103-125
    • /
    • 2023
  • This study aims to explore the direction and tasks of Christian unification education as peace education. To this end, after examining the historical trend of peace education and unification education in Korea, the tasks of peaceful unification education are reviewed. Peace education has expanded with the activation of peace movements and educational discourse starting from civil society, while unification education has been planned in accordance with the government's unification and North Korea policy and is moving toward the field of education practice. However, due to the nature of unification education that aspires for peace, the combination of the two fields has continued steadily, and research on peace unification education has been continuously conducted. The direction and tasks of Christian unification education as peace education were proposed based on the tasks of peace unification education derived through prior research analysis and the trend of the times in the two areas to carry out the research purpose. For the sustainability of peace on the Korean Peninsula, Christian unification education as a peace education should aim to foster peaceful citizens who take the lead in transitioning from a culture of violence to a culture of peace. To this end, first, it is necessary to seek the direction of Christian education for the dissolution of the antagonist image. Second, activities that guarantee learners' subjectivity and autonomy should be carried out away from the top-down method in teaching and learning. Third, a curriculum connected to daily life should be formed.

Autobiographical Writing for Faith Education of the Elderly (노년기 신앙교육을 위한 자전적 글쓰기)

  • Hyang-Sook Park
    • Journal of Christian Education in Korea
    • /
    • v.76
    • /
    • pp.73-93
    • /
    • 2023
  • Purpose of study: The purpose of this study is to propose an autobiographical writing as an alternative Christian education for the elderly. Research Contents and Methods : First, after analyzing the previous studies on Christian education for the elderly, it was found that most of the studies suggest the need for integrated Christian elderly education and church elderly ministry, and there is a need for a study that suggests a curriculum that can be implemented in the field. Second, there are two educational objectives derived from Fowler's study of faith. One is to describe, analyze, and reconstruct the three elements that make up the content of faith: centers of value, image of powers, and central stories. Second, to explore vocation through a life of pilgrimage in response to the call to partnership with God. Third, autobiographical writing involves an approach based on the tradition of qualitative research and should be oriented toward teaching and learning principles based on descriptive, native, holistic, lived-experience, pathic, interpretive, and open-ended principles. Conclusions and Recommendations: Autobiographical writing will contribute to helping the elderly experiencing crises of despair and anxiety to integrate the meaning of their lives through the holistic expression of their thoughts and feelings, to helping socially isolated older adults to feel connected to society, and to helping them to envision and imagine the future through the present act of revealing their voice. It is hoped that autobiographical writing will increase the number of conversations through retrospection and confession of faith of the elderly.