• Title/Summary/Keyword: Q learning

Search Result 433, Processing Time 0.034 seconds

Design and Implementation of an Problem-Solving Based and Self-Directed Learning System on Web (웹에서 문제 해결 기반 및 자기 주도적학습 시스템의 설계와 구현)

  • Kim, Kyung-Deok;Lee, Sang-Woon
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.7
    • /
    • pp.944-955
    • /
    • 2004
  • The modern society as a high-level information-oriented society lays a great emphasis on lifelong education. It emphasizes all the learners' creative learning ability and various teaching-learning methods as well. We need the self-directed learning to meet these requirements, and one of the solutions is the self-directed teaching-learning process employing the web. Though many educators, so far, developed a number of teaching materials, they are no more than web-based teaching materials for simple learning activities or simple item-bank systems. So, this paper suggests an problem-solving based and self-directed learning system on web in order to overcome such simplicities, and it shows design and implementation of the system. Suggested learning system enables learners to get thinking skill though self-directed control of learning level after they learn the basic concepts and principles on the web as self-directed learning. For example, the system was applied to mathematics education for a middle school students. It supports a test of questions chosen from the item bank in a self-directed way, and helps learners to understand their learning levels for themselves and to solve their questions through on-line discussions with their instructor. The system can also be helpful in improving the learners' learning effects by sharing mutual information through the data room or the Q&A between learners and learners or between learners and instructors.

  • PDF

Time Critical Packet Scheduling via Reinforcement Learning (강화학습을 통한 시간에 엄격한 패킷 스케쥴링)

  • Jeong, Hyun-Seok;Lee, Tae-Ho;Lee, Byung-Jun;Kim, Kyoung-Tae;Youn, Hee-Yong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2018.07a
    • /
    • pp.45-46
    • /
    • 2018
  • 본 논문에서는 시간에 엄격한(Time critical) 산업용 IoT(Industrial IoT) 환경의 무선 센서 네트워크 시스템 상의 효율적인 패킷 전달과 정확도(Accuracy) 향상을 위해 강화학습과 EDF 알고리즘을 혼합한 스케쥴링 기법을 제안한다. 이 방식은 다중 대기열(Multiple queue) 환경에서 각 대기열의 요구 정확도(Accuracy Requirement)를 기준으로 최대한 패킷 처리를 미룸으로써 효율적인 CPU자원 분배와 패킷 손실율(Packet Loss)을 조절한다. 제안하는 기법은 무선 센서 네트워크 상의 가변적이고 예측 불가능한 환경에 대한 사전지식이 없이도 요구하는 서비스의 질(Quality of service)를 만족할 수 있도록 한다. 또한 정확도를 요구조건으로 제시하여 마감시간이 중요시되는 작업에서도 효율을 최대화한다.

  • PDF

Autonomous pothole detection using deep region-based convolutional neural network with cloud computing

  • Luo, Longxi;Feng, Maria Q.;Wu, Jianping;Leung, Ryan Y.
    • Smart Structures and Systems
    • /
    • v.24 no.6
    • /
    • pp.745-757
    • /
    • 2019
  • Road surface deteriorations such as potholes have caused motorists heavy monetary damages every year. However, effective road condition monitoring has been a continuing challenge to road owners. Depth cameras have a small field of view and can be easily affected by vehicle bouncing. Traditional image processing methods based on algorithms such as segmentation cannot adapt to varying environmental and camera scenarios. In recent years, novel object detection methods based on deep learning algorithms have produced good results in detecting typical objects, such as faces, vehicles, structures and more, even in scenarios with changing object distances, camera angles, lighting conditions, etc. Therefore, in this study, a Deep Learning Pothole Detector (DLPD) based on the deep region-based convolutional neural network is proposed for autonomous detection of potholes from images. About 900 images with potholes and road surface conditions are collected and divided into training and testing data. Parameters of the network in the DLPD are calibrated based on sensitivity tests. Then, the calibrated DLPD is trained by the training data and applied to the 215 testing images to evaluate its performance. It is demonstrated that potholes can be automatically detected with high average precision over 93%. Potholes can be differentiated from manholes by training and applying a manhole-pothole classifier which is constructed using the convolutional neural network layers in DLPD. Repeated detection of the same potholes can be prevented through feature matching of the newly detected pothole with previously detected potholes within a small region.

A Study on Improving the Satisfaction of Non-face-to-face Video Lectures Using IPA Analysis (IPA 분석법을 활용한 비대면 동영상 강의 만족도 제고 방안 연구)

  • Jung, Dae-Hyun;Kim, Jin-Sung
    • The Journal of Information Systems
    • /
    • v.29 no.4
    • /
    • pp.45-56
    • /
    • 2020
  • Purpose The purpose of this study is to present the direction of efficient e-learning education through the importance and satisfaction survey of learners of non-face-to-face video lectures. Therefore, by grasping the degree of satisfaction of the importance ratio through the IPA analysis method, we try to present improvement measures for insufficient education methods. Design/methodology/approach For IPA analysis, we conducted an online survey of four universities and analyzed 154 samples. The analysis method used SPSS, and through the wordcloud analysis method of R, the suggestions for the non-face-to-face lecture method felt by learners were analyzed to derive implications for improving the quality of education. Findings As a result of the overall satisfaction survey for the entire non-face-to-face class, the factors with the greatest dissatisfaction are listed as follows. Complaints about the adequacy of learning materials and activities (quiz, discussion, assignments, etc.), Complaints about how to use the produced content, and complaints about announcements about class management (lecture schedule, lecture method) were identified in order. The factors of dissatisfaction were clear in the non-face-to-face class where interactive communication was impossible or insufficient. In addition to the lack of quick Q&A, there seems to have been a phenomenon of some neglect.

New Approaches to Xerostomia with Salivary Flow Rate Based on Machine Learning Algorithm

  • Yeon-Hee Lee;Q-Schick Auh;Hee-Kyung Park
    • Journal of Korean Dental Science
    • /
    • v.16 no.1
    • /
    • pp.47-62
    • /
    • 2023
  • Purpose: We aimed to investigate the objective cutoff values of unstimulated flow rates (UFR) and stimulated salivary flow rates (SFR) in patients with xerostomia and to present an optimal machine learning model with a classification and regression tree (CART) for all ages. Materials and Methods: A total of 829 patients with oral diseases were enrolled (591 females; mean age, 59.29±16.40 years; 8~95 years old), 199 patients with xerostomia and 630 patients without xerostomia. Salivary and clinical characteristics were collected and analyzed. Result: Patients with xerostomia had significantly lower levels of UFR (0.29±0.22 vs. 0.41±0.24 ml/min) and SFR (1.12±0.55 vs. 1.39±0.94 ml/min) (P<0.001), respectively, compared to those with non-xerostomia. The presence of xerostomia had a significantly negative correlation with UFR (r=-0.603, P=0.002) and SFR (r=-0.301, P=0.017). In the diagnosis of xerostomia based on the CART algorithm, the presence of stomatitis, candidiasis, halitosis, psychiatric disorder, and hyperlipidemia were significant predictors for xerostomia, and the cutoff ranges for xerostomia for UFR and SFR were 0.03~0.18 ml/min and 0.85~1.6 ml/min, respectively. Conclusion: Xerostomia was correlated with decreases in UFR and SFR, and their cutoff values varied depending on the patient's underlying oral and systemic conditions.

Enhancing Service Availability in Multi-Access Edge Computing with Deep Q-Learning

  • Lusungu Josh Mwasinga;Syed Muhammad Raza;Duc-Tai Le ;Moonseong Kim ;Hyunseung Choo
    • Journal of Internet Computing and Services
    • /
    • v.24 no.2
    • /
    • pp.1-10
    • /
    • 2023
  • The Multi-access Edge Computing (MEC) paradigm equips network edge telecommunication infrastructure with cloud computing resources. It seeks to transform the edge into an IT services platform for hosting resource-intensive and delay-stringent services for mobile users, thereby significantly enhancing perceived service quality of experience. However, erratic user mobility impedes seamless service continuity as well as satisfying delay-stringent service requirements, especially as users roam farther away from the serving MEC resource, which deteriorates quality of experience. This work proposes a deep reinforcement learning based service mobility management approach for ensuring seamless migration of service instances along user mobility. The proposed approach focuses on the problem of selecting the optimal MEC resource to host services for high mobility users, thereby reducing service migration rejection rate and enhancing service availability. Efficacy of the proposed approach is confirmed through simulation experiments, where results show that on average, the proposed scheme reduces service delay by 8%, task computing time by 36%, and migration rejection rate by more than 90%, when comparing to a baseline scheme.

Prenatal Diagnosis of the 22q11.2 Duplication Syndrome

  • Lee, Moon-Hee;Park, So-Yeon;Lee, Bom-Yi;Choi, Eun-Young;Kim, Jin-Woo;Park, Ju-Yeon;Lee, Yeon-Woo;Oh, Ah-Rum;Lee, Shin-Young;Yang, Jae-Hyug;Ryu, Hyun-Mee
    • Journal of Genetic Medicine
    • /
    • v.6 no.2
    • /
    • pp.175-178
    • /
    • 2009
  • The 22q11.2 duplication syndrome is an extremely variable disorder with a phenotype ranging from normal to congenital defects and learning disabilities. Recently, the detection rate of 22q11.2 duplication has been increased by molecular techniques, such as array CGH. In this study, we report a familial case of 22q11.2 duplication detected prenatally. Her first pregnancy was terminated because of 22q11.2 duplication detected incidentally by BAC array CGH. The case was referred due to second pregnancy with same 22q11.2 duplication. We perfomed repeat amniocentesis for karyotype and FISH analysis. Karyotype analysis from amniocytes and parental lymphocytes were normal, while FISH analysis of interphase cells presented a duplication of 22q11.2 in the fetus and phenotypically normal mother. The fetal ultrasound showed grossly normal finding. After genetic counseling about variable phenotype with intrafamilial variability with 50% recurrence rate, the couple decided to continue the pregnancy. The newborn had no apparent congenital abnormalities until 2 weeks after birth. We recommend that family members of patients with a 22q11.2 duplication be tested by the interphase FISH analysis. Also, we point out the importance of genetic counseling and an evaluation of the clinical relevance of diagnostic test results.

  • PDF

Understanding and Designing Teachable Agent (교수가능 에이전트(Teachable Agent)의 개념적 이해와 설계방안)

  • 김성일;김원식;윤미선;소연희;권은주;최정선;김문숙;이명진;박태진
    • Korean Journal of Cognitive Science
    • /
    • v.14 no.3
    • /
    • pp.13-21
    • /
    • 2003
  • This study presents a design of Teachable Agent(TA) and its theoretical background. TA is an intelligent agent to which students as tutors teach, pose questions, and provide feedbacks using a concept map. TA consists of four independent Modules, Teach Module, Q&A Module, Test Module, and Resource Module. In Teach Module, students teach TA by constructing concept map. In Q&A Module, both students and TA ask questions and answer questions each other through an interactive window. To assess TA's knowledge and provide feedback to students, Test Module consists of a set of predetermined questions which TA should pass. From Resource Module, students can search and look up important information to teach, ask questions, and provide feedbacks whenever they want. It is expected that TA should provide student tutors with an active role in learning and positive attitude toward the subject matter by enhancing their cognition as well as motivation.

  • PDF

Performance Evaluation on the Learning Algorithm for Automatic Classification of Q&A Documents (고객 질의 문서 자동 분류를 위한 학습 알고리즘 성능 평가)

  • Choi Jung-Min;Lee Byoung-Soo
    • The KIPS Transactions:PartD
    • /
    • v.13D no.1 s.104
    • /
    • pp.133-138
    • /
    • 2006
  • Electric commerce of surpassing the traditional one appeared before the public and has currently led the change in the management of enterprises. To establish and maintain good relations with customers, electric commerce has various channels for customers that understand what they want to and suggest it to them. The bulletin board and e-mail among em are inbound information that enterprises can directly listen to customers' opinions and are different from other channels in characters. Enterprises can effectively manage the bulletin board and e-mail by understanding customers' ideas as many as possible and provide them with optimum answers. It is one of the important factors to improve the reliability of the notice board and e-mail as well as the whole electric commerce. Therefore this thesis researches into methods to classify various kinds of documents automatically in electric commerce; they are possible to solve existing problems of the bulletin board and e-mail, to operate effectively and to manage systematically. Moreover, it researches what the most suitable algorithm is in the automatic classification of Q&A documents by experiment the classifying performance of Naive Bayesian, TFIDF, Neural Network, k-NN

Bug Report Quality Prediction for Enhancing Performance of Information Retrieval-based Bug Localization (정보검색기반 결함위치식별 기술의 성능 향상을 위한 버그리포트 품질 예측)

  • Kim, Misoo;Ahn, June;Lee, Eunseok
    • Journal of KIISE
    • /
    • v.44 no.8
    • /
    • pp.832-841
    • /
    • 2017
  • Bug reports are essential documents for developers to localize and fix bugs. These reports contain information regarding software bugs or failures that occur during software operation and maintenance phase. Information Retrieval-based Bug Localization (IR-BL) techniques have been proposed to reduce the time and cost it takes for developers to resolve bug reports. However, if a low-quality bug report is submitted, the performance of such techniques can be significantly degraded. To address this problem, we propose a quality prediction method that selects low-quality bug reports. This process; defines a Quality property of a Bug report as a Query (Q4BaQ) and predicts the quality of the bug reports using machine learning. We evaluated the proposed method with 3 open source projects. The results of the experiment show that the proposed method achieved an average F-measure of 87.31% and outperformed previous prediction techniques by up to 6.62% in the F-measure. Finally, a combination of the proposed method and traditional automatic query reformulation method improved the MRR and MAP by 0.9% and 1.3%, respectively.