• Title/Summary/Keyword: Q learning

Search Result 422, Processing Time 0.035 seconds

Estimation of BOD in wastewater treatment plant by using different ANN algorithms

  • BAKI, Osman Tugrul;ARAS, Egemen
    • Membrane and Water Treatment
    • /
    • v.9 no.6
    • /
    • pp.455-462
    • /
    • 2018
  • The measurement and monitoring of the biochemical oxygen demand (BOD) play an important role in the planning and operation of wastewater treatment plants. The most basic method for determining biochemical oxygen demand is direct measurement. However, this method is both expensive and takes a long time. A five-day period is required to determine the biochemical oxygen demand. This study has been carried out in a wastewater treatment plant in Turkey (Hurma WWTP) in order to estimate the biochemical oxygen demand a shorter time and with a lower cost. Estimation was performed using artificial neural network (ANN) method. There are three different methods in the training of artificial neural networks, respectively, multi-layered (ML-ANN), teaching learning based algorithm (TLBO-ANN) and artificial bee colony algorithm (ABC-ANN). The input flow (Q), wastewater temperature (t), pH, chemical oxygen demand (COD), suspended sediment (SS), total phosphorus (tP), total nitrogen (tN), and electrical conductivity of wastewater (EC) are used as the input parameters to estimate the BOD. The root mean squared error (RMSE) and the mean absolute error (MAE) values were used in evaluating performance criteria for each model. As a result of the general evaluation, the ML-ANN method provided the best estimation results both training and test series with 0.8924 and 0.8442 determination coefficient, respectively.

Client-Centered Self Management Program for Chronic Disease Patients: Focusing on Hypertension, Diabetes Mellitus (대상자 중심의 만성질환 자가관리 프로그램: 고혈압, 당뇨병을 중심으로)

  • Song, Yeon Yi;Lee, Kang-Sook;Cho, Hyun-Young;Lee, Binna
    • Korean Journal of Health Education and Promotion
    • /
    • v.31 no.4
    • /
    • pp.93-106
    • /
    • 2014
  • Objectives: The aim of this study was to develop the efficient program protecting shift to cerebrovascular disease as complication for patients with diabetes and hypertension. Methods: Chronic disease self management program(CDSMP), implement manual, action plan, Q&A card and motivation methods were suggested based on Bandura's social learning theory through reviewing various literatures and cases. Results: This program can increase self-efficacy, individual health behavior change and quality of life and it makes to continuous care of chronic disease. Conclusion: In order to operate chronic disease self-management program, standardized education courses training of specialist leaders and expert patients leaders would be required. And the development enlargement of self-management program for various other chronic disease such as arthritis, back pain, atopy, asthma would be required in the future.

Optimal Learning Control Combined with Quality Inferential Control for Batch and Semi-batch Processes

  • Chin, In-Sik;Lee, Kwang-Soon;Park, Jinhoon;Lee, Jay H.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1999.10a
    • /
    • pp.57-60
    • /
    • 1999
  • An optimal control technique designed for simultaneous tracking and quality control for batch processes. The proposed technique is designed by transforming quadratic-criterion based iterative learning control(Q-ILC) into linear quadratic control problem. For real-time quality inferential control, the quality is modeled by linear combination of control input around target qualify and then the relationship between quality and control input can be transformed into time-varying linear state space model. With this state space model, the real-time quality inferential control can be incorporated to LQ control Problem. As a consequence, both the quality variable as well as other controlled variables can progressively reduce their control error as the batch number increases while rejecting real-time disturbances, and finally reach the best achievable states dictated by a quadratic criterion even in case that there is significant model error Also the computational burden is much reduced since the most computation is calculated in off-line. The Proposed control technique is applied to a semi-batch reactor model where series-parallelreactions take place.

  • PDF

Reinforcement learning packet scheduling using UCB (UCB를 이용한 강화학습 패킷 스케줄링)

  • Kim, Dong-Hyun;Kim, Min-Woo;Lee, Byung-Jun;Kim, Kyung-Tae;Youn, Hee-Yong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2019.01a
    • /
    • pp.45-46
    • /
    • 2019
  • 본 논문에서는 Upper Confidence Bound (UCB)를 이용한 효율적인 패킷 스케줄링 기법을 제안한다. 기존 e-greedy 등 강화학습의 보상을 극대화 할 수 있는 행동을 선택하는 것과 다르게, 제안된 UCB를 이용한 강화학습 패킷 스케줄링 기법은 각 상태에서 행동을 선택한 횟수를 추가적으로 고려한다. 이는 보다 효율적인 강화학습의 탐구(Exploration)를 가능케 한다. 본 논문에서는 컴퓨터 시뮬레이션을 통하여 제안하는 UCB를 이용한 강화학습 패킷 스케줄링 기법이 기존의 e-greedy 및 softmax를 기반으로 한 패킷 스케줄링 기법에 비해 정확도 측면에서 향상된 정확도를 보인다.

  • PDF

Students' Online Fashion Studio Class Experience and Factors Affecting Their Class Satisfaction

  • Lee, Jungmin;Lee, MiYoung
    • Journal of Fashion Business
    • /
    • v.24 no.6
    • /
    • pp.135-147
    • /
    • 2020
  • This study explored students' online fashion studio class experiences, and investigated the factors affecting their class satisfaction. An online survey of college students who were enrolled in online studio classes within apparel and fashion-related departments during the spring of 2020 was conducted in June 2020. Responses from a total of 213 participants were included in the final data. Respondents rated lecture clips as the most useful, followed by teacher demonstration and feedback, PowerPoint (PPT) supplements, and Q&As. Frequently mentioned areas of improvement were online platform stability and video quality. Many respondents also stated that more streamlined teacher-student communication channels, immediate and meticulous teacher feedback, the adoption of course contents developed specifically for an online environment, and provisions for equipment usage would be desirable. Student satisfaction of an online fashion design studio class was significantly affected by teaching presence, social presence, online learning system stability, perceived usefulness of teacher's demonstration, and affective response toward COVID-19. Students satisfaction of an online garment construction studio class was significantly affected by teaching and social presence, online learning system stability, and perceived usefulness of teacher's demonstration. Based on these findings, we recommend developing teaching contents and methods that allow students to feel included in class and establish an online system with various functions to enhance the sense of social connection that can enable two-way communication.

A Learning-based Power Control Scheme for Edge-based eHealth IoT Systems

  • Su, Haoru;Yuan, Xiaoming;Tang, Yujie;Tian, Rui;Sun, Enchang;Yan, Hairong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.12
    • /
    • pp.4385-4399
    • /
    • 2021
  • The Internet of Things (IoT) eHealth systems composed by Wireless Body Area Network (WBAN) has emerged recently. Sensor nodes are placed around or in the human body to collect physiological data. WBAN has many different applications, for instance health monitoring. Since the limitation of the size of the battery, besides speed, reliability, and accuracy; design of WBAN protocols should consider the energy efficiency and time delay. To solve these problems, this paper adopt the end-edge-cloud orchestrated network architecture and propose a transmission based on reinforcement algorithm. The priority of sensing data is classified according to certain application. System utility function is modeled according to the channel factors, the energy utility, and successful transmission conditions. The optimization problem is mapped to Q-learning model. Following this online power control protocol, the energy level of both the senor to coordinator, and coordinator to edge server can be modified according to the current channel condition. The network performance is evaluated by simulation. The results show that the proposed power control protocol has higher system energy efficiency, delivery ratio, and throughput.

The Design and Development of Online Learning Community for Teenagers (10대 학생들을 위한 온라인 학습 커뮤니티 설계 및 개발)

  • Jo, Mi-Heon
    • Journal of The Korean Association of Information Education
    • /
    • v.11 no.1
    • /
    • pp.79-89
    • /
    • 2007
  • Considering the continuous increase of teenagers' Internet use and the high rate of their participation in online communities, educators need to devote efforts to minimize the negative function of teenagers' Internet use and to guide them to experience positive aspects of Internet. Through activities in online communities, teenagers can experience various socialities and explore their self-consciousness. However, on the other hand many communities do not provide teenagers with considerate care. This may cause conflict in their sense of value and mislead them. Through this study, online learning community is designed and developed, which can reflect teenagers' various needs and connect their needs with learning experiences. The community consists of the following categories: 'about e-Tivity'(community vision, general information, list of activities, Q&A), 'activity space for teens'(event hall, data park, e-Tivity center), 'administrative space for teachers and managers'(research room, management room), and 'teen's private space'(my room, my avatar).

  • PDF

The Development and Effect Analysis of an Internet Based Nursing Program: Application to Nursing Informatics (인터넷을 이용한 간호학 교육 프로그램 개발 및 효과분석 -간호정보학을 중심으로-)

  • Yom, Young-Hee
    • Journal of Korean Academy of Nursing
    • /
    • v.30 no.4
    • /
    • pp.1035-1044
    • /
    • 2000
  • The purpose of this study was to develop and evaluate an internet based program for nursing informatics. The course subject, Nursing Informatics, was made by a computerized instructional module using the internet. The program was developed after taking into consideration the level of competence and knowledge in the subjects. It was based on 10 steps of the CAI module developed by Alessi and Trollip. The subjects consisted of 76 junior nursing students taking a Nursing Informatics course. Two sets of questionnaires were used for this study. First, a questionnaire was administered to 76 students to collect general information on their experience while using computers and the internet. Secondly, another questionnaire was administrated to 76 students after they took the course. They were asked to evaluate the program in terms of easiness of use, precision of contents, freshness of contents, motivation in learning, effectiveness of learning, enhancement of communication, precision of screen, and interest in the contents. IDs and passwords were given to the students. The students were asked to write their IDs and passwords when they connected to Nursing Informatics (http://hallym.ac.kr/~yhyom/ inform.html). They were led the menu page which was categorized into 8 icons (i. e., syllabus, lecture notes, quick test, Q & A board, assignment, on-line test, related web sites and mailing lists) after confirming their IDs and passwords. The students' responses were very positive. This program was a very useful in increasing the effectiveness of learning and motivation in the students. Suggest to be use for other nursing courses.

  • PDF

Advanced Control Techniques for Batch Processes Based on Iterative Learning Control Methods (반복학습제어를 기반으로 한 회분공정의 고급제어기법)

  • Lee, Kwang Soon
    • Korean Chemical Engineering Research
    • /
    • v.44 no.5
    • /
    • pp.425-434
    • /
    • 2006
  • The operability and productivity of continuous processes, especially in petrochemical industries have made remarkable improvement during the past twenty years through advanced process control (APC) typified by model-based predictive control. On the other hand, APC have not been actively practiced in industrial batch processes typified by batch polymerization reactors. Perhaps the main cause for this has been the lack of reliable batch process APC techniques that can overcome the unique problems in industrial batch processes. Recently, some noteworthy progress is being made in this area. New high-performance batch process control techniques that can accommodate and also overcome the unique problems of industrial batch processes have been proposed on the basis of iterative learning control (ILC). In this review paper, recent advancement in the batch process APC techniques are presented, with a particular focus on the variations of the so called Q-ILC method, with the hope that they are widely practiced in different industrial batch processes and enhance their operations.

Development of an Item Based Learning System Using E-mail (전자우편을 활용한 문항 기반 학습 시스템 개발)

  • Choi, Yong S.;Kim, Phil-Sun
    • The Journal of Korean Association of Computer Education
    • /
    • v.6 no.4
    • /
    • pp.85-93
    • /
    • 2003
  • This paper proposes an item based learning system using e-mail in order to motivate learners effectively and avoid the bottleneck problem under highly competitive access situations such as the traditional web based learning. The proposed system has th ree features as follows: first, through e-mail, a learner receives test items depending on his/her level, submit an answer sheet, and then identify an assessment with help messages. Secondly, on the web, an instructor easily constructs item database without any other tools and monitors the status of each learner by identifying the learners' record. Finally, an easy-to-use interaction mechanism enhances the inter-activity between learners and instructors, and the usability of Q&A(Question and Answer) service by incorporating e-mail into the web bulletin board.

  • PDF