• Title/Summary/Keyword: Dynamic Programming

Search Result 955, Processing Time 0.031 seconds

Direct Load Control Using Priority Based Dynamic Programming (우선순위기반 동적 프로그래밍을 이용한 직접부하제어)

  • Kim, Tae-Hyun;Lee, Seung-Youn;Shin, Myong-Chul;Cha, Jae-Sang;Suh, Hee-Seok;Kim, Jong-Boo;Choi, Sang-Yul
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.18 no.6
    • /
    • pp.78-83
    • /
    • 2004
  • Currently used DLC(Direct Load Control) algorithm is only focused on ON/OFF load control not concerning about reliving participated customer's inconvenience and load priority. Therefore, that is a major obstacle to attract customer participating in demand response program. To overcome the above defects, the authors represent direct load control algorithm using priority based dynamic programming. the proposed algorithm is that participant customer send E-mail to DLC center about priority of load before executing DLC, then DLC algorithm decide which load to be OFF by using priority and off time constraint of the load. By using dynamic programming based on the order of priority for DLC algorithm it is possible to maximize participating customer's satisfaction and it will help to attract more customer's participating in demand response program.

Exploring Efficient Solutions for the 0/1 Knapsack Problem

  • Dalal M. Althawadi;Sara Aldossary;Aryam Alnemari;Malak Alghamdi;Fatema Alqahtani;Atta-ur Rahman;Aghiad Bakry;Sghaier Chabani
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.2
    • /
    • pp.15-24
    • /
    • 2024
  • One of the most significant issues in combinatorial optimization is the classical NP-complete conundrum known as the 0/1 Knapsack Problem. This study delves deeply into the investigation of practical solutions, emphasizing two classic algorithmic paradigms, brute force, and dynamic programming, along with the metaheuristic and nature-inspired family algorithm known as the Genetic Algorithm (GA). The research begins with a thorough analysis of the dynamic programming technique, utilizing its ability to handle overlapping subproblems and an ideal substructure. We evaluate the benefits of dynamic programming in the context of the 0/1 Knapsack Problem by carefully dissecting its nuances in contrast to GA. Simultaneously, the study examines the brute force algorithm, a simple yet comprehensive method compared to Branch & Bound. This strategy entails investigating every potential combination, offering a starting point for comparison with more advanced techniques. The paper explores the computational complexity of the brute force approach, highlighting its limitations and usefulness in resolving the 0/1 Knapsack Problem in contrast to the set above of algorithms.

Control of pH Neutralization Process using Simulation Based Dynamic Programming in Simulation and Experiment (ICCAS 2004)

  • Kim, Dong-Kyu;Lee, Kwang-Soon;Yang, Dae-Ryook
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.620-626
    • /
    • 2004
  • For general nonlinear processes, it is difficult to control with a linear model-based control method and nonlinear controls are considered. Among the numerous approaches suggested, the most rigorous approach is to use dynamic optimization. Many general engineering problems like control, scheduling, planning etc. are expressed by functional optimization problem and most of them can be changed into dynamic programming (DP) problems. However the DP problems are used in just few cases because as the size of the problem grows, the dynamic programming approach is suffered from the burden of calculation which is called as 'curse of dimensionality'. In order to avoid this problem, the Neuro-Dynamic Programming (NDP) approach is proposed by Bertsekas and Tsitsiklis (1996). To get the solution of seriously nonlinear process control, the interest in NDP approach is enlarged and NDP algorithm is applied to diverse areas such as retailing, finance, inventory management, communication networks, etc. and it has been extended to chemical engineering parts. In the NDP approach, we select the optimal control input policy to minimize the value of cost which is calculated by the sum of current stage cost and future stages cost starting from the next state. The cost value is related with a weight square sum of error and input movement. During the calculation of optimal input policy, if the approximate cost function by using simulation data is utilized with Bellman iteration, the burden of calculation can be relieved and the curse of dimensionality problem of DP can be overcome. It is very important issue how to construct the cost-to-go function which has a good approximate performance. The neural network is one of the eager learning methods and it works as a global approximator to cost-to-go function. In this algorithm, the training of neural network is important and difficult part, and it gives significant effect on the performance of control. To avoid the difficulty in neural network training, the lazy learning method like k-nearest neighbor method can be exploited. The training is unnecessary for this method but requires more computation time and greater data storage. The pH neutralization process has long been taken as a representative benchmark problem of nonlin ar chemical process control due to its nonlinearity and time-varying nature. In this study, the NDP algorithm was applied to pH neutralization process. At first, the pH neutralization process control to use NDP algorithm was performed through simulations with various approximators. The global and local approximators are used for NDP calculation. After that, the verification of NDP in real system was made by pH neutralization experiment. The control results by NDP algorithm was compared with those by the PI controller which is traditionally used, in both simulations and experiments. From the comparison of results, the control by NDP algorithm showed faster and better control performance than PI controller. In addition to that, the control by NDP algorithm showed the good results when it applied to the cases with disturbances and multiple set point changes.

  • PDF

Resource Constrained Dynamic Multi-Projects Scheduling Based by Constraint Programming (Constraint Programming을 이용한 자원제약 동적 다중프로젝트 일정계획)

  • Lee, Hwa-Ki;Chung, Je-Won
    • IE interfaces
    • /
    • v.12 no.3
    • /
    • pp.362-373
    • /
    • 1999
  • Resource Constrained Dynamic Multi-Projects Scheduling (RCDMPS) is intended to schedule activities of two or more projects sequentially arriving at die shop under restricted resources. The aim of this paper is to develop a new problem solving method for RCDMPS to make an effect schedule based by constraint programming. The constraint-based scheduling method employs ILOG Solver which is C++ constraint reasoning library for solving complex resource management problems and ILOG Schedule which is a add-on library to ILOG Solver dedicated to solving scheduling problems. And this method interfaces with ILOG Views so that the result of scheduling displays with Gantt chart. The scheduling method suggested in this paper was applied to a company scheduling problem and compared with the other heuristic methods, and then it shows that the new scheduling system has more preference.

  • PDF

A Study on an Engine Control System using an Object Oriented Programming Method (객체지향 프로그래밍 기법을 이용한 엔진제어시스템에 관한 연구)

  • 윤팔주;이상준;선우명호
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.8 no.3
    • /
    • pp.98-109
    • /
    • 2000
  • A new PC-based Engine Control system (ECS) is developed using an object oriented programming method. This system provides more convenient environment for engine tests, easier user interface and extended functions. A Windows-based ECS software is developed with class, and the class structure is built on encapsulation and abstraction. The closed-loop engine control scheme can be easily constructed by using dynamic link library and multitasking. This means that a user can perform desired experiments without clear knowledge of the hardware structure of the ECS. Also this system allows a user to individually control the ignition and fuel injection for each cylinder in a simple manner such as through a keyboard/mouse or in a real-time operation from a closed-loop control program.

  • PDF

Collision Prediction based Genetic Network Programming-Reinforcement Learning for Mobile Robot Navigation in Unknown Dynamic Environments

  • Findi, Ahmed H.M.;Marhaban, Mohammad H.;Kamil, Raja;Hassan, Mohd Khair
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.2
    • /
    • pp.890-903
    • /
    • 2017
  • The problem of determining a smooth and collision-free path with maximum possible speed for a Mobile Robot (MR) which is chasing a moving target in a dynamic environment is addressed in this paper. Genetic Network Programming with Reinforcement Learning (GNP-RL) has several important features over other evolutionary algorithms such as it combines offline and online learning on the one hand, and it combines diversified and intensified search on the other hand, but it was used in solving the problem of MR navigation in static environment only. This paper presents GNP-RL based on predicting collision positions as a first attempt to apply it for MR navigation in dynamic environment. The combination between features of the proposed collision prediction and that of GNP-RL provides safe navigation (effective obstacle avoidance) in dynamic environment, smooth movement, and reducing the obstacle avoidance latency time. Simulation in dynamic environment is used to evaluate the performance of collision prediction based GNP-RL compared with that of two state-of-the art navigation approaches, namely, Q-Learning (QL) and Artificial Potential Field (APF). The simulation results show that the proposed GNP-RL outperforms both QL and APF in terms of smooth movement and safer navigation. In addition, it outperforms APF in terms of preserving maximum possible speed during obstacle avoidance.

CONTINUOUS PROGRAMMING CONTAINING SUPPORT FUNCTIONS

  • Husain, I.;Jabeen, Z.
    • Journal of applied mathematics & informatics
    • /
    • v.26 no.1_2
    • /
    • pp.75-106
    • /
    • 2008
  • In this paper, we derive necessary optimality conditions for a continuous programming problem in which both objective and constraint functions contain support functions and is, therefore, nondifferentiable. It is shown that under generalized invexity of functionals, Karush-Kuhn-Tucker type optimality conditions for the continuous programming problem are also sufficient. Using these optimality conditions, we construct dual problems of both Wolfe and Mond-Weir types and validate appropriate duality theorems under invexity and generalized invexity. A mixed type dual is also proposed and duality results are validated under generalized invexity. A special case which often occurs in mathematical programming is that in which the support function is the square root of a positive semidefinite quadratic form. Further, it is also pointed out that our results can be considered as dynamic generalizations of those of (static) nonlinear programming with support functions recently incorporated in the literature.

  • PDF

Hybrid Transient Stability Analysis Using Object-oriented method (객체지향기법을 적용한 하이브리드 과도안정도 해석)

  • Park, Ji-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2007.07a
    • /
    • pp.451-452
    • /
    • 2007
  • In this paper, we simulate power system transient stability using object-oriented programming(OOP). OOP is a more flexible method than procedual programming. There are several advantages in dynamic system simulation using OOP. We also calculate critical fault clearing time using energy functions for detailed models.

  • PDF

A Study on Efficient Vehicle Tracking System using Dynamic Programming Method (동적계획법을 이용한 효율적인 차량 추적 시스템에 관한 연구)

  • Kwon, Hee-Chul
    • Journal of Digital Convergence
    • /
    • v.13 no.12
    • /
    • pp.209-215
    • /
    • 2015
  • In the past, there have been many theory and algorithms for vehicle tracking. But the time complexity of many feature point matching methods for vehicle tracking are exponential. Also, object segmentation and detection algorithms presented for vehicle tracking are exhaustive and time consuming. Therefore, we present the fast and efficient two stages method that can efficiently track the many moving vehicles on the road. The first detects the vehicle plate regions and extracts the feature points of vehicle plates. The second associates the feature points between frames using dynamic programming.

Optimal LNG Procurement Policy in a Spot Market Using Dynamic Programming (동적 계획법을 이용한 LNG 현물시장에서의 포트폴리오 구성방법)

  • Ryu, Jong-Hyun
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.41 no.3
    • /
    • pp.259-266
    • /
    • 2015
  • Among many energy resources, natural gas has recently received a remarkable amount of attention, particularly from the electrical generation industry. This is in part due to increasing shale gas production, providing an environment-friendly fossil fuel, and high risk of nuclear power. Because South Korea, the world's second largest LNG importing nation after Japan, has no international natural gas pipelines and relies on imports in the form of LNG, the natural gas has been traditionally procured by long term LNG contracts at relatively high price. Thus, there is a need of developing an Asian LNG trading hub, where LNG can be traded at more competitive spot prices. In a natural gas spot market, the amount of natural gas to be bought should be carefully determined considering a limited storage capacity and future pricing dynamics. In this work, the problem to find the optimal amount of natural gas in a spot market is formulated as a Markov decision process (MDP) in risk neutral environment and the optimal base stock policy which depends on a stage and price is established. Taking into account price and demand uncertainties, the basestock target levels are simply approximated from dynamic programming. The simulation results show that the basestock policy can be one of effective ways for procurement of LNG in a spot market.