Journal of the Korean Operations Research and Management Science Society (한국경영과학회지)

The Korean Operations Research and Management Science Society (한국경영과학회)
권호 표지

An Empirical Data Driven Optimization Approach By Simulating Human Learning Processes

인간의 학습과정 시뮬레이션에 의한 경험적 데이터를 이용한 최적화 방법

  • Published : 2004.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

This study suggests a data driven optimization approach, which simulates the models of human learning processes from cognitive sciences. It shows how the human learning processes can be simulated and applied to solving combinatorial optimization problems. The main advantage of using this method is in applying it into problems, which are very difficult to simulate. 'Undecidable' problems are considered as best possible application areas for this suggested approach. The concept of an 'undecidable' problem is redefined. The learning models in human learning and decision-making related to combinatorial optimization in cognitive and neural sciences are designed, simulated, and implemented to solve an optimization problem. We call this approach 'SLO : simulated learning for optimization.' Two different versions of SLO have been designed: SLO with position & link matrix, and SLO with decomposition algorithm. The methods are tested for traveling salespersons problems to show how these approaches derive new solution empirically. The tests show that simulated learning for optimization produces new solutions with better performance empirically. Its performance, compared to other hill-climbing type methods, is relatively good.

Keywords

References

  1. Aytug, H., S. Bhattacharyya, G.J, Koehler and J.L. Snowdon, 'A Review of Machine Learning in Scheduling,' IEEE Transaction on Engineering Management, Vol.41, No.2(1994), pp. 165-171 https://doi.org/10.1109/17.293383
  2. Baker, K R., Elements of Sequencing and Scheduling, 1995
  3. Biegel, J.E. and J.J. Davern, 'Genetic Algorithms and Job Shop Scheduling,' Computers and Interstrial Engineering, Vol.19(1990), pp. 81-91
  4. Bower, G.H, 'Organized Memory,' In Morris P.E. and M.A Conway, The Psychology of Memory, Vol.I(1993)
  5. Colorni, C.N., The Structure of Human Memory, W. H Freeman Company, San Francisco, California, 1975
  6. Colomi, A, M. Dorigo, F. Maffioli, V. Mani, G. Righini and M. Trubian, ' Heuristics from Nature for Hard Combinatorial Problems,' International Transactions in Operational Research, Vol.3, No.1(1996), pp.1-21 https://doi.org/10.1111/j.1475-3995.1996.tb00032.x
  7. De Robotis, E., 'The Synaptosome, Tow Decades of Cell Fractionation of the Brain,' International Brain Research Organization Monograph Series, Neural Transmission, Learning, and Memory, Vol.10(1983)
  8. Deese, J., 'On the Structure of Associative Meaning,' Psychological Review, Vol.69, No.3 (1962), pp.161-175 https://doi.org/10.1037/h0045842
  9. Dietterich, T.G. and R.S. Michalski, 'Learning to Predict Sequences,' In Michalski, R.S., J.G. Carbonell and T.M Mitchell, Machine Learning Vol.II, Morgan Kaufmann, Los Altos, California(1986), pp.63-100
  10. Dong, Z., Artificial Intelligence in Optimal Design and Manufacturing, Prentice Hall (1994), pp.153-170
  11. Eysenck, M, W., Human Memory : Theory Research and Individual Differences, Pergamon Press, Elmsford, New York, 1977
  12. Glover, F. and M Laguna, 'Target Analysis to Improve a Tabu Search Method for Machine Scheduling,' Advanced Knowledge Research Group, US West Advanced Technologies, Boulder, Co., 1989
  13. Glover, F., 'Tabu Search', Modem Heuristic Techniques for Combinatorial Problems, Colin R. Reeves (Ed), Blackwell Scientific Publications, Oxford(1993), pp.70-150
  14. Goldberg, D.E., Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley, 1988
  15. Hintzrnan, D.L., 'Schema Abstraction in a Multiple-Trace Memory Model,' Psychological Review, Vol.93, No.4(1986), pp.411-428 https://doi.org/10.1037/0033-295X.93.4.411
  16. Holland, J.H., Adaptation in Natural and Artificial Systems, University of Michigan Press, 1975
  17. Holland, J.J. and D.W. Tank, 'Neural Computation of Decision in Optimization Problems,' Biological Cybernetics, Vol.52(1985), pp.141-152
  18. Jones, D.J., Computability and Complexity From a Programming Perspective, Massa chusetts Institute of Technology(1997), pp.5-245
  19. Kempf, K., 'Practical Applications of Artificial Intelligence in Manufacturing,' Artificial Intelligence in Manufacturing, Assembly and Robotics, R. Oldenbourg Verlag Munchen Wien(1988), pp.1-27.
  20. Kinnear, KE., Advances in Genetic Programming, MlT Press, 1994
  21. Kirkpatrick, S., CD. Gelatt and M.P. Vecchi, 'Optimization by Simulated Annealing,' Science 220(1983), pp.671-680
  22. Klatzky, R.L., Human Memory: Structures and Processes, W.H. Freeman and Company, San Francisco, California, 1975
  23. Klimesch， W., The structure of Long-Term Memory, A Connectivity Model of Semantic Processing, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1994
  24. Lo, Z. and B. Bavarian, 'Scheduling with Neural Networks for Flexible Manufacturing Systems,' Proceedings of 1991 IEEE International Conference on Robotics and Automation, Sacramento, California(1991), pp.818-823
  25. Loftus, G.R. and E.F. Loftus, Human Memory The Processing of Information, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1976
  26. Lowerre, B.T., The Harpy Speech Recognition System, Ph.D. Thesis, Caregie Mellon University, Pittsburgh, PA, 1976
  27. Mackenzie, A. and U. Sydney, 'Undecidability : The History and Time of the Universal Turing Machine,' Configurations(1997), pp 359-379
  28. Malek，M., S. Guruswamy, M. Pandya and H. Owens, 'Serial and Parallel Simulated Annealing and Tabu Search Algorithms for the Traveling Salesman Problem,' Annals of Operations Research, 21(1989), pp.59-84
  29. Matsuo, H., C.J. Suh and R.S. Sullivan, 'A controlled search simulated annealing method for the single machine weighted tardiness problem,' Annals of Operations Research 21(1989), pp.85-108
  30. McKay, N.N., F.R. Safayeni and J.A. Buzacott, 'Job-Shop Scheduling Theory : What Is Relevant?' Interfaces 18 : 4(July-August 1999), pp.84-89
  31. Montgomery, D.C., Design and Analysis of Experiments, John Wiley & sons(1976), pp. 341-367
  32. Norman, D.A. and D.G. Boblow, 'On the Role of Active Memory Processes in Perception and Cognition,' The Structure of Human Memory, W.H. Freeman and Company, San Francisco, California (1975), pp.115-132
  33. Ovarcik, I.M. and R. Uzsoy, Decomposition Methods for Complex Factory Scheduling Problems, Kluwer Academic Publisher, 1997
  34. Papadimitriou, C.H. and K Steiglitz, Combinatorial Optimization : Algorithms and Complexity, Prentice-Hall，Englewood Cliffs(1982), pp.157
  35. Pinedo, M., Scheduling: Theory, Algorithms, and Systems, Prentice Hall, New Jersey, 1996
  36. Piramuthu, S., N. Raman, M.J. Shaw and S. C. Park, 'Integration of Simulation Modeling and Inductive Learning in an Adaptive Decision Support System,' Decision Support Systems, Vol.9, No.1(1993), pp.127-142 https://doi.org/10.1016/0167-9236(93)90027-Z
  37. Rose, S., 'Transient and Lasting Biochemical Response to Visual Deprivation and Experience in the Rat Visual Cortex,' International Brain Research Organization, Monograph Series, Vol.10, Neural Transmission, Learning, and Memory, 1983
  38. Schmitt, F.O., 'Molecular Neurobiology in the Context of the Neuroscience,' in the Context of the Neuroscience,' In Quarton G.C., .Melnechuk T. and Schmitte F.O., The Neurosciences, 1991
  39. Shaw, Mj., S.C. Park, N. Raman, 'Intelligent Scheduling with Machine Learning Capabilities : The Induction of Scheduling Knowledge,' IIE Transactions, Vol.24, No.2 (1992), pp.156-168 https://doi.org/10.1080/07408179208964213
  40. Simon, H.A and K Kotovsky, 'Human Acquisition of Concepts for Sequential Patterns,' Psychological Review, Vol.70, No.6(1963), pp. 534-546 https://doi.org/10.1037/h0043901
  41. Turner, E.H., 'A Schema-based Approach to Cooperative Problem Solving with Autnnomous Underwater Vehicles,' Technical Report, Department of Computer Science，University of New Hampshire, 1994
  42. Tookey, K.R., Arithmetic Schema and Strategy Instruction, Ph.D. Dissertation, University of Wisconsin at Madison, 1994
  43. Turing, A, 'On Computable Numbers, with an Application to the Entscheidungs-problems, 'Preceedings of the London Mathematical Society (2), 42(1936), pp.230-265