Browse > Article

An Empirical Data Driven Optimization Approach By Simulating Human Learning Processes  

Kim Jinhwa (서강대학교 경영학과)
Publication Information
Journal of the Korean Operations Research and Management Science Society / v.29, no.4, 2004 , pp. 117-134 More about this Journal
Abstract
This study suggests a data driven optimization approach, which simulates the models of human learning processes from cognitive sciences. It shows how the human learning processes can be simulated and applied to solving combinatorial optimization problems. The main advantage of using this method is in applying it into problems, which are very difficult to simulate. 'Undecidable' problems are considered as best possible application areas for this suggested approach. The concept of an 'undecidable' problem is redefined. The learning models in human learning and decision-making related to combinatorial optimization in cognitive and neural sciences are designed, simulated, and implemented to solve an optimization problem. We call this approach 'SLO : simulated learning for optimization.' Two different versions of SLO have been designed: SLO with position & link matrix, and SLO with decomposition algorithm. The methods are tested for traveling salespersons problems to show how these approaches derive new solution empirically. The tests show that simulated learning for optimization produces new solutions with better performance empirically. Its performance, compared to other hill-climbing type methods, is relatively good.
Keywords
Undecidable Problems; Human Learning; Cognitive Science; Simulated Learning for Optimization; Combinatorial Optimization; TSP;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tookey, K.R., Arithmetic Schema and Strategy Instruction, Ph.D. Dissertation, University of Wisconsin at Madison, 1994
2 Bower, G.H, 'Organized Memory,' In Morris P.E. and M.A Conway, The Psychology of Memory, Vol.I(1993)
3 Holland, J.H., Adaptation in Natural and Artificial Systems, University of Michigan Press, 1975
4 Holland, J.J. and D.W. Tank, 'Neural Computation of Decision in Optimization Problems,' Biological Cybernetics, Vol.52(1985), pp.141-152
5 Jones, D.J., Computability and Complexity From a Programming Perspective, Massa chusetts Institute of Technology(1997), pp.5-245
6 Kempf, K., 'Practical Applications of Artificial Intelligence in Manufacturing,' Artificial Intelligence in Manufacturing, Assembly and Robotics, R. Oldenbourg Verlag Munchen Wien(1988), pp.1-27.
7 Klatzky, R.L., Human Memory: Structures and Processes, W.H. Freeman and Company, San Francisco, California, 1975
8 Simon, H.A and K Kotovsky, 'Human Acquisition of Concepts for Sequential Patterns,' Psychological Review, Vol.70, No.6(1963), pp. 534-546   DOI   ScienceOn
9 Kinnear, KE., Advances in Genetic Programming, MlT Press, 1994
10 Lo, Z. and B. Bavarian, 'Scheduling with Neural Networks for Flexible Manufacturing Systems,' Proceedings of 1991 IEEE International Conference on Robotics and Automation, Sacramento, California(1991), pp.818-823
11 Turing, A, 'On Computable Numbers, with an Application to the Entscheidungs-problems, 'Preceedings of the London Mathematical Society (2), 42(1936), pp.230-265
12 Lowerre, B.T., The Harpy Speech Recognition System, Ph.D. Thesis, Caregie Mellon University, Pittsburgh, PA, 1976
13 Montgomery, D.C., Design and Analysis of Experiments, John Wiley & sons(1976), pp. 341-367
14 Turner, E.H., 'A Schema-based Approach to Cooperative Problem Solving with Autnnomous Underwater Vehicles,' Technical Report, Department of Computer Science，University of New Hampshire, 1994
15 Papadimitriou, C.H. and K Steiglitz, Combinatorial Optimization : Algorithms and Complexity, Prentice-Hall，Englewood Cliffs(1982), pp.157
16 Pinedo, M., Scheduling: Theory, Algorithms, and Systems, Prentice Hall, New Jersey, 1996
17 De Robotis, E., 'The Synaptosome, Tow Decades of Cell Fractionation of the Brain,' International Brain Research Organization Monograph Series, Neural Transmission, Learning, and Memory, Vol.10(1983)
18 Piramuthu, S., N. Raman, M.J. Shaw and S. C. Park, 'Integration of Simulation Modeling and Inductive Learning in an Adaptive Decision Support System,' Decision Support Systems, Vol.9, No.1(1993), pp.127-142   DOI   ScienceOn
19 Dietterich, T.G. and R.S. Michalski, 'Learning to Predict Sequences,' In Michalski, R.S., J.G. Carbonell and T.M Mitchell, Machine Learning Vol.II, Morgan Kaufmann, Los Altos, California(1986), pp.63-100
20 Mackenzie, A. and U. Sydney, 'Undecidability : The History and Time of the Universal Turing Machine,' Configurations(1997), pp 359-379
21 Colomi, A, M. Dorigo, F. Maffioli, V. Mani, G. Righini and M. Trubian, ' Heuristics from Nature for Hard Combinatorial Problems,' International Transactions in Operational Research, Vol.3, No.1(1996), pp.1-21   DOI   ScienceOn
22 Eysenck, M, W., Human Memory : Theory Research and Individual Differences, Pergamon Press, Elmsford, New York, 1977
23 Norman, D.A. and D.G. Boblow, 'On the Role of Active Memory Processes in Perception and Cognition,' The Structure of Human Memory, W.H. Freeman and Company, San Francisco, California (1975), pp.115-132
24 Aytug, H., S. Bhattacharyya, G.J, Koehler and J.L. Snowdon, 'A Review of Machine Learning in Scheduling,' IEEE Transaction on Engineering Management, Vol.41, No.2(1994), pp. 165-171   DOI   ScienceOn
25 Loftus, G.R. and E.F. Loftus, Human Memory The Processing of Information, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1976
26 Glover, F. and M Laguna, 'Target Analysis to Improve a Tabu Search Method for Machine Scheduling,' Advanced Knowledge Research Group, US West Advanced Technologies, Boulder, Co., 1989
27 Biegel, J.E. and J.J. Davern, 'Genetic Algorithms and Job Shop Scheduling,' Computers and Interstrial Engineering, Vol.19(1990), pp. 81-91
28 Kirkpatrick, S., CD. Gelatt and M.P. Vecchi, 'Optimization by Simulated Annealing,' Science 220(1983), pp.671-680
29 Schmitt, F.O., 'Molecular Neurobiology in the Context of the Neuroscience,' in the Context of the Neuroscience,' In Quarton G.C., .Melnechuk T. and Schmitte F.O., The Neurosciences, 1991
30 Glover, F., 'Tabu Search', Modem Heuristic Techniques for Combinatorial Problems, Colin R. Reeves (Ed), Blackwell Scientific Publications, Oxford(1993), pp.70-150
31 Ovarcik, I.M. and R. Uzsoy, Decomposition Methods for Complex Factory Scheduling Problems, Kluwer Academic Publisher, 1997
32 Rose, S., 'Transient and Lasting Biochemical Response to Visual Deprivation and Experience in the Rat Visual Cortex,' International Brain Research Organization, Monograph Series, Vol.10, Neural Transmission, Learning, and Memory, 1983
33 Goldberg, D.E., Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley, 1988
34 McKay, N.N., F.R. Safayeni and J.A. Buzacott, 'Job-Shop Scheduling Theory : What Is Relevant?' Interfaces 18 : 4(July-August 1999), pp.84-89
35 Matsuo, H., C.J. Suh and R.S. Sullivan, 'A controlled search simulated annealing method for the single machine weighted tardiness problem,' Annals of Operations Research 21(1989), pp.85-108
36 Dong, Z., Artificial Intelligence in Optimal Design and Manufacturing, Prentice Hall (1994), pp.153-170
37 Baker, K R., Elements of Sequencing and Scheduling, 1995
38 Hintzrnan, D.L., 'Schema Abstraction in a Multiple-Trace Memory Model,' Psychological Review, Vol.93, No.4(1986), pp.411-428   DOI
39 Klimesch， W., The structure of Long-Term Memory, A Connectivity Model of Semantic Processing, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1994
40 Shaw, Mj., S.C. Park, N. Raman, 'Intelligent Scheduling with Machine Learning Capabilities : The Induction of Scheduling Knowledge,' IIE Transactions, Vol.24, No.2 (1992), pp.156-168   DOI   ScienceOn
41 Malek，M., S. Guruswamy, M. Pandya and H. Owens, 'Serial and Parallel Simulated Annealing and Tabu Search Algorithms for the Traveling Salesman Problem,' Annals of Operations Research, 21(1989), pp.59-84
42 Colorni, C.N., The Structure of Human Memory, W. H Freeman Company, San Francisco, California, 1975
43 Deese, J., 'On the Structure of Associative Meaning,' Psychological Review, Vol.69, No.3 (1962), pp.161-175   DOI   PUBMED   ScienceOn