Finite Alphabet Control and Estimation

  • Goodwin, Graham C. (School of Electrical Engineering and Computing Science, The University of Newcastle) ;
  • Quevedo, Daniel E. (School of Electrical Engineering and Computing Science, The University of Newcastle)
  • Published : 2003.12.01

Abstract

In many practical problems in signal processing and control, the signal values are often restricted to belong to a finite number of levels. These questions are generally referred to as "finite alphabet" problems. There are many applications of this class of problems including: on-off control, optimal audio quantization, design of finite impulse response filters having quantized coefficients, equalization of digital communication channels subject to intersymbol interference, and control over networked communication channels. This paper will explain how this diverse class of problems can be formulated as optimization problems having finite alphabet constraints. Methods for solving these problems will be described and it will be shown that a semi-closed form solution exists. Special cases of the result include well known practical algorithms such as optimal noise shaping quantizers in audio signal processing and decision feedback equalizers in digital communication. Associated stability questions will also be addressed and several real world applications will be presented.

Keywords

References

  1. B. Electr. Eng. Thesis, The Univ. of Newcatle Optimisation of George Schroder pumping station M. Lane
  2. Power Electronics M. H. Rashid
  3. IEEE Trans. Ind. Electron. v.49 Multilevel inverters: A survey of topologies, controls, and applications J. Rodriquez;J.-S. Lai;F. Z. Peng https://doi.org/10.1109/TIE.2002.801052
  4. Proc. IEEE v.89 Large static converters for industry and utility operations H. Akaki https://doi.org/10.1109/5.931498
  5. J. Audio Eng. Soc. v.40 Psycho-acoustically optimal noise shaping R. A. Wannamaker
  6. J. Audio Eng. Soc. v.39 Minimally audible noise shaping S. P. Lipschitz;J. Vanderkooy;R. A. Wannamaker
  7. Optimal noise shaping and dither of digital signals M. Gerzon;P. G. Craven
  8. Collected Papers on Digital Audio Bit-Rate Reduction N. Gilchrist;C. Grewin(eds.)
  9. IEEE Spectr. v.40 Digital audio’s final frontier B. Putzeys
  10. IEEE Trans. Circuits Syst. v.30 Discrete coefficient FIR digital filter design based upon an LMS criteria Y. C. Lim;S. R. Parker https://doi.org/10.1109/TCS.1983.1085295
  11. Digital Communications J. G. Proakis
  12. IEEE Trans. Inform. Theory v.18 no.3 Maximum likelihood sequence estimation of digital sequences in the presence of intersymbol interference G. Forney https://doi.org/10.1109/TIT.1972.1054829
  13. The Bell Syst. Tech. J. v.52 A geometric theory of intersymbol interference D. G. Messerschmitt https://doi.org/10.1002/j.1538-7305.1973.tb02030.x
  14. IEEE Trans. Inform. Theory v.35 Maximum likelihood sequence estimators: A geometric view L. C. Barbosa https://doi.org/10.1109/18.32136
  15. IEEE Control Syst. Mag. v.21 Special section on networks and control L. Bushnell (Guest Editor) https://doi.org/10.1109/37.898792
  16. Limited Data Rate in Control Systems with Networks H. Ishii;B. A. Francis
  17. IEEE Control Syst. Mag. v.21 Performance evaluation of control networks F. L. Lian;J. R. Moyne;D. M. Tilbury
  18. Automatica v.39 Networked control design for linear systems P. V. Zhivoglyadov;R. H. Middleton https://doi.org/10.1016/S0005-1098(02)00306-0
  19. Syst. & Contr. Lett. v.37 no.4 Limited communication control D. Hristu;K. Morgansen https://doi.org/10.1016/S0167-6911(99)00020-1
  20. Proc. IEEE Conf. Decis. Contr. Minimizing down-link traffic in networked control systems via optimal control techniques D. E. Quevedo;G. C. Goodwin;J. S. Welsh
  21. Tech. Rep. EE03023, School of Elect. Eng. and Comput. Sci., The Univ. of Newcastle A moving horizon optimization approach to networked control system design G. C. Goodwin;D. E. Quevedo;H. Haimovich;J. Welsh
  22. Switching Power Supply Design A. I. Pressman
  23. Switchmode Power Supply Handbook K. Billings
  24. Power Supplies, Part B: Switchedmode Power Supplies. O. Ferenczi;Power Supplies
  25. Proc. INTELEC’88 Reducing EMI in switch mode power supplies D. F. Knurek
  26. J. Electric. Electron. Eng. Australia v.16 no.3/4 A review of EMI problems in switch mode power supply design M. K. W. Wu;C. K. Tse
  27. Power Electronics Technology and Applications II Power electronics and electromagnetic compatibility R. Redl;F. C. Lee(ed.)
  28. Proc. IEEE Africon Some origins and mitigation of conducted common mode EMI in switching converters T. Broom;I. W. Hofsajer
  29. IEE Proc..Electr. Power Appl. v.150 Reduction in conducted EMI noises of a switching power supply after thermal management design J. B. Wang https://doi.org/10.1049/ip-epa:20030194
  30. IEEE Trans. Power Electron. v.8 Programmed pulsewidth modulated waveforms for electromagnetic interference mitigation in DC-DC converters A. C. Wang;S. R. Sanders https://doi.org/10.1109/63.261032
  31. IEEE Trans. Power Electron. v.9 Reduction of power supply EMI emission by switching frequency modulation F. Lin;D. Y. Chen https://doi.org/10.1109/63.285504
  32. IEEE Trans. Power Electron. v.10 Analysis and synthesis of randomized modulation schemes for power converters A. M. Stankovic;G. C. Verghese;D. J. Perreault https://doi.org/10.1109/63.471288
  33. IEEE Trans. Power Electron. v.15 Analysis and spectral characteristics of a spread-spectrum technique for conducted EMI suppression K. K. Tse;H. S.-H. Chung;S. Y. Hui;H. C. So https://doi.org/10.1109/63.838113
  34. IEEE Trans. Ind. Electtron. v.48 Use of Sigma.Delta modulation to control EMI from switch-mode power supplies L. Paramesh;A. von Jouanne https://doi.org/10.1109/41.904570
  35. IEEE Trans. Power Electron. v.13 A comparision of nondeterministic and deterministic switching methods for DC-DC power converters S. Y. Hui;Y. Shrivastava;S. Sathiakumar;K. K. Tse;H. S.-H. Chung https://doi.org/10.1109/63.728332
  36. IEEE Trans. Power Electron. v.13 Improved spectral performance of random PWM schemes with weighted switching decision Y. Shrivastava;S. Sathiakumar;S. Y. Hui https://doi.org/10.1109/63.728331
  37. Delta.Sigma Data Converters: Theory, Design and Simulation S. R. Norsworthy;R. Schreier;G. C. Temes(eds.)
  38. Tech. Rep. EE03036, School of Elect. Eng. and Comput. Sci., The Univ. of Newcastle Control of EMI from switch-mode power supplies via multi-step optimization D. E. Quevedo;G. C. Goodwin
  39. J. Acoust. Soc. Am. v.5 Loudness, its definition, measurement, and calculation H. Fletscher;W. A. Munson https://doi.org/10.1121/1.1915637
  40. J. Audio Eng. Soc. v.51 Moving-horizon optimal quantizer for audio signals G. C. Goodwin;D. E. Quevedo;D. McGrath
  41. Proc. Amer. Contr. Conf. Audio quantization from a receding horizon control perspective D. E. Quevedo;G. C. Goodwin
  42. Tech. Rep. EE03027, School of Elect. Eng. and Comput. Sci., The Univ. of Newcastle Moving horizon design of discrete coefficient FIR filters D. E. Quevedo;G. C. Goodwin
  43. Tech. Rep. EE03013, School of Elect. Eng. and Comput. Sci., The Univ. of Newcastle A multi-step detector for linear ISI-channels incorporating degrees of belief in past estimates D. E. Quevedo;G. C. Goodwin;J. A. De Dona
  44. Int. J. Robust Nonlin. Contr. v.13 Finite constraint set receding horizon contro D. E. Quevedo;G. C. Goodwin;J. A. De Dona
  45. Master’s thesis, Dep. of Systems, Signals and Sensors (S3), Royal Inst. Techn. (KTH) Bandwidth and quantization constraints in feedback control K. Kiihtelys
  46. Proc. IEEE Conf. Decis. Contr. Stabilization of motor networks R. W. Brockett
  47. Tech. Rep. EE03032, School of Elect. Eng. and Comput. Sci., The Univ. of Newscatle Multi-step optimal analog-to-digital conversion D. E. Quevedo;G. C. Goodwin
  48. Vector Quantization and Signal Compression A. Gersho;R. M. Gray
  49. IEEE Trans. Automat. Contr. v.45 no.10 Observability and controllability of piecewise affine and hybrid systems A. Bemporad;G. Ferrari-Trecate;M. Morari https://doi.org/10.1109/TAC.2000.880987
  50. Automatica v.37 no.7 Equivalence of hybrid dynamical models W. P. M. H. Heemels;B. De Schutter;A. Bemporad https://doi.org/10.1016/S0005-1098(01)00059-0
  51. IEEE Trans. Circuits Syst. v.35 no.6 Chaos in digital filters L. O. Chua;T. Lin https://doi.org/10.1109/31.1802
  52. Int. J. Circuit Theory Appl. v.25 A tutorial introduction to non-linear dynamics and chaos and their application to Sigma-Delta modulators O. Feely https://doi.org/10.1002/(SICI)1097-007X(199709/10)25:5<347::AID-CTA978>3.0.CO;2-R
  53. Ergod. Th. & Dynam. Sys. v.21 Dynamics of non-ergodic piecewise affine maps of the torus R. Adler;B. Kitchens;C. Tresser
  54. IEEE Trans. Circuits Syst. Ⅱ v.41 Symbolic dynamics of piecewise-linear maps C. W. Wu;L. O. Chua https://doi.org/10.1109/82.300203
  55. IEEE Trans. Automat. Contr. v.35 On the periodicity of symbolic observations of piecewise smooth discrete-time systems P. J. Ramadge https://doi.org/10.1109/9.57019
  56. Automatica v.36 no.6 Constrained model predictive control: Optimality and stability D. Q. Mayne;J. B. Rawlings;C. V. Rao;P. O. M. Scokaert https://doi.org/10.1016/S0005-1098(99)00214-9
  57. Automatica v.35 Set invariance in control F. Blanchini https://doi.org/10.1016/S0005-1098(99)00113-2
  58. IMA J. Mathem. Contr. & Inform. v.16 Lyapunov stability of discontinuous dynamic systems Z. Li;C. B. Soh https://doi.org/10.1093/imamci/16.3.261
  59. Adaptive Filtering Prediction and Control G. C. Goodwin;K. S. Sin
  60. third Convention of the AES Super bit mapping: Psychoacoustically optimized digital recording M. Akune;R. M. Heddle;K. Akagiri
  61. IEEE Trans. Acoust., Speech, Signal Processing v.38 FIR filters with sigma-delta modulation encoding P. W. Wong;R. M. Gray https://doi.org/10.1109/29.56058
  62. IEEE Trans. Circuits Syst. II v.41 Efficient narrowband FIR and IFIR filters based on powers-of-two sigma-delta coefficient truncation S. R. Powell;P. M. Chau https://doi.org/10.1109/82.318938
  63. Electron. Lett. v.34 Higher order ${\Sigma} - {\Delta}$ modulation encoding for design of multiplierless FIR filters C. L. Chen;A. N. Willson https://doi.org/10.1049/el:19981617
  64. IEEE Trans. Acoust., Speech, Signal Processing v.37 Design of linear-phase directform FIR digital filters with quantized coefficients using error spectrum shaping J. J. Nielsen https://doi.org/10.1109/29.32280
  65. IEEE Trans. Commun. v.40 no.2 Block decision feedback equalization D. Williamson;R. A. Kennedy;G. W. Pulford https://doi.org/10.1109/26.129188
  66. IEE Proceedings v.129 no.2 Developments of the conventional nonlinear equaliser A. P. Clark;L. H. Lee;R. S. Marshall
  67. Constrained Control & Estimation - An Optimization Perspective J. A. De Dona;G. C. Goodwin;M. M. Seron
  68. European J. Contr. v.9 Semidefinite programming relaxations and algebraic optimization in control P. A. Parrilo;S. Lall https://doi.org/10.3166/ejc.9.307-321