Cover image for Adaptive signal processing : next generation solutions
Title:
Adaptive signal processing : next generation solutions
Series:
Adaptive and learning systems for signal processing, communications, and control
Publication Information:
New York : IEEE, Institute of Electrical and Electronics Engineers ; [Hoboken, N.J.] : Wiley, 2010
Physical Description:
xv, 407 p. : ill. ; 24 cm.
ISBN:
9780470195178

Available:*

Library
Item Barcode
Call Number
Material Type
Item Category 1
Status
Searching...
30000010236595 TK5102.9 A33 2010 Open Access Book Book
Searching...

On Order

Summary

Summary

Leading experts present the latest research results in adaptive signal processing

Recent developments in signal processing have made it clear that significant performance gains can be achieved beyond those achievable using standard adaptive filtering approaches. Adaptive Signal Processing presents the next generation of algorithms that will produce these desired results, with an emphasis on important applications and theoretical advancements. This highly unique resource brings together leading authorities in the field writing on the key topics of significance, each at the cutting edge of its own area of specialty. It begins by addressing the problem of optimization in the complex domain, fully developing a framework that enables taking full advantage of the power of complex-valued processing. Then, the challenges of multichannel processing of complex-valued signals are explored. This comprehensive volume goes on to cover Turbo processing, tracking in the subspace domain, nonlinear sequential state estimation, and speech-bandwidth extension.

Examines the seven most important topics in adaptive filtering that will define the next-generation adaptive filtering solutions

Introduces the powerful adaptive signal processing methods developed within the last ten years to account for the characteristics of real-life data: non-Gaussianity, non-circularity, non-stationarity, and non-linearity

Features self-contained chapters, numerous examples to clarify concepts, and end-of-chapter problems to reinforce understanding of the material

Contains contributions from acknowledged leaders in the field

Adaptive Signal Processing is an invaluable tool for graduate students, researchers, and practitioners working in the areas of signal processing, communications, controls, radar, sonar, and biomedical engineering.


Author Notes

Tulay Adali, PhD, is Professor of Electrical Engineering and Director of the Machine Learning for Signal Processing Laboratory at the University of Maryland, Baltimore County. Her research interests are in statistical and adaptive signal processing, with emphasis on nonlinear and complex-valued signal processing, and applications in biomedical data analysis and communications.
Simon Haykin PhD, is Distinguished University Professor and Director of the Cognitive Systems Laboratory in the Faculty of Engineering at McMaster University. A world-renowned authority on adaptive and learning systems, Dr. Haykin has pioneered signal-processing techniques and systems for radar and communication applications, culminating in the study of cognitive dynamic systems, which has become his research passion.


Table of Contents

Prefacep. xi
Contributorsp. xv
Chapter 1 Complex-Valued Adaptive Signal Processingp. 1
1.1 Introductionp. 1
1.1.1 Why Complex-Valued Signal Processingp. 3
1.1.2 Outline of the Chapterp. 5
1.2 Preliminariesp. 6
1.2.1 Notationp. 6
1.2.2 Efficient Computation of Derivatives in the Complex Domainp. 9
1.2.3 Complex-to-Real and Complex-to-Complex Mappingsp. 17
1.2.4 Series Expansionsp. 20
1.2.5 Statistics of Complex-Valued Random Variables and Random Processesp. 24
1.3 Optimization in the Complex Domainp. 31
1.3.1 Basic Optimization Approaches in R Np. 31
1.3.2 Vector Optimization in C Np. 34
1.3.3 Matrix Optimization in C Np. 37
1.3.4 Newton-Variant Updatesp. 38
1.4 Widely Linear Adaptive Filteringp. 40
1.4.1 Linear and Widely Linear Mean-Square Error Filterp. 41
1.5 Nonlinear Adaptive Filtering with Multilayer Perceptronsp. 47
1.5.1 Choice of Activation Function for the MLP Filterp. 48
1.5.2 Derivation of Back-Propagation Updatesp. 55
1.6 Complex Independent Component Analysisp. 58
1.6.1 Complex Maximum Likelihoodp. 59
1.6.2 Complex Maximization of Non-Gaussianityp. 64
1.6.3 Mutual Information Minimization: Connections to ML and MNp. 66
1.6.4 Density Matchingp. 67
1.6.5 Numerical Examplesp. 71
1.7 Summaryp. 74
1.8 Acknowledgmentp. 76
1.9 Problemsp. 76
Referencesp. 79
Chapter 2 Robust Estimation Techniques for Complex-Valued Random Vectorsp. 87
2.1 Introductionp. 87
2.1.1 Signal Modelp. 88
2.1.2 Outline of the Chapterp. 90
2.2 Statistical Characterization of Complex Random Vectorsp. 91
2.2.1 Complex Random Variablesp. 91
2.2.2 Complex Random Vectorsp. 93
2.3 Complex Elliptically Symmetric (CES) Distributionsp. 95
2.3.1 Definitionp. 96
2.3.2 Circular Casep. 98
2.3.3 Testing the Circularity Assumptionp. 99
2.4 Tools to Compare Estimatorsp. 102
2.4.1 Robustness and Influence Functionp. 102
2.4.2 Asymptotic Performance of an Estimatorp. 106
2.5 Scatter and Pseudo-Scatter Matricesp. 107
2.5.1 Background and Motivationp. 107
2.5.2 Definitionp. 108
2.5.3 M-Estimators of Scatterp. 110
2.6 Array Processing Examplesp. 114
2.6.1 Beamformersp. 114
2.6.2 Subspace Methodsp. 115
2.6.3 Estimating the Number of Sourcesp. 118
2.6.4 Subspace DOA Estimation for Noncircular Sourcesp. 120
2.7 MVDR Beamformers Based on M-Estimatorsp. 121
2.7.1 The Influence Function Studyp. 123
2.8 Robust ICAp. 128
2.8.1 The Class of DOGMA Estimatorsp. 129
2.8.2 The Class of GUT Estimatorsp. 132
2.8.3 Communications Examplep. 134
2.9 Conclusionp. 137
2.10 Problemsp. 137
Referencesp. 138
Chapter 3 Turbo Equalizationp. 143
3.1 Introductionp. 143
3.2 Contextp. 144
3.3 Communication Chainp. 145
3.4 Turbo Decoder: Overviewp. 147
3.4.1 Basic Properties of Iterative Decodingp. 151
3.5 Forward-Backward Algorithmp. 152
3.5.1 With Intersymbol Interferencep. 160
3.6 Simplified Algorithm: Interference Cancelerp. 163
3.7 Capacity Analysisp. 168
3.8 Blind Turbo Equalizationp. 173
3.8.1 Differential Encodingp. 179
3.9 Convergencep. 182
3.9.1 Bit Error Probabilityp. 187
3.9.2 Other Encoder Variantsp. 190
3.9.3 EXIT Chart for Interference Cancelerp. 192
3.9.4 Related Analysesp. 194
3.10 Multichannel and Multiuser Settingsp. 195
3.10.1 Forward-Backward Equalizerp. 196
3.10.2 Interference Cancelerp. 197
3.10.3 Multiuser Casep. 198
3.11 Concluding Remarksp. 199
3.12 Problemsp. 200
Referencesp. 206
Chapter 4 Subspace Tracking for Signal Processingp. 211
4.1 Introductionp. 211
4.2 Linear Algebra Reviewp. 213
4.2.1 Eigenvalue Value Decompositionp. 213
4.2.2 QR Factorizationp. 214
4.2.3 Variational Characterization of Eigenvalues/Eigenvectors of Real Symmetric Matricesp. 215
4.2.4 Standard Subspace Iterative Computational Techniquesp. 216
4.2.5 Characterization of the Principal Subspace of a Covariance Matrix from the Minimization of a Mean Square Errorp. 218
4.3 Observation Model and Problem Statementp. 219
4.3.1 Observation Modelp. 219
4.3.2 Statement of the Problemp. 220
4.4 Preliminary Example: Oja's Neuronp. 221
4.5 Subspace Trackingp. 223
4.5.1 Subspace Power-Based Methodsp. 224
4.5.2 Projection Approximation-Based Methodsp. 230
4.5.3 Additional Methodologiesp. 232
4.6 Eigenvectors Trackingp. 233
4.6.1 Rayleigh Quotient-Based Methodsp. 234
4.6.2 Eigenvector Power-Based Methodsp. 235
4.6.3 Projection Approximation-Based Methodsp. 240
4.6.4 Additional Methodologiesp. 240
4.6.5 Particular Case of Second-Order Stationary Datap. 242
4.7 Convergence and Performance Analysis Issuesp. 243
4.7.1 A Short Review of the ODE Methodp. 244
4.7.2 A Short Review of a General Gaussian Approximation Resultp. 246
4.7.3 Examples of Convergence and Performance Analysisp. 248
4.8 Illustrative Examplesp. 256
4.8.1 Direction of Arrival Trackingp. 257
4.8.2 Blind Channel Estimation and Equalizationp. 258
4.9 Concluding Remarksp. 260
4.10 Problemsp. 260
Referencesp. 266
Chapter 5 Particle Filteringp. 271
5.1 Introductionp. 272
5.2 Motivation for Use of Particle Filteringp. 274
5.3 The Basic Ideap. 278
5.4 The Choice of Proposal Distribution and Resamplingp. 289
5.4.1 Choice of Proposal Distributionp. 290
5.4.2 Resamplingp. 291
5.5 Some Particle Filtering Methodsp. 295
5.5.1 SIR Particle Filteringp. 295
5.5.2 Auxiliary Particle Filteringp. 297
5.5.3 Gaussian Particle Filteringp. 301
5.5.4 Comparison of the Methodsp. 302
5.6 Handling Constant Parametersp. 305
5.6.1 Kernel-Based Auxiliary Particle Filterp. 306
5.6.2 Density-Assisted Particle Filterp. 308
5.7 Rao-Blackwellizationp. 310
5.8 Predictionp. 314
5.9 Smoothingp. 316
5.10 Convergence Issuesp. 320
5.11 Computational Issues and Hardware Implementationp. 323
5.12 Acknowledgmentsp. 324
5.13 Exercisesp. 325
Referencesp. 327
Chapter 6 Nonlinear Sequential State Estimation for Solving Pattern-Classification Problemsp. 333
6.1 Introductionp. 333
6.2 Back-Propagation and Support Vector Machine-Learning Algorithms: Reviewp. 334
6.2.1 Back-Propagation Learningp. 334
6.2.2 Support Vector Machinep. 337
6.3 Supervised Training Framework of MLPs Using Nonlinear Sequential State Estimationp. 340
6.4 The Extended Kalman Filterp. 341
6.4.1 The EKF Algorithmp. 344
6.5 Experimental Comparison of the Extended Kalman Filtering Algorithm with the Back-Propagation and Support Vector Machine Learning Algorithmsp. 344
6.6 Concluding Remarksp. 347
6.7 Problemsp. 348
Referencesp. 348
Chapter 7 Bandwidth Extension of Telephony Speechp. 349
7.1 Introductionp. 349
7.2 Organization of the Chapterp. 352
7.3 Nonmodel-Based Algorithms for Bandwidth Extensionp. 352
7.3.1 Oversampling with Imagingp. 353
7.3.2 Application of Nonlinear Characteristicsp. 353
7.4 Basicsp. 354
7.4.1 Source-Filter Modelp. 355
7.4.2 Parametric Representations of the Spectral Envelopep. 358
7.4.3 Distance Measuresp. 362
7.5 Model-Based Algorithms for Bandwidth Extensionp. 364
7.5.1 Generation of the Excitation Signalp. 365
7.5.2 Vocal Tract Transfer Function Estimationp. 369
7.6 Evaluation of Bandwidth Extension Algorithmsp. 383
7.6.1 Objective Distance Measuresp. 383
7.6.2 Subjective Distance Measuresp. 385
7.7 Conclusionp. 388
7.8 Problemsp. 388
Referencesp. 390
Indexp. 393