Machine Learning

1. Introduction 2. Probability and Stochastic Processes 3. Learning in Parametric Modeling: Basic Concepts and Directions 4: Mean-Square Error Linear Estimation 5. Stochastic Gradient Descent: The LMS Algorithm and Its Family 6. The Least-Squares Family 7. Classification: A Tour of the Classics 8. Parameter Learning: A Convex Analytic Path 9. Sparsity-Aware Learning: Concepts and Theoretical Foundations 10. Sparsity-Aware Learning: Algorithms and Applications 11. Learning in Reproducing Kernel Hilbert Spaces 12. Bayesian Learning: Inference and the EM Algorithm 13. Bayesian Learning: Approximate Inference and Nonparametric Models 14. Monte Carlo Methods 15. Probabilistic Graphical Models: Part 1 16. Probabilistic Graphical Models: Part 2 17. Particle Filtering 18. Neural Networks and Deep Learning 19. Dimensionality Reduction and Latent Variables Modeling

Theodoridis, Sergios
Sergios Theodoridis is professor of machine learning and signal processing with the National and Kapodistrian University of Athens, Athens, Greece and with the Chinese University of Hong Kong, Shenzhen, China.

He has received a number of prestigious awards, including the 2014 IEEE Signal Processing Magazine Best Paper Award, the 2009 IEEE Computational Intelligence Society Transactions on Neural Networks Outstanding Paper Award, the 2017 European Association for Signal Processing
(EURASIP) Athanasios Papoulis Award, the 2014 IEEE Signal Processing Society Education Award, and the 2014 EURASIP Meritorious Service Award. He has served as president of EURASIP and vice president for the IEEE Signal Processing Society and as Editor-in-Chief IEEE Transactions on Signal processing. He is a Fellow of EURASIP and a Life Fellow of IEEE.
He is the coauthor of the best selling book Pattern Recognition, 4th edition, Academic Press, 2009 and of the book Introduction to Pattern Recognition: A MATLAB Approach, Academic Press, 2010.

"Overall, this text is well organized and full of details suitable for advanced graduate and postgraduate courses, as well as scholars." -- Computing Reviews

" Machine Learning: A Bayesian and Optimization Perspective , Academic Press, 2105, by Sergios Theodoridis is a wonderful book, up to date and rich in detail. It covers a broad selection of topics ranging from classical regression and classification techniques to more recent ones including sparse modeling, convex optimization, Bayesian learning, graphical models and neural networks, giving it a very modern feel and making it highly relevant in the deep learning era. While other widely used machine learning textbooks tend to sacrifice clarity for elegance, Professor Theodoridis provides you with enough detail and insights to understand the "fine print". This makes the book indispensable for the active machine learner." --Prof. Lars Kai Hansen, DTU Compute - Dept. Applied Mathematics and Computer Science Technical University of Denmark

"Before the publication of Machine Learning: A Bayesian and Optimization Perspective , I had the opportunity to review one of the chapters in the book (on Monte Carlo methods). I have published actively in this area, and so I was curious how S. Theodoridis would write about it. I was utterly impressed. The chapter presented the material with an optimal mix of theoretical and practical contents in very clear manner and with information for a wide range of readers, from newcomers to more advanced readers. This raised my curiosity to read the rest of the book once it was published. I did it and my original impressions were further reinforced. S. Theodoridis has a great capability to disentangle the important from the unimportant and to make the most of the used space for writing. His text is rich with insights about the addressed topics that are not only helpful for novices but also for seasoned researchers. It goes without saying that my department adopted his book as a