September 30th, 2022 – 10:30 am
The talk introduces the motivation behind statistical learning theory and after reviewing some earlier approaches gives an overview of the PAC-Bayes methodology to analysing generalisation, highlighting the links between Bayesian and frequentist ideas that it embodies. Its application to Support Vector Machines and Deep Neural Networks will be discussed in more detail demonstrating its value in assessing performance and motivating different algorithms, but also exposing the mismatches between theory and practice.
Bio:
John Stewart Shawe-Taylor is Director of the Centre for Computational Statistics and Machine Learning at University College, London (UK). His main research area is statistical learning theory. He has contributed to a number of fields ranging from graph theory through cryptography to statistical learning theory and its applications. However, his main contributions have been in the development of the analysis and subsequent algorithmic definition of principled machine learning algorithms founded in statistical learning theory. This work has helped to drive a fundamental rebirth in the field of machine learning with the introduction of kernel methods and support vector machines, including the mapping of these approaches onto novel domains including work in computer vision, document classification and brain scan analysis. More recently he has worked on interactive learning and reinforcement learning. He has also been instrumental in assembling a series of influential European Networks of Excellence (initially the NeuroCOLT projects and later the PASCAL networks). The scientific coordination of these projects has influenced a generation of researchers and promoted the widespread uptake of machine learning in both science and industry that we are currently witnessing. He has published over 300 papers with over 42000 citations. Two books co-authored with Nello Cristianini have become standard monographs for the study of kernel methods and support vector machines and together have attracted 21000 citations. He is Head of the Computer Science Department at University College London, where he has overseen a significant expansion and witnessed its emergence as the highest ranked Computer Science Department in the UK in the 2014 UK Research Evaluation Framework (REF).
This talk is co-organised by 3IA Côte d’Azur and is part of the sequence of the UNESCO chair in the Ethics of the Living and Artificial (EVA)