| STUDENTS
> Probabilistic and Unsupervised Learning
|
Probabilistic and Unsupervised Learning
Note:
Whilst every effort is made to keep the syllabus and assessment records correct
for this course, the precise details must be checked with the lecturer(s).
| Code: | GI18 |
| Year: | MSc |
| Prerequisites: | A good background in statistics, calculus, linear algebra, and computer science. You should thoroughly review the maths in the cribsheet provided at http://www.gatsby.ucl.ac.uk/teaching/courses/ml1-2008/cribsheet.pdf before the start of the module. You must either know Matlab or Octave, be taking a class on Matlab/Octave, or be willing to learn it on your own. Any student or researcher at UCL meeting these requirements is welcome to attend the lectures. Students wishing to take it for credit should consult with the module lecturer. |
| Term: | 1 |
| Taught By: | Maneesh Sahani (Gatsby Computational Neuroscience Unit)
(50%)
YeeWhye Teh (Gatsby Computational Neuroscience Unit)
(50%)
|
| Aims: | This course provides students with an in-depth introduction to statistical modelling and unsupervised learning techniques It presents probabilistic approaches to modelling and their relation to coding theory and Bayesian statistics. A variety of latent variable models will be covered including mixture models (used for clustering), dimensionality reduction methods, time series models such as hidden Markov models which are used in speech recognition and bioinformatics, independent components analysis, hierarchical models, and nonlinear models. The course will present the foundations of probabilistic graphical models (e.g. Bayesian networks and Markov networks) as an overarching framework for unsupervised modelling. We will cover Markov chain Monte Carlo sampling methods and variational approximations for inference. Time permitting, students will also learn about other topics in probabilistic (or Bayesian) machine learning.
|
| Learning Outcomes: | To be able to understand the theory of unsupervised learning systems; to have in-depth knowledge of the main models used in Unsupervised Learning; to understand the methods of exact and approximate inference in probabilistic models; to be able to recognise which models are appropriate for different real-world applications of machine learning methods. |
Content:
| Topics covered | Latent variable models including;
Mixture models (used for clustering)
dimensionality reduction methods
time series models such as hidden Markov models used in speech regognition and bioinformatics
Gaussian process models
independent components analysis
hierarchical models
nonlinear models.
Foundations of probabilistic graphical models, e.g. Bayesian networks and Markov networks as an overarching framework for unsupervised modelling.
Markov chain Monte Carlo sampling methods and variational approximations for inference.
Other topics in probabilistic (or Bayesian) machine learning (time permitting). |
Method of Instruction:
Lecture presentations with associated class problems.
Assessment:
The course has the following assessment components:
- Written Examination (2.5 hours, 50%)
- Coursework Section (1 piece, 50%)
To pass this course, students must:
- Obtain an average of at least 50% when the coursework and exam components of a course are weighted together
The examination rubric is:
Answer all questionsResources:
There is no required textbook. However, the following in an excellent sources for many of the topics covered here. David J.C. MacKay (2003) Information Theory, Inference, and Learning Algorithms, Cambridge University Press. (also available online)
Unsupervised Learning module web page
|
+44 (0)20 7679 7214 - Copyright © 1999-2007
UCL
