We will use a dedicated Piazza forum to support interaction. Please feel free to ask questions and answer/discuss other's questions! You will receive a link to join if you are registered to the course.
The course is based on the textbook Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani: An Introduction to Statistical Learning with Applications in R, Springer, 2013 (see link below).
You may also find last year's course materials useful (see link below).
Project for separate exam takers
If you wish to take a separate exam without having taken part in the exercise sessions, you must complete a project. The deadline for returning the project is 10 days before the exam. For the dates of the separate exams, please see the department homepage (under 'Studies'). More instructions are given in the project description below.
Data Science Master's programme
Data Science Methods module
The course is available to students from other degree programmes
Basics of probability theory and statistics (e.g. course Introduction to statistics, including multivariate probability, Bayes formula, and maximum likelihood estimators) and intermediate level linear algebra (e.g. some elements of Linear algebra and matrices I-II, including multivariate calculus)
Good programming skills in some language and the ability to quickly acquire the basics of a new environment (R or python/numpy/scipy)
Introduction to Data Science and Introduction to Artificial Intelligence are recommended but not required.
Courses in the Machine Learning module
- Defines and is able to explain basic concepts in machine learning (e.g. training data, feature, model selection, loss function, training error, test error, overfitting)
- Recognises various machine learning problems and methods suitable for them: supervised vs unsupervised learning, discriminative vs generative learning paradigm, symbolic vs numeric data
- Knows the basics of a programming environment (such as R or python/numpy/scipy) suitable for machine learning applications
- Is able to implement at least one distance-based, one linear, and one generative classification method, and apply these to solving simple classification problems
- Is able to implement and apply linear regression to solve simple regression problems
- Explains the assumptions behind the machine learning methods presented in the course
- Implements testing and cross- validation methods, and is able to apply them to evaluate the performance of machine learning methods and to perform model selection
- Comprehends the most important clustering formalisms (distance measures, k-means clustering, hierarchical clustering)
- Explains the idea of the k-means clustering algorithm and is able to implement it
- Is able to implement a method for hierarchical clustering and can interpret its results
First semester (Autumn)
Typically 2nd period
- statistical learning, models and data, evaluating performance, overfitting, bias-variance tradeoff
- linear regression
- classification: logistic regression, linear and quadratic discriminant analysis, naive Bayes, nearest neighbour classifier, decision trees, support vector machine
- clustering (flat and hierarchical); k-means, agglomerative clustering
- resampling methods (cross-validation, bootstrap), ensemble methods (bagging, random forests)
Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani: An Introduction to Statistical Learning with Applications in R, Springer, 2013.
Parts of the textbook that are required are specified on the course web page.
The course will involve weekly exercises that include both programming and other kinds of problems ("pen and paper").
Assessment and grading is based on completed exercises and a course exam. Possible other criteria will be specified on the course web page.
- Contact teaching
- Possible attendance requirements are specified each year at the course web page
- Completion is based on exercises and one or more exams. Possible other methods of completion will be announced on the course web page.