Week 39: Resampling methods and logistic regression
Contents
Plan for week 39, September 22-26, 2025
Readings and Videos, resampling methods
Readings and Videos, logistic regression
Lab sessions week 39
Lecture material
Resampling methods
Resampling approaches can be computationally expensive
Why resampling methods ?
Statistical analysis
Resampling methods
Resampling methods: Bootstrap
The bias-variance tradeoff
A way to Read the Bias-Variance Tradeoff
Understanding what happens
Summing up
Another Example from Scikit-Learn's Repository
Various steps in cross-validation
Cross-validation in brief
Code Example for Cross-validation and \( k \)-fold Cross-validation
More examples on bootstrap and cross-validation and errors
The same example but now with cross-validation
Logistic Regression
Classification problems
Optimization and Deep learning
Basics
Linear classifier
Some selected properties
Simple example
Plotting the mean value for each group
The logistic function
Examples of likelihood functions used in logistic regression and nueral networks
Two parameters
Maximum likelihood
The cost function rewritten
Minimizing the cross entropy
A more compact expression
Extending to more predictors
Including more classes
More classes
Optimization, the central part of any Machine Learning algortithm
Revisiting our Logistic Regression case
The equations to solve
Solving using Newton-Raphson's method
Example code for Logistic Regression
Synthetic data generation
Readings and Videos, resampling methods
Raschka et al, pages 175-192
Hastie et al Chapter 7, here we recommend 7.1-7.5 and 7.10 (cross-validation) and 7.11 (bootstrap). See
https://link.springer.com/book/10.1007/978-0-387-84858-7
.
Video on bias-variance tradeoff
Video on Bootstrapping
Video on cross validation
«
1
2
3
4
5
6
7
8
9
10
11
12
...
45
»