From ecfcca8a0addbf33afd4e4333b035453cb47566b Mon Sep 17 00:00:00 2001 From: ludwigbothmann <46222472+ludwigbothmann@users.noreply.github.com> Date: Wed, 13 Dec 2023 10:56:04 +0100 Subject: [PATCH] Updates from Overleaf --- slides/regularization/slides-regu-intro.tex | 2 +- slides/regularization/slides-regu-ridge-deepdive.tex | 5 +++-- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/slides/regularization/slides-regu-intro.tex b/slides/regularization/slides-regu-intro.tex index 24b08232..c740760a 100644 --- a/slides/regularization/slides-regu-intro.tex +++ b/slides/regularization/slides-regu-intro.tex @@ -33,7 +33,7 @@ \end{vbframe} -\begin{vbframe}{Invariance/Symmetry} +\begin{vbframe}{Regularization for Invariance/Symmetry} Prior knowledge often requires that model predictions should be invariant under certain input transformations.\\ In image classification, label ``cat'' should hold regardless of position or size of relevant object (translation/scale invariance) \begin{enumerate}\setlength\itemsep{1.02em} diff --git a/slides/regularization/slides-regu-ridge-deepdive.tex b/slides/regularization/slides-regu-ridge-deepdive.tex index 9f2317e3..199e82f8 100644 --- a/slides/regularization/slides-regu-ridge-deepdive.tex +++ b/slides/regularization/slides-regu-ridge-deepdive.tex @@ -5,8 +5,9 @@ \newcommand{\titlefigure}{figure_man/bias-variance-ridge.png} \newcommand{\learninggoals}{ - \item Know four perspectives interpretations on Ridge regression - \item Derivation of the bias-variance tradeoff for Ridge regression + \item Know interpretation of $L2$ regularization as row-augmentation + \item Know interpretation of $L2$ regularization as minimizing risk under feature noise + %\item Derivation of the bias-variance tradeoff for Ridge regression } \title{Introduction to Machine Learning}