diff --git a/slides-pdf/slides-nonlinsvm-featuregen.pdf b/slides-pdf/slides-nonlinsvm-featuregen.pdf index 3dbc3413..10a57cbf 100644 Binary files a/slides-pdf/slides-nonlinsvm-featuregen.pdf and b/slides-pdf/slides-nonlinsvm-featuregen.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-kernel-poly.pdf b/slides-pdf/slides-nonlinsvm-kernel-poly.pdf index cf81360b..4ffdff09 100644 Binary files a/slides-pdf/slides-nonlinsvm-kernel-poly.pdf and b/slides-pdf/slides-nonlinsvm-kernel-poly.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-kernel-rbf.pdf b/slides-pdf/slides-nonlinsvm-kernel-rbf.pdf index b0fb56bd..22083f75 100644 Binary files a/slides-pdf/slides-nonlinsvm-kernel-rbf.pdf and b/slides-pdf/slides-nonlinsvm-kernel-rbf.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-kernel-trick.pdf b/slides-pdf/slides-nonlinsvm-kernel-trick.pdf index 2f9e3d76..111753b1 100644 Binary files a/slides-pdf/slides-nonlinsvm-kernel-trick.pdf and b/slides-pdf/slides-nonlinsvm-kernel-trick.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-modelsel.pdf b/slides-pdf/slides-nonlinsvm-modelsel.pdf index 83cc331f..113276f6 100644 Binary files a/slides-pdf/slides-nonlinsvm-modelsel.pdf and b/slides-pdf/slides-nonlinsvm-modelsel.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-rkhs-repr.pdf b/slides-pdf/slides-nonlinsvm-rkhs-repr.pdf index 3feeff60..ea190336 100644 Binary files a/slides-pdf/slides-nonlinsvm-rkhs-repr.pdf and b/slides-pdf/slides-nonlinsvm-rkhs-repr.pdf differ diff --git a/slides-pdf/slides-nonlinsvm-uniapprox.pdf b/slides-pdf/slides-nonlinsvm-uniapprox.pdf index 0c376982..66b8adea 100644 Binary files a/slides-pdf/slides-nonlinsvm-uniapprox.pdf and b/slides-pdf/slides-nonlinsvm-uniapprox.pdf differ diff --git a/slides/nonlinear-svm/slides-nonlinsvm-kernel-poly.tex b/slides/nonlinear-svm/slides-nonlinsvm-kernel-poly.tex index d277c5b3..1b812be5 100644 --- a/slides/nonlinear-svm/slides-nonlinsvm-kernel-poly.tex +++ b/slides/nonlinear-svm/slides-nonlinsvm-kernel-poly.tex @@ -34,13 +34,16 @@ \end{vbframe} \begin{vbframe}{NonHomogeneous Polynomial Kernel} +\small $$k(\xv, \xtil) = (\xv^T \xtil + b)^d, \text{ for } b\geq 0, d \in \N$$ The maths is very similar as before, we kind of add a further constant term in the original space, with -$$ (\xv^T \xtil + b)^d = (x_1 \tilde{x}_1 + \ldots + x_p \tilde{x_p} + \sqrt{b} \sqrt{b})^d$$ +$$ (\xv^T \xtil + b)^d = (x_1 \tilde{x}_1 + \ldots + x_p \tilde{x_p} + b)^d$$ The feature map contains all monomials up to order $d$. $$\phix = \left( \sqrt{\mat{d \\ k_1, \ldots, k_{p+1}}} x_1^{k_1} \ldots x_p^{k_p} b^{k_{p+1}/2} \right)_{k_i \geq 0, \sum_i k_i = d}$$ The map $\phix$ has $\mat{p + d\\ d}$ dimensions. For $p=d=2$: -$$\phix = (x_1^2, x_2^2, \sqrt{2} x_1 x_2, \sqrt{2b} x_1, \sqrt{2b} x_2, \sqrt{b})$$ +$$(x_1 \tilde{x}_1 + x_2 \tilde{x}_2 + b)^2 = x_1^2\tilde{x}_1^2 + x_2^2 \tilde{x}_2^2 + 2 x_1 x_2 \tilde{x}_1 \tilde{x}_2 + 2b x_1 \tilde{x}_1 + 2b x_2 \tilde{x}_2 + b^2$$ +Therefore, +$$\phix = (x_1^2, x_2^2, \sqrt{2} x_1 x_2, \sqrt{2b} x_1, \sqrt{2b} x_2, b)$$ % From the sum-product rules it directly follows that this is a kernel. \end{vbframe}