Skip to content

Commit

Permalink
Updates from Overleaf
Browse files Browse the repository at this point in the history
  • Loading branch information
ludwigbothmann committed Dec 20, 2023
1 parent f74764c commit 0a87b99
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions slides/information-theory/slides-info-mutual-info2.tex
Original file line number Diff line number Diff line change
Expand Up @@ -182,17 +182,19 @@

\begin{vbframe} {Mutual information vs. correlation}

\begin{itemize}
\begin{itemize}
\item If two variables are independent, their correlation is 0.
\item However, the reverse is not necessarily true. It is possible for two dependent variables to have 0 correlation because correlation only measures linear dependence.
\end{itemize}

\begin{center}
\includegraphics[width = 10cm ]{figure/correlation_plot.png} \\
\includegraphics[width = 0.99\textwidth]{figure/correlation_plot.png} \\
\end{center}

\begin{itemize}
\item The figure above shows various scatterplots where, in each case, the correlation is 0 even though the two variables are strongly dependent, and MI is large.
\item Mutual information can therefore be seen as a more general measure of dependence between variables than correlation.
\end{itemize}
\end{itemize}

\end{vbframe}

Expand Down

0 comments on commit 0a87b99

Please sign in to comment.