2024/09/25: GSNs : Generative Stochastic Networks

[animesh3008]

Hey guys, I will be discussing Generative Stochastic Networks in the next journal club on 25th Sept 2024. More information follows soon :)
I will primarily be discussing this paper: https://academic.oup.com/imaiai/article/5/2/210/2363406

Here is the original paper which is shorter and condensed: https://proceedings.mlr.press/v32/bengio14.html

[animesh3008]

Hi Everyone,

As you may have already noticed, this paper is very long and covers many important concepts, but it does not include much supplementary material like blog posts or videos making it tough to understand. It will not be possible for me to cover all aspects in one session.

Therefore, tomorrow I will present a general overview of the paper without going into detailed proofs. We will then discuss the best possible way to read this paper and continue the discussion in much more detail next week. The session might be relatively shorter than usual.

[animesh3008]

Attached is the presentation from today's discussion:
20240925_GenerativeStochasticNetworks.pdf

[moritzschaefer]

Here is what we agreed upon for the upcoming sessions:

• Next one @shemlem will talk about Neural ODEs (looking forward)
• After that one, @adam will make a recap session
  • homework for that session: distribute the modern papers, for everyone to skim through them
    • then everyone can share the concepts that are lacking and that we should cover

It was also noted that these topics would probably be helpful to cover

• MCMC
• and potentially Boltzmann machines (less important though) might be beneficial
• score matching (we should probably stick around the gradient-field and similiar models for abit then)

Thanks a lot Animesh!