Skip to content

Layer Collections, support for GroupNorm, QuasiDiag representation
Compare
Choose a tag to compare
@tfjgeorge tfjgeorge released this 09 Oct 14:57
· 203 commits to master since this release
v0.2
67043d5
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

This release revamps NNGeometry in order to have LayerCollection at its heart, which allows:

  • flexibility in parameter space definition (e.g. if you want to compute FIM or NTK for a subset of your layers)
  • flexbility in some operations, e.g. in a Fv product F.mv(v) F and v do not need to be created from the same model instance, but as long as they share the same LayerCollection it is enough

We also added support for GroupNorm layers, and included the QuasiDiag parameter space representation.

This release includes some documentation (not perfect !), and supports continuous integration tools.

Assets 2
Loading