Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Restore from master weights (& allow restoring from a checkpoint of different precision) #702

Merged
merged 6 commits into from
Jul 30, 2024
Merged

Restore from master weights (& allow restoring from a checkpoint of different precision) #702

merged 6 commits into from
Jul 30, 2024

Commits on Jul 25, 2024

  1. Allow restoring weights from the master weights of a checkpoint (dete… 

    …rministically by also saving RNG state of last update)
    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    f470fbd View commit details
    Browse the repository at this point in the history

  2. make restoring from master weights actually work

    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    5cae10f View commit details
    Browse the repository at this point in the history

  3. allow restoring from checkpoint of different precision

    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    9781627 View commit details
    Browse the repository at this point in the history

  4. simplify a little bit

    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    2eabc22 View commit details
    Browse the repository at this point in the history

  5. simplified further (don't need non-functional error checking...)

    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    4d77ece View commit details
    Browse the repository at this point in the history

  6. fix bug from merge (init_state set to false too late)

    @ademeure
    ademeure committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    52e6e0f View commit details
    Browse the repository at this point in the history