Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#14186: Fixed moreh_adam and moreh_adamw #14243

Merged
merged 4 commits into from
Oct 25, 2024
Merged

Conversation

dmakoviichuk-tt
Copy link
Contributor

Ticket

#14186

Problem description

Here are some issues with hash computation so I used another version of the hash

What's changed

First idea is that something wrong with lr passing.
But when I added it back to cache I found it doesn't work.

Checklist

  • Post commit CI passes
  • Blackhole Post commit (if applicable)
  • Model regression CI testing passes (if applicable)
  • Device performance regression CI testing passes (if applicable)
  • New/Existing tests provide coverage for changes

@rfurko-tt rfurko-tt changed the title #14186: Fixed moreh_adam #14186: Fixed moreh_adam and moreh_adamw Oct 24, 2024
Copy link
Contributor

@rfurko-tt rfurko-tt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@o2buzzle
Copy link
Contributor

o2buzzle commented Oct 25, 2024

@dmakoviichuk-tt Would you mind if I push the patch for moreh_adam into this PR as well? The current changes are only for adamw

@dmakoviichuk-tt
Copy link
Contributor Author

will do it.

@dmakoviichuk-tt dmakoviichuk-tt merged commit 59a2d5e into main Oct 25, 2024
7 checks passed
@dmakoviichuk-tt dmakoviichuk-tt deleted the DM/remove_lr_adamw branch October 25, 2024 18:14
ct-clmsn pushed a commit to ct-clmsn/tt-metal that referenced this pull request Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants