You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1)albert_v2_base (accuracy 0.694):
1. low pcc at ttnn_tanh (0.9945167693107032) (created ticket: tenstorrent/tt-metal#17721)
2. PCC seems to gradually shrink to 0.694 result of a faulty tanh
2)albert_v2_large (accuracy: 0.2363122287623936):
1. low pcc at ttnn_tanh (0.994849691145142 in model and 0.9960485128140038 in unit test provided in created ticket) (created ticket: tenstorrent/tt-metal#17840)
2. Accuracy unusually small (0.236), when compared to large and base (investigating further!)
3)albert_v2_xlarge (accuracy: 0.5342303226987013):
1. low pcc at ttnn_tanh (0.9933987640618709 in model and 0.9942273950085615 in unit test provided in created ticket) (created ticket: tenstorrent/tt-metal#17841)
2. PCC seems to gradually shrink to 0.53 as a result of a faulty tanh]
ayerofieiev-tt
changed the title
Investigate low accuracy in albert/albert-xlarge-v2
Investigate low accuracy in Albert Masked LM
Feb 12, 2025
No description provided.
The text was updated successfully, but these errors were encountered: