You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What I want to is to intervene the f5 and l5 tokens at both layer 15 and layer 16,but confused with the following results.
Here are first five results of all data:
I am confused about the three-dimention list. for each line in the list is a two-dimention list represents the first five tokens and last five tokens, does it mean intervene the first five token at layer 15 and last five token at layer 16 or intervene both first five and last five tokes at both layer 15 and layer 16? what is the meaning of the thee-dimention list?
Thanks for answering me question!!!
The text was updated successfully, but these errors were encountered:
Hello! I'm interested in the ReFT but have some questions.
I want to intervene the 15th and 16th layer of the model, I use the following code:
and use the code to get intervention_locations:
What I want to is to intervene the f5 and l5 tokens at both layer 15 and layer 16,but confused with the following results.
Here are first five results of all data:
I am confused about the three-dimention list. for each line in the list is a two-dimention list represents the first five tokens and last five tokens, does it mean intervene the first five token at layer 15 and last five token at layer 16 or intervene both first five and last five tokes at both layer 15 and layer 16? what is the meaning of the thee-dimention list?
Thanks for answering me question!!!
The text was updated successfully, but these errors were encountered: