Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration with TransformerLens ? #1205

Open
glerzing opened this issue Jul 28, 2023 · 0 comments
Open

Integration with TransformerLens ? #1205

glerzing opened this issue Jul 28, 2023 · 0 comments

Comments

@glerzing
Copy link

I discovered LIT from an issue on TransformerLens, which is a mechanistic interpretability Python library that seeks to analyze at a low level how transformers work. They use techniques such as activation patching, that help to analyze the causal relation between each layer and the output, and notably how much each attention head contributes the result.
Do you think there is some potential in integrating TransformerLens into LIT (or just re-implement these techniques), or the other way, integrate LIT into TransformerLens to get access to a GUI ?
I might consider helping with the development if I have the time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant