Skip to content

v1.1
Compare
Choose a tag to compare
@bdu91 bdu91 released this 21 Feb 07:38
· 90 commits to main since this release
v1.1
11b1748
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

This release provides the capabilities to interpret and debug the behaviors of Generative AI models in LIT. Specifically, we added sequence salience, which explains the impact of the preceding tokens on the generated tokens produced by the GenAI models. Major changes include:

  • An LM salience module in the LIT UI that computes generations, tokenization, and sequence salience on-demand;
  • Computation of sequence salience at different granularities, from the smallest possible level of tokens, to more interpretable larger spans, such as words, sentences, lines, or paragraphs.
  • Support of OSS modeling frameworks, including KerasNLP and Hugging Face Transformers for sequence salience computation.

This release would not have been possible without the work of our contributors. Many thanks to Ryan Mullins, Ian Tenney, Bin Du, and Cibi Arjun.

New Stuff

Non-breaking Changes, Bug Fixes, and Enhancements

  • Improvements to display various fields and their default ranges - 8a3f366, e63b674, d274508
  • Allow only displaying the UI layouts provided by users - a219863
  • Internal dependency changes -, f254fa8, 724bdee, 2138bd9
  • Fix issues with adding more than one example from counterfactual generators - d4302bd
  • Fix issues with loading SimpleSentimentModel - ac8ed59
  • Notebook widget improvements - cdf79eb
  • Docs updates
Assets 2
Loading