Skip to content

Commit

Permalink
Update llm nightly
Browse files Browse the repository at this point in the history
  • Loading branch information
mgoin authored Oct 12, 2023
1 parent 9b44bcc commit baa9f91
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ We are excited to announce initial support for performant LLM inference in DeepS

Install (requires Linux):
```bash
pip install -U deepsparse-nightly[transformers]==1.6.0.20231007
pip install -U deepsparse-nightly[llm]
```

Run inference:
Expand Down
2 changes: 1 addition & 1 deletion docs/llms/text-generation-pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ This user guide explains how to run inference of text generation models with Dee
DeepSparse support for LLMs is available on DeepSparse's nightly build on PyPi:

```bash
pip install -U deepsparse-nightly[transformers]==1.6.0.20231007
pip install -U deepsparse-nightly[llm]
```

#### **System Requirements**
Expand Down
2 changes: 1 addition & 1 deletion research/mpt/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ While GSM is a "toy" math dataset, it serves as an example of how LLMs can be ad
Install the DeepSparse Nightly build (requires Linux):

```bash
pip install deepsparse-nightly[transformers]==1.6.0.20231007
pip install -U deepsparse-nightly[llm]
```

The models generated in the paper are hosted on [SparseZoo](https://sparsezoo.neuralmagic.com/?ungrouped=true&sort=null&datasets=gsm8k&architectures=mpt) and [Hugging Face](https://huggingface.co/collections/neuralmagic/sparse-finetuning-mpt-65241d875b29204d6d42697d).
Expand Down

0 comments on commit baa9f91

Please sign in to comment.