Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix minor issues with LLM example documentation #1992

Merged
5 changes: 4 additions & 1 deletion examples/llm/agents/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -126,10 +126,13 @@ This example demonstrates the basic implementation of Morpheus pipeline, showcas
- Stores and manages the results within the pipeline using an InMemorySinkStage.


To run the example with default options, use the following command:
```bash
python examples/llm/main.py agents simple [OPTIONS]
python examples/llm/main.py --log_level=info agents simple
```

Available options for the simple pipeline are as follows:

### Options:
- `--use_cpu_only`
- **Description**: Run in CPU only mode
Expand Down
1 change: 0 additions & 1 deletion examples/llm/completion/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -145,6 +145,5 @@ python examples/llm/main.py completion [OPTIONS] COMMAND [ARGS]...
### Running Morpheus Pipeline with OpenAI LLM service

```bash

python examples/llm/main.py completion pipeline --llm_service OpenAI
```
8 changes: 0 additions & 8 deletions examples/llm/rag/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -96,14 +96,6 @@ The standalone Morpheus pipeline is built using the following components:

Before running the pipeline, we need obtain service API keys for the following services:

### Ensure that LFS files are downloaded

To retrieve datasets from LFS run the following:

```bash
./scripts/fetch_data.py fetch datasets
```

### Obtain an OpenAI API or NGC API Key

#### NGC
Expand Down
13 changes: 9 additions & 4 deletions examples/llm/vdb_upload/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -123,16 +123,21 @@ Before running the pipeline, we need to ensure that the following services are r

#### Ensure LFS files are downloaded

To retrieve datasets from LFS run the following:
To retrieve the datasets from LFS run the following:

```bash
./scripts/fetch_data.py fetch datasets
./scripts/fetch_data.py fetch examples
```

#### Milvus Service

- Follow the instructions [here](https://milvus.io/docs/install_standalone-docker.md) to install and run a Milvus
service.
- Refer to the [Milvus documentation](https://milvus.io/docs/install-overview.md) for more details on running Milvus. For the purposes of testing the pipeline, we will launch an instance of Milvus Lite.

From the root of the Morpheus repository, run the following to launch Milvus in a separate terminal:
```bash
mkdir -p .tmp/milvusdb
milvus-server --data .tmp/milvusdb
```

#### Triton Service

Expand Down
Loading