Skip to content

[Demos] Adding OctoAI API Examples (Hosted Llama solution) #379

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 36 commits into from
Feb 27, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
3cbbad1
adding OctoAI hello llama cloud example
tmoreau89 Feb 5, 2024
747fab1
octoai live data example, tested
tmoreau89 Feb 5, 2024
c8625b5
adding OctoAI gradio example
tmoreau89 Feb 5, 2024
8812b1c
remove space
tmoreau89 Feb 5, 2024
d1a0863
adding video summary OctoAI example
tmoreau89 Feb 6, 2024
15ac2fe
rename examples
tmoreau89 Feb 6, 2024
4b166f4
adding RAG chatbot example
tmoreau89 Feb 8, 2024
a119469
update index
tmoreau89 Feb 8, 2024
b5946e3
naming tweaks
tmoreau89 Feb 8, 2024
864aae0
pinning RAG chatbot requirements
tmoreau89 Feb 15, 2024
2c4383b
update to use OctoAI embedding
tmoreau89 Feb 15, 2024
2c338d2
adding purple llama to the mix
tmoreau89 Feb 15, 2024
3f462cb
updated examples to (1) use OctoAI embeddings, and (2) not state the …
tmoreau89 Feb 15, 2024
b8fd519
adding OctoAI hello llama cloud example
tmoreau89 Feb 5, 2024
e79e5a7
octoai live data example, tested
tmoreau89 Feb 5, 2024
813a99e
adding OctoAI gradio example
tmoreau89 Feb 5, 2024
5251288
remove space
tmoreau89 Feb 5, 2024
0db9414
adding video summary OctoAI example
tmoreau89 Feb 6, 2024
961660f
rename examples
tmoreau89 Feb 6, 2024
5f2855e
adding RAG chatbot example
tmoreau89 Feb 8, 2024
1ca4a9c
update index
tmoreau89 Feb 8, 2024
993fea0
naming tweaks
tmoreau89 Feb 8, 2024
0a57c80
pinning RAG chatbot requirements
tmoreau89 Feb 15, 2024
635923e
update to use OctoAI embedding
tmoreau89 Feb 15, 2024
26d7b34
adding purple llama to the mix
tmoreau89 Feb 15, 2024
bd23f8b
updated examples to (1) use OctoAI embeddings, and (2) not state the …
tmoreau89 Feb 15, 2024
d57354a
Merge branch 'tmoreau-octoai' of github.com:octoml/llama-recipes into…
tmoreau89 Feb 15, 2024
47ccf9b
adding the getting to know llama starter guide
tmoreau89 Feb 15, 2024
c68c044
authorship update
tmoreau89 Feb 15, 2024
5e777e1
simplifying the model names
tmoreau89 Feb 26, 2024
b7d0941
documentation update
tmoreau89 Feb 26, 2024
92166ac
documentation update ++
tmoreau89 Feb 26, 2024
621195a
md fix
tmoreau89 Feb 26, 2024
34399ad
fix path
tmoreau89 Feb 26, 2024
409f4b5
added update for this PR
tmoreau89 Feb 26, 2024
ede3860
hyperlink fix
tmoreau89 Feb 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Llama 2 Fine-tuning / Inference Recipes, Examples, Benchmarks and Demo Apps

**[Update Feb. 26, 2024] We added examples to showcase OctoAI's cloud APIs for Llama2, CodeLlama, and LlamaGuard: including [PurpleLlama overview](./examples/Purple_Llama_OctoAI.ipynb), [hello Llama2 cloud](./demo_apps/OctoAI_API_examples/HelloLlamaCloud.ipynb), [getting to know Llama2](./demo_apps/OctoAI_API_examples/Getting_to_know_Llama.ipynb), [live search example](./demo_apps/OctoAI_API_examples/LiveData.ipynb), [Llama2 Gradio demo](./demo_apps/OctoAI_API_examples/Llama2_Gradio.ipynb), [Youtube video summarization](./demo_apps/OctoAI_API_examples/VideoSummary.ipynb), and [retrieval augmented generation overview](./demo_apps/OctoAI_API_examples/RAG_Chatbot_example/RAG_Chatbot_Example.ipynb)**.

**[Update Feb. 5, 2024] We added support for Code Llama 70B instruct in our example [inference script](./examples/code_llama/code_instruct_example.py). For details on formatting the prompt for Code Llama 70B instruct model please refer to [this document](./docs/inference.md)**.

**[Update Dec. 28, 2023] We added support for Llama Guard as a safety checker for our example inference script and also with standalone inference with an example script and prompt formatting. More details [here](./examples/llama_guard/README.md). For details on formatting data for fine tuning Llama Guard, we provide a script and sample usage [here](./src/llama_recipes/data/llama_guard/README.md).**
Expand Down
Loading