Web Search Beta Release
Warning
You will need a Credit Card for the FREE API access.
Important
We are exploring other search backends that don’t require such a process to get a key.
Brave search was built in to llama 3.1 by Meta which is why we started with this. (Stay posted)
Note
Join the search for the best system prompt in our Discord thread.
Web-Search-Beta-Release-Prompt-Engineering
"The only good bug is a dead one!" Join the fight in this discussion.
Web-Search-Beta-Release-Bugs
1. Install via the beta release located here: v3.1.0-web_search_beta
2. Sign up for a free Brave search AI API Key: https://brave.com/search/api/
Jump straight to Get started for FREE <<<< Click here to jump in!
3. Ensure you verify your email. Then "login".
4. At the Welcome screen you first need a free "subscription". (Credit Card Required)
5. Choose Data for AI then "Free AI" and click (Subscribe) at the bottom.
6. Next we add an API key, click this button (+ Add API key).
7. Name it GPT4All then select the "Free AI" option.
8. Copy the newly created key by clicking "copy"
9. Paste this key in the Tools Settings in GPT4All
10. Download the Llama 3.1 8B Instruct model provided here, if you don't have it already.
11. Copy the following system prompt for the brave api access.
<|start_header_id|>system<|end_header_id|>
Environment: ipython
Tools: brave_search
Cutting Knowledge Date: December 2023
Today Date: 25 Jul 2024
You are a helpful assistant.<|eot_id|>
12. Paste this into the model settings for the system prompt.
Do not set the context larger than 8192. (full rope scaling is coming soon)
13. Go to the chat view and load the Llama 3.1 8B Instruct model and type in:
Search the web and tell me who the 44th president of the United States was
You should see this:
Enjoy and let us know of any problems or feedback on discord - https://discord.com/invite/4M2QFmTt2k