ACAI
A Spring AI Exploring Project[Caicai]. Functions include:
- Support Ollama Chat, using the Spring AI Chat SDK.
- Support RAG(Retrieval Augmented Generation), able to retrieve and generate content based on user queries and input documents.
- TESTS: Embedding, Vector Store, ETL pipeline
TODO:
- Image
- Audio
- Function Calling
- Multimodality
- User Interface
- Evaluation Testing
Environment | Version |
---|---|
java | OpenJDK version 21.0.1 |
gradle | Gradle 8.6 |
pgvector | pgvector:pg16 |
ollama | 0.1.38 |
httpie | 3.2.2 |
ollama run llama3
OR
ollama run wangshenzhi/llama3-8b-chinese-chat-ollama-q8:latest
ollama rum nomic-embed-text
./gradlew bootRun
4、Retrieval Augmented Generation(RAG)
http -f POST :8080/rga/upload file@~/Desktop/upload_test.txt
http :8080/rga/search keyword=="Caicai AI test"
http :8080/rga/chat message=="Caicai AI test"
http :8080/chat message=="Tell me a funny story."
http :8080/chat/generic-options message=="what is spring AI? Give a short answer."
http :8080/chat/generic-options message=="what is spring AI? Give a short answer."