Replies: 1 comment
-
|
similar #3968 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! Trying to launch this mode: https://localai.io/features/distribute/#without-p2p
Started remote worker with
local-ai worker llama-cpp-rpc -- -H 0.0.0.0 -p 25678Statred local instance with
LLAMACPP_GRPC_SERVERS="?.?.?.?:25678" local-ai runAnd local instance still tries to run model only locally. Worker mode don't work.
Beta Was this translation helpful? Give feedback.
All reactions