Skip to content

Anyone has tried multi gpu inferencing using llamacpp ? If so how to set the main gpu as I get an error when trying to assign using the parameter #1496

Unanswered
shaunck96 asked this question in Q&A
Anyone has tried multi gpu inferencing using llamacpp ? If so how to set the main gpu as I get an error when trying to assign using the parameter #1496
@shaunck96 shaunck96
May 30, 2024 · 0 comments
Return to top
Discussion options

shaunck96
May 30, 2024

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant
@shaunck96