Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to poll engines for available devices #21

Closed
wants to merge 2 commits into from

Conversation

alanocallaghan
Copy link
Contributor

This seems to me the only thing needed for WSInfer/InstanSeg's use of DJL.

Not sure about how to handle when the engine isn't available, but empty set seemed more logical than assuming CPU only for an engine that effectively doesn't exist.

@petebankhead
Copy link
Member

This code looks familiar - I presume it came from the WSInfer extension?

I think MPS is only actually available with PyTorch, so we should probably restrict it to that - otherwise DJL should already know the engines. With WSInfer we knew that we were using PyTorch, so the check there wasn't needed.

(Still waiting for Apple Silicon to be supported with TensorFlow Java (seems close), and then it'll need integrated into DJL.)

@alanocallaghan
Copy link
Contributor Author

Yes from WSInfer originally, currently used in InstanSeg but it seems likely that InstanSeg won't properly support MPS either way at this point

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants