Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I send an image data when requesting an Execute session? #54

Open
gzxy-0102 opened this issue Jun 25, 2024 · 8 comments
Open

How can I send an image data when requesting an Execute session? #54

gzxy-0102 opened this issue Jun 25, 2024 · 8 comments

Comments

@gzxy-0102
Copy link

How can I send an image data when requesting an Execute session? If I send a numpy array of images, there will be a body limit error

@kibae
Copy link
Owner

kibae commented Jun 28, 2024

Hi, @gzxy-0102
I would like to know the following information to troubleshoot the problem.

  • What is the size of your numpy array?
  • Which protocol did you use, HTTP/HTTPS or TCP?
  • What did the error message say?

@gzxy-0102
Copy link
Author

Hi, @gzxy-0102 I would like to know the following information to troubleshoot the problem.

  • What is the size of your numpy array?
  • Which protocol did you use, HTTP/HTTPS or TCP?
  • What did the error message say?

Hi, @kibae
I didn't record the size of numpy, but I can provide a picture
I am using the HTTP protocol
The error message is that the body has exceeded the limit

mmexport1705047066507

kibae added a commit that referenced this issue Jun 28, 2024
@kibae kibae closed this as completed in 42a6d00 Jun 28, 2024
kibae added a commit that referenced this issue Jun 28, 2024
kibae added a commit that referenced this issue Jun 28, 2024
kibae added a commit that referenced this issue Jun 28, 2024
kibae added a commit that referenced this issue Jun 28, 2024
…port (#58)

* fixes #54: Added --request-payload-limit option for large request support
@kibae
Copy link
Owner

kibae commented Jun 28, 2024

@gzxy-0102
There was a payload size limit for HTTP/HTTPS requests. I resolved this issue by adding the --request-payload-limit option. It can also be set using the environment variable ONNX_SERVER_REQUEST_PAYLOAD_LIMIT. The unit is in bytes.
https://github.com/kibae/onnxruntime-server?tab=readme-ov-file#options

Coincidentally, onnxruntime has been updated to version 1.18.1. I have prepared a new Docker image accordingly. If you are using the Docker image, you can pass the environment variable with an option like -e "ONNX_SERVER_REQUEST_PAYLOAD_LIMIT=xxxxxxxxxxxxxxx".

Please let me know if you encounter any issues. Thank you.

@gzxy-0102
Copy link
Author

@gzxy-0102 There was a payload size limit for HTTP/HTTPS requests. I resolved this issue by adding the --request-payload-limit option. It can also be set using the environment variable ONNX_SERVER_REQUEST_PAYLOAD_LIMIT. The unit is in bytes. https://github.com/kibae/onnxruntime-server?tab=readme-ov-file#options

Coincidentally, onnxruntime has been updated to version 1.18.1. I have prepared a new Docker image accordingly. If you are using the Docker image, you can pass the environment variable with an option like -e "ONNX_SERVER_REQUEST_PAYLOAD_LIMIT=xxxxxxxxxxxxxxx".

Please let me know if you encounter any issues. Thank you.

@kibae Thank you so much. I whill try it later

@gzxy-0102
Copy link
Author

Hi @kibae
It can now send images, but when I requested the API to register the model, the request to register the model kept running

@gzxy-0102
Copy link
Author

Hi @kibae It can now send images, but when I requested the API to register the model, the request to register the model kept running

微信图片_20240701124838

@kibae kibae reopened this Jul 2, 2024
@kilievich-dmitriy-andreevich

Hi @kibae It can now send images, but when I requested the API to register the model, the request to register the model kept running

Hello! Could you please send me the code to send the image? I'm interested in its function of converting from image to JSON

@kilievich-dmitriy-andreevich

Hi @kibae It can now send images, but when I requested the API to register the model, the request to register the model kept running

微信图片_20240701124838

Yes, I have exactly the same error, in the end I just refused logging in docker volumes and just watch them through exec so that they don't spam endlessly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants