[BUG]: ModuleNotFoundError: No module named 'tensorrt' when using morpheus tools in nlp-si-detection example

[aadesoba-nv]

Version

24.10-release

Which installation method(s) does this occur on?

Source

Describe the bug.

when running the sid-minibert-trt model I am trying to create the model.plan for the sid-minibert-onnx modelbased on the README.md instruction here. using the command below from within the release container: it says morpheus not found.

morpheus tools onnx-to-trt --input_model ../../sid-minibert-onnx/1/model.onnx --output_model ./model.plan --batches 1 8 --batches 1 16 --batches 1 32 --seq_length 256 --max_workspace_size 16000

Minimum reproducible example

(morpheus) root@tme-vrl135-2:/workspace/models/triton-model-repo/sid-minibert-trt/1# morpheus tools onnx-to-trt --input_model ../../sid-minibert-onnx/1/sid-minibert.onnx --output_model ./sid-minibert-trt_b1-8_b1-16_b1-32.engine --batches 1 8 --batches 1 16 --batches 1 32 --seq_length 256 --max_workspace_size 16000
Usage: morpheus tools onnx-to-trt [OPTIONS]
Try 'morpheus tools onnx-to-trt --help' for help.

changed this path: '../../sid-minibert-onnx/1/sid-minibert.onnx to '../../sid-minibert-onnx/1/model.onnx now the error is a module issue

Relevant log output

Click here to see error details

[Error: Invalid value for '--input_model': Path '../../sid-minibert-onnx/1/sid-minibert.onnx' does not exist.]
cli(obj={}, auto_envvar_prefix='MORPHEUS', show_default=True, prog_name="morpheus")
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/cli/utils.py", line 116, in new_func
    return f(ctx, *args, **kwargs)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/cli/commands.py", line 225, in onnx_to_trt
    from morpheus.utils.onnx_to_trt import gen_engine
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/utils/onnx_to_trt.py", line 22, in <module>
    import tensorrt as trt
ModuleNotFoundError: No module named 'tensorrt'

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

• I agree to follow Morpheus' Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report

[morpheus-bot-test]

Hi @aadesoba-nv!

Thanks for submitting this issue - our team has been notified and we'll get back to you as soon as we can!
In the meantime, feel free to add any relevant information to this issue.