Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadrive: Flaky test behavior with Dragon Rider #34044

Closed
JakobSpahn opened this issue Nov 18, 2024 · 1 comment
Closed

Metadrive: Flaky test behavior with Dragon Rider #34044

JakobSpahn opened this issue Nov 18, 2024 · 1 comment
Labels
PC Issues related to running openpilot on PC

Comments

@JakobSpahn
Copy link
Contributor

JakobSpahn commented Nov 18, 2024

Describe the bug

ONNXCPU=1 pytest tools/sim/test/test_metadrive_bridge.py fails locally when using Dragon Rider.

FAILED tools/sim/tests/test_metadrive_bridge.py::TestMetaDriveBridge::test_driving - AssertionError: Simulator fails to finish a loop. Failure states: ['out_of_lane']

When switching to the previous model, the test always succeeds.

It would be very informative if anyone manages to reproduce (or not reproduce).


Switched between the following models:

Dragon Rider

git checkout 47bd0f0166db1268bfa5504d7b95f94264d15500 -- selfdrive/modeld/models/supercombo.onnx && scons -u -j$(nproc)

MLSIM V4

git checkout 34dde0bb36b528febee292891523e30e82835aac -- selfdrive/modeld/models/supercombo.onnx && scons -u -j$(nproc)

OS Version

Ubuntu 24.04

openpilot version or commit

c11e9a3

Additional info

No response

@JakobSpahn JakobSpahn added the PC Issues related to running openpilot on PC label Nov 18, 2024
@JakobSpahn
Copy link
Contributor Author

Closing this since the recent models all pass.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PC Issues related to running openpilot on PC
Projects
None yet
Development

No branches or pull requests

1 participant