Skip to content

Issues: mlcommons/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

188 Open 698 Closed
188 Open 698 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Problem with run GPTJ-99
#2146 opened Mar 5, 2025 by Agalakdak
Inference 5.0 submission failure for Llama3.1-405b caused by hardcode in submission checker
#2142 opened Feb 28, 2025 by zhonglidaniel
1
Refactor TEST01 message so it's less confusing
#2138 opened Feb 25, 2025 by nvzhihanj
Fail to build the docker for mlc command on Ubuntu 22.04
#2132 opened Feb 25, 2025 by Bob123Yang
7
Resnet50 MLPerf 4.1 Attribute Error: ResNet50EngineBuilder object has no attribute calibrator
#2129 opened Feb 21, 2025 by SomeGuyFarAway
Error in RsNet50 server run
#2128 opened Feb 21, 2025 by KathpaliaChirag
Question: Benchmark results.
#2122 opened Feb 20, 2025 by Agalakdak
2
[GNN] Acc eval script change: incompatibility or corrupted file?
#2119 opened Feb 19, 2025 by attafosu
3
Llama3.1-405B non-zero temperature inference v5.0
#2116 opened Feb 18, 2025 by psyhtest
4
Is beam search strategy mandatory in gptj-6b benchmark?
#2107 opened Feb 12, 2025 by phoenixysj
1
LLAMA3_1-405B-99 Docker Cmind not found issues
#2105 opened Feb 11, 2025 by hhuo24pm
12
RuntimeError: list index out of range on RetinaNet
#2103 opened Feb 11, 2025 by kingjuno
1
Offline scenario Crashed for GPT-J (Failed to create file system for "mlc-inference:mlcommons-inference-wg-public/gpt-j": didn't find section in config file)
#2102 opened Feb 11, 2025 by KathpaliaChirag
1
SingleStream scenario crashes for Resnet50
#2100 opened Feb 7, 2025 by nintendoit
2
Inference [4.1.5] Inference nvidia-smi command exits but failed to execute
#2098 opened Feb 6, 2025 by msalaz03
Create MLCommons Croissant Metadata for the Datasets created by MLCommons Inference WG croissant
#2076 opened Feb 2, 2025 by arjunsuresh
Official Readme files are having Huggingface Download Links for the Llama models needed-for-v5.0
#2075 opened Feb 1, 2025 by arjunsuresh
Release mlcommons inference submission tools as a Python package postmortem 5.0
#2074 opened Feb 1, 2025 by arjunsuresh
Need to fix TEST01 performance check postmortem 5.0
#2072 opened Feb 1, 2025 by arjunsuresh
[405b-SUT] Max number of output tokens
#2060 opened Jan 28, 2025 by attafosu
1
The documents are outdated
#2048 opened Jan 23, 2025 by MohdShariq91
1
Save the docker with Resnet50 running successfully and load it on another system with the same config but fail to run Resnet50
#2023 opened Jan 9, 2025 by Bob123Yang
1
Fail to build the GPT-J docker after successfully installation of tensorrt-llm
#2022 opened Jan 8, 2025 by Bob123Yang
2
mixtral-8x7b: Reference Implementation Accuracy Failure on H200
#2018 opened Jan 7, 2025 by mrmhodak
8
Metrics definition and settings used for LLM benchmarks
#2012 opened Jan 3, 2025 by vineel96
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.