diff --git a/README.md b/README.md index bf3aebc7c..068f42aab 100755 --- a/README.md +++ b/README.md @@ -64,7 +64,7 @@ see [online catalog at CK playground](https://access.cknowledge.org/playground/? CM scripts extend the concept of `cmake` with simple Python automations, native scripts and JSON/YAML meta descriptions. They require Python 3.7+ with minimal dependencies and are -[continuously extended by the community and MLCommons members](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md) +[continuously extended by the community and MLCommons members](https://github.com/mlcommons/ck/blob/master/CONTRIBUTORS.md) to run natively on Ubuntu, MacOS, Windows, RHEL, Debian, Amazon Linux and any other operating system, in a cloud or inside automatically generated containers while keeping backward compatibility. @@ -176,7 +176,7 @@ and to advance its development as a collaborative, community-driven effort. We thank [MLCommons](https://mlcommons.org), [FlexAI](https://flex.ai) and [cTuning](https://cTuning.org) for supporting this project, -as well as our dedicated [volunteers and collaborators](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md) +as well as our dedicated [volunteers and collaborators](https://github.com/mlcommons/ck/blob/master/CONTRIBUTORS.md) for their feedback and contributions! If you found the CM automations helpful, kindly reference this article: diff --git a/cmx4mlops/README.md b/cmx4mlops/README.md index e034c78c9..674e1da1f 100644 --- a/cmx4mlops/README.md +++ b/cmx4mlops/README.md @@ -22,9 +22,10 @@ by `yaml` metadata, enabling the creation of robust and flexible ML workflows. Grigori Fursin, the cTuning foundation and OctoML donated the CK and CM projects to MLCommons to benefit everyone and encourage collaborative development. -## Maintainer(s) +## Maintainers -* MLCommons +* CM, CM4MLOps and MLPerf automations: MLCommons +* CMX (the next generation of CM): Grigori Fursin ## Author @@ -37,6 +38,25 @@ for their invaluable feedback and support! Check our [ACM REP'23 keynote](https://doi.org/10.5281/zenodo.8105339) and the [white paper](https://arxiv.org/abs/2406.16791). +## Test image classification and MLPerf R-GAT inference benchmark via CMX PYPI package + +```bash +pip install cmind +pip install cmx4mlops +cmx run script "python app image-classification onnx" --quiet +cmx run script --tags=run,mlperf,inference,generate-run-cmds,_submission,_short --submitter="MLCommons" --adr.inference-src.tags=_branch.dev --pull_changes=yes --pull_inference_changes=yes --submitter="MLCommons" --hw_name=ubuntu-latest_x86 --model=rgat --implementation=python --backend=pytorch --device=cpu --scenario=Offline --test_query_count=500 --adr.compiler.tags=gcc --category=datacenter --quiet --v --target_qps=1 +``` + +## Test image classification and MLPerf R-GAT inference benchmark via CMX GitHub repo + +```bash +pip uninstall cmx4mlops +pip install cmind +cmx pull repo mlcommons@ck --dir=cmx4mlops/cmx4mlops +cmx run script "python app image-classification onnx" --quiet +cmx run script --tags=run,mlperf,inference,generate-run-cmds,_submission,_short --submitter="MLCommons" --adr.inference-src.tags=_branch.dev --pull_changes=yes --pull_inference_changes=yes --submitter="MLCommons" --hw_name=ubuntu-latest_x86 --model=rgat --implementation=python --backend=pytorch --device=cpu --scenario=Offline --test_query_count=500 --adr.compiler.tags=gcc --category=datacenter --quiet --v --target_qps=1 +``` + ## Parent project Visit the [parent Collective Knowledge project](https://github.com/mlcommons/ck) for further details. diff --git a/cmx4mlops/cmx4mlops/cmr.yaml b/cmx4mlops/cmx4mlops/cmr.yaml index a62e4cf25..4e2dbf480 100644 --- a/cmx4mlops/cmx4mlops/cmr.yaml +++ b/cmx4mlops/cmx4mlops/cmr.yaml @@ -5,7 +5,7 @@ git: true version: "0.5.1" -author: "Grigori Fursin" +author: "Grigori Fursin and contributors" install_python_requirements: false diff --git a/cmx4mlperf/README.md b/cmx4mlperf/README.md new file mode 100644 index 000000000..a0990367e --- /dev/null +++ b/cmx4mlperf/README.md @@ -0,0 +1 @@ +TBD diff --git a/cmx4mlperf/cmx4mlperf/VERSION b/cmx4mlperf/cmx4mlperf/VERSION new file mode 100644 index 000000000..4b9fcbec1 --- /dev/null +++ b/cmx4mlperf/cmx4mlperf/VERSION @@ -0,0 +1 @@ +0.5.1 diff --git a/cmx4mlperf/cmx4mlperf/__init__.py b/cmx4mlperf/cmx4mlperf/__init__.py new file mode 100644 index 000000000..e69de29bb diff --git a/cmx4mlperf/cmx4mlperf/cmr.yaml b/cmx4mlperf/cmx4mlperf/cmr.yaml new file mode 100644 index 000000000..258c731ec --- /dev/null +++ b/cmx4mlperf/cmx4mlperf/cmr.yaml @@ -0,0 +1,14 @@ +alias: cmx4mlperf +uid: 5c24e5e0ce5a457a + +git: true + +version: "0.5.1" + +author: "Grigori Fursin and contributors" + +install_python_requirements: false + +min_cm_version: "3.5.3" + +prefix: repo