Skip to content

A collection of portable, reusable and cross-platform CM automations to modularize MLPerf and simplify the process of building and benchmarking AI systems across diverse models, data sets, software and hardware

License

Notifications You must be signed in to change notification settings

mlcommons/cm4mlops

Repository files navigation

Unified and cross-platform CM interface for DevOps, MLOps and MLPerf

License Python Version Powered by CM. Downloads

CM script automation features test MLPerf inference bert (deepsparse, tf, onnxruntime, pytorch) MLPerf inference MLCommons C++ ResNet50 MLPerf inference ABTF POC Test Test Compilation of QAIC Compute SDK (build LLVM from src) Test QAIC Software kit Compilation

CM4MLOps repository

CM4MLOps repository is powered by the Collective Mind automation framework, a Python package with a CLI and API designed for creating and managing automations.

Two key automations developed using CM are Script and Cache, which streamline machine learning (ML) workflows, including managing Docker runs. Both Script and Cache automations are part of the cm4mlops repository.

The CM scripts, also housed in this repository, consist of hundreds of modular Python-wrapped scripts accompanied by yaml metadata, enabling the creation of robust and flexible ML workflows.

The mlperf-branch of the cm4mlops repository is dedicated to developments specific to MLPerf Inference. Please submit any pull requests (PRs) to this branch. For more information about using CM for MLPerf Inference, refer to the MLPerf Inference Documentation.

News

License

Apache 2.0

CM concepts

Check our ACM REP'23 keynote and the white paper.

CM script developers

Arjun Suresh, Anandhu Sooraj, Grigori Fursin

Parent project

Visit the parent Collective Knowledge project for further details.

About

A collection of portable, reusable and cross-platform CM automations to modularize MLPerf and simplify the process of building and benchmarking AI systems across diverse models, data sets, software and hardware

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published