Skip to content

Releases: tenstorrent/tt-metal

v0.56.0-rc3

31 Jan 02:08
@github-actions github-actions
v0.56.0-rc3
1550e2a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.56.0-rc3 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/13064647165

📦 Uncategorized

  • #0: Add a way to specify custom dispatch topology
  • Initialize work_executor_ and set WorkExecutorMode::SYNCHRONOUS in MeshDevice constructor
  • [UMD] Switching to new coord API
  • #0: Increase create heads test coverage for Llama shapes
  • #16503: Optimize semaphore and CB writes
  • Quiet down the CMake output from dependencies
  • #16847: update to address the unaligned noc_async_copy from DRAM to L1
  • remove ND failing big shape in transpose failures that is already tracked and disabled in test_transpose_2d
  • #14898: pass in pad value to transpose in reduce
  • rm -rf build.yaml
  • #16982: Fixing program cache issues with reshape
  • Delete convd_host_weights and update all tests using conv2d
  • Update CODEOWNERS for the public API
  • Aliu/bug fix
  • #0: Move distributed headers into the public API directory
  • [Llama3.2-11b-vision] Add support for text-only inference through generator api
  • Remove references to ARCH_NAME in programming example
  • Enable PR Gate
  • #16806: Fixed watcher assert on reshape in debug mode
  • #0: Fix doc links and make them point to the new location
  • Remove ARCH_NAME references in prog_examples
  • Prefer MOLD over LLD over LD
  • Restore build-wrapper.yaml with updated method
  • [TT-Train] Fix text generation
  • LightMetal - Add Flatbuffers into cmake infra/build as cpm package (#17039)
  • Format broken Kernel APIs Tables
  • #0: Use MeshBuffer to store MeshWorkload kernel binaries
  • Increase rms_norm and layernorm coverage for Llama shapes
  • #17213: update fused and matmul trace sweep tests
  • Add support for reading from / writing to partial buffer regions that are page size aligned for sharded buffers
  • #0: Fix clang-format for dataflow_api.h
  • Kkabilar tt single card perf
  • [FABRIC] ASYNC_WR_ATOMIC_INC
  • #9945: Enable and fix SD device perf test
  • Check context switch pointer for eth cores before resetting
  • Pull llrt.hpp out of public interface
  • Update perf and latest features for llm models (Jan 27)
  • #0: (MINOR) Bump to generate RCs for v0.57.0
  • Remove dead includes of host_api.hpp from ttnn
  • Prevent UNet Shallow perf report entry from being overwritten
  • Fix setup.py for Anaconda
  • Do not run PR Gate on Draft PRs
  • Add a timeout for docker image building
  • LightMetal - New APIs LightMetalBeginCapture() and LightMetalEndCapture() and docs (#17039)
  • #0: Update distributed tests build to account for arch
  • #17227: Make dispatch core order match for single chip 2 CQ and multchip 2 CQ topologies
  • #17215: Add explicit dealloc for mesh buffer
  • #0: Add validation test for dispatched remote circular buffer config to device
  • Remove get_completion_queue_reader_core() API from Device
  • Add resharding to post all gather layernorm/ rms norm op
  • #0: Fix ttnn shared libs build
  • #0: Schedule runs for single card new models tests
  • Implement JointAttention
  • Revert "Add resharding to post all gather layernorm/ rms norm op (#17156)
  • Update memory config when using view op with height sharded tensors
  • #16812: Reordering cbs in reduce_init_delta
  • #17083: Add support for watcher printing phys coords
  • #16945: Add auto retries to post commit on branches
  • Remove CommandQueue redirecting usages straight to HWCQ
  • 1D support for tilize/reshape ops
  • #16138: W-broadcasting for sharded tensors
  • #0: Add PR Gate to data pipeline
  • #15174: Re-enable mistral7b demo test after fw upgrade
  • LightMetal - Add LoadTrace() API and move TraceDescriptor out of detail namespace (#17039)
  • #15974: Create device tensors table in report database
  • Privatize dprint_server.hpp
  • Uplift Allocator to be its own class + migrate calls to Allocator APIs
  • Bump CMake in the Docker image
  • Add perf reporting for ccl async mode
  • Fix debug checks for bank assignments when initializing the allocator
  • Add perf report for reduce scatter async
  • #0: expand halo documentation and fix images
  • Fix shard and physical height mismatch in ttnn.convert_to_chw tests
  • #17134: Remove unused components
  • #0: Fix retry comparison which causes endless retries until pass
  • Make runtime_args_ptr const ref to solve clang-tidy error due to 58f9654
  • Use padded shape to construct output memory config in ttnn.view
  • #17322 Remove transpose cpp unit tests
  • #17215: Initial MeshBuffer integration with TTNN
  • fix sub-height height sharded WH transpose by setting output memory config to width sharded
  • #0: Only produce cicd data on workflow runs that are success/failure/cancelled (ignore skipped runs)
  • #0: Use posted writes for profiler.
  • #16149: Add DeviceCommandCalculator to calculate command size
  • #15889: Fix handling of mantissa rounding to respect ties round to even
  • #17312: Fix type error when saving report config to json file
  • Implement ttnn.sampling op for top-k, top-p sampling
  • Test for a bad state before building
  • #0: Fix incorrect assertion introduced in #17259
  • #0: Add missing include for work_split.hpp
  • Replace ttnn::Shape/LegacyShape with SimpleShape in Python
  • #0: Correcting bad dim check in CCL tests
  • [tt-train] Add scatter workaround while proper version is in development
  • [skip-ci] Bump timeout
  • #15414: Read annotation data to determine job-level failure signature and reason
  • #0: TT-Mesh bug fix MeshCQ/MeshWorkload on device indexing
  • #17374: Add concurrency group for _produce-data.yaml
  • Revert "#17374: Add concurrency group for _produce-data.yaml"
  • #0: Fix broken link for "Programming Mesh of Devices" tech report
  • Revert "#15414: Read annotation data to determine job-level failure signature and reason"
  • Debug strange error
Assets 9
Loading

v0.56.0-rc2

30 Jan 02:07
@github-actions github-actions
v0.56.0-rc2
064646a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.56.0-rc2 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/13043899749

📦 Uncategorized

  • #0: Add a way to specify custom dispatch topology
  • Initialize work_executor_ and set WorkExecutorMode::SYNCHRONOUS in MeshDevice constructor
  • [UMD] Switching to new coord API
  • #0: Increase create heads test coverage for Llama shapes
  • #16503: Optimize semaphore and CB writes
  • Quiet down the CMake output from dependencies
  • #16847: update to address the unaligned noc_async_copy from DRAM to L1
  • remove ND failing big shape in transpose failures that is already tracked and disabled in test_transpose_2d
  • #14898: pass in pad value to transpose in reduce
  • rm -rf build.yaml
  • #16982: Fixing program cache issues with reshape
  • Delete convd_host_weights and update all tests using conv2d
  • Update CODEOWNERS for the public API
  • Aliu/bug fix
  • #0: Move distributed headers into the public API directory
  • [Llama3.2-11b-vision] Add support for text-only inference through generator api
  • Remove references to ARCH_NAME in programming example
  • Enable PR Gate
  • #16806: Fixed watcher assert on reshape in debug mode
  • #0: Fix doc links and make them point to the new location
  • Remove ARCH_NAME references in prog_examples
  • Prefer MOLD over LLD over LD
  • Restore build-wrapper.yaml with updated method
  • [TT-Train] Fix text generation
  • LightMetal - Add Flatbuffers into cmake infra/build as cpm package (#17039)
  • Format broken Kernel APIs Tables
  • #0: Use MeshBuffer to store MeshWorkload kernel binaries
  • Increase rms_norm and layernorm coverage for Llama shapes
  • #17213: update fused and matmul trace sweep tests
  • Add support for reading from / writing to partial buffer regions that are page size aligned for sharded buffers
  • #0: Fix clang-format for dataflow_api.h
  • Kkabilar tt single card perf
  • [FABRIC] ASYNC_WR_ATOMIC_INC
  • #9945: Enable and fix SD device perf test
  • Check context switch pointer for eth cores before resetting
  • Pull llrt.hpp out of public interface
  • Update perf and latest features for llm models (Jan 27)
  • #0: (MINOR) Bump to generate RCs for v0.57.0
  • Remove dead includes of host_api.hpp from ttnn
  • Prevent UNet Shallow perf report entry from being overwritten
  • Fix setup.py for Anaconda
  • Do not run PR Gate on Draft PRs
  • Add a timeout for docker image building
  • LightMetal - New APIs LightMetalBeginCapture() and LightMetalEndCapture() and docs (#17039)
  • #0: Update distributed tests build to account for arch
  • #17227: Make dispatch core order match for single chip 2 CQ and multchip 2 CQ topologies
  • #17215: Add explicit dealloc for mesh buffer
  • #0: Add validation test for dispatched remote circular buffer config to device
  • Remove get_completion_queue_reader_core() API from Device
  • Add resharding to post all gather layernorm/ rms norm op
  • #0: Fix ttnn shared libs build
  • #0: Schedule runs for single card new models tests
  • Implement JointAttention
  • Revert "Add resharding to post all gather layernorm/ rms norm op (#17156)
  • Update memory config when using view op with height sharded tensors
  • #16812: Reordering cbs in reduce_init_delta
  • #17083: Add support for watcher printing phys coords
  • #16945: Add auto retries to post commit on branches
  • Remove CommandQueue redirecting usages straight to HWCQ
  • 1D support for tilize/reshape ops
  • #16138: W-broadcasting for sharded tensors
  • #0: Add PR Gate to data pipeline
  • #15174: Re-enable mistral7b demo test after fw upgrade
  • LightMetal - Add LoadTrace() API and move TraceDescriptor out of detail namespace (#17039)
  • #15974: Create device tensors table in report database
  • Privatize dprint_server.hpp
  • Uplift Allocator to be its own class + migrate calls to Allocator APIs
  • Bump CMake in the Docker image
Assets 9
Loading

v0.56.0-rc1

29 Jan 02:07
@github-actions github-actions
v0.56.0-rc1
c8d0488
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.56.0-rc1 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/13022911064

📦 Uncategorized

  • #0: Add a way to specify custom dispatch topology
  • Initialize work_executor_ and set WorkExecutorMode::SYNCHRONOUS in MeshDevice constructor
  • [UMD] Switching to new coord API
  • #0: Increase create heads test coverage for Llama shapes
  • #16503: Optimize semaphore and CB writes
  • Quiet down the CMake output from dependencies
  • #16847: update to address the unaligned noc_async_copy from DRAM to L1
  • remove ND failing big shape in transpose failures that is already tracked and disabled in test_transpose_2d
  • #14898: pass in pad value to transpose in reduce
  • rm -rf build.yaml
  • #16982: Fixing program cache issues with reshape
  • Delete convd_host_weights and update all tests using conv2d
  • Update CODEOWNERS for the public API
  • Aliu/bug fix
  • #0: Move distributed headers into the public API directory
  • [Llama3.2-11b-vision] Add support for text-only inference through generator api
  • Remove references to ARCH_NAME in programming example
  • Enable PR Gate
  • #16806: Fixed watcher assert on reshape in debug mode
  • #0: Fix doc links and make them point to the new location
  • Remove ARCH_NAME references in prog_examples
  • Prefer MOLD over LLD over LD
  • Restore build-wrapper.yaml with updated method
  • [TT-Train] Fix text generation
  • LightMetal - Add Flatbuffers into cmake infra/build as cpm package (#17039)
  • Format broken Kernel APIs Tables
  • #0: Use MeshBuffer to store MeshWorkload kernel binaries
  • Increase rms_norm and layernorm coverage for Llama shapes
  • #17213: update fused and matmul trace sweep tests
  • Add support for reading from / writing to partial buffer regions that are page size aligned for sharded buffers
  • #0: Fix clang-format for dataflow_api.h
  • Kkabilar tt single card perf
  • [FABRIC] ASYNC_WR_ATOMIC_INC
  • #9945: Enable and fix SD device perf test
  • Check context switch pointer for eth cores before resetting
  • Pull llrt.hpp out of public interface
  • Update perf and latest features for llm models (Jan 27)
  • #0: (MINOR) Bump to generate RCs for v0.57.0
  • Remove dead includes of host_api.hpp from ttnn
  • Prevent UNet Shallow perf report entry from being overwritten
  • Fix setup.py for Anaconda
  • Do not run PR Gate on Draft PRs
Assets 9
Loading

v0.55.0

28 Jan 21:00
@github-actions github-actions
v0.55.0
dc5def7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0 Latest
Latest

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/13018933285

📦 Uncategorized

  • Create an API for running and measuring the runtime of a ttnn op chain for use during forge compilation
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimize usage and implementation of encode/decode tensor data
  • Device to Device profiler sync
  • Templating and Queue Size Adjustments for Packet Queue
  • Refactor Superset model benchmarking tools to use Pydantic classes and save one json
  • #16078: Fix back-to-back calls of ttnn.close_device()
  • #16434: DPRINT to read buffer once
  • Bring Taskflow from CPM
  • This file seems to be kernel-only
  • Minor SDPA optimizations
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Eltwise Unary
  • Fix scaling issue with RT arguments in tilize/untilize with padding
  • Make stress noc mcast test respect physical coordinates + allow option to skip mcaster
  • Fix some shapes for Prefetcher + Matmul, Use Multi-device Global CB
  • Do not build UMD tests
  • Move risc_attribs back to hw/inc
  • Re-enable UNet Shallow trace+2CQ test case
  • Upgrade error message in control plane
  • #15824 Workaround LLK issue in max_pool
  • [skip ci] Fixed TG configuration description in documentation
  • #0: Update pgm_dispatch_golden.json
  • #0: fix stackoverflow in eth tun
  • #0: Refactor enqueue_write_buffer
  • #0: Add skip for mnist tests because I can't take this anymore
  • #0: Remove SetLazyCommandQueueMode from Metal API
  • #16868: Update profiler post proc asserts tripping due to kernel preload
  • #16350: Update reciprocal docs
  • [skip ci] : Update INSTALLING.md
  • Remove sharded_to_interleaved workaround in UNet Shallow
  • Add CI job for running models in comparison mode
  • pybind expose MeshDevice::reshape
  • #0: Update sweeps README
  • Workaround issue #16895, fix PCC checking for wormhole in Resnet50 demo
  • #0: Refactor enqueue_read_buffer
  • move device checking outside of invalidate code func
  • Disable Unstable Transpose 2D Test
  • New Operation: Fill_Tile_Pad ; Op to fill tile padding with a specific value
  • #0: Separate HWCommandQueue in it's own header
  • Update Mamba device performance targets
  • Changing how we setup simulator.
  • Add missing include for types used
  • Adding active erisc FW for BH + support for compiling this + updating BH eth_l1_address_map
  • disable test_transpose_2D due to python-side segfault
  • #16913: Add Model Updates to the Release assets
  • Add Datagram Sockets to Fabric
  • [Llama3] Send decode output logits to dram to reduce trace l1 usage and fix 8b-n150 memory crash
  • Sharding support for binary_ng
  • Fix mcast end core for stress noc mcast test
  • #13901: MaxPool Wide Reductions with Non-8-Tile Multiples
  • Make creation functions use SimpleShape, expose SimpleShape & TensorSpec to Python
  • Feature/vecadd sharding
  • Resolve the issue in ubenchmark pipeline
  • #0: update test_vc_uni_tunnel bw requirement
  • [tt-train] Fix broken build due to taskflow change
  • #16415: fix moreh_adam
  • #16469 Add sharding to vecadd example
  • Revert "#16469 Add sharding to vecadd example"
  • Revert "Feature/vecadd sharding"
  • #13195: Squeezebert using Conv1d Width Sharded
  • Cleanup of various issues
  • Add sweeps with pre-allocated output for topk and argmax
  • #16510: Eltwise sweep test for add and mul + silu - LLama
  • Fixing variable name to build umd tests
  • #15246: Add sweeps for acos...
Read more
Assets 9
Loading

v0.55.0-rc20

28 Jan 02:06
@github-actions github-actions
v0.55.0-rc20
28554c9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0-rc20 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/13001851215

📦 Uncategorized

  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimize usage and implementation of encode/decode tensor data
  • Device to Device profiler sync
  • Templating and Queue Size Adjustments for Packet Queue
  • Refactor Superset model benchmarking tools to use Pydantic classes and save one json
  • #16078: Fix back-to-back calls of ttnn.close_device()
  • #16434: DPRINT to read buffer once
  • Bring Taskflow from CPM
  • This file seems to be kernel-only
  • Minor SDPA optimizations
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Eltwise Unary
  • Fix scaling issue with RT arguments in tilize/untilize with padding
  • Make stress noc mcast test respect physical coordinates + allow option to skip mcaster
  • Fix some shapes for Prefetcher + Matmul, Use Multi-device Global CB
  • Do not build UMD tests
  • Move risc_attribs back to hw/inc
  • Re-enable UNet Shallow trace+2CQ test case
  • Upgrade error message in control plane
  • #15824 Workaround LLK issue in max_pool
  • [skip ci] Fixed TG configuration description in documentation
  • #0: Update pgm_dispatch_golden.json
  • #0: fix stackoverflow in eth tun
  • #0: Refactor enqueue_write_buffer
  • #0: Add skip for mnist tests because I can't take this anymore
  • #0: Remove SetLazyCommandQueueMode from Metal API
  • #16868: Update profiler post proc asserts tripping due to kernel preload
  • #16350: Update reciprocal docs
  • [skip ci] : Update INSTALLING.md
  • Remove sharded_to_interleaved workaround in UNet Shallow
  • Add CI job for running models in comparison mode
  • pybind expose MeshDevice::reshape
  • #0: Update sweeps README
  • Workaround issue #16895, fix PCC checking for wormhole in Resnet50 demo
Assets 9
Loading

v0.55.0-rc19

27 Jan 02:09
@github-actions github-actions
v0.55.0-rc19
dc5def7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0-rc19 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/12980411497

📦 Uncategorized

  • Remove ARCH_NAME from host library code
  • #16367: Added support to enable dram and l1 memory collection without saving to disk
  • Update .clang-format-ignore
  • Tweak BH csrrs init code
  • #0: Clean up confusing refs to Greyskull from ttnn.copy error messages.
  • Update perf and latest features for llm models (Jan 13)
  • Update README.md
  • #16657: Fix to_layout conversion into row major for 1D tensors
  • Tilize with val padding results in L1 cache OOM
  • #0: Fixes from commit ae61802
  • #0: Skip build-docker-image during post-commit code-analysis since the docker image is already built in a previous job
  • Generate test executables per architecture
  • #16587: Update UMD submodule commit for P150 compatibility
  • Replace some instances of Tensor::get_shape with get_logical_shape
  • Update METALIUM_GUIDE.md
  • #16621: Add barriers at end of cq_dispatch_slave.cpp on IERISC
  • Finish porting OPs to compute_output_specs
  • ScopedGraphCapture
  • #15756 Pull in BH LLK fix for maxpool hang
  • #15246: Add sweep tests for logical_and, logical_or, logical_xor
  • #0: (MINOR) Bump to v0.55.0
  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimize usage and implementation of encode/decode tensor data
  • Device to Device profiler sync
  • Templating and Queue Size Adjustments for Packet Queue
  • Refactor Superset model benchmarking tools to use Pydantic classes and save one json
  • #16078: Fix back-to-back calls of ttnn.close_device()
  • #16434: DPRINT to read buffer once
  • Bring Taskflow from CPM
  • This file seems to be kernel-only
  • Minor SDPA optimizations
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Eltwise Unary
  • Fix scaling issue with RT arguments in tilize/untilize with padding
  • Make stress noc mcast test respect physical coordinates + allow option to skip mcaster
  • Fix some shapes for Prefetcher + Matmul, Use Multi-device Global CB
  • Do not build UMD tests
  • Move risc_attribs back to hw/inc
  • Re-enable UNet Shallow trace+2CQ test case
  • Upgrade error message in control plane
  • #15824 Workaround LLK issue in max_pool
  • [skip ci] Fixed TG configuration description in documentation
  • #0: Update pgm_dispatch_golden.json
  • #0: fix stackoverflow in eth tun
  • #0: Refactor enqueue_write_buffer
  • #0: Add skip for mnist tests because I can't take this anymore
  • #0: Remove SetLazyCommandQueueMode from Metal API
  • #16868: Update profiler post proc asserts tripping due to kernel preload
  • #16350: Update reciprocal docs
  • [skip ci] : Update INSTALLING.md
  • Remove sharded_to_interleaved workaround in UNet Shallow
  • Add CI job for running models in comparison mode
  • pybind expose MeshDevice::reshape
  • #0: Update sweeps README
  • Workaround issue #16895, fix PCC checking for wormhole in Resnet50 demo
Assets 9
Loading

v0.55.0-rc18

25 Jan 02:06
@github-actions github-actions
v0.55.0-rc18
8a59830
Compare
Choose a tag to compare
v0.55.0-rc18 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/12960537424

📦 Uncategorized

  • Remove ARCH_NAME from host library code
  • #12253: Implement Batch norm operation for inference mode
  • #16443: Add a programming example of vecadd_multi_core and gtest
  • Enable to/from torch tests for 0D/1D tensors
  • Port all data movements ops to compute_output_specs
  • #15246: Add sweep tests for addcdiv, addcmul, rdiv, rsub, ceil
  • Fix build break
  • Logical sharding for input tensor and halo output
  • #16495: reduce grid for falcon7b mlp matmul
  • Stress NOC mcast test
  • [skip ci] Update subdevice doc
  • Read from and write to partial buffer regions for interleaved buffers where offset and size of specified buffer region are divisible by buffer page size
  • Fix resnet large on GS
  • Fix Pre-allgather Layernorm bad PCC when use 1D reduction
  • #16353: skip no volume tensors
  • Create README.md
  • Update README.md
  • #16367: Added support to enable dram and l1 memory collection without saving to disk
  • Update .clang-format-ignore
  • Tweak BH csrrs init code
  • #0: Clean up confusing refs to Greyskull from ttnn.copy error messages.
  • Update perf and latest features for llm models (Jan 13)
  • Update README.md
  • #16657: Fix to_layout conversion into row major for 1D tensors
  • Tilize with val padding results in L1 cache OOM
  • #0: Fixes from commit ae61802
  • #0: Skip build-docker-image during post-commit code-analysis since the docker image is already built in a previous job
  • Generate test executables per architecture
  • #16587: Update UMD submodule commit for P150 compatibility
  • Replace some instances of Tensor::get_shape with get_logical_shape
  • Update METALIUM_GUIDE.md
  • #16621: Add barriers at end of cq_dispatch_slave.cpp on IERISC
  • Finish porting OPs to compute_output_specs
  • ScopedGraphCapture
  • #15756 Pull in BH LLK fix for maxpool hang
  • #15246: Add sweep tests for logical_and, logical_or, logical_xor
  • #0: (MINOR) Bump to v0.55.0
  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimize usage and implementation of encode/decode tensor data
  • Device to Device profiler sync
  • Templating and Queue Size Adjustments for Packet Queue
  • Refactor Superset model benchmarking tools to use Pydantic classes and save one json
  • #16078: Fix back-to-back calls of ttnn.close_device()
  • #16434: DPRINT to read buffer once
  • Bring Taskflow from CPM
  • This file seems to be kernel-only
  • Minor SDPA optimizations
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Eltwise Unary
  • Fix scaling issue with RT arguments in tilize/untilize with padding
  • Make stress noc mcast test respect physical coordinates + allow option to skip mcaster
  • Fix some shapes for Prefetcher + Matmul, Use Multi-device Global CB
  • Do not build UMD tests
  • Move risc_attribs back to hw/inc
  • Re-enable UNet Shallow trace+2CQ test case
  • Upgrade error message in control plane
  • #15824 Workaround LLK issue in max_pool
  • [skip ci] Fixed TG configuration description in documentation
  • #0: Update pgm_dispatch_golden.json
  • #0: fix stackoverflow in eth tun
  • #0: Refactor enqueue_write_buffer...
Read more
Assets 9
Loading

v0.55.0-rc15

24 Jan 16:29
@github-actions github-actions
v0.55.0-rc15
c8b0fa8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0-rc15 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/12953022780

📦 Uncategorized

  • Enable multi-core and fixing bfloat8 for untilize with unpadding
  • Remove ARCH_NAME from host library code
  • Support subcoregrids in concat_heads
  • Build wheels in ttnn unit tests workflow because the tests need it and we forgot to put it in
  • #16590: profiler trace detection fix
  • #16503: Optimize CoreRangeSets for CBs and semaphores
  • Revert "#16621: Add barriers at end of cq_dispatch_slave.cpp"
  • Fix nightly stable diffusion tests
  • #0: Used github team for conv files
  • Sweeps: fixed abs, added acos and acosh sharded and non sharded
  • fix reduce scatter multi-link support bug
  • support i/p tensors of all dimensions/rank for prod operation
  • Create Infrastructure to exactly calculate L1 Memory Usage for Conv2D #15088
  • #12253: Implement Batch norm operation for inference mode
  • Port all experimental ops to compute_output_specs
  • #16443: Add a programming example of vecadd_multi_core and gtest
  • Enable to/from torch tests for 0D/1D tensors
  • Port all data movements ops to compute_output_specs
  • #15246: Add sweep tests for addcdiv, addcmul, rdiv, rsub, ceil
  • Fix build break
  • Logical sharding for input tensor and halo output
  • #16495: reduce grid for falcon7b mlp matmul
  • Stress NOC mcast test
  • [skip ci] Update subdevice doc
  • Read from and write to partial buffer regions for interleaved buffers where offset and size of specified buffer region are divisible by buffer page size
  • Fix resnet large on GS
  • Fix Pre-allgather Layernorm bad PCC when use 1D reduction
  • #16353: skip no volume tensors
  • Create README.md
  • Update README.md
  • #16367: Added support to enable dram and l1 memory collection without saving to disk
  • Update .clang-format-ignore
  • Tweak BH csrrs init code
  • #0: Clean up confusing refs to Greyskull from ttnn.copy error messages.
  • Update perf and latest features for llm models (Jan 13)
  • Update README.md
  • #16657: Fix to_layout conversion into row major for 1D tensors
  • Tilize with val padding results in L1 cache OOM
  • #0: Fixes from commit ae61802
  • #0: Skip build-docker-image during post-commit code-analysis since the docker image is already built in a previous job
  • Generate test executables per architecture
  • #16587: Update UMD submodule commit for P150 compatibility
  • Replace some instances of Tensor::get_shape with get_logical_shape
  • Update METALIUM_GUIDE.md
  • #16621: Add barriers at end of cq_dispatch_slave.cpp on IERISC
  • Finish porting OPs to compute_output_specs
  • ScopedGraphCapture
  • #15756 Pull in BH LLK fix for maxpool hang
  • #15246: Add sweep tests for logical_and, logical_or, logical_xor
  • #0: (MINOR) Bump to v0.55.0
  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimize usage and implementation of encode/decode tensor data
  • Device to Device profiler sync
  • Templating and Queue Size Adjustments for Packet Queue
  • Refactor Superset model benchmarking tools to use Pydantic classes and save one json
  • #16078: Fix back-to-back calls of ttnn.close_device()
  • #16434: DPRINT to read buffer once
  • Bring Taskflow from CPM
  • This file seems to be k...
Read more
Assets 9
Loading

v0.55.0-rc14

24 Jan 02:07
@github-actions github-actions
v0.55.0-rc14
0d54d94
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0-rc14 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/12941480379

📦 Uncategorized

  • Remove halo from shard spec
  • Enable multi-core and fixing bfloat8 for untilize with unpadding
  • Composite binary sweeps: gcd and lcm
  • Remove ARCH_NAME from host library code
  • [tt-train] Add nanogpt ddp mode
  • #16312: Fix full op to query physical shape for buffer volume
  • #16366: Changed default kernal_config_val for 32bit matmul
  • #16621: Add barriers at end of cq_dispatch_slave.cpp
  • Build wheels in models unit tests workflow
  • Mo/10234 eth dispatch profiling
  • Support subcoregrids in concat_heads
  • Build wheels in ttnn unit tests workflow because the tests need it and we forgot to put it in
  • #16590: profiler trace detection fix
  • #16503: Optimize CoreRangeSets for CBs and semaphores
  • Revert "#16621: Add barriers at end of cq_dispatch_slave.cpp"
  • Fix nightly stable diffusion tests
  • #0: Used github team for conv files
  • Sweeps: fixed abs, added acos and acosh sharded and non sharded
  • fix reduce scatter multi-link support bug
  • support i/p tensors of all dimensions/rank for prod operation
  • Create Infrastructure to exactly calculate L1 Memory Usage for Conv2D #15088
  • #12253: Implement Batch norm operation for inference mode
  • Port all experimental ops to compute_output_specs
  • #16443: Add a programming example of vecadd_multi_core and gtest
  • Enable to/from torch tests for 0D/1D tensors
  • Port all data movements ops to compute_output_specs
  • #15246: Add sweep tests for addcdiv, addcmul, rdiv, rsub, ceil
  • Fix build break
  • Logical sharding for input tensor and halo output
  • #16495: reduce grid for falcon7b mlp matmul
  • Stress NOC mcast test
  • [skip ci] Update subdevice doc
  • Read from and write to partial buffer regions for interleaved buffers where offset and size of specified buffer region are divisible by buffer page size
  • Fix resnet large on GS
  • Fix Pre-allgather Layernorm bad PCC when use 1D reduction
  • #16353: skip no volume tensors
  • Create README.md
  • Update README.md
  • #16367: Added support to enable dram and l1 memory collection without saving to disk
  • Update .clang-format-ignore
  • Tweak BH csrrs init code
  • #0: Clean up confusing refs to Greyskull from ttnn.copy error messages.
  • Update perf and latest features for llm models (Jan 13)
  • Update README.md
  • #16657: Fix to_layout conversion into row major for 1D tensors
  • Tilize with val padding results in L1 cache OOM
  • #0: Fixes from commit ae61802
  • #0: Skip build-docker-image during post-commit code-analysis since the docker image is already built in a previous job
  • Generate test executables per architecture
  • #16587: Update UMD submodule commit for P150 compatibility
  • Replace some instances of Tensor::get_shape with get_logical_shape
  • Update METALIUM_GUIDE.md
  • #16621: Add barriers at end of cq_dispatch_slave.cpp on IERISC
  • Finish porting OPs to compute_output_specs
  • ScopedGraphCapture
  • #15756 Pull in BH LLK fix for maxpool hang
  • #15246: Add sweep tests for logical_and, logical_or, logical_xor
  • #0: (MINOR) Bump to v0.55.0
  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update llms.md
  • fuse residual add with layernorm
  • [TT-Train] Add multidevice support to dropout
  • #16171: Preload kernels before receiving go message
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Test Kernels
  • #16366: Changed kernel config to HiFi4 for 32F matmul
  • Add nightly APC run in debug mode
  • [skip ci] Update llms.md
  • [skip ci] Update llms.md
  • Remove some ARCH_NAME ENV usage at runtime
  • Move out tensor storage into a separate .hpp/.cpp
  • #16460: Add more helpful error message when tt-topology needs to be run
  • Make creation functions use SimpleShape, expose SimpleShape to Python
  • #16242: Initial implementation of MeshBuffer
  • Enable use-override check
  • Privatize Taskflow
  • Fix test_new_all_gather.py regressions caused by API unification between Device/MeshDevice
  • Fix CB allocation warnings from ttnn.reshard
  • Optimize upsample for bilinear mode
  • Remove Shape usage from MultiDeviceStorage
  • Remove redundant bank offset from destination address in ttnn.reshard
  • Add option to raise error on failed local/global tensor comparison
  • Padded Shards for Concat Support
  • #0: Add support for tracing some sub-devices while others are still running programs
  • #16769: bring up all reduce async as a composite op and added llama shape ccl test sweep
  • #0: Lower Size to metalium as Shape2D
  • #15976: Ensure reports insert all devices into the devices table
  • Modify UNet Shallow to return output in CHW channel ordering
  • #16758: Optimiz...
Read more
Assets 9
Loading

v0.55.0-rc13

23 Jan 09:52
@github-actions github-actions
v0.55.0-rc13
a21a47d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.55.0-rc13 Pre-release
Pre-release

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/12925964343

📦 Uncategorized

  • fix multi-iter in reduce scatter and adopt runtime arg overrider infra
  • [tt-train] Add linear regression ddp example
  • Remove eth_l1_address_params.h from device.cpp
  • Sharded sweeps: exp, exp2, expm1, erfc, erfinv, round, log
  • Fix ttnn.concat golden function when groups > 1
  • #16171: Assert that NCRISC NOC is idle at kernel end.
  • Remove eth_l1_address_params.h from tt_cluster.cpp and watcher
  • Remove dev_mem_map.h usage from watcher_device_reader.cpp
  • #14616: Remove ARCH_* ifdefs from tt_cluster.cpp
  • Add support for DRAM Prefetcher op
  • Resolve reduce-scatter-async sharded tensor correctness bug & hang
  • disable flaky t3k test
  • Remove "noc_parameters.h" from device.cpp
  • Remove restriction of input_nsticks_per_core % w == 0
  • Add tt-forge sweep for conv2d.
  • Remove noc header file inclusion from watcher_device_reader.cpp
  • Fix ttnn.from_torch for 0D/1D tensors with tile layout
  • Short list failing conv2d for forge sweeps
  • Remove halo from shard spec
  • Address issues of var & std
  • #16492: Remove sub_device_ids apis from various read/write functions throughout the stack
  • #6344: Update RoBERTa QA demo
  • Remove noc_parameters.h inclusion from ttnn
  • Resubmit #16339: parameterize dispatch_constants
  • #11512: Refactor bitwise sweeps, add bitwise sharded sweeps, modify t…
  • Update CODEOWNERS
  • Enable multi-core and fixing bfloat8 for untilize with unpadding
  • Set up targeting idle eth cores on BH - won't enable because of hang debug
  • Reorganize Print Pages Infrastructure
  • lower fabric erisc datamover eth context switching frequency when workload is running
  • Composite binary sweeps: gcd and lcm
  • Remove ARCH_NAME from host library code
  • [tt-train] Add nanogpt ddp mode
  • #16312: Fix full op to query physical shape for buffer volume
  • #16366: Changed default kernal_config_val for 32bit matmul
  • #16621: Add barriers at end of cq_dispatch_slave.cpp
  • Build wheels in models unit tests workflow
  • Mo/10234 eth dispatch profiling
  • Support subcoregrids in concat_heads
  • Build wheels in ttnn unit tests workflow because the tests need it and we forgot to put it in
  • #16590: profiler trace detection fix
  • #16503: Optimize CoreRangeSets for CBs and semaphores
  • Revert "#16621: Add barriers at end of cq_dispatch_slave.cpp"
  • Fix nightly stable diffusion tests
  • #0: Used github team for conv files
  • Sweeps: fixed abs, added acos and acosh sharded and non sharded
  • fix reduce scatter multi-link support bug
  • support i/p tensors of all dimensions/rank for prod operation
  • Create Infrastructure to exactly calculate L1 Memory Usage for Conv2D #15088
  • #12253: Implement Batch norm operation for inference mode
  • Port all experimental ops to compute_output_specs
  • #16443: Add a programming example of vecadd_multi_core and gtest
  • Enable to/from torch tests for 0D/1D tensors
  • Port all data movements ops to compute_output_specs
  • #15246: Add sweep tests for addcdiv, addcmul, rdiv, rsub, ceil
  • Fix build break
  • Logical sharding for input tensor and halo output
  • #16495: reduce grid for falcon7b mlp matmul
  • Stress NOC mcast test
  • [skip ci] Update subdevice doc
  • Read from and write to partial buffer regions for interleaved buffers where offset and size of specified buffer region are divisible by buffer page size
  • Fix resnet large on GS
  • Fix Pre-allgather Layernorm bad PCC when use 1D reduction
  • #16353: skip no volume tensors
  • Create README.md
  • Update README.md
  • #16367: Added support to enable dram and l1 memory collection without saving to disk
  • Update .clang-format-ignore
  • Tweak BH csrrs init code
  • #0: Clean up confusing refs to Greyskull from ttnn.copy error messages.
  • Update perf and latest features for llm models (Jan 13)
  • Update README.md
  • #16657: Fix to_layout conversion into row major for 1D tensors
  • Tilize with val padding results in L1 cache OOM
  • #0: Fixes from commit ae61802
  • #0: Skip build-docker-image during post-commit code-analysis since the docker image is already built in a previous job
  • Generate test executables per architecture
  • #16587: Update UMD submodule commit for P150 compatibility
  • Replace some instances of Tensor::get_shape with get_logical_shape
  • Update METALIUM_GUIDE.md
  • #16621: Add barriers at end of cq_dispatch_slave.cpp on IERISC
  • Finish porting OPs to compute_output_specs
  • ScopedGraphCapture
  • #15756 Pull in BH LLK fix for maxpool hang
  • #15246: Add sweep tests for logical_and, logical_or, logical_xor
  • #0: (MINOR) Bump to v0.55.0
  • #11512: Add sweeps for eltwise sharded ops 3
  • Add sweeps for unary, unary_sharded and binary_sharded versions of ops: fmod, remainder, maximum, minimum.
  • Don't leak tt_cluster.hpp through kernel_types.hpp
  • #6983: Renable skipped TT-NN unit test
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs
  • update build flag on programming examples docs
  • Fix for P100 board type
  • Sever TT-Train's dependency on TT-Metalium's tests
  • [TT-Train] Update generate of LLM
  • [TT-Train] Add bias=false in LinearLayer
  • TT-Fabric Bringup Initial Check-in
  • #0: Sanitize writes to mailbox on ethernet cores.
  • Add Llama11B-N300 and Llama70B-TG (TP=32) to LLM table in README.md
  • [skip ci] Update llms.md
  • Update test_slice.py
  • #16625: Refactor tracking of sub-device managers from Device to a new class
  • Update code-analysis.yaml
  • [skip ci] Update llms.md
  • remove references to LFS
  • Fixes for conversion to row major for 0D and 0-volume tensors
  • #0: Disable BH tools test at workflow level
  • Removing some usages of LegacyShape, improve Tensor::to_string
  • [skip ci] Fix lint on a doc
  • #0: API Unification for Device and MeshDevice
  • Port ttnn::random and uniform from LegacyShape to SimpleShape
  • #16379: make softmax call moreh_softmax if rank above 4
  • #7126: remove skip for test_sd_matmul test
  • #0: Make device an optional parameter in the tensor distribution API
  • Added build-wheels to fast-dispatch-build-and-unit-tests-wrapper.yaml
  • Adding CCL Async test cases to TG nightly and bug fix
  • #11119: Move op_profiler.hpp under the ttnn folder
  • #15979: Switch to google benchmark for pgm dispatch tests
  • [tt-train] Add weight tying option for NanoGPT demo
  • #0: Fix build of test_pgm_dispatch
  • [tt-train] Update serialization of tensor for DDP
  • #0: Fix failing TG regression tests
  • [skip ci] Update llms.md
  • Add tiled interleaved permute for when width dimension doesn't move (row-major tiled invariant)
  • Add Fabric Router Config to to Hal
  • [skip ci] Update llms.md
  • Reflect ARCH_NAME Changes in CI Workflows
  • [skip ci] Update llms.md
  • #0: Migrate pytensor to use from_vector Tensor creation APIs
  • Afuller/metalium api reorg
  • Ngrujic/sweep tests 3
  • #0: Enable nlp create heads tests on BH
  • Fix to_layout shard bug
  • Fix broken link to host API
  • Add noc flag to test stress noc mcast
  • Set codeowners for transformer ttnn ops
  • #15450: Remove default value for ocb argument in LLK compute API
  • Linking tensor.reshape to ttnn.reshape
  • #16646: Fix dangling reference in sharded tensor args
  • #15450: Remove default values from circular buffer parameters in LLK compute APIs: Transpose and Reduce
  • Add new python api to get architecture name
  • Remove base.hpp
  • [tt-train] Change weights initialization for GPT-2
  • [skip ci] Update...
Read more
Assets 9
Loading