From 98d272c12c25bb8f4332b324f9fbe96c64f6c1dd Mon Sep 17 00:00:00 2001 From: pytorchbot Date: Wed, 1 Jan 2025 02:04:12 +0000 Subject: [PATCH] auto-generating sphinx docs --- main/_modules/torchtune/datasets/_sft.html | 2 +- main/generated/torchtune.datasets.SFTDataset.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/main/_modules/torchtune/datasets/_sft.html b/main/_modules/torchtune/datasets/_sft.html index 473846c2fb..dfc6b9b7f8 100644 --- a/main/_modules/torchtune/datasets/_sft.html +++ b/main/_modules/torchtune/datasets/_sft.html @@ -513,7 +513,7 @@

Source code for torchtune.datasets._sft

             ``load_dataset`` for more details.
         message_transform (Transform): callable that keys into the desired fields in the sample
             and converts text content to a list of :class:`~torchtune.data.Message`. It is expected that the final list
-            of messages are stored in the ``"messages"`` key.
+            of messages are stored in the ``"messages"`` key. See :ref:`message_transform_usage_label` for details.
         model_transform (Transform): callable that applies model-specific pre-processing to the sample after the list of
             messages is created from ``message_transform``. This includes tokenization and any modality-specific
             transforms. It is expected to return at minimum ``"tokens"`` and ``"mask"`` keys.
diff --git a/main/generated/torchtune.datasets.SFTDataset.html b/main/generated/torchtune.datasets.SFTDataset.html
index cd3da7887e..173a3b71a2 100644
--- a/main/generated/torchtune.datasets.SFTDataset.html
+++ b/main/generated/torchtune.datasets.SFTDataset.html
@@ -500,7 +500,7 @@ 

SFTDatasetload_dataset for more details.

  • message_transform (Transform) – callable that keys into the desired fields in the sample and converts text content to a list of Message. It is expected that the final list -of messages are stored in the "messages" key.

  • +of messages are stored in the "messages" key. See Message Transforms for details.

  • model_transform (Transform) – callable that applies model-specific pre-processing to the sample after the list of messages is created from message_transform. This includes tokenization and any modality-specific transforms. It is expected to return at minimum "tokens" and "mask" keys.