LatestTrainingNotebook.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "source": [
        "## Finetuned Llama3 8b for Java Code Generation\n",
        "\n",
        "This Colab notebook focuses on utilizing a finetuned version of Llama3 8b, a language model, for generating Java code snippets. The model has been optimized and trained specifically for Java code generation tasks.\n"
      ],
      "metadata": {
        "id": "C6axa23BfyOs"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "!nvidia-smi # check the details of env before running"
      ],
      "metadata": {
        "id": "OWKQZAgAyhts",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "ccce883f-2ab3-4e06-c8db-8c6fdf198952"
      },
      "execution_count": 1,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Sun Jun 16 17:09:15 2024       \n",
            "+---------------------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 535.104.05             Driver Version: 535.104.05   CUDA Version: 12.2     |\n",
            "|-----------------------------------------+----------------------+----------------------+\n",
            "| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                                         |                      |               MIG M. |\n",
            "|=========================================+======================+======================|\n",
            "|   0  Tesla T4                       Off | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   44C    P8               9W /  70W |      0MiB / 15360MiB |      0%      Default |\n",
            "|                                         |                      |                  N/A |\n",
            "+-----------------------------------------+----------------------+----------------------+\n",
            "                                                                                         \n",
            "+---------------------------------------------------------------------------------------+\n",
            "| Processes:                                                                            |\n",
            "|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |\n",
            "|        ID   ID                                                             Usage      |\n",
            "|=======================================================================================|\n",
            "|  No running processes found                                                           |\n",
            "+---------------------------------------------------------------------------------------+\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🔵 **Installation of Dependencies**\n",
        "\n",
        "<details>\n",
        "\n",
        "<summary>The first cell of this notebook handles the installation of necessary packages and dependencies required for running the code.( click here to expand ) </summary>\n",
        "\n",
        "It installs:\n",
        "- **Unsloth**: A Python package for integrating pretrained language models into your projects, tailored for Colab environments.\n",
        "- **Xformers**: Utilized for its Flash Attention mechanism, enhancing the model's performance.\n",
        "- Other supporting packages required for this task, such as `trl`, `peft`, `accelerate`, and `bitsandbytes`.\n",
        "\n",
        "The `%%capture` magic command is used to suppress the output of the installation process within the notebook.\n",
        "\n",
        "<br>\n",
        "<hr>\n",
        "\n",
        "### Note:\n",
        "Ensure that you have adequate resources available in your Colab environment, especially GPU acceleration, to efficiently run the notebook and leverage the power of the language model for Java code generation tasks.\n",
        "\n",
        "</details>"
      ],
      "metadata": {
        "id": "EMJu4HJyk0fm"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "<details>\n",
        "  <summary><b>Explanation: Dependencies</b> (click to expand)</summary>\n",
        "  \n",
        "### Package Explanations:\n",
        "\n",
        "#### trl:\n",
        "- **Description**: Transfer Learning Library (`trl`) is a Python library designed to facilitate transfer learning with pretrained language models. It offers utilities for fine-tuning and adapting these models to specific downstream tasks, providing a streamlined workflow for model adaptation.\n",
        "- **Usefulness**: `trl` is particularly valuable for tasks requiring domain-specific language generation, such as Java code generation. By leveraging pre-existing knowledge encoded in pretrained models like Llama3 8b, `trl` allows for efficient fine-tuning and customization, enhancing the model's performance on specialized tasks.\n",
        "\n",
        "#### peft:\n",
        "- **Description**: Parameter-Efficient Fine-Tuning (`peft`) methods enable efficient adaptation of large pretrained models to various downstream applications by only fine-tuning a small number of (extra) model parameters instead of all the model's parameters. This significantly decreases the computational and storage costs. Basically it freezes most of the pre-trained network's parameters.\n",
        "- **Usefulness**: For tasks like Java code generation, where generating semantically correct and contextually relevant code is crucial, `peft` can significantly improve model performance. By fine-tuning with parameter-efficient techniques, the model learns to generate code snippets that not only adhere to syntax rules but also exhibit contextually appropriate behavior, enhancing the overall quality of generated code.\n",
        "\n",
        "#### accelerate:\n",
        "- **Description**: Accelerate is a PyTorch-based library aimed at optimizing computations, particularly for deep learning tasks. It offers features such as distributed training, mixed precision, and optimized backends to improve performance and efficiency.\n",
        "- **Usefulness**: When fine-tuning large language models like Llama3 8b, `accelerate` can greatly accelerate the training process by leveraging GPU acceleration and other optimization techniques. This leads to faster convergence and reduced training times, making it an essential tool for training complex models efficiently.\n",
        "\n",
        "#### bitsandbytes:\n",
        "- **Description**: Bitsandbytes is a Python utility package providing tools for efficient data manipulation and conversion, particularly focusing on binary data and byte-level operations.\n",
        "- **Usefulness**: While not directly related to language model fine-tuning, `bitsandbytes` can be useful for preprocessing or post-processing tasks associated with code generation. It offers functionalities for handling binary data formats, encoding and decoding operations, and byte-level manipulations, which may be relevant in certain scenarios during the code generation pipeline.\n",
        "\n",
        "### Note:\n",
        "Understanding these dependencies and their functionalities can significantly aid in optimizing model performance, accelerating training, and effectively handling data throughout the fine-tuning process.\n",
        "\n",
        "</details>\n"
      ],
      "metadata": {
        "id": "P9Odfh-MiwcA"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "id": "2eSvM9zX_2d3"
      },
      "outputs": [],
      "source": [
        "%%capture\n",
        "# Installs Unsloth, Xformers (Flash Attention) and all other packages!\n",
        "!pip install \"unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git\"\n",
        "!pip install --no-deps xformers trl peft accelerate bitsandbytes"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🔵 **Loading Pretrained Language Model and Tokenizer**\n",
        "<details>\n",
        "\n",
        "<summary>( click here to expand )</summary>\n",
        "\n",
        "This cell loads a pretrained language model and its associated tokenizer using the `unsloth` library. The model and tokenizer are essential components for generating Java code snippets using the Llama3 8b model.\n",
        "\n",
        "<br>\n",
        "\n",
        "<details>\n",
        "<summary><b>Parameters:</b></summary>\n",
        "\n",
        "- **max_seq_length**: Defines the maximum sequence length for input tokens. Setting this parameter higher allows the model to process longer sequences but may require more memory.\n",
        "- **dtype**: Specifies the data type for model parameters. By default (`None`), it is auto-detected. Using `Float16` is recommended for GPUs like Tesla T4 or V100, while `Bfloat16` is suitable for Ampere+ GPUs.\n",
        "- **load_in_4bit**: Controls whether to use 4-bit quantization to reduce memory usage during model loading. This can be set to `True` or `False` based on memory constraints.\n",
        "\n",
        "</details>\n",
        "\n",
        "<br>\n",
        "\n",
        "<details>\n",
        "<summary><b>Pre-Quantized Models:</b></summary>\n",
        "\n",
        "The code includes a list of pre-quantized models available for faster downloading and reduced out-of-memory errors. These models are pre-quantized to 4 bits and include variants such as `mistral-7b`, `llama-2-7b`, `gemma-7b`, and `gemma-2b`, among others. You can find more models at [Hugging Face's model hub](https://huggingface.co/unsloth).\n",
        "\n",
        "</details>\n",
        "\n",
        "<br>\n",
        "\n",
        "<details>\n",
        "<summary><b>Model Loading:</b></summary>\n",
        "\n",
        "The `FastLanguageModel.from_pretrained` method is used to load the pretrained language model and tokenizer. It takes several parameters:\n",
        "- `model_name`: Specifies the name of the pretrained model to be loaded.\n",
        "- `max_seq_length`: Sets the maximum sequence length for input tokens.\n",
        "- `dtype`: Specifies the data type for model parameters.\n",
        "- `load_in_4bit`: Controls whether to load the model with 4-bit quantization.\n",
        "\n",
        "</details>\n",
        "\n",
        "<br>\n",
        "\n",
        "<hr>\n",
        "\n",
        "### Note:\n",
        "\n",
        "Ensure that you have a stable internet connection to download the pretrained model and tokenizer. Additionally, verify that your Colab environment has sufficient memory to accommodate the chosen `max_seq_length` and model parameters.\n",
        "\n",
        "</details>"
      ],
      "metadata": {
        "id": "vL-F051HlJow"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 3,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 330,
          "referenced_widgets": [
            "945d2116b7f7467caca24fc9d4bba1ac",
            "3b65e39a6e5a4191a99fac9d3f998af5",
            "fdd9e126b68f4ba9b0a675a3a10fc59b",
            "33db5d355038411cb454c36a96d3693d",
            "09359f68fcbc4ee89ba3da3a2c54a6f4",
            "9cd6c556bc344909b0495e0a6e4f268a",
            "f2ec5bac15e74210810ddd23d4f59c41",
            "e36eb5f575534f9196b06ee77f0f3f97",
            "710723326a414017bc4e73130ecfdbed",
            "6f6bf98ab09e4629876a5dabef0edd63",
            "fcf488d800634bcdaf225ef92284e5ed",
            "e7828728be144f9f99c5f3ebb7d56c27",
            "ddd9959c649a46108159d439d8d337bd",
            "72ad1c5a1fbf48a68247d9fc94e36c12",
            "6d5027b8c4b04da78e42c7f5a6f0b910",
            "a020589ef22f48fbba6b77b1e2e581a9",
            "239fd08523fa4a0abac87634416dbddc",
            "8eaaa3991a694c249871ceaafb4afc30",
            "77cccfcf7ad64e9ab8d830657bb0c6bc",
            "9bb66977176e438d8f1a4e50d8cec764",
            "e0b1d894e98d49edaa6888fff6e4c5e3",
            "6f4b4ed8441b4f2bb06a412767bf6ec6",
            "d4cd5f906f204a63b8dc80a4eba9df10",
            "043e234b17b44e8fa9222d3b70c6e7ef",
            "56f145358fba4724af42150f6b07e0a2",
            "ab878c85ccd2472da73b3c6f21e00597",
            "345366e9a18840cf97f8f9a5b9d8e9c0",
            "28e1c7038c7c49d2821296d800c70d16",
            "7e18c25674d045439e48fa1639d25a0a",
            "44bf1bd23fa240bcb916fffbcbdc7783",
            "186e74cbc0e1430a94ba81ae514822d2",
            "fe81793507e74ed7ba32b6abf44c7ec6",
            "6f74bf7834374f8c9424601d3836a06f",
            "d484dfa1e946400bbc3f5b432007c765",
            "5289ff66075d481db4f4c3609f0d864e",
            "2b4659d715664f28878ae0e3dfc52474",
            "4dbf4ab944e049f0a3fa90b9a06b0840",
            "44756048150b444494bc640012b6216b",
            "dd20760707d44d638becdf50f7f80b82",
            "c7179c658d0e47f7a8ebcd6f87a5211b",
            "37b7ec2b88c2451087d3a964d85f28d8",
            "3f5624b3549146149d87dc7c447ac892",
            "a367c55f415645c08aa7e174f54d0ed9",
            "dac7184509bc45868c6794a5439aaec9",
            "1fde5a4dc0ed4218a01fa2fdb30535fb",
            "ee7bf5ad00594a448e832ae9ad4916b1",
            "c12c5a1692164ae88c309348cb59a52f",
            "cf1b25511a5f4867b16288d9fe0eb3a7",
            "8a41600c8a38468ab61a8d84f08c1d9e",
            "ea7709623a494b8cb142f6892884feb0",
            "8ab6fdd4b492499eb2371e09f73797c4",
            "77c88da58aa741c8a3aca32157926222",
            "7a15b226349e4bb5892f46d6d9d791d7",
            "549d71a0df3b4f9198f2541e921acbd4",
            "58a5d398858f40249f628d338c748637",
            "2ec2114496854e5ab440c95b18beabe2",
            "fd35d73034164274bc6e18ca827b5d5a",
            "eb26cf6694144ebfb01e2e83d141b9ce",
            "977b688d76e54d2fb067a5e8c8efae01",
            "f8296c1a098a4bbb9d8ee9565822426c",
            "d8fd97272ee946c48abcfa570e96fe3e",
            "4131dbb0aa1d40c8bbb4c1908f26ba2c",
            "b5e3458e5f894c92b11d18d6e78fe868",
            "8be1032ddac7434aaf798109f48d7bd1",
            "b159c66c3bcb4c189e5802904807c59d",
            "3fbd89229de54c7a9bc2d6074b13af1c"
          ]
        },
        "id": "QmUBVEnvCDJv",
        "outputId": "776f1b6c-a299-40bb-c289-1404d81924eb"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "config.json:   0%|          | 0.00/1.20k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "945d2116b7f7467caca24fc9d4bba1ac"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "==((====))==  Unsloth: Fast Llama patching release 2024.6\n",
            "   \\\\   /|    GPU: Tesla T4. Max memory: 14.748 GB. Platform = Linux.\n",
            "O^O/ \\_/ \\    Pytorch: 2.3.0+cu121. CUDA = 7.5. CUDA Toolkit = 12.1.\n",
            "\\        /    Bfloat16 = FALSE. Xformers = 0.0.26.post1. FA = False.\n",
            " \"-____-\"     Free Apache license: http://github.com/unslothai/unsloth\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "model.safetensors:   0%|          | 0.00/5.70G [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e7828728be144f9f99c5f3ebb7d56c27"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "generation_config.json:   0%|          | 0.00/172 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d4cd5f906f204a63b8dc80a4eba9df10"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer_config.json:   0%|          | 0.00/50.6k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d484dfa1e946400bbc3f5b432007c765"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "tokenizer.json:   0%|          | 0.00/9.09M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "1fde5a4dc0ed4218a01fa2fdb30535fb"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "special_tokens_map.json:   0%|          | 0.00/464 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "2ec2114496854e5ab440c95b18beabe2"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.\n"
          ]
        }
      ],
      "source": [
        "from unsloth import FastLanguageModel\n",
        "import torch\n",
        "\n",
        "# Define parameters\n",
        "max_seq_length = 2048  # Choose any! We auto support RoPE Scaling internally!\n",
        "dtype = None  # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+\n",
        "load_in_4bit = True  # Use 4bit quantization to reduce memory usage. Can be False.\n",
        "\n",
        "# List of 4bit pre-quantized models\n",
        "fourbit_models = [\n",
        "    \"unsloth/mistral-7b-bnb-4bit\",\n",
        "    \"unsloth/mistral-7b-instruct-v0.2-bnb-4bit\",\n",
        "    \"unsloth/llama-2-7b-bnb-4bit\",\n",
        "    \"unsloth/gemma-7b-bnb-4bit\",\n",
        "    \"unsloth/gemma-7b-it-bnb-4bit\",  # Instruct version of Gemma 7b\n",
        "    \"unsloth/gemma-2b-bnb-4bit\",\n",
        "    \"unsloth/gemma-2b-it-bnb-4bit\",  # Instruct version of Gemma 2b\n",
        "    \"unsloth/llama-3-8b-bnb-4bit\",   # [NEW] 15 Trillion token Llama-3\n",
        "]  # More models at https://huggingface.co/unsloth\n",
        "\n",
        "# Load the model and tokenizer\n",
        "model, tokenizer = FastLanguageModel.from_pretrained(\n",
        "    model_name=\"unsloth/llama-3-8b-bnb-4bit\",\n",
        "    max_seq_length=max_seq_length,\n",
        "    dtype=dtype,\n",
        "    load_in_4bit=load_in_4bit,\n",
        "    # token=\"hf_...\",  # Use one if using gated models like meta-llama/Llama-2-7b-hf\n",
        ")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🔵 **Enhancing Model with Parameter Efficient Fine-Tuning (PEFT) Technique**\n",
        "<details>\n",
        "<summary>( click here to expand )</summary>\n",
        "\n",
        "This cell utilizes the Parameter Efficient Fine-Tuning (PEFT) technique to enhance the pretrained language model (`model`). The PEFT technique optimizes certain parameters of the model to improve its performance and efficiency for specific tasks, such as Java code generation.\n",
        "\n",
        "<br>\n",
        "\n",
        "<details>\n",
        "<summary><b>PEFT Parameters:</b></summary>\n",
        "\n",
        "- **r**: Specifies the value of parameter `r`, which influences the fine-tuning process. It is recommended to choose a value greater than 0. Common values include 8, 16, 32, 64, or 128.\n",
        "\n",
        "- **target_modules**: Defines the target modules within the model architecture that will be fine-tuned using the PEFT technique. These modules include `[\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\", \"gate_proj\", \"up_proj\", \"down_proj\"]`.\n",
        "\n",
        "- **lora_alpha**: Sets the value of the `lora_alpha` parameter, which controls the alpha parameter of LoRA (Local Rank Adaptation) technique. This parameter influences the fine-tuning process.\n",
        "\n",
        "- **lora_dropout**: Specifies the dropout rate for LoRA. A value of 0 indicates no dropout, while other values are supported but less optimized.\n",
        "\n",
        "- **bias**: Determines the bias type used in the model. The value `none` is recommended for optimization purposes.\n",
        "\n",
        "- **use_gradient_checkpointing**: Controls the usage of gradient checkpointing for memory efficiency during fine-tuning. Set to `unsloth` for optimal performance.\n",
        "\n",
        "- **random_state**: Sets the random seed for reproducibility during fine-tuning.\n",
        "\n",
        "- **use_rslora**: Indicates whether to utilize rank-stabilized LoRA. Currently set to `False`.\n",
        "\n",
        "- **loftq_config**: LoftQ configuration. Currently set to `None`.\n",
        "\n",
        "</details>\n",
        "\n",
        "<br>\n",
        "<hr>\n",
        "\n",
        "### Note:\n",
        "\n",
        "By applying the PEFT technique with carefully chosen parameters, the model's performance and efficiency can be significantly improved for the task of Java code generation. Ensure that the parameters are adjusted according to the specific requirements and constraints of your project.\n",
        "\n",
        "</details>"
      ],
      "metadata": {
        "id": "SXd9bTZd1aaL"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "metadata": {
        "id": "6bZsfBuZDeCL",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "63a6bd30-80b3-4e1a-fae8-85e91e65591e"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Unsloth 2024.6 patched 32 layers with 32 QKV layers, 32 O layers and 32 MLP layers.\n"
          ]
        }
      ],
      "source": [
        "# Enhance model using Parameter Efficient Fine-Tuning (PEFT) technique\n",
        "model = FastLanguageModel.get_peft_model(\n",
        "    model,\n",
        "    r=16,  # Choose any number > 0! Suggested 8, 16, 32, 64, 128\n",
        "    target_modules=[\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",
        "                    \"gate_proj\", \"up_proj\", \"down_proj\"],\n",
        "    lora_alpha=16,\n",
        "    lora_dropout=0,  # Supports any, but = 0 is optimized\n",
        "    bias=\"none\",  # Supports any, but = \"none\" is optimized\n",
        "    # Use gradient checkpointing for memory efficiency\n",
        "    use_gradient_checkpointing=\"unsloth\",  # True or \"unsloth\" for very long context\n",
        "    random_state=3407,\n",
        "    use_rslora=False,  # We support rank stabilized LoRA\n",
        "    loftq_config=None  # And LoftQ\n",
        ")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<details>\n",
        "<summary><b>🔴Code to load dataset from hugging face (click to expand)</b> OR press \"ctrl\" + \"M\" + \"J\" </summary>\n",
        "\n",
        "# alpaca_prompt = \"\"\"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n",
        "\n",
        "# ### Instruction:\n",
        "# {}\n",
        "\n",
        "# ### Input:\n",
        "# {}\n",
        "\n",
        "# ### Response:\n",
        "# {}\"\"\"\n",
        "\n",
        "# EOS_TOKEN = tokenizer.eos_token # Must add EOS_TOKEN\n",
        "# def formatting_prompts_func(examples):\n",
        "#     instructions = examples[\"instruction\"]\n",
        "#     inputs       = examples[\"input\"]\n",
        "#     outputs      = examples[\"output\"]\n",
        "#     texts = []\n",
        "#     for instruction, input, output in zip(instructions, inputs, outputs):\n",
        "#         # Must add EOS_TOKEN, otherwise your generation will go on forever!\n",
        "#         text = alpaca_prompt.format(instruction, input, output) + EOS_TOKEN\n",
        "#         texts.append(text)\n",
        "#     return { \"text\" : texts, }\n",
        "# pass\n",
        "\n",
        "# from datasets import load_dataset\n",
        "# dataset = load_dataset(\"yahma/alpaca-cleaned\", split = \"train\")\n",
        "# dataset = dataset.map(formatting_prompts_func, batched = True,)\n"
      ],
      "metadata": {
        "id": "sQrdD6wJr_jI"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "## 🟢 JSON Dataset Structure Explanation\n",
        "\n",
        "<details>\n",
        "\n",
        "<summary> The dataset contains multiple JSON objects, each representing a programming task or problem statement along with its solution in Java code. (click here to expand) </summary>\n",
        "\n",
        "### JSON Object Structure\n",
        "\n",
        "Each JSON object consists of the following fields:\n",
        "\n",
        "- **Instruction**: A description of the task or problem statement.\n",
        "- **Input**: An optional field for input data (not used in this dataset).\n",
        "- **Output**: The solution or implementation in Java code.\n",
        "\n",
        "### Example JSON Object\n",
        "\n",
        "```json\n",
        "[\n",
        "{\n",
        "  \"instruction\": \"Write a Java class for a BankAccount...\",\n",
        "  \"input\": \"\",\n",
        "  \"output\": \"Java code representing a BankAccount class...\"\n",
        "},\n",
        "{\n",
        "  \"instruction\": \"Write a Java class for a BankAccount...\",\n",
        "  \"input\": \"\",\n",
        "  \"output\": \"Java code representing a BankAccount class...\"\n",
        "}\n",
        "]\n",
        "```\n",
        "\n",
        "</details>"
      ],
      "metadata": {
        "id": "TY9arzu5xlGu"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🔵 **Data Preparation: Formatting Alpaca Prompts**\n",
        "<details>\n",
        "<summary> This cell prepares the Alpaca prompts by formatting them into a suitable format for training. It involves importing necessary libraries, defining the prompt template, and loading the dataset from a JSON file. ( click here to expand )</summary>\n",
        "\n",
        "<br>\n",
        "\n",
        "# 1. Importing Required Libraries:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- The cell begins by importing the necessary libraries, including `json` for handling JSON files and `Dataset` from the `datasets` library for managing datasets efficiently.\n",
        "\n",
        "</details>\n",
        "\n",
        "# 2. Defining the Alpaca Prompt Template:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- The Alpaca prompt template is defined as a multi-line string (`alpaca_prompt`). It includes placeholders for the instruction, input, and response parts of each prompt.\n",
        "\n",
        "</details>\n",
        "\n",
        "# 3. Defining the End-of-Sequence Token:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- An end-of-sequence token (`EOS_TOKEN`) is defined using the `tokenizer.eos_token` attribute. This token is used to mark the end of each prompt.\n",
        "\n",
        "</details>\n",
        "\n",
        "# 4. Loading the Dataset:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- The dataset is loaded from a JSON file located at `/content/your_dataset.json`. Make sure to update the file path according to your dataset's location. The JSON file contains a list of dictionaries, where each dictionary represents an example with keys for instruction, input, and output.\n",
        "\n",
        "</details>\n",
        "\n",
        "# 5. Formatting the Prompts:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- The prompts are formatted by iterating over each example in the dataset list. The instruction, input, and output texts are extracted from each example, and the `alpaca_prompt` template is filled with these values. The end-of-sequence token is appended to each prompt, and the formatted prompt is added to the `texts` list.\n",
        "\n",
        "</details>\n",
        "\n",
        "# 6. Creating a Hugging Face Dataset:\n",
        "<details>\n",
        "<summary><b>click here to expand</b></summary>\n",
        "\n",
        "- Finally, a Hugging Face dataset is created from the `texts` list containing the formatted prompts. This dataset is now ready to be used for training or further processing.\n",
        "\n",
        "</details>\n",
        "\n",
        "<br>\n",
        "\n",
        "<hr>\n",
        "\n",
        "# Note:\n",
        "- Ensure that the dataset JSON file (`your_dataset.json`) is properly formatted and contains the required fields (instruction, input, output) for each example.\n",
        "- Additionally, verify that the `tokenizer` variable is defined elsewhere in the notebook to access the end-of-sequence token.\n",
        "</details>"
      ],
      "metadata": {
        "id": "-BHmV4B2qOzK"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "id": "LjY75GoYUCB8"
      },
      "outputs": [],
      "source": [
        "# Importing required libraries\n",
        "import json\n",
        "from datasets import Dataset\n",
        "\n",
        "# Define the Alpaca prompt template\n",
        "alpaca_prompt = \"\"\"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n",
        "\n",
        "### Instruction:\n",
        "{}\n",
        "\n",
        "### Input:\n",
        "{}\n",
        "\n",
        "### Response:\n",
        "{}\"\"\"\n",
        "\n",
        "# Define the end-of-sequence token\n",
        "EOS_TOKEN = tokenizer.eos_token  # Assuming 'tokenizer' is defined elsewhere\n",
        "\n",
        "# Load the dataset from the JSON file in Google Colab\n",
        "dataset_path = \"/content/modified_latest_proper_dataset.json\" # Update with your file path\n",
        "with open(dataset_path, \"r\") as f:\n",
        "    dataset_list = json.load(f)\n",
        "\n",
        "# Format the prompts\n",
        "texts = []\n",
        "for example in dataset_list:\n",
        "    instruction = example[\"instruction\"]\n",
        "    input_text = example[\"input\"]\n",
        "    output_text = example[\"output\"]\n",
        "    text = alpaca_prompt.format(instruction, input_text, output_text) + EOS_TOKEN\n",
        "    texts.append(text)\n",
        "\n",
        "# Create a Hugging Face dataset\n",
        "dataset = Dataset.from_dict({\"text\": texts})\n",
        "\n",
        "# Now 'dataset' contains the formatted prompts ready to be used\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🔵 **Training and Testing**"
      ],
      "metadata": {
        "id": "AjulpPJ66hvy"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "<a name=\" Train\"></a>\n",
        "### **Training with Huggingface TRL's SFTTrainer**\n",
        "**bold text**\n",
        "In this code, we are using Huggingface's Transfer Representation Learning (TRL) library to train a model using the SFTTrainer.\n",
        "\n",
        "We set `num_train_epochs=1` for a full run by setting `max_steps=None`.\n",
        "<br>\n",
        "\n",
        "The code supports TRL's `DPOTrainer`.\n",
        "<br>\n",
        "\n",
        "More documentation on TRL's SFTTrainer can be found [here](https://huggingface.co/docs/trl/sft_trainer).\n"
      ],
      "metadata": {
        "id": "idAEIeSQ3xdS"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "id": "95_Nn-89DhsL",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 260,
          "referenced_widgets": [
            "7a71d2cac0c04987acfc113f5f597eeb",
            "ba6fb526acd743ae9f5309e5730bc59b",
            "f39a76b92b124c6da8e6fc7956f9a263",
            "278c1bb958d94444a2b8f7443c3745a8",
            "768a07270ed84ef4ab757f3a24eb42d4",
            "5758399a22e840a3afdc993a714040e2",
            "d7bbdeeff7d24bcb99ace85d050d4731",
            "d1d8bccdfce24a94aeb3398cda09dd9b",
            "80b26d70f8ed4df08fef40fedd1b7b98",
            "e742cc815b2a403cae45eec4059c9905",
            "25c3c916840945039450257b775ce81f"
          ]
        },
        "outputId": "a21c2f43-3da5-463e-9adc-8596d3c87578"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "/usr/local/lib/python3.10/dist-packages/transformers/training_args.py:1965: FutureWarning: `--push_to_hub_token` is deprecated and will be removed in version 5 of 🤗 Transformers. Use `--hub_token` instead.\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/trl/trainer/sft_trainer.py:269: UserWarning: You passed a `max_seq_length` argument to the SFTTrainer, the value you passed will override the one in the `SFTConfig`.\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/trl/trainer/sft_trainer.py:283: UserWarning: You passed a `dataset_num_proc` argument to the SFTTrainer, the value you passed will override the one in the `SFTConfig`.\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/trl/trainer/sft_trainer.py:307: UserWarning: You passed a `dataset_text_field` argument to the SFTTrainer, the value you passed will override the one in the `SFTConfig`.\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.\n",
            "  self.pid = os.fork()\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Map (num_proc=2):   0%|          | 0/24 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "7a71d2cac0c04987acfc113f5f597eeb"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "max_steps is given, it will override any value given in num_train_epochs\n"
          ]
        }
      ],
      "source": [
        "# @title\n",
        "from trl import SFTTrainer\n",
        "from transformers import TrainingArguments\n",
        "from unsloth import is_bfloat16_supported\n",
        "\n",
        "# Initialize the trainer with SFTTrainer\n",
        "trainer = SFTTrainer(\n",
        "    model = model,\n",
        "    tokenizer = tokenizer,\n",
        "    train_dataset = dataset,\n",
        "    dataset_text_field = \"text\",\n",
        "    max_seq_length = max_seq_length,\n",
        "    dataset_num_proc = 2,  # Number of processes to use while preparing the dataset\n",
        "    packing = False,  # Whether to use packing to make training faster for short sequences\n",
        "    args = TrainingArguments(\n",
        "        per_device_train_batch_size = 2,  # Batch size per GPU/CPU for training\n",
        "        gradient_accumulation_steps = 4,  # Number of updates steps to accumulate before performing a backward/update pass\n",
        "        warmup_steps = 5,  # Number of steps for the warmup phase\n",
        "        max_steps = 60,  # Maximum number of training steps\n",
        "        learning_rate = 2e-4,  # Initial learning rate for AdamW optimizer\n",
        "        fp16 = not is_bfloat16_supported(),  # Whether to use FP16 (mixed precision) training\n",
        "        bf16 = is_bfloat16_supported(),  # Whether to use BF16 training\n",
        "        logging_steps = 1,  # Log every X updates steps\n",
        "        optim = \"adamw_8bit\",  # Optimizer type\n",
        "        weight_decay = 0.01,  # Weight decay rate for AdamW optimizer\n",
        "        lr_scheduler_type = \"linear\",  # Learning rate scheduler type\n",
        "        seed = 3407,  # Random seed for reproducibility\n",
        "        output_dir = \"outputs\",  # Directory to save the output files\n",
        "    ),\n",
        ")\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "id": "2ejIt2xSNKKp",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "f254a7f3-8551-4ab4-9399-cae54a4c90d6"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "GPU = Tesla T4. Max memory = 14.748 GB.\n",
            "5.594 GB of memory reserved.\n"
          ]
        }
      ],
      "source": [
        "#@title Show current memory stats\n",
        "gpu_stats = torch.cuda.get_device_properties(0)\n",
        "start_gpu_memory = round(torch.cuda.max_memory_reserved() / 1024 / 1024 / 1024, 3)\n",
        "max_memory = round(gpu_stats.total_memory / 1024 / 1024 / 1024, 3)\n",
        "print(f\"GPU = {gpu_stats.name}. Max memory = {max_memory} GB.\")\n",
        "print(f\"{start_gpu_memory} GB of memory reserved.\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "id": "yqxqAZ7KJ4oL",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "bde253b3-bde2-4263-92ae-639f99cea974"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "==((====))==  Unsloth - 2x faster free finetuning | Num GPUs = 1\n",
            "   \\\\   /|    Num examples = 24 | Num Epochs = 20\n",
            "O^O/ \\_/ \\    Batch size per device = 2 | Gradient Accumulation steps = 4\n",
            "\\        /    Total batch size = 8 | Total steps = 60\n",
            " \"-____-\"     Number of trainable parameters = 41,943,040\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ],
            "text/html": [
              "\n",
              "    <div>\n",
              "      \n",
              "      <progress value='60' max='60' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
              "      [60/60 29:54, Epoch 20/20]\n",
              "    </div>\n",
              "    <table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              " <tr style=\"text-align: left;\">\n",
              "      <th>Step</th>\n",
              "      <th>Training Loss</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <td>1</td>\n",
              "      <td>0.562200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>2</td>\n",
              "      <td>0.582100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>3</td>\n",
              "      <td>0.564900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>4</td>\n",
              "      <td>0.521100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>5</td>\n",
              "      <td>0.536000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>6</td>\n",
              "      <td>0.479400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>7</td>\n",
              "      <td>0.419400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>8</td>\n",
              "      <td>0.419700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>9</td>\n",
              "      <td>0.347900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>10</td>\n",
              "      <td>0.319100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>11</td>\n",
              "      <td>0.294700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>12</td>\n",
              "      <td>0.287700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>13</td>\n",
              "      <td>0.226200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>14</td>\n",
              "      <td>0.274700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>15</td>\n",
              "      <td>0.228500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>16</td>\n",
              "      <td>0.228100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>17</td>\n",
              "      <td>0.201200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>18</td>\n",
              "      <td>0.171400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>19</td>\n",
              "      <td>0.184400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>20</td>\n",
              "      <td>0.161800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>21</td>\n",
              "      <td>0.124500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>22</td>\n",
              "      <td>0.148500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>23</td>\n",
              "      <td>0.096800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>24</td>\n",
              "      <td>0.109600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>25</td>\n",
              "      <td>0.072500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>26</td>\n",
              "      <td>0.096400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>27</td>\n",
              "      <td>0.081900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>28</td>\n",
              "      <td>0.052700</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>29</td>\n",
              "      <td>0.060000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>30</td>\n",
              "      <td>0.051800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>31</td>\n",
              "      <td>0.030800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>32</td>\n",
              "      <td>0.036900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>33</td>\n",
              "      <td>0.040300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>34</td>\n",
              "      <td>0.026800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>35</td>\n",
              "      <td>0.023100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>36</td>\n",
              "      <td>0.018200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>37</td>\n",
              "      <td>0.014600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>38</td>\n",
              "      <td>0.013300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>39</td>\n",
              "      <td>0.016100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>40</td>\n",
              "      <td>0.012600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>41</td>\n",
              "      <td>0.011300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>42</td>\n",
              "      <td>0.009100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>43</td>\n",
              "      <td>0.007300</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>44</td>\n",
              "      <td>0.009600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>45</td>\n",
              "      <td>0.006000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>46</td>\n",
              "      <td>0.006900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>47</td>\n",
              "      <td>0.005600</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>48</td>\n",
              "      <td>0.008000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>49</td>\n",
              "      <td>0.006000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>50</td>\n",
              "      <td>0.006100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>51</td>\n",
              "      <td>0.005000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>52</td>\n",
              "      <td>0.005100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>53</td>\n",
              "      <td>0.004500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>54</td>\n",
              "      <td>0.005900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>55</td>\n",
              "      <td>0.004400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>56</td>\n",
              "      <td>0.004900</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>57</td>\n",
              "      <td>0.005200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>58</td>\n",
              "      <td>0.005000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>59</td>\n",
              "      <td>0.004400</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>60</td>\n",
              "      <td>0.004100</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table><p>"
            ]
          },
          "metadata": {}
        }
      ],
      "source": [
        "trainer_stats = trainer.train()"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "id": "pCqnaKmlO1U9",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "170af570-308e-4434-c1aa-e1510ebdb22c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "1830.2073 seconds used for training.\n",
            "30.5 minutes used for training.\n",
            "Peak reserved memory = 9.711 GB.\n",
            "Peak reserved memory for training = 4.117 GB.\n",
            "Peak reserved memory % of max memory = 65.846 %.\n",
            "Peak reserved memory for training % of max memory = 27.916 %.\n"
          ]
        }
      ],
      "source": [
        "#@title Show final memory and time stats\n",
        "used_memory = round(torch.cuda.max_memory_reserved() / 1024 / 1024 / 1024, 3)\n",
        "used_memory_for_lora = round(used_memory - start_gpu_memory, 3)\n",
        "used_percentage = round(used_memory         /max_memory*100, 3)\n",
        "lora_percentage = round(used_memory_for_lora/max_memory*100, 3)\n",
        "print(f\"{trainer_stats.metrics['train_runtime']} seconds used for training.\")\n",
        "print(f\"{round(trainer_stats.metrics['train_runtime']/60, 2)} minutes used for training.\")\n",
        "print(f\"Peak reserved memory = {used_memory} GB.\")\n",
        "print(f\"Peak reserved memory for training = {used_memory_for_lora} GB.\")\n",
        "print(f\"Peak reserved memory % of max memory = {used_percentage} %.\")\n",
        "print(f\"Peak reserved memory for training % of max memory = {lora_percentage} %.\")"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<a name=\"Inference\"></a>\n",
        "### Inference\n",
        "Let's run the model! You can change the instruction and input - leave the output blank!"
      ],
      "metadata": {
        "id": "ekOmTR1hSNcr"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# alpaca_prompt = Copied from above\n",
        "FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
        "inputs = tokenizer(\n",
        "[\n",
        "    alpaca_prompt.format(\n",
        "        \"Develop a Java program for a library book lending system. Create classes for Library, Book, and Borrower, establishing relationships through aggregation and inheritance. Implement generateID() methods to generate unique IDs based on borrower attributes using static counters, and validateID() methods to verify IDs against specific instance criteria like borrower names or email addresses. Design the system to manage book lending, borrower registrations, add a method that calculates overdue fines for books that are returned late by borrowers and overdue tracking. Use wrapper classes for method return types and parameters to ensure type safety, and demonstrate system functionalities in a main class.\", # instruction\n",
        "        \"\", # input\n",
        "        \"\", # output - leave this blank for generation!\n",
        "    )\n",
        "], return_tensors = \"pt\").to(\"cuda\")\n",
        "\n",
        "outputs = model.generate(**inputs, max_new_tokens = 2048, use_cache = True)\n",
        "tokenizer.batch_decode(outputs)"
      ],
      "metadata": {
        "id": "kR3gIAX-SM2q",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "cebc7405-f225-4f97-fe53-6d4c355adade"
      },
      "execution_count": 14,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation.\n"
          ]
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\\n\\n### Instruction:\\nDevelop a Java program for a library book lending system. Create classes for Library, Book, and Borrower, establishing relationships through aggregation and inheritance. Implement generateID() methods to generate unique IDs based on borrower attributes using static counters, and validateID() methods to verify IDs against specific instance criteria like borrower names or email addresses. Design the system to manage book lending, borrower registrations, add a method that calculates overdue fines for books that are returned late by borrowers and overdue tracking. Use wrapper classes for method return types and parameters to ensure type safety, and demonstrate system functionalities in a main class.\\n\\n### Input:\\n\\n\\n### Response:\\nimport java.util.Date;\\n\\npublic class Library {\\n    private static int libraryCounter = 1;\\n    private static int bookCounter = 1;\\n    private static int borrowerCounter = 1;\\n    private String libraryId;\\n    private String libraryName;\\n    private LibraryMember[] members;\\n    private int size;\\n\\n    public Library(String libraryName) {\\n        this.libraryId = generateID(libraryName);\\n        this.libraryName = libraryName;\\n        this.members = new LibraryMember[10];\\n        this.size = 0;\\n    }\\n\\n    private String generateID(String name) {\\n        return this.libraryName.substring(0, 3).toUpperCase() + Library.libraryCounter++;\\n    }\\n\\n    public void addMember(LibraryMember member) {\\n        this.members[this.size++] = member;\\n    }\\n\\n    public LibraryMember[] getMembers() {\\n        return this.members;\\n    }\\n\\n    public boolean validateID(String id, Class<?> type) {\\n        if (id == null || id.isEmpty()) {\\n            return false;\\n        }\\n        if (type == LibraryMember.class) {\\n            // Example validation for Library Member ID\\n            // Validate format: LIB-[3 chars]-Counter\\n            return id.matches(\"LIB-\\\\p{XDigit}{3}-\\\\d+\");\\n        } else if (type == Book.class) {\\n            // Example validation for Book ID\\n            // Validate format: BOOK-[3 chars]-Counter\\n            return id.matches(\"BOOK-\\\\p{XDigit}{3}-\\\\d+\");\\n        } else {\\n            throw new IllegalArgumentException(\"Unknown type: \" + type);\\n        }\\n    }\\n\\n    public double calculateFine(Book book, Date returnDate) {\\n        // Example fine calculation logic\\n        long diffInMillies = Math.abs(returnDate.getTime() - book.getDueDate().getTime());\\n        long diffInDays = TimeUnit.DAYS.convert(diffInMillies, TimeUnit.MILLISECONDS);\\n\\n        if (diffInDays > 0) {\\n            double fineAmount = diffInDays * 2.0; // Assuming $2 per day fine\\n            return fineAmount;\\n        } else {\\n            return 0.0;\\n        }\\n    }\\n\\n    public class LibraryMember extends Person {\\n        private String memberId;\\n        private String email;\\n\\n        public LibraryMember(String name, String email) {\\n            super(name);\\n            this.memberId = generateID(email);\\n            this.email = email;\\n        }\\n\\n        private String generateID(String email) {\\n            return email.substring(0, 3).toUpperCase() + Library.borrowerCounter++;\\n        }\\n\\n        public boolean validateID() {\\n            // Example validation for Member ID\\n            // Validate format: MEM-[3 chars]-Counter\\n            // And email format\\n            return this.email.endsWith(\"@gmail.com\") && this.email.length() > 0;\\n        }\\n\\n        public class Person {\\n            private String firstName;\\n            private String lastName;\\n\\n            public Person(String firstName, String lastName) {\\n                this.firstName = firstName;\\n                this.lastName = lastName;\\n            }\\n\\n            public String getFirstName() {\\n                return this.firstName;\\n            }\\n\\n            public String getLastName() {\\n                return this.lastName;\\n            }\\n\\n            public String getName() {\\n                return this.firstName + \" \" + this.lastName;\\n            }\\n        }\\n    }\\n\\n    public class Book extends LibraryMember {\\n        private String bookId;\\n        private String title;\\n        private String author;\\n        private Date dueDate;\\n\\n        public Book(String title, String author, Date dueDate) {\\n            super(\"Unknown\", \"Unknown\");\\n            this.title = title;\\n            this.author = author;\\n            this.dueDate = dueDate;\\n        }\\n\\n        private String generateID() {\\n            return this.title.substring(0, 3).toUpperCase() + Library.bookCounter++;\\n        }\\n\\n        public boolean validateID() {\\n            // Example validation for Book ID\\n            // Validate format: BOOK-[3 chars]-Counter\\n            // And title and author length\\n            return this.author.length() > 0 && this.title.length() > 0;\\n        }\\n\\n        public Date getDueDate() {\\n            return this.dueDate;\\n        }\\n\\n        public class Person extends LibraryMember {\\n            // Inheritance from LibraryMember\\n\\n            public String getFirstName() {\\n                // Method overriding\\n                return super.getLastName();\\n            }\\n        }\\n    }\\n\\n    public static class Main {\\n        public static void main(String[] args) {\\n            Library library = new Library(\"Central Library\");\\n\\n            Library.Book book1 = library.new Book(\"Java Programming\", \"John Doe\", new Date());\\n            Library.Book book2 = library.new Book(\"Python for Beginners\", \"Alice Smith\", new Date());\\n\\n            Library.LibraryMember member1 = library.new LibraryMember(\"Alice Johnson\", \"alice@gmail.com\");\\n            Library.LibraryMember member2 = library.new LibraryMember(\"Bob Smith\", \"bob@gmail.com\");\\n\\n            library.addMember(member1);\\n            library.addMember(member2);\\n\\n            System.out.println(\"Library ID: \" + library.libraryId);\\n            System.out.println(\"Book1 ID valid: \" + library.validateID(book1.bookId, Book.class));\\n            System.out.println(\"Book2 ID valid: \" + library.validateID(book2.bookId, Book.class));\\n            System.out.println(\"Member1 ID valid: \" + library.validateID(member1.memberId, LibraryMember.class));\\n            System.out.println(\"Member2 ID valid: \" + library.validateID(member2.memberId, LibraryMember.class));\\n\\n            System.out.println(\"\\\\nMember 1 Details:\");\\n            System.out.println(\"ID valid: \" + member1.validateID());\\n            System.out.println(\"Name: \" + member1.getName());\\n            System.out.println(\"Email: \" + member1.email);\\n\\n            System.out.println(\"\\\\nBook 1 Details:\");\\n            System.out.println(\"ID valid: \" + library.validateID(book1.bookId, Book.class));\\n            System.out.println(\"Title: \" + book1.title);\\n            System.out.println(\"Author: \" + book1.author);\\n            System.out.println(\"Due Date: \" + book1.dueDate);\\n\\n            // Set due date for Book 1\\n            book1.dueDate = new Date(book1.dueDate.getTime() + 7 * 24 * 60 * 60 * 1000); // 7 days from now\\n\\n            // Calculate and print fine for Book 1\\n            Date returnDate = new Date();\\n            double fineAmount = library.calculateFine(book1, returnDate);\\n            System.out.println(\"\\\\nFine for Book 1: $\" + fineAmount);\\n\\n            // Set due date for Book 2\\n            book2.dueDate = new Date(book2.dueDate.getTime() + 14 * 24 * 60 * 60 * 1000); // 14 days from now\\n\\n            // Add books and members to library\\n            library.addMember(book1);\\n            library.addMember(book2);\\n            Library.LibraryMember[] members = library.getMembers();\\n            for (Library.LibraryMember member : members) {\\n                if (member!= null) {\\n                    System.out.println(\"\\\\nMember ID: \" + member.memberId);\\n                    System.out.println(\"Name: \" + member.getName());\\n                    System.out.println(\"Email: \" + member.email);\\n                }\\n            }\\n        }\\n    }\\n}<|end_of_text|>']"
            ]
          },
          "metadata": {},
          "execution_count": 14
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        " You can also use a `TextStreamer` for continuous inference - so you can see the generation token by token, instead of waiting the whole time!"
      ],
      "metadata": {
        "id": "CrSvZObor0lY"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# alpaca_prompt = Copied from above\n",
        "FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
        "inputs = tokenizer(\n",
        "[\n",
        "    alpaca_prompt.format(\n",
        "        \"Develop a Java program for a library book lending system. Create classes for Library, Book, and Borrower, establishing relationships through aggregation and inheritance. Implement generateID() methods to generate unique IDs based on borrower attributes using static counters, validateID() methods to verify IDs and  add a method that calculates overdue fines for books that are returned late by borrowers and overdue tracking . Design the system to manage book lending, borrower registrations. Use wrapper classes for method return types and parameters to ensure type safety, and demonstrate system functionalities in a main class.\", # instruction\n",
        "        \"\", # input\n",
        "        \"\", # output - leave this blank for generation!\n",
        "    )\n",
        "], return_tensors = \"pt\").to(\"cuda\")\n",
        "\n",
        "from transformers import TextStreamer\n",
        "text_streamer = TextStreamer(tokenizer)\n",
        "_ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 2048)"
      ],
      "metadata": {
        "id": "e2pEuRb1r2Vg",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "320640dd-379e-4ce8-dbc5-faea34c9396e"
      },
      "execution_count": 15,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation.\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n",
            "\n",
            "### Instruction:\n",
            "Develop a Java program for a library book lending system. Create classes for Library, Book, and Borrower, establishing relationships through aggregation and inheritance. Implement generateID() methods to generate unique IDs based on borrower attributes using static counters, validateID() methods to verify IDs and  add a method that calculates overdue fines for books that are returned late by borrowers and overdue tracking. Design the system to manage book lending, borrower registrations. Use wrapper classes for method return types and parameters to ensure type safety, and demonstrate system functionalities in a main class.\n",
            "\n",
            "### Input:\n",
            "\n",
            "\n",
            "### Response:\n",
            "import java.util.Date;\n",
            "\n",
            "public class Library {\n",
            "    private static int libraryCounter = 1;\n",
            "    private static int borrowerCounter = 1;\n",
            "    private String libraryId;\n",
            "    private String name;\n",
            "    private Book[] books;\n",
            "    private int bookCount;\n",
            "\n",
            "    public Library(String name) {\n",
            "        this.libraryId = generateId(name);\n",
            "        this.name = name;\n",
            "        this.books = new Book[50]; // Assume a library with up to 50 books\n",
            "        this.bookCount = 0;\n",
            "    }\n",
            "\n",
            "    private String generateId(String name) {\n",
            "        return this.name.substring(0, 3).toUpperCase() + Library.libraryCounter++;\n",
            "    }\n",
            "\n",
            "    public boolean validateId(String id) {\n",
            "        return id!= null && id.matches(\"[A-Z]{3}\\d+\");\n",
            "    }\n",
            "\n",
            "    public void addBook(Book book) {\n",
            "        if (this.bookCount < this.books.length) {\n",
            "            this.books[this.bookCount++] = book;\n",
            "        }\n",
            "    }\n",
            "\n",
            "    public Book[] getBooks() {\n",
            "        return this.books;\n",
            "    }\n",
            "\n",
            "    public class Book {\n",
            "        private static int bookCounter = 1;\n",
            "        private String bookId;\n",
            "        private String title;\n",
            "        private String author;\n",
            "        private Library library;\n",
            "        private Date dueDate;\n",
            "\n",
            "        public Book(String title, String author, Library library) {\n",
            "            this.bookId = library.generateId(title);\n",
            "            this.title = title;\n",
            "            this.author = author;\n",
            "            this.library = library;\n",
            "        }\n",
            "\n",
            "        public boolean validateId() {\n",
            "            return this.library.validateId(this.bookId) && this.dueDate!= null;\n",
            "        }\n",
            "\n",
            "        public void setDueDate(Date dueDate) {\n",
            "            this.dueDate = dueDate;\n",
            "        }\n",
            "\n",
            "        public Date getDueDate() {\n",
            "            return this.dueDate;\n",
            "        }\n",
            "\n",
            "        public class Borrower {\n",
            "            private static int counter = 1;\n",
            "            private String borrowerId;\n",
            "            private String name;\n",
            "            private String email;\n",
            "            private Library library;\n",
            "            private Date joinedDate;\n",
            "\n",
            "            public Borrower(String name, String email, Library library) {\n",
            "                this.borrowerId = library.generateId(name);\n",
            "                this.name = name;\n",
            "                this.email = email;\n",
            "                this.library = library;\n",
            "                this.joinedDate = new Date();\n",
            "            }\n",
            "\n",
            "            public boolean validateId() {\n",
            "                return this.library.validateId(this.borrowerId) && this.joinedDate!= null;\n",
            "            }\n",
            "\n",
            "            public void checkOutBook(Book book) {\n",
            "                book.setDueDate(new Date(book.getDueDate().getTime() + 14 * 24 * 60 * 60 * 1000)); // Due date 14 days from now\n",
            "                // Additional logic for checking out a book (e.g., validating borrower eligibility, updating library database)\n",
            "            }\n",
            "\n",
            "            public void returnBook(Book book) {\n",
            "                // Additional logic for returning a book (e.g., updating library database, calculating fine if late)\n",
            "                book.setDueDate(null);\n",
            "            }\n",
            "\n",
            "            public int calculateFine(Book book) {\n",
            "                if (book.validateId() && book.getDueDate()!= null) {\n",
            "                    long diffInMillies = Math.abs(new Date().getTime() - book.getDueDate().getTime());\n",
            "                    long diffInDays = TimeUnit.DAYS.convert(diffInMillies, TimeUnit.MILLISECONDS);\n",
            "                    if (diffInDays > 0) {\n",
            "                        return (int) (diffInDays * 2); // Example fine calculation: $2 per day\n",
            "                    }\n",
            "                }\n",
            "                return 0;\n",
            "            }\n",
            "\n",
            "            public String calculateTotalFine() {\n",
            "                // Example method to calculate total fine across all books borrowed by a borrower\n",
            "                int totalFine = 0;\n",
            "                Book[] books = this.library.getBooks();\n",
            "                for (Book book : books) {\n",
            "                    if (book!= null && book.validateId() && book.getDueDate()!= null) {\n",
            "                        int fineForBook = this.calculateFine(book);\n",
            "                        totalFine += fineForBook;\n",
            "                    }\n",
            "                }\n",
            "                return \"$\" + totalFine;\n",
            "            }\n",
            "\n",
            "            public String getBorrowerDetails() {\n",
            "                // Example method to get borrower details (e.g., name, email, joined date)\n",
            "                return \"Borrower ID: \" + this.borrowerId + \", Name: \" + this.name + \", Email: \" + this.email + \", Joined Date: \" + this.joinedDate;\n",
            "            }\n",
            "        }\n",
            "\n",
            "        public class Main {\n",
            "            public static void main(String[] args) {\n",
            "                Library library = new Library(\"Example Library\");\n",
            "\n",
            "                Book book1 = library.new Book(\"Incredible Journey\", \"Mark Twain\", library);\n",
            "                Book book2 = library.new Book(\"Pride and Prejudice\", \"Jane Austen\", library);\n",
            "\n",
            "                library.addBook(book1);\n",
            "                library.addBook(book2);\n",
            "\n",
            "                Borrower borrower1 = library.new Borrower(\"Alice Smith\", \"alice@example.com\", library);\n",
            "                Borrower borrower2 = library.new Borrower(\"Bob Johnson\", \"bob@example.com\", library);\n",
            "\n",
            "                // Check out books\n",
            "                borrower1.checkOutBook(book1);\n",
            "                borrower2.checkOutBook(book2);\n",
            "\n",
            "                // Return books\n",
            "                borrower1.returnBook(book1);\n",
            "                borrower2.returnBook(book2);\n",
            "\n",
            "                // Calculate total fine for borrower1\n",
            "                int fine1 = borrower1.calculateFine(book1);\n",
            "                System.out.println(\"Fine for Book 1: $\" + fine1);\n",
            "\n",
            "                // Calculate total fine for borrower2\n",
            "                int fine2 = borrower2.calculateFine(book2);\n",
            "                System.out.println(\"Fine for Book 2: $\" + fine2);\n",
            "\n",
            "                // Calculate total fine for both books borrowed by borrower1\n",
            "                System.out.println(\"Total Fine for Borrower1: \" + borrower1.calculateTotalFine());\n",
            "\n",
            "                // Display borrower details\n",
            "                System.out.println(\"Borrower1 Details:\\n\" + borrower1.getBorrowerDetails());\n",
            "                System.out.println(\"Borrower2 Details:\\n\" + borrower2.getBorrowerDetails());\n",
            "            }\n",
            "        }\n",
            "    }\n",
            "}<|end_of_text|>\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "<a name=\"Save\"></a>\n",
        "### Saving, loading finetuned models\n",
        "To save the final model as LoRA adapters, either use Huggingface's `push_to_hub` for an online save or `save_pretrained` for a local save.\n",
        "\n",
        "**[NOTE]** This ONLY saves the LoRA adapters, and not the full model. To save to 16bit or GGUF, scroll down!"
      ],
      "metadata": {
        "id": "uMuVrWbjAzhc"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# model.save_pretrained(\"code_lora_model\") # Local saving\n",
        "# tokenizer.save_pretrained(\"code_lora_model\") # Local saving\n",
        "model.push_to_hub(\"somashekar2002/Java-code-Gen-Z\", token = \"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\") # Online saving\n",
        "tokenizer.push_to_hub(\"somashekar2002/Java-code-Gen-Z\", token = \"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\") # Online saving"
      ],
      "metadata": {
        "id": "upcOlWe7A1vc",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 98,
          "referenced_widgets": [
            "da4b7e048c224ef2be683182fd523621",
            "a80e036c08484161aa6358763f886dac",
            "743778b118e1466b9adb08d8cb5d73ee",
            "e4feced0b4174df782749d91f6aef9ef",
            "5aef584875774c6d9db4d4e6f6c7cfbb",
            "e15d2cb620034c43b72c9c1495b718c7",
            "6bdbaea234aa45a8af1379742f8d1740",
            "1a89395b021c4a27b5fd3c85f2e4381a",
            "8ac0660294f34e6eb0cc25b2bb7a7074",
            "3e423522c88c4dcf9766e26638b011e3",
            "55d360b3456d440a8f9785bc31f3317f",
            "c0255318730e43f7bc55d6deca36631f",
            "b70c6c3d30c842318d93c092360fbb0f",
            "20fa52d573ce4244aba6f6cdcdf82f13",
            "5a9ab0f7a1bc4b7f9cb6fc78f3cf1a25",
            "9371791ca9ea4c5fb5dff06075a829f3",
            "f49d9679d7204e6388b0e791e24fa782",
            "022094b250a84c1fbeeb563ec6a86df2",
            "5811614ebab440a5a161257b86d25a3f",
            "eb9d9a9c50ca4af48a692733698217cc",
            "2ca97a83670541b486aa49490facb17f",
            "2a7e154986864d7797ae55c4bba837c7"
          ]
        },
        "outputId": "914d02c3-d0f0-47f8-ae7f-5ef9febf30a6"
      },
      "execution_count": 16,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "adapter_model.safetensors:   0%|          | 0.00/168M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "da4b7e048c224ef2be683182fd523621"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Saved model to https://huggingface.co/somashekar2002/Java-code-Gen-Z\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "README.md:   0%|          | 0.00/5.18k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c0255318730e43f7bc55d6deca36631f"
            }
          },
          "metadata": {}
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Now if you want to load the LoRA adapters we just saved for inference, set `False` to `True`:"
      ],
      "metadata": {
        "id": "AEEcJ4qfC7Lp"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# if False:\n",
        "#     from unsloth import FastLanguageModel\n",
        "#     model, tokenizer = FastLanguageModel.from_pretrained(\n",
        "#         model_name = \"code_lora_model\", # YOUR MODEL YOU USED FOR TRAINING\n",
        "#         max_seq_length = max_seq_length,\n",
        "#         dtype = dtype,\n",
        "#         load_in_4bit = load_in_4bit,\n",
        "#     )\n",
        "#     FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
        "\n",
        "# # alpaca_prompt = You MUST copy from above!\n",
        "\n",
        "# inputs = tokenizer(\n",
        "# [\n",
        "#     alpaca_prompt.format(\n",
        "#         \"Develop a Java program for a library book lending system. Create classes for Library, Book, and Borrower, establishing relationships through aggregation and inheritance. Implement generateID() methods to generate unique IDs based on borrower attributes using static counters, and validateID() methods to verify IDs against specific instance criteria like borrower names or email addresses. Design the system to manage book lending, borrower registrations, add a method that calculates overdue fines for books that are returned late by borrowers and overdue tracking. Use wrapper classes for method return types and parameters to ensure type safety, and demonstrate system functionalities in a main class.\", # instruction\n",
        "#         \"\", # input\n",
        "#         \"\", # output - leave this blank for generation!\n",
        "#     )\n",
        "# ], return_tensors = \"pt\").to(\"cuda\")\n",
        "\n",
        "# outputs = model.generate(**inputs, max_new_tokens = 500, use_cache = True)\n",
        "# tokenizer.batch_decode(outputs)"
      ],
      "metadata": {
        "id": "MKX_XKs_BNZR",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "38ac5853-2a2d-4274-93fb-30b78a4859c5"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation.\n"
          ]
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['<|begin_of_text|>Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\\n\\n### Instruction:\\nWrite a Java class representing a SocialMediaPost that showcases encapsulation by encapsulating attributes like content and author, abstraction by providing methods for liking and commenting, and inheritance by having subclasses like TextPost and ImagePost.\\n\\n### Input:\\n\\n\\n### Response:\\npublic class SocialMediaPost {\\n    private String content;\\n    private User author;\\n    private Date createdDate;\\n    private static int postCounter = 1;\\n\\n    public SocialMediaPost(String content, User author) {\\n        this.content = content;\\n        this.author = author;\\n        this.createdDate = new Date();\\n    }\\n\\n    public String getContent() {\\n        return content;\\n    }\\n\\n    public User getAuthor() {\\n        return author;\\n    }\\n\\n    public Date getCreatedDate() {\\n        return createdDate;\\n    }\\n\\n    public void like(PostLike like) {\\n        // Logic for liking a post\\n    }\\n\\n    public void comment(String comment) {\\n        // Logic for adding a comment\\n    }\\n}\\n\\nclass User {\\n    private String username;\\n    private String name;\\n    private String profilePictureUrl;\\n    private static int userCounter = 1;\\n\\n    public User(String username, String name) {\\n        this.username = username;\\n        this.name = name;\\n        this.profilePictureUrl = \"\";\\n    }\\n\\n    public String getUsername() {\\n        return username;\\n    }\\n\\n    public String getName() {\\n        return name;\\n    }\\n\\n    public String getProfilePictureUrl() {\\n        return profilePictureUrl;\\n    }\\n}\\n\\nclass TextPost extends SocialMediaPost {\\n    private String text;\\n\\n    public TextPost(String text, User author) {\\n        super(text, author);\\n        this.text = text;\\n    }\\n\\n    public String getText() {\\n        return text;\\n    }\\n}\\n\\nclass ImagePost extends SocialMediaPost {\\n    private String imageUrl;\\n\\n    public ImagePost(String imageUrl, User author) {\\n        super(\"\", author);\\n        this.imageUrl = imageUrl;\\n    }\\n\\n    public String getImageUrl() {\\n        return imageUrl;\\n    }\\n}\\n\\nclass PostLike {\\n    private User liker;\\n    private Date createdDate;\\n    private static int likeCounter = 1;\\n\\n    public PostLike(User liker) {\\n        this.liker = liker;\\n        this.createdDate = new Date();\\n    }\\n\\n    public User getLiker() {\\n        return liker;\\n    }\\n\\n    public Date getCreatedDate() {\\n        return createdDate;\\n    }\\n}\\n\\npublic class SocialMediaPlatformMain {\\n    public static void main(String[] args) {\\n        User user1 = new User(\"Alice\", \"Alice Smith\");\\n        User user2 = new User(\"Bob\", \"Robert Johnson\");\\n\\n        TextPost post1 = new TextPost(\"Hello, this is a test post!\", user1);\\n       ']"
            ]
          },
          "metadata": {},
          "execution_count": 26
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "You can also use Hugging Face's `AutoModelForPeftCausalLM`. Only use this if you do not have `unsloth` installed. It can be hopelessly slow, since `4bit` model downloading is not supported, and Unsloth's **inference is 2x faster**."
      ],
      "metadata": {
        "id": "QQMjaNrjsU5_"
      }
    }
  ],
  "metadata": {
    "colab": {
      "provenance": [],
      "gpuType": "T4"
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "945d2116b7f7467caca24fc9d4bba1ac": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3b65e39a6e5a4191a99fac9d3f998af5",
              "IPY_MODEL_fdd9e126b68f4ba9b0a675a3a10fc59b",
              "IPY_MODEL_33db5d355038411cb454c36a96d3693d"
            ],
            "layout": "IPY_MODEL_09359f68fcbc4ee89ba3da3a2c54a6f4"
          }
        },
        "3b65e39a6e5a4191a99fac9d3f998af5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9cd6c556bc344909b0495e0a6e4f268a",
            "placeholder": "​",
            "style": "IPY_MODEL_f2ec5bac15e74210810ddd23d4f59c41",
            "value": "config.json: 100%"
          }
        },
        "fdd9e126b68f4ba9b0a675a3a10fc59b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e36eb5f575534f9196b06ee77f0f3f97",
            "max": 1200,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_710723326a414017bc4e73130ecfdbed",
            "value": 1200
          }
        },
        "33db5d355038411cb454c36a96d3693d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6f6bf98ab09e4629876a5dabef0edd63",
            "placeholder": "​",
            "style": "IPY_MODEL_fcf488d800634bcdaf225ef92284e5ed",
            "value": " 1.20k/1.20k [00:00&lt;00:00, 87.8kB/s]"
          }
        },
        "09359f68fcbc4ee89ba3da3a2c54a6f4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "9cd6c556bc344909b0495e0a6e4f268a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f2ec5bac15e74210810ddd23d4f59c41": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e36eb5f575534f9196b06ee77f0f3f97": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "710723326a414017bc4e73130ecfdbed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6f6bf98ab09e4629876a5dabef0edd63": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fcf488d800634bcdaf225ef92284e5ed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e7828728be144f9f99c5f3ebb7d56c27": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ddd9959c649a46108159d439d8d337bd",
              "IPY_MODEL_72ad1c5a1fbf48a68247d9fc94e36c12",
              "IPY_MODEL_6d5027b8c4b04da78e42c7f5a6f0b910"
            ],
            "layout": "IPY_MODEL_a020589ef22f48fbba6b77b1e2e581a9"
          }
        },
        "ddd9959c649a46108159d439d8d337bd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_239fd08523fa4a0abac87634416dbddc",
            "placeholder": "​",
            "style": "IPY_MODEL_8eaaa3991a694c249871ceaafb4afc30",
            "value": "model.safetensors: 100%"
          }
        },
        "72ad1c5a1fbf48a68247d9fc94e36c12": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_77cccfcf7ad64e9ab8d830657bb0c6bc",
            "max": 5702746405,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_9bb66977176e438d8f1a4e50d8cec764",
            "value": 5702746405
          }
        },
        "6d5027b8c4b04da78e42c7f5a6f0b910": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e0b1d894e98d49edaa6888fff6e4c5e3",
            "placeholder": "​",
            "style": "IPY_MODEL_6f4b4ed8441b4f2bb06a412767bf6ec6",
            "value": " 5.70G/5.70G [00:29&lt;00:00, 287MB/s]"
          }
        },
        "a020589ef22f48fbba6b77b1e2e581a9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "239fd08523fa4a0abac87634416dbddc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8eaaa3991a694c249871ceaafb4afc30": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "77cccfcf7ad64e9ab8d830657bb0c6bc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "9bb66977176e438d8f1a4e50d8cec764": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e0b1d894e98d49edaa6888fff6e4c5e3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6f4b4ed8441b4f2bb06a412767bf6ec6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d4cd5f906f204a63b8dc80a4eba9df10": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_043e234b17b44e8fa9222d3b70c6e7ef",
              "IPY_MODEL_56f145358fba4724af42150f6b07e0a2",
              "IPY_MODEL_ab878c85ccd2472da73b3c6f21e00597"
            ],
            "layout": "IPY_MODEL_345366e9a18840cf97f8f9a5b9d8e9c0"
          }
        },
        "043e234b17b44e8fa9222d3b70c6e7ef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_28e1c7038c7c49d2821296d800c70d16",
            "placeholder": "​",
            "style": "IPY_MODEL_7e18c25674d045439e48fa1639d25a0a",
            "value": "generation_config.json: 100%"
          }
        },
        "56f145358fba4724af42150f6b07e0a2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_44bf1bd23fa240bcb916fffbcbdc7783",
            "max": 172,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_186e74cbc0e1430a94ba81ae514822d2",
            "value": 172
          }
        },
        "ab878c85ccd2472da73b3c6f21e00597": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fe81793507e74ed7ba32b6abf44c7ec6",
            "placeholder": "​",
            "style": "IPY_MODEL_6f74bf7834374f8c9424601d3836a06f",
            "value": " 172/172 [00:00&lt;00:00, 10.7kB/s]"
          }
        },
        "345366e9a18840cf97f8f9a5b9d8e9c0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "28e1c7038c7c49d2821296d800c70d16": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7e18c25674d045439e48fa1639d25a0a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "44bf1bd23fa240bcb916fffbcbdc7783": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "186e74cbc0e1430a94ba81ae514822d2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "fe81793507e74ed7ba32b6abf44c7ec6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6f74bf7834374f8c9424601d3836a06f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d484dfa1e946400bbc3f5b432007c765": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_5289ff66075d481db4f4c3609f0d864e",
              "IPY_MODEL_2b4659d715664f28878ae0e3dfc52474",
              "IPY_MODEL_4dbf4ab944e049f0a3fa90b9a06b0840"
            ],
            "layout": "IPY_MODEL_44756048150b444494bc640012b6216b"
          }
        },
        "5289ff66075d481db4f4c3609f0d864e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dd20760707d44d638becdf50f7f80b82",
            "placeholder": "​",
            "style": "IPY_MODEL_c7179c658d0e47f7a8ebcd6f87a5211b",
            "value": "tokenizer_config.json: 100%"
          }
        },
        "2b4659d715664f28878ae0e3dfc52474": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_37b7ec2b88c2451087d3a964d85f28d8",
            "max": 50641,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_3f5624b3549146149d87dc7c447ac892",
            "value": 50641
          }
        },
        "4dbf4ab944e049f0a3fa90b9a06b0840": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a367c55f415645c08aa7e174f54d0ed9",
            "placeholder": "​",
            "style": "IPY_MODEL_dac7184509bc45868c6794a5439aaec9",
            "value": " 50.6k/50.6k [00:00&lt;00:00, 3.41MB/s]"
          }
        },
        "44756048150b444494bc640012b6216b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dd20760707d44d638becdf50f7f80b82": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c7179c658d0e47f7a8ebcd6f87a5211b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "37b7ec2b88c2451087d3a964d85f28d8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3f5624b3549146149d87dc7c447ac892": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a367c55f415645c08aa7e174f54d0ed9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dac7184509bc45868c6794a5439aaec9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "1fde5a4dc0ed4218a01fa2fdb30535fb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ee7bf5ad00594a448e832ae9ad4916b1",
              "IPY_MODEL_c12c5a1692164ae88c309348cb59a52f",
              "IPY_MODEL_cf1b25511a5f4867b16288d9fe0eb3a7"
            ],
            "layout": "IPY_MODEL_8a41600c8a38468ab61a8d84f08c1d9e"
          }
        },
        "ee7bf5ad00594a448e832ae9ad4916b1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ea7709623a494b8cb142f6892884feb0",
            "placeholder": "​",
            "style": "IPY_MODEL_8ab6fdd4b492499eb2371e09f73797c4",
            "value": "tokenizer.json: 100%"
          }
        },
        "c12c5a1692164ae88c309348cb59a52f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_77c88da58aa741c8a3aca32157926222",
            "max": 9085698,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_7a15b226349e4bb5892f46d6d9d791d7",
            "value": 9085698
          }
        },
        "cf1b25511a5f4867b16288d9fe0eb3a7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_549d71a0df3b4f9198f2541e921acbd4",
            "placeholder": "​",
            "style": "IPY_MODEL_58a5d398858f40249f628d338c748637",
            "value": " 9.09M/9.09M [00:00&lt;00:00, 13.8MB/s]"
          }
        },
        "8a41600c8a38468ab61a8d84f08c1d9e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ea7709623a494b8cb142f6892884feb0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8ab6fdd4b492499eb2371e09f73797c4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "77c88da58aa741c8a3aca32157926222": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7a15b226349e4bb5892f46d6d9d791d7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "549d71a0df3b4f9198f2541e921acbd4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "58a5d398858f40249f628d338c748637": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2ec2114496854e5ab440c95b18beabe2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_fd35d73034164274bc6e18ca827b5d5a",
              "IPY_MODEL_eb26cf6694144ebfb01e2e83d141b9ce",
              "IPY_MODEL_977b688d76e54d2fb067a5e8c8efae01"
            ],
            "layout": "IPY_MODEL_f8296c1a098a4bbb9d8ee9565822426c"
          }
        },
        "fd35d73034164274bc6e18ca827b5d5a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d8fd97272ee946c48abcfa570e96fe3e",
            "placeholder": "​",
            "style": "IPY_MODEL_4131dbb0aa1d40c8bbb4c1908f26ba2c",
            "value": "special_tokens_map.json: 100%"
          }
        },
        "eb26cf6694144ebfb01e2e83d141b9ce": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b5e3458e5f894c92b11d18d6e78fe868",
            "max": 464,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8be1032ddac7434aaf798109f48d7bd1",
            "value": 464
          }
        },
        "977b688d76e54d2fb067a5e8c8efae01": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b159c66c3bcb4c189e5802904807c59d",
            "placeholder": "​",
            "style": "IPY_MODEL_3fbd89229de54c7a9bc2d6074b13af1c",
            "value": " 464/464 [00:00&lt;00:00, 16.4kB/s]"
          }
        },
        "f8296c1a098a4bbb9d8ee9565822426c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d8fd97272ee946c48abcfa570e96fe3e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4131dbb0aa1d40c8bbb4c1908f26ba2c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b5e3458e5f894c92b11d18d6e78fe868": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8be1032ddac7434aaf798109f48d7bd1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "b159c66c3bcb4c189e5802904807c59d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3fbd89229de54c7a9bc2d6074b13af1c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7a71d2cac0c04987acfc113f5f597eeb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ba6fb526acd743ae9f5309e5730bc59b",
              "IPY_MODEL_f39a76b92b124c6da8e6fc7956f9a263",
              "IPY_MODEL_278c1bb958d94444a2b8f7443c3745a8"
            ],
            "layout": "IPY_MODEL_768a07270ed84ef4ab757f3a24eb42d4"
          }
        },
        "ba6fb526acd743ae9f5309e5730bc59b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5758399a22e840a3afdc993a714040e2",
            "placeholder": "​",
            "style": "IPY_MODEL_d7bbdeeff7d24bcb99ace85d050d4731",
            "value": "Map (num_proc=2): 100%"
          }
        },
        "f39a76b92b124c6da8e6fc7956f9a263": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d1d8bccdfce24a94aeb3398cda09dd9b",
            "max": 24,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_80b26d70f8ed4df08fef40fedd1b7b98",
            "value": 24
          }
        },
        "278c1bb958d94444a2b8f7443c3745a8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e742cc815b2a403cae45eec4059c9905",
            "placeholder": "​",
            "style": "IPY_MODEL_25c3c916840945039450257b775ce81f",
            "value": " 24/24 [00:02&lt;00:00, 13.72 examples/s]"
          }
        },
        "768a07270ed84ef4ab757f3a24eb42d4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5758399a22e840a3afdc993a714040e2": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d7bbdeeff7d24bcb99ace85d050d4731": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d1d8bccdfce24a94aeb3398cda09dd9b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "80b26d70f8ed4df08fef40fedd1b7b98": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e742cc815b2a403cae45eec4059c9905": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "25c3c916840945039450257b775ce81f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "da4b7e048c224ef2be683182fd523621": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_a80e036c08484161aa6358763f886dac",
              "IPY_MODEL_743778b118e1466b9adb08d8cb5d73ee",
              "IPY_MODEL_e4feced0b4174df782749d91f6aef9ef"
            ],
            "layout": "IPY_MODEL_5aef584875774c6d9db4d4e6f6c7cfbb"
          }
        },
        "a80e036c08484161aa6358763f886dac": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e15d2cb620034c43b72c9c1495b718c7",
            "placeholder": "​",
            "style": "IPY_MODEL_6bdbaea234aa45a8af1379742f8d1740",
            "value": "adapter_model.safetensors: 100%"
          }
        },
        "743778b118e1466b9adb08d8cb5d73ee": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1a89395b021c4a27b5fd3c85f2e4381a",
            "max": 167832240,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8ac0660294f34e6eb0cc25b2bb7a7074",
            "value": 167832240
          }
        },
        "e4feced0b4174df782749d91f6aef9ef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3e423522c88c4dcf9766e26638b011e3",
            "placeholder": "​",
            "style": "IPY_MODEL_55d360b3456d440a8f9785bc31f3317f",
            "value": " 168M/168M [00:12&lt;00:00, 20.6MB/s]"
          }
        },
        "5aef584875774c6d9db4d4e6f6c7cfbb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e15d2cb620034c43b72c9c1495b718c7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6bdbaea234aa45a8af1379742f8d1740": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "1a89395b021c4a27b5fd3c85f2e4381a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8ac0660294f34e6eb0cc25b2bb7a7074": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "3e423522c88c4dcf9766e26638b011e3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "55d360b3456d440a8f9785bc31f3317f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c0255318730e43f7bc55d6deca36631f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_b70c6c3d30c842318d93c092360fbb0f",
              "IPY_MODEL_20fa52d573ce4244aba6f6cdcdf82f13",
              "IPY_MODEL_5a9ab0f7a1bc4b7f9cb6fc78f3cf1a25"
            ],
            "layout": "IPY_MODEL_9371791ca9ea4c5fb5dff06075a829f3"
          }
        },
        "b70c6c3d30c842318d93c092360fbb0f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f49d9679d7204e6388b0e791e24fa782",
            "placeholder": "​",
            "style": "IPY_MODEL_022094b250a84c1fbeeb563ec6a86df2",
            "value": "README.md: 100%"
          }
        },
        "20fa52d573ce4244aba6f6cdcdf82f13": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5811614ebab440a5a161257b86d25a3f",
            "max": 5181,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_eb9d9a9c50ca4af48a692733698217cc",
            "value": 5181
          }
        },
        "5a9ab0f7a1bc4b7f9cb6fc78f3cf1a25": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2ca97a83670541b486aa49490facb17f",
            "placeholder": "​",
            "style": "IPY_MODEL_2a7e154986864d7797ae55c4bba837c7",
            "value": " 5.18k/5.18k [00:00&lt;00:00, 343kB/s]"
          }
        },
        "9371791ca9ea4c5fb5dff06075a829f3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f49d9679d7204e6388b0e791e24fa782": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "022094b250a84c1fbeeb563ec6a86df2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5811614ebab440a5a161257b86d25a3f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "eb9d9a9c50ca4af48a692733698217cc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "2ca97a83670541b486aa49490facb17f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2a7e154986864d7797ae55c4bba837c7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        }
      }
    },
    "accelerator": "GPU"
  },
  "nbformat": 4,
  "nbformat_minor": 0
}