Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[P1] If yaml has no model specified, metadata is not dumped and will error out #99

Open
frankaging opened this issue Jan 20, 2025 · 1 comment

Comments

@frankaging
Copy link
Collaborator

No description provided.

@yuqinan
Copy link
Collaborator

yuqinan commented Jan 20, 2025

yaml:

generate:
  lm_model: "gpt-4o-mini"
  input_length: 32
  output_length: 32
  num_of_examples: 0 #no need for for training 
  # concept_path: "<your local csv file path>"
  concept_path: "axbench/data/output/output_gemma_2b_layer_0_data.json" #change to Mor Geva's concepts (but only 40)
  max_concepts: 10
  master_data_dir: "axbench/data"
  seed: 42
  #metadata.jsonl

train:
  model_name: "google/gemma-2-2b"
  layer: 0
  component: "res"
  seed: 42
  use_bf16: true

cmd:
`#!/bin/bash

#Check if nvidia-smi command exists
if ! command -v nvidia-smi &> /dev/null; then
echo "nvidia-smi could not be found. Please ensure NVIDIA drivers are installed."
exit 1
fi

#Get the number of GPUs
gpu_count=$(nvidia-smi --query-gpu=name --format=csv,noheader | wc -l)

python axbench/scripts/generate.py --config axbench/demo/sweep/simple.yaml --dump_dir axbench/demo

torchrun --master_port=12345 --nproc_per_node=$gpu_count axbench/scripts/train.py
--config axbench/demo/sweep/simple.yaml --dump_dir axbench/demo`

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants