Skip to content

Some online tools that helps you prepare data for OpenAI batch processing

Notifications You must be signed in to change notification settings

zheqiaochen/openaibatch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OpenAI Batch Tools

Some simple tools to convert a CSV file to JSONL, split a JSONL file into multiple parts, and extract responses from JSONL files. These tools are designed to help you prepare data for OpenAI batch processing. You can see full details on my blog post here.

Screenshot

screenshot

Features

  1. CSV to JSONL Converter

    • Convert CSV files to JSONL format for OpenAI batch processing
    • Customize system prompts and model parameters
  2. JSONL File Splitter

    • Split large JSONL files into smaller parts
    • Specify the number of splits needed
  3. JSONL Response Extractor

    • Convert JSONL files to CSV format

Installation

  1. Clone the repository:
git clone https://github.com/yourusername/openai-batch-tools.git
  1. Install dependencies:
cd openai-batch-tools
pip install -r requirements.txt
  1. Run the application:
python app.py

About

Some online tools that helps you prepare data for OpenAI batch processing

Topics

Resources

Stars

Watchers

Forks