This repository contains code to fine tune a classifier using the imdb dataset. The resulting model can then be converted to ONNX (and used by Apache OpenNLP).
For a trained model, see https://huggingface.co/jzonthemtn/distilbert-imdb.
python3 -m pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu116
python3 -m pip install transformers onnxruntime torch sklearn
python3 -m transformers.onnx --model=local-pt-checkpoint/ --feature sequence-classification exported-to-onnx
| Version | Evaluation |
|---|---|
| 1 | {'eval_loss': 0.21822933852672577, 'eval_accuracy': 0.93224, 'eval_f1': 0.9321042084168337, 'eval_runtime': 225.0407, 'eval_samples_per_second': 111.091, 'eval_steps_per_second': 13.886} |