Skip to content

Commit

Permalink
add readme info
Browse files Browse the repository at this point in the history
  • Loading branch information
husseinmozannar committed Nov 3, 2024
1 parent 3b1d5d7 commit 12f7b9c
Showing 1 changed file with 14 additions and 1 deletion.
15 changes: 14 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,16 @@

Associated code, data and interface for the paper "The Real HumanEval: Evaluating Large Language Models’ Abilities to Support Programmers”.


The interface in [interface](interface) also includes code from our follow-up work "Need Help? Designing Proactive AI Assistants for Programming" by
Valerie Chen, Alan Zhu, Sebastian Zhao, Hussein Mozannar, David Sontag, Ameet Talwalkar.

Quick Links:


- **Data**: [HF Datasets link](https://huggingface.co/datasets/hsseinmz/realhumaneval) and local link [data](data/README.md). All dataset documentation, Croissant metadata record, hosting, licensing, and maintenance plan are provided in the HF link.

- **Interface Code**[interface](interface/README.md) (under development)
- **Interface Code**[interface](interface/README.md) - local version

- **Analysis Code**[analysis](analysis/README.md)

Expand Down Expand Up @@ -81,6 +85,15 @@ To reproduce figures and results from the paper, you can run the following noteb
      archivePrefix={arXiv},
      primaryClass={cs.SE}
}
@misc{chen2024needhelpdesigningproactive,
title={Need Help? Designing Proactive AI Assistants for Programming},
author={Valerie Chen and Alan Zhu and Sebastian Zhao and Hussein Mozannar and David Sontag and Ameet Talwalkar},
year={2024},
eprint={2410.04596},
archivePrefix={arXiv},
primaryClass={cs.HC},
url={https://arxiv.org/abs/2410.04596},
}
```

License information is available [here](LICENSE)
Expand Down

0 comments on commit 12f7b9c

Please sign in to comment.