Dataset for "Pop Quiz! Can a Large Language Model Help WIth Reverse Engineering?"

Hammond Pearce, Benjamin Tan, P. Krishnamurthy, Farshad Khorrami, Ramesh Karri, Brendan Dolan-GavittZenodo 2022 · DOI · OpenAlex

Abstract

Source files and scripts for the test framework used in evaluating OpenAI's code-davinci-001 (also known as davinci-codex) model for reverse engineering tasks. All results presented in the associated manuscript are preserved in this dataset, or you can use it to perform additional experiments or re-generate the results.
BibTeX
@inproceedings{pearce2022dataset,
  author = {Hammond Pearce and Benjamin Tan and P. Krishnamurthy and Farshad Khorrami and Ramesh Karri and Brendan Dolan-Gavitt and Prashanth Krishnamurthy},
  title = {{Dataset for "Pop Quiz! Can a Large Language Model Help WIth Reverse Engineering?"}},
  booktitle = {Zenodo},
  year = {2022},
  doi = {10.5281/zenodo.5949075},
}

Loading related content...

Figure