Commit graph

1 commit

Author SHA1 Message Date
Eric Lee
ba561956b5
Add Decompiler Corpus Test Framework (#5028)
* Add workflows for testing angr decompiler against a corpus of binaries.
Use external github repo for binaries to test.
Use external github repo for decompiler output snapshots for comparisons.

* Remove corpus_tests test scripts and test code; update readme.

* Fix duplicate quote.

* Dump head and tail of pytest-insta log.

* Add more debug info.

* fix: make corpus_test.yml callable rather than dispatchable

* fix: move last few vars out of vars and into env for GitHub Actions and fix last few actionlint warnings

* fix: workflow had invalid yaml-reserved syntax for conditionals

* fix: create and cache venv outside of analyze job matrix; sync snapshot pr branch name and add comment linking original pr to snapshot pr

* fix: allow intermediate errors in Maybe Create Snapshot Pull Request step

* feat: setup scripts to run snapshot diffing out of pipeline

* feat: break out scripts for corpus_test.yml

* fix: add snapshot_diff.sh comment to PR

* fix: update corpus_tests documentation and remove hard-coded ref names

* doc: add syntax highlighting to README.md

* fix: run ruff and black against corpus_tests

* feat: add in precondition step for corpus_test.yml for transition to angr-owned repos and automatically merge snapshot PR

* fix: remove ghapi.py in favor of scripting with gh; fix linter errors

* fix: black linter pass on test_corpus.py

* switch repo setups

* adjust corpus test trigger condition

---------

Co-authored-by: Yakobh <122582481+Yakobh@users.noreply.github.com>
Co-authored-by: Doug Rogers <doug@karambit.ai>
Co-authored-by: Fish <fishw@asu.edu>
2024-11-25 15:11:15 -07:00