Commit graph

2 commits

Author SHA1 Message Date
Fish
5fc89c39cf
Multiple fixes for corpus tests. (#5052)
* create snapshot files at a different base dir.

* Fix branch name in "Push snapshots to snapshot repo".

* sanitize snapshot index file path

* snapshot_diff.sh expects GITHUB_TOKEN instead of GH_TOKEN.

* snapsnot_diff.sh needs repo specified.

* Fix PR number in snapshot_diff summary.

* Use ANGR_PR_PAT instead when updating angr PRs.
2024-11-29 21:53:44 -07:00
Eric Lee
ba561956b5
Add Decompiler Corpus Test Framework (#5028)
* Add workflows for testing angr decompiler against a corpus of binaries.
Use external github repo for binaries to test.
Use external github repo for decompiler output snapshots for comparisons.

* Remove corpus_tests test scripts and test code; update readme.

* Fix duplicate quote.

* Dump head and tail of pytest-insta log.

* Add more debug info.

* fix: make corpus_test.yml callable rather than dispatchable

* fix: move last few vars out of vars and into env for GitHub Actions and fix last few actionlint warnings

* fix: workflow had invalid yaml-reserved syntax for conditionals

* fix: create and cache venv outside of analyze job matrix; sync snapshot pr branch name and add comment linking original pr to snapshot pr

* fix: allow intermediate errors in Maybe Create Snapshot Pull Request step

* feat: setup scripts to run snapshot diffing out of pipeline

* feat: break out scripts for corpus_test.yml

* fix: add snapshot_diff.sh comment to PR

* fix: update corpus_tests documentation and remove hard-coded ref names

* doc: add syntax highlighting to README.md

* fix: run ruff and black against corpus_tests

* feat: add in precondition step for corpus_test.yml for transition to angr-owned repos and automatically merge snapshot PR

* fix: remove ghapi.py in favor of scripting with gh; fix linter errors

* fix: black linter pass on test_corpus.py

* switch repo setups

* adjust corpus test trigger condition

---------

Co-authored-by: Yakobh <122582481+Yakobh@users.noreply.github.com>
Co-authored-by: Doug Rogers <doug@karambit.ai>
Co-authored-by: Fish <fishw@asu.edu>
2024-11-25 15:11:15 -07:00