domains / families / research / issta-artifact-evaluation

issta-artifact-evaluation

separate

Use when packaging an ISSTA tool, benchmark, and results for the artifact-evaluation track, covering the ACM badges (Artifacts Available via Zenodo, Evaluated Functional and Reusable, Results Reproduced), the anonymous review-time copy, containerization, a runnable entry point, and what ISSTA artifact evaluators actually try first.

When to use

• packaging ISSTA tool, benchmark, and results
• targeting ACM badges (Artifacts Available, Evaluated Functional and Reusable, Results Reproduced)
• preparing anonymous review-time copy
• containerization and runnable entry point
• pinning subjects and benchmark versions
• providing results-regeneration path
• handling long-running and non-deterministic tools

When not to use

• tasks not related to ISSTA artifact-evaluation track

Skill page

Source