domains / families / research / vldb-reproducibility

vldb-reproducibility

separate

Use when engineering reproducibility into a VLDB paper before submission, covering hardware and configuration disclosure, dataset and workload provenance, run-to-run variance in systems measurements, competitor-version pinning, figure-to-raw-data traceability, and the disclosure floor PVLDB reviewers apply to performance claims.

When to use

• engineering reproducibility into a VLDB paper
• hardware and configuration disclosure
• dataset and workload provenance
• run-to-run variance in systems measurements
• competitor-version pinning
• figure-to-raw-data traceability
• disclosure floor for performance claims

When not to use

• packaging step after experiments
• ML papers randomizing over seeds

Skill page

Source