domains / families / research / sigir-reproducibility

sigir-reproducibility

separate

Use when strengthening the reproducibility of a SIGIR paper or preparing a SIGIR Reproducibility track submission — pinning the retrieval pipeline, seeds and variance for neural rankers, documenting collection versions and index settings, and structuring a reproduction study of published IR results with honest divergence analysis.

When to use

• strengthening reproducibility of a SIGIR paper
• preparing a SIGIR Reproducibility track submission
• pinning the retrieval pipeline
• documenting collection versions and index settings
• structuring a reproduction study of published IR results
• divergence analysis
• decay planning for long-term reproducibility
• reproducibility as review defense

When not to use

• reproducing only the headline number while skipping ablations
• declaring failure to reproduce without exhausting configuration space
• shipping a reproduction whose own pipeline is unpinned

Skill page

Source